The problem, as I see it, with gold and silver as an investment is its volatile nature. It's a market that is very highly manipulated, with massive reserves that could be dumped at any time to destroy the value (diamonds are even worse in this regard).
I really don't know anything about your situation, but, generally, I encourage people to invest in their own well-being and self-sufficiency before investing in things that only have monetary or trade value. For instance, owning land, tools, reliable vehicle(s), guns, ammo, efficient appliances, and similar items seems much more pragmatic than metal that you can't really do much of anything with directly. If you feel that you have that stuff taken care of and you want to do some small-scale investing, you might want to consider setting up a small solar farm. If you're on the power grid and hook up your collectors, you can eliminate your electric bill and, possibly, start receiving a small check every month instead, depending on what state you live in and who your provider is.
Another thing to consider is an investment in self-improvement. Martial arts, blacksmithing, first aid/CPR, wilderness training, and tactical firearms training courses are a few that interest me. These pursuits are somewhat practical (potentially), they let you meet people, and they're fun.
If you have money to throw around, you could also invest in some sort of business. Your own, perhaps, or someone else's. I'm not really telling you to go play the ponies on Wall Street, but there are plenty of good, smart startups that you could support and also see a return on investment from. Crowd-funding is a very awesome form of investment, for instance. It's definitely more of a gamble, but there are opportunities for shrewd people with some extra money.
That's my two cents, anyway. I don't think it hurts to have some gold and silver laying around, but, again, I'd only be interested in that if all of my other needs and desires were squared away first.