But then you could miss out on more qualified people who are not in your immediate social network. It seems wrong for example that most VCs will only take you seriously if you are introduced to them via someone they know.
You don't miss out, because introductions flow so freely. It's not hard to find someone two hops from anyone you want to meet, and once you've done that (if you seem worth introducing), the two hops happen fast.
Wrong, perhaps, but a necessary wrong. Smart people that you know are perhaps the most effective filter to gauge purportedly smart people you don't know. While it would be nice if connections didn't matter, such a world would be infeasible. Thus, you enter the social network on merit: impress someone who is known to be smart, and that's your in. Eventually the line of contact reaches the VC you need to take you seriously.