Right, the veil of ignorance AFAICT (Rawls may have addressed this somewhere) sidesteps the question of probability. Shouldn't you weight the interests of a group proportionally to the likelihood that you would have been born into such a group, i.e. by their relative population?
That kinda depends on your subjective risk aversion/tolerance.
I think the veil of ignorance is a great thought experiment everyone should think about, but there shouldn't be any prescribed way how to think about it.