Right, it's difficult to imagine external GPUs becoming obsolete without a radical new computing technology to take their place.

For games it's easy to find useful ways to use 10x the existing GPU power, not even counting an increase in display resolution.

For massively parallel computing, the sky is the limit.