That depends on the fact that rich countries are accepting of migrants, which looks like is reversing in last couple of years in US (which other countries may follow)
Me worry about it? No, I live in a highly educated part of America.
My uncle who lives in Omak, Washington has to worry about it. The brain-drain from rural America into urban America is pretty serious. (And indeed, it was visiting my uncle there which made the situation obvious to me)
Especially as local plants close down and local economies suffer. Young Americans will leave rural areas and go towards more prosperous ones.
-------------
This fundamental mechanic is why poor urban areas (or poor rural areas) get less and less educated. Education only serves to send kids away to richer areas. It doesn't benefit the area where the education takes place.
Urbanization can result workforce exploitation, and in large parts of land being drained of it's work-force, driving up the cost of living as more food needs to be imported and as it will be more expensive to get a roof over your head.
It's all a worst-case scenario, of course, but the risk is still there.