Yes this is true.

I was also thinking it will take time to build facilities.

He's talking about millions of people, even if they just get thousands to begin with, that is a lot of people house unless you just plan to have electrified barbed wire and armed guards.