New villages made by kingdoms stop building mines and stuff

I've played the game and I noticed that the newly created settlements stop expanding after building 5/6 houses and is needed to drop a stone,gold and ore deposit for them to expand which can get annoying