They need to work on the late game, and the living stiuation of your peasants. Even if you build new houses next to your pruduction sites your peasants will find a way to cross half the city work for a bit and go back home. This kills your economy. Maybe there is a trick I haven't figuered out yet, but if your City becomes too big it'll die.