Well, you can to some extent as every increase in population requires more land for housing, food, commerce; more energy to feed the extra demand created; more resources used up. Then that population creates waste that needs to be dealt with.
But certainly in many aspects a select few are...