Going from Hunter Gathers to farmers may have been humanities worst mistake, but we are so far past the carrying capacity of earth as human-gathers that we would have to kill 99.999% of the population to be able to feed the rest without agriculture and even the survivors would have to forgo things like antibiotics.