Your response is a tautology! ""right" temperature for the planet" and "optimal temperature for human civilization" is the same thing.
Worse than your food concern is without enough CO2 we don't breathe!
Being the slightest bit off can push the planet into an ice age. Just which do you think would be worse?