Violence is a key word in that definition.
Violence: Behavior or treatment in which physical force is exerted for the purpose of causing damage or injury.
So, starving a group of people isn't terrorism because you're not exerting physical force.
Not easily stopping a fire when you know it's going to spread towards an occupied house isn't violence because you're not exerting physical force.
Poisoning drinking water isn't violence because you're not exerting physical force.
Real question: what do you call those things? It can't be defined as terrorism. What is it?