In my experience, many people confuse being cowardly with being nice.
People confuse goodness with weakness. It is weak people, not good people (goodness demands strength), who are taken advantage of.
Have a think about this as you go about your daily business.