I agree that there are some assholes that take advantage and/or don't give a fuck. They are mostly thieves criminals, some are meth addicted macho bros gone full retard.
But the majority have severe mental issues, are seniors, or are just down out on their luck. They need help, and until they do get it, there won't be any resolution and the DTES will only get worse.
Blanket statements don't work, they just compound the issue. Constructive conversation and solid ideas go a lot further to engage all and everyone at stake.