everywhere else in the world seems to be fine with pavers.. not sure why that's an issue. Hell you don't even have to go far, just 45 mins down the highway to Toronto to see excellent parks with pavers.
If you are really concerned about it get a paver type that's smoother and give it a good sub-base to keep it flat over the long term. Given Hamilton's maintenance practices that would be doubtful though.. but even the asphalt will probably end up being a heaving, cracked mess in a few years.
Berczy Park has very flat, smooth pavers that give off a very premium feel which are still very easily accessible:
https://www.google.ca/maps/@43.64779...7i16384!8i8192
Queens Quay has an entire street of not-so-smooth pavers that seem to be no issue for those in wheelchairs:
https://www.google.ca/maps/@43.63959...7i16384!8i8192
Honestly you can see from Berczy Park what mature trees do to parks as well. Give it another 10 years for the trees in the park to be looking more substantial and it'll be fine.