Quebec City has no real CBD, so even though one can find shacks even near the heart of the city, it's not really possible to find this "shack in the shadow of great skyscrapers" effect there.
It's possible to find single-family residential very close to the center of the city, like that pink one there:
https://www.google.ca/maps/@46.80973...7i13312!8i6656
But you have to go further away to find classic detached SFHs.
Closest shacks to the city's core would likely be on the Lévis side.