Here's the same view as above now, though the wide-angle streetview cameras don't do it justice. Looking west where Queen and King meet - a number of the buildings are still visible but there's obviously a lot more now. Would have been a bit of an industrial wasteland at the time:
https://goo.gl/maps/zf8DWgJ1kA3GxPpx8
Also glad to hear that my memories of paddle boats at the CN tower weren't made up!