An example for ya...
This is what you see (more or less) when facing the city:
So the above is taken about half-way between Water and Duckworth Street, right where the Water Street buildings end and the Duckworth ones begin. Below is taken from the far side of Duckworth, looking at the Duckworth-facing side of the same buildings above:
We should count the backside of our buildings for height.

Half the downtown would be 7-10 floors.