But keep in mind that West Street has been moved in the past. Here I'll show you where it was during the times of the old WTC and where it is now:
Old West Street:
Pic taken from Wikipedia
New West Street:
Pic taken from panynj.gov
Also, I regularily see buildings being close to streets. Why should the WFC be an exception?