A further look into the atlas from 1878, tracing the existing routes of the Intercolonial Railway reveals the location of the roundhouse and shops at that time, along the harbourfront, right at the Narrows:
https://novascotia.ca/archives/maps/plate.asp?ID=23