I have a shot of the same block in my horde, although it's a few years earlier since what is CIBC in your shot is still the Imperial Bank in mine (the Canadian Bank of Commerce and the Imperial Bank of Canada merged in 1955).
According to
Going Downtown, the upper storeys of the Affleck Building burned in 1973. The two buildings together were originally called the Kennedy Block.