For a city with a metro population of only ~400,000 people Victoria has a nice selection of fine hotels starting with yet another classic Fairmont Hotel, the Empress:
If you prefer something a little newer there's always the Grand Pacific Hotel:
There's also the Ocean Pointe Resort:
