Of course there is Point Roberts (Washington), a peninsula only accessible by land through British Columbia (due south of Tsawwassen in Delta/suburban Vancouver).
And the Northwest Angle, an enclave of Minnesota in Lake of the Woods, but only accessible by land through Manitoba.
all photos from Wikipedia