There is one skyscraper I know that did sway badly in the wind at one point, and caused glass to come off the building. That would be the John Hancock Tower in Boston, MA. It left I.M. Pei with a bad reputation for a while.
http://en.wikipedia.org/wiki/John_Hancock_Tower