Most cities who host Olympics don't necessarily benefit and it either becomes a wash or a great loss. I think Atlanta, despite the many mishaps and odd caricatures, profited greatly as a region and as a city from the Olympics.
What helped in Atlanta's case was its small size at the time...3.5-3.6 million people, which in Sunbelt America terms is very small compared to most world cities who win the Olympic bids.
I think the city overall has always been a big picture city filled with eccentric people who have big picture ideas. It's always about economic growth with Atlanta. The railroads (Atl took them in the 1800s when Decatur turned them down). The Civil Rights Movement (was always about economic growth rather than pure "love" of the opposite skin color). The Federal Air Mail Route (Atl happily took it when Birmingham turned it down). MARTA (we happily did what we could to beat out Seattle in federal funding to build mass transit). The Olympics (a small idea then accepted by everyone in Atlanta...for economic gain rather than glory). Finally, and hopefully the Beltline/Transportation Investment Act will be the next in a series of big picture ideas to come to fruition in Atlanta. It could do for the whole city what the High Line has done for Chelsea/Meatpacking District in Manhattan.
Other Sunbelt cities have a history of anti-growth policy. Louisville, Birmingham, New Orleans, and Richmond were all much larger than Atlanta from the 1800s to even as far in as 1960. They all had so many things going for those cities, but some let corruption and all let anti-growth policies get in the way. Atlanta then took literally all the growth in the south, and with warm and open arms. Now Charlotte and Nashville are back on track to being growth cities, so there is some competition for the first time in decades.