There are plenty of state parks in the Rabun County area, along with some good home-cookin' eateries nearby.
You could start with this one: http://gastateparks.org/info/blackrock/
I've a cabin about 1.5 hours east of Rabun Gap, but will probably just make the 2-hour trek from Atlanta.
Lemme know if there's a caravan heading up from the city.