As a non-resident of GA with GA source income, you have to file a GA tax return.
An LLC can provide some liability shield relating to the operation of the rental; yet, there is paperwork and expense associated with forming and maintaining an LLC.
Assuming you are the sole member of the LLC, there are no tax benefits of forming an LLC since the IRS considers a single member LLC as a "disregarded entity."