Yes, you can get a refund of the Georgia tax withheld.  In order to do so, you will need to file a Georgia non-resident tax return.  Just be sure to indicate in the state tax section that none of your income was earned in Georgia.