When you enter the 1099G under unemployment, does the withholding show up on 1040 line 25b? Maybe when you tried entering it as wages it wasn't fully deleted from unemployment. Or it sounds like you just aren't understanding how it works. When you entered the 1099G your income increased and the withholding wasn't enough to cover the increase in tax on all your income.
