When you put $4000 in box 3 at the 1099-Q screen, you must also put $3800 (7800 minus 4000) in box 2.
$3800 will get taxed (plus $380 for the 10% penalty).
