You do not pay the 50% penalty with the filing of Form 5329 requesting a waiver of this penalty. The IRS is no history of denying the waiver under these circumstances.
