No, you do not pay taxes on the early withdrawal penalty as you can deduct it for a taxable CD.
When you enter the interest income on Form 1099-INT, check the box next to 'My form has info in more than one box 1'. Then enter the penalty amount in box 2. This will reduce your interest income by the penalty amount.
@phildiane80