You cannot deduct past federal taxes paid. Nor can you deduct any federal interest or penalty payments paid.
If you had to pay past state taxes, those would be deductible on your federal return - but not any interest or penalties.
**Answers are correct to the best of my ability but do not constitute tax or legal advice.