This is not entirely true. Late fees and penalties can be deductible for a credit card. However , late fees and penalties on federal or state tax due are never deductible.
