Are installment payments for past taxes, tax deductible

For a federal tax payment plan, no, that is not deductible at all.

For a state tax payment plan, you can deduct the amount for taxes in the year that you pay it, but not any penalties or interest, only the tax.