A payment plan, known as an Installment Agreement, (Form 9465) does charge interest. You would pay it monthly and ideally not miss any payment. You choose the number of months you wish to pay the balance due. The faster, the better.
Please see this LINK for more information.