No, the IRS does not pay interest on estimated taxes you paid, even if these payments exceed your tax liability and result in a refund to you. It is your responsibility to estimate these amounts and pay them at the due dates.
However, you may incur a penalty for underpayment of estimated taxes if the estimated taxes paid were insufficient.