Eliminate estimated payments

We have been making estimated payments for the last couple of years because of the Covid distribution we took. My husband retired at the end of the year (2023) our income will be reduced. We were entitled to a substantial refund for  2023 so we did not intend to continue  making estimated payments. 
Our refund was just direct deposited, but they have   deducted the first estimated payment for 2024 from the refund.

How does one opt out of estimated payments?