I'm getting taxed on alimony for 2023 but I no longer get it. 2022 was my last year receiving it...

To enter, edit or delete Alimony payments received -

Click on Federal Taxes (Personal using Home and Business)
Click on Wages and Income (Personal Income using Home and Business)
Click on I'll choose what I work on (if shown)
Scroll down to Less Common Income
On Alimony Received, click the start or update button

Just to expand the answer given above, once you get to a screen that says Alimony or Spousal income Received, remove the entries that are reported in the boxes.