Complete Form W-4 and indicate that you are married in Step1 (c).
Since you will be working a short time in 2024, it is not necessary for you to complete worksheets relating to your spouse's pension and Social Security income.
Your employer will withhold Federal Income Tax at standard rate and this will most likely trigger a refund when you file your 2024 tax return.
There is not an elegant way to shut off the Federal withholding because of your unique circumstances.