You have until the tax filing deadline (April 15, 2024) to remove the excess contributions. You will then treat it on your tax return as if the contributions were never made. Contact the HSA bank to do this, there will likely be a special form, it is not a normal withdrawal. If the excess contributions earned any money, that will also be withdrawn, and those earnings will be taxable as "other income" on your 2024 return (for earnings that were removed in 2024).
Even though the contributions were after-tax and not through an employer, they are still subject to the 6% penalty if you leave them in the account, and the penalty recurs in every future year unless you spend the account down or find another way to make the contributions no longer count as excess.
