you answered wrong on your return by saying yes when it in fact did not happen. so what the IRS gets from the HSA custodian and what you reported will differ. you may get a notice from the IRS at which time you can respond accordingly. also you are required to report any earnings on the 2022 return
from the instructions for form 5329 HSA section
If you timely filed your return without withdrawing the excess
contributions, you can still make the withdrawal no later than 6
months after the due date of your tax return, excluding
extensions. If you do, file an amended return with “Filed pursuant
to section 301.9100-2” entered at the top. Report any related
earnings for 2022 on the amended return and include an
explanation of the withdrawal. Make any other necessary
changes on the amended return (for example, if you reported the
contributions as excess contributions on your original return,
include an amended Form 5329 reflecting that the withdrawn
contributions are no longer treated as having been contributed)e form 5329 instructions for HSA
