Yes, you do need to amend your return to make the adjustment to the cost basis.
Take a look at the following article for a good explanation about how RSU stock award work and what is reported on your tax return: https://thefinancebuff.com/rsu-sell-to-cover-deconstructed.html
