I tried multiple times and finally solved. Here is what I do.
Go to "Forms". Find and open your 4797 form, highlight the number you want to change, go to "Edit" -> "Override", then you can change to your new number.
You can not delete the form but you can modify.
Hope it will help. Good luck!
