Not necessarily.
If the bank deleted the erroneous 1099-INT with the IRS, there would be no "corrected" one.
You could ask the bank for some sort of confirmation that the form was deleted, or assume they made the correction properly since a new, updated 1099-INT was issued.