I was able to cancel my payment via the phone number provided. That being said, you cannot schedule a new payment more than 30 days away on the IRS website (at least via direct pay), so I have set myself a reminder for June 15 to schedule it.
