Remove dependent

My 21 year old college student wants me to re-file my taxes and remove him as a dependent so he can receive stimulus checks, even though he hasn’t filled since his junior year of high school. He seems to think I’ve been getting “his” stimulus checks, can I remove him as a dependent from what i already filed, without it messing my taxes up, or me having to pay money back ?