"Can i go back and file or correct returns with EIN?"
You can generally amend (correct) past returns that you filed, but it is unclear how you handled the EIN with respect to filing past returns (or not).
Did you actually file returns for your corporation or did you not file them at all? If you filed returns for your corporation, did you use some other tax ID number?
Please provide more details.
