How do I delete a prior year unfinished tax file?

If it's in the online version you can't delete it.  Just abandon it.  You may want to set up a new account next time.