Complete all the things on the IRS list that is applicable : https://www.irs.gov/businesses/small-businesses-self-employed/closing-a-business
