I'm not sure what you mean by registering a business. You do not have to have an LLC. You can simply be a Sole-Proprietor. Taxwise, you would still enter your income and expenses on Schedule C.
You can keep it simple.
Your city will want you to register as a business, but that is not for federal tax purposes. If your name is in the business it is easier, such as John Doe's Honey. Check with your local city office. There will be an annual fee for either business tax based on proceeds or just for having a license to do business in that city.
You should also check the state's sales tax registration requirements; for paying on sales and for exemption on business purchases.
www.score.org is a good place for getting free assistance in setting up a business or to have questions answered by retired business owners.