Yes, in order to claim the start up costs, you would need to enter the new business on your tax return. Depending on how you filed your LLC if you are considered a disregarded entity you will just enter it on Schedule C
As you walk through the questions in TurboTax Home and Business or TurboTax Self-Employed, you will be asked if you started or stopped this business in 2021. Answer yes and you will be guided through entering your start up costs.