Florida does not levy a state income tax on S corporation income (unless it was formerly a C corporation).
You will need to register the corporation to transact business within the state.
See https://form.sunbiz.org/pdf/cr2e007.pdf
Further, your local municipalities (county and city) may also have registration requirements (in the form of licenses or certificates).
Sales taxes and tangible personal property taxes are separate issues.