Is there a limit to how much business expenses I can write off for a small side business?

Within reason, no. Many businesses have more expenses than income in the first year.

You might review this TurboTax post for more info: Taking Business Tax Deductions