If my schedule C line 31 is negative balance, do I have to pay self employment tax?

No, if your business is showing a loss (negative) on Line 31 of Schedule C, then you would not be subject to Self-Employment tax for that business.