do I have to file income tax for that state?

Only if that state taxes personal income. For example, Florida does not tax personal income. So if your rental property is located in FL, you have nothing to report to that state concerning your rental income.