Note that the safe harbor is only that. meet it and you qualify for the QBI. Don't doesn't mean you don't qualify but then if you take the QBI deduction and the IRS inquired you would have to prove to them that the rental activity rises to the level of a trade or business (not defied in the tax code but by numerous court cases). Based on what you provided you wouldn't be able to do so. However, some taxpayers take an aggressive approach to the QBI deduction when it comes to rental real estate.
