mortgage interest on second home lowers tax refund

I have seen several posts regarding this issue.  If entering the mortgage interest on the second home lowers my tax refund by several thousand dollars, is it permissiable to not include the mortgage interest for the second home?