Cash out portion of second home refinance used to pay down primary residence mortgage

I did a cash out refinance of my second home and used the cash out amount to pay down my primary residence mortgage (so I could refinance my primary residence mortgage at conventional rates).  Is the refinanced second home mortgage fully deductible?