Probably not. If you just use the home for leisure, do not rent your vacation home, or perform any business out of the home, you have no NJ income tax obligation.
Here is some information you may find helpful: How Does Your Vacation Home Affect Your Taxes?
