You are correct. Only required to file a PA resident return.
You only need to file a NJ return if NJ state income taxes were withheld from your pay and you wished a refund.
However, if you operated a business or rental in NJ, or sold property in NJ, then you would need to file a NJ return.
