Yes, when you are doing your nonresident return for Delaware, only include the Delaware-sourced income from your part-time job.
Your other income, if it is taxable in PA, will be subject to PA taxes and PA taxes only. You will get a credit on your PA tax return for the taxes you pay to Delaware on your earned income.
