You do not have to add this as income. A loan from a qualified plan (401k) is not considered a taxable transaction as long as you are paying the loan back according to the terms of the loan. Also, if you quit employment it is a deemed distribution and it becomes taxable at your termination.