No. As long as you make the payments, there are no tax consequences for taking a loan from your retirement plan.
