Loan against 403(b) after separation of service

If you have an existing 403b that you never moved from an old employer, are you allowed to take a loan against this retirement plan?  If the plan administrator allowed for a loan to be taken out, but the IRS rules state that this is not allowed, what would the potential penalty be?