If you are mainly concerned about your credit score, you should not cancel your credit card accounts once they are paid off, unless that is the only way to prevent yourself from overusing them again. Having credit accounts that are open and unused will usually improve your credit score. If you do want to close some accounts, close the youngest ones and leave the oldest ones open and unused.
