No it does not matter as long as it is the correct mailing address for the IRS to get in touch with you.
