Provided you have now included all of your income, and also filled any state tax returns that may have been required, you will be Okay!
There are 13 states that tax Social Security: Colorado, Connecticut, Kansas, Minnesota, Missouri, Montana, Nebraska, New Mexico, North Dakota, Rhode Island, Utah, Vermont and West Virginia.