Do I need to file out of state purchases in Kentucky? If so, would this include things like amazon purchases?

Probably not. You only report out-of-state purchases on which you did not already pay sales tax. Amazon and most other retailers will automatically charge the proper sales tax based on your jurisdiction.