Yes, you should be worried.
The bank or the IRS might consider what you are doing to be "structuring." That is making repeated deposits under $10,000 to try to evade the requirement for the bank to report cash deposits of $10,000 or more. Structuring is illegal.
The IRS might also want to know where the large amounts of cash that you deposited in your account came from, and why you didn't report it as income on your tax return.
I agree with Bsch4477. You should stop doing it.
