Do I need to notify IRS about our taxable income, not ssn, is under $4K?
Depends what kind of income. Did you get a W2 or 1099R or 1099NEC for it? If you don't need to file you can file to get back any withholding taken out. If you got a 1095-A for MarketPlace Health Ins you need to file.