should we pay tax on the family saving account related interest income that we don't withdraw?
Yes. Even though you didn't withdraw it, interest is income. You are not taxed when you take money out of a saving account.