Retirement tax questions

.I was puzzled by this and disappointed .  So we do get social security  wow so much money (not) my husband is the working old people.  He had to take SS for the big crash in 2008 and gets a very reduced amount.  We had no source of income then.  His work of 31 years then got rid of him and all the other old people.  He went back to work eventually  a no where job, because he had to.   So now  he is getting unemployment and the minus 10200 is added right back into the social security worksheet.  Am I right to see we pay taxes on the whole amount of unemployment anyway?  BTW Our income NOT even close to the 150K threshold