<<"Do I have to claim the CT unemployment income in MA as well and pay taxes on it even though it was from a different state?">>
Yes. Your unemployment compensation is taxable by both CT (because that's where you earned it) and MA (because that's where you live). But you'll be able to claim a credit on your MA return for the taxes you pay to CT on that income, so you won't be double-taxed.