Is it feasible to live abroad while working remotely in your original country -- as if on vacation using a US bank and debit/credit card? Would there be extra taxes etc?

I would like to live in Latvia with my boyfriend, however, having a job in the US would be great because it would be less of a language barrier and prices there are cheaper. But I have also been told that companies in the US wouldn't hire someone living abroad because it'd be more complicated/cost them money.