Quite honestly, the US/Japan tax treaty is not helping here, it basically says that the tax should be paid in a country of residency, I spoke to a Japanese CPA in the US, he couldn't provide a clear answer either. I'm running out of options here, as far as I know, foreign retirement pension issues are very tricky. Thanks for your time and answers, you've really tried to help me.
