Tax implications after home buyout

If I buyout from my partner (we’re not married) our house, on what capital gain will I be taxed once I sell it?

Let’s assume the house originally costed 500k, I pay him $100k for the buyout. Once I sell it, will I consider the capital gain coming from the selling value minus  $500k or $600k?