Capital Gains

If I make periodic contributions to my brokerage account and take no withdrawals as it appreciates do I start paying capital gains tax after I withdraw more than the sum of my contributions?