The deferred losses are not "capital" in nature and will not affect the capital gain calculation. If your income hadn't been high enough to eliminate the immediate recognition of the losses as they occurred you'd simply have recognized the losses each year.
