As far as I know, Fidelity does not permit precious metals to be held within their IRAs, so to have an IRA that holds precious metal coins or bullion you would have to liquidate an asset within the Fidelity IRA, perform a trustee-to-trustee transfer of cash to a IRA custodian that will hold the coins or bullion in an IRA and purchase the coins or bullion within that IRA. Be aware that it's the precious metals IRA that owns the coins or bullion, not you personally. If the coins or bullion then ever come into your physical possession, it's a distribution.
While you could do a cash distribution from the Fidelity IRA and roll the cash over to the new custodian, that would be subject to the one-rollover-per-12-months limitation. A trustee-to-trustee transfer of an IRA (or a portion of an IRA) is neither a distribution nor a rollover so such a transfer is not subject to that limitation.
