Roth IRA Penalty?

If I withdraw contributions from my Roth IRA will I get penalized? I have a small amount in there and have only lost money. I haven't made anything so want to put it in a high yield checking/savings instead. I was under the impression I won't get penalized on withdrawing contributions from my Roth IRA.