Your question is an excellent one but is more financial planning rather than tax related. Delaying social security is often recommended but the decision should be made taking into account your entire financial situation and goals. You might want to consult a financial planner.
My thoughts.....When I turned 65 my retirement (actually my husband's retirement plan) said I had to start paying the Medicare part B to coordinate with my health insurance. So since it was just a year early for me to start getting Social Security I went ahead and signed up for SS to have the Medicare deducted.
If you need the income (or even if you don't) I would consider taking SS so it there are any future changes to the SS system you are already getting it. And only up to 85% of SS is taxable depending on your other income. Whereas IRA withdrawals will be 100% taxable unless you made any non-deductible contributions. And if you don't need the money you don't have to start taking your IRA RMD until you turn 73 or maybe it's later now.