I see no restrictions for each spouse to take a withdrawal from their own accounts as long as each of them meets the qualifications to be able to withdraw without the penalty. See the IRS news release:
https://www.irs.gov/newsroom/coronavirus-related-relief-for-retirement-plans-and-iras-questions-and-...
