As inflation and affordability dominate voter concerns, these numbers suggest Republicans face a battle to defend their majority.