Text this: The housing affordability crisis isn't just crushing millennials—it's squeezing out buyers in their 40s, 50s, and beyond, too.