It'd never happen now

I'm watching the first few episodes of The Forsyte Saga. Last night I finished up the Brideshead Revisted series. Back in the day, whenever that day may be, from the 19th century through the first few decades of the 20th, men were apparently renting extra apartments and houses for their mistresses willy nilly.

Most of the 2 income families I know now can barely afford to get and keep one apartment or house. Granted I probably wouldn't have run in the same circles as the Bridesheads or the Forsytes but damn! Where are all these people with all this disposable income? So much that no one notices when they're buying a whole new dwelling? I'll say it again, damn!