To play devil's advocate, people who go to work are very likely to interact with other people, which might help keep our society a little closer together. They might become bitter (since nobody respects low-end service workers), but at least they remember what people are like, and don't turn insane/radical through isolation.

I am not sure if there's data to support this claim, though.