I'm a lefty and I fucking hated all of my coworkers. And I'm sure I'll hate them when I rejoin the work force again.
I think it's more an issue of people just being braindead NPC's who make whatever they are doing at the moment their whole "thing". "I'm at work, so this is my WHOLE life!!!11!!!!11"
I promise you, just as many click-y Republican's do the exact same thing at work and get all butthurt when people just want to go to work, do their work, and then go home and not hang out chitchatting.
It's probably too late now, but in the future my advice is to go and then just sit there, stony faced. Don't try to fit in at all. Don't talk, don't interact, but also don't leave. Make it unbearably uncomfortable. Only leave once they say they are leaving. They should be so uncomfortable by the whole thing, they won't invite you again.
Hopefully.
Sometimes people are just nuts, even if you make it clear you don't give a shit, they just can't stop their behavior. They just NEED to talk and NEED to socialize because it's all they have to fill their meaningless day and life.