If your group only bonds over someone you all dislike, the bond is borrowed.

A group held together by a shared target is renting its closeness. Disliking the same person generates real warmth and instant agreement, and it needs a constant supply of material, so the group either keeps finding new targets or discovers it has nothing to talk about when the first one leaves. None of that arrangement is actually about the people in it, and you are also next in line.

Try changing the subject next time it starts and see whether the conversation survives. Bring something you actually care about. A group that can be interested in things rather than against somebody is more work and considerably safer.