If someone can push your buttons that easily, it’s time to rewire the panel.

Certain people know the exact sentence that gets a reaction out of you, usually because they have watched it work before. That is not weakness on your part. It means there is an open circuit, something you already feel unsure about, and they found the wire. The reaction comes fast because the doubt was there first.

Rather than trying not to react, look at what the comment actually touches. If it is something you genuinely want to change, work on that and the wire goes dead. If it is simply not true, say the plain version to yourself once and let them keep pressing a button connected to nothing.