It is not only arrogant, but it is profligate, for a man to disregard the world’s opinion of himself.

Total indifference to what others think of you sounds like strength and is usually waste. Reputation is a working asset: it decides who will trust you with something, who will warn you, who picks up the phone. Throwing it away costs more than pride does. The point is not to be ruled by opinion but to stop pretending it is worthless.

Notice where you have been telling yourself a bad impression does not matter. Ask whether that is independence or avoidance of an awkward conversation. Caring what a few good judges think of you is not vanity, it is information.