Wear the thing you like. The people judging your outfit will forget it before lunch.

The audience you are dressing for is much less attentive than you imagine. People are running their own commentary about themselves and have very little processing left over for your jacket, which is freeing once you actually believe it. The judgment you are bracing for is mostly happening inside your own head.

Wear the thing this week and watch what happens, which is almost certainly nothing. If someone does comment, notice how little it costs you by dinner. Dress for the person who has to be in the clothes all day.