Money buys a lot. It doesn’t buy back the people you ignored while you were chasing it.

Some costs get paid in a currency that does not convert back. Money can buy almost anything facing forwards, and it cannot buy the ordinary evenings you were not there for, because those were never stored anywhere. Nobody notices at the time, since each absence is individually reasonable and they only add up looking backwards. The bill arrives late and in full.

None of this asks you to abandon the ambition. Just put the few people who matter into the calendar with the same seriousness as the work. Turning up on ordinary days is the whole mechanism, and it is not expensive.