Some departures hurt because you are saying goodbye to a version of daily life, not merely a building.

What you lose in a move is not the building but a daily life: a particular walk, a shop, a rhythm, the people you passed without speaking. That texture cannot be packed and it does not transfer, and its absence is felt as a diffuse loss that seems disproportionate to a change of address. It is not disproportionate. It was your life.

Allow the grief its actual size rather than arguing yourself out of it. Name the specific things you miss. Some of them can be rebuilt, and naming is how you find out which.