The crosswalk button might not do anything, but the light changes anyway. Some waits aren’t yours to control.

Much of what you do while waiting exists to make the waiting bearable rather than to affect the outcome. That is not useless, since the anxiety has to go somewhere, but confusing the two leaves you believing you have influence where you have none, and then blaming yourself when the timing does not go your way. The light was always on its own cycle.

Sort your current waits by whether your action changes the result. Where it does not, stop pressing and refreshing. Let it resolve on its own schedule while your attention goes elsewhere.