I would focus on controlling as much as you can. By adopting good productivity practices (some of which are listed in this article), you can ensure you are being effective with your time.

In every job there will be occasions where you need to work late to meet some unexpected demand. But if this happens often, despite being effective with your time, then it may be a signal this is a toxic environment.

I would then consider changing jobs, if this is feasible.