There is a physical explanation of some irreversibility, via the second law of dynamics
... the second law implies that time is asymmetrical with respect to the amount of order in an isolated system...
And this article argues at length that the flow of time is incoherent, except as a feature of human experience.
[T]he passage of time connotes more than just an intrinsic asymmetry: not just any asymmetry would produce passing. Space, for example, could contain some sort of intrinsic asymmetry, but that alone would not justify the claim that there is a “passage of space” or that space passes.
Apparently, time itself is irreversible
Time, in its entirety, is reversible if and only if all the processes (both existing ones and those that can exist) are reversible. Correspondingly, time as such is irreversible, if and only if there is at least one irreversible process possible.
Says the philosopher Shramko
Is is possible to explain the psychological experience of the flow of time? If time itself is irreversible but does not flow.