There's a complicated issue that arises in the concept of "ordered by preference."
On one hand, one may define this phrase such that what you describe is tautological. This is the argument used by the phrasing "Well you must have really wanted X all along." This phrasing is indeed useful for developing formulae approximating one's preference.
The other is that we define a priority order for options before the choice is made, and then a human exerts "free will" to decide between them. In this case, the devil is in the details. Given some unbounded amount of decision making time, we like to believe that humans will pick their first preference. This is at the root of why we model humans as "rational actors." They try to maximize some internal goal.
However, in practice, humans do not have unbounded time. The time one spends thinking affects the outcome, as the world keeps moving. As such, humans rarely follow this simple rule precisely. Consider the example of police officers who make a split second decision as to whether to shoot someone or not. It is highly unlikely that they will make a decision based on the objective truth of the entire scenario because they have not had time to analyze everything. The Trolley Problem is an excellent way to explore this: there's always some nuance that you haven't considered which could matter when you find yourself holding the controls of a runaway trolley.
If we try to mix these two, we see that a rational human must fundamentally be aware that, in the moment, they will make a decision based on incomplete information. Given enough time, humans will try to optimize their lives to "win" at this decision. But at this point it gets sufficiently murky that it's hard to keep going with the model of a simple ordered priority list. The long standing philosophies surrounding death show that we've got some really complicated thoughts regarding what our most important decision might be.
So, as such, I would say that if one uses the tautological pattern for priority, then we always follow it. However, if one takes one step off of this extreme, towards the idea of having a pre-determined ordered priority list, humans begin to do things which are not modeled well with this priority list.