The SEP article here outlines different kinds of simplicity, otherwise known as parsimony. The two main ones outlined are elegance (related to the simplicity of a theory and how simply it can be formulated) vs. ontological parsimony (how many kinds of entities are posited in the theory).
Is there ever a case where the latter is preferred in practice by science? Or is there a rationalist case for preferring it over elegance? Examples tend to either include theories that are empirically equivalent but postulate more entities (such as Lorentz’s aether theory vs. special relativity) or theories that postulate more entities but make the theory more conceptually elegant (such as positing Neptune before it was discovered which “allowed the perturbations in the orbits of other observed planets to be explained without complicating the laws of celestial mechanics”).
Even in the aether case, the article notes
The problem with using this example as evidence for Occam’s Razor is that Special Relativity (SR) has several other theoretical advantages over the Lorentz-Poincaré (LP) theory in addition to being more ontologically parsimonious. Firstly, SR is a simpler and more unified theory than LP, since in order to ‘save the phenomena’ a number of ad hoc and physically unmotivated patches had been added to LP.
If SR is more simplified than LP, it also makes it more elegant. Thus, elegance, even here plays a role in preferring SR.
In other words, elegance seems to take precedence over ontological parsimony in history. Are there any justifications for taking ontological parsimony as more important, even at the cost of added complexity to a theory?