sometimes one sees/reads assertions such as "[the bounded inverse theorem] is equivalent to both the open mapping theorem and the closed graph theorem", but taken formally and literally this would amount to the trivial observation that (φ∧ψ) → (φ↔ψ) [ which holds in logics weaker than classical logic ], and, in particular, that all theorems of a given theory are equivalent, which does not seem to be the intended meaning
the historical examples of euclidean geometry and set theory suggest that, from a slightly technical viewpoint, it would be that "theorems φ and ψ of a given theory Γ are 'equivalent' just in case there is a subtheory Γ' of Γ such that Γ'⊬φ, and Γ'⊬ψ, but Γ'⊢(φ↔ψ)" [think of euclid and playfair's axioms, for the first, and choice, well-ordering and zorn, for the latter], and this also seems to be the approach of reverse mathematics, but it may not necessarily be the naïve use/viewpoint of mathematicians not versed in matters of logic, as it seems to hint more at some intuitive grasp of the 'content' of the theorems/statements than to provability in such more strict terms
is this use/notion of 'equivalence' discussed/examined somewhere in the philosophy of mathematics literature (perhaps in the 'philosophy of mathematical practice' literature), or perhaps even in the usual mathematics literature?