There are no great metaphysical insights into this question.
First of all, contradictions aren't discovered. They're constructed, and a good explanation of this is Constructive Mathematics (SEP). You give me an example of a contradiction in mathematical logic (Russell's paradox is a good example), and I'll show you how it is constructed, and then how it is obviated through another construction. (Russell himself devised simple type theory). Mathematical statements in this view are nothing more than constructions.
Secondly, given the construction of a contradiction, there is no great implications to reality or thought given your ability to produce systems that admit all manner of true, but meaningless inferences. That's because reason requires relevance for such inferences to be meaningful and useful. In fact, there are now decently complex relevance logics (SEP) that govern such issues. From the SEP:
In addition, relevance logicians have had qualms about certain inferences that classical logic makes valid. For example, consider the classically valid inference... The moon is made of green cheese. Therefore, either it is raining in Ecuador now or it is not... Again here there seems to be a failure of relevance. The conclusion seems to have nothing to do with the premise. Relevance logicians have attempted to construct logics that reject theses and arguments that commit “fallacies of relevance”.
So, while your question is meaningless in a technical sense, it betrays a certain perspective of logic that somehow the rules of the game manufacture meaning, when in reality, meaning dictates the rules of the game. Games that produce meaningless results are simply trivial. This is because the language of logic is governed by the broader nature of the Wittgensteinian language-game. Languages, including those of mathematical logic, are ways about sharing experience and bringing about change in the world through speech acts. There is no great mystery when nonsense is uttered.