The idea that mathematical objects exists independently of the material world is called Mathematical Platonism, which is a form of Mathematical Realism.

Well, the logic of such a theory as you are hypothesising, if I understand you correctly, would have to take into account many of the issues being debated in the field of Philosophy of Mathematics. For example see the following questions being asked there:

What are the sources of mathematical subject matter? What is the ontological status of mathematical entities? What does it mean to refer to a mathematical object? What is the character of a mathematical proposition? What kinds of inquiry play a role in mathematics? What are the objectives of mathematical inquiry? What gives mathematics its hold on experience? What is the source and nature of mathematical truth?

And most relevant to your question: What is the relationship between the abstract world of mathematics and the material universe?

The idea that mathematical objects exists independently of the material world is called Mathematical Platonism, which is a form of Mathematical Realism.

Now, the logic of such a theory as you are hypothesising, if I understand you correctly, would have to take into account many of the issues being debated in the field of Philosophy of Mathematics. For example see the following questions being asked there:

What are the sources of mathematical subject matter? What is the ontological status of mathematical entities? What does it mean to refer to a mathematical object? What is the character of a mathematical proposition? What kinds of inquiry play a role in mathematics? What are the objectives of mathematical inquiry? What gives mathematics its hold on experience? What is the source and nature of mathematical truth?

And most relevant to your question: What is the relationship between the abstract world of mathematics and the material universe?