As with any short statement, it is possible to disagree with it. However, I think you get more benefit by being charitable and seeing what insight the fellow was talking about. I think his main point is that physics DOES pertain to our universe. Math is an abstract system.
This is a very cool insight. But it isn't necessarily a point in math's favor. There tends to be some loss of connection to the real world, when you move to the abstract. Physicists get to learn about electricity and things like that that we experience. Math majors don't. Similarly many biologists LOVE their topic because what could be more interesting than learning about our bodies. But if you want to learn the abstractions more power to you.
You asked for other writings and I was glad to see the V Arnold comments but surprised nobody mentioned this clip:
https://www.youtube.com/watch?v=obCjODeoLVw
In addition to the math versus physics, I would be attuned to where he mentions hypotheses based on bias. I.e. that it is OK to have them but realize it and don't be too prejudiced. It's a good philosophical point.
Finally in the context of what is a better major, I think that a lot of that comes down to YOU, not to which major is better. Is basketball "better" than wrestling. Maybe. You can make actually make arguments. Not definitive, sure, but you can find factors like team sport, notability, etc. to support a stance. However, what is best for YOU will likely have a lot to do with your physique, skills, aggressiveness, enjoyment, etc.
So...I definitely think that "this is better" field is a very low factor in your calculus. It should be more about what you enjoy, what you are good at. And also, I would be careful to consider what further training will be like and what jobs will be like. You might like freshman calculus and physics equally but find the move to proof mathematics a turnoff in the math curriculum (real analysis doesn't actually help you solve more integrals!)
Feynman had a negative reaction to math, his initial major at MIT, when he asked the professors what they did with higher math in later parts of math major and the answer was teaching more people to do that in the future. At first he switched all the way to EE. Then he decided that was too applied for him and settled on physics.
None of this is to argue you to physics (I'm even more applied than physics), because if you like math and are good at it, then fine. Also there are a few fields of math (real mathematicians will scoff) like statistics or operations research where you learn and perhaps even research fundamental math in the topic but there's also a pretty strong emphasis on collaboration with practitioners in the real world.