What's so special or unique about mathematics that we keep coming back to this phrasing?
Math is built on the principle of idealized precision and unambiguity. The value of 1 is precisely 1. It's not 1.0001. That's a completely different value. There's also no other value which is equivalent to 1 in every way. Every value is strictly defined and unique. Every operation is deterministically precise.
Without this kind of precision, math would fall apart by its very threads. It's the equivalent of rounding pi down to be equal to three and then expecting all the subsequent math to still make sense.
From the perspective of someone who enjoys the solidity that such a deterministic system provides (logicians, mathematicians, software developers, ... are definitely a subset of those), human language flaunts these rules constantly. There's ambiguities, partial synonyms, a dependency on contextual inference, a non-universally agreed upon standard, and imprecision is not only understood but also even expected in some cases.
Take the following examples:
Yesterdya I ate an apple
There's a mistake in there, but we hardly stumble over it. If I write this in a book, everyone will know what I mean to convey.
PI = 3.14159265539...
First of all, you're not going to easily spot where I swapped two digits. Secondly, if we take what I wrote at face value, all of my subsequent calculations would start showing inconsistencies, and it would all fall apart.
Using an example from the field of software development to explain how messy humans are: dates.
Humans do reasonably well at understanding dates in daily life and how to make their schedule around them. But the date system is a very human and imprecise one. Inbetween timezones, months of arbitrary length, leap years, exceptions to leap years (and then exceptions to those exceptions, and then ...) DST in some but not all locales, arbitrary holidays that aren't bound to the same date every year and differ for countries and cultures,, timezones with 15/20/30 min differences instead of hourly increments, non-straight timezone boundaries, changes to the standard calendar (julian/gregorian), countries having historically skipped a few days to correct their calendar (IIRC France once skipped 12 days in July to synchronize back to the English' calendar), (let alone relativistic concepts!) ... it is insanely hard to come up with a deterministic system that is consistent and precise.
It is the bane of every software developer's career. If there is a Hell, I imagine it's a place that would make me write the logic that encompasses conversions between all of humanity's timekeeping systems.
It isn't universal concision - there are many concepts more concisely put in English than math
In its defense, this is where the imprecision of human language shines. By being vague and leaving details up for inference, you are able to skip the time-consuming pedantry, instead being able to focus on the broad strokes. Because of math's dependency on absolute precision, it doesn't allow for broad strokes.
A simple example here is that our country has tried to pass a law that lowers the speed limit for trucks when it rains. Simple, clear, understandable. Except that they are unable to enforce this law due to the seemingly infinite ambiguity in "when it rains". How much water should fall from the sky precisely? What about if it stops raining but the road is still wet? How wet should the road be? How could drivers know if the markers for "it rains" have been met while driving? ...
Humans really like building systems that are flexible and malleable so exceptions and inconsistencies can be added whenever there's a reason for them to be there. Mathematics and other deterministic fields abhor flexibility, instead favoring rigidity and extreme consistency.
To a human, math and logic is unnaturally cold and uncaring, devoid of all soul. To a logician, human systems are dirty, messy, and unpredictable.