My memory seems to be failing me at the moment, but I seem to recall Russell saying something like the following on some occasion:
The consistency of mathematics does not show that it is true but only that it could be true.
I think he might have said something like this in his book The Philosophy of Logical Atomism, but I can't seem to find it there. Anyone care to lend a hand by giving the exact phrasing and source?