Kitcher’s basis for the indefeasibility requirement on a priori knowledge is that empirical indefeasibility is required for independence, in the sense Kant intended, of empirical evidence. I am inclined to agree with Casullo (2003, §2.2) that Kant’s remarks on ‘independence’ are not sufficient to determine whether what he had in mind entailed such indefeasibility or not. On the other hand, a good reason for doubting the interest of the indefeasibility-involving conception is that it is just too easy to show that there is no a priori knowledge on this conception. Even core putative cases of a priori knowledge – mathematical knowledge, for instance – are, familiarly, defeasible by empirical evidence. However good your intuitions, conceptual analyses, proofs or deductions are, if all the mathematical experts tell you that you have made a subtle but crucial mistake, your justification will (and should) be defeated. Thus if there is anything interesting to debate about the claim that mathematics is a priori, the notion of a prioricity in play cannot involve an empirical indefeasibility requirement.
Carrie Jenkins, 2008, "A Priori Knowledge: Debates and Developments", p.2 (this paper is not a published version but a final draft to be found her website.)
I don't understand why mathematical justification will(and should) be defeated simply by mathematicians 'telling that there's been a mistake'. For the justification to be defeated, I think it is necessary to point out what exactly the mistake is.
Then, it seems that the proofs, or whatever, were actually bad and false, thus not knowledge at the outset. it seems to me that the justification in question is defeated in the way that isn't empirical.