Consider the claim that we knew that Earth was flat. The aforementioned claim seems counter-intuitive, at first glance; and false in accordance with the definition of "knowledge" as "justified true belief", since, presumably, it has never—at least since the existence of humankind upto the present—been a justified true belief that Earth is flat. So, one who argues that knowledge is indeed fallible, could either bite this bullet, or set the record straight.
The question "what is knowledge?" may also be relevant