Was it just a coincidence because he simply never got the opportunity to, or because he refused to leave his home city for ideological reasons ?
This doesn't really answer your question in the terms given; but it might throw some light on it.
Arendt wrote in her short book, The political theory of Kant:
How serious Kant was about the enlargenment of his own mentality is indicated by the fact that he introduced and taught a course on physical geography at the university.
then she goes on to say:
he was an eager reader of all kinds of travel reports; and he - who never left konigsberg - knew his way around both London and Italy; he said he had no time to travel precisely because he wanted to know so much about every single country.