There's no one answer to your question, because this is a live debate, and different thinkers have very different moral intuitions about it. Traditional Catholic theology represents perhaps the position most to the end of one extreme, that the fetus should be treatedtreated as a full person (regardless of its actual ontological status) from the very moment of conception.
At the other end of the spectrum, utilitarian philosopher Peter Singer is perhaps the visible figure who has most fully embraced your exact line of reasoning with all its uncomfortable ramifications --in his point of view, a young child, an intelligent animal, and a mentallymentally disabled adult should all be viewed as essentially equivalent based on their intellectual capacitycapacities and abilityrespective abilities to live a rich life. He would argue that if it is justified to kill any one of those, it would be justified to kill any of the others given the necessary equivalences --in other words, that the mere fact of personhood (in terms of biological membership in the human species) doesn't invoke any special protections or privileges. This is also the basis of his arguments in favor of animal rights.