In an op-ed in FT, philosophy and cognitive science professor Susan Schneider argues that augmenting the human mind with AI will eventually lead to a kind of metaphorical suicide.

In the piece, she poses a question -- if you gradually offload mental tasks to an implanted AI, where does your self end and the AI begin?

She describes a short story by science fiction author Greg Egan, in which an AI chip called "the jewel,"" is implanted in a human at birth and learns to mimic their behavior and thoughts by adulthood:

... let us assume the jewel works perfectly. So which is you — your brain or your jewel? It doesn’t seem possible that the jewel could ever truly be you, as your biological brain and consciousness exist alongside it. It is implausible to think that your consciousness could magically transfer to the jewel upon the destruction of your brain. Instead, it’s more likely that at the moment you opted to remove your brain, you inadvertently killed yourself.

Talking to TNW after the FT article was published, Schneider went into more detail:

The issue is also philosophical: What is the nature of the self or mind? If the mind is just the brain, a full merger with AI wouldn’t work. I suspect those advocating a mind-machine merger think the self is a program.