The Cognitive Revolution · Thursday, October 1, 2026
Daniel McKinnon reports that an AI model, Grok 4.6, failed to identify a critical genetic deletion in a child's case because it incorrectly renamed the gene. This error, where the model changed the gene's name to something else, led to a missed diagnosis, highlighting the need for robust error prevention in AI tools.
“And you'll see things like there's one particular case where Grok 4.6, which at that point was state of the art on our benchmark in Grok build, where it missed one because it just renamed Grok.”
“the gene. It just was saying like, oh, you know, nrf2 or whatever is responsible. And then it just changed the name of the gene to something totally different.”
“I'd never seen that before. And I was just like, this is... dumb and our harness and our tools prevent the agents from doing dumb things.”