← Front page

Machine Learning Street Talk · Sunday, June 28, 2026

The Deceptive Nature of AI Model Progress in Code Generation

Thomas Ahle suggests that advancements in AI models, such as Fable and GPT-4.5, can be deceptive. He notes that while newer models may appear superior to older versions, this rapid progress might obscure underlying issues or a lack of true understanding, comparing it to "smoking mirrors" and emphasizing the importance of rigorous, objective testing.

personThomas Ahle

The tape

3 quotes
But did it though? Do you think it could be deceptive?
Thomas Ahle
Because you know when Fable comes out, all of a sudden 4.8 looks terrible. And when 4.8 came out, it looked amazing compared to, you know, 4.6.
Thomas Ahle
But I think that's why it's good to have also the the hard tests.
Thomas Ahle
Heard on Machine Learning Street Talk — “The Thermodynamic AI Computing Chip - Thomas Ahle, published Sunday, June 28, 2026. Heardvine summarizes and quotes with attribution and timestamps, and links to the original everywhere.
Transcribed via Gemini audio transcription · $0.06