Machine Learning Street Talk · Saturday, September 26, 2026
The discussion touches upon the debate of whether AI self-improvement should be judged solely by outcome or also by the elegance of the method. The concept of Goodhart's Law, where a measure becomes a target and ceases to be a good measure, is raised in the context of AI development.
“We are a bit torn on the experiment results. Like, to what extent we want to stick to more first principles, uh, clean solutions we generate versus the solution that actually works better in practice.”
“And also, what about this small matter of Goodhart's Law, which is that when a measure becomes a target, it ceases to be a good measure.”