The AI Daily Brief · Friday, September 18, 2026
While Anthropic's new proposed metrics for AI development were generally welcomed, some experts called for more comprehensive data. Eli Bakaush suggested combining Anthropic's automation levels with OpenAI's R&D task breakdowns, while Arron Rao advocated for weekly public reporting of standard measures across all labs.
“great to see this from Anthropic. A few weeks ago, I wrote that the company could be a lot more transparent, and I appreciate how they've stepped up, both with this and the recent incident investigation report and misuse report.”
“interesting that OpenAI gives us the breakdown of usage per R&D task, and Anthropic gives us automation levels. Would be great to combine both and get the evolution of automation per R&D task.”
“we need standard measures across all labs to measure progress to RSI and publicly report on it weekly to monthly.”