Risky Business · Wednesday, July 29, 2026
The discussion highlights the sensitivity surrounding AI model distillation, noting that Google has removed its distillation service for Gemini. This action occurred shortly after an open letter from Nvidia's CEO addressed the importance of distillation techniques for AI innovation.
“Interestingly enough, too, someone pointed out on, uh, on Twitter, that Google offered a distillation service for Gemini, where you could take a Gemini, uh, you know, a 3.1 or something or 3.2, and then distill it into a sub model for a specific task.”
“Uh, what's really interesting is that Gemini distillation service, you can find it on Google, you click through, and it's been 404. Right?”
“So, thus is the sensitivity around anything to do with distillation.”