← Front page

The TWIML AI Podcast · Monday, July 27, 2026

AI Researcher Proposes Using Trained Model Weights as Training Data for New Models

Damian Borth, a professor of AI and Machine Learning, suggests a novel approach where the weights of already trained neural networks can serve as input data for training new models. This 'weight space learning' could accelerate and refine the process of creating new AI models.

personDamian Borth

The tape

2 quotes
So we basically thought about this very simple idea. What happens actually if we take the weights of trained neural networks as the input to train a neural network to understand these weights that we have out there, much, much better.
Damian Borth
Thinking about that, that you can treat the weights as an input modality, gives you suddenly this opportunity of, of, can we be much, much faster in creating new weights for particular tasks, or can we be much more precise in analyzing weights when somebody gives me a new neural network that I'm not knowledgeable about, and I never saw before?
Damian Borth
Heard on The TWIML AI Podcast — “Why Models Are AI’s Next Training Dataset with Damian Borth - #772, published Monday, July 27, 2026. Heardvine summarizes and quotes with attribution and timestamps, and links to the original everywhere.
Transcribed via Gemini audio transcription · $0.05
AI Researcher Proposes Using Trained Model Weights as Training Data for New Models — Heardvine