← Front page

Latent Space · Saturday, October 31, 2026

OpenAI Solves Pre-training Scaling Issues in 2026

Joseph Kim revealed that OpenAI experienced problems with pre-training and scaling models in the past, but the company has successfully resolved many of these issues in 2026.

personJoseph KimcompanyOpenAI

The tape

1 quote
“At OpenAI, we ran into problems with pre-training, and therefore had difficulty scaling the model. In 2026, we've been able to solve many of these issues.”
Joseph Kim
Heard on Latent Space — “⚡ Building ChatGPT for Finance — Joseph Kim, OpenAI's Head of Financial Services”, published Saturday, October 31, 2026. Heardvine summarizes and quotes with attribution and timestamps, and links to the original everywhere.
Transcribed via deepinfra · $0.01
OpenAI Solves Pre-training Scaling Issues in 2026 — Heardvine