← Front page

Machine Learning Street Talk · Thursday, October 1, 2026

The 'One Step to the Real World' Problem in AI

Shawn Wen explains that current AI innovation is largely focused on the digital and text world, making it easier to solve complex problems. However, adding the 'one step into the physical world' via voice introduces significant complexity due to the critical element of time, which models are not yet adept at handling.

The tape

3 quotes
“it's actually harder than we think.”
Shawn Wen
“We kind of like, you know, settle on this idea that actually voice is, if you think about voice, the voice is actually one step to the real world. Where if you think about all the current innovation on the AI front is predominantly on the text and the digital world.”
Shawn Wen
“And I think, and because of that one step into the physical world, we started to realize, okay, well, there's actually a lot more complexity when you add that time element into it.”
Shawn Wen
Heard on Machine Learning Street Talk — “How a Voice Agent Learns the Rhythm of Conversation — Shawn Wen”, published Thursday, October 1, 2026. Heardvine summarizes and quotes with attribution and timestamps, and links to the original everywhere.
Transcribed via deepinfra · $0.01
The 'One Step to the Real World' Problem in AI — Heardvine