Technical Talks

View All

The Modern Data Stack Lost the War: Stop Building more DataFrame APIs

Leonhard Spiegelberg Leonhard Spiegelberg | Member of Technical Staff | OpenAI

After more than a decade of limited innovation, the modern data stack is still slow, fragmented, and painfully repetitive. Every new dataframe library promises better ergonomics or performance, yet converges on the same API with the same limitations. The failure isn’t execution or scale, it is ignoring that appearance doesn't matter anymore: Agents and AI-first developers couldn't care less about how an API looks today. In this talk we’ll examine why the dataframe paradigm keeps reproducing itself, why it consistently underdelivers, and why the data stack’s biggest problems were never going to be solved at the API layer first. Princess Leia once put her trust into Obi-Wan Kenobi - what if we did the same with simple Python functions? Could we defeat the evil empire of DataFrame APIs?

Leonhard Spiegelberg
Leonhard Spiegelberg
Member of Technical Staff | OpenAI

Bio Coming Soon

FEATURED MEETINGS