This Week in Startups

Jason Calacanis covers startups, tech, markets, media, and all the hottest topics in business and technology. He also interviews the world’s greatest founders, operators, investors, and innovators.

What's Next for AI Infrastructure with Amin Vahdat | AI Basics with Google Cloud

May 1, 2025 • 28 mins

In this episode of AI Basics, Jason sits down with Amin Vahdat, VP of ML at Google Cloud, to unpack the mind-blowing infrastructure behind modern AI. They dive into how Google’s TPUs power massive queries, why 2025 is the “Year of Inference,” and how startups can now build what once felt impossible. From real-time agents to exponential speed gains, this is a look inside the AI engine that’s rewriting the future.

Key Points

Google's TPU advancements have significantly increased computational efficiency, allowing for more complex AI tasks to be performed with greater speed and lower cost.
The exponential growth in AI compute power and efficiency is transforming previously impossible tasks into feasible projects, enabling startups to innovate without being constrained by infrastructure limitations.
AI-driven tools and agents are rapidly advancing, enhancing productivity and enabling more sophisticated automation and decision-making processes across various industries.

Speakers

Jason Calacanis

Host • 61%

Amin Vadat

Guest • 39%

Chapters

0:00	Jason introduces today’s guest Amin Vahdat
3:18	Data movement implications for founders and historical bandwidth perspective
5:29	The shift to inference and AI infrastructure trends in startups and enterprises
8:40	Evolution of productivity and potential of low-code/no-code development
11:20	AI infrastructure pricing, cost efficiency, and historical innovation
17:53	Google's TPU technology and infrastructure scale
23:21	Building AI agents for startup evaluation and supervised associate agents
26:08	Documenting decisions for AI learning and early AI agent development

Transcript

Loading transcript...

- / -