The history and future of AI at Google, with Sundar Pichai
- 01Google Was Always an AI-First Company
- 02The AI Intelligence Overhang: Models Are Far Ahead of Adoption
- 03Hardware Constraints Will Define the AI Race in 2026-2027
Podcast: Cheeky Pint Participants: Elad Gil (investor), John (host/Stripe CEO), Sundar Pichai (CEO, Alphabet/Google)
1. Key Themes
Google Was Always an AI-First Company — The "Research-to-Product Gap" Narrative Is Wrong
The popular narrative that Google invented transformers but failed to productize them is significantly misunderstood. Google did productize transformers immediately — in Search via BERT, and had already internally built what was essentially an early ChatGPT called Lambda.
"We exactly even conceived the product, which is like ChatGPT. It was Lambda... So we even had the product version of it in the multiverse somewhere else. Google probably shipped that nine months later or something like that." — Sundar Pichai 00:02:09
The real constraint was internal quality bar and safety thresholds, not lack of product vision.
"The version I saw was a lot more toxic at a level we couldn't have possibly put it out at that time." — Sundar Pichai 00:02:36
The AI Intelligence Overhang: Models Are Far Ahead of Adoption
There is a massive gap between what AI models can do and what companies are actually using them for. The bottleneck is not capability — it is data access, permissions infrastructure, workflow transformation, and prompting skill development. This is described as a "fixed cost" that will eventually unlock enormous productivity gains.
"I can see groups, particularly I would say GDM and some of the suite groups really change their workflows... But just last week, we kind of rolled it out to the search team. So we're constantly pushing that. In a large organization, I think change management is a hard aspect of this technology diffusing." — Sundar Pichai 00:01:34
"The AIs are now amazing in terms of what they can do in the abstract. And if you look at how AI-native a company is or just kind of how much it uses that intelligence, there'll probably be a shortfall." — John 00:01:02
Hardware Constraints Will Define the AI Race in 2026-2027
The binding constraints on AI progress are physical and geopolitical, not intellectual. Memory supply, wafer starts, permitting, and power are the real bottlenecks — not model capability or funding. Whoever has compute now has a structural advantage.
"There is no way the leading memory companies are going to dramatically improve their capacity. So, you have those constraints in the short term, but they get more relaxed as you go out." — Sundar Pichai 00:30:54
"The black market price of zero days is dropping because the supply is growing due to AI." — Elad Gil 00:34:57 (signaling that AI-driven security vulnerabilities are already a real-world market signal)
2. Contrarian Perspectives
The AI Race Is Not Zero-Sum — It Is Profoundly Expansionary
The prevailing framing of AI as a competitive winner-take-all market is wrong. Sundar argues that every major platform shift has grown the overall pie dramatically, and AI is no different.
"I didn't view it as a zero-sum moment at all. Right. And I felt like everything is going to scale up 10x. Right. And there's going to be room for other people. Right. And you go back, you know, Amazon has done well since Google came into the picture and Facebook." — Sundar Pichai 00:14:29
"YouTube has done well since TikTok and Instagram has... The more you view it as a zero-sum game, it looks difficult." — Sundar Pichai 00:11:34
Google Was Not "Less AGI-Pilled" — That's a Cultural Misread, Not a Strategic Difference
The common Valley narrative that Google is more conservative or less committed to AGI than OpenAI or Anthropic is dismissed as largely cosmetic — a function of company age, geography, and language, not actual belief or ambition.
"I think the founders were AGI pilled probably, you know, my earliest conversation... At one point, I don't know, Demis, Jeff, Ilya, Dario were all there." — Sundar Pichai 00:17:34
"We probably have scaled our CapEx from $30 billion to approximately $180 billion. It's like real money now. You know, you don't do it if you don't think about the curve a certain way." — Sundar Pichai 00:17:05
First-Party Hardware Is a Strategic Necessity, Not a Vertical Integration Luxury
The conventional wisdom is that software companies should stay asset-light and partner for hardware. Sundar explicitly rejects this, arguing that direct product feedback loops — especially in safety-regulated domains — require owning hardware.
"My lesson from Waymo and on the AI side with TPUs, etc., I think to really push the curve well, particularly in areas where you have safety, regulatory, everything — you want the first-hand experience of the product feedback cycle. So I think having first-party hardware will end up being very important." — Sundar Pichai 00:49:14
The Market for Software Engineering Is Being Dramatically Underestimated
The common framing of AI vs. software engineers as a substitution story is wrong. The market for coding has been so demand-constrained that adding AI supply will expand the total market, not cannibalize it.
"I think the market for software engineering and coding is dramatically bigger than anybody thinks. And it's the wrong metric to say, you know, token budget versus engineers. So I actually think it should grow a lot of things." — Elad Gil 00:25:05
AI-Driven Cybersecurity Vulnerabilities Are an Underappreciated Systemic Risk
While everyone focuses on AI productivity and CapEx, the security attack surface being opened by AI is treated as a footnote. Sundar suggests it could be a genuine shock to the system.
"These models are definitely going to break pretty much all software out there. Maybe already we don't know if we sit here and speak... How many zero days? So there are constraints here in the system, right? You just can't wish away." — Sundar Pichai 00:34:34
"Somebody was telling me the black market price of zero days is dropping because the supply is growing due to AI, which I thought was a really interesting market metric." — Elad Gil 00:34:57
3. Companies Identified
Waymo Alphabet's autonomous vehicle subsidiary. Cited as the quintessential example of Google's long-term, technology-first capital allocation — doubling down when sentiment was most negative, and now producing a demonstrably superior product. Also highlighted as a model for how AI + first-party hardware creates durable competitive advantage.
"Waymo was a great example where I think we increased our investment two to three years ago when the rest of the world got pessimistic on it. When others, some of the people were backing off." — Sundar Pichai 00:45:22
"It's very magical. It's such a magical experience. I take Waymo now every day to work when I can." — Elad Gil 00:45:23
Isomorphic Labs Google DeepMind spinout focused on AI-driven drug discovery. Cited by both Elad Gil and Sundar Pichai as the most sophisticated approach in the space because it addresses the full drug discovery pipeline, not just molecular design.
"Think about being focused on these models in a targeted way to improving all the possible steps in drug discovery. And even though you have long posts like phase three trials, etc., getting there with a much higher probability of success." — Sundar Pichai 00:40:55
"I think it's definitely the smartest approach I've seen in terms of the different bio models and really thinking about the broader swath beyond just the molecular design, which is, I think, where most of them are stuck." — Elad Gil 00:41:14
Wing (Alphabet drone delivery) Alphabet's drone delivery service. Highlighted as a scaling moonshot nearing mass market deployment.
"I think we are scaling up Wing where in some reasonable time period, like 40 million Americans will have access to a Wing delivery service, right? And I'm not talking years out or something like that." — Sundar Pichai 00:40:30
Anthropic AI safety and frontier model company. Mentioned as one of the two or three frontier labs genuinely pushing the capability curve, and as a Google investment.
"I think there are two to three labs who are pushing each other pretty vigorously. You know, at any given month, we feel like, oh, great, we've done this well. Oh, shit, there's like a couple of things we're behind, right?" — Sundar Pichai 00:15:52
Stripe Global payments infrastructure. Mentioned as an example of a Google minority investment made with ROIC discipline, and discussed throughout as the host company navigating the same AI adoption challenges Google faces.
"We felt our investment in Stripe was being a good steward of our capital." — Sundar Pichai 00:50:51
Boston Dynamics / Agility Robotics Robotics hardware companies. Cited as Google DeepMind's key hardware partners for deploying Gemini robotics models.
"We are partnering back in an ironic way with Boston Dynamics and Agile and a few other companies and, you know, determined way making progress." — Sundar Pichai 00:40:06
4. People Identified
Demis Hassabis CEO of Google DeepMind. Cited as having been deeply committed to AGI from the earliest days, and credited with the multimodal-first design of Gemini models.
"I think the founders were AGI pilled probably, you know, my earliest conversation... Demis and team... I mean, at one point, I don't know, Demis, Jeff, Ilya, Dario were all there." — Sundar Pichai 00:17:34
Jeff Dean Google's longtime AI/infrastructure leader. Cited as having demoed the foundational Google Brain neural network work in 2012 — which Sundar identifies as his personal "AGI moment."
"My first feeling, the AGI moment was 2012 when Jeff Dean demoed the earliest version of Google Brain. This is when the neural networks recognized a cat, right?" — Sundar Pichai 00:19:39
Tony Xu (DoorDash CEO) Cited as an exemplar of CEO-level product connection — still working as a DoorDash driver to stay close to the user experience.
"Tony Hsu is talking about how he still works as a door dasher, you know, to stay very connected to that experience." — John 00:21:41
5. Operating Insights
The "Latency Budget" System: A Rigorous Framework for Speed Discipline
Google runs a structured internal economy around latency — teams earn latency budget credits by shipping features, and must spend them with explicit tradeoffs. This is a replicable operating model for any product company that wants to institutionalize speed as a value rather than just a slogan.
"Search, you know, I was speaking with the teams, right? Like they now have for sub-teams, like latency budgets, like in the milliseconds. You'll get 50% credit. So if you ship something which shaves off three milliseconds, you earn 1.5 milliseconds for your latency budget. And 1.5 milliseconds gets passed on to the user." — Sundar Pichai 00:06:53
CEO-Level Compute Allocation as a Weekly Practice
At this stage of AI development, the most senior operator in the company should be personally reviewing compute allocation at a project-by-project level weekly. This is not a delegation item — it is the most consequential resource allocation decision in the company.
"I at least spend a dedicated hour a week thinking about that question at a pretty granular level. So I will know by projects and by teams the compute units they are using, right? And, you know, or at least I have that information and I'm looking at it and assessing it. And in some ways, it's a really important thing to be doing right now, I feel." — Sundar Pichai 00:53:23
Use AI to Aggregate Raw Product Feedback at Scale
Rather than relying on slide-deck summaries from teams, Sundar uses an internal AI agent (anti-gravity/JetSki) to query real user feedback directly and surface the top five positive and negative reactions to any product launch. This is a scalable, less-filtered alternative to traditional product review processes.
"I would query in anti-gravity, just our internal version of anti-gravity. Hey, we launched this thing. Like what did people think about this? Tell me that like the worst five things people are talking about, the best five things people are talking about. And I typed that." — Sundar Pichai 00:23:01
Evaluate Long-Term Technology Bets on Deep Technical Milestones, Not Business Metrics
The reason Google kept Waymo but cut Loon was not financial projections — it was rigorous assessment of underlying technology progress against preset milestones. This framework is applicable to any company making bets on deep technology with long payoff curves.
"Like we're judging the underlying, like, you know, so you have goals around, you know, what logical qubit error corrected, large stable, logical qubit threshold by when you're going to get to and is the team able to do that? Right." — Sundar Pichai 00:44:13
6. Overlooked Insights
Data Centers in Space: Google's Earliest-Stage Moonshot Is More Serious Than It Sounds
Mentioned almost in passing, this is actually a direct response to the physical constraint problem discussed throughout the episode — land, power, and permitting. If terrestrial data center construction is a 10-year bottleneck, space-based compute is not science fiction; it is a logical infrastructure hedge that Google is already quietly funding.
"We're in the earliest stages of thinking about data centers in space, right? But your earlier discussion around constraint inspires creativity. But if you take a 20-year outlook, right? Where are you going to put most of these data centers? Really hard problems to solve." — Sundar Pichai 00:37:14
This was mentioned in one sentence and not followed up on by either interviewer — but given that Google is already on its seventh generation of TPUs, has committed $180B in CapEx, and is running out of permitting capacity on Earth, this is not a casual remark. It is a directional signal about where Google sees the physical infrastructure ceiling.
2027 Is the Real Enterprise AI Inflection Year — Not 2025 or 2026
Almost buried in a side answer about forecasting, Sundar gives a remarkably specific prediction: 2027 is when non-engineering enterprise workflows — finance, operations, planning — will shift profoundly to agentic AI. This is a more concrete and actionable timeline than most public commentary offers, and has direct implications for enterprise software investment and workforce planning.
"I definitely expect in some of these areas, 27 to be an important inflection point for certain things. Even the people doing it, that is the workflow through which they would produce it... But I expect 27 to be a big year in which some of those shifts happen pretty profoundly." — Sundar Pichai 00:07:19
For investors, this is a signal: enterprise software companies that are not AI-native by end of 2026 may face sudden displacement in 2027, while companies building agentic workflow infrastructure today are well-positioned.