Teahose.
SIGN IN
NEW HERE — WHAT TEAHOSE DOES
We read the entire AI & tech firehose — so you don't have to.
PODPodcastsAll-In, No Priors, Acquired…
NEWNewslettersStratechery, Newcomer…
PAPPapersPhysical AI research
PHProduct Huntdaily launches
VCInvestor ScoutSequoia, a16z, Benchmark…
CLAUDE DISTILLS →
7 reads, 30 sec each — free, 6 AM ET.
+ a live graph of the companies, people & themes underneath.
HOME/THE A16Z SHOW/Gavin Baker: Why AI Demand Is Ou…
POD
// EPISODE
THE A16Z SHOW

Gavin Baker: Why AI Demand Is Outrunning Compute Supply

DATE August 31, 2026SOURCE THE A16Z SHOWPARTICIPANTS DAVID GEORGE, GAVIN BAKER
// KEY TAKEAWAYS6 ITEMS
  1. 01The AI Ecosystem Is Positive-Sum, Not Zero-Sum
  2. 02AI Demand Is Massively Underpenetrated
  3. 03Sub-One-Year Paybacks on Compute Are Creating a Historic Capital Deployment Opportunity
  4. 04NVIDIA's Vertically Integrated but Horizontally Open Strategy Is Nearly Unassailable
  5. 05The Future of Enterprise AI Is a Hybrid Model Router, Not a Single Dominant Frontier Model
  6. 06Orbital Compute Is a Real Near-Term Business, Not Science Fiction

1. Key Themes

The AI Ecosystem Is Positive-Sum, Not Zero-Sum

Gavin argues that the instinctive framing — that frontier labs, open source, and cloud providers must cannibalize each other — is fundamentally wrong. Multiple layers of the stack can win simultaneously.

"Our friend Eric Vischer did a podcast with Patrick O'Shaughnessy, and he said maybe everyone wins. Anthropic wins. OpenAI wins. SpaceX wins. Meta wins. Google wins by selling a lot of TPUs. Open source wins. Neo clouds win. The inference clouds went on top of the Neo clouds. Applications win." 00:03:18

David George reinforces this when talking to LPs:

"Frontier is going to work really well. N minus one models are going to work really well. Open source is going to work really well. There's going to be a bunch of application companies that work really well. The clouds are probably going to be fine. They're probably going to work really well. The five lab companies are probably going to do really well." 00:08:10

AI Demand Is Massively Underpenetrated — the Real Risk Is Undersupply

Both speakers converge on the idea that despite all the bubble talk, actual heavy AI users are a tiny fraction of the addressable market. The risk most people are pricing wrong is not oversupply — it's undersupply.

"The monetization of these companies, which are doing call it $180 billion of revenue or something in that direction, is on the back of what, like, 30 million actual heavy-paying users? Like, getting real value. I'm talking about, like, developers." 00:14:26

"I might take the under on 30 million, man... There's 1.5 billion knowledge workers. Like, it feels like we're nowhere on the demand side, and we're massively supply-constrained." 00:14:56

Gavin adds a concrete internal data point:

"At Atreides, our internal token consumption has gone up 100x from the month of March. March through August, 100x our token spend. And we just got access to GrokBot Enterprise. And with two people using it, like, it looks like token spend might 10 or 20x in a month." 00:16:28

Sub-One-Year Paybacks on Compute Are Creating a Historic Capital Deployment Opportunity

Gavin makes a precise financial case that the ROI on AI infrastructure is unlike almost anything he has seen in his career, with payback periods well inside a year even on conservative assumptions.

"In my career as an investor, there haven't been that many opportunities where you have companies that could deploy tens, hundreds of billions of dollars and get sub one year paybacks." 00:12:52

He walks through the Nebius math specifically:

"You can kind of get to a nine to 10-month payback for Nebius because, okay, you bring on a gig. It costs $50 billion. You can get an upfront payment for 50% to 60% of that for customers. So now you're talking about $25 or $30 billion. And then you can monetize it if you put it into the spot market." 00:11:44

NVIDIA's Vertically Integrated but Horizontally Open Strategy Is Nearly Unassailable

Gavin explains why Jensen Huang's structural position — locking up supply chain, financing, and ecosystem simultaneously — makes competition extraordinarily difficult, and why the right move for any competitor is cooperation, not confrontation.

"Every 1% share today is probably worth $100 billion. So there's no need to go head on with NVIDIA... He has nine chips. He's got multiple flavors of accelerators. He's got CPUs. He's got Ethernet switches. He has two kinds of DPUs... just try to find a way to plug into his ecosystem." 01:00:55

On NVIDIA's supply chain dominance:

"He's got the fab capacity locked up. He's got DRAM capacity locked up. He's got NAND capacity. He's got laser capacity. He has capacitor capacity... He used to say, if I go back 15 years, he'd say, listen, I'm making a $2 or $3 billion bet every two years. Now he's making these multi-hundred billion dollar bets, bringing the supply chain alongside him." 01:05:52

And on NVIDIA as the financier of the ecosystem:

"Dylan at Semi Analysis talks about how he's the bank of AI. He's like the central bank of AI... NVIDIA data centers are the most financeable. Let's just say a good case for probably TPUs are the second most financeable. It probably takes, I don't know, double the equity check at least." 01:11:28

The Future of Enterprise AI Is a Hybrid Model Router, Not a Single Dominant Frontier Model

Gavin argues the enterprise AI stack converges toward each company owning a fine-tuned open source model, routed alongside one or two frontier models — and that this architecture significantly changes the competitive landscape.

"What you're going to do is you're going to take whatever the best open source model is... you do a lot of RL and supervised fine tuning on your own data. So you own it and it's your model. And then if intelligence is a super important input into your business, you want to own and control your intelligence, its capabilities, its cost." 00:48:31

On Fireworks Nexus as the clearest current instantiation:

"You can choose your frontier model. Let us take whatever open source model you want. RL it for you, for your data, for Goldman Sachs, for Morgan Stanley, for JP Morgan, for Fidelity, for A16Z. You have all your own data. You control your intelligence. And we make it transparent behind a router. I think that is like a very plausible future." 00:53:09

Orbital Compute Is a Real Near-Term Business, Not Science Fiction

Gavin and David discuss SpaceX's orbital data center plans in concrete engineering and economic terms, arguing the economics flip decisively once Starship reusability is proven.

"Let's just say it's $50 billion a gig. And let's just say $35 of that is IT... The rest is power, cooling, labor, all sorts of things that you don't need in space because you have the solar panel and the big radiator... What you have to compare it to is the cost of launch. And with Starship reusability, that goes to under a billion. So the economics just instantly flip." 00:36:59

Gavin cites a specific launch milestone:

"Elon said that he and Jensen have co-designed a Rubin rack. And it's going to launch in the fourth quarter of 27." 00:38:25

Data Centers Are Re-Industrializing America and the Narrative War Is Being Lost

Gavin argues that the tangible local economic benefits of data centers — tax revenue transformation, working-class job creation, re-industrialization — are real and documented, but the industry is failing to tell that story while an organized opposition fills the vacuum.

"You're opposed to data centers. Well, you know what? It's probably the best thing that has ever happened to working class Americans... when a data center goes in, it transforms a town. Like tax revenue, it doesn't double. It's like 10Xs. And it is revitalizing all of these dying small towns all over America." 00:00:32

"There is an organized CCP-funded campaign, I think, against data centers here in America. Like, I think a lot of it gets laundered through TikTok. And it's just tragic because the other thing that's happening is this is re-industrializing America." 00:26:41

Token Pricing Could Go Up, Not Down — the Consensus Is Wrong

The conventional wisdom assumes tokens get relentlessly cheaper. Gavin and David surface the scenario where demand so massively outstrips supply that prices actually rise — a deeply non-consensus view.

"The cost of a token could go up 10x or something like that... which is crazy, but like we do live in a supply demand world. Like it's conceivable if the demand goes massively." 00:30:08

"There's a case you could make that the prices actually of all this stuff go up, which could make the supply side economics even more compelling." 00:14:05

The Training vs. Inference Allocation Decision Creates Unprecedented Revenue Volatility Risk for Public Markets

Gavin identifies a structural feature of frontier lab economics that public market investors are entirely unprepared for: revenue is largely within management's discretion based on how they allocate compute between inference and training.

"Let's say they have a big research breakthrough, and they decide, wow, it is to our long-term advantage to go from eight gigs allocated to inference, two gigs allocated to training, to eight gigs on training, and then your revenue just went from $480 to $120. And I actually think they would do that. They would make that decision. And this is just something that public markets are going to really have to get used to." 00:06:40


2. Contrarian Perspectives

Open Source Tokens Are Not Free — the Cost Equation Is Misunderstood

Most people assume open source = free compute. Gavin calls this out as a fundamental misconception with real economic consequences.

"People have this idea that open source tokens are free. They're not. And it's like it takes the exact same amount of compute, all else equal, to make an open source token as a frontier token for a comparably sized model. It's just a question of what are the margins that are charged on top of that." 00:32:03

He adds a specific contractual detail most investors miss entirely about Llama's license terms:

"The Llama license stipulates a 30% share of any revenue. So Llama has taken a 30% cut of all the revenue generated on its... and this is because it's open weights, not open source." 00:32:13

The Bubble Narrative Is Wrong Because This Buildout Is Mostly Equity/Cash-Flow Funded, Not Debt-Funded

Every prior technology bubble was amplified by debt requiring immediate ROI. Gavin argues the current buildout has a structurally different and safer funding profile.

"Every time you've had a real profound new technology, you get a bubble because the markets get really excited... That overvaluation leads to an overbuild. And then particularly if you're funding it with debt, and even today, a majority of this is still being funded out of operating cash flow, which I think is really helpful. Debt-funded buildouts, they demand immediate ROI, not an ROI in two years." 00:00:00

Data Center Opposition Is Not Organic — It Is a Coordinated Foreign Influence Campaign

Gavin makes a pointed and specific claim that goes well beyond normal tech-policy commentary.

"There is an organized CCP-funded campaign, I think, against data centers here in America. Like, I think a lot of it gets laundered through TikTok. And it's just tragic because... we are re-industrializing America and it's awesome." 00:26:41

The Compute Inequality Narrative Will Be Caused by the People Warning About AI Risks

Gavin inverts the logic of AI critics in a striking way — arguing that the activists most worried about concentrated AI power will, by blocking data center construction, produce exactly the outcome they fear.

"These data center de-growthers may be causing real compute inequality where big companies and wealthy people can afford compute. And then, you know, two years from now, they'll be on about that. And it's like, well, that happened because of you. You wouldn't let us build data centers." 00:30:48

Elon Joining the NVIDIA Ecosystem Instead of Fighting It Was a High-IQ Strategic Move

While most observers frame xAI as an NVIDIA competitor or independent chip developer, Gavin argues the decision to stay within Jensen's ecosystem was the right call for reasons most people haven't worked through.

"Everybody else try and build their own ASIC. They've gotten up on stage. Sometimes they say negative things about Jensen or NVIDIA or take shots... I think it was really smart for Elon instead of competing with somebody who is fully aligned." 01:09:04


3. Companies Identified

NVIDIA

Global leader in AI accelerators and the central infrastructure platform for the AI buildout. Mentioned as the dominant, nearly unassailable player across the entire AI stack — chips, networking, financing, and supply chain. Jensen Huang described as the "Federal Reserve of AI."

"The last 26 years have taught me not to bet against Jensen." 00:08:56 "He's got the fab capacity locked up. He's got DRAM capacity locked up. He's got NAND capacity. He's got laser capacity. He has capacitor capacity... he's making these multi-hundred billion dollar bets, bringing the supply chain alongside him." 01:05:52

SpaceX / xAI

Elon Musk's rocket company (now also operating GrokBot AI via xAI). Mentioned for orbital compute, Starlink, GrokBot's explosive growth, and Elon's strategic decision to co-design a Rubin rack with Jensen rather than compete with NVIDIA.

"Elon said that he and Jensen have co-designed a Rubin rack. And it's going to launch in the fourth quarter of 27." 00:38:25 "GrokBot does feel like another, at least for me, kind of ChatGPT moment." 00:18:27

Anthropic

Frontier AI lab, noted as the "accidental enterprise company" navigating a quiet IPO period while competitors are aggressive. Gavin hypothesizes their conservative compute spending strategy may have cost them relative share.

"Dario said, listen, some people are being super irresponsible with their spending... I'd rather be conservative. And he was conservative. And OpenAI was aggressive. And now OpenAI is back in the game." 00:11:06

OpenAI

Frontier AI lab noted for aggressive compute investment and re-acceleration. Described as more commercially oriented than Anthropic.

"Open AI has clearly accelerated." 00:02:19

Meta

Noted for its open source AI model efforts (Llama) and its track record of coming back into AI competitiveness after appearing to fall behind. Also praised for best-in-class narrative communication strategy around AI's economic benefits.

"Who could have imagined a year ago, when it was like Gemini was a sin deck, that this is the scenario that we're in... Muse and Meta would be significantly ahead of them from a capability perspective." 00:52:09

Fireworks (Fireworks AI)

AI inference and model platform. Identified as the clearest current instantiation of the hybrid model router thesis — allowing enterprises to combine proprietary fine-tuned open source models with frontier models behind a transparent router.

"The best broad instantiation of that today, outside of GrokBot, outside of Cursor... is actually just the Fireworks Nexus product. You can choose your frontier model. Let us take whatever open source model you want. RL it for you, for your data... You control your intelligence. And we make it transparent behind a router." 00:52:39

Nebius

Neo-cloud company that disclosed data center unit economics. Used by Gavin as a concrete financial model to demonstrate sub-one-year paybacks.

"You can kind of get to a nine to 10-month payback for Nebius because you bring on a gig, it costs $50 billion. You can get an upfront payment for 50% to 60% of that for customers." 00:11:44

CoreWeave

Neo-cloud company that alongside Nebius provided key financial disclosures enabling analysis of AI infrastructure payback economics.

"Nebius and CoreWeave both gave some interesting disclosures." 00:11:44

Cursor

AI coding assistant. Praised for being the most product-focused company at the frontier, legging its way into autonomy by meeting customers where they are rather than pursuing AGI narratives.

"Everybody else in the lab space had this, we're creating a digital deity, and AGI and ASI... and the Cursor guys were just like, we want to make great product. And in a strange way, everybody at the frontier, probably Cursor was the most product focused." 00:55:33

Harvey

Legal AI company. Named as the clearest example of vertical AI doing the abstraction layer work well, with legal cited as a sector with unique verifiability advantages.

"Harvey has done an incredible job of this. Legal has sort of been takeoff and I think they can see the future of how to be that abstraction layer and do the work." 00:57:34

Microsoft

Noted for its Copilot/abstraction layer strategy, which has become more viable in a multi-model world. Also noted for "blinking" on CapEx investment and regretting it.

"The world has gotten a lot friendlier for their strategy... I think the future is an ensemble of models. No one model is going to be the best at everything." 00:48:04

Cerebras

AI chip company noted for powering through product-market fit challenges across two chip generations. Used as an illustration of the distinction between chips that technically work vs. chips that find commercial adoption.

"I think each Cerebras chip worked. It just struggled to find product market fit for the first two generations. The chip worked. It just didn't have product work to do." 01:07:52

Databricks

Data and AI platform company identified as one of the key competitors vying to be the enterprise abstraction layer for AI intelligence.

"They're going to be competing with not only the labs to be that abstraction layer, but Databricks." 00:57:34

Palantir

Enterprise AI platform named as another contender for the enterprise AI abstraction layer.

"The inference providers. Fireworks, the inference files. The application companies." 00:57:34

Google / DeepMind

Noted for TPU monetization strategy, potential long-term play as the open-source cashflow funder, and for producing Gemini models used inside GrokBot's routing stack.

"Maybe Google's super long-term play is they seem to have maybe opted out of the frontier race for now. We're going to monetize our compute at high rates and sell TPUs externally, but that generates so much cashflow and open source is getting closer and closer to the frontier." 00:49:00

Blackstone, KKR, Apollo

Major alternative asset managers identified as the sophisticated financiers underwriting AI infrastructure deals at relatively low cost of capital, with specific structural protections.

"I know a lot of smart people who work at Blackstone and KKR and Apollo. And they're the ones that are financing it at a relatively low cost." 00:13:20

Poolside

AI coding startup acquired by NVIDIA. Noted as strategically significant because it brought American open source talent into NVIDIA's ecosystem.

"They paid that Poolside acquisition was made for a reason. Poolside actually had a lot of really good American open source talent." 00:49:28

Kirkland & Ellis

Major law firm cited as validation of the scale of the legal AI market — their $500 million commitment to build internal AI capability signals how large the prize is.

"Kirkland and Ellis said, we're going to spend 500 million bucks to build this ourselves... that actually tells you that the pie is really big." 00:58:30

Cognition

AI coding/agent company briefly mentioned as one of the companies that believes it could become the enterprise abstraction layer.

"I think probably in their heart of hearts, Cognition thinks something like that, too." 00:58:14

Salesforce, Workday, Snowflake

Enterprise software incumbents all named as future competitors in the battle to be the enterprise AI abstraction layer.

"Salesforce, I think is going to, you know, Salesforce and Workday and all these companies. This is like, everybody's going to go after it." 00:59:16

DeepSeek, Kimi, Qwen

The three major Chinese open source AI models noted for evolving in different architectural directions, which Gavin uses to argue for why general-purpose GPUs remain necessary even for specialized inference.

"The three big Chinese open source models, DeepSeek, Kimi, Qwen, they're kind of all evolving in very different ways... they can all run on a more general purpose chip, a GPU. But you're going to need general purposes at a minimum for the types of evolution you see from that." 00:10:23

Town (portfolio company)

A16Z portfolio company working on AI-powered workflow automation and agent orchestration for professional users.

"I have Town doing it as well, which is one of our companies. It's really good at it." 00:19:57

Starlink

SpaceX's satellite internet division. Mentioned for bringing low-cost internet to communities that were never economically viable for traditional connectivity, creating massive consumer surplus.

"Starlink, bringing low-cost internet access to the poorest communities in the world, which is amazing... there was never going to be an economic case to build internet access in those places because of the cost. And now it's there." 00:33:23


4. People Identified

Jensen Huang

CEO and co-founder of NVIDIA. Described throughout as the defining figure of AI infrastructure — the "Michael Jordan" of chips, the "Federal Reserve of AI," and a patriotic American whose business incentives are perfectly aligned with what is good for the country.

"The last 26 years have taught me not to bet against Jensen." 00:08:56 "When the history of the 21st century is written, I think this will be like the age of Elon and Jensen. Because they are fundamentally altering the fabric of human society and civilization." 00:00:00

Elon Musk

CEO of SpaceX, Tesla, and xAI. Discussed for orbital compute strategy, the decision to co-design the Rubin rack with Jensen, GrokBot's rapid growth, and the long-term Mars vision.

"Elon said that he and Jensen have co-designed a Rubin rack. And it's going to launch in the fourth quarter of 27." 00:38:25 "I think it was really smart for Elon instead of competing with somebody who is fully aligned." 01:11:49

Dario Amodei

CEO of Anthropic. Noted for his conservative capital allocation philosophy, his two contrasting essays on AI risk and opportunity, and his call to stop talking about curing cancer and actually cure it.

"Dario said, listen, some people are being super irresponsible with their spending... if you don't spend enough, you could lose a lot of share. But if you spend too much, you could go bankrupt... I'd rather be conservative. And he was conservative. And OpenAI was aggressive. And now OpenAI is back in the game." 00:11:06

Satya Nadella

CEO of Microsoft. Discussed for his CapEx hesitation ("blinking") and his framing of the future as "specialized intelligence."

"Satya really regrets that, I think. Yeah, yeah. He kind of blinked, I think it was last year... I think they blinked a little. They slowed down. They regret that." 00:10:43

Eric Vishria

Partner at Benchmark. Credited with the insight on the Patrick O'Shaughnessy podcast that "maybe everyone wins" in AI.

"Our friend Eric Vishria did a podcast with Patrick O'Shaughnessy, and he said maybe everyone wins." 00:03:18

Brad Gerstner

Investor and founder of Altimeter Capital. Quoted for the observation that orbital compute is happening in plain sight and nobody is paying attention.

"As Brad Gerstner says, like, nobody's really paying attention to this. And it's like kind of happening in plain sight." 00:38:25

Dylan Patel

Founder of SemiAnalysis. Credited with the framing of Jensen Huang as "the bank of AI" / "the Federal Reserve of AI."

"Dylan at Semi Analysis talks about how he's the bank of AI. He's like the central bank of AI." 01:11:28

Lynn (Fireworks AI)

CEO of Fireworks AI (Lynn Doong). Credited as the originator of the hybrid model router thesis before Microsoft and Palantir adopted their own versions.

"That's clearly what Lynn from Fireworks, she was the first one to say it. And then Alex Karp and Satya, they both kind of took their own version of it." 00:53:09

Alex Karp

CEO of Palantir. Noted for independently arriving at a version of the hybrid intelligence/model router thesis.

"That's clearly what Lynn from Fireworks, she was the first one to say it. And then Alex Karp and Satya, they both kind of took their own version of it." 00:53:09

Sholto Douglas

Researcher at Anthropic. Mentioned in the context of a public X exchange with Gavin Baker and Dario Amodei about AI messaging and risk narratives.

"I had this exchange with Sholto from Anthropic and Dario on X last weekend." 00:22:39

Jeff Bezos

Founder of Amazon. Quoted for his long-standing vision of earth being "zoned residential" with all heavy industry moving to outer space.

"Jeff Bezos said something very interesting. He said, I think in the future, earth is going to be zoned residential... all heavy industry will take place in outer space." 00:45:28

Sheryl Sandberg

Former COO of Meta. Praised for establishing Meta's practice of telling specific small-business impact stories on earnings calls — a communications playbook Gavin says the entire AI industry should adopt.

"Sheryl Sandberg would run through 10 or 15 very specific small businesses that had started using Meta's advertising products and the impact it had on that business... And they would just run through that every time." 00:27:57

Patrick O'Shaughnessy

Host of the Invest Like the Best podcast. Referenced twice — once as the host of the Eric Vishria "everyone wins" conversation, and once as the host of a prior podcast Gavin did five months earlier where he discussed AI tools.

"I went on this Patrick O'Shaughnessy podcast, like, five months ago. And I said, I love having a podcast summarizer." 00:18:00

Eliezer Yudkowsky

AI safety researcher. Briefly referenced as a representative of the most extreme AI doom narrative, used as a foil for the optimistic case.

"That Eliezer Yudkowsky guy says, if we build it, everyone will die. And it's like, how about if we build it, we're going to cure cancer. We're all going to live forever." 00:23:07


5. Operating Insights

GrokBot Agents Can Replace Hours of Claude Code Work in Seconds — Audit Your Tooling Stack

Gavin provides a specific operational data point: tasks he built over hours in Claude Code were replicated in 7-12 seconds in GrokBot — better and faster. The implication for operators is to continuously horse-race AI tools rather than institutionalizing any one, and to specifically test GrokBot Enterprise for knowledge worker productivity.

"All of those would have taken me, I don't know, hours working with Claude Code. And they each took 7 to 12 seconds with GrokBot. And it's better." 00:18:27

"I now have it. I'm horse racing all these, which is, like, I have GrokBot doing it, Codex doing it, all the action taking for it. I just want to know, make me better at my job." 00:19:57

Measure AI ROI as Token Spend as a Percentage of Human Compensation

David George surfaces a specific internal benchmark across the A16Z portfolio: AI-native companies spend 10%+ of human compensation on tokens; old economy companies doing a good job spend ~1%. This is a practical yardstick for evaluating AI adoption maturity in portfolio companies or your own organization.

"High single digits, some at 10%. Like, some of the very AI-native ones, like, 10% plus. And so old economy companies are spending the ones that are probably doing a good job, like, 1%." 00:15:55

When Evaluating Chip Companies, Read the Deal Structure to Infer True Customer Preference

Gavin lays out a specific analytical framework: in a supply-constrained environment where customers "will take anything," the actual deal structure (equity investment, RVG, warrants tied to token performance, or straight warrants) reveals true underlying preference when usage data cannot.

"You can kind of look at that hierarchy of deals and like infer something about true customer preferences... If you just give warrants away, it could be negative in NPV because the better the stock does, the worse the deal is. The more value that's captured by the person." 01:00:03

Value Hyperscalers on EV to Net PP&E, Not Traditional Multiples

Gavin proposes a specific valuation framework for AI infrastructure companies: net PP&E is essentially a proxy for compute fleet, and EV/net PP&E functions as an AI-era price-to-book — surfacing inefficiencies invisible in traditional revenue-based multiples.

"I increasingly look at these hyperscalers on EV to net PP&E. Because net PP&E is compute, and that is just what the market thinks you're going to monetize your fleet of compute at. And you can kind of look at them, and there's some pretty obvious inefficiencies to it. Kind of an AI version of price to book." 00:59:45


6. Overlooked Insights

NVIDIA Is Training Its Own Open Source Frontier Model — and This Could Reshape the Entire Competitive Landscape

Gavin mentions almost in passing that he expects NVIDIA, via its NemoTron model and the Poolside acquisition, to produce an open source model that gets "really close to the frontier." This is not framed as a prediction anyone is paying attention to, but the implications are enormous: the chip company that supplies everyone becomes the model company that trains the base model everyone else fine-tunes. It would make NVIDIA the de facto standard at every layer of the stack simultaneously — silicon, system, and model.

"I think probably in the very near, near future, that's going to be an NVIDIA model... In a world where open source wins, who funds the training? Well, the chip companies could fund the training. It's trivial to do a $50 to $100 billion training run for Jensen. And maybe soon... that is really good for Microsoft." 00:48:31 "They paid that Poolside acquisition was made for a reason. Poolside actually had a lot of really good American open source talent." 00:49:28

If accurate, every enterprise that adopts the "fine-tune an open source base model" strategy described by Gavin would be starting from an NVIDIA-trained model — deepening NVIDIA's lock across infrastructure, software, and model IP simultaneously.

Llama's License Demands a 30% Revenue Share — Almost Nobody in the Industry Knows This

In a single sentence, Gavin reveals that Meta's Llama license is not truly "open source" — it is "open weights" — and that it contains a provision requiring a 30% share of any commercial revenue generated on top of the model. This is almost never discussed in mainstream coverage of the open source AI debate, and it has major implications for any company building a commercial product on Llama assuming it is free. The economics of "open source AI" are materially different from what the market believes.

"The Llama license stipulates a 30% share of any revenue. So Llama has taken a 30% cut of all the revenue generated on its... and this is because it's open weights, not open source." 00:32:13