Teahose.
SIGN IN
NEW HERE — WHAT TEAHOSE DOES
We read the entire AI & tech firehose — so you don't have to.
PODPodcastsAll-In, No Priors, Acquired…
NEWNewslettersStratechery, Newcomer…
PAPPapersPhysical AI research
PHProduct Huntdaily launches
VCInvestor ScoutSequoia, a16z, Benchmark…
CLAUDE DISTILLS →
7 reads, 30 sec each — free, 6 AM ET.
+ a live graph of the companies, people & themes underneath.
HOME/THE A16Z SHOW/Can Anyone Catch NVIDIA? | The F…
POD
// EPISODE
THE A16Z SHOW

Can Anyone Catch NVIDIA? | The Future of Chips and Infrastructure

DATE July 15, 2026SOURCE THE A16Z SHOWPARTICIPANTS DYLAN PATEL, ERIK TORENBERG, ERIN PRICE-WRIGHT, GUIDO APPENZELLER
// KEY TAKEAWAYS6 ITEMS
  1. 01NVIDIA's Moat Is Multidimensional and Nearly Impossible to Replicate
  2. 02AI Value Creation Already Exceeds Spend
  3. 03OpenAI's Router Is the Key to Monetizing Free Users
  4. 04Power Infrastructure Is the True Bottleneck for U.S. AI Buildout
  5. 05Custom Silicon Will Only Succeed at Scale if AI Remains Concentrated
  6. 06The AI Model Design-Silicon Co-Evolution Problem Creates Perpetual Moving Targets

1. Key Themes

NVIDIA's Moat Is Multidimensional and Nearly Impossible to Replicate

NVIDIA's dominance isn't just about chip performance — it's a compounding advantage across supply chain, software ecosystems, networking, memory, process node access, and time-to-market. Competitors must be 5x better on hardware just to break even after NVIDIA's advantages erode the lead.

"You have to be like 5x better. Because the supply chain stuff means that 5X actually turns into a 2.5X, and then NVIDIA can compress their margin a little bit if you're actually competitive, and then that 2.5X becomes like a 50% better." [00:32:02]

"NVIDIA is going to have better networking than you, they're going to have better HBM, they're going to have better process node, they're going to come to market faster, they're going to be able to ramp faster, they're going to have better negotiations with whether it's TSMC or SK Hynix... so you have to be like 5x better." [00:31:33]

AI Value Creation Already Exceeds Spend — But Value Capture Is Broken

The fundamental issue isn't whether AI creates value — it demonstrably does — but that the companies building it are capturing only a tiny fraction of the value they generate, creating a structural business model problem.

"AI is already generating more value than the spend. It's that the value capture is broken. I legitimately believe OpenAI is not even capturing 10% of the value they've created in the world already." [00:16:38]

"The value capture is just harder and harder and harder for these companies, because they're making, you know, 50% gross margin on inference if they're, you know, or less in many cases." [00:17:37]

OpenAI's Router Is the Key to Monetizing Free Users

The GPT-5 launch's most significant innovation isn't model quality — it's the routing infrastructure that enables OpenAI to dynamically allocate compute by query value, unlocking a new monetization layer from free users through commerce and agentic actions.

"If they ask, what's the best DUI lawyer near me, right? All of a sudden, this is like, you know, you're in jail, you have one shot... the model's not capable of it today. But soon enough, it'll be able to contact all the lawyers in the area and figure out what their results are and maybe search their court filings and whatever, right? Book the best lawyer for you or an airplane ticket." [00:05:50]

"Etsy, 10% of their traffic now comes from chat. And OpenAI makes nothing off of that. But they really, really will soon." [00:06:33]

Power Infrastructure Is the True Bottleneck for U.S. AI Buildout

Despite massive capital commitments, U.S. AI expansion is physically constrained by power availability, grid interconnection timelines, and skilled labor — not capital or chip supply. Chips are sitting idle waiting for data centers to come online.

"Companies like CoreWeave, you know, why is CoreWeave valuable? It's really because they build infrastructure really fast... They grew more aggressively. And they'll go anywhere." [00:39:18]

"Companies that were like, they would like, you know, Jensen keeps saying he couldn't give away H20 in America for free, but I've literally heard companies now say, yeah, no, I wouldn't because I only have this much power... if I bought H20, I'd literally have less compute capacity and then I'd lose, right? Even if it was free." [00:34:38]

"Electrical contractors, electricians in Texas, if you're willing to be a travel electrician, it's like oil pay... your pay is up like 2x now versus what it was just a few years ago." [00:41:32]

Custom Silicon Will Only Succeed at Scale if AI Remains Concentrated

The viability of hyperscaler custom silicon (Google TPUs, Amazon Trainium) depends heavily on whether AI workloads remain concentrated among a few large players. Fragmentation driven by open-source models benefits NVIDIA, not custom silicon.

"If AI is concentrated, then custom silicon will do better... but if it gets dispersed broadly because there's all these open source models from China, and there's all these open source software libraries from NVIDIA and China... then potentially NVIDIA will remain the most valuable company in the world for a long period of time." [00:20:22]

The AI Model Design-Silicon Co-Evolution Problem Creates Perpetual Moving Targets

Chip startups face an unsolvable problem: by the time they design and tape out a chip optimized for current model architectures, the models have evolved, often in directions that make the chip's design choices wrong.

"The software is evolving constantly because of what works best on NVIDIA, and you see that whether it be what DeepSeek's doing or Alibaba's doing or what the labs are doing internally... DeepSeek or go look at what the labs are doing, actually their shapes are much smaller, actually you need to do a bunch of small matrix multiplies, not massive, massive, massive singular matrix multiplies per layer, and then it ends up, oh, well that chip you're designing for that is actually not super effective for that." [00:30:02]

Intel's Survival Depends on Operational Execution, Not Corporate Restructuring

Despite widespread calls to split Intel's design and foundry businesses, doing so would consume all executive bandwidth and likely bankrupt the company before the split creates value. The real fix is aggressive internal talent culling and execution speed improvement.

"The process of splitting it would take so much executive time and so much executive effort that you would have been bankrupt by then." [00:48:42]

"Intel's problem is that like it takes them five to six years to go from design to shipping the product in some cases more and when they tape out a chip right they go through 14 revisions in some cases where it's like the rest of the industry goes through like one to three." [00:49:12]

Microsoft Is Dangerously Mis-Executing Across Every AI Vector

Despite having every structural advantage — the best IDE, the biggest enterprise sales force, exclusive OpenAI access, and first-mover position — Microsoft is losing ground in AI infrastructure, models, cloud share, and developer tools simultaneously.

"GitHub Copilot is failing, Microsoft Copilot is still crap. It's like what is going on... they end up not having the actual product to sell them which is really scary." [01:02:46] — [01:03:16]

"They were going to be the largest infrastructure company in the world by a factor of 2x... they're losing grasp on OpenAI, their internal model efforts are failing spectacularly... Azure is losing a lot of share to Oracle and CoreWeave and Google." [01:01:32]


2. Contrarian Perspectives

Selling H20s to China Creates More Value for China Than Selling Chips Does for NVIDIA

The conventional framing is that export controls protect the U.S. by limiting China's AI hardware access. Dylan argues the opposite: giving China access to inference-capable chips creates far more economic value for China than the chip revenue creates for the U.S., especially since AI services — not hardware — capture the real economic surplus.

"If you believe the models deliver more economic value to society than the hardware, which I actually think they do, it's just there's a value capture problem today, then you're giving China way more by giving them H20s and soon a version of Blackwell that's cut down... The economic value derived from selling the chips is not as large as being able to somehow sell them AI services." [00:36:28]

TSMC Could Charge Far More and Chooses Not To — A Strategic Anomaly

TSMC operates as a true monopoly on leading-edge silicon and yet raises prices only 3–10% annually. This restraint is cultural, not economic. If managed differently, TSMC could extract dramatically more value — a profound misalignment between market power and pricing behavior.

"TSMC is a monopoly. Like they could raise a lot more but they're good Taiwanese people rather than like dirty American capitalists. If TSMC was owned or managed by Americans I think most ownership is actually American in terms of the stock... they would have raised prices a lot more." [00:47:42]

Google Should Sell TPUs on the Open Market — It Could Be Worth More Than Their Entire Business

The idea that Google's internal chip operation could, if restructured to sell externally, eclipse the value of Alphabet itself is a radical but logical claim given NVIDIA's current market cap exceeding Google's.

"I absolutely think so. I think Google's even discussing it internally. I think it would require a big reorg of culture... I totally think Google should sell TPUs externally. Not just renting, but like physically." [00:21:18]

"It's kind of funny if a side hobby in theory has a higher company value potential as your entire business, especially as you think about the degradation of search as a core business." [00:21:47]

Dispersed AI (Open Source Proliferation) Paradoxically Helps NVIDIA, Not Hurts It

Most observers assume open-source model proliferation threatens NVIDIA by enabling more custom silicon deployments. Dylan inverts this: fragmented AI workloads are harder to serve with custom silicon (which requires concentrated, predictable workloads) and actually entrench NVIDIA's general-purpose architecture.

"If AI is really concentrated, then they'll do better, custom silicon, but if it gets dispersed broadly because there's all these open source models from China, and there's all these open source software libraries... it makes the deployment costs like rock bottom, then potentially... NVIDIA will remain the most valuable company in the world for a long period of time." [00:20:22]

Speed of Data Center Deployment Outweighs Optimization of Data Center Economics

The common view is that overspending on data center infrastructure (e.g., using expensive generators instead of grid power) is waste. Dylan argues getting compute online even three months earlier is worth far more than any infrastructure cost savings, fundamentally reframing data center economics around time, not capital efficiency.

"What Elon did would seem silly, right? They spent a lot more money on generators outside the data center and these mobile chillers to cool the water down for their liquid cooling instead of like the more cost-effective option because it got the data center up three months faster. And so like that three months of additional training time is worth way, way, way more on a TCO basis." [00:46:23]


3. Companies Identified

NVIDIA

The dominant AI chip company; most valuable company on the planet. Discussed as having near-unassailable competitive advantages across hardware, software, supply chain, and ecosystem. Dylan recommends Jensen use NVIDIA's massive cash balance (projected >$100B by year end) to accelerate investment into the data center infrastructure layer.

"NVIDIA is going to have better networking than you, they're going to have better HBM, they're going to have better process node, they're going to come to market faster, they're going to be able to ramp faster, they're going to have better negotiations with whether it's TSMC or SK Hynix." [00:31:33]

CoreWeave

AI cloud infrastructure company; went public in what was described as the biggest AI IPO so far. Praised for aggressive, flexible data center build-out, willingness to deploy anywhere, and speed of infrastructure delivery.

"CoreWeave doesn't care, right? They're like, oh, crypto data center, I will convert it to AI data center... companies like CoreWeave and Oracle are moving to... actually today, Google just bought 8% of a crypto mining company called Terrawulf, right? Not because they're getting into crypto mining. Because they need the data centers." [00:39:50]

Cursor

AI code editor. Called out as having rapidly surpassed GitHub Copilot on ARR in a fraction of the time, and cited as evidence of how fast value is moving in the developer tools space.

"Cursor, you know, easily surpassed that. And then like, even like companies like Replit are like, and Windsurf slash Cognition are like, going to pass them. Like, it's like, you're preaching to the choir." [00:15:14]

Anthropic

AI lab, fully B2B-focused. Noted for having more compute-efficient thinking models than OpenAI's early reasoning models, and for their partnership with Amazon on Trainium. Cited as an example of subscription pricing creating negative gross margin issues with power users.

"When you look at Anthropic's thinking models, even when you put them in thinking mode, they think a lot less, right? To get to the same results or better results, right? As OpenAI was." [00:02:55]

Google / DeepMind

Highlighted for TPU infrastructure (described as 100% utilized), Gemini models, and the potential to sell TPUs externally as a business that could exceed Alphabet's current valuation. Sergey Brin noted as actively working within DeepMind.

"Amazon is making millions of Trainium, Google's making millions of TPUs. TPUs clearly are like 100% utilized." [00:19:52]

TSMC

The world's leading semiconductor foundry; described as a monopoly on leading-edge process technology. Called out for strategically under-pricing its monopoly position.

"TSMC is a monopoly in some extent... TSMC is a monopoly, like they could raise a lot more but they're good Taiwanese people rather than like dirty American capitalists." [00:47:12]

Meta

Praised for aggressive GPU and data center investment (building "tents" to deploy faster), growing CapEx, and serious experimentation with generative AI ads. Cited as one of the few hyperscalers executing well on infrastructure and open-source strategy.

"Meta's upping hugely. Google's upping hugely." [00:13:03]

"Meta is now building these effectively tents." [00:38:36]

ByteDance

Cited as either the largest or second-largest customer of Google Cloud, renting significant Blackwell GPU capacity. Highlighted as an example of Chinese companies accessing best-in-class Western compute infrastructure offshore.

"ByteDance is either the biggest or the second-biggest customer of Google Cloud for a reason, and they're getting many, many Blackwell from them, right? And the same with Oracle and the same with Microsoft." [00:43:00] — [00:43:05]

Etched

AI chip startup. Mentioned for raising significant capital without yet having launched a chip publicly — cited as evidence of the extraordinary capital appetite in silicon startups.

"Companies like Etched and Rivos and a number of other companies, you know, Madax and others like have gotten the amount of funding they've had without even launching a chip, right?" [00:24:44]

Grok (Groq)

AI inference chip company (older generation of chip startups). Cited as an example of companies that over-indexed to model architectures that were leading at design time but became misaligned as models evolved.

"You look at Grok, Cerebras, Sambanova, they all sort of over-indexed to the models that were leading at the time when they designed their chips." [00:28:41]

Cerebras

AI chip company. Same context as Groq — made design trade-offs (more on-chip SRAM, less DRAM, less compute) that were rational at the time but became misaligned with growing model sizes.

"I have no doubt that Cerebras would run certain types of models better than NVIDIA or Grok." [00:29:02]

Terrawulf

Crypto mining company. Google recently purchased an 8% stake — not for Bitcoin mining but to access powered data center infrastructure.

"Google just bought 8% of a crypto mining company called Terrawulf, right? Not because they're getting into crypto mining. Because they need the data centers, right? They want the power." [00:39:50]

Semi Analysis

Dylan's company. Highlighted as an example of extreme leverage from AI: a four-developer team uses Gemini API at very low cost to automatically process every data center permit and regulatory filing, analyze satellite photos, identify equipment, and track construction progress worldwide.

"We go through every single permit and regulatory filing around every single data center with AI. And it's like, and we take satellite photos of every data center and we like, we're able to label our data set and then recognize what generators people are using, what cooling towers and the construction progress and substation. All this stuff is like automated and it's only possible because of Gen AI." [00:17:08]

Huawei

Chinese chip company. Described as still slightly behind NVIDIA's H20 in AI chip capability, but the likely beneficiary of export controls that prevent NVIDIA from selling into China, since those controls push Chinese companies to build out Huawei's software ecosystem.

"By NVIDIA selling GPUs, NVIDIA's argument again was like, they were able to stop Huawei from building up a software ecosystem. And the Western ecosystem is better." [00:35:58]

xAI

Elon Musk's AI company. Praised for the speed of its Memphis data center deployment (using generators and mobile chillers to get online three months faster), but noted for internal tension over certain product decisions driving talent loss.

"What Elon did would seem silly, right? They spent a lot more money on generators outside the data center and these mobile chillers... because it got the data center up three months faster. And so like that three months of additional training time is worth way, way, way more on a TCO basis." [00:46:23]

Replit / Windsurf / Cognition

Developer AI tool companies. Mentioned in the context of rapidly catching or surpassing GitHub Copilot in ARR, illustrating the pace of disruption in the coding tools market.

"Even like companies like Replit are like, and Windsurf slash Cognition are like, going to pass them." [00:15:14]

Amazon / AWS

Discussed for Trainium custom silicon investment (making millions of chips), noted that utilization is not yet at TPU levels but expected to improve with Anthropic's help. Also cited as blocking ChatGPT from their shopping ecosystem.

"Amazon is making millions of Trainium... Trainium's not there, but I think Amazon will figure out how to do that and Anthropic will." [00:20:22]

Oracle

Cited alongside CoreWeave as aggressive, flexible infrastructure builders willing to deploy compute capacity rapidly and grow CapEx beyond what pure economics might justify.

"Companies like CoreWeave and Oracle, because they're tapping capital markets, can raise way more than 20 to 30% CapEx." [00:18:29]

Intel

Major semiconductor company discussed extensively as at risk of bankruptcy without capital infusion. Seen as strategically critical for U.S. national security as a non-TSMC option for leading-edge fabrication, but operationally dysfunctional.

"Intel is literally going to go bankrupt if they don't have a big cash infusion or they lay off half the company." [00:52:55]


4. People Identified

Dylan Patel

Co-founder of Semi Analysis, the leading independent research firm covering AI hardware, semiconductors, and data center infrastructure. Cited throughout as the primary expert voice on chip economics, NVIDIA's competitive position, and infrastructure bottlenecks.

"I think Dylan, you've done an exceptional job in covering what's happening in the AI hardware space, AI semi-space, and now more and more data center space as well." [00:01:19]

Jensen Huang (NVIDIA)

CEO of NVIDIA. Discussed in terms of strategic advice: deploy the company's massive cash position (projected >$100B by year-end) into the data center infrastructure layer rather than buybacks.

"Jensen keeps saying he couldn't give away H20 in America for free, but I've literally heard companies now say, yeah, no, I wouldn't because I only have this much power." [00:34:38]

"The cash on their balance sheet keeps growing and they're going to have north of a hundred billion dollars of cash on their balance by the end of this year." [00:55:57]

Lip-Bu Tan (Intel CEO)

Described as one of the greatest semiconductor investors ever. Praised specifically for bypassing Intel's organizational hierarchy to directly identify and remove underperforming individuals, which Dylan sees as the right approach to fixing Intel's execution culture.

"He's one of the greatest semiconductor investors ever right he's invested in so many different companies... he recognizes the companies like he understands the supply chain... he had never talked to the guy because it was four layers down the company has absurd amounts of hierarchy, it's like four layers down he goes and talks to the guy and he's out." [00:48:42]

Sergey Brin (Google)

Google co-founder. Noted as actively working within Google DeepMind, driving a harder push on AI model development after some internal reorganization.

"Sergey works within DeepMind a lot and they're driving hard, they're still a little bit behind." [00:57:49]

Elon Musk (Tesla / xAI)

Discussed primarily in the context of xAI's rapid data center deployment (using unconventional methods to get online faster) and Tesla's Dojo chip program. Described as a talent magnet but someone whose impulsive decisions are currently hurting xAI.

"Elon is a magnet to amazing talent and building stuff so I won't bet against him but it seems like since he left the administration and focused on stuff again... I think he's focused on a lot of things." [01:03:19]

Sam Altman (OpenAI)

Referenced in the context of strategic advice — Dylan would recommend immediately launching a commerce/agentic take-rate product — and for shifting his stance on advertising from firmly opposed to more open.

"He shifted his tone massively on like ads over the last six months, right? He used to be like, no way. And now he's like, maybe, you know, there's a way to do it without harming the user." [00:12:16]

Andrej Karpathy

Cited for a key conceptual framework about agentic systems: the loop between model inference and user feedback/verification is the fundamental design problem for agentic UIs. (Referenced as "Andrew Parthy" in transcript — corrected.)

"Andrej Karpathy has this great slide where he basically says, if you're building an agentic system today, right? But fundamentally what it is is of this loop, right? Where half of the loop is the model thinking, right? And the other half is then the user verifying what did the agent do." [00:09:50]

Howard Lutnick (U.S. Commerce Secretary)

Referenced in the context of export controls and supply chain policy for rare earth minerals and AI chips.

"Lutnick himself said we had to do this for rare earth minerals." [00:33:53]


5. Operating Insights

Use AI for Deep, Repetitive Research Workflows at a Fraction of Normal Cost

Semi Analysis demonstrates that a four-person team can run what would otherwise require a large analyst operation — processing every data center permit, regulatory filing, satellite image, and equipment identification globally — using Gemini API at extremely low cost. The key is designing AI into the core research workflow rather than using it as a writing assistant.

"We go through every single permit and regulatory filing around every single data center with AI. And it's like, and we take satellite photos of every data center and we like, we're able to label our data set and then recognize what generators people are using, what cooling towers and the construction progress and substation. All this stuff is like automated and it's only possible because of Gen AI. But we do it with like very few developers." [00:17:08]

Route Users to Expensive AI Only When the Query Has High Economic Value

The OpenAI router strategy is a direct operating template: don't treat all user queries as equally expensive to serve. Build routing logic that identifies which queries justify full model compute (high-intent commercial, agentic actions with monetization) versus which can be handled with cheaper models.

"If the user asks a low value query, hey, why is the sky blue? Just route them to mini, right? The model can answer perfectly fine. And that is a chunk of queries, right? But if they ask, what's the best DUI lawyer near me... all of a sudden the model's not capable of it today. But soon enough, it'll be able to contact all the lawyers in the area." [00:05:50]

Subscriptions Create Stickiness — But Usage-Based Pricing Is Where Economics Force You

For companies building AI products, there is a real tension: subscriptions lock users in and create stickiness (especially valuable given how much UI/UX workflow integration matters for agentic tools), but the underlying cost structure of AI — with 20x variability in usage between light and heavy users — makes flat pricing economically dangerous.

"I think with consumers, it's frankly very hard to not have usage-based pricing just because the variability is so massive, right? If it's us coding versus somebody who does this as their full-time job, right? You just have a factor of 20 or so difference in usage. That costs a lot of money." [00:11:07]

Time-to-Market on Infrastructure Beats Cost Optimization — Always

For companies building or leasing AI compute infrastructure, the opportunity cost of idle chips far exceeds any efficiency gains from optimizing infrastructure costs. Getting compute online faster — even at higher capex — is almost always the right call.

"That three months of additional training time is worth way, way, way more on a TCO basis, right? The performance you got out of the chips and the time to market and all this is way, way faster and therefore it was the right decision even though this part of the data center bloomed at cost." [00:46:23]


6. Overlooked Insights

China's Hyperscalers Are Renting Western Blackwell Clusters at Scale — Export Controls Are Partially Moot

The most quietly explosive claim in the entire conversation is that ByteDance is one of Google Cloud's largest customers specifically to access Blackwell GPUs, and that Chinese companies are systematically renting best-in-class Western compute offshore rather than building domestically. This means U.S. export controls on chip sales are being circumvented not through smuggling but through entirely legal cloud rental — and the hyperscalers are profiting from it.

"ByteDance is either the biggest or the second-biggest customer of Google Cloud for a reason, and they're getting many, many Blackwell from them, right? And the same with Oracle and the same with Microsoft and all these other companies are renting tons of chips to China anyways, because it's more cost-effective to do that than build it yourself." [00:43:00]

This is a massive policy, regulatory, and investment insight that passed without any of the hosts pressing on it. If accurate, it means: (1) export controls are structurally leaky through cloud rental; (2) hyperscalers face a future regulatory risk if this is closed; and (3) any company building offshore cloud infrastructure in neutral jurisdictions (Singapore, UAE, etc.) has a strategically valuable asset for Chinese enterprise demand.

The New Trump Tax Bill's Immediate GPU Depreciation Is a Hidden Accelerant for AI CapEx

Dylan mentions almost in passing that the new tax legislation allows full depreciation of GPU cluster costs in year one — and that this alone is worth $10 billion annually to Meta and comparable amounts to each major hyperscaler. This is a massive, underappreciated fiscal stimulus for AI infrastructure investment that has received almost no attention relative to its scale.

"The new Trump tax bill institutes something really incredible which is you can depreciate all of the GPU cluster costs in year one which we put out a note about how the tax implications to Meta are $10 billion a year and across each of the major hyperscalers it's massive." [00:54:28]

This functions as an enormous hidden subsidy for AI infrastructure investment — potentially adding tens of billions of dollars annually in accelerated AI CapEx across the hyperscalers, compounding NVIDIA's revenue visibility and making infrastructure-adjacent investments (power, data centers, networking) more attractive than the headline CapEx numbers alone suggest.