The State of AI: Macro, Apps, and Consumer
- 01The Case for Radical Optimism
- 02Most Moats Are Intact
- 03Frontier Tokens for Unbounded Jobs, Open-Weight Models for Bounded Jobs
- 04AI Models Are Not Commodities
- 05Labs Are Vertically Integrating Down, Not Up
- 06Intelligence Is a Primitive
Speakers: Anish Acharya (a16z GP, Consumer) and Jen Kha (a16z GP)
1. Key Themes
The Case for Radical Optimism — Not Bubble Paranoia
The more contrarian and under-discussed risk isn't a bubble, it's that investors are insufficiently optimistic. Anish points to GPU pricing as a non-obvious signal: commodity hardware getting more expensive, not less, is a powerful indicator of demand vastly outpacing supply.
"The out-of-distribution topic that's less discussed is what if we're insufficiently optimistic? And if you look at some of the underlying indicators, what they point to is essentially infinite demand and highly constrained supply. Things like B200, which is a non-cutting-edge GPU, prices going up on a per-hour basis. That is very strange. Normally we see these things be highly deflationary." [00:04:15]
Most Moats Are Intact — Only One Is Seriously Threatened
Despite widespread fear that AI destroys competitive moats, Anish argues this is largely wrong. Network effects, scale effects, and brand moats are unaffected. The one moat genuinely at risk: the integration moat, historically exploited by enterprise software vendors like SAP and the SIs that surround them.
"The integration moat is the most obvious one. And SAP is so famously complex to integrate into and out of that it's a sort of existential risk to even migrate from one version of SAP to the next. Coding agents makes this dramatically better. I think there's a bit of an existential question, actually, for SIs and GSIs as to what will their value be when they've historically been this sort of point of integration." [00:06:34]
Frontier Tokens for Unbounded Jobs, Open-Weight Models for Bounded Jobs
A clear and actionable framework emerges for enterprise AI architecture: use the most expensive frontier models for functions with unlimited upside (sales, product, engineering), and open-weight fine-tuned models for functions where the ceiling on value is defined (finance, legal compliance, HR).
"For jobs that have unlimited upside, like sales or product, you always want to use frontier tokens. And the reason for that is you just don't know what the value of the new product feature or closing a customer account is. It's effectively unbounded... Conversely, when you talk about something like finance, the best way to close the books is accurately. You can't close it 10x better than accurately. So it makes sense to use open-weight models with reinforcement learning for the kind of Pareto-efficient cost curve." [00:07:25]
AI Models Are Not Commodities — They Have Distinct Cognitive Personalities
Anish introduces a framework borrowed from psychology: AI models differ in Big Five personality traits. Some models are "neurotic" (literal, precise, rule-following — e.g., GLM-5-2 and GLM-5-3); others are "open" (creative, presumptuous — e.g., Kimi K3). Enterprises will need both types, just as they need different human personalities for different roles.
"You see a certain set of models that have a high degree of neuroticism, like they're sort of autistic models. GLM-5-2 and GLM-5-3 are great examples of this, where they're very literal and they'll only do exactly what you told them to do and nothing more. Then we're seeing models like Kimi K3 that are just much more open, and they're very presumptuous, and they're creative. And there are roles for both types of models in the organization." [00:08:57]
Labs Are Vertically Integrating Down, Not Up — Application Layer Is Safe
The feared scenario of AI labs eating the application layer has inverted. Labs are integrating downward into inference and compute, not upward into apps, because inference workloads are homogeneous and scalable, while the application layer is heterogeneous, OPEX-heavy, and requires deep market-specific product work.
"Yes, they are vertically integrating, but they're vertically integrating down into inference and compute. It's actually logical now, in hindsight, because the workloads for inference are very homogeneous. So you can build enormous scale in one part of the value chain. Whereas when you think about the application layer, you've got so many idiosyncrasies and unique needs in terms of pricing, packaging, productization, how the market wants to buy. So it's actually a much more challenging and OPEX-heavy proposition to move into the application layer." [00:10:48]
Intelligence Is a Primitive — The Application Layer Is Its Productization
The application layer's job is to convert the raw intelligence primitive into economic outcomes for specific market segments, just as Salesforce converted AWS compute into CRM. This reframe elevates app companies from "wrappers" to essential value-creation infrastructure.
"It's great to have the raw intelligence primitive, but you really need Harvey to turn that into an economic outcome for the legal industry... The application layer's opportunity is to be the one that kind of delivers that." [00:15:05]
Consumer AI Is Finally Having Its Moment — Three Structural Barriers Are Falling
Anish identifies three reasons consumer AI has lagged: high marginal inference costs, no AI-native distribution channel (no "app store for AI"), and poor UX/design (the "DOS era" of AI). All three are now improving simultaneously, especially as open-weight models collapse per-user onboarding costs.
"I built an app I use to help me browse my X timeline and it costs $250 to onboard a new user... That is changing now because of open-weight models, dramatically cheaper and more performant. The second is we've never had an AI native distribution channel. There's no app store for AI... We're sort of in the DOS era of AI and for this technology to fully be embraced by consumers, we're going to need the Windows, so to say." [00:18:00]
Personal Agents as Compounding "Tenured Employees"
The mental model for personal agents is not a tool but a tenured employee: they compound in value as they accumulate memory and context. The longer a consumer uses the agent, the more pricing power the product earns and the higher the retention.
"The new hire may be brilliant, it may even cost less than the tenured employee, but we all know the value of a tenured employee — they're just able to make great assumptions on behalf of the organization... by day 30, it's able to make excellent assumptions on your behalf because it just has soaked in 30 days of context, memory, and skills. This is a pattern we're seeing more and more — the compounding value being delivered to the end customer showing up as retention in the business and showing up as pricing power on a per-customer basis." [00:23:48]
New Business Formation Is at an All-Time High — A New SMB Class Is Emerging
The most exciting SMB opportunity isn't serving existing small businesses; it's the new cohort of entrepreneurs who would previously have become YouTube creators but are now building micro-SaaS businesses using AI coding agents. New business formation is at its highest point outside of the COVID peak.
"New business formation is at an all-time high. It's the highest it's been outside of a peak sort of moment during COVID. These are people who would have never otherwise been SMEs. It's not the sort of 55-year-old plumber. It's a 25-year-old who previously would have been a YouTube creator and now is building SaaS for their neighborhood or their city or their high school or whatever else it is." [00:35:25]
2. Contrarian Perspectives
The Real Risk Is Being Too Pessimistic, Not Too Optimistic
Conventional discourse focuses on AI bubble risk. Anish argues the under-examined scenario is that we are collectively underpricing the opportunity. His evidence: even commodity GPUs (B200) are appreciating in price per hour, an almost unprecedented signal of supply constraints at massive scale.
"I think that the kind of case for this being a bubble is over-discussed or at least fully discussed. I think actually the out-of-distribution topic that's less discussed is what if we're insufficiently optimistic?" [00:04:15]
Enterprise Software Spend Is Too Small to Matter as an AI Target
While the narrative is that AI will destroy SaaS, Anish notes enterprise software is only 8–12% of total enterprise spend — making it a relatively small target. The real downside risk for enterprises vibe-coding their own payroll or CRM is essentially unlimited (compliance failure), while the upside is capped.
"For the enterprise, software spend is 8 to 12 percent. It's just not a huge proportion of spend. So the upside to vibe-code your own payroll or CRM is not particularly high. The downside is essentially unlimited. Obviously, there's all kinds of compliance implications of not getting things like payroll right." [00:05:10]
Startups Have a Structural Advantage Over Big Tech in Consumer AI Precisely Because of Their Willingness to Be Controversial
Google and other large tech companies are culturally and structurally blocked from building certain categories of consumer AI products (companions, emotionally engaging agents with edgy content). Startups face no such constraints, giving them a durable wedge in categories that matter to consumers most.
"You think about launching a companion product at Google that may disagree with you, that may have sexual innuendo in it — these are things that there are a thousand committees at Google designed to prevent. So startups have... they're willing to pay $200 a month. So it's sort of a renaissance for consumer builders." [00:29:00]
Less MBA, More Researcher Is the Right Founder Profile Right Now
Contrary to the conventional wisdom that business sophistication matters most, Anish argues technical sophistication is upstream of all valuable outcomes and cannot be taught. The best founders emerging now are earlier career, more technical, and unburdened by preconceived notions of what's possible.
"Less MBAs, more researchers... The business sophistication of the founders we're seeing is lower, but the technical sophistication is dramatically higher, and the technical sophistication is upstream of all the good things that happen. Business sophistication can be taught and observed, but technical sophistication typically not." [00:31:46]
Model Aggregation Delivers Greater-Than-Sum-of-Parts Value
Contrary to the assumption that picking the single best model is the strategy, the real product insight is that aggregating multiple models — like Expedia aggregating airlines — produces better outcomes than any single model. This is already happening in coding (Cursor), creative tools, and research workflows.
"There are many product categories in which model aggregation delivers a greater-than-sum-of-parts outcome... In coding, we're actually seeing this with Cursor a ton where you want to use a very frontier model for planning but then you can use a lesser model for execution." [00:13:09]
3. Companies Identified
Harvey
Description: AI-native legal work platform using fine-tuned models for legal industry use cases. Why mentioned: Cited as the canonical example of how the application layer converts the raw intelligence primitive into economic outcomes for a specific vertical. Also highlighted for achieving strong results with reinforcement learning on domain-specific reasoning traces.
"You really need Harvey to turn that into an economic outcome for the legal industry." [00:15:05] "I know Harvey's had some great results with this as well." [00:09:52]
Decagon
Description: AI-native customer support platform founded by Jesse Zhang; uses open-weight models. Why mentioned: Cited by Jen Kha as a company for which open-source/open-weight models are the only viable option — not just a cost decision, but a localization, fine-tuning, and data control necessity. Represents the class of startups that structurally cannot rely on proprietary frontier APIs.
"Our founder Jesse Zhang from Decagon dropped this great post around the fact that in some respects, and for a lot of companies like Decagon, open source is actually the only option. It's not just cost, it's that they can actually localize it, train, fine-tune it." [00:08:19]
Cursor
Description: AI-powered coding IDE that orchestrates multiple models for different tasks. Why mentioned: Best live example of model aggregation delivering greater-than-sum-of-parts value — using frontier models for planning and cheaper models for execution within one product shell.
"In coding, we're actually seeing this with Cursor a ton where you want to use a very frontier model for planning but then you can use a lesser model for execution. And you really need to have one product harness that lets you use multiple models." [00:13:36]
Grok / GrokBots (xAI)
Description: xAI's AI assistant and multi-agent personal bot platform. Why mentioned: Cited by Anish as the best current example of personal agents becoming consumer-ready. He used GrokBots to autonomously research, select, and purchase a pair of jeans overnight — the defining example of resourceful consumer AI action. Also highlighted for its multi-bot coordination architecture.
"I went to bed a few nights ago and said, hey, buy me a pair of jeans inspired by these... I woke up in the morning and it had researched, found a pair, same fit, different wash, used my credit card, purchased them, and they're on the way." [00:01:19] "GrokBots has done a nice job of illustrating this in product where you have many bots that are pointed in slightly different directions that all coordinate to deliver a globally optimal outcome." [00:25:22]
Notion/Town (Tana/Town — a16z investment)
Description: Personal AI agent product that manages email, subscriptions, and life administration; a16z investment led by partner Alex Rampell. Why mentioned: Highlighted as the best live example of compounding memory-based personal agents, with Jen Kha as an active personal user. Demonstrates how AI agents accrue pricing power and retention as they accumulate user context over time.
"Town is an investment our partner Alex Rampell made. It's a really extraordinary productivity product and you sort of see how the compounding improvement of the product through memory advantages it over time." [00:21:59] "Once you plug into your personal email — I don't even check it anymore. If there's something important, Town will surface it to me." [00:22:38]
ElevenLabs
Description: AI audio and voice synthesis platform. Why mentioned: Named as the best-in-class model for voice and music modalities within the creative tools multi-model aggregation thesis. Represents a node in a multi-model creative platform.
"You've got something like an ElevenLabs, which of course is incredible at voice, music as well." [00:13:36]
Black Forest Labs
Description: AI video and image generation company. Why mentioned: Named as best-in-class for video and creative direction within the same multi-model aggregation framework for creative tools.
"You've got something like Black Forest, which is doing such an excellent job in kind of video and creative direction." [00:14:06]
Replit
Description: Browser-based coding and development platform for non-technical users. Why mentioned: Cited as the highest-abstraction layer in the coding intelligence stack — making software development accessible to small business owners with no coding background.
"All the way up to Replit, which is a great abstraction layer for the average small business owner that's unfamiliar with code." [00:17:02]
Claude Code (Anthropic)
Description: Terminal-based agentic coding product from Anthropic. Why mentioned: Cited as the clearest example of domain-specific specialization at the model/product level — every design decision (terminal UI, code planning, code testing) is optimized for the software engineer persona.
"Claude Code, which many of you I'm sure have used, is just so oriented towards software engineering. It's in a terminal UI. Everything from the small design decisions to the areas in which it specializes, like code planning and code testing, is oriented towards the software engineer." [00:12:11]
ChatGPT / OpenAI
Description: OpenAI's flagship consumer and enterprise AI product suite, including new desktop app and Codex. Why mentioned: Highlighted for its recent excellence in knowledge work, the Codex harness for productivity, and the ChatGPT desktop app as an exceptional product container for document, spreadsheet, and knowledge workflows.
"OpenAI, who's just had an excellent three months. The new models are exceptional. The new Codex harness and ChatGPT desktop app is very well done." [00:02:43]
SAP
Description: Multinational enterprise software company. Why mentioned: Used as the canonical example of a company whose primary moat — integration complexity — is now being eroded by coding agents. Presented as an existential risk case study.
"SAP is so famously complex to integrate into and out of that it's a sort of existential risk to even migrate from one version of SAP to the next. Coding agents makes this dramatically better." [00:06:34]
Thomson Reuters
Description: Global media and information services company with major legal data products. Why mentioned: Named as an example of a company whose stock overreacted to Anthropic's release of a legal plugin — which turned out to be "just prompts" — illustrating how market panic around vertical integration by labs was overblown.
"Thomson Reuters and a bunch of other sort of big legal names traded down dramatically. But those were really just prompts." [00:10:48]
Character.ai
Description: Personalized AI companion and chat platform. Why mentioned: Cited as an example of an early AI-native entertainment company — a category Anish believes will be massive and distinct from productivity AI.
"I would argue Character was kind of an entertainment company." [00:20:59]
Frame (denim brand)
Description: Premium denim clothing brand. Why mentioned: Named incidentally as Anish's preferred jeans brand — the real-world purchase target in the GrokBots personal agent demo story.
"I mostly wear Frame jeans. Frame is a great brand." [00:01:19]
Expedia
Description: Online travel aggregation platform. Why mentioned: Used as the primary metaphor for the model aggregation thesis — just as Expedia is more useful than visiting each airline individually, AI product aggregators that surface multiple models outperform single-model products.
"It's so much more useful to use Expedia than it is to go to United, then to go to Delta, then to go to Southwest. You just want a single place where you can benefit from seeing every airline's inventory." [00:13:09]
4. People Identified
Jesse Zhang
Description: Founder of Decagon, an AI customer support startup. Why mentioned: Published a notable post articulating why open-weight models are structurally necessary — not just cheaper — for companies like Decagon that need to localize and fine-tune. Cited as a clear-eyed voice on the open-source vs. proprietary API debate.
"Our founder Jesse Zhang from Decagon dropped this great post around the fact that in some respects, and for a lot of companies like Decagon, open source is actually the only option." [00:08:19]
Alex Rampell
Description: General Partner at a16z. Why mentioned: Named as the partner who led a16z's investment in Town — held up as a forward-looking bet on the compounding personal agent category.
"Town is an investment our partner Alex Rampell made. It's a really extraordinary productivity product." [00:21:59]
David George
Description: General Partner at a16z (growth). Why mentioned: Referenced twice — once as someone who would be horrified by inbox disorganization (implying high operational standards), and once for authoring a key post on software pricing ceilings and the concept of "what's the $200/month SKU and the $2,000/month SKU" of your product.
"David wrote a great post on this. What's the $200 a month SKU of your product? And in fact what's the $2,000 a month SKU? Like what's the Birkin bag of software?" [00:30:06]
Leopold (Aschenbrenner — implied)
Description: Author of the "Situational Awareness" AI safety/forecasting document; former OpenAI researcher. Why mentioned: Anish briefly and affectionately referenced his work ("hopefully our dear friend Leopold doesn't mind me poking a little fun at him") in framing the macro optimism section — implying his situational awareness thesis anchors the bull case for the presentation.
"Hopefully our dear friend Leopold doesn't mind me poking a little fun at him here with situational awareness." [00:03:45]
Mark (Andreessen — implied)
Description: Co-founder and General Partner at a16z. Why mentioned: Cited for the key mental model of assessing AI opportunity as "industries, not markets" — a framing Anish credits directly to him.
"This is something that Mark says and he's so right, which is if you look at intelligence as a primitive, let's think about coding intelligence as a primitive... we're assessing these as industries, not necessarily simple markets." [00:17:02]
5. Operating Insights
The $15K ACV Rule for Defining Consumer vs. Enterprise Go-to-Market
Anish offers a clean, actionable heuristic for founders deciding whether to build a sales motion or a marketing motion: if you cannot justify acquiring a customer through a sales rep — meaning the ACV is below roughly $15K — you must treat that customer as a consumer and acquire them through marketing. This cuts through the fuzzy "PLG vs. sales-led" debate with a concrete number.
"Our simple rule is: if you cannot justify acquiring the customer through sales — which usually means a $15K ACV — you have to acquire them through marketing. We think of them as a consumer, which is most small business owners." [00:20:59]
Build Products That Improve Through Memory, Not Just Features
The most durable retention mechanism in AI products is not feature velocity — it is accumulated user context. Products that get meaningfully better after 30 days of use (because they know the user's preferences, habits, and history) create a switching cost that is qualitatively different from traditional software lock-in. Founders should design explicitly for this compounding memory loop from day one.
"The first day you use a product it doesn't know you that well... by day 30 it's able to make excellent assumptions on your behalf because it just has soaked in 30 days of context, memory, and skills. This is a pattern that we're seeing more and more — the compounding value being delivered to the end customer showing up as retention in the business and showing up as pricing power on a per-customer basis." [00:21:59]
Word of Mouth Is the Only Reliable New SMB Distribution Channel
With existing SMB channels (Instagram, TikTok) being expensive and crowded, founders targeting SMBs must build products viral enough to generate organic word of mouth — the original network effect. There is no shortcut through paid acquisition at scale for this segment.
"A lot of it, for existing SMEs, is Instagram, TikTok. It's very hard to build a new distribution channel off the backs of existing ones. So what founders have to do is build a product that has the original network effect, which is word of mouth." [00:34:54]
6. Overlooked Insights
Open-Weight Reinforcement Learning Creates a Compounding Competitive Moat That Is Self-Reinforcing
This was mentioned briefly but carries enormous strategic weight. When a company fine-tunes an open-weight model on its own reasoning traces and domain-specific data, it creates a model that outperforms any general-purpose frontier model in that narrow domain — and this advantage compounds as more domain-specific data is generated. Crucially, this creates a data flywheel that proprietary API users cannot replicate. Anish noted Harvey is already seeing this. The implication: the companies that move fastest on domain-specific RL fine-tuning with open-weight models are building a moat that is invisible to their competitors because it lives in a private model weight, not a feature set.
"If you actually have a problem that you can specialize the model around with your reasoning traces, you can start to create this compounding advantage in your domain for your customer base, where you're able to kind of shape the intelligence to be better than any general intelligence for your problem. I know Harvey's had some great results with this as well." [00:09:23]
The "Business Loop" Is the Most Underestimated AI Application Category
Anish briefly introduced a hierarchy of AI loops — coding loops, process loops (pricing, procurement), and "business loops" — but moved past it quickly. The business loop concept — where an AI agent makes cross-cutting recommendations affecting the entire organizational structure (e.g., "open a branch in Tijuana") — represents a category of software that has never existed: an AI that operates at the level of strategic business decision-making, not just workflow automation. No company is clearly winning this category yet, and it is the logical destination of enterprise AI. The investor or founder who identifies and backs the right "business loop" platform before the category is named will have extraordinary timing.
"Perhaps the most ambitious type of loop is the business loop, which is: hey, you make a change that's very cross-cutting to the business and the model comes back and says, hey, I think we need to open a branch in Tijuana. Now, the model can't do that autonomously, but it can make a change at the sort of surface level of the entire business, which is extraordinary. This is how enterprise automation is going to occur through AI." [00:16:32]