What’s Next for Consumer AI? | Josh Elman Joins a16z
- 01AI's Productivity Bias Is Leaving Consumer Opportunity on the Table
- 02Personal Intelligence Is the Meaningful Frontier, Not General Intelligence
- 03Retention Over Acquisition
- 04Distribution Has Shifted from Virality and SEO to Creator-Led Word of Mouth
- 05GEO (Generative Engine Optimization) Is the Next Search
- 06The Roblox/Minecraft Generation Will Demand Remixable Software
1. Key Themes
AI's Productivity Bias Is Leaving Consumer Opportunity on the Table
The bulk of AI startup investment has been directed at B2B productivity, leaving an enormous consumer surface largely untouched. Josh Elman argues this is a historical mismatch that will self-correct.
"Right now, AI has been so much about productivity, job replacement, work replacement. And I think we have a moment to shift that, which is how does these new tools help you get more out of your own day and your own life and the things you want to do?" [00:00:00]
Personal Intelligence Is the Meaningful Frontier, Not General Intelligence
The differentiated value of on-device AI is contextual access to your own data — mail, messages, calendar — not raw world knowledge. Elman's Siri anecdote illustrates how this shifts from search replacement to genuine personal assistance.
"What's really special with these assistants is not just what they can help you do or navigate in the world and kind of bring the world knowledge to place but what they can understand about you... Being able to just have an assistant that can tap into that and answer questions." [00:06:45]
Retention Over Acquisition — Always
Elman repeatedly returns to the primacy of genuine behavioral change over top-of-funnel metrics. The willingness to try new products is historically high, but that means nothing if habit formation doesn't follow.
"Everybody is like, how do you get to this many users so fast? And the answer is don't. Get to a smaller number who have moved their lives over to your product. Who have truly found something new that they are doing that they will not want to go back from." [00:25:01]
Distribution Has Shifted from Virality and SEO to Creator-Led Word of Mouth
Elman traces distribution's evolution — viral loops, search optimization, and now creator trust relationships — and argues that authentic creator endorsement is actually the most powerful form of word of mouth at scale.
"The creators are able to talk about the things that they're doing and exploring and figuring out. And you learn to trust that this person isn't just doing it to make money or an endorsement... That's the new path of discovery is you have to be so good that you're getting those people to talk about it." [00:18:25]
GEO (Generative Engine Optimization) Is the Next Search
The emerging distribution layer for apps isn't the App Store or Google — it's getting referenced by AI agents when users are solving problems. Most founders haven't yet operationalized this.
"You're going to need to figure out how to do what they call it, GEO, generative optimization, where the agents talk about you. And when someone's trying to solve a problem, the agents will actually do that." [00:21:34]
The Roblox/Minecraft Generation Will Demand Remixable Software
Gen Alpha grew up with user-controlled, co-created worlds and will expect tinkering, customization, and ownership from every category of software — including productivity and utility apps.
"The apps that will win in the next generation will give people that sense of ownership at the end... Once they've got the thing that does most of those functions, they're going to want to tinker with it. They're going to want that flexibility." [00:16:51]
On-Device Inference Will Restructure Consumer AI Economics
The cost constraint on free-tier consumer AI products — inference — will be progressively mitigated by pushing non-complex workloads to device GPUs. This reopens the mass-market free-product playbook.
"There's no reason that everything you're ever trying to do, whether it's refining a title or just rewriting a paragraph or answering some basic questions — those can actually use models that are incredibly powerful that can run on the devices now. And then you only send the more complex stuff up." [00:37:50]
Labs Won't Win Everything — The Market Stays Open
Every prior technology cycle produced the same "will the platform owner win it all?" anxiety (Google, Apple), and each time startups found abundant whitespace. Elman believes the same pattern holds for AI labs.
"I think right now, I think the world is so open again. The main chatbots, the main assistants are going to do a lot for us... But I think we're going to expect everything to work like them. And we're going to rewire so much else of what we do in life and our services... the opportunities to fill all of those areas of our lives are not just going to go to like, there's only two products we ever use." [00:40:17]
2. Contrarian Perspectives
Paid Acquisition Is Not Inherently a Bad Signal — Retention Is the Variable That Matters
Conventional startup wisdom treats heavy paid acquisition as a red flag. Elman argues TikTok's paid scale-up was correct and repeatable, contingent entirely on underlying retention.
"I have no problem with people doing paid if they understand it. Paid to both get people in who will become very good retained users and who will spread the word for you can be a great catalyst. What you can't do is spend a lot of money to like burn 10 people to find the one who actually stuck with your product and think that that's going to scale." [00:35:49]
Companion AI and Emotionally Rich Products Are Genuinely Defensible Startup Territory
Most big tech companies are constitutionally unable to ship products involving probabilistic behavior, sexuality, or deep emotional intimacy. This committee-approval failure creates durable startup moats, not just temporary gaps.
"Companion touches on everything that every committee at a big tech company doesn't want you to do. You know, there's disagreement. There is probabilistic behavior. There's sexuality... And as you know, when you're at really big scale, it's hard to ship things like that." [00:40:57] — Anish Acharya
Consumers Don't Want to Save Time — They Want to Spend It Well
The productivity framing baked into most AI product design is a fundamental mismatch with how consumers actually experience time. Products optimized around "time saved" will lose to products optimized around "time well spent."
"People are not trying to save time. They're trying to spend time... the average consumer doesn't know what to do with the blinking cursor. They actually need to have things pushed to them so that they actually can explore and not have to be so high agency." [00:47:27] — Anish Acharya, quoting Eugenia
AI Agents Should Actively Refer Users Out — Not Retain Them
Every major AI assistant is currently optimized to solve problems within its own interface. Elman argues the winning strategy is the opposite: agents that intelligently hand users off to specialized apps will compound faster than those that try to own every vertical.
"What would be really cool is if it said, hey, I know you're trying to plan a trip. Here's a bunch of things. By the way, here's the resources to go deeper... Being even smarter about knowing when it's good to hand you off, I think will be great. And then it'll create a lot of opportunity for those tools." [00:22:04]
The Most Important Product Metric Has Not Changed Despite AI
Despite the radical model-level disruption, the fundamental product loop question — do people actually change their behavior? — remains unchanged. Chasing user count is a distraction from this.
"I think the world is so open again... I'm less worried about finding just the distribution methods for awareness. As much as like, what are the products that are actually going to move our habits and change us?" [00:40:17]
3. Companies Identified
Robinhood Retail brokerage and financial services platform. Cited as the canonical example of starting with a hyper-focused retained user base, brilliant referral mechanics, and expanding the platform over time; also highlighted as a founder-led company executing a long-term vision.
"Robin Hood's an incredible example where they had a vision to democratize finance for everybody... it started very small with, hey, if you are actively thinking about wanting to invest or actively already trading, we should be a better product for you." [00:25:51] "I'm just blown away by what they've done with the company... It's no longer just trading. It's retirement. It's credit card. It's got some banking components. And all these products, they're bringing the same care, design, trust for the user." [00:30:42]
Musical.ly / TikTok Short-form video platform, originally Musical.ly, acquired by ByteDance and merged with Douyin to become TikTok. Cited as an exception to the rule that paid acquisition doesn't scale, because the underlying product loop was so strong that paid spend simply poured into an already-retained base.
"They spent, they were probably one of the biggest spenders on Facebook, Twitter, kind of every social media to get people to download TikTok at that time. But the product loop was so good that everybody retained." [00:34:57]
Discord Community and gaming communication platform. Cited as a model of pure organic word of mouth distribution — not driven by mass influencers but by the one person in every gaming group who rallied their circle onto the platform.
"The person who gathers everybody for games would go, hey, I'm trying this new tool. It's way better than what we've been using before. Everybody jump on it. And that one person would bring everybody in their group that they played games with." [00:20:41]
Apple / Siri AI Consumer hardware and software company. Cited for its unique position as the on-device personal intelligence layer — access to all personal data in one trusted place — and for its culture of debate as a model for rigorous decision-making.
"The story of what Siri AI is and I'm using it every day and it's fantastic... When you trust it, your device has your mail, your messages, your calendar, notes, anything that you save. Being able to just have an assistant that can tap into that and answer questions." [00:06:29]
ChatGPT / OpenAI AI conversational assistant. Cited as the prime example of a 10x better consumer product displacing an entrenched incumbent (Google Search) through sheer quality differential.
"ChatGPT was amazing for a whole bunch of searches that we thought were totally solved through Google. And all of a sudden you start putting those searches into ChatGPT. You're like, this answer is more than 10 times better. This experience is more than 10 times better than Google links back and forth." [00:00:25]
Roblox User-generated gaming and co-experience platform. Cited as the formative platform experience for Gen Alpha — a generation that grew up expecting ownership, tinkering, and co-creation from all software.
"Roblox is this incredible co-experience platform where you get a couple people together and they're playing games and having conversation at the same time with their friends. And they're going to expect, as that group grows up, more and more experiences like that that are rich, that value that sense of control, that sense of ownership." [00:16:13]
Companion (app) AI companion and emotionally intelligent chat application. Cited as the clearest example of a startup product category that large tech companies are structurally unable to build due to internal approval culture.
"Companion touches on everything that every committee at a big tech company doesn't want you to do. There's disagreement. There is probabilistic behavior. There's sexuality... when you're at really big scale, it's hard to ship things like that." [00:40:57]
LinkedIn Professional social network. Cited as an early example of overcoming user resistance to a fundamentally new behavior — putting your professional identity online — to unlock fluid information exchange.
"LinkedIn was like, you're going to put your resume online. We're like, what? I would never put where I've worked online. That's only if I'm looking for a job." [00:09:48]
Minecraft Sandbox building and survival game. Cited alongside Roblox as formative for Gen Alpha's expectation of control, tinkering, and open-ended worlds.
"We have a generation of kids growing up that grew up on Minecraft and Roblox. They were used to playing a game where they controlled the world, where they chose to join the world." [00:15:49]
Quibi Short-form mobile video platform (now defunct). Cited as a cautionary contrast to TikTok — similar paid acquisition spend, but without the retained product loop to support it.
"I joke at the same time, Quibi was pouring similar amounts of money to get people to download Quibi, which didn't totally work." [00:35:27]
ByteDance / Douyin Chinese technology company behind TikTok and Douyin. Cited for combining an existing large Chinese short-video product with Musical.ly's Western community and a strong AI recommendation engine to create global scale.
"ByteDance had had a product, Douyin, that was very, very large in China... they had kind of both modeled some after Musical.ly, had had their own invention and had this great AI team." [00:34:18]
4. People Identified
Josh Elman Consumer technology investor and operator; new partner at a16z; formerly product and growth at LinkedIn, Facebook, Twitter; investor in Discord; CPO-adjacent at Robinhood; product marketing lead for AI at Apple. Cited throughout for his pattern recognition across every major consumer platform cycle.
"Getting to be part of creating technology that we all use every day in our lives... everything I've gotten to work on in my career has been really fortunate to have found its way to that and then build and compound and set the company up to really scale from that." [00:02:25]
Vlad Tenev Co-founder and CEO of Robinhood. Cited as a model founder-led public company executive who navigated multiple existential crises (GameStop, market downturns) and expanded Robinhood from single-product trading into a full financial services platform.
"Vlad has just done an incredible job navigating the seas. It went through some real bumpy times too... they came back to their core values. Great design, great product, trust for the user, something people are proud to talk about and share." [00:30:42]
Alex Zhu Co-founder of Musical.ly; later ran significant TikTok operations at ByteDance. Cited for the original insight into lip sync behavior spikes and the product architecture decisions that gave Musical.ly its viral loop.
"Alex, who was the founder of Musical.ly and actually went and ran a lot of TikTok, was telling me this, that they were so confused. And they found out finally that the spikes on Thursday night was because of when Lip Sync Battle appeared on like MTV." [00:31:55]
Andrej Karpathy AI researcher; former Tesla and OpenAI. Cited for foundational work showing that capable models can be trained and run on extremely constrained hardware, supporting the thesis that inference will push aggressively to the edge.
"I know that Karpathy has done a bunch of work, a few folks have showing that you can actually train and run models on 386s and 486s. Incredible." [00:38:23] — Anish Acharya
Eugenia (last name not stated) Entrepreneur known to both Elman and Acharya; a16z portfolio-connected. Cited for a single reframing insight about consumer motivation that Acharya describes as "profound" and repeats consistently.
"She just said this thing that was so profound and I keep repeating it, which is, look, people are not trying to save time. They're trying to spend time." [00:47:27] — Anish Acharya
5. Operating Insights
The Referral Program Architecture That Actually Works
Most referral programs fail because the incentive is a flat dollar amount that forces users to consciously trade social capital for a trivial sum. Robinhood's lottery-stock mechanic solved this by making the reward variable, share-denominated, and emotionally engaging — enough winners at high value drove word of mouth, while lower-value winners still felt they gained an asset.
"The team came up with this mechanic to figure out how to make it give and get a share, an actual share. And then was able to use the fact that that share was a lottery. Sometimes it would be a $2 stock. Sometimes it would be a $100 stock. And enough people got the $100 stock that they raved about it." [00:28:59]
Hold Two Scales in Your Head Simultaneously
The failure mode of most founders is optimizing for either current traction or billion-user vision, but not both at once. The best founders can articulate the full vision clearly while executing a hyper-focused near-term wedge.
"The best founders I've gotten to work with figured out how to both have that vision of what is billion user scale and why is the world different when we're actually everybody's using it, but then go, but I'm not going to get there today. Today I've just got to get to this and I have to win this area and convince this group to become passionate." [00:25:51]
Product-Led Debate Requires Pre-Work, Not Spontaneity
Apple's culture of rigorous debate produced better outcomes not because people argued harder in the room, but because information was prepared more thoroughly before entering the room. AI agents can systematize this preparation advantage.
"The only way you can have real debate is to have as much information and thought prepared ahead of time. And that was really the hard work there." [00:13:10]
Single-Use to Multi-Use Platform Expansion Is a Learnable Playbook
The art of scaling a product is knowing when and how to expand from the core retained behavior to adjacent uses without confusing the initial user base. Robinhood's sequential expansion — trading, then retirement, then credit card, then banking — is the model.
"How do you evolve a single use product into multiple uses and scale that as a product platform?" [00:50:55]
6. Overlooked Insights
The Waterfall Model of Musical.ly's Influencer Strategy Is Directly Replicable for AI Consumer Apps
Elman describes a precise, three-tier influencer flywheel that Musical.ly engineered deliberately: B-list Instagram creators became A-list Musical.ly stars, then exported content back to Instagram with a persistent branded watermark. The watermark was non-removable, creating permanent attribution. This wasn't accidental — it was architecture. The insight that a startup can deliberately manufacture a class of "made stars" who then evangelize on a larger platform, while the watermark acts as a viral loop, is a playbook that almost no AI consumer company is currently deploying.
"There were a bunch of B-plus stars on Instagram who weren't quite getting enough credibility... on Musical.ly, they'd become the number one stars, the ones with the most followers because they were getting featured in the feed... there was always a little Musical.ly bug at the bottom of the Instagram video... People were cutting that out... And it created this great loop." [00:33:21]
AI Assistants That Refer Out Will Compound Faster Than Those That Don't — and No One Is Doing This Yet
Elman observes that every major AI assistant is currently optimized to retain the user within its own interface, even when a specialized downstream app would serve the user far better. He frames referral-out as the single biggest untapped distribution mechanism for the next layer of consumer AI apps. This is essentially a claim that the next App Store moment will be earned by whichever assistant first commits to being a trusted referral engine — and that this hasn't happened yet, meaning both the assistant builders and the vertical app builders are leaving a structural opportunity on the table.
"Right now, I don't think any of the core assistants kind of have that mentality that referring people out makes them actually stronger. But I think that's the biggest opportunity." [00:22:04]