Andrej Karpathy

“Andrej Karpathy has a great explanation of this.”

“Andrej Karpathy's auto research is like a very basic version of this.”

“The biggest thing that changed was developers and in particular in the enterprise being open-minded to this new way of working... And when Andrej Karpathy tweets about something, then every engineer suddenly is like, okay, maybe this is true.”

“I saw Andrej Karpathy gave an interview where now all of a sudden he's re-underwritten this and he says AGI is at least a decade away. He's basically saying that reinforcement learning has its limits.”

“Andrej Karpathy has this great slide where he basically says, if you're building an agentic system today, right? But fundamentally what it is is of this loop, right? Where half of the loop is the model thinking, right? And the other half is then the user verifying what did the agent do.”

“Karpathy, you know, whatever, two days ago, is being painted as like a skeptic for saying AGI is 10 years away. Are you kidding? It's insane. 10 years? That's wild.”

“Andrej Karpathy called a community demo 'incredible.'”

“One engineer pointed it at file compression with Claude Code: 10 unsupervised iterations at about $4 each, and the home-built algorithm beat common tools on audio and video. Zero ML involved.”

“Karpathy's auto research idea. He wrote this basically one Python file that does basic LLM training and then just had a repo where LLM agents would like try to make modifications to the file.”

“I think Karpathy said this when he came on my podcast, is that for humans, many billions of years of evolution had to go into basically pre-training us. And so we're being unfair when we're comparing how little data we see within our lifetimes to what these cold-started LLMs, who are just starting off with a totally random initialization, have to learn from.”

“If you're following folks like, you know, Karpathy, Noam Brown at OpenAI, Shalto, at Anthropic...”

“Last week, they published this blog saying that recursive self-improvement could end the world. Therefore, we need a pause. What did they do the previous month? They hired Andrej Karpathy to run recursive self-improvement at Anthropic.”

“I was watching Andrej Karpathy and he was talking recently about, you know, the 10X engineer actually is wildly misunderstood and you won't see the 10X engineer, you'll actually see a smaller number of 100X engineers.”

“Karpathy said last year's code tools could write 20% and 80% would be handwritten. That flipped when the latest model came out, and now he hasn't written a line of code except in English.”

“Andre Carbethy retweeted it. It was pretty popular on Twitter. It was like this new way to find information.”

“Andre Carbethy retweeted it. It's pretty popular on Twitter. It was like this new way to find information. It was the first time people were like, holy cow, it's possible to find things beyond Google.”

“One of his research wikis reportedly reached around 400,000 words. A book's worth of organized domain knowledge, maintained by AI and instantly queryable.”

“Anthropic hired high-profile talent (Andrej Karpathy); referenced in the newsletter's opening as the subject of viral industry attention”

“Auto research from Karpathy again... Slash goal now in Codex. Like they've incorporated it too.”

“Andrej Karpathy... coined 'vibe coding,' previously led FSD at Tesla and co-founded OpenAI, now leading pre-training at Anthropic focused on recursive self-improvement.”

“This idea of recursive self-learning puts these models on a combination of overdrive and autopilot. And if you put those two things together, I think that you start to, you could potentially live out this idea that there's an order of magnitude improvement on a yearly basis.”

“He's been at the wave upon wave of AI. He was probably the first person that really commercialized the Richard Sutton bitter lesson essay when he was leading FSD at Tesla... And what he's done as a kind of a free agent is also quite impressive.”

“He co-founded OpenAI, led AI at Tesla during its push into autonomy.”

“By morning, there is a log of attempts. Dozens, sometimes over a hundred. Each one tried a variation, ran it for a fixed window, and recorded the outcome.”

“Decart...raised a $300 million round at a nearly $4 billion valuation.”

“Backed by Nvidia and Andrej Karpathy.”

“You can also use kind of a Karpathy-style auto-research hyperparameter tuning to make your architecture pretty good.”

“People of different generations use ChatGPT differently. So if you're in your 30s, you use it as a Google search replacement. But if you're in your teens, ChatGPT is your gateway to the internet.”

“Can you spot another? That's Andre right there. So Andre, we're going to the Computer History Museum.”

“I just started to notice that with the latest models, the chunks just came out fine. And then I kept asking for more and it just came out fine. And then I can't remember the last time I corrected it.”

“I'm going to use 10 codex 5.4 x high to try to break your website that you deployed. And they're going to try to basically break it and they should not be able to break it.”

“Participants: Andrej Karpathy, Stephanie Zhan”

“All of my menu gen is spurious. It's working in the old paradigm that app shouldn't exist.”

“We see that with examples like Karpathy's auto-research project.”

“We see that with examples like Karpathy's auto-research project...”

“Andrej Karpathy in AI, right, who just like shows up and like explains like, here is how this all works... is just like amazing. — Marc Andreessen”

“Andre and I were just talking about this has been a long term dream of mine... maybe combining the representation of convolutional neural network as well as the language sequential model of LSTM”