Andrej Karpathy

“I think Karpathy said this when he came on my podcast, is that for humans, many billions of years of evolution had to go into basically pre-training us. And so we're being unfair when we're comparing how little data we see within our lifetimes to what these cold-started LLMs, who are just starting off with a totally random initialization, have to learn from.”

“If you're following folks like, you know, Karpathy, Noam Brown at OpenAI, Shalto, at Anthropic...”

“I was watching Andrej Karpathy and he was talking recently about, you know, the 10X engineer actually is wildly misunderstood and you won't see the 10X engineer, you'll actually see a smaller number of 100X engineers.”

“Last week, they published this blog saying that recursive self-improvement could end the world. Therefore, we need a pause. What did they do the previous month? They hired Andrej Karpathy to run recursive self-improvement at Anthropic.”

“Karpathy said last year's code tools could write 20% and 80% would be handwritten. That flipped when the latest model came out, and now he hasn't written a line of code except in English.”

“Andre Carbethy retweeted it. It was pretty popular on Twitter. It was like this new way to find information.”

“Andre Carbethy retweeted it. It's pretty popular on Twitter. It was like this new way to find information. It was the first time people were like, holy cow, it's possible to find things beyond Google.”

“Anthropic hired high-profile talent (Andrej Karpathy); referenced in the newsletter's opening as the subject of viral industry attention”

“One of his research wikis reportedly reached around 400,000 words. A book's worth of organized domain knowledge, maintained by AI and instantly queryable.”

“Auto research from Karpathy again... Slash goal now in Codex. Like they've incorporated it too.”

“This idea of recursive self-learning puts these models on a combination of overdrive and autopilot. And if you put those two things together, I think that you start to, you could potentially live out this idea that there's an order of magnitude improvement on a yearly basis.”

“He's been at the wave upon wave of AI. He was probably the first person that really commercialized the Richard Sutton bitter lesson essay when he was leading FSD at Tesla... And what he's done as a kind of a free agent is also quite impressive.”

“Andrej Karpathy... coined 'vibe coding,' previously led FSD at Tesla and co-founded OpenAI, now leading pre-training at Anthropic focused on recursive self-improvement.”

“He co-founded OpenAI, led AI at Tesla during its push into autonomy.”

“By morning, there is a log of attempts. Dozens, sometimes over a hundred. Each one tried a variation, ran it for a fixed window, and recorded the outcome.”

“Backed by Nvidia and Andrej Karpathy.”

“Decart...raised a $300 million round at a nearly $4 billion valuation.”

“You can also use kind of a Karpathy-style auto-research hyperparameter tuning to make your architecture pretty good.”

“All of my menu gen is spurious. It's working in the old paradigm that app shouldn't exist.”

“I'm going to use 10 codex 5.4 x high to try to break your website that you deployed. And they're going to try to basically break it and they should not be able to break it.”

“Participants: Andrej Karpathy, Stephanie Zhan”

“People of different generations use ChatGPT differently. So if you're in your 30s, you use it as a Google search replacement. But if you're in your teens, ChatGPT is your gateway to the internet.”

“I just started to notice that with the latest models, the chunks just came out fine. And then I kept asking for more and it just came out fine. And then I can't remember the last time I corrected it.”

“We see that with examples like Karpathy's auto-research project...”

“We see that with examples like Karpathy's auto-research project.”

“Andrej Karpathy in AI, right, who just like shows up and like explains like, here is how this all works... is just like amazing. — Marc Andreessen”