Dwarkesh Patel
Independent podcast host who has become the go-to media platform for top AI researchers and executives.
“Is Nigeria own a lot of SK Hynix and like Anthropic? I'm guessing not right. It's not enough for them to just own the S and P 500.”
Source→“Your colleague, Chad Jones, has a very interesting result about how the share of the economy that is going towards paying for computing, basically paying for the transistors, has been decreasing.”
Source→“After Cursor injects these hint tokens they run another forward pass — the trajectory itself doesn't change but the hint causes the model to assign lower probability to the error tokens. Cursor then trains the original model to match those probabilities, basically teaching it to downweight these specific mistakes.”
Source→“Omni is the next step towards more accurate world models. Because in order to predict the next frame of a video, you have to have a deep understanding of physics and spatial dynamics.”
Source→“There aren't that many institutions that have thought as hard as Jane Street about how to turn smart people into some of the most competent researchers and engineers in the world.”
Source→“Crusoe was one of the first clouds to adopt Envy Sentinel, NVIDIA's own GPU monitoring and self-healing software for enhanced GPU uptime utilization and reliability... Crusoe can swap in a healthy node in less than 10 minutes.”
Source→“A 10-layer neural network pass... 10 steps of reasoning... is able to amortize and approximate to a very high fidelity a nearly intractable search problem.”
Source→“Jensen Huang: 'I didn't deeply internalize how difficult it would be to build a foundation AI lab like OpenAI and Anthropic… I'm not going to make that same mistake again.'”
“Last week Horace was kind enough to give me and my friends a great lecture on large scale pre-training systems and there were some concepts that I wanted to animate for a write-up on my blog.”
Source→“There's a talk by Ilya where he says today we know not to do pipeline parallelism.”
Source→“There's a talk by Ilya where he says today we know not to do pipeline parallelism.”
Source→“All of a sudden, Dwarkesh Patel's podcast has become must-listen content among top AI researchers and executives.”
AI-extracted from podcast / newsletter / paper summaries. May contain errors.