Ilya Sutskever
Co-founder of OpenAI and Safe Superintelligence (SSI), a leading AI researcher.
- 💥Top Employers to Create Outlier Founders, State of Pre-Seed, Cost of AI Talent, Tech Stack Ownership & More
- The Abrupt Fall of Situational Awareness Is a Warning Sign. So Is Nvidia’s Vendor Financing.
- ⭕ Nvidia's circularity
- Tech Investors Will Be Sweating the Dog Days of Summer in More Ways Than One
- 😠 Chorus of boos
- The AI Trade Keeps on Giving as Cerebras, Nvidia & Market Indexes Soar
- Reiner Pope – The math behind how LLMs are trained and served
- Why We Need Continual Learning
“there's the classic example, I think, from Ilya, where... the final sentence of the mystery novel is, like, and the killer was, predict the next token”
Source→“Within 10 years, I believe we... continuous learning models will come into existence. That means that every generation of every model we have today dies, goes away.”
Source→“Google's 2013 acquisition of DNNResearch (the Hinton/Krizhevsky/Sutskever spinout) for a reported $40-44M implies roughly $15M per head, the top of the market through 2017.”
Source→“Ilya, especially — his belief in Scaling Law is like a religious faith. He made people believe: don't overthink it, just scale, get the work done, put in the data and train. But I heard him say in an interview late last year that the room in Scaling Law is running out... I very much agree with that.”
Source→“This week, it was a $5 billion commitment to Ilya Sutskever's Safe Superintelligence, much of which will be used to buy Nvidia gear.”
Source→“Ilya Sutskever... Credited with the foundational insight that undergirds the entire modern AI paradigm... 'Prediction is very close to intelligence.' (said in 2015)”
“His claims of honesty were undercut by testimony from former colleagues Ilya Sutskever and Mira Murati.”
Source→“Five different people who'd testified in the case said he wasn't a trustworthy person (Helen Toner, Tasha McCauley, Ilya Sutskever, Mira Murati, and Musk).”
Source→“No one can describe what happened next better than Ilya himself. If you believe in deep learning, deep learning will believe in you.”
Source→“There's a talk by Ilya where he says today we know not to do pipeline parallelism.”
Source→“There's a talk by Ilya where he says today we know not to do pipeline parallelism.”
Source→“I come back to just what Ilya talked about just recently. And what he said was basically, like, with AGI, we almost overshot the target... Humans are not AGI, but we still learn on the job. We learn from experience. And that's what makes kind of humans kind of unique. [00:14:16:100]”
Source→“I come back to just what Ilya talked about just recently. And what he said was basically, like, with AGI, we almost overshot the target. Humans are not AGI, but we still learn on the job. We learn from experience. And that's what makes kind of humans kind of unique.”
Source→AI-extracted from podcast / newsletter / paper summaries. May contain errors.