Ilya Sutskever

“Cranked through ImageNet. Kicked off the whole damn thing”

“there's the classic example, I think, from Ilya, where... the final sentence of the mystery novel is, like, and the killer was, predict the next token”

“Within 10 years, I believe we... continuous learning models will come into existence. That means that every generation of every model we have today dies, goes away.”

“Google's 2013 acquisition of DNNResearch (the Hinton/Krizhevsky/Sutskever spinout) for a reported $40-44M implies roughly $15M per head, the top of the market through 2017.”

“Ilya, especially — his belief in Scaling Law is like a religious faith. He made people believe: don't overthink it, just scale, get the work done, put in the data and train. But I heard him say in an interview late last year that the room in Scaling Law is running out... I very much agree with that.”

“Co-founder of OpenAI, now at SSI.”

“This week, it was a $5 billion commitment to Ilya Sutskever's Safe Superintelligence, much of which will be used to buy Nvidia gear.”

“Thinking machines, safe superintelligence from Ilya and Daniel.”

“"Ilya Sutskever is idealistic but corruptible."”

“Ilya Sutskever... Credited with the foundational insight that undergirds the entire modern AI paradigm... 'Prediction is very close to intelligence.' (said in 2015)”

“His claims of honesty were undercut by testimony from former colleagues Ilya Sutskever and Mira Murati.”

“Five different people who'd testified in the case said he wasn't a trustworthy person (Helen Toner, Tasha McCauley, Ilya Sutskever, Mira Murati, and Musk).”

“No one can describe what happened next better than Ilya himself. If you believe in deep learning, deep learning will believe in you.”

“There's a talk by Ilya where he says today we know not to do pipeline parallelism.”

“There's a talk by Ilya where he says today we know not to do pipeline parallelism.”

“I come back to just what Ilya talked about just recently. And what he said was basically, like, with AGI, we almost overshot the target. Humans are not AGI, but we still learn on the job. We learn from experience. And that's what makes kind of humans kind of unique.”

“I come back to just what Ilya talked about just recently. And what he said was basically, like, with AGI, we almost overshot the target... Humans are not AGI, but we still learn on the job. We learn from experience. And that's what makes kind of humans kind of unique. [00:14:16:100]”