Zyphra

“plausibly million fold behind humans in terms of how much data a human sees from birth to adulthood versus how much a model sees.”

“finding data explains ~9x compute efficiency gains vs. 3x from architecture”