Elorian

“AI startups Elorian and Scale AI have built and released Humanity's Sixth Sense, a benchmark that 'measures how a model interprets and reasons through information a visual scene implies but doesn't explicitly show.'”

“The two most common single mistakes were (1) missing a detail that decides the answer (21% of failures) and (2) misidentifying an object, person, or role (20%).”