Niko Grupen
Head of Applied Research at Harvey, upcoming guest to discuss the Legal Agent Benchmark.
“I think this year is the year that we see intelligence at an individual level kind of brought into intelligence at an organizational level... How do lawyers collaborate with lawyers on our platform? How do human agent teams collaborate?”
Source→“We launched Lab, which is our legal agent benchmark. It's a benchmark for measuring the performance of agents on real world legal tasks.”
Source→“Niko Grupen: Head of Applied Research at Harvey; former Google Brain researcher; joined Harvey nearly three years ago”
“People aren't really thinking about performance in terms of just, like, quality maxing anymore. The frame has shifted to quality per dollar and quality per second.”
“Harvey's response is the Legal Agent Benchmark (LAB), open-sourced in May, which tests long-horizon agentic work across 1,200+ tasks and 24 practice areas, with collaborators including NVIDIA, OpenAI, Anthropic, Mistral, and DeepMind.”
“Co-founder Gabe Pereyra & Niko Grupen, Harvey's Head of Applied Research, join us next to break down LAB, the new benchmark data, and the technical architecture behind legal agents at production scale.”
AI-extracted from podcast / newsletter / paper summaries. May contain errors.