RoboReact

“RoboReact eliminates the need for teleoperation or human demonstrations entirely. Given a single egocentric RGB-D frame and a language instruction, it generates a human manipulation video, distills it into keyframe-based skills, and executes on a real humanoid.”

“RoboReact is the first framework to solve long-horizon, generalizable whole-body manipulation using only pretrained models and a single RGB-D frame as data source, without any teleoperated or human demonstrations”

“The offboard workstation uses an RTX 4080 Super for perception and high-level control. The compute requirements are modest enough for consumer-grade GPUs, which has implications for deployment cost.”