Goodfire

“the vision-language backbone does not need to pass information to the action expert at every layer. Instead, there is a 'narrow middle-to-late region through which the backbone conditions action generation'”

“latency dropped from 311 ms to 209 ms, and throughput increased by 44% on an H100”