Rainer Pope

“You might have seen my episode with Rainer Pope where we discussed this in detail... if per company instructions require full weight updates rather than living in low rank adapters, there's huge advantages from batching.”