Base Labs (@baselabs)

Distillation is a common way to prepare a model for RL where learning occurs from a stronger model, and then improves through trial and error. But how much does that better starting point help after RL? We conduct preliminary research on this question across model sizes and reasoning tasks. 🧵...