Did you use the -Zero model, which doesn't have the "cold-start data before RL" which prevents it from language mixing?
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Did you use the -Zero model, which doesn't have the "cold-start data before RL" which prevents it from language mixing?