Multi-Turn On-Policy Distillation with Prefix Replay
Paper • 2607.04763 • Published • 13
ReOPD
On-policy distillation for agents without the environment: replay teacher prefixes instead of live rollouts.
-
-
baohao/Math_Qwen3-4B-Instruct-2507_SFT-RL
4B • Updated • 187 -
baohao/Math_Qwen3-4B-Instruct-2507_SFT
4B • Updated • 71 -
baohao/Math_Qwen3-30B-A3B-Instruct-2507_SFT
31B • Updated • 4 -
baohao/Math_Qwen3-30B-A3B-Instruct-2507_SFT-RL
31B • Updated • 6 -
baohao/Math_Qwen3-8B_SFT
8B • Updated • 9 -
baohao/Math_Qwen3-8B_SFT-RL
8B • Updated • 39 -
baohao/Search_Qwen3-8B_SFT
8B • Updated • 8 -
baohao/Search_Qwen3-4B-Instruct-2507_SFT
4B • Updated • 6 • 1 -
baohao/Search_Qwen3-4B-Instruct-2507_SFT-RL
4B • Updated • 3 • 1 -
baohao/Search_Qwen3-8B_SFT-RL
8B • Updated • 7 • 1 -
baohao/OPD_Math_Qwen3-4B-Instruct-2507_SFT-RL_to_Math_Qwen3-4B-Instruct-2507_SFT
4B • Updated • 6 • 1 -
baohao/OPD_Math_Qwen3-8B_SFT-RL_to_Math_Qwen3-4B-Instruct-2507_SFT
4B • Updated • 10 -
baohao/OPD_Math_Qwen3-30B-A3B-Instruct-2507_SFT-RL_to_Math_Qwen3-4B-Instruct-2507_SFT
4B • Updated • 5 -
baohao/OPD_Math_Qwen3-30B-A3B-Instruct-2507_SFT-RL_to_Math_Qwen3-8B_SFT
8B • Updated • 6 -
baohao/ReOPD_Math_Qwen3-30B-A3B-Instruct-2507_SFT-RL_to_Math_Qwen3-8B_SFT
8B • Updated • 8 -
baohao/OPD_Math-Search_Qwen3-4B-Instruct-2507_SFT-RL_to_Both_Qwen3-4B-Instruct-2507_SFT
4B • Updated • 7 • 1 -
baohao/ReOPD_Math_Qwen3-30B-A3B-Instruct-2507_SFT-RL_to_Math_Qwen3-4B-Instruct-2507_SFT
4B • Updated • 4 -
baohao/OPD_Search_Qwen3-4B-Instruct-2507_SFT-RL_to_Search_Qwen3-4B-Instruct-2507_SFT
4B • Updated • 5 • 1 -
baohao/ReOPD_Search_Qwen3-8B_SFT-RL_to_Search_Qwen3-4B-Instruct-2507_SFT
4B • Updated • 6 -
baohao/OPD_Search_Qwen3-8B_SFT-RL_to_Search_Qwen3-4B-Instruct-2507_SFT
4B • Updated • 4 • 1 -
baohao/ReOPD_Math-Search_Qwen3-4B-Instruct-2507_SFT-RL_to_Both_Qwen3-4B-Instruct-2507_SFT
4B • Updated • 6 -
baohao/ReOPD_Math_Qwen3-4B-Instruct-2507_SFT-RL_to_Math_Qwen3-4B-Instruct-2507_SFT
4B • Updated • 6 -
baohao/ReOPD_Search_Qwen3-4B-Instruct-2507_SFT-RL_to_Search_Qwen3-4B-Instruct-2507_SFT
4B • Updated • 5 -
baohao/ReOPD_Math_Qwen3-8B_SFT-RL_to_Math_Qwen3-4B-Instruct-2507_SFT
4B • Updated • 22 • 1 -
baohao/SFT_Math_Qwen3-4B-Instruct-2507_SFT_on_Math_Qwen3-8B_SFT-RL_trace
4B • Updated • 6 • 1 -
baohao/SFT_Math_Qwen3-4B-Instruct-2507_SFT_on_Math_Qwen3-4B-Instruct-2507_SFT-RL_trace
4B • Updated • 6 • 1 -
baohao/Both_Qwen3-4B-Instruct-2507_SFT
4B • Updated • 4 • 1 -
baohao/aime24
Viewer • Updated • 30 • 324 -
baohao/aime25
Viewer • Updated • 30 • 290 -
baohao/amc23
Viewer • Updated • 40 • 288 -
baohao/minerva_math
Viewer • Updated • 272 • 250 -
baohao/olympiadbench
Viewer • Updated • 675 • 272 -
baohao/math500
Viewer • Updated • 500 • 298 -
baohao/search-test
Viewer • Updated • 51.7k • 113 -
baohao/search-train
Viewer • Updated • 6.5k • 88 • 1 -
baohao/search-cold-start
Viewer • Updated • 2k • 40 • 1 -
baohao/math-cold-start
Viewer • Updated • 2k • 83 • 1 -
baohao/math-train
Viewer • Updated • 6.4k • 96 -
baohao/Math_Qwen3-4B-Instruct-2507_SFT-RL_Prefix
Viewer • Updated • 81.9k • 95 • 1 -
baohao/Math_Qwen3-8B_SFT-RL_Prefix
Viewer • Updated • 53.8k • 61 -
baohao/Math_Qwen3-30B-A3B-Instruct-2507_SFT-RL_Prefix
Viewer • Updated • 54.7k • 65 • 1 -
baohao/Search_Qwen3-4B-Instruct-2507_SFT-RL_Prefix
Viewer • Updated • 145k • 65 • 2 -
baohao/Search_Qwen3-8B_SFT-RL_Prefix
Viewer • Updated • 141k • 62 • 1 -
baohao/both-cold-start
Viewer • Updated • 4k • 66