Thinking While Speaking: Inference-Time Knowledge Transfer for Responsive and Intelligent Conversational Voice Agents
Paper • 2511.07397 • Published • 12
YAML Metadata Warning:empty or missing yaml metadata in repo card
Check out the documentation for more information.
ConvFill Qwen3.5-4B reproduction scaffold
This repo contains a TRL SFT script to reproduce/adapt ConvFill: Model Collaboration for Responsive Conversational Voice Agents (arXiv:2511.07397) with Qwen/Qwen3.5-4B instead of SmolLM2-360M-Instruct.
Important: the paper's training corpus/code are not public yet. The script expects the same raw JSONL schema described in Section 4.1: one conversation per line, with turns containing user, responder (list of conversational phrases), and responder_thoughts (list of knowledge chunks or <|sil|>).
Training recipe implemented from the paper: 5 epochs, lr 1e-5, 500 warmup steps, cosine scheduler, added <|sil|> token, per-phrase prompt/completion expansion, completion/assistant-only SFT loss, Trackio logging, push to Hub.
Script: convfill_qwen35_repro.py.
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support