ResearchNov 3, 2026, 7:00 PM EST

TurnWise applies turn-level credit assignment to streaming video RL

A paper on arXiv describes TurnWise, a reinforcement learning framework for streaming video understanding, where a model repeatedly decides whether to answer or keep observing. The authors note that existing GRPO-based approaches keep a single trajectory-level advantage across turns, which they say can reinforce redundant replies after earlier successes and discourage useful follow-ups after failures. TurnWise instead assigns credit per turn, using silence-completed prefix scoring to build group-relative advantages from each decision's remaining return. It also averages token losses within each turn before averaging across turns, so responding and waiting carry equal weight regardless of output length. The authors report it outperforms prior RL approaches in their experiments without a learned critic or extra rollouts.

Why it matters

Assistants that watch a video stream have to judge when to speak and when to stay quiet; scoring each decision separately, rather than the whole session at once, could make those choices less redundant and more responsive without a critic model or added rollouts.

Sources

Written by AIToolMaps from the source above and checked against it sentence by sentence.

Comments

No comments yet