Open sourceNov 18, 2026, 7:00 PM EST

WeMM-Video releases open-source models for audio-visual video understanding

The WeMM-Video report introduces a family of Chinese-English bilingual omni-modal models at 2B, 4B, 9B and 35B-A3B sizes, built around joint audio-visual perception and reasoning. They handle text, images, audio and video in one system, with an instruct mode for direct answers and a thinking mode for step-by-step reasoning. Training covered roughly 1.2 trillion tokens using progressive pre-training plus multi-stage post-training with multi-teacher OPD, anti-repetition MrDPO and specialist reinforcement learning. The authors report evaluations across more than 120 benchmarks, saying the flagship 35B-A3B model sets a new open-source state of the art on omni-modal video tasks, beating Qwen3.5-Omni-Flash and Seed2.0-Mini-0428 and narrowing the gap to Gemini-3.0-Flash, while the 9B model surpasses Qwen3-Omni-30B-A3B-Instruct. The model family, evaluation and reproduction pipeline are publicly released for the research community.

Sources

Written by AIToolMaps from the source above and checked against it sentence by sentence.

Comments

No comments yet