WeMM-Video releases open-source models for audio-visual video understanding
The WeMM-Video report introduces a family of Chinese-English bilingual omni-modal models at 2B, 4B, 9B and 35B-A3B sizes, built around joint audio-visual perception and reasoning. They handle text, images, audio and video in one system, with an instruct mode for direct answers and a thinking mode for step-by-step reasoning. Training covered roughly 1.2 trillion tokens using progressive pre-training plus multi-stage post-training with multi-teacher OPD, anti-repetition MrDPO and specialist reinforcement learning. The authors report evaluations across more than 120 benchmarks, saying the flagship 35B-A3B model sets a new open-source state of the art on omni-modal video tasks, beating Qwen3.5-Omni-Flash and Seed2.0-Mini-0428 and narrowing the gap to Gemini-3.0-Flash, while the 9B model surpasses Qwen3-Omni-30B-A3B-Instruct. The model family, evaluation and reproduction pipeline are publicly released for the research community.
Sources
- PrimaryHugging Face Papers
Written by AIToolMaps from the source above and checked against it sentence by sentence.