New arXiv paper introduces NEO-VLA, an encoder-free vision-language-action model
A preprint on arXiv presents NEO-VLA, a vision-language-action framework that drops the separate visual encoder used in most manipulation policies. Images are split into patches by lightweight convolutional layers and then processed alongside language through the same backbone, so a flow-matching action expert can draw on instruction-conditioned visual features at several depths. In controlled comparisons, the authors report that this native design beats encoder-based versions, that full fine-tuning narrows the gap without closing it, and that added scale alone does not recover it. Layer-wise probing found action-critical signals often peak well before the final visual representation.
Why it matters
Robot policies usually act on a single fixed encoder output, and this work finds task-critical visual detail often appears earlier in the network. That points to manipulation systems that read visual computation at multiple depths for finer geometry and steadier behavior under distribution shift.
Sources
- PrimaryHugging Face Papers
Written by AIToolMaps from the source above and checked against it sentence by sentence.