Hugging Face proposes Model Integration Contracts to catch model bugs earlier

Hugging Face published transformers-mic, a proposed standard for packaging lightweight regression tests for models integrated into its Transformers library. Each contract combines a fixture shrunk from a real checkpoint's configuration, a runnable example of a common usage path, and human-reviewed baselines, then checks on a cheap CPU runner that the example still produces those results. The post says a small UMT5 fixture would have caught an attention bug that sat in main from July 30 to September 28, 2026. A command-line tool, tmic, builds contracts locally with review at each step, and published contracts live in the huggingface-mic dataset. The contract job in Transformers CI currently reports failures without blocking pull requests.