NVIDIA open-sources Attribution tool for diagnosing AI workload failures
NVIDIA has released NVIDIA Attribution as open source, a system that ties failures in distributed AI jobs back to their actual origin instead of the point where training stopped. It ships as two pieces: a Service that exposes a REST API around the attribution engine, and a Blueprint, a Python orchestrator that pulls scheduler and telemetry data from Slurm, Kueue, Loki, Kubernetes pod logs, local files and PromQL metrics. NVIDIA says it has run the system in production across hundreds of thousands of GPUs, analyzing millions of workloads weekly. The repository, a quickstart with sample workloads and a local diagnosis dashboard, and Blueprint configuration docs are available now for teams running their own clusters.
Sources
- PrimaryNVIDIA Developer
Written by AIToolMaps from the source above and checked against it sentence by sentence.