Authors Release InclusionMed Benchmark for Inclusive Medical AI
The team behind InclusionMed, an open medical AI evaluation initiative, published a benchmark suite and a model index. The InclusionMed Atlas organizes evaluations by three healthcare roles and three AI capabilities; its first release selected four public benchmarks from 388 candidates after structured audits and independent reproduction. Adding the private diagnostic reasoning set InclusionMed-DxFiles, five benchmarks now cover three of the nine role-capability cells. Frontier language models scored between 17.5 and 49.1 out of 100 on the aggregate InclusionMed Index. A model's rank changed with the role or capability examined, and the ten top-ranked models all scored higher on patient communication than on clinical decision-making. Models with similar Index scores differed substantially in estimated inference cost.
Sources
- PrimaryHugging Face Papers
Written by AIToolMaps from the source above and checked against it sentence by sentence.