Google Research open-sources Agile Deliberation for subjective AI classifiers
Google Research introduced Agile Deliberation, a framework for building image classifiers around subjective categories such as healthy food or content-moderation cases. It guides a user through concept scoping, where broad ideas are split into subcategories and exclusions, then concept iteration, where a vision-language model surfaces borderline images and routes feedback into an automatic prompt-refinement loop. The team open-sourced the code and algorithms on GitHub for the research community. In a live study with 18 sessions, participants using the workflow produced classifiers that outperformed zero-shot, automated collaborator, and manual deliberation baselines, the researchers report.
Why it matters
For teams using AI tools to sort or moderate images, this offers a way to encode shifting human definitions through feedback on edge cases rather than one-time prompts. The open-source release lets developers try the workflow, though it is described as a research prototype.
Sources
- PrimaryGoogle Research
Written by AIToolMaps from the source above and checked against it sentence by sentence.