Fabric Data Agents can now capture feedback from consumers. This is valuable, but reviewing feedback manually does not create a repeatable quality assurance process. Please allow Data Agent owners to convert a user question, incorrect answer, or negative feedback item directly into a reusable evaluation test case. The test case should store the original question, expected data source, expected measures or fields, expected query behavior, expected answer criteria, and optional reviewer notes. Creators should be able to maintain a library of these tests and run the complete evaluation suite before publishing changes to agent instructions, semantic model configuration, query templates, ontology context, or other agent settings. Fabric should compare results between the current and proposed agent versions and highlight Pass, Fail, Improved, and Regressed results. This would turn real production feedback into a continuous improvement and regression testing process for Fabric Data Agents.
No CommentsBe the first to comment
