Forum Discussion

jlll's avatar
jlll
Frequent Visitor
7 months ago

Fabric Data Agent SDK Issue when evaluating different agent configurations on the same eval set

Hello, I was wondering if I could get some help with an issue with the Fabric Data SDK 

evaluate_data_agent() command. When I run this, I get an error for pretty much every single one of my eval threads. Below is a screen shot of the error I get.

 

Is there a known way to resolve this issue? It seems as though the data agent caches questions and isn't able to repeat them back?
I don't get this problem when running the command on fresh new eval pairs, but every subsequent run after results in this exact same "Failed to execute step (RAID: 0bd7d288-aee9-49e1-817f-be7ad93889e1). Error: An item with the same key has already been added. Key: What is the count of unique clients in the dataset?" Error
Would be great to get some help on this!
data hub

3 Replies

  • v-prasare's avatar
    v-prasare
    Icon for Community Support rankCommunity Support
    7 months ago

    Hi jlll,

     

    If your blocked on this i suggest, raising a support ticket for further assistance.
    To raise a support ticket for Fabric and Power BI, kindly follow the steps outlined in the following guide:

    How to create a Fabric and Power BI Support ticket - Power BI | Microsoft Learn

    How to create a Fabric and Power BI Support ticket - Power BI | Microsoft Learn

    Learn how to create a support ticket for Fabric and Power BI, depending on your role (administrator versus user).

     

     

    Thanks,

    prashanth

    • jlll's avatar
      jlll
      Frequent Visitor
      7 months ago

      Okok, thank you for your help

  • v-prasare's avatar
    v-prasare
    Icon for Community Support rankCommunity Support
    7 months ago

    Hi jlll,

    We are following up once again regarding your query. Could you please confirm if the issue has been resolved through the support ticket with Microsoft?
    If the issue has been resolved, we kindly request you to share the resolution or key insights here to help others in the community. If we don’t hear back, we’ll go ahead and close this thread. Should you need further assistance in the future, we encourage you to reach out via the Microsoft Fabric Community Forum and create a new thread. We’ll be happy to help.

    Thank you for your understanding and participation.