Forum Discussion

EC7865's avatar
EC7865
New Member
1 year ago
Solved

SharePoint Document library metadata Power BI report and incremental refresh

Hello,    I am hoping someone can help with the following scenario.  I have a SharePoint document library (not the main 'documents' one, another library created in the same site), with folders, ...
Need Help
Tutorial Requests
  • v-csrikanth's avatar
    v-csrikanth
    1 year ago

    Hi EC7865 
    Instead of relying on incremental refresh, use Power Automate to trigger dataset refreshes only when needed, reducing unnecessary processing.

    Steps to create PA flow:

      • Use the “when a file is created or modified (properties only)” trigger from SharePoint.
      • Filter to check if it’s a new file, modified file, or metadata update.
      • Add the "Refresh a dataset" action to refresh only the required dataset.

    Note: Refreshes only when required, instead of processing the entire dataset each time.


    Power BI dataflows support query folding, using dataflows instead of direct Power BI queries can improve refresh performance.
    Steps to create a Dataflow in Power BI Service:

    • Connect to the SharePoint document lib using dataflows instead of BI Desktop.
    • Perform transformations inside dataflows.
    • Load into Power BI Dataset with Incremental Refresh.
           Since Dataflows support folding, Incremental Refresh works correctly.

    Ref link: https://learn.microsoft.com/en-us/power-apps/maker/data-platform/create-and-use-dataflows 

     

    If the above information helps you, please give us a Kudos and marked the reply Accept as a Solution.

    Thanks,
    Cheri Srikanth

     

v-csrikanth's avatar
v-csrikanth
Community Support
1 year ago

Hi EC7865 
Instead of relying on incremental refresh, use Power Automate to trigger dataset refreshes only when needed, reducing unnecessary processing.

Steps to create PA flow:

    • Use the “when a file is created or modified (properties only)” trigger from SharePoint.
    • Filter to check if it’s a new file, modified file, or metadata update.
    • Add the "Refresh a dataset" action to refresh only the required dataset.

Note: Refreshes only when required, instead of processing the entire dataset each time.


Power BI dataflows support query folding, using dataflows instead of direct Power BI queries can improve refresh performance.
Steps to create a Dataflow in Power BI Service:

  • Connect to the SharePoint document lib using dataflows instead of BI Desktop.
  • Perform transformations inside dataflows.
  • Load into Power BI Dataset with Incremental Refresh.
         Since Dataflows support folding, Incremental Refresh works correctly.

Ref link: https://learn.microsoft.com/en-us/power-apps/maker/data-platform/create-and-use-dataflows 

 

If the above information helps you, please give us a Kudos and marked the reply Accept as a Solution.

Thanks,
Cheri Srikanth