Forum Discussion

Anonymous's avatar
Anonymous
Not applicable
3 years ago
Solved

Best practice Power BI Dataflows Architecture

Dear community, 

 

info: 
- 10 factories, each has a own Sharepoint folder with 12 Excel files for every month

- Every Excel file has 5 different tables

- Power Automate is blocked in my organization

 

my idea:

- set up a dataflow for every factory which has 5 tables

- append all files from the specific factory dynamically to one of the corresponding 5 main tables

- Reference all factory dataflows to one major dataflow

- All factories & all dataflows are within the same Premium Workspace

- Connect Power BI Desktop to the major dataflow and publish the report

 

--> The Power BI Pro Users from the factories can add a file in their folder (e.g. for a new monthh), then refresh the dataflow of their specific factory. As all factory flows are referenced to the majr flow, the major flow will refreshed automatically as soon as a factory flow has been refreshed (is that correct?). 

 

--> Then in the next step the Users have to manually refresh the dataset. Ater that the Report would show the refreshed data.  

 

Will my ideas work / do you have any suggestions for a better architecture?

 

Thank you for your support! 🙂
Lukas 

 

 

 

  • Hi Anonymous,

     

    A Power BI Premium subscription is required to refresh more than 10 dataflows across workspaces.

    Refresh limits for shared dataflows are limited to two hours per entity and three hours per dataflow.

    For Power BI Premium, the only limit for Power BI Premium is 24 hours per dataflow refresh.

     

    I think you can refer to the following documentation that may be helpful to you.

    Dataflow best practices - Power BI | Microsoft Learning

    Solved: All tables to dataflows - Microsoft Power BI community

     

    Best Regards,
    Community Support Team _ xiaosun

    If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

  • Hi Anonymous ,

     

    There are two types of refreshes applicable to dataflows: Full and Incremental (Premium only).

    For Power BI Premium, guidance and limits are driven by individual use cases rather than specific requirements. The only limit for Power BI Premium is a 24-hour refresh per dataflow.

    Moreover, there are some considerations when you refresh dataflows in Premium. Please reference the following document.

    Understanding and optimizing dataflows refresh - Power BI | Microsoft Learn

     

    Best Regards,
    Community Support Team _ xiaosun

    If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

3 Replies

  • v-xiaosun-msft's avatar
    v-xiaosun-msft
    Icon for Community Support rankCommunity Support

    Hi Anonymous,

     

    A Power BI Premium subscription is required to refresh more than 10 dataflows across workspaces.

    Refresh limits for shared dataflows are limited to two hours per entity and three hours per dataflow.

    For Power BI Premium, the only limit for Power BI Premium is 24 hours per dataflow refresh.

     

    I think you can refer to the following documentation that may be helpful to you.

    Dataflow best practices - Power BI | Microsoft Learning

    Solved: All tables to dataflows - Microsoft Power BI community

     

    Best Regards,
    Community Support Team _ xiaosun

    If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

    • Anonymous's avatar
      Anonymous
      Not applicable

      Hi, 

       

      thank you for your answer. We have a Premium Workspace and all data flows are within that workspace. 

      Do we have any limitations for refreshing the flows? 

      • v-xiaosun-msft's avatar
        v-xiaosun-msft
        Icon for Community Support rankCommunity Support

        Hi Anonymous ,

         

        There are two types of refreshes applicable to dataflows: Full and Incremental (Premium only).

        For Power BI Premium, guidance and limits are driven by individual use cases rather than specific requirements. The only limit for Power BI Premium is a 24-hour refresh per dataflow.

        Moreover, there are some considerations when you refresh dataflows in Premium. Please reference the following document.

        Understanding and optimizing dataflows refresh - Power BI | Microsoft Learn

         

        Best Regards,
        Community Support Team _ xiaosun

        If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.