Forum Discussion
Best practice with dataflow and dataset
I created dataflows in PBI premium workspace, there are 2 fact dataflow (including sales and target ... ) and 1 dimension dataflow.
Now, I want to create datasets from dataflows, 1 try in 2 ways:
1. I use Power BI DataFlow to create dataset with Direct query for fact and import for dimension: It worked but I read the document that imposite model doesn't support. I got this issue:
2. I use Dataflow to import Fact and use the incremental refresh. It take time to complete the refresh, and sometimes I got this issue:
"An error happened while reading data from the provider: 'Unable to read data from the transport connection: An existing connection was forcibly closed by the remote host.'. The exception was raised by the IDataReader interface. Please review the error message and provider documentation for further information and corrective action."
Can anyone suggest to me the best way to do it with dataflow?
My fact table has 30M rows.
Thank you, everyone.
2 Replies
Hi tannhq,
May I know which official document are you referring to? In the dataflows and composite model official docuemnts, I don’t find such limitations.
Use composite models in Power BI Desktop - Power BI | Microsoft Docs
Normally, if you see the following popped bar, it means you don’t apply the changes in Power Query Editor(Transform Data) to Power BI Desktop. You need click on Apply changes to load the changes into the model.
If you would like to combine all your dataflows into one dataset, there are these strategies normally.
1 Create a dataflow based on all the upstream dataflows, and then build a dataset on it, which is supported by Premium.
Creating a dataflow - Power BI | Microsoft Docs
2 Combine the dataflow data in Power BI Desktop, but due to the large data amount, I would suggest you take Direct Query mode to the dataflows.
Using DirectQuery with dataflows - Power BI | Microsoft Docs
For your data amount is large, I would suggest you the first strategy as prefer.
If there is any post helps, then please consider Accept it as the solution to help the other members find it more quickly. If I misunderstand your needs or you still have problems on it, please feel free to let me know. Thanks a lot!
Best Regards,
Community Support Team _ Caiyun
Thanks for your respone v-cazheng-msft ,
Here is the document of premium features of dataflow limitations for DirectQuery
