Create Dataset from DataFlow using PowerBI Pro

[Bromo98]

Happy Holidays folks, I am relatively new to PowerBI and hit a wall with an entity that I've created in Dataflow on Power BI Pro.

The idea was to create an entity and setup the refresh rate then to generate a report in PowerBI cloud using the dataset so I can Publish to Web.  I can't figure out how to create a dataset from it using the PowerBI Pro and not Power BI desktop.

Any guidance or thoughts on what I am doing wrong or what I am missing ?

Thank you in advance for all your feedback and assistance.

Regards,
Mohamed

[v-xuding-msft]

Hi @Bromo98 ,

Currently, we only can create datasets using dataflow in Power BI Desktop. It is not supported in Service directly. There is a similar idea that you could vote up. Or you could create a new idea to submit your request and vote it up.

https://ideas.powerbi.com/forums/265200-power-bi-ideas/suggestions/39156334-dataflow-based-datasets-...

Reference:

https://docs.microsoft.com/en-us/power-bi/service-dataflows-create-use#connect-to-your-dataflow-in-p...

https://docs.microsoft.com/en-us/power-bi/desktop-connect-dataflows

Best Regards,

Xue Ding

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

[Bromo98]

Thank you Xue Ding, for your response but this seems odd. 

1. With Power BI Pro, we can upload a dataset and create a report based on it. 
2. Data Flow allows a user to establish a LIVE connection via OData and establish a refresh with cleaning rules which is great but based on what you've said it drops the ball since there is no ability in the cloud service (PowerBI Pro) to connect to the dataflow to generate a dataset from it.
3. Instead we have to connect to the dataflow from Power BI Desktop to generate the dataset so we can create a report and publish it to the web which adds an extra step of using PowerBI desktop. This defeats the ability to establish a LIVE connection (OData) since PowerBI desktop is the only way to connect to the DataFlow established on a Shared Workspace.

Is anything that I said in statement 3 incorrect ? 

I have gone ahead and published the dataset back to my workspace but is it possible to have a report published from PowerBI Desktop that is constantly updated based on the DataFlow and does the device that published the report need to be constantly online to maintain the LIVE reporting?

Sorry if I am asking newbie questions as I am trying to understand/learn this as I tinker with PowerBI.

Regards,

Mohamed

[Bromo98]

Using Power BI Desktop, I've established a connection to the DataFlow and published the report to the shared workspace. 

1. I manually triggered a refresh on the DataFlow but the update was not reflected in the PowerBI Desktop.
2. I triggered a manual refresh on PowerBI Desktop and the update was not reflected in the published report in the shared workspace.
3. The published report in the shared workspace was manually refreshed but the change is not reflected there either.
4. Is it possible to automate the refresh in PowerBI Desktop to pull the from the DataFlow ?

What am I doing wrong in Steps A thru C ?

Regards,

Mohamed

[v-xuding-msft]

Hi @Bromo98 ,

1. When you refreshed data in service, you actually refreshed the data source. And it is live connection to get data from dataflow in Desktop. So the data is always latest. You just need to re-open the file to check it.

2. When you refreshed data in Desktop, you actually refreshed the dataflow. It is the data source that you connected. So the original  data source that dataflow connected is not refreshed. (After you connected data in Service using dataflow, data will be stored. )  So the updated data will be not reflected in the published report in the shared workspace.

3. The scenario is the same as 1.

4.You could configure scheduled refresh or try incremental refresh if you have premium license. Then your on-premise pbix file will be always latest while be opened.

Best Regards,

Xue Ding

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

[Bing]

Hi Xue Ding,

In the past, I used to use automate trigger refresh fror PBI dataset when a new item is created in SharePoint List, now I move to PBI dataflow and my entities don't have date/time filed, so incremental refresh cannot work, do we have another way to refresh PBI dataflow when a new item is created in SharePoint List? Thanks.

[Bromo98]

Hi, thanks again for responding.  I've colour coded our responses to track responses.  Your response is in blue and my response to you is in green.  I've also attached screenshots to illustrate some of my points.

Regards,

Mohamed

1.     I manually triggered a refresh on the DataFlow but the update was not reflected in the PowerBI Desktop.

When you refreshed data in service, you actually refreshed the data source. And it is live connection to get data from dataflow in Desktop. So the data is always latest. You just need to re-open the file to check it.

I’ve confirmed that the DataFlow (Figure 1) was refreshed (n=2152), and I tried to re-open the PBIX file as you stated but its not showing the latest data (it shows n=2144) until I hit the refresh button located in the ribbon. 

1.     I triggered a manual refresh on PowerBI Desktop and the update was not reflected in the published report in the shared workspace.

When you refreshed data in Desktop, you actually refreshed the dataflow. It is the data source that you connected. So the original data source that dataflow connected is not refreshed. (After you connected data in Service using dataflow, data will be stored. )  So the updated data will be not reflected in the published report in the shared workspace.

I understand that when the PowerBI Desktop is refreshed it didn’t refresh the DataFlow.  It simply pulled the latest data (n=2152) in the DataFlow but what I was trying to understand is whether the published report from Power BI Desktop will and based on your answer its won’t be updated with the latest data (it will only show n=2144).

1.     The published report in the shared workspace was manually refreshed but the change is not reflected there either.

The scenario is the same as 1.

I am not following you here.  I’ve confirmed Power BI Desktop’s published report on PowerBI Pro was refreshed (Figure 2 and Figure 3) but the report based on the data set only shows the n=2144 instead of n=2152.  What am I missing from allowing the report to automatically be updated to changes to the dataset ?

1.     Is it possible to automate the refresh in PowerBI Desktop to pull the from the DataFlow ?

You could configure scheduled refresh or try incremental refresh if you have premium license. Then your on-premise pbix file will be always latest while be opened.

I have Power BI Pro.  The link you’ve supplied points to configuring PowerBI cloud service to schedule refresh and not how configure the refresh in PowerBI Desktop.  Based on the readings I’ve gone through PBI Desktop is not capable of doing a scheduled refresh.

Figure 1. Dataflow - Refresh Confirmed

Figure 1. Dataflow - Refresh Confirmed

Figure 3. Dataset - Scheduled refresh

Figure 3. Dataset - Refresh Confirmed

 Figure 2. Dataset - Refresh Confirmed

Figure 2. Dataset - Scheduled Refresh