Dataflow: Cannot be added to gateway. Used in dataset.

[daamruth]

Hi community, 

we have setup a dataset which gets it's data from an onPrem SQL. 

It contains facts and master data. 

We then decided to put the master data in a dataflow (same WS) and import the master data from there. 

It works in Power BI Desktop and I can manually refresh the dataset in the service but I cannot setup a scheduled refresh. 

Furthermore when going to the gateway connections on that DS I now have a new "datasource" which I cannot map to the gateway: 

Extension{"extensionDataSourceKind":"PowerBI","extensionDataSourcePath":"PowerBI"} : 

Cannot be added to gateway This must be the connection to the DF because when I delete my imports in PBI Desktop and upload again this new connection is gone and I can refresh again.  Furthermore all tables in the DF are of table type "pending validation".  Can anybody help me out here?  Thanks a lot Daniel 

[lbendlin]

"We then decided to put the master data in a dataflow (same WS) and import the master data from there. " 

Please explain the rationale for that decision. Assuming you use an import mode dataset and a sufficiently fast SQL server there shouldn't really be a need for a dataflow. Remember that dataflows are basically blob storage, pretty much the opposite of what you have with your SQL source.

[daamruth]

Hi @lbendlin , 

my goal is to reuse the "dimension" in other datasets as well. Isn't that one of the aspects? 

You are though right about the fact, that I could use it directly from SQL. I thought it might be an approach to centralize master data and also offer it to other apps via this cloud service as well (don't yet know how, tough :)). 

Furthermore we might switch from SQL to Snowflake or Azure in the next years. In that case the FD could serve as abstraction layer in between these platforms so the interface towards PBI stays stable. 

Makes sense? 

Daniel 

[lbendlin]

Stick with datasets.  Reserve dataflows for data sources that don't play well in the area of query performance and throughput.