Solved: Re: Merged Queries not working in Dataflow and Dat...

bryanshaw46 · ‎02-22-2023

We have on-premises gateways that are clustered. We have data from a lot of data sources. Some of these are large and some small.

When we try to do dataflows or datamarts using merged queries, they fail to refresh. This is especially true when the data is from 2 different SQL Servers.

Things we have tried:

Designating a gateway that is not clustered.

Using the same signon credentials.

Made sure the data is small.

bryanshaw46 · ‎02-23-2023

Solution - Get your data into the workspace storage first. Just get the data, no transformations. I label these stageTablename.

Make a reference to the stage tables, these will appear with a lightning bolt icon and are called Computed Tables. Dataflows will stage all of your data before doing anything with Computed Tables.

Do all of your tranformations in the Computed Tables. Perform merged queries with Computed Tables only.

Dataflows are an ETL tool. Extract your data, transform it, then load it.

View solution in original post

bryanshaw46 · ‎02-23-2023

Solution - Get your data into the workspace storage first. Just get the data, no transformations. I label these stageTablename.

Make a reference to the stage tables, these will appear with a lightning bolt icon and are called Computed Tables. Dataflows will stage all of your data before doing anything with Computed Tables.

Do all of your tranformations in the Computed Tables. Perform merged queries with Computed Tables only.

Dataflows are an ETL tool. Extract your data, transform it, then load it.

bryanshaw46 · ‎02-23-2023

More details:

Error: On-Prem execution not supported for entity '<ccon>a6a80582aca3/SiteControl</ccon>' since it refers to another entity.. Param1 = <ccon>bb45da6a80582aca3/SiteControl</ccon> Request ID: b18587d5-8ab9-ef2d-5dad-57e2826fd237.

What does this mean? How can I use it to figure out what is wrong?