Connecting to Warehouse within dataflow gen2 next to on-premise connection

[Anonymous]

Suppose I want to implement a dataflow gen2 with a behaviour like described here: https://learn.microsoft.com/en-us/fabric/data-factory/tutorial-setup-incremental-refresh-with-datafl... 

So, I want a connection to my on-premise oracle database, and I want a connection to my data warehouse. I have two connections to my warehouse, one where I chose "none" as Data gateway, and one where I chose the same Data gateway which I use for the oracle database.

Both of the connections can be "refreshed" in the "Manage connections" screen, and give me a status of "Online".

First question: Which of the two connections should I use and why? Can I use both? Does it matter?

When I unlink the connection above, and try to use the other connection, I fail to sign-in, with the following warning:

What does it mean? Why is it failing? What should I do?

As you might guess, the dataflow overall fails, when I try to "Publish" and run it.

I get different kinds of errors, like these:

HALL_BI_CUSLOADPROFILEVALUES_WriteToDataDestination: Challenge Error Data source credentials are missing or invalid. Please update the connection credentials in settings, and try again.Warning: We found that your gateway version is lower than the recommended gateway version. Details: Found version: 3000.214.9 Recommended version: 3000.216 (Request ID: dcd12709-1345-484b-8da7-e6644b4dbc7e).

HALL_BI_CUSLOADPROFILEVALUES: Error Code: Mashup Exception Expression Error, Error Details: Couldn't refresh the entity because of an issue with the mashup document MashupException.Error: Fehler beim Einfügen einer Tabelle., InnerException: Die Spalte "#{0}" der Tabelle wurde nicht gefunden., Zugrunde liegender Fehler: Die Spalte "Column1" der Tabelle wurde nicht gefunden. Details: Reason = Expression.Error;Message = Die Spalte "Column1" der Tabelle wurde nicht gefunden.;Detail = Column1;Message.Format = Die Spalte "#{0}" der Tabelle wurde nicht gefunden.;Message.Parameters = {"Column1"};Microsoft.Data.Mashup.Error.Context = System GatewayObjectId: 83375c91-f9ad-4511-8d51-177586459a2e (Request ID: 79e38240-4550-43fe-8a8e-8774ab902edf).Warning: HALL_BI_CUSLOADPROFILEVALUES: Error Code: OptimizationNotSupported, Error Details: Fast Copy is not supported for any of the data sources in the source expression. (Request ID: 79e38240-4550-43fe-8a8e-8774ab902edf)

I will try to switch from data warehouse as a target to a lakehouse, plus disable staging - maybe this will help.

I am happy to hear from you'all,

best regards,

Sebastian

[v-linyulu-msft · Accepted solution]

Hi,@Anonymous 

Regarding the issue you raised, my solution is as follows:
1.First, regarding your first question: choosing a data gateway. You can choose both, and in our tests, data was configured correctly with both choices. However, we suggest you'd better configure the gateway, because after configuring the gateway, you can keep the data refresh efficiently when you do the data refresh subsequently, if you don't configure it, it may have an impact on your subsequent work.

 Secondly, in the upload interface, if you select "None", it will directly display your current powerbi account, if you select a gateway, it will ask you to log in to verify the information, as shown in the figure below. If you select a gateway, it will ask you to verify your login information, as shown in the picture below.

You can't select both at the same time, or the following similar error screenshot will appear.

Here is the relevant documentation:

Using an on-premises data gateway in Power Platform dataflows - Power Query | Microsoft Learn

An overview of dataflows across Microsoft Power Platform and Dynamics 365 products - Power Query | Microsoft Learn
2. Based on your reported error message, you can try the following steps:

First, check if your connection credentials have permission to access the database. Your database connection may require your hosting domain user instead of your powerbi login account. In your scenario, you can try using a data gateway.
You can also edit the voucher directly in the image below:

Second, check if there is any problem with your network connection and if the firewall is affecting your normal data connection.

Finally, check if your gateway version needs to be updated.

If the above doesn't work, you can also try troubleshooting with the link below:
Troubleshoot gateways - Power BI | Microsoft Learn

Best Regards,

Leroy Lu

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.