topic Re: Problems running DataFlow in Fabric in Dataflow

Problems running DataFlow in Fabric

FilipVDR — Tue, 30 May 2023 07:19:52 GMT

Problems running Dataflows within Fabric.

I'm trying to follow this step by step.

https://learn.microsoft.com/en-us/power-bi/fundamentals/fabric-get-started

I was able to create this Dataflow and a lakehouse.

I'm having issues when refreshing the Dataflow from MyWorkspace.

null Error: Data source credentials are missing or invalid. Please update the connection credentials in settings, and try again..

When in my Dataflow, and i connect with my organisational account it works, but when i go back a few moments later it is gone again. Any idea or tips?

Also: When creating a Data Pipeline i'm getting an error: Failed to load dataflows. Request failed with status code 401.

Thanks!

Re: Problems running DataFlow in Fabric

FilipVDR — Tue, 30 May 2023 07:45:59 GMT

Seems i got a similar error: even when I create a new dataflow and enter data with one column and one row, and I want to write it to the lakehouse i get an error:

It seems that the dataflow can't save my connection using my Organizational Account

Re: Problems running DataFlow in Fabric

frlunett — Tue, 30 May 2023 09:51:16 GMT

Hello FilipVDR,

thanks for reporting the issue. Would you be able to share additional information for both cases mentioned above:

- are you using a gateway to load data to the lakehouse destination?

- would you be able to share the RequestID/SessionId from the refresh operations in both cases? this will help with troubleshooting. You can find this information in the refresh history page:

Thanks,

Frank.

Re: Problems running DataFlow in Fabric

FilipVDR — Tue, 30 May 2023 10:51:57 GMT

hi Frank,

- no, even if I make a dataflow and I just enter raw data (one line, one column), that fails

Re: Problems running DataFlow in Fabric

DIMBACKA — Tue, 30 May 2023 11:13:10 GMT

Hi all,
Same issue here. It seems like the credentials used to setup the data connection are not being saved.

Re: Problems running DataFlow in Fabric

FilipVDR — Tue, 30 May 2023 11:15:27 GMT

Yes true, when I go back to the dataflow and look for the connection to write to the Datalake, I have to sign in every time I go back.

Re: Problems running DataFlow in Fabric

DIMBACKA — Tue, 30 May 2023 11:51:06 GMT

Something additionally which I notice:
It seems like the owner of the resources created by me are (correctly) assigned to my personal account.
But the auto created ones are having an owner called "My Workspace".
Could this cause the authentication issues with the (non-saved) credentials?

Re: Problems running DataFlow in Fabric

SidJay — Wed, 31 May 2023 09:36:38 GMT

We believe this is an issue specific to My Workspace which occurs in either of the following cases:

1) A query that references another query which has Load enabled

2) A query that outputs to a destination and also has Load enabled

We are investigating the issue and will release a fix as quickly as feasible.

In the interim we believe it should be possible to temporarily work around these issues by using a workspace other than My Workspace.

Thanks.

Re: Problems running DataFlow in Fabric

FilipVDR — Wed, 31 May 2023 09:53:19 GMT

Thanks! When running my testflow in an other workspace it works.

Re: Problems running DataFlow in Fabric

CSeat — Fri, 02 Jun 2023 06:51:04 GMT

Same problem, once I used a different workspace it worked fine 🙂

Re: Problems running DataFlow in Fabric

SidJay — Sat, 03 Jun 2023 19:20:16 GMT

The issues specific to "My Workspace" are now resolved. For on-premises scenarios, you need the latest version of the Gateway (3000.174.13, published on June 2nd).

Thanks.

Re: Problems running DataFlow in Fabric

DIMBACKA — Mon, 05 Jun 2023 07:24:44 GMT

Hi SidJay,

Thank you for your help.
I've updated the gateway as requested.

I'll keep you posted should the issue return.

KR.

Re: Problems running DataFlow in Fabric

Dave_De — Sat, 01 Jul 2023 23:14:44 GMT

I have the same exact issue, but in a workspace that is not My Workspace, so the workaround suggested does not work. Same exact scenario with the organizational logins and the fails are writing due to the token issue described. The pull for our Azure DB works just fine. Are you aware of that this issue is not just in My Workspace?

Re: Problems running DataFlow in Fabric

Dave_De — Sat, 01 Jul 2023 23:30:57 GMT

Also get the same error when pulling data from the Lakehouse with the Gen2 dataflow. I just used copy to successfully load data into the lakehouse I just created and then attempted to use the Lakehouse as the source and got the login error.

Re: Problems running DataFlow in Fabric

frlunett — Mon, 03 Jul 2023 10:53:56 GMT

Hello Dave_De,

would it be possible to share a screenshot of the failure you are hitting with Request/Session IDs so we can drill down into the issue?

Thanks,

Frank.

Re: Problems running DataFlow in Fabric

Dave_De — Mon, 03 Jul 2023 21:02:47 GMT

I beleive I may have found the issue. If you change the name of the lakehouse even before you have set it as a desitination in the dataflow, then it will fail, but changing it back to the original name helps it go through. Below are the screenshots: