topic Re: Dataflow Gen2 cant connect to data warehouse in Dataflow

Dataflow Gen2 cant connect to data warehouse

mandania — Wed, 05 Jun 2024 13:01:53 GMT

I have two workspaces, workspace A is only for Lakehouse and Warehouse. Workspace B is where i have my gen2 data flows. I can connect to workspace A lakehouse but i cannot connect to the warehouse that sits inside this workspace.

When i try to publish from Workspace B, i only see an option such as Warehouse ->staging warehouse, which seems to a default warehouse for workspace B.

I have shared the warehouse in workspace A but no luck.

How can i connect to my warehouse that sits in worksapce A from a dataflow that sits in workspace B?

The following screen show the current data warehouse during publishing.

Re: Dataflow Gen2 cant connect to data warehouse

Anonymous — Thu, 06 Jun 2024 09:51:21 GMT

Hi mandania ,

Thanks for using Fabric Community.
As I understand due to performance reasons, dataflow gen2 is only showing Warehouse in current workspace.

In your scenario I can suggest 2 options -

Option 1: Use only Dataflow Gen2
Create Dataflow Gen 2 in the workspace where the destination warehouse is located.

Option 2: Use Copy Activity along with DataflowGen2
If you are planning to create Dataflow Gen2 in Workspace A. You can create a temp warehouse in that Workspace A and publish the Dataflow Gen2. Now create a pipeline with DataFlow Gen2 and CopyActivity.

With the help of Copy Activity you can send data from Warehouse A (present in Workspace A) to Warehouse B (present in Workspace B)

Hope this is helpful. Please do let me know incase of further queries.

Re: Dataflow Gen2 cant connect to data warehouse

Ray_Minds — Thu, 06 Jun 2024 13:53:27 GMT

In fabric, we couldn't read the data from workspace A to workspace B. Data reads individually for each workspaces.
If you want to move the data from workspace A to Workspace B then you should be use Copy activity in the Data factory in the fabric

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

Re: Dataflow Gen2 cant connect to data warehouse

Anonymous — Fri, 07 Jun 2024 09:21:07 GMT

Hi mandania ,

We haven’t heard from you on the last response and was just checking back to see if your query was answered.
Otherwise, will respond back with the more details and we will try to help .

Thanks

Re: Dataflow Gen2 cant connect to data warehouse

Anonymous — Mon, 10 Jun 2024 06:07:47 GMT