Forum Discussion

st_0999's avatar
st_0999
Helper II
3 years ago

Dataflow staging?

Hi,   I finally got a Dataflow to work today. I had to disable Enable Staging for all tables except for the last table.   I had a few questions though:   Q1. What is the Enable Staging feature...
Dataflows
st_0999's avatar
st_0999
Helper II
3 years ago

Hi, 

 

Thanks for the help. For my work I decided on the following approach

 

- Load the output tables of a Dataflow to a LakeHouse

- Not use Staging (I discovered these get loaded to the LakeHouse anyway, in the Default Staging Lakehouse - the one you can't delete). And hence, with this, not use the Dataflows connector. Just the Lakehouse connector

- If a ETL is complex, that not using Staging results in a Stacked Overflow error (I got this several times), to:

1. Split the Query into smaller tables, and still send the Output table of the result to the Lakehouse

 

So effectively, I'm doing my own staging. 

 

I think, too, that the Excel I'm using is a bit old, but you still can't see the Fabric preview connectors, like you can with Power BI. 

 

Cheers, 

 

 

  • miguel's avatar
    miguel
    Community Admin
    3 years ago

    Availability of connectors relies on the product integration. You are correct that some connectors might be available in one product, but not in others, but this is by design. You can suggest new ideas to have those connectors in Excel by posting the idea on the ideas site: aka.ms/FabricIdeas

     

    If you are seeing stackoverflow errors, please do reach out to our support team so an engineer can take a closer look at it. You can use the link below to raise a support ticket:

    https://support.fabric.microsoft.com/support