Forum Discussion

AnthonyGenovese's avatar
AnthonyGenovese
Icon for Resolver III rankResolver III
3 years ago

Data Source Credentials Invalid - From STAGING to LAKEHOUSE, Not touching Gateway

We are trying a new pattern to load data to get around the issue of long running queries not letting us load data into Fabric. The patter is loading smaller sets of data into staging as its own data...
Dataflows
Need Help
DennesTorres's avatar
DennesTorres
Icon for Power Participant rankPower Participant
3 years ago

Hi,

Dataflows Gen 2 have a staging feature, so it's not clear in your question if "staging" is something you created or if it's the Dataflow Gen 2 staging.

 

Unless I'm mistaken, the Dataflow Gen 2 staging is not intended to be directly used by us. In fact, it's possible in a future moment these objects would not even be visible.

Kind Regards,

 

Dennes

  • AnthonyGenovese's avatar
    AnthonyGenovese
    Icon for Resolver III rankResolver III
    3 years ago

    You are mistaken. This pattern was given directly to me from the Dataflows team. In addition, there was a blog post about using staging from Chris Webb last week.

    • DennesTorres's avatar
      DennesTorres
      Icon for Power Participant rankPower Participant
      3 years ago

      Hi,

      It's a fact that I still need to read a lot about the staging for dataflows, but for you to know where I got the information, I'm quoting the community admin:

      "Note that we're working towards hiding these staging artifacts in the future, and it is not recommended for users to make direct changes to them (other than those triggered by their use of Dataflows capabilities such as computed entities)."

      It's on this link: https://community.fabric.microsoft.com/t5/Dataflows/Dataflow-Staging/m-p/3383380#M678

      Kind Regards,

       

      Dennes

      • AnthonyGenovese's avatar
        AnthonyGenovese
        Icon for Resolver III rankResolver III
        3 years ago

        Yah, that is specifically talking about the artificats in your workspace that popup when you create a lakehouse. You should definately not touch those. It will screw everything up if you delete it.