Forum Discussion

Dhairya's avatar
Dhairya
Solution Supplier
2 years ago
Solved

Does Dataflow Gen2 Store Data?

In Fabric, if we create Dataflow Gen 2 does it store data with or without specifying a destination, while importing data in Power BI Desktop using Dataflow Gen 2 as a source it displays the data and I haven't specified the destination while creating the Dataflow.

  • Anonymous's avatar
    Anonymous
    2 years ago

    Hi Dhairya 

     

    When you create a Dataflow Gen 2, you have the option to specify a data destination for each query in your dataflow.

     

    This means that you can choose where to store the output of your data transformation, and use different destinations for different queries within the same dataflow.

     

    However, specifying a data destination is not mandatory. If you do not specify a data destination, the data will be stored in the dataflow’s internal storage by default.

     

    Dataflows gen 2 data destinations and managed settings | Microsoft Fabric Blog | Microsoft Fabric

     

    When setting up Dataflow Gen2, you must connect it to an Azure Data Lake Storage Gen2 account.

     

    This acts as the specified destination for your data. The integration of Power BI dataflows with ADLS Gen2 enables enhanced data management, storage, and security features.

     

    Configuring dataflow storage to use Azure Data Lake Gen 2 - Power BI | Microsoft Learn

     

    Once your dataflow is configured to store data in ADLS Gen2, you can import this data into Power BI Desktop using the Azure Data Lake Storage Gen2 connector.

     

    This process involves connecting to your ADLS Gen2 account from Power BI Desktop and navigating to the data you wish to import.

     

    Regards,

    Nono Chen

    If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

5 Replies

  • Anonymous's avatar
    Anonymous
    Not applicable

    Yes, the is an Azure storage account plus container hidden behind the scenes that stores the data in parquet structure

  • Anonymous's avatar
    Anonymous
    Not applicable

    Hi Dhairya 

     

    When you create a Dataflow Gen 2, you have the option to specify a data destination for each query in your dataflow.

     

    This means that you can choose where to store the output of your data transformation, and use different destinations for different queries within the same dataflow.

     

    However, specifying a data destination is not mandatory. If you do not specify a data destination, the data will be stored in the dataflow’s internal storage by default.

     

    Dataflows gen 2 data destinations and managed settings | Microsoft Fabric Blog | Microsoft Fabric

     

    When setting up Dataflow Gen2, you must connect it to an Azure Data Lake Storage Gen2 account.

     

    This acts as the specified destination for your data. The integration of Power BI dataflows with ADLS Gen2 enables enhanced data management, storage, and security features.

     

    Configuring dataflow storage to use Azure Data Lake Gen 2 - Power BI | Microsoft Learn

     

    Once your dataflow is configured to store data in ADLS Gen2, you can import this data into Power BI Desktop using the Azure Data Lake Storage Gen2 connector.

     

    This process involves connecting to your ADLS Gen2 account from Power BI Desktop and navigating to the data you wish to import.

     

    Regards,

    Nono Chen

    If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

    • Angith_Nair's avatar
      Angith_Nair
      Continued Contributor

      Hi Anonymous 

      Thank you for your valuable answer.
      "If you do not specify a data destination, the data will be stored in the dataflow’s internal storage by default."
      Does that mean if we specify a destination then the data will not be stored internally..?

      • Anonymous's avatar
        Anonymous
        Not applicable

        Hi Angith_Nair 

         

        It depends on the type of data destination you specify.

         

        Some data destinations, such as Azure Data Lake Storage or Azure SQL Database, allow you to copy the data from the dataflow’s internal storage to the destination, while others, such as Power BI datasets, allow you to move the data from the internal storage to the destination.

         

        If you copy the data, it will still be stored internally, but if you move the data, it will not be stored internally.

         

        Regards,

        Nono Chen

        If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.