Does Dataflow Gen2 Store Data?

[Dhairya]

In Fabric, if we create Dataflow Gen 2 does it store data with or without specifying a destination, while importing data in Power BI Desktop using Dataflow Gen 2 as a source it displays the data and I haven't specified the destination while creating the Dataflow.

[Anonymous · Accepted solution]

Hi @Dhairya 

When you create a Dataflow Gen 2, you have the option to specify a data destination for each query in your dataflow.

This means that you can choose where to store the output of your data transformation, and use different destinations for different queries within the same dataflow.

However, specifying a data destination is not mandatory. If you do not specify a data destination, the data will be stored in the dataflow’s internal storage by default.

Dataflows gen 2 data destinations and managed settings | Microsoft Fabric Blog | Microsoft Fabric

When setting up Dataflow Gen2, you must connect it to an Azure Data Lake Storage Gen2 account.

This acts as the specified destination for your data. The integration of Power BI dataflows with ADLS Gen2 enables enhanced data management, storage, and security features.

Configuring dataflow storage to use Azure Data Lake Gen 2 - Power BI | Microsoft Learn

Once your dataflow is configured to store data in ADLS Gen2, you can import this data into Power BI Desktop using the Azure Data Lake Storage Gen2 connector.

This process involves connecting to your ADLS Gen2 account from Power BI Desktop and navigating to the data you wish to import.

Regards,

Nono Chen

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

[Angith_Nair]

Hi @Anonymous 

Thank you for your valuable answer.
"If you do not specify a data destination, the data will be stored in the dataflow’s internal storage by default."
Does that mean if we specify a destination then the data will not be stored internally..?

[Anonymous]

Hi @Angith_Nair 

It depends on the type of data destination you specify.

Some data destinations, such as Azure Data Lake Storage or Azure SQL Database, allow you to copy the data from the dataflow’s internal storage to the destination, while others, such as Power BI datasets, allow you to move the data from the internal storage to the destination.

If you copy the data, it will still be stored internally, but if you move the data, it will not be stored internally.

Regards,

Nono Chen

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

[Angith_Nair]

Got it. Thanks a lot.

[Anonymous]

Yes, the is an Azure storage account plus container hidden behind the scenes that stores the data in parquet structure