How do you transfer a Parquet file e to the warehouse

[GuillaumePower]

Hello, In Fabric how do you transfer a Parquet file from Lake House to the warehouse ? I ve a not so big Parquet File, that i've put in the LakeHouse and I would like to put it in the DWH but,  how to do that ?

Thanks in advance ?

[v-shex-msft · Accepted solution]

Hi @GuillaumePower,

As NandanHegde said, you can consider to use data pipeline to ingest data from lakehouse to data warehouse.

You can use pipeline add a 'copy data activity' at first.
In the source step, choose your lakehouse and select your file with parquet format. At the destination step, setting the connection to the data warehouse.

Tutorial link about data ingest:

Data warehouse tutorial - ingest data into a Warehouse in Microsoft Fabric - Microsoft Fabric | Micr...

Regards,

Xiaoxin Sheng

[GuillaumePower · Accepted solution]

Thanks, that has run even the DWH table was not ready in the 30 minutes. I ve seen that the data have been moved only 3 hours later.

[GuillaumePower · Accepted solution]

Thanks, that has run even the DWH table was not ready in the 30 minutes. I ve seen that the data have been moved only 3 hours later.

[frithjof_v · Accepted solution]

That sounds surprisingly slow.

Perhaps a temporary issue.

You could also try using Dataflow Gen2 (however copy activity in data pipeline is generally regarded as being faster than Dataflow Gen2).

[v-shex-msft · Accepted solution]

Hi @GuillaumePower,

As NandanHegde said, you can consider to use data pipeline to ingest data from lakehouse to data warehouse.

You can use pipeline add a 'copy data activity' at first.
In the source step, choose your lakehouse and select your file with parquet format. At the destination step, setting the connection to the data warehouse.

Tutorial link about data ingest:

Data warehouse tutorial - ingest data into a Warehouse in Microsoft Fabric - Microsoft Fabric | Micr...

Regards,

Xiaoxin Sheng

[NandanHegde]

Have you tried using fabric data pipeline copy activity to copy from lake house to fabric warehouse?