Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Be one of the first to start using Fabric Databases. View on-demand sessions with database experts and the Microsoft product team to learn just how easy it is to get started. Watch now

Reply
v-cyu
Microsoft Employee
Microsoft Employee

How many pipeline copy activities can be writing into the same Lakehouse Table at once?

As titled

1 ACCEPTED SOLUTION
v-zhangtin-msft
Community Support
Community Support

Hi, @v-cyu 

 

From the information I found, it appears that there isn't a specific limit on the number of pipeline copy activities that can write into the same Lakehouse Table at once.

 

More information can be found in the following documentation: Configure Lakehouse in a copy activity - Microsoft Fabric | Microsoft Learn

 

Best Regards,

Community Support Team _Charlotte

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

View solution in original post

2 REPLIES 2
Houston-ho
Advocate I
Advocate I

A bit curious why you need multiple pipeline copy activities into same table in lake house.
I guess all those pipelines are having different data sources or transformation, but with same schema in the destination lakehouse table, plsu you are talking about "append" not "overwrite", otherwise, that looks a bit strange.

Houstonho_0-1726236904149.png

 

If all the above assumptions are true, that make sense.

And yes, seems no stated limitation, but i believe your might consider what file format are actually stored in the Onelake, if they are column based like Parquet, ok, if they are partitioned appropriately, even better. However, if your lake house table is just a huge CSV file, i doubt the performance issue on multiple pipelines writing on it.

v-zhangtin-msft
Community Support
Community Support

Hi, @v-cyu 

 

From the information I found, it appears that there isn't a specific limit on the number of pipeline copy activities that can write into the same Lakehouse Table at once.

 

More information can be found in the following documentation: Configure Lakehouse in a copy activity - Microsoft Fabric | Microsoft Learn

 

Best Regards,

Community Support Team _Charlotte

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

Helpful resources

Announcements
Las Vegas 2025

Join us at the Microsoft Fabric Community Conference

March 31 - April 2, 2025, in Las Vegas, Nevada. Use code MSCUST for a $150 discount!

ArunFabCon

Microsoft Fabric Community Conference 2025

Arun Ulag shares exciting details about the Microsoft Fabric Conference 2025, which will be held in Las Vegas, NV.

December 2024

A Year in Review - December 2024

Find out what content was popular in the Fabric community during 2024.