Forum Discussion
Write data directly to DWH from external application?
Hi Fragmaticx,
Thank you for reaching out to Microsoft Fabric Community Forum.
It appears that you're encountering slow performance when inserting data directly into your DWH table from an external application. This often occurs if each row is being inserted individually, which is not efficient for large datasets.
Consider using data pipelines to load bulk data from storage solutions like Azure Blob Storage or other external sources into your DWH.
Did I answer your question? Mark my post as a solution, this will help others!
If my response(s) assisted you in any way, don't forget to give "Kudos"Regards,
Vinay Pabbu
Super UserHi Fragmaticx ,
To efficiently write data directly to a Microsoft Fabric Data Warehouse (DWH) from an external application, you need to use optimized data ingestion methods that avoid row-by-row inserts, which are inherently slow
Use the COPY INTO Command
The COPY INTO command is a high-performance method for bulk loading data into Microsoft Fabric DWH. It supports loading data from external sources such as Azure Blob Storage or ADLS Gen2 in formats like Parquet or CSV. This method is highly efficient and can handle millions of rows in minutes.
- Use "Fast Load" mode in OLE DB to enable batch inserts.
If this post helps, then please give us Kudos and consider Accept it as a solution to help the other members find it more quickly.