pipeline
3 TopicsCopyjob charges too many resources?
Hello everyone, We are currently testing the copyjob functionality in the fabric. We always load from the same on prem SQL server. The exciting thing is that each process takes a comparatively large number of CU(s): Regardless of whether it is a full load with 1 million rows (<4 minutes) or an incremental load 10 minutes later, which only reloads 26 rows (1<min), for example. Always 4*5400 CU(s) + 360 CU(s). This means that we utilise 12.71% of the daily capacity of an F2 capacity for each load, i.e. we could make 6 loads throughout the day. That is far too many resources for these comparatively low requests. Now to my question: How can this match up with the 1.5 CU / hour = 5400CU(s) noted in the docs? Pricing for data pipelines - Microsoft Fabric | Microsoft Learn They match the 360 CU(s) because that is roughly equivalent to 4 minutes, but the 4*5400 CU(s) make the copy job unusable because that is far too much. Could this be a bug and not be calculated for every load? Thank you for your help! StewweSolved6.6KViews1like10CommentsCopy Job vs Copy Activity
Hello, How to understand when to use Copy job and when to set a pipeline with copy activity? I feel confused and a bit overwhelmed with all the possibilities shared within Microsoft Fabric. I would like to understand the basic concept and the guidelines for using various functionalities in Fabric. Is there a place where I can get all the information condensed about what to use in which case of data processing? I would like to know: 1. the differences on performace, what better works for big sets of data and what can be used on small sets, 2. what can be used on hot and what on cold data How to choose the right functionality to prepare a well-designed architecture that will assure the best performance?Solved9.5KViews2likes3CommentsCopy Job
For a workspace on my organization , the license is set as my trail license. The orgranization have an F2 capacity. However, when i use the capacity metrics for my organization, a copy job inside my trail license workspace is also listed there with CU , duration and tag billable. Will this be included in the bill for the whole organization even though the worksopace with that copy job have my trail license ?8.6KViews0likes5Comments