Copy Job: Using variable library prevents editing mappings
I have created copy job which reads CSV file into Lakehouse as Delta table. I can edit mappings when I have hardcoded lakehouse and warehouse id. If I change them to come from variable library and open the edit mapping page I get this error: Lakehouse operation failed for: Operation returned an invalid status code 'NotFound'. Workspace: 'a2e4fabe-c127-4f69-b7a5-6fd1acfc677f'. Path: 'a03b2b59-cfc5-3189-d41f-9be4fa2a40f7/Tables/dbo/project/projects.csv'. ErrorCode: 'PathNotFound'. Message: 'The specified path does not exist.'. RequestId: '3d5bec09-501f-0059-5ae9-6f9b03000000'. TimeStamp: 'Thu, 18 Dec 2025 06:40:50 GMT'. Operation returned an invalid status code 'NotFound' Activity ID: e23619c1-1e8e-4918-92bf-b2b6594f057b Pipeline works so workspaceid and lakehouseid are correctly set. I have default values and environment specific values in variable library set. All of these are working, but I cannot edit mappings after using the variable library in copy job.CopyJob status is different in a Pipeline
Hello everyone! I'm having an issue with a pipeline that calls a Copy Job activity. When the pipeline sends a request for the Copy Job to run, the activity shows a "Running" status in the pipeline. However, when I check the execution history of the Copy Job that was called, the latest run already shows a "Completed" status. The problem is that the pipeline continues to show the activity as running even though the Copy Job has already completed. This keeps my entire pipeline running for a long time, and eventually the activity changes to "Completed." Here is a screenshot of the pipeline activity showing that it had been running for 26 minutes at 9/25/2026 12:17 PM UTC. And here is a screenshot of the Copy Job execution history. It shows the same time, but in UTC-3. Both screenshots were taken at the same time. This Copy Job usually takes around 10–20 minutes to complete, but the pipeline activity remained running for 54 minutes. Is this normal behavior? Has anyone experienced something similar?
Copy Job Not Saving
I want to know how everyone is dealing with this. I have a Copy Job that brings over 30+ tables from one lakehouse to another and has column mappings. I find that when I try to edit the mapping of one table after running the Copy Job and then hitting the Apply button, I receive a validation model error message even though I only edited a single table and then the mappings of the other tables disappear and I have to redo the mappings for all 30+ tables. If I try to add another table from the source, all my mappings from the previous sources will disappear as well and I have to redo it. I was hoping that I could hold onto the JSON code and paste in the old mappings but there's no way to edit the Copy Job JSON file only to view it. How is everyone editing their Copy Jobs?
nested Array Issue in Mapping the key Values Part
I have a nested list of the array within the API Response in the Azure Data Factory. When I am mapping it with the column its is showing me null value instead of giving me the actual value which exist. Here rthe Product List Part part of the reposnse that I wanted to map "products": [ { "id": 1, "catalogItem": { "id": 1, "identifier": "1", "_info": { "catalog_href": "https://example.com/1" } }, "description": "1", "sequenceNumber": 1, "quantity": 1, "price": 1, "cost": 1, "agreementAmount": 1, "billableOption": "1", "agreement": { "id": 1, "name": "1", "_info": { "agreement_href": "https://example.com/1" } }, "locationId": 1, "businessUnitId": 1, "taxableFlag": false, "dropshipFlag": false, "specialOrderFlag": false, "phaseProductFlag": false, "cancelledFlag": false, "quantityCancelled": 1, "customerDescription": "1", "productSuppliedFlag": false, "invoice": { "id": 1, "identifier": "1", "_info": { "invoice_href": "https://example.com/1" } }, "warehouseId": 1, "warehouseBinId": 1, "calculatedPriceFlag": false, "calculatedCostFlag": false, "warehouse": "1", "warehouseBin": "1", "company": { "id": 1, "identifier": "1", "name": "1", "_info": { "company_href": "https://example.com/1" } }, "productClass": "1", "needToPurchaseFlag": false, "minimumStockFlag": false, "calculatedPrice": 1, "calculatedCost": 1, "_info": { "lastUpdated": "2026-01-01T00:00:00Z", "updatedBy": "1" } } ] I am trying the catlogitem.id and the the Same Format you can see here but still cant get an data in the rows of the SQL Table How to refrenece it or how to flat it?
Copy Job - Lakehouse Files to Lakehouse Table
Hi there, I am exactly trying to achieve what Patrick is doing in the video: Nutzen Sie den Kopierauftrag, um die neueste Datei in die Data Factory zu kopieren. - YouTube Shortcut loading Blob Files into Lakehouses Files and then using a Copy Job to move in the same Lakehouse with incremental load into the Table section. However this seems to be not working anymore? I am receiving a error message stating that: "ErrorCode=ApplyChangesNotSupported,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=ApplyChanges is not supported for the copy pair from Lakehouse to LakehouseTable.,Source=Microsoft.DataTransfer.ClientLibrary,'" However I am curious if there is anything that I am doing wrong? Are there better ways to move within a Lakehouse from Files into Table incrementally with a low-code experience? Thanks for the help!
Incremental Copy Job error from NetSuite
I am trying to configure a copy job to incrementally load data from NetSuite SuiteAnalytics Connect. The source is accessed using the NetSuite ODBC driver installed on an on-prem data gateway. I receive this error when trying to run the job, regardless of table selected: Failure happened on 'Source' side. ErrorCode=UserErrorOdbcOperationFailed,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=ERROR [HY000] [NetSuite][ODBC 64bit driver][OpenAccess SDK SQL Engine]Error getting the literal value of right operand.[10169],Source=Microsoft.DataTransfer.Runtime.GenericOdbcConnectors,''Type=System.Data.Odbc.OdbcException,Message=ERROR [HY000] [NetSuite][ODBC 64bit driver][OpenAccess SDK SQL Engine]Error getting the literal value of right operand.[10169],Source=NQoa27.dll,' The field used as a watermark is recognised by Fabric as a datetime column. Before I raise a support request with MS, has anyone else encountered this issue and found a solution?
