Pipeline activities failing with 'Failed to resolve connection ... referenced in activity run ...'
Hello, A few days ago my pipeline activities started failing with the following error: Error Code: UserError Failure Type: User Configuration Issue Details: Failed to resolve connection [Connection ID] referenced in activity run [Activity ID]' Prior to seeing this error, the pipelines ran on schedule every night without any issue. No changes were made to the source, destination or pipeline prior to experiencing this issue. I own the source, destination and pipeline. To resolve the error, I have to go to each activity and run a test connection then rerun. However, this solution only resolves the issue temporarily. All failed activities are copy data activitities which have an Azure SQL Database as both the source and destination. All the copy data activities in these pipelines run concurrently (as opposed to sequentially). So far I have tried: o Creating new connections (issue remains) o Rerunning Pipeline without testing connection (issue remains) Does anyone know how to permanently resolve this issue? Currently, it is taking hours everyday to run a test connection on every failed activity.
Data corruption when copying an Oracle table with number fields
I created a pipeline with a Copy Data task that reads from Oracle and writes to a Fabric lakehouse. I noticed that every column defined in Oracle as NUMBER with no specified scale or precision is corrupted by the copy task. The values in the lakehouse table are off by factors of around 10^18. The factor seems to depend on the data. As a test, I ran a copy task that reads from an Oracle query that hard-codes a variety of number values. The values show correctly in the preview in the copy task wizard, but not in the lakehouse table. The only workaround I've found is to first copy from Oracle to csv and then from csv to lakehouse tables. select cast(1 as number) test_1number, cast(0.1 as number) test_01number, cast(10 as number) test_10number, cast(0.15 as number) test_015number, cast(1 as number) test_mixed_number, cast(15 as number) test_15number, cast(1 as number(5)) test_number_5, cast(1 as number(5,2)) test_number_5_2 from dual union all select cast(1 as number) test_1number, cast(0.1 as number) test_01number, cast(10 as number) test_10number, cast(0.15 as number) test_015number, cast(0.1 as number) test_mixed_number, cast(15 as number) test_15number, cast(1 as number(5)) test_number_5, cast(1 as number(5,2)) test_number_5_2 from dualRefresh Semantic Model - Table Dynamic Content
I've set up dynamic content inside of a Refresh Semantic Model activity inside of a data pipeline. So far I've dynamically set the Workspace Id and the Semantic Model but I've previously left the table line blank. The pipeline would refresh properly until now and the only way it seems to run even with static Workspace Id and Semantic Model values is if I specify the tables. For the static values I can wait for the drop down menu to load and select all but when I use dynamic content in Workspace and Semantic Model ID, the table names won't load and I can only input dynamic content. How do I write in the tables through dynamic content. I've tried the following based off the JSON file: {"table": "TableName"} TableName table:TableName [{"table": "TableName"}] TableName1, TableName2 Editing the JSON file directly by copying and pasting how a non-dynamic content inputted Workspace and Semantic model ID has the table names set up How do I dynamically write in multiple tables for the dynamic content? Is there a way to specify select all when I write in dynamic content?
pipeline return value to parent pipeline
Hi I want to pass return value from child pipeline to parent pipeline and followed the example mentioned in this guide. Set Pipeline Return Value - Azure Data Factory & Azure Synapse | Microsoft Learn Child pipeline Unfortunately I am getting error indicating the output property of pipelineReturnValue itself doesn't exist. The expression 'setProperty(json('{}'),'output',activity('Invoke pipeline1_copy1').output.pipelineReturnValue.child_return)' cannot be evaluated because property 'pipelineReturnValue' doesn't exist, available properties are 'id, itemId, jobType, invokeType, status, failureReason, rootActivityId, startTimeUtc, endTimeUtc, monitoringURL, pipelineRunId, ResponseHeaders, effectiveIntegrationRuntime, executionDuration, durationInQueue, billingReference'. Strangely this works fine in legacy pipeline activity and not preview pipeline activity.Fabric Pipelines - Not opening
We have some Fabric piplines that we have been developing and for the last days I can't open any of them. They just keep loading on the left menu but I can't acces or modify the content. The only way I was able to acces is using a VDI and then using this other machine to load the content on a diferent web explorer and different machine.Dynamically set source connection in copy activity and connection in lookup, script activity
Wanted to understand how we can provide the source connection dynamically rather than manually selecting from the dropdown for copy activity, lookup, script, get metadata activity, etc. as we have to deploy the pipeline to other workspaces which uses different connection name (DEV/QA/UAT/PROD).
