Hi,
I have a task to union two delta table into one. I used copy activity.
It works when i create and save it. However, it fails to validate the source connection when i open the data pipeline after closed.
If i reenter everything into the source tab, it will work again (But it will fail again in next time when i open the data pipeline after closed)
It is how it works before i close the pipeline
It is how it failed in the validate when i open it after closed. You can notice that it doesn't show the connection string (while the content is still available in the "View JSON code")
Source:
- Data store type: Workspace
- Workspace data store type: Data Warehouse
- Data Warehouse object ID: (the GUID of my lakehouse SQL endpoint) (it doesn't show the lakehouse SQL endpoint for my selection, i need to enter the GUID manually in dynamic content)
- SQL connection string: (connection string of my lakehouse SQL endpoint)
- Use query: Query
- Query "select * from tableA union all select * from tableB" (actually, i used dynamic content, i simplied here)
Destination: (another lakehouse in the same workspace)
(No specific mapping or setting)
