Copy Activity with Warehouse source (lakehouse sql endpoint) validation issue

RaymondLaw — Thu, 13 Jul 2023 17:47:08 GMT

Hi,

I have a task to union two delta table into one. I used copy activity.

It works when i create and save it. However, it fails to validate the source connection when i open the data pipeline after closed.

If i reenter everything into the source tab, it will work again (But it will fail again in next time when i open the data pipeline after closed)

It is how it works before i close the pipeline

It is how it failed in the validate when i open it after closed. You can notice that it doesn't show the connection string (while the content is still available in the "View JSON code")

Source:

- Data store type: Workspace

- Workspace data store type: Data Warehouse

- Data Warehouse object ID: (the GUID of my lakehouse SQL endpoint) (it doesn't show the lakehouse SQL endpoint for my selection, i need to enter the GUID manually in dynamic content)

- SQL connection string: (connection string of my lakehouse SQL endpoint)

- Use query: Query

- Query "select * from tableA union all select * from tableB" (actually, i used dynamic content, i simplied here)

Destination: (another lakehouse in the same workspace)

(No specific mapping or setting)

Re: Copy Activity with Warehouse source (lakehouse sql endpoint) validation issue

ajarora — Fri, 14 Jul 2023 01:15:35 GMT

Can you please log a support ticket for this, as this looks like a bug.

topic Copy Activity with Warehouse source (lakehouse sql endpoint) validation issue in Pipelines

Copy Activity with Warehouse source (lakehouse sql endpoint) validation issue

Re: Copy Activity with Warehouse source (lakehouse sql endpoint) validation issue