CopyJob Query as Source

[AntonioPineda]

Hi.

We are trying to use the CopyJob to do Merge on some table in order to do incremental loads to a Lakehouse in Fabric from an onpremises SQL Server. Some of the tables we use are not very well constructed so we sometimes have to get rid of some columns in the source for which we use a Query instead of bringing the whole table which sometimes can have more than 100 columns (again not very well constructed table).

On the Copy Activity we have the ability so send a Query or ingest a whole table with all the columns. We would like to see this option available for the CopyJob if at all possible.

Thanks!

[Miwa1]

Query is already supported for the following connectors and we're expanding it to more. Lakehouse AzureSql AzureSqlMI FabricSql SqlServer AzureSQLDatawarehouse Snowflake Google BigQuery Oracle Kusto

[AntonioPineda]

YES! We noticed it is added now. Thanks a lot!

[yexu]

Use query as source has been added in Copy job.  See details in Truncate Destination, Queries and Multiple Folders – Simplifying Data Ingestion with Copy Job | Micr...