topic Re: Enabling Partition Option in Source tab in Pipelines

Enabling Partition Option in Source tab

v-cyu — Mon, 26 Aug 2024 23:39:59 GMT

We are utilizing Copy Activity to copy from Cosmos Structured Stream (Not CosmosDB) to a lakehouse table.
However, in the process of copying, we are seeing this tuning tips

However, in the source tab, we do not see any "Partition Option" available.

Please let me know how we can tune this to allow parallelism and improve performance?

Re: Enabling Partition Option in Source tab

Anonymous — Tue, 27 Aug 2024 01:24:40 GMT

Hi v-cyu

I noticed that your screenshot shows Advanced under the Source tab. Loading data into Lakehouse using partition columns is set up in Advanced under the Destination tab.

You can view the link below for more details:

Load data to Lakehouse using partition - Microsoft Fabric | Microsoft Learn

Regards,

Nono Chen

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

Re: Enabling Partition Option in Source tab

v-cyu — Tue, 27 Aug 2024 17:27:14 GMT

We have tried that option, however we are still seeing the same "tip"

Re: Enabling Partition Option in Source tab

Anonymous — Wed, 28 Aug 2024 01:38:20 GMT

Hi v-cyu

If you are still being prompted, it is recommended that you consider checking the partition configuration of the source data to ensure that it supports and configures partitions correctly.

Regards,

Nono Chen

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.