topic Re: How to capture @odata.deltaLink from Copy Activity that use Microsoft Graph delta API in Fabric? in Pipelines

How to capture @odata.deltaLink from Copy Activity that use Microsoft Graph delta API in Fabric?

larry-lau — Wed, 09 Apr 2025 16:08:22 GMT

Hi Fabric members,

I am able to configure the Copy Activity in Fabric to load data by calling Microsoft Graph delta API and page through all the data by setting the Pagination rule to AbsoluteUrl = $['@odata.nextLink']

According to the delta API documentation user: delta - Microsoft Graph v1.0 | Microsoft Learn, the last page request would return an attribute called @odata.deltaLink which should be used to request data the next time the Copy Activity execute. I couldn't figure out how to capture the @odata.deltaLink value in the Copy Activity or from the output of the Copy Activity.

The Copy Activity returns the output as follow. Any help would be appreciated. Thanks

{ "dataRead": 48462, "dataWritten": 11468, "filesWritten": 1, "sourcePeakConnections": 1, "sinkPeakConnections": 1, "rowsRead": 2, "rowsCopied": 119, "copyDuration": 24, "throughput": 4.039, "errors": [], "usedDataIntegrationUnits": 4, "usedParallelCopies": 1, "executionDetails": [ { "source": { "type": "RestService" }, "sink": { "type": "Lakehouse" }, "status": "Succeeded", "start": "4/7/2025, 4:28:44 PM", "duration": 24, "usedDataIntegrationUnits": 4, "usedParallelCopies": 1, "profile": { "queue": { "status": "Completed", "duration": 8 }, "transfer": { "status": "Completed", "duration": 14, "details": { "readingFromSource": { "type": "RestService", "workingDuration": 2, "timeToFirstByte": 2 }, "writingToSink": { "type": "Lakehouse", "workingDuration": 0 } } } }, "detailedDurations": { "queuingDuration": 8, "timeToFirstByte": 2, "transferDuration": 12 } } ], "dataConsistencyVerification": { "VerificationResult": "Unsupported" } }

Re: How to capture @odata.deltaLink from Copy Activity that use Microsoft Graph delta API in Fabric?

Anonymous — Thu, 10 Apr 2025 11:18:14 GMT

Hi larry-lau,

Thank you for reaching out in Microsoft Community Forum.

Please follow below for Capturing @odata.deltaLink in Fabric Copy Activity;

1.Use a Web Activity after the Copy Activity to make a final call to the delta API, retrieve the last page, and extract the @odata.deltaLink. You can then store it in a Lakehouse table, pipeline variable, or external store (like Azure Key Vault) for reuse.

2.Explore using a Data Flow or Custom Logic App workflow, which gives more control over how responses are handled, parsed, and persisted.

3.If feasible, use an external orchestration (like Azure Logic Apps or Azure Functions) to wrap the delta load logic entirely and pass only cleaned data into Fabric.

Please continue using Microsoft community forum.

If you found this post helpful, please consider marking it as "Accept as Solution" and give it a 'Kudos'. if it was helpful. help other members find it more easily.

Regards,
Pavan.

Re: How to capture @odata.deltaLink from Copy Activity that use Microsoft Graph delta API in Fabric?

Anonymous — Mon, 14 Apr 2025 09:26:15 GMT

Hi larry-lau,

I wanted to check if you had the opportunity to review the information provided. Please feel free to contact us if you have any further questions. If my response has addressed your query, please "Accept as Solution" and give a 'Kudos' so other members can easily find it.

Thank you,
Pavan.

Re: How to capture @odata.deltaLink from Copy Activity that use Microsoft Graph delta API in Fabric?

Anonymous — Mon, 21 Apr 2025 11:29:44 GMT

Hi larry-lau,

I hope this information is helpful. Please let me know if you have any further questions or if you'd like to discuss this further. If this answers your question, kindly "Accept as Solution" and give it a 'Kudos' so others can find it easily.

Thank you,
Pavan.

Re: How to capture @odata.deltaLink from Copy Activity that use Microsoft Graph delta API in Fabric?

Anonymous — Sun, 27 Apr 2025 11:21:39 GMT

Hi larry-lau,

I wanted to follow up since we haven't heard back from you regarding our last response. We hope your issue has been resolved.
If the community member's answer your query, please mark it as "Accept as Solution" and select "Yes" if it was helpful.
If you need any further assistance, feel free to reach out.

Please continue using Microsoft community forum.

Thank you,
Pavan.