SAP Connection with Select Incremental

[JuanMahecha]

Hello, good day.

I am looking for a way to ingest SAP data into Fabric with the feature of an incremental select, that is, to ingest only the new/modified data, I saw that it is possible to do it with a dataflow but you want to minimize costs so I want to know if it can be done with a pipeline and how? or if there are other options I would greatly appreciate the information.

[Anonymous]

Hi @JuanMahecha,

I hope this information is helpful. Please let me know if you have any further questions or if you'd like to discuss this further. If this answers your question, kindly "Accept  as  Solution" and give it a 'Kudos' so others can find it easily.

Thank you,
Pavan.

[Anonymous]

Hi @JuanMahecha,

I wanted to check if you had the opportunity to review the information provided. Please feel free to contact us if you have any further questions. If my response has addressed your query, please "Accept  as  Solution" and give a 'Kudos' so other members can easily find it.

Thank you,
Pavan.

[Anonymous · Accepted solution]

Hi @JuanMahecha,

Thank you for reaching out in Microsoft Community Forum.

Yes, you can ingest SAP data incrementally in Fabric using a pipeline without needing a Dataflow, helping you minimize costs.

Please follow below steps to acheive this;

1.connect to SAP and configure a query that filters only new/modified records (using a "Last Modified Date" or similar column).

2.use a pipeline variable or metadata table to track the last successful ingestion time dynamically.

3.apply the stored timestamp in the query to load only incremental changes during every pipeline execution.

4.you can use Mapping Data Flows (more advanced but costly) or third-party connectors (higher cost) if needed.

Please continue using Microsoft Community Forum.

If you found this post helpful, please consider marking it as "Accept as Solution" and give it a 'Kudos' to help others find it more easily.

Regards,
Pavan.