Forum Discussion
SAP Connection with Select Incremental
- Anonymous1 year ago
Hi Anonymous,
Thank you for reaching out in Microsoft Community Forum.
Yes, you can ingest SAP data incrementally in Fabric using a pipeline without needing a Dataflow, helping you minimize costs.
Please follow below steps to acheive this;
1.connect to SAP and configure a query that filters only new/modified records (using a "Last Modified Date" or similar column).
2.use a pipeline variable or metadata table to track the last successful ingestion time dynamically.
3.apply the stored timestamp in the query to load only incremental changes during every pipeline execution.
4.you can use Mapping Data Flows (more advanced but costly) or third-party connectors (higher cost) if needed.
Please continue using Microsoft Community Forum.
If you found this post helpful, please consider marking it as "Accept as Solution" and give it a 'Kudos' to help others find it more easily.
Regards,
Pavan.
Hi Anonymous,
I wanted to check if you had the opportunity to review the information provided. Please feel free to contact us if you have any further questions. If my response has addressed your query, please "Accept as Solution" and give a 'Kudos' so other members can easily find it.
Thank you,
Pavan.