Forum Discussion
SAP Connection with Select Incremental
Hi Anonymous,
Thank you for reaching out in Microsoft Community Forum.
Yes, you can ingest SAP data incrementally in Fabric using a pipeline without needing a Dataflow, helping you minimize costs.
Please follow below steps to acheive this;
1.connect to SAP and configure a query that filters only new/modified records (using a "Last Modified Date" or similar column).
2.use a pipeline variable or metadata table to track the last successful ingestion time dynamically.
3.apply the stored timestamp in the query to load only incremental changes during every pipeline execution.
4.you can use Mapping Data Flows (more advanced but costly) or third-party connectors (higher cost) if needed.
Please continue using Microsoft Community Forum.
If you found this post helpful, please consider marking it as "Accept as Solution" and give it a 'Kudos' to help others find it more easily.
Regards,
Pavan.
Hi Anonymous,
Thank you for reaching out in Microsoft Community Forum.
Yes, you can ingest SAP data incrementally in Fabric using a pipeline without needing a Dataflow, helping you minimize costs.
Please follow below steps to acheive this;
1.connect to SAP and configure a query that filters only new/modified records (using a "Last Modified Date" or similar column).
2.use a pipeline variable or metadata table to track the last successful ingestion time dynamically.
3.apply the stored timestamp in the query to load only incremental changes during every pipeline execution.
4.you can use Mapping Data Flows (more advanced but costly) or third-party connectors (higher cost) if needed.
Please continue using Microsoft Community Forum.
If you found this post helpful, please consider marking it as "Accept as Solution" and give it a 'Kudos' to help others find it more easily.
Regards,
Pavan.