SAP ECC Data Ingestion using Pipeline into DataWarehouse

HIi CeeVee33 

Here are the responses to your follow-up questions:

Q) With copy into and merge, can I use Pipeline for it? If not, then what should be used?
A) Pipelines in fabric do not natively support “copy into” or “merge” directly.
     However, you can use Notebook (PySpark or T-SQL) activities within the Pipeline to execute these statements.
      Another option is to use a stored procedure in the warehouse that performs copy into or merge, and call this           stored procedure from the Pipeline.

Q) Is Data Lake the same as Lakehouse?
A) A data lake is a storage layer that holds raw and processed data.
       Lakehouse is a structured approach on top of the Data Lake that integrates data
        warehousing features (like tables, SQL queries) with the flexibility of a Data Lake.

Q)Can I use Dataflow Gen2? If so, how do I configure incremental load in Power Query?
A)Yes, you can use Dataflow Gen2 to ingest data into the Lakehouse or Warehouse.
     For increamental refresh in Power Query, follow these steps:
     Define Date/Time Filter: In Power Query, add a filter on a date column to select only new or modified rows.
     Enable Incremental Refresh:
      In the Dataflow settings, go to Incremental Refresh & Real-Time Data.
      Define the Range (e.g., load data from the last X days).
      Choose Detect Data Changes (if a LastModified column exists).
      Publish and ensure your destination supports incremental loading.
Develop ABAP reports within SAP ECC to extract data into a staging area such as Azure Blob Storage or Azure Data Lake.
From there, use COPY INTO to efficiently load the data into Fabric Data Warehouse.

If the above information is helpful, please give us Kudos and mark the response as Accepted as solution.

Best Regards,

Community Support Team _ C Srikanth.