Forum Discussion
Microsoft Fabric
Hello, I am new to fabric and have had a hard time answering this question " What in the object extracts data from the system source ? Is it code in a notebook or data flow? Or does a data flow execute a notebook? "
Thank you for taking the time to read, hope you can help me out !
There are multiple tools in Fabric which you can use for extracting data from data sources.
Some examples of tools are:
- Dataflow Gen 2
- Data pipeline (copy activity)
- Notebook (Spark)
Data pipeline is also commonly used for orchestration, e.g. executing Notebooks or Dataflow Gen 2 in a pipeline run, however Notebooks and Dataflow Gen 2 can also be executed without being inside a Data Pipeline.
Here is some information about the differences:
https://learn.microsoft.com/en-us/fabric/get-started/decision-guide-pipeline-dataflow-spark
Common methods for ingesting data into Lakehouse:
https://learn.microsoft.com/en-us/fabric/data-engineering/load-data-lakehouse
Common methods for ingesting data into Data Warehouse:
https://learn.microsoft.com/en-us/fabric/data-warehouse/ingest-data
1 Reply
There are multiple tools in Fabric which you can use for extracting data from data sources.
Some examples of tools are:
- Dataflow Gen 2
- Data pipeline (copy activity)
- Notebook (Spark)
Data pipeline is also commonly used for orchestration, e.g. executing Notebooks or Dataflow Gen 2 in a pipeline run, however Notebooks and Dataflow Gen 2 can also be executed without being inside a Data Pipeline.
Here is some information about the differences:
https://learn.microsoft.com/en-us/fabric/get-started/decision-guide-pipeline-dataflow-spark
Common methods for ingesting data into Lakehouse:
https://learn.microsoft.com/en-us/fabric/data-engineering/load-data-lakehouse
Common methods for ingesting data into Data Warehouse:
https://learn.microsoft.com/en-us/fabric/data-warehouse/ingest-data