Forum Discussion

amien's avatar
amien
Helper V
1 year ago
Solved

generic question about how dataflow store the data

If i have two dataflow Gen1   dataflow 1 : ingestion dataflow. Reads the data from data source (SQL for example) dataflow 2 : transformation dataflow. Uses ingestion dataflow as data source.   m...
  • GilbertQ's avatar
    1 year ago

    Hi amien 

     

    1. It is stored within the data flow

    2. It will get the data from your data flow 1.

    3. Wednesday staging is enabled it will then get this using a SQL endpoint.

    4. Yet, the data flow gin 2 is totally rewritten under the hoods. So is it a lot faster and will be able to store the output in a lake house or sql server, as an example.