Forum Discussion

FarhanMalik's avatar
FarhanMalik
Frequent Visitor
5 years ago
Solved

Dataflow Capture Snapshots

Hi All,   I have a dataflow which is connected to a organization wide database. Now the requirement is to take snapshots of the data as of different dates and times so changes can be compared. A ma...
  • lbendlin's avatar
    5 years ago

    Change your direction of thought.  Keep in mind that dataflows are already csv-like storage blobs. When you take your snapshots of the organization wide database contents you stuff these snapshots into the dataflow.  Then do your intended reports in Power BI as needed.

     

    WARNING:  There is no guarantee that dataflows will hold your data forever. You may lose all of the history when you have to rebuild the dataflow for whatever reason. Either store your snapshots on-premise, or abandon the idea altogether and move on to the much more efficient CDC (Change Data Capture) philosophy where you keep track of changes in the data rather than wasting space with unreliable (and un-recoverable) snapshots.