Forum Discussion
joshua1990
Post Prodigy
Post ProdigyDataflow filtering but still full refresh
Hi we have a dataset / report that is linked to a huge dataflow (150 columns and like 5MM rows). I have like as a second step to filter only for the current week based on a date field but in the de...
Dataflows are just glorified CSV files in Azure Blob storage (They do usually ingest fast though - maybe you do too many transforms?).
If you want to streamline the process then cut out the middle man (the dataflow) and implement Incremental Refresh of your Semantic Model table from a foldable source.
joshua1990Post Prodigy
Post ProdigySo it is normal that the refresh from dataflows takes so long?
lbendlin
Super User
Super UserDataflows are just glorified CSV files in Azure Blob storage (They do usually ingest fast though - maybe you do too many transforms?).
If you want to streamline the process then cut out the middle man (the dataflow) and implement Incremental Refresh of your Semantic Model table from a foldable source.