Forum Discussion
Post ProdigyDataflow filtering but still full refresh
Dataflows are just glorified CSV files in Azure Blob storage (They do usually ingest fast though - maybe you do too many transforms?).
If you want to streamline the process then cut out the middle man (the dataflow) and implement Incremental Refresh of your Semantic Model table from a foldable source.
Super UserThe filter query doesn't fold. It is only applied after all the data is downloaded.
Post ProdigySo it is normal that the refresh from dataflows takes so long?
- lbendlin
Dataflows are just glorified CSV files in Azure Blob storage (They do usually ingest fast though - maybe you do too many transforms?).
If you want to streamline the process then cut out the middle man (the dataflow) and implement Incremental Refresh of your Semantic Model table from a foldable source.