Forum Discussion
Post PartisanDealing with a huge csv file
I heard Dataflows is good for situations where one does not have permissions to access the database but another user doesalso called "breaking the security chain of custody" - I can not endorse that.
dataflow can be used as tool to reduce the semantic model size by trying to push much of the transformations away from the semantic model into the dataflowDataflows are glorified CSV files. Do these transforms at your own risk.
can a dataflow be used by a report in a different workspace?yes. Reusability is one of the positive features of dataflows. You will still need to have access to that "other" workspace.
Super UserDoesn't take long at all. You can assume that CSV and Parquet are the best performing formats for ingesting data from Import Mode sources.
We use the SharePoint Folder connector exclusively as we want to combine all the CSVs (in this case 50 CSVs at 800 MB each) into the semantic model.
So when or under what scenario would dataflows be useful?1. dataflows can shield the developer (NOT the report user) from a slow data source.
2. dataflows can be re-used in multiple semantic models.
Post PartisanWhen you say dataflow shields the developer (NOT the report user) from a slow data source - doesn't a slow data source also affect a report user as well? If so, why does a dataflow only applicable to developer and not report user?
- lbendlin
doesn't a slow data source also affect a report user as well?No, because dataflows are not even accessible to report users. The developer has to import the dataflow into a semantic model. The report users interact with the semantic model. The semantic model is stored in SSAS Tabular, in memory, with compression etc. That is usually faster than Direct Lake or Direct Query.
- mp390988
I heard Dataflows is good for situations where one does not have permissions to access the database but another user does so they can then create dataflow and allow the other user who deosn't have access to the database to use the dataflow instead?
Also, I guess dataflow can be used as tool to reduce the semantic model size by trying to push much of the transformations away from the semantic model into the dataflow, right?
Also, can a dataflow be used by a report in a different workspace? Or does the report and dataflow have to be in the same workspace. Let's say I am a report developer and a dataflow lives in workspace X to which I don't have access to, then that means I cannot create a report using this dataflow unless I have been granted access to workspace X right?
- mp390988
I heard Dataflows is good for situations where one does not have permissions to access the database but another user does so they can then create dataflow and allow the other user who deosn't have access to the database to use the dataflow instead?
Also, I guess dataflow can be used as tool to reduce the semantic model size by trying to push much of the transformations away from the semantic model into the dataflow, right?
Also, can a dataflow be used by a report in a different workspace? Or does the report and dataflow have to be in the same workspace. Let's say I am a report developer and a dataflow lives in workspace X to which I don't have access to, then that means I cannot create a report using this dataflow unless I have been granted access to workspace X right?