Forum Discussion
Historic data (last 4 days data), dataflow vs dataset ?
I have premium capacity p1 workspace
I have an oracle pipeline query that gets data for the previous working day only (more than a million rows)
business need is to get data , at any given time, for the last 4 days...
what should be the best possible approach for this, is dataflow a better approach ?
i am right now experimenting with power bi dataset import mode, since 30 minutes screen shows loading from...so i think its loading into azure ?
how do I get historic data into my report if the business need is to get data for last 4 days ? mind you i cannot expand the pipeline query where clause to get 4 days data, each day is 1 million rows, so it has to be one day at a time
please suggest how to show historic data in the report ? and if dataflow is faster compared to dataset ?
Can you just close this thread by accepting it, if it is solved
Thanks
11 Replies
- aj1973
Community Champion
Hi Anonymous
Your questions are really clear;
"what should be the best possible approach for this, is dataflow a better approach ?"
Better approach than what?
"i am right now experimenting with power bi dataset import mode, since 30 minutes screen shows loading from...so i think its loading into azure ?"
Are you talking about after publishing to the service or in your desktop?"how do I get historic data into my report if the business need is to get data for last 4 days ?"
Are you talking about how to refresh your report?
please suggest how to show historic data in the report ?
It depends where the source is, a Gateway is a solution
and if dataflow is faster compared to dataset ?
Can't campare as the Dataflow will become the source for your dataset.
- aj1973
No, It's been loaded into your desktop, into the Dataset File.
Trying to apply incremental refresh to my DQ dataset in power bi desktop, I will close this topic once its done, if thats ok, also when I right click on the table (after transform data), I dont see see native query enabled, my understanding is it needs to be enabled for incremental refresh to work
and in general do you think incremental refresh makes sense for direct query ? cause its direct query and there's no refresh concept at all