Forum Discussion
Power BI dataflows
Hi BharathS1307,
How much data are you working with?
THis type of error generally means that you're trying to process too much data at once.
Is there any filtering or removing of columns that you can do before the pivot?
If you found this helpful, consider giving some Kudos. If I answered your question or solved your problem, mark this post as the solution.
Hi BharathS1307,
GIve it a shot and see what happens. That is the best way to learn.
Without a clearer understanding of what you're trying to achieve and the structure of the data you're working with, I can't give any specific recommendations. Whatever you do try to filter data early and limit it to only what you need so that the power query engine isn't trying to process all of it at once.
If you found this helpful, consider giving some Kudos. If I answered your question or solved your problem, mark this post as the solution.
Hi BharathS1307,
How much data are you working with?
THis type of error generally means that you're trying to process too much data at once.
Is there any filtering or removing of columns that you can do before the pivot?
If you found this helpful, consider giving some Kudos. If I answered your question or solved your problem, mark this post as the solution.
Hi tayloramy , Thanks for the response
Yes before adding filtering step I am removing most of the columns and I am filtering with only 3 columns, adding filtering in one of the columns and I am receiving this error
The dataload is high only, but we need this filtering to be part of it, Can you suggest some steps which can make this filteration and merge work?
Hi tayloramy,
As it contains huge data, and as I mentioned we are filtering 15 values and making it as pivot, Can I create duplicate of the main query and do filtering for 3 values separately like 3*5, then total it would be 5 queries and after loading the data in Power BI. I can trying appending them or keep it as separate tables for use?
please let me know will this step works!
ThanksHi BharathS1307,
GIve it a shot and see what happens. That is the best way to learn.
Without a clearer understanding of what you're trying to achieve and the structure of the data you're working with, I can't give any specific recommendations. Whatever you do try to filter data early and limit it to only what you need so that the power query engine isn't trying to process all of it at once.
If you found this helpful, consider giving some Kudos. If I answered your question or solved your problem, mark this post as the solution.Tried most of the methods in the dataflow, but still faced the same data volume issue,So we are currently working in the source to get the data as per our convinence with required filters.
Thanks for the help!!