Forum Discussion
Advocate IINeed your JOIN/MERGE brainpower/skills please
Hello All,
Situation: I have data in a table in SFDC with 250,000 rows and many columns. I only care about 200 of the rows. There is no way to filter the table from SFDC to select the 200 rows. I have a table in Sharepoint which contains the 200 unique IDs of the rows from SFDC that I care about. These change daily.
If I use PowerBI merge functionality, PowerBI tries to download a quarter of a million rows then does the join which takes along time: 10+ mins. I tried writing a dynamic select statement but when the select statement gets too long, the web api request to SFDC fails.
Does anyone know how I can get PowerBI to select the IDs from one table1 and use them as a filter on table2 BEFORE it downloads the entire data set from table2?
Thanks in advance!
Xerxel
3 Replies
- BhaveshPatel
Super User
Hi xerxel
Other than the Merge Step, I don't see any other functionality would fit in your scenario as you have mentioned that using SELECT will not work in your case.
- ImkeF
Community Champion
So you are merging on JoinKind.Inner and it doesn't fold to the source?
Then you could chunk up your SELECT-statement into multiple queries and append the results. Just create a table which holds the chunks for each query in one row and pass them as parameters into your SELECT-statement. Expanding the resulting column should then present your consolidated results.
xerxelGood idea! Haven't tried using parameters anywhere yet. Will give it a try!
