Forum Discussion
Power BI + Salesforce Data Limits
I have data as follows:
| SnapshotDate | User | Last Modified | Is X Done | Is Y Done |
| 1/1/2016 | A | 1-Jan | No | Yes |
| 1/8/2016 | A | 1-Jan | No | Yes |
| 1/15/2016 | A | 1-Jan | No | Yes |
| 1/1/2016 | B | 1-Jan | No | No |
| 1/8/2016 | B | 8-Jan | Yes | No |
| 1/15/2016 | B | 15-Jan | Yes | Yes |
| 1/1/2016 | C | 1-Jan | No | No |
| 1/8/2016 | C | 1-Jan | No | No |
| 1/15/2016 | C | 15-Jan | Yes | No |
Snapshots are taken once per week for all users, A, B, and C. Every time a User updates the responses to questions "Is X Done" and "Is Y Done" the data gets changed and the "Last Modified" reflects the date that the change was made.
I have data like this coming in from Salesforce. There are currently about 20,000 rows of data excluding snapshots. If we add snapshots, there will be a snapshot per week and it's desired to have a history of 5 weeks. This would translate to 100,000 rows (20,000 * 5). In the next few years the data is expected to increase by 1200%, which, if my math is correct would correspond to roughly 1.2 million rows of data including snapshots. It currently takes me about 30 seconds to refresh all the data for those 20,000 rows. Is it correct to assume that the refresh speed is going to slow down by 1200% as well?
If this is the case, is there a better way to deal with this situation?
Hi travbum,
Based on my testing and researching, I don't think the refresh speed vary linearly with the rows of data as you described above. And to double confirm that, I would suggest you to test it with a test environment first in your scenario.:smileyhappy:
Regards
2 Replies
Hi travbum,
Based on my testing and researching, I don't think the refresh speed vary linearly with the rows of data as you described above. And to double confirm that, I would suggest you to test it with a test environment first in your scenario.:smileyhappy:
Regards
Hi travbum You can try your connection using the SF objects API, it would let you connect all your data as that one does not have the 20k rows limit. I've tried tools like windsor.ai, supermetrics and funnel.io. I stayed with windsor because it is much cheaper so just to let you know other options. In case you wonder, to make the connection first search for the Salesforce connector in the data sources list:
After that, just grant access to your Salesforce account using your credentials, then on preview and destination page you will see a preview of your Salesforce fields:
There just select the fields you need. It is also compatible with custom fields and custom objects, so you'll be able to export them through windsor. Finally, just select PBI as your data destination and finally just copy and paste the url on PBI --> Get Data --> Web --> Paste the url.
