This is best Fabric, Power BI, SQL and AI community event. How do we know? The last event sold out! Save €200 with code FABCMTY200.
Register nowThe Fabric community is now in read-only for platform upgrade. Learn more
I am importing data from Salesforce Objects. My tables have data from up to 6 years old, but I only need the data from the last 2 years in my report. Additionally, I need to make my model more efficient and decrease the size of the file. How can I filter by date when importing? Or in Powerquery?
Hi @mariajuliao
Native Salesforce Objects connector doesn't push date filters back to Salesforce as SOQL, so it pulls the full object first and filters in Power Query after. For a 6-year history that you only want 2 years of, that means downloading 3x more data than you need, every refresh.
If you'd rather filter on the Salesforce side before any data leaves, Power BI Connector for Salesforce on AppExchange does exactly that. You set the date filter (e.g. CreatedDate >= LAST_N_YEARS:2) in the connector's UI on the Salesforce side, and only those 2 years are sent through to Power BI. Smaller file, faster refresh, lower API consumption.
30-day free trial, no card. Docs at https://metricasoftware.com/, happy to set up a quick demo on your specific date filter if useful.
Cheers,
Metrica Team.
Hi Mariajuliao,
I have the same matter as you, did you find a solution to filter your data at the root ? not after importing everything ?
Thanks,
Hi @mariajuliao ,
When you filter in power query editor, it takes time and resources to filter.
It's always recommended to filter your data in the early stages of your query or as early as possible. Some connectors will take advantage of your filters through query folding, as described in Power Query query folding. It's also a best practice to filter out any data that isn't relevant for your case. This will let you better focus on your task at hand by only showing data that’s relevant in the data preview section.
But if you use the Salesforce Objects connector, then I think you will have to filter the data after previewing data in Power Query.
If the problem is still not resolved, please provide detailed error information or the expected result you expect. Let me know immediately, looking forward to your reply.
Best Regards,
Winniz
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.
Join us in Barcelona for FabCon and SQLCon, the Fabric, Power BI, SQL, and AI community event. Save €200 with code FABCMTY200.