- Subscribe to RSS Feed
- Mark Topic as New
- Mark Topic as Read
- Float this Topic for Current User
- Bookmark
- Subscribe
- Printer Friendly Page
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
MongoDB ODBC connector for PowerBI - Incremental refreshes are slow
Hi all,
We are using the Mongo DB ODBC connector for PowerBI to connect the MongoDB data source. We have implemented incremental refresh as per our data size is concerned. But after the initial refresh, 20-30K rows are pulled into the report in 11 mins on average. This is not what we are expecting. The refreshes are very slow.
I think query folding is also not happening in the Power Query at the first step where a simple SQL query is used to fetch the data from MongoDB through the ODBC connector. Please help! Thanks for your suggestions.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
@lbendlin: I just found something in the Microsoft docs. It says, only the PostgreSQL connector supports query folding. No other connectors support query folding if you use a native database query.
I am unsure about this.
Here is the link (https://docs.microsoft.com/en-us/power-query/native-database-query)
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Note that query folding is not a hard requirement for incremental refresh. It is merely a preferred option. Incremental refresh will work with a source that doesn't fold.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Thanks, @lbendlin for your reply. I have tried what you said. But I am facing this error. I followed this video (https://www.youtube.com/watch?v=8hjdOCni_ZY)
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Sorry, I don't have a MongoDB environment to play with. Maybe someone else can test it out.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
You are not actually doing an incremental refresh. Instead, you apply the RangeStart/RangeEnd filter over the full result set of your custom SQL query.
Move your SQL statement into the Power Query code (via Value.NativeQuery) and incorporate RangeStart and RangeEnd directly into that query.
Helpful resources
Join us at the Microsoft Fabric Community Conference
March 31 - April 2, 2025, in Las Vegas, Nevada. Use code MSCUST for a $150 discount!
Microsoft Fabric Community Conference 2025
Arun Ulag shares exciting details about the Microsoft Fabric Conference 2025, which will be held in Las Vegas, NV.
Subject | Author | Posted | |
---|---|---|---|
10-07-2024 09:31 AM | |||
06-20-2024 12:34 AM | |||
05-24-2024 06:27 AM | |||
07-11-2024 08:34 PM | |||
02-22-2024 03:51 AM |