Power BI: Importing a huge dataset from MongoDB SQL Connector

[tenderd]

I am getting this error while importing a dataset approximately 1.5 million rows from mongodb to powerbi through sql connector. I have used the same connection of other tasks, so the connection is good. I have filtered the rows to approximately 25000 rows. However, when I import my data into Power BI, I get this error:

Failed to save modifications to the server. Error returned: 'OLE DB or ODBC error: [Expression.Error] Data source error occurred. SQLSTATE: 22003 NativeError: 0 Error message: ODBC: ERROR [22003] [MongoDB][API] integral data "3741325568" was truncated due to overflow. '.

Furthermore, while loading into power bi or even further data processing. The power query seems to query on the whole dataset even after row filter.

Can anyone help?

[Idrissshatila]

Hello @tenderd ,

try to limit the data from sql and load the 25000 rows =, like by creating a view that has the rows and columns you only need.

also try using star schema data model https://learn.microsoft.com/en-us/power-bi/guidance/star-schema

If I answered your question, please mark my post as solution, Appreciate your Kudos 👍

Follow me on Linkedin
Vote For my Idea💡

[tenderd]

I cannot Query data like SQL here and restrict it. I am using MongoDB SQL connector here so all data from the database is loaded here then I filter out the data I need in power query. I do not see any option to create "match" / "project" nosql pipelines to filter exactly the data I need before it comes into power query.

However, if you think it is possible to apply filter and limit data, let me know. I would be happy to learn.