Forum Discussion
Unable to import complete data to Power BI
I am trying to import data to Power BI through ODBC connection to Dremio. I am using the web option in get data and passing the url as shown below
open.dev.********.com/api/v1/accounting/feeconversion?output=csv
This is recorded as a ODBC connection to Dremio.
The dataset has around 5.6 million records. But every time I tried to import the dataset to Power BI, the ODBC connection to dremio terminates and returns exactly 1,147,806 records.
I found the following information on Dremio
Input
| Input Bytes: | 1.06 GB |
| Input Records: | 1,180,942 |
Output
| Output Bytes: | 1.32 GB | |
| Output Records: | 1,147,806 |
Is there some kind of limitations that is restricting the import?
PS - Dremio is a data-as-a-service platform that empowers users to discover, curate, accelerate, and share any data at any time, regardless of location, volume, or structure.
Thank you.
2 Replies
v-cherch-msftMicrosoft Employee
Hi Anonymous
You may have a look at below posts.
For Desktop:
https://community.powerbi.com/t5/Desktop/Power-BI-Desktop-IMPORT-data-limitation/td-p/466576
For Service:
https://community.powerbi.com/t5/Desktop/Size-limit-of-a-file-pbx/td-p/41371
https://docs.microsoft.com/en-us/power-bi/service-get-data#considerations-and-limitations
Regards,
Cherie
Thank you for your response.
For Desktop:
https://community.powerbi.com/t5/Desktop/Power-BI-Desktop-IMPORT-data-limitation/td-p/466576
The above scenario talks about importing the data using ODBC connectors. I do not have any difficulties importing the data using the ODBC connectors to connect to Dremio.
But when I use the "Web" import option and pass the URL, that's when PBI terminates the connection to Dremio after importing only 1.1 million records of the total 5.5 million.
So I was wondering if there is any limitations to the data imported when I use REST API which outputs the results as CSV.
open.dev.********.com/api/v1/accounting/feeconversion?output=csv
Since I am using output=csv in the URL, the call made to Dremio is an ODBC call, not a REST call.
Thank you.