Forum Discussion
DataSource.Error: ODBC: ERROR [HY000] unknown error (7) - SQLite3 - Huge Database
I have a database in .db (SQLite3) with more than 20GB (About 60 Mi of Lines) of data and I can't import more than 4 Mi of data without having an import error. Recently I chose to divide this base into parts of about 3GB to avoid errors, but operationally it's pretty bad to work with.
The ODBC SQLite3 driver was installed correctly and the variables were created in ODBC Data Sources, however the update process is unstable and slow.
Is there any way to import this 20GB directly from the .db?
All parts were defined in ODBC Source
The base called 'dbDadosGeral' joins all parts
In Power Query, the error presented in the base that joins the others is not reflected in the parts individually
Hi Anonymous ,
If you are a Power BI Pro license user, there is a 1GB size limit when you import data into Power BI.
We recommend you to check this article to optimize your data.Data reduction techniques for Import modeling - Power BI | Microsoft Docs
If this still does not work and you want to achieve your needs, you need to change your license:
- You may consider purchasing the Power BI Premium Per user license, which allows you to upload or publish .pbix files up to 10GB in size when using PPU capacity.
- You could also purchase a Power BI Premium license.If you enable the Large dataset storage format setting for a dataset, the .pbix file size limitations still apply to file upload or publish. The upload size limit is unaffected by the large dataset storage format. However, when published to the service, with incremental refresh and large dataset storage format enabled, datasets can grow much larger than these limits. With large dataset storage format, the dataset size is limited only by the Power BI Premium capacity size.With large models, the limitation is removed and dataset sizes are limited only by the capacity size, or a maximum size set by the administrator.
For more,you may refer to:Visualise SQLite Data in Power BI
What is Microsoft Power BI Premium? - Power BI | Microsoft Docs
Pricing & Product Comparison | Microsoft Power BI
Best Regards,
Eyelyn Qin
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.
1 Reply
Hi Anonymous ,
If you are a Power BI Pro license user, there is a 1GB size limit when you import data into Power BI.
We recommend you to check this article to optimize your data.Data reduction techniques for Import modeling - Power BI | Microsoft Docs
If this still does not work and you want to achieve your needs, you need to change your license:
- You may consider purchasing the Power BI Premium Per user license, which allows you to upload or publish .pbix files up to 10GB in size when using PPU capacity.
- You could also purchase a Power BI Premium license.If you enable the Large dataset storage format setting for a dataset, the .pbix file size limitations still apply to file upload or publish. The upload size limit is unaffected by the large dataset storage format. However, when published to the service, with incremental refresh and large dataset storage format enabled, datasets can grow much larger than these limits. With large dataset storage format, the dataset size is limited only by the Power BI Premium capacity size.With large models, the limitation is removed and dataset sizes are limited only by the capacity size, or a maximum size set by the administrator.
For more,you may refer to:Visualise SQLite Data in Power BI
What is Microsoft Power BI Premium? - Power BI | Microsoft Docs
Pricing & Product Comparison | Microsoft Power BI
Best Regards,
Eyelyn Qin
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.