Forum Discussion
Get data - Source contraints and SQL / ODBC connectors.
Hello team,
In building a report I have several contraints and I would like to have your input on it.
The data source are a MySQL server running since 2010 with 6 tables containing millions of records, no restrictions here.
A SQLServer, a quite new SaaS with overall little amount of data for now, with a 10000 row exportation limitation, my aim is to use 7 or 8 tables from this database.
My aim is create a report getting data from these databases through SQL(MySQL) and ODBC(SQLServer) connectors, and either hit refresh data on-demmand or schedule a gateway in order to automatize this during the nights.
The issues I am facing are that:
- Powerbi is only storing/replacing 10000 rows of data from the last SQLServer connection, it is not keeping the previous records or incrementing the records. This is currently a show stopper.
- Whenever I want to gather the last results from the SQL server the whole table is downloaded (millions of rows). This is not a show stopper but an incovenience.
Thank you very much,
4 Replies
I don't believe that incremental refresh exists quite yet.
Why does your SQL server have a 10000 row export limit?
Completely besides the point, but why ODBC to the SQL Server?
Hello Greg_Deckler!
Thanks for raising this incremental point, I am used to Splunk and took this feature for granted.
The SQL Server is running below a ServiceNow (ITSM tool) production instance, it is a mission critical tool, that's the reason to both OBDC and the limitation, to prevent performance issues.
I hope it helps.
Thank you,
Hello,
Recent update from Microsoft show some efforts and development towards incremental storage:
https://ideas.powerbi.com/forums/265200-power-bi-ideas/suggestions/7288623-incremental-data-loads
I don't know what a premium license is, currently I am holding just "Pro", so it looks we do not have an easy solutions here for the time being.
What I have been considering is having a DB replica without the 10000 rows limitation that connects to the limited source on daily basis and syncs the 10000 most recent records, then connect PowerBi to this replica. It is a somewhat suboptimal workaround as it requires a new server implementation, connection configuration, etc.
Best,
Hello,
In case you're still struggling exporting data from Servicenow, you might want to try out our Servicenow app: Power BI Connector:
- https://store.servicenow.com/sn_appstore_store.do#!/store/application/87a42573879e0110fb5033773cbb35...
- https://www.alphaservesp.com/products/servicenow/power-bi/
We have a handy User and Admin Guides for your convenience, but feel free to reach out support team at [email protected] if you need any assistance.
Thank you.
Regards,
Anton
===
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.
