Forum Discussion
Helper IPremium Per user Site Incremental refresh
I am looking for thoughts on setting up a scheduled incremental refresh for my data sets in Power BI.
I would like to share multiple datasets for many differant power bi reports.
I have a read only connection with a maximum of 5 connections, I use the power query thru postgres sql connector to an on premis postgres table thru MS on premis gateway tool loaded on a pc.
I tried to build a test Data flow in Power BI for a single dataset and when i got to the incremental refresh part on the date time field the refresh failed because of to many connections.
I also have an Azur Blob Gen 2 site should i try to go there .
Looking for best option on what tool to use to get scheduled incremental refresh going for power bi ...
Thanks
5 Replies
- edhans
Community Champion
I am not aware of a way to limit the number of connections the refresh starts. It will start as many as it thinks is necessary and send multiple queries to the DB to get data in chunks, or from different tables/views simultaneously. I would consider talking to your DBA to allow the service to have more than 5 connections.
nroweyI dont have the option to have more connections, I need another workaround. Can connections be limiited with the MS on premis gateway or in the postgres connector have been trying to find answer with no sucess so far.
- bcdobbs
I think you can limit it by changing a confit file for on prem gateway...
Set MashupDefaultPoolContainerMaxCount To 5
https://docs.microsoft.com/en-us/data-integration/gateway/service-gateway-performance-cpu
Think you have to restart the gateway after changing the parameter.
