Forum Discussion
Incremental Refresh Synapse - Reduce Number of Concurrent Session
Solution SpecialistIt's not clear whether you are using gateway here or not. In case you aren't using gateway, you can try setting up gateway for Synapse since synapse supports gateway.
By using the gateway, there is possibility to control the concurrent connections to the source. We need to change a setting in gateway configuration file to make it work. Please refer to the below doc.
https://docs.microsoft.com/en-us/data-integration/gateway/service-gateway-performance-cpu
You need to change the below mentioned field value to the desired number of concurrent connections.
MashupDefaultPoolContainerMaxCount
Did I answer your questions? Give a thumbs up and accept this post as solution!
Ahh thank you, thats a great idea, I will give that a go.
We are not using the gateway at the moment, I will give that a go this morning and let you know if that solves it.
_sfrost just wanted to check with this, would you expect to use the on prem gateway and somehow shoehorn it to working cloud to cloud or is there another type?
Ive just had a look and am not sure where to start with that part, any pointers would be appreciated
- _sfrost
Though your source is cloud and doesn't require gateway for refresh, we can still set up gateway to control the number of concurrent sessions. That's the reason I suggested you to use gateway and I am not sure if we can control this if we do not use gateway.
To start with, install a gateway and add your Synapse datasource under that gateway.
Once set up, follow the article I provided and change the gateway configuration file.
Once done, do a refresh and observe the behaviour.
Morning, I spent all of yesterday looking into Gateways and the issue I have is that I don't have a machine to stand the on prem gateway on, so I was looking into VNet gateways.
Do you know if there is anyway to do the what you surguest with them.
I now have one setup and get the concurent connections errors, but I don't know where to start in limiting these in the Vnet Gateway. Any pointers?
