Lackluster Data Warehouse performance

[Wilsonjr]

I am writing this because I am getting fed up with the ill performance of Datawarehouse. Here is my current setup:

(External Data such as SQL, Sharepoint, and GA4) => (Dataflow Gen2) => (Data WareHouse) => (Dataset) => (Report)

The issue lies with the data warehouse, it is without fail that once or twice a week I have to manually go and click the refresh button on my Dataset that points at the data warehouse because the connection to the warehouse failed or timed out. A simple click of the refresh and it's fine. That would be find except now, the performance on the warehouse just tanked. Now when I try to do a simple select top 1 (seq_no) from Table I tried to let it load for over 30 minutes and no results. I have lost all faith in data warehouses.

I have also set up a data lake house in a different workspace and different project. This one is connected to a gen 2, and similar issues in the fact that without fail 1 or 2 times a week I have to go in and click the refresh button on the data set because it is unable to establish connection to the lake house. It works fine after that.

For reference:
Gateway is (3000.214.8) ( I know there is a new version, waiting on our network teams schedule to have it pushed, but this issue existed prior to the new release)

Let me know if you need anymore details or if i should just open a ticket.

[Anonymous]

Hi @Wilsonjr ,

Apologize for the issue you are facing. The best course of action is to open a support ticket and have our support team take a closer look at it.

Please reach out to our support team so they can do a more thorough investigation on why this it is happening: Link 

After creating a Support ticket please provide the ticket number as it would help us to track for more information.

Hope this helps. Please let us know if you have any other queries.

[Anonymous]

Hi @Wilsonjr ,

We haven’t heard from you on the last response and was just checking back to see if you got a chance to open a support ticket.
After creating a Support ticket please provide the ticket number as it would help us to track for more information.

[Wilsonjr · Accepted solution]

Sorry for the delay, It took some time and effort but we found the error to be caused by our firewall rules blocking some IP's. It was odd that we were having a few refreshes work but not all. We have since adjusted the firewall and our having no issues for 1 week. Will continue to monitor but expect that the issue is fully resolved.