Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

The ultimate Microsoft Fabric, Power BI, Azure AI & SQL learning event! Join us in Las Vegas from March 26-28, 2024. Use code MSCUST for a $100 discount. Register Now

Datamart as datasource for other datamart Timeout

Dear all,

I'm trying to set-up a multi-datamart ETL process.

 

The process should look like this:

Step 1 (Ingestion): From .xlsx files to Datamart (only Types and Renaming activities)

Step 2 (ETL): From Ingestion (Step 1) to another Datamart (transformation activities all foldable)

Step 3 (Specialized Datamarts): From Step 2 to Specialized datamarts for reporting

 

No problem with Step 1, for Step 2 I experience a Timeout error (408) without being able to retrieve any data.

 

This is the error 

BrabusAle_1-1661952438471.png

During the process I cannot see any progress just this info

BrabusAle_0-1661952097838.png

 

Connection set-up is like this:

BrabusAle_2-1661952595155.png

 

Am I the only facing this problem? Thanks

Status: Needs Info

Hi @BrabusAle 

I don't quite understand you said From Ingestion (Step 1) to another Datamart (transformation activities all foldable) . Can you explain it in detail ?

 

Best Regards,
Community Support Team _ Ailsa Tao

Comments
v-yetao1-msft
Community Support
Status changed to: Needs Info

Hi @BrabusAle 

I don't quite understand you said From Ingestion (Step 1) to another Datamart (transformation activities all foldable) . Can you explain it in detail ?

 

Best Regards,
Community Support Team _ Ailsa Tao

BrabusAle
Regular Visitor

Dear @v-yetao1-msft,

we do not have any DWH, so our idea is to:

 

- Collect raw data into a Datamart as ingestion layer without strong ETL processing (only renaming) - Let's call this datamart as "DATAMART 1"

 

Once we have all raw data into DATAMART 1 we should be able to develop strong ETL processes by using SQL features and engine into another datamart (DATAMART 2)

By foldable transformation  I mean that all queries from DATAMART 1 to 2 are totally foldable, so no additional steps outside the query folding process.

 

Unfortunately right now simples queries as group-by, join etc... works in the visual query designer but once we try to replicate the exact query into a different datamart we face this Timeout error or the process (if working) tooks hours instead of seconds.

 

BrabusAle_0-1662021758967.png

 

The same issues is experienced if, instead of Datamart 2 we try the same process into a Dataset.

RH2
Regular Visitor

Similar issue here. I have Dataflow for which the source is a Datamart. I am simply querying one specific table. It works very fast in Desktop but when I save the dataflow and refresh it is failing after about 20 minutes with this error: 
Error: Data Source Error : DataSource.Error: An error happened while reading data from the provider: 'Execution Timeout Expired. The timeout period elapsed prior to completion of the operation or the server is not responding.' . RootActivityId = ....Param1 = DataSource.Error: An error happened while reading data from the provider: 'Execution Timeout Expired. The timeout period elapsed prior to completion of the operation or the server is not responding.'


Have you had any luck with your issue?