Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Find everything you need to get certified on Fabric—skills challenges, live sessions, exam prep, role guidance, and more. Get started

Datamart as datasource for other datamart Timeout

Dear all,

I'm trying to set-up a multi-datamart ETL process.

 

The process should look like this:

Step 1 (Ingestion): From .xlsx files to Datamart (only Types and Renaming activities)

Step 2 (ETL): From Ingestion (Step 1) to another Datamart (transformation activities all foldable)

Step 3 (Specialized Datamarts): From Step 2 to Specialized datamarts for reporting

 

No problem with Step 1, for Step 2 I experience a Timeout error (408) without being able to retrieve any data.

 

This is the error 

BrabusAle_1-1661952438471.png

During the process I cannot see any progress just this info

BrabusAle_0-1661952097838.png

 

Connection set-up is like this:

BrabusAle_2-1661952595155.png

 

Am I the only facing this problem? Thanks

Status: Needs Info

Hi @BrabusAle 

I don't quite understand you said From Ingestion (Step 1) to another Datamart (transformation activities all foldable) . Can you explain it in detail ?

 

Best Regards,
Community Support Team _ Ailsa Tao

Comments
v-yetao1-msft
Community Support
Status changed to: Needs Info

Hi @BrabusAle 

I don't quite understand you said From Ingestion (Step 1) to another Datamart (transformation activities all foldable) . Can you explain it in detail ?

 

Best Regards,
Community Support Team _ Ailsa Tao

BrabusAle
Regular Visitor

Dear @v-yetao1-msft,

we do not have any DWH, so our idea is to:

 

- Collect raw data into a Datamart as ingestion layer without strong ETL processing (only renaming) - Let's call this datamart as "DATAMART 1"

 

Once we have all raw data into DATAMART 1 we should be able to develop strong ETL processes by using SQL features and engine into another datamart (DATAMART 2)

By foldable transformation  I mean that all queries from DATAMART 1 to 2 are totally foldable, so no additional steps outside the query folding process.

 

Unfortunately right now simples queries as group-by, join etc... works in the visual query designer but once we try to replicate the exact query into a different datamart we face this Timeout error or the process (if working) tooks hours instead of seconds.

 

BrabusAle_0-1662021758967.png

 

The same issues is experienced if, instead of Datamart 2 we try the same process into a Dataset.

RH2
Regular Visitor

Similar issue here. I have Dataflow for which the source is a Datamart. I am simply querying one specific table. It works very fast in Desktop but when I save the dataflow and refresh it is failing after about 20 minutes with this error: 
Error: Data Source Error : DataSource.Error: An error happened while reading data from the provider: 'Execution Timeout Expired. The timeout period elapsed prior to completion of the operation or the server is not responding.' . RootActivityId = ....Param1 = DataSource.Error: An error happened while reading data from the provider: 'Execution Timeout Expired. The timeout period elapsed prior to completion of the operation or the server is not responding.'


Have you had any luck with your issue?