Datamart as datasource for other datamart Timeout

[BrabusAle]

Dear all,

I'm trying to set-up a multi-datamart ETL process.

The process should look like this:

Step 1 (Ingestion): From .xlsx files to Datamart (only Types and Renaming activities)

Step 2 (ETL): From Ingestion (Step 1) to another Datamart (transformation activities all foldable)

Step 3 (Specialized Datamarts): From Step 2 to Specialized datamarts for reporting

No problem with Step 1, for Step 2 I experience a Timeout error (408) without being able to retrieve any data.

This is the error 

During the process I cannot see any progress just this info

Connection set-up is like this:

Am I the only facing this problem? Thanks

[Anonymous]

Hi @BrabusAle 

I don't quite understand you said From Ingestion (Step 1) to another Datamart (transformation activities all foldable) . Can you explain it in detail ?

Best Regards,
Community Support Team _ Ailsa Tao

[BrabusAle]

Dear @Anonymous,

we do not have any DWH, so our idea is to:

- Collect raw data into a Datamart as ingestion layer without strong ETL processing (only renaming) - Let's call this datamart as "DATAMART 1"

Once we have all raw data into DATAMART 1 we should be able to develop strong ETL processes by using SQL features and engine into another datamart (DATAMART 2)

By foldable transformation  I mean that all queries from DATAMART 1 to 2 are totally foldable, so no additional steps outside the query folding process.

Unfortunately right now simples queries as group-by, join etc... works in the visual query designer but once we try to replicate the exact query into a different datamart we face this Timeout error or the process (if working) tooks hours instead of seconds.

The same issues is experienced if, instead of Datamart 2 we try the same process into a Dataset.

[RH2]

Similar issue here. I have Dataflow for which the source is a Datamart. I am simply querying one specific table. It works very fast in Desktop but when I save the dataflow and refresh it is failing after about 20 minutes with this error: 
Error: Data Source Error : DataSource.Error: An error happened while reading data from the provider: 'Execution Timeout Expired. The timeout period elapsed prior to completion of the operation or the server is not responding.' . RootActivityId = ....Param1 = DataSource.Error: An error happened while reading data from the provider: 'Execution Timeout Expired. The timeout period elapsed prior to completion of the operation or the server is not responding.'


Have you had any luck with your issue?