Datamart as datasource for other datamart Timeout
Dear all,
I'm trying to set-up a multi-datamart ETL process.
The process should look like this:
Step 1 (Ingestion): From .xlsx files to Datamart (only Types and Renaming activities)
Step 2 (ETL): From Ingestion (Step 1) to another Datamart (transformation activities all foldable)
Step 3 (Specialized Datamarts): From Step 2 to Specialized datamarts for reporting
No problem with Step 1, for Step 2 I experience a Timeout error (408) without being able to retrieve any data.
This is the error
During the process I cannot see any progress just this info
Connection set-up is like this:
Am I the only facing this problem? Thanks
3 Comments
- AnonymousNot applicable
Hi BrabusAle
I don't quite understand you said From Ingestion (Step 1) to another Datamart (transformation activities all foldable) . Can you explain it in detail ?
Best Regards,
Community Support Team _ Ailsa Tao - BrabusAleRegular Visitor
Dear Anonymous,
we do not have any DWH, so our idea is to:
- Collect raw data into a Datamart as ingestion layer without strong ETL processing (only renaming) - Let's call this datamart as "DATAMART 1"
Once we have all raw data into DATAMART 1 we should be able to develop strong ETL processes by using SQL features and engine into another datamart (DATAMART 2)
By foldable transformation I mean that all queries from DATAMART 1 to 2 are totally foldable, so no additional steps outside the query folding process.
Unfortunately right now simples queries as group-by, join etc... works in the visual query designer but once we try to replicate the exact query into a different datamart we face this Timeout error or the process (if working) tooks hours instead of seconds.
The same issues is experienced if, instead of Datamart 2 we try the same process into a Dataset.
- RH2Regular Visitor
Similar issue here. I have Dataflow for which the source is a Datamart. I am simply querying one specific table. It works very fast in Desktop but when I save the dataflow and refresh it is failing after about 20 minutes with this error:
Error: Data Source Error : DataSource.Error: An error happened while reading data from the provider: 'Execution Timeout Expired. The timeout period elapsed prior to completion of the operation or the server is not responding.' . RootActivityId = ....Param1 = DataSource.Error: An error happened while reading data from the provider: 'Execution Timeout Expired. The timeout period elapsed prior to completion of the operation or the server is not responding.'
Have you had any luck with your issue?