BrabusAle's avatar
BrabusAle
Regular Visitor
4 years ago
Status:
Needs Info

Datamart as datasource for other datamart Timeout

Dear all,

I'm trying to set-up a multi-datamart ETL process.

 

The process should look like this:

Step 1 (Ingestion): From .xlsx files to Datamart (only Types and Renaming activities)

Step 2 (ETL): From Ingestion (Step 1) to another Datamart (transformation activities all foldable)

Step 3 (Specialized Datamarts): From Step 2 to Specialized datamarts for reporting

 

No problem with Step 1, for Step 2 I experience a Timeout error (408) without being able to retrieve any data.

 

This is the error 

During the process I cannot see any progress just this info

 

Connection set-up is like this:

 

Am I the only facing this problem? Thanks

3 Comments

  • Anonymous's avatar
    Anonymous
    Not applicable

    Hi BrabusAle 

    I don't quite understand you said From Ingestion (Step 1) to another Datamart (transformation activities all foldable) . Can you explain it in detail ?

     

    Best Regards,
    Community Support Team _ Ailsa Tao

  • BrabusAle's avatar
    BrabusAle
    Regular Visitor

    Dear Anonymous,

    we do not have any DWH, so our idea is to:

     

    - Collect raw data into a Datamart as ingestion layer without strong ETL processing (only renaming) - Let's call this datamart as "DATAMART 1"

     

    Once we have all raw data into DATAMART 1 we should be able to develop strong ETL processes by using SQL features and engine into another datamart (DATAMART 2)

    By foldable transformation  I mean that all queries from DATAMART 1 to 2 are totally foldable, so no additional steps outside the query folding process.

     

    Unfortunately right now simples queries as group-by, join etc... works in the visual query designer but once we try to replicate the exact query into a different datamart we face this Timeout error or the process (if working) tooks hours instead of seconds.

     

     

    The same issues is experienced if, instead of Datamart 2 we try the same process into a Dataset.

  • RH2's avatar
    RH2
    Regular Visitor

    Similar issue here. I have Dataflow for which the source is a Datamart. I am simply querying one specific table. It works very fast in Desktop but when I save the dataflow and refresh it is failing after about 20 minutes with this error: 
    Error: Data Source Error : DataSource.Error: An error happened while reading data from the provider: 'Execution Timeout Expired. The timeout period elapsed prior to completion of the operation or the server is not responding.' . RootActivityId = ....Param1 = DataSource.Error: An error happened while reading data from the provider: 'Execution Timeout Expired. The timeout period elapsed prior to completion of the operation or the server is not responding.'


    Have you had any luck with your issue?