Forum Discussion
wintergolem
4 years agoFrequent Visitor
Dataflow with incremental refresh doing a full table load x16 times
I'm working on adding incremental refresh to a fact table in my dataflow, unfortunately when this dataflow does it's next refresh I see 16 processes on my mysql instance that are all performing the s...
- 4 years ago
With the information given, the first place I'd be checking is to ensure query folding is occurring.
I assume query folding works with MySQL the same as MSSQL?
My understanding is, without query folding, the advantages of incremental refresh are redundant.
KNP
4 years agoSuper User
With the information given, the first place I'd be checking is to ensure query folding is occurring.
I assume query folding works with MySQL the same as MSSQL?
My understanding is, without query folding, the advantages of incremental refresh are redundant.
wintergolem
4 years agoFrequent Visitor
Accepting this as the solution cause I believe this was ultimatly the issue. Having a new PipelineExpection: IO Timeout issue that's preventing me from verifying it though