Forum Discussion

DALI007's avatar
DALI007
Helper II
2 years ago
Solved

saturation occurred at DataFlowGen2

Hello ,

I work with a DataflowGen2 to process extremely large tables. However, after 7 hours of data recovery, a saturation occurred at DataFlowGen2. To resolve this issue, I would like to know if it is possible to schedule a run time out or limit the volume of recovered data.
Could you help me set this up, please?

Thank you

Dataflows
  • miguel's avatar
    miguel
    2 years ago

    Not a feature that exists today, but you can definitely suggest this as a new feature by posting your idea in the Fabric Ideas portal (https://aka.ms/FabricIdeas).

     

    At the moment if you wish to set a particular limit or want to take advantage of query folding in any particular way, you will have to do it at the query level inside of the Power Query editor. Don't forget that it also depends on how things will get evaluated, so its important to understand what queries might benefit from such filter and what others might not get any sort of benefit from it due to how query folding wouldn't impact it or simply how query folding isn't supported for a particular data source.

12 Replies

  • Anonymous's avatar
    Anonymous
    Not applicable
    2 years ago

    Hi DALI007 

    Thanks for using Fabric Community.

    Can you please provide more details about the ask? What do you mean by saturation here?

    There is no way to set a timeout limit, you can apply a row limit. You can do this by taking x number of rows from the source. 

    • DALI007's avatar
      DALI007
      Helper II
      2 years ago

      Hello Anonymous ,
      Thank you for your quick feedback
      thank you for your quick feedback
      After 7hour data recovery I got an error message. can you tellme what parametrage to do to make a line number limit please ?
      Thank you