Forum Discussion

sholy29's avatar
sholy29
Frequent Visitor
1 year ago

My DataFlow Gen 2 Fails with Unknown Evaluation Error 999999 (Request ID: fcd89914-0dd9-44ea-9b09-94

I do not understand why the Dataflow gen 2 is too buggy. This should be a revolutionary product from Fabric but it just cannot work without errors all the time.   I have a dataflow gen 2 that takes...
dataflow
CRadziwill's avatar
CRadziwill
Frequent Visitor
1 year ago

Hi Alessandro,

Thank you for your quick response, that solved the problem. Thank you very much!

Does that mean I can't use the function at all, even though it should offer advantages? Or do I have to make special settings for it? Can you help me with that?

 

Alven's avatar
Alven
Icon for Microsoft Employee rankMicrosoft Employee
1 year ago

Hi CRadziwill ,

usage (or not) of staging should not cause any failure, and if you instead get one, it usually means there is a problem somewhere thay requires an investigation / support ticket.

In general, staging can help with performance in some cases, but it really depends on the scenario.

For example, if your query does not perform complex transformations and is simply copying data from a SQL database to a Lakehouse using an output destination, staging is not needed, and it's actually disabled automatically when setting the output destination.

 

Some useful information can be found in Best practices for getting the best performance with Dataflow Gen2 in Fabric Data Factory - Microsoft Fabric | Microsoft Learn.

 

Regards,

Alessandro