Forum Discussion
DataflowGen2, which does not copy all the data...
miguel ,
Thank you very much for your feedback and testing.
I can confirm that the Staging feature is not enabled.
When I count the lines, I have more than 70,000 lines.
I did another test. I took only the 111 columns I need (out of 350).
And in this case, it works :
This confirms that it is Value.NativeQuery that causes problems when there are too many columns/too much data.
Can you reproduce a test on your side with a volume (rows and columns) equivalent to what I have on my side?
Thank you in advance for your feedback.
Vivien
I don't have an environment that matches that criteria, but it would help tremendously if our engineering team can capture some traces for your Dataflow. They wouldn't need access to the environment, but just be able to capture the traces from your account / dataflow with explicit consent and do some deeper investigations. Definitely do feel free to raise the support ticket if you have a chance and our team can get to the bottom of it.
In theory a "SELECT * FROM dbo.Account" is not exactly the same query plan that shows up for the query without the Value.NativeQuery, so the team might start by analyzing that first.