Forum Discussion
V55
Helper I
Helper IDataflow error for huge records - Evaluation resulted in a stack overflow
I have a table with lakhs of records. 'Time' is one of the fields. I have created a function fetchlatest to get the latest record based on 'time'. As you can see in the below code, the function basic...
v-yuta-msft
Community Support
Community SupportHi V55,
These kind of issue may caused by the datasize. Is the data source Azure Data Lake Storage Gen2? Please refer to consideration and limitation here:
Regards,
Jimmy Tao
V55Helper I
Helper IHi v-yuta-msft,
Thanks for the response.
I am assuming all the dataflow data gets stored ADLS Gen2.
My datasource is blob, but I am actually storing it in a different dataflow.
Then I created another dataflow to fetch data from above dataflow, transform the data and then call get latest function.
I just want to highlight that I did not get the error when datasize is less. When I have lakhs of records, I am getting this error.
The error returned by dataflow can be seen here :Dataflow Error. (WCUS)