Supplies are limited. Contact info@espc.tech right away to save your spot before the conference sells out.
Get your discountScore big with last-minute savings on the final tickets to FabCon Vienna. Secure your discount
How long in average if you setup a Dataflow loading 400K rows all 53 columns?
I would like to know to compare mine (about 1.5 mins) to have an idea of baseline workload.
Thanks and best regards.
Rich
Solved! Go to Solution.
Hi @rdnguyen ,
Too many datasets to refresh at the same time occupy CPU and memory, Insufficient gateway or underlying data source performance (busy on network / refresh), To refresh the model to be loaded into memory, it takes up 2 times the size of the data set, and you need to wait for memory resources.
If you feel slow when refreshing, you can consider the following actions:
You can select the dataflow options (the ellipses next to the dataflow) and then select Cancel refresh. Or scheduled the refresh of dataset at different time.
Understanding and optimizing dataflows refresh
Best Regards,
Liu Yang
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.
Hi @rdnguyen ,
Too many datasets to refresh at the same time occupy CPU and memory, Insufficient gateway or underlying data source performance (busy on network / refresh), To refresh the model to be loaded into memory, it takes up 2 times the size of the data set, and you need to wait for memory resources.
If you feel slow when refreshing, you can consider the following actions:
You can select the dataflow options (the ellipses next to the dataflow) and then select Cancel refresh. Or scheduled the refresh of dataset at different time.
Understanding and optimizing dataflows refresh
Best Regards,
Liu Yang
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.
Hi @rdnguyen
It would depend on a lot of things such as how many steps, where it is gettings its data for etc?
From your timing above I would say that is pretty quick.