Forum Discussion
Big Data Cleansing
I'm curious on how you all handle cleansing/massaging big amounts of data. By big data, talking about > 1,000,000 rows. My data source is a direct SQL query so I am not uploading any files. I just re...
Hi Anonymous,
Since it's a Direct Query mode, I would suggest you apply the data manipulations in the data source as more as possible. There is a limitation of the rows of Direct Query that is 1 million rows. Please refer to service-get-data#considerations-and-limitations. Mostly because of the performance.
Best Regards,
Dale
v-jiascu-msft
Microsoft Employee
Microsoft EmployeeHi Anonymous,
Since it's a Direct Query mode, I would suggest you apply the data manipulations in the data source as more as possible. There is a limitation of the rows of Direct Query that is 1 million rows. Please refer to service-get-data#considerations-and-limitations. Mostly because of the performance.
Best Regards,
Dale