Advance your Data & AI career with 50 days of live learning, dataviz contests, hands-on challenges, study groups & certifications and more!
Get registeredGet Fabric Certified for FREE during Fabric Data Days. Don't miss your chance! Request now
This is request from STrategic customer T-Mobile. They point out that there is metadata in the parquet files already, so why do they have to spend compute to count all the rows to get a simple count of rows. More details:
Regarding the rowcount functionality request for Parquet in ADF by T-Mobile, I followed up with the customer and they advised as follows:
“The count should be instant because it is in the metadata of the file. right now you have to run a select count from the serverless endpoint. so counting the startup time of synapse serverless could be 3- 5 min”
As a reminder/context, your guidance was for him to not ask for a specific technical implementation, but to ask for a functional requirement/sla.
There is already an open feature request, but we were hoping that this could help to prioritize it.
You must be a registered user to add a comment. If you've already registered, sign in. Otherwise, register and sign in.