Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Get Fabric Certified for FREE during Fabric Data Days. Don't miss your chance! Request now

Data Factory count rows using metadata, rather than have to go through all the data.

This is request from STrategic customer T-Mobile. They point out that there is metadata in the parquet files already, so why do they have to spend compute to count all the rows to get a simple count of rows. More details:

Regarding the rowcount functionality request for Parquet in ADF by T-Mobile, I followed up with the customer and they advised as follows:


“The count should be instant because it is in the metadata of the file. right now you have to run a select count from the serverless endpoint. so counting the startup time of synapse serverless could be 3- 5 min”


As a reminder/context, your guidance was for him to not ask for a specific technical implementation, but to ask for a functional requirement/sla.

There is already an open feature request, but we were hoping that this could help to prioritize it.


Status: Needs Votes
Comments
fbcideas_migusr
New Member
Status changed to: Needs Votes