Forum Discussion
Filtering csv files from Azure Blob Storage
I have one question that might sound stupid, but I could not find answer anywere, so here it is. When we connect to data source, is whole data downloaded immediately when we click on transform button...
This data is generated on daily basis so it amount will increase quickly. I will consider moving it somewhere else for sure.
See this article published just yesterday on using Azure Data Lake gen 2. Seems perfect for your scenario. I know ADL does not download file contents until it begins the combine operation.