Forum Discussion
Super UserHow to use partitions with azure blob storage?
Hello,
I noticed that incremental refresh is working for azure blob storage.
1. But it is another possibility ? Like Direct Query ?
2. How to implement properly "folder" structure to filter azure blob storage properly with incremental refresh?
I have daily data like 01.04.2025, 02.04.2025, monthly like 04.2025 or yearly like 2025.
All saved as parquets.
If naming convention can do a work?
Please propose proper design for it.
Best,
Jacek
Hi jaryszek.,
Organizes Parquet files using a hierarchical structure such as year=2025/month=04/day=01/.
Below are the links for your reference:
Azure Blob Storage - Power Query | Microsoft Learn
Parquet, ADLS Gen2, ETL, and Incremental Refresh i... - Microsoft Fabric Community
Thank you.
6 Replies
v-saisrao-msftCommunity Support
Hi jaryszek,
Thank you for reaching out to the Microsoft Fabric Forum Community.
DirectQuery is not supported with Azure Blob Storage. To handle large datasets efficiently, you need to use Import mode along with Incremental Refresh.
Azure Blob Storage - Power Query | Microsoft Learn
Thank you.
- jaryszek
Thanks this is answering my first question.
what about this ?
2. How to implement properly "folder" structure to filter azure blob storage properly with incremental refresh?
I have daily data like 01.04.2025, 02.04.2025, monthly like 04.2025 or yearly like 2025.
All saved as parquets. - v-saisrao-msft
Hi jaryszek.,
Organizes Parquet files using a hierarchical structure such as year=2025/month=04/day=01/.
Below are the links for your reference:
Azure Blob Storage - Power Query | Microsoft Learn
Parquet, ADLS Gen2, ETL, and Incremental Refresh i... - Microsoft Fabric Community
Thank you.
- v-saisrao-msft
Hi jaryszek,
Have you had a chance to review the solution we shared earlier? If the issue persists, feel free to reply so we can help further.
Thank you.
- v-saisrao-msft
Hi jaryszek,
Checking in to see if your issue has been resolved. let us know if you still need any assistance.
Thank you.
- v-saisrao-msft
Hi jaryszek,
We haven’t heard back from you in a while regarding your issue. let us know if your issue has been resolved or if you still require support.
Thank you.
