Configurable and triggerable caching for cross-cloud and inter-region queries in OneLake
In the Fabric launch, it was mentioned that cross-cloud and inter-region queries in OneLake would utilize smart caching to optimize on egress charges and performance of these distributed queries.
It will be very useful to be able to trigger cache invalidations and refreshes for this technology. An opaque cache layer that is attempting to be smart is a path to pain for someone's use case, and my luck tells me it is likely my own use case.
Many data processes are still batch oriented, and many modern processes are event driven. Both of these are better supported by a triggerable cache refresh than by any smart heuristic.
Please do not make more opaque and hard to manage features. A smart layer is great, only insofar as we can troubleshoot and override it when necessary.
2 Comments
- nishalitNew MemberIt is our roadmap to utilize smart caching to optimize on egress charges and to allow configuring cache retention period. We will share more details as it becomes available.
- fbcideas_migusrNew MemberStatus added:Planned
Recent ideas
Paste values in slicers for hierarchy data
Hierarchical slicers are widely used in enterprise reports (for example Product RCN > SKU Key, Region > Country > City, or GPP > Division > RCN > SKU). Users often need to bulk-filter by pasting valu...eddieisking200053 minutes agoFrequent VisitorNew4Views0likes0CommentsPower Query Parameter create/use when connecting to a dataflow
In power query when you connect to a table in a dataflow there are no options to create or use a parameter for that dataflow. When connecting to SQL there is an option when setting up the connection ...ben_holmes3 hours agoNew MemberNeed Clarification203Views3likes2CommentsMake Copilot Approval status for semantic model available through API
In recent versions fabric allowed to mark a semantic model as approved for copilot to reduce AI adoption friction. However there is no specific way for external governance application to analyse whi...FrançoisD3 hours agoFrequent VisitorNew11Views2likes0CommentsClone a workspace, including its data, to a new workspace
Description: Today there's no way to fully clone a Fabric workspace: git sync and Deployment Pipelines move item definitions only, not the underlying data; Warehouse's zero-copy CREATE TABLE ... AS ...gclements4 hours agoHelper IINew12Views1like0CommentsAllow NotebookUtils getSecret() to authenticate with Workspace Identity
Current behavior In Microsoft Fabric, notebookutils.credentials.getSecret() authenticates against Azure Key Vault using the identity of the user who executes the notebook. This behavior appli...tmihara10 hours agoNew MemberNew8Views0likes0Comments