Please give the option to turn on/off the background refresh to the database when building/editing Gen2 dataflows. This is sending constant queries to the database (SAP) resulting in poor database performance.
1 Comment
- miguelCommunity AdminStatus changed:NewtoNeed Clarification
In order to compute each step, we require to send the request to your source. Turning it off would mean that we wouldn't be able to communicate with your data source and validate that the request is valid. Imagine a scenario in which you manually type the name of a value which is incorrect and we aren't able to filter your table to say that there are no values with that string in your column. This wouldn't be possible to compute solely on the data preview as the preview typically only holds around 200 rows unless you start scrolling further down.
If perhaps the idea is more geared towards creating a local cache of your data and only working against that cached and sampled dataset, definitely feel free to edit your idea to fit such description.
We recommend using either one of the two features below to reduce the number of requests as well as the load to your data source:
Using Schema view (Preview) - Power Query | Microsoft Learn - this makes sure that you only work with your table schema and are not loading anything other than just the schema
Preview only step in Dataflow Gen2 (Preview) - Microsoft Fabric | Microsoft Learn - you can set a filter against your data to, fundamentally, work on a sample of your while authoring your dataflow without ever impacting the end-result which would go against the unfiltered dataset.
Recent ideas
Allow External OneLake Data Shares to Be Accepted into Multiple Fabric Item Types
Fabric External Data Sharing provides an excellent zero-copy mechanism for sharing OneLake data across tenants. However, the receiving tenant currently has to accept the share into a Lakehouse. I w...Mourak14 hours agoNew MemberNew5Views0likes0CommentsAllow OneLake Shortcut Authentication Mode to Be Changed In Place
OneLake shortcuts support passthrough and delegated authentication, but changing the authentication model currently requires deleting and recreating the shortcut. I would like shortcut authenticatio...Mourak14 hours agoNew MemberNew7Views0likes0CommentsTenant-Wide OneLake Shortcut Lineage and Impact Analysis
This is grounded in a documented limitation: shortcut lineage is currently workspace-scoped, and Microsoft specifically says lineage for shortcuts to warehouses and semantic models isn't currently av...Mourak14 hours agoNew MemberNew14Views0likes1CommentAdd an End-to-End Production Reference Architecture for Microsoft Fabric Real-Time Intelligence
I would like to see a complete end-to-end Microsoft Fabric Real-Time Intelligence reference architecture that demonstrates how the individual RTI capabilities work together in a production-oriented s...Mourak14 hours agoNew MemberNew5Views0likes0CommentsImprove CI/CD consistency for Microsoft Fabric Real-Time Intelligence Eventstreams
Microsoft Fabric Real-Time Intelligence has made strong progress with Git integration and deployment pipelines, but lifecycle management can still be inconsistent across Eventstream sources, destinat...Mourak14 hours agoNew MemberNew3Views0likes0Comments