Dataflows would be really useful if you could connect to them via DirectQuery. This would mean that we could query enormous dataflows that are not practical to load to the Data model and can make agg...
tmckenzie3
6 years agoNew Member
The other aspect I am finding the more I tinker with Dataflows is increasing the importance of being able to DQ these for a few reasons. 1) Getting the timing schedules for refreshes has just got a lot more complex - To get a Dataset refreshed you need to have the Dataflow refresh complete to get the latest data, then only after that is finished start refreshing the Dataset to get the latest data. The sequence of timings is going to be complex, plus also time debilitating. My first dataflows are taking around 1 hour to process, and then my datasets after that are taking a bit of time. Waiting a few hours to get the latest data is feeling like a step backwards compared to the refresh times I was getting with my existing models. 2) We can use Dataflows as a way to generate a 'Single Model of Truth' with the data preparation. However, since anyone can modify a DF in their Datasets this also breaks the certainty that the data validity is maintained. By allowing a DQ connection you can be assured that the Single Model of Truth can be maintained.
Recent ideas
Access Variable Library in Semantic Models
Enable the Variable Library as a centralized location for storing all environment‑specific variables, allowing us to adjust them for promotion scenarios (e.g., from dev to prod) without relying on de...FreddyH1 hour agoAdvocate IINew910Views31likes2CommentsEnhance Fabric Pipeline Monitoring with Parent-Child Pipeline Lineage and Parameter Visibility
Currently, Microsoft Fabric Pipeline monitoring lacks several capabilities that are available in Azure Data Factory, making troubleshooting and operational support challenging in enterprise environme...dwramreddy2 hours agoRegular VisitorNew2Views0likes0CommentsDynamic ADLS-Gen2 path input for Spark Jobs Main definition file
I would like the ability to add a dynamic input box on a spark job definition's "Main Definition File" "ADLS-Gen2 path". this would be useful to set base and variable paths across all spark jobs...mfink_db6 hours agoNew MemberNew238Views2likes2CommentsReintroduce Tenant/Capacity Switch to Control "Users can create Plan items" Post-GA
During the Preview phase of Fabric Plan items, administrators had access to a dedicated tenant/capacity setting: "Users can create Plan items". With General Availability (GA), this granular administr...Sri-Surendra_Ku9 hours agoNew MemberNew106Views14likes1Comment