If Fabric shortcuts has ability to point to specific version of underlying delta files, we could easily implement versioning in ETL process. Currenly Data Engineering solutions implement custom versioning solutions to provide good quality data downstreams. If Fabric can provide that feature in built, that would greatly reduce development efforts. Also, everyone can follow standard approach. ... View more

Hi,   Currently, it is not possible to trigger a Fabric notebook run via the REST API, when the notebook is communicating with a lakehouse that has schemas enabled.   This feature is marked as 'Public preview', but there are several threads suggesting a fix would have been in place by late 2024: https://community.fabric.microsoft.com/t5/Data-Engineering/Error-when-writing-data-into-schema-enabled-lakehouse-using/td-p/4111069   The workaround suggested does not work either. It seems very strange that it works without the schemas enabled. The underlying issue seems to be:   INFO notebookUtils [Thread-62]: [FabricClient][ListWorkspaceByMssparkutils][get] Completed request url https://api.fabric.microsoft.com/v1/workspaces/ with correlation id X, requestId: X, activityId: , status code: 403, total cost 173ms, request cost 166ms   A timeline of when this feature would be supported will be appreciated.   Regards,   Oliver ... View more

Currently, when creating a shortcut in Fabric to ADLS Gen2 containing delta table, it does not work properly when checkpointPolicy configuration is set to v2.  Reference: https://github.com/delta-io/delta/blob/master/PROTOCOL.md#v2-spec From time to time it fails with an error: Delta table 'X' with '_last_checkpoint' file references version 'X' but the associated checkpoint file is missing from the _delta_log directory. But it is not missing, it just stored in the sidecars folder which is a new addition in v2. ... View more

Is it possible to add more write access roles for specific folders in a lakehouse? It seems that the folder-based access currently only has the option of providing read access to other users. We are thinking of a data landing lakehouse for external users to upload data into specific folders they are provided access to. ... View more

The image URL should be a publicly accessible link. However, many users prefer to use image files securely. When opening a report, it is preferable to also authenticate the image.   ... View more

Can we just get an API that does whatever is going on under the hood when the user goes through the UI and does the Edit Model > Refresh action? I have a lakehouse. I build a custom semantic model from it. Now I add or delete columns in tables of the LH. As Patrick points out in this GIAC video, there is no way to get the model to auto-update columns (add or delete them). You have to go into the UI (Edit Model > Refresh). https://youtu.be/2RuoHpNZbc4?si=zSbhKHc0G0iIzQVJ That is a non-workable solution for any large deployment. There is an API that can modify the model schema, but it requires explicit naming of columns to be added or deleted. That requires coding scripts that read the LH model, compare it to the semantic model, then dynamically build script to add/delete columns. So ... can we just get an API that does whatever is going on when the user does Edit Model > Refresh in the UI? We clearly have the function to do it. Just need to be able to call it. ... View more

Idea: Allow syncing of "Object Type Code Name fields" from Microsoft Dataverse Reason: Currently, when making a Fabric Lakehouse link from Dataverse, for choice fields, only internal values (Object Type Code) get pulled from Dataverse (e.g. "recurringapppointmentmaster" instead of the more eligible "Recurring Appointment"). While in Dataverse the column Object Type Name doesn't get pulled to Fabric Lakehouse Benefit: By allowing this extra field to by synced to Lakehouse also, it takes away the need for manual intervention, in such cases when the more stylized and eligible Object Type Code Name is preferred over the internal values, like when used Reports, Analytics and Presentation. Especially since Fabric is already a Storage and Analytics service. ... View more

We propose as a feature improvement the ability to sync files stored in OneLake to SharePoint Online and save those files to SharePoint Online. Thank you in advance. ... View more

To work with S3 shortcuts without storing credentials somewhere in Fabric would be amazing and more secure. That would be possible with Identity Federation for passwordless Authentication based on Workspace Identity. AWS IAM allows to build this, there should be a good instruction and the technical possibility. ... View more

Currently the Onelake Data access roles support only Read permission on subfolders. It would be good feature to provide write permission on individual subfolders as well. ... View more

We propose to improve the functionality so that data stored in OneLake can be exported to SharePoint using the Microsoft Fabric pipeline and data flow. Thank you in advance for your cooperation. ... View more

In enterprise environment CISO requires to have dat protection against ransomware. Backup in most cases an obvious choice but currently there is no way to do it fabric except a custom implementation. Adding support of OneLake objects to Azure Backup seems to be a good option to solve the problem. Please add it. ... View more

I have a pipeline that dumps data into a Lakehouse table (via a Copy Data task, with Overwrite option). After the pipeline runs, the Lakehouse view of the table gets updated fairly quickly. But the SQL Analytic endpoint view as accessed via SSMS still shows the OLD schema and data of the table. (Note that the old schema is 3 columns, and the new schema is 12 columns.) I have tried disconnecting the Object Explorer in SSMS and re-connecting but after 20 minutes it still shows a table of 3 columns. A simple "SELECDT * FROM ..." of that table yields a dataset of the correct 12 columns, but Object Explorer is stuck. Is this a caching bug in SSMS? ... View more

Microsoft Fabric should introduce a native Workday connector, similar to existing connectors for platforms like Salesforce and SAP, enabling seamless ingestion, transformation, and analysis of Workday data. Key Features Requested: Direct Data Extraction: Fetch Workday data via a low-code/no-code interface. Optimized Performance: Support for batch and incremental loading to minimize API calls and improve refresh speeds. Prebuilt Authentication: Simplified OAuth or SAML authentication for Workday. Schema Detection & Mapping: Auto-detect Workday objects (e.g., employees, payroll, financials) and enable easy transformations in Fabric. Real-Time & Scheduled Sync: Support real-time ingestion or scheduled data refresh for Workday data. ... View more

Make it possible to apply a Filter or RLS (Row Level Security) on OneLake shortcuts. For example: We have a central workspace which holds data for the entire organization. We have a giant fact table with data for all departments in the organization. We would like to create shortcuts from each department's workspace to the central fact table, but we would like each shortcut to only have access to that department's data. So we need the ability to apply filter or RLS to the shortcut. ... View more

Make it possible to edit the target path of a shortcut. If the data source gets moved (for some reason) then we should be able to point our existing shortcut to the new target path. ... View more

This feature is on our Roadmap. We will let you know when you can try it out. ... View more

Currently, OneLake lacks the capability to track and log access to files or tables, and this limitation extends to Shortcuts as well. Consider a scenario where a Storage Account is associated with a Log Analytics Workspace, enabling the logging of every operation. This feature proves invaluable in the event of a security breach, as it allows for a detailed investigation into the incident. It’s an essential security measure. My proposal is to enhance the existing functionality by allowing a workspace to be linked to a Log Analytics Workspace. This would enable the logging of all data operations performed on data within a lakehouse, thereby enhancing security and accountability. ... View more

Please consider adding the ability to add the use of Customer Managed Keys to Microsoft Fabric OneLake storage. ... View more