onelake
221 TopicsCopy job for SAP with ABAP Add-On in Microsoft Fabric (Preview)
SAP systems sit at the center of many enterprisesโ core business operations, powering processes across finance, supply chain, manufacturing, procurement, and HR. That makes SAP data some of the most business-critical data in the enterprise. As organizations modernize their analytics and AI platforms, bringing SAP data together with the rest of the enterprise data estate has become increasingly important. But moving SAP data at enterprise scale has historically been difficult. SAP landscapes are complex, data volumes are large, and extraction architectures often require specialized frameworks, custom code, and additional operational layers. For many organizations, this creates friction between where their most important operational data lives and where they want to analyze, enrich, and activate it. We are delivering the next step of our SAP roadmap: Copy job for SAP with ABAP Add-On in Microsoft, this new capability complements offerings like: SAP Business Data Cloud Connect was announced in SAP and Microsoft accelerate business insights and AI innovation with SAP Business Data Cloud Connect for Microsoft Fabric and will be available over the coming months). It will enable bi-directional zero-copy sharing between SAP Business Data Cloud and Microsoft Fabric without the need for data movement. Mirroring via SAP Datasphere, a turnkey data replication capability providing scalable near real-time data movement from SAP sources into Fabric OneLake (Generally Available). To learn more, refer to the Fabric mirroring documentation. Now, organizations can extract large volumes of SAP data through Copy job, reduce the need for external extraction frameworks, and build a scalable path from initial ingestion to ongoing incremental updates. Copy job provides a configuration driven experience for moving data across clouds, applications and on-premises systems โ designed to support high-scale, multi-cloud data movement for petabyte-scale ingestion scenarios. Copy job helps bring data into OneLake as part of a unified, governed foundation for analytics and AI. High-performance SAP extraction with Copy job and Microsoft ABAP add-on integration This new integration option enables scalable, high-throughput extraction from SAP systems, making it easier than ever to bring large volumes of SAP data into Microsoft Fabric for analytics, reporting, and AI. Figure: High-level architecture diagram of Copy job with ABAP Add-on. Broad data coverage across SAP Systems Extracting data from SAP systems at scale can be complex and resource intensive. This new capability simplifies the process while delivering high performance. The solution runs directly inside SAP using a Microsoft-provided ABAP Add-On. Data is extracted at the application layer and transferred efficiently through Copy Job in Fabric Data Factory. This removes the need for complex external extraction frameworks and reduces operational overhead. It supports a wide range of SAP data sources. You can extract from SAP tables, views, and ABAP CDS views, including semantically rich models used for analytics. The capability works across both SAP ECC and SAP S/4HANA, whether deployed on-premises or in the cloud. Providing consistent access to both raw operational data and business-ready data models. Flexible data delivery styles for real-world SAP scenarios Through the integration with Copy Job, the solution handles data movement at scale. The integration is designed for high throughput and efficient processing of large datasets. Parallel execution capabilities help accelerate ingestion and reduce data transfer times. The solution supports different loading strategies depending on your needs. You can perform full snapshots for initial ingestion or bulk replication scenarios. For ongoing updates, incremental loads can be configured using watermark-based extraction. This allows you to process only the data that has changed. Together, these capabilities make it easier to design efficient pipelines. You can start with a large initial load and then transition seamlessly to incremental updates, without changing the overall architecture. SAP data in OneLake, ready for analytics and AI After ingestion, SAP data is immediately available in Microsoft OneLake. From there, it can be used across the entire Fabric platform. You can build Power BI reports directly on SAP data and operational datasets. You can run large-scale analytics workloads or combine SAP data with non-SAP sources from across your organization creating a unified data foundation without silos. With all data in one place, it also becomes easier to enable AI-driven scenarios. Applications and data agents can access consistent, trusted business data to generate insights and drive automation. Get started For more information, refer to the ABAP Add-On for SAP data extraction with Copy Job in Microsoft Fabric documentation. You can start exploring this capability today to: Accelerate SAP data ingestion Simplify data extraction architectures Enable scalable analytics and AI scenarios Looking ahead Copy job for SAP with Microsoft ABAP Add-On is another step in our continued investment in SAP data integration for Microsoft Fabric. SAP is one of the most important enterprise data sources for our customers, and Data Factory in Fabric is designed to help organizations bring SAP and non-SAP data together through scalable, flexible data movement experiences. With Copy job, customers can move data across clouds, applications, and on-premises systems into OneLake. With the Microsoft provided ABAP Add-On, that same Copy job experience now extends more deeply into SAP, helping customers bring business-critical SAP data into Fabric for analytics, reporting, and AI. We will continue expanding SAP data integration capabilities across Microsoft Fabric so customers can simplify their data architectures, reduce silos, and build a unified, governed foundation for enterprise analytics and AI.3.3KViews1like3CommentsFirst Look at Microsoft Fabric
Join us for an exciting session as we dive into the world of Microsoft Fabric and explore its powerful capabilities. In this session, Mim, a seasoned expert in data engineering and analytics, will take you on a journey through the intricacies of building a full data pipeline using Microsoft Fabric. Throughout the demonstration, Mim will showcase how to leverage various cutting-edge technologies, including Python Notebook, OneLake Storage, and PowerBI Direct Lake Mode, to create a seamless and efficient data workflow. You'll get a firsthand look at how these tools can be integrated within Microsoft Fabric to enhance your data processing and analysis capabilities. In addition to the technical aspects, Mim will share valuable insights and observations on Fabric's pricing model. Understanding the financial implications of utilizing Microsoft Fabric is crucial for organizations aiming to optimize their resources and budget effectively. Mim will shed light on the different pricing structures, helping you make informed decisions when incorporating Fabric into your data ecosystem. Whether you're a data engineer, data scientist, or an analytics enthusiast, this session will provide you with a solid foundation in utilizing Microsoft Fabric for building efficient data pipelines. Don't miss out on this opportunity to gain valuable knowledge and practical insights from an industry expert. ๐๐๐ง๐จ๐๐๐ฃ ๐๐ฝ๐๐๐- ๐๐๐๐ง๐ค๐จ๐ค๐๐ฉ ๐พ๐ค๐ข๐ข๐ช๐ฃ๐๐ฉ๐ฎ: Link ๐๐๐ฃ๐ ๐๐๐๐ฃ: https://bit.ly/32tGkif ๐๐๐ก๐๐๐ง๐๐ข ๐พ๐๐๐ฃ๐ฃ๐๐ก: https://t.me/PersianPBIUG ๐๐ค๐ช๐๐ช๐๐: https://bit.ly/3hk20RL Language: English253Views0likes0CommentsIntroduction to Microsoft Fabric with James Serra | Calgary Fabric User Group
Join us on February 6, 2024, at 12:00 pm MST for a Live Stream Event via Microsoft Teams! The purpose of this group is to discuss and keep up with the ever-shifting landscape of the Microsoft Fabric Experience. Agenda 12:00 pm โ 12:05 pm โ Networking & Welcome 12:05 pm โ 12:55 pm โ An Introduction to Microsoft Fabric | James Serra 12:55 pm โ 1:00 pm โ Q&A & Meeting Close Presentation Description Microsoft Fabric is the next version of Azure Data Factory, Azure Data Explorer, Azure Synapse Analytics, and Power BI. It brings all of these capabilities together into a single unified analytics platform that goes from the data lake to the business user in a SaaS-like environment. Therefore, the vision of Fabric is to be a one-stop shop for all the analytical needs for every enterprise and one platform for everyone from a citizen developer to a data engineer. Fabric will cover the complete spectrum of services including data movement, data lake, data engineering, data integration and data science, observational analytics, and business intelligence. With Fabric, there is no need to stitch together different services from multiple vendors. Instead, the customer enjoys end-to-end, highly integrated, single offering that is easy to understand, onboard, create and operate. Register Here433Views0likes0CommentsDriving Actions and Alerts with Data Activator | Calgary Fabric User Group
Agenda 12:00 pm โ 12:05 pm โ Networking & Welcome 12:05 pm โ 12:55 pm โ Driving Actions and Alerts with Data Activator | Tessa Hurr and Rony Thomas 12:55 pm โ 1:00 pm โ Q&A & Meeting Close Presentation Description Join this session to learn more about how you can take insights to action with Data Activator, a no-code tool for automatically taking actions when patterns or conditions are detected in changing data. By the end of this session, youโll get an introductory overview of the product, discover how Data Activator applies to your business goals, and will have the opportunity to chat further with members of the product team.77Views0likes0CommentsEliminate Data Silos with OneLake, the OneDrive for Data
Microsoft OneLake is a single, unified, logical data lake for your whole organization. Like OneDrive, OneLake comes automatically with every Microsoft Fabric tenant and is designed to be the single place for all your analytics data. Elizabeth Oldag of Microsoft will give an overview of OneLake to help you get started. With OneLake shortcuts, you can connect data from anywhere into a single, multi-cloud data lake. The same data can be used across multiple analytical engines because Fabric engines store all tabular data in the open Delta Parquet format. Not only that, OneLake provides open access to all of your Fabric items through existing Azure Data Lake Storage (ADLS) Gen2 APIs and SDKs, so you have a choice in what analytic engines to use, including other services, such as Azure Databricks. Elizabethโs presentation will include a mix of slides and demos. You will learn: About OneLakeโs core value propositions and features How these features enable a true data mesh as a service How to unify data across an organization and clouds Elizabeth Oldag is a Principal Product Manager on Microsoft OneLake.Direct Lake Migration & Semantic Link Labs
In this session, you will learn how to migrate an import or DirectQuery semantic model to Direct Lake mode, leveraging the newly released semantic-link-labs python library for Fabric notebooks. Additionally, other feature capabilities within semantic-link-labs will be introduced which are geared towards semantic model development and optimization. Tentative Agenda (subject to change, all times listed are in Pacific Time) 7:45am Teams Meeting opens 8:00am-8:05 am Welcome 8:05am-9:05am Feature Presentation 9:05am-9:10am Wrap-up Registration: This meet-up will be hosted on Microsoft Teams and recorded for those who cannot attend live. To access the Teams Meeting link, you must RSVP for the event. Joining the event: Attendees can join the Teams Meeting starting at 7:45 am PST on the event day. The event will begin at 8:00 am PST. Please ensure you are on mute to minimize background noise and distractions. During the presentation, type your questions and comments into the chat area, which the event hosts will monitor. There will be a Q&A session at the end, where you can unmute your mic and share your video to ask questions.Power BI Security
Brianna Reddick, Associate Director of Business Intelligence, will walk us through her approach to security in Power BI and Microsoft Fabric. She will walk through basic concepts like App audiences; use of Power Apps and Power Automate to control Entra group access and look ahead to the upcoming OneLake Security and discuss how it might change our approach to Fabric security.Credit Unions Microsoft Fabric User Group - Session 2
Join us for Session 2 of the Credit Unions Microsoft Fabric User Group! This month we're excited to welcome Kevin Arnold, Microsoft Data Platform MVP, as our guest speaker. Kevin will be presenting "Building a Data Warehouse on the Shores of OneLake in Microsoft Fabric" โ a deep dive into warehouse design and architecture patterns on OneLake. Agenda: 5 min โ Welcome & Housekeeping 60 min โ Guest Speaker: Kevin Arnold "Building a Data Warehouse on the Shores of OneLake in Microsoft Fabric" 20 min โ Open Discussion & Questions 5 min โ Closing Friday, May 22, 2026 11:00 AM PT | 1:00 PM CT | 2:00 PM ET Virtual โ Microsoft Teams Whether you're already building in Fabric or just getting started, this is a great opportunity to learn from an MVP and connect with other credit union professionals on the same journey. See you there!16KViews0likes0CommentsSimplifying secure data access with Delegated OneLake Shortcuts (Preview)
Introduction Data rarely stays in one place. As organizations standardize Microsoft Fabric and OneLake, the same datasets need to be reused across teams, domains, workspaces, and increasingly across tenant boundaries. The challenge is no longer moving data; it is sharing it securely, consistently, and at scale without creating copies, breaking governance, or forcing every consumer to be individually provisioned at the source. OneLake Shortcuts already solve a large part of this problem. A shortcut presents data where people need it while the data stays in its original location, enabling a true zero-copy approach to distribution. By default, OneLake Shortcuts use pass-through authentication: when a user reads a shortcut, Fabric accesses the target data using that signed-in userโs identity, and the data owner controls access directly on the target. Pass-through is the right model for many collaborative scenarios, but customers have consistently told us it does not fit every access pattern. Two points came up frequently: Access management does not scale. When a curated dataset must be served to thousands of downstream users across multiple teams, the data owner becomes responsible for granting and maintaining every individual userโs permission on the source, an operational bottleneck that grows with every new consumer. Cross-tenant sharing is harder than it should be. Multi-tenant organizations told us that they need to access data residing in OneLake across their own tenant. These are not edge cases. They are everyday realities for enterprises building governed, reusable data products on Fabric. The preview of Delegated OneLake Shortcuts โ including delegated sharing both within a tenant and across tenants โ gives data owners a simpler, governed way to distribute data without compromising on security. Introducing delegated OneLake Shortcuts Delegated OneLake Shortcuts add a second authentication option to the existing shortcut experience you already know. Instead of accessing the target data as each signed-in user, a delegated shortcut accesses the target through a configured connection identity. That identity can be an organizational account, a service principal. This identity is attached to the shortcut, so all access to the shortcut reaches the target as the delegated identity. Delegated authentication is entirely optional and complements the default experience. If a user does not choose delegated authentication when creating a shortcut, the shortcut continues to use pass-through authentication exactly as before. The default flow is unchanged; delegation is simply there when you need it. How it works A delegated shortcut behaves like other external shortcuts in Fabric. When you create one, you sp, and that connection is used to browse and read the target data. This brings a familiar, governed connection model to OneLake-to-OneLake sharing. Identity delegation - Downstream users access the data through the delegated identity rather than their own, so the data owner no longer must provision each individual consumer on the source item. Secure access enforcement with OneLake security - OneLake security roles can be configured on both the data producer and data consumer delegated Shortcuts. At the time of this writing, table level security and column-level security are supported for delegated shortcuts, on both the target (where you are creating the shortcut) and the shortcut source (where data resides). Delegated permissions management - A shortcut can delegate as a fixed identity that represents a business unit. The central data owner controls what that identity can see, while the business unit manages OneLake security for its own end users, all while still honoring the controls applied to the delegated identity. Cross-tenant sharing Delegated shortcuts also work across Microsoft Fabric tenants. A cross-tenant delegated shortcut lets you create a OneLake shortcut to data that lives in another organizationโs Fabric tenant. You provide a connection path to the external OneLake data and authenticate with an identity from that tenant; downstream users then access the external data through the configured delegated identity, without each user needing individual cross-tenant permissions. This makes delegated shortcuts a natural fit for multi-tenant enterprises, for example, sharing curated data between an organizationโs test and production tenants, or between a parent company and a subsidiary using the same zero-copy, intersection-based security model that applies within a tenant. Difference between External Data Sharing and delegated Shortcuts Microsoft Fabric has External Data Sharing, a feature that enables Fabric users to share data from their tenant with users in another Fabric tenant. External data sharing can be used when the consumer has no identity in the producer's tenant, such as sharing across organizational boundaries with an outside partner or customer. This is ideal when you must share with partners or when ISVs must share data with their customers and donโt want to have the consumer identity in their tenant. Cross-tenant delegated shortcuts are used when the data consumer has an identity, such as an organizational account or service principal, in the producerโs tenant. For example, an organization can share data between its own test and production tenants, with access flowing through the configured delegated identity. Use cases Delegated OneLake Shortcuts are designed for the moments when the default pass-through behavior does not match the access pattern you want for a data product. Common scenarios include: Departmental data sharing at scale - Represent each department with a delegated identity, scope what that identity can see, and let department owners manage access for their own users instead of routing every request through the central data owner. Cross-tenant and subsidiary sharing - Share curated data between tenants โ such as test-to-production or parent-to-subsidiary โ with no data copies and the same delegated security model. Getting started Open the target Fabric item, such as a Lakehouse, and select Get data > New table shortcut. In New shortcut, select Microsoft OneLake, then choose the source you want to shortcut to. For cross-tenant data, select Enter connection details and provide the external OneLake path. For Connection method, select Delegated identity, then Connect. Choose an existing connection or create a new one by providing the OneLake path, a recognizable connection name, and an authentication kind (organizational account or service principal). Sign in to complete authentication. Browse the source, select the folders or tables to include, then review and create the shortcut. To switch an existing shortcut between pass-through and delegated authentication, delete and recreate it with the desired method. For detailed steps, refer to the OneLake Shortcuts documentation. Conclusion and next steps OneLake shortcuts are a foundational building block for zero-copy data distribution across Microsoft Fabric. Delegated OneLake Shortcuts extend that foundation to the scenarios enterprises care about most: serving curated data to large audiences, delegating access management to the teams closest to the users, and sharing securely across tenant boundaries. Together, pass-through and delegated shortcuts let organizations choose the right balance of control, scale, and simplicity for each data product. Pass-through keeps source-managed authorization per person for collaborative engineering. Delegated mode turns a shortcut into part of a governed publishing architecture: central teams retain ownership of the source, consuming teams avoid copying data, and downstream audiences access a managed experience rather than raw-path access โ without ever giving up the governance benefits of unifying data in OneLake. Share your feedback, use cases, and questions in the Microsoft Fabric Community. Your input directly shapes the roadmap.4.3KViews4likes4Comments