spark
9 TopicsDiscover the Latest Microsoft Fabric Updates & Connect with the Community
Discover the Latest Microsoft Fabric Updates & Connect with the Community, Thu, Dec 12, 2024, 6:00 PM | Meetup Join us for an engaging evening of insights, learning, and networking as we explore the latest in Microsoft Fabric, the all-in-one analytics platform that revolutionizes how businesses manage data, analytics, and business intelligence. From data engineering and lakes to real-time analytics, Microsoft Fabric delivers a unified ecosystem to maximize your organization's data potential. This meetup is tailored for professionals and enthusiasts passionate about leveraging Microsoft Fabric's capabilities. Whether you're a seasoned pro or just starting out, this is your chance to connect with like-minded peers and industry experts. Agenda 18:00 – Arrive, grab a drink, and find your spot Introduction & Purpose of the User Group Learn about the goals of this user group and how we aim to foster a thriving community around Microsoft Fabric. 18:15 – (Un)limited Lakehouse Power! Get the Most Out of Your Capacity Maximize your Microsoft Fabric experience with tips and insights on fully leveraging your lakehouse capacity. Speaker: Niels Siepe & Martin Wille, Obungi GmbH 19:00 – Short Break 19:15 – What's up and coming in Microsoft Fabric In this session, you’ll learn all about the latest updates in Microsoft Fabric and get a glimpse of what’s on the roadmap. Plus, look forward to an exciting demo! Speaker: Niels Siepe & Martin Wille, Obungi GmbH 20:00 – Panel Discussion & Drinks Engage with our speakers and participants in an open panel discussion while enjoyingData Connect: Create a Medallion Architecture in Fabric lakehouse using Spark
IDBC Data Connect Series – Next Session is Here! We’re thrilled to announce our next Data Connect Series session, where we’ll explore Medallion Architecture in a Microsoft Fabric Lakehouse Using Spark with an industry expert! Date: 4th May 2025 Time: 11:00 AM IST Venue: Online Speaker: Vijay Perepa | Co-Founder @PerepaEdu | MCT | Microsoft Super User Host: Anmol Malviya | Microsoft Super User What You’ll Learn? Understanding Medallion Architecture (Bronze, Silver, Gold layers) How to build a structured Lakehouse in Microsoft Fabric Using Apache Spark for efficient data transformation Best practices & real-world use cases Who Should Attend? Data professionals, Power BI users, and tech enthusiasts Those exploring Microsoft Fabric & Lakehouse architecture Anyone interested in modern data engineering Let’s learn, collaborate & innovate together! Register Now Join IDBC on Microsoft Teams: https://teams.live.com/l/community/FEAPg7Z13cnL8RrVAU Join Our WhatsApp Group for Updates: https://chat.whatsapp.com/HL6aOLHMqAGJm1JqpzhkJw #MicrosoftFabric #FabricCommunity #PowerBI #DataEngineering #ApacheSpark #DataLakehouse #MedallionArchitecture #IDBC #FabricSuperUser264Views0likes0CommentsAccelerating Spark in Microsoft Fabric:Native Execution and Beyond by Miles Cole
What if your Spark jobs could run significantly faster, with zero effort and no additional cost? In this session, I'll unpack how the new Native Execution Engine and other innovations in Microsoft Fabric are redefining performance—powered by vectorized processing, columnar memory, and intelligent runtime optimizations. Whether you're building ELT pipelines, crunching massive datasets, or running complex analytics, see how these advancements can supercharge your workflows and help you unlock the full potential of Fabric. TENTATIVE AGENDA (subject to change, all times listed are in Pacific Time): 2:45 pm Teams Meeting opens 3:00 pm-3:05 pm Welcome 3:05 pm-4:05 pm Feature Presentation 4:05 pm-4:10 pm Wrap-up REGISTRATION: This meet-up will be hosted on Microsoft Teams and will be recorded for those who cannot attend live. To access the Teams Meeting link, you must RSVP for the event. JOINING THE EVENT: Attendees can join the Teams Meeting starting at 2:45 pm PST on the day of the event. The link will be visible only if you RSVP beforehand. The event will begin at 4:00 pm PST. Please ensure you are on mute to minimize background noise and distractions. During the presentation, type your questions and comments into the chat area, which will be monitored by the event hosts. There will be a Q&A session at the end, where you can unmute your mic and share your video to ask questions.Data Analytic Group Presents Fabric Data Days – DP-700 Vol.4
Details 11/28/2025 06:00 PM to 07:00 PM IST Session 1 We’re kicking off our first session of the DP-700 series with the topic: Implement and Manage Analytics Solutions This session will cover: In this first DP-700 session, discover how Microsoft Fabric powers end-to-end analytics in a unified environment. From data ingestion and transformation to modeling and insights, experience the complete analytics journey. Whether you're preparing for the DP-700 certification or strengthening real-world analytics skills, this session is for you. Your path to mastering Fabric’s analytics and AI capabilities starts here. Speaker: Amit Chandak Chief Analytics Officer - Kanerika, Microsoft Data Platform MVP, Super User- Power BI Community, YouTuber Note: As part of the series, the remaining session will be held on 30th November 2025 (Sunday) from 10:00 AM to 01:00 PM IST Upcoming session : 30/11/2025 Sunday Session 2 (10:00 AM – 11:00 AM) Ingest and Transform Data Ingest and transform batch data,Ingest and transform streaming data,Design and implement loading patterns Speaker: Rajendra Ongole Microsoft Data Platform MVP | Superuser at Fabric Community | BI Lead at Bosch | 5x MCT Session 3 (11:00 AM – 12:00 PM) Monitor and Optimize Microsoft Fabric Solutions Importance of monitoring and optimization in Fabric,Monitor analytics solutions in Fabric,Optimize analytics solutions in Fabric,Security and compliance monitoring Speaker: INTURI SUPARNA BABU Microsoft Fabric Community Super User | Specialist – Data Engineering Session 4 (1:00 PM – 2:00 PM) Prepare for Exam Day + Open Q&A In this final session, we will cover: Why get certified?,How to prepare effectively,Understanding the exam format and scoring,Practice questions and case studies,Tips and tricks for exam day,Interactive Q&A Speaker: Anusha Gudapati Manager at Life Insurance | PL-300, DP-600, DP-700 – Microsoft Certified Associate Organizers: Rajendra Ongole, Navya, Koundinya Lanka,Shashi 𝑹𝒆𝒈𝒊𝒔𝒕𝒆𝒓 𝒂𝒕 𝑴𝒆𝒆𝒕𝒖𝒑: https://www.meetup.com/dataanalyticgroup/ 𝑱𝒐𝒊𝒏 𝒕𝒉𝒆 𝑾𝒉𝒂𝒕𝒔𝑨𝒑𝒑 𝑮𝒓𝒐𝒖𝒑: https://chat.whatsapp.com/CkMRYzyoKSNKbXUs2IN2MU 𝑱𝒐𝒊𝒏 𝒕𝒉𝒆 𝑾𝒉𝒂𝒕𝒔𝑨𝒑𝒑 𝑪𝒉𝒂𝒏𝒏𝒆𝒍 𝑳𝒊𝒏𝒌:https://whatsapp.com/channel/0029VaBgfAwDOQIeuTjGbF3u YouTube channel: https://www.youtube.com/@Dataanalyticgroup 𝑱𝒐𝒊𝒏 𝒖𝒔 𝒐𝒏 𝑭𝒂𝒃𝒓𝒊𝒄 𝑪𝒐𝒎𝒎𝒖𝒏𝒊𝒕𝒚 : https://community.fabric.microsoft.com/t5/Data-Analytic-Group/gh-p/DataAnalyticGroup162Views0likes0CommentsIssues Connecting Power BI to Spark (Livy + Kerberos) Behind Knox – Configuration Guidance Needed
Hello everyone, We are trying to connect Power BI Desktop to our internal Spark cluster but consistently run into authentication/connection issues. Before raising an official support ticket, I’d like to ask the community for advice on whether our configuration is correct or if there are common pitfalls we might be missing. Below are the architecture details and the parameters we are using. Architecture Spark Environment: Cloudera Private Cloud (on-premises) Gateway: Apache Knox (single access point) Spark Endpoint: Livy, exposed over HTTPS with Kerberos authentication Full URL: https://loadbalancer-coll.hadoop.xxxxx.it:8443/gateway/kerberos-lb/livy_for_spark3/v1 Authentication: Kerberos (corporate AD realm) and this is the error. Is there something we can do to try to see clearer error messages? any suggestion? thank s in advance MM1.2KViews0likes5CommentsPython Library not Loading in Fabric" : fbprophet
Hi I am having a problem loading the fbprofit library in the Workspace settings. This is a well known forcasting library that I need. When I try load it ..it encouters an error.. it seems to recognise the library in the initial search bar ? It just says fabric encouters an error. I try load it from the notebook and it says problem with the library. Can somebody check. I dont mind using pip install from Jupyter notebook , but preferable I d like to load it from the settings .. if I cant then at least pip install. Please aloso give me the correct instruction as it may differ relative to a normal local install instruction. The end of the log file is shown below Any assistance would be appreciated Thanks Graham1.7KViews0likes1CommentCan't perform scheduled refresh when connecting Spark database directly to Power BI Report Server
Hey team, my customer wants to connect their Spark database directly to Power BI Report Server with scheduled refresh. But it looks like PBI doesn't support it. Is there any good suggestions for this situation? I have suggested the customer to first connect their data to SQL server/MySQL and then connect to PBI. But the customer doesn't want to do it this way. Also, the customer wants to keep their data on-prem, so I can't leverage Spark connector (Databricks). Many thanks to your answers.Solved2.9KViews0likes3Comments