architecture
12 TopicsData Lakehouse Architecture with Microsoft Fabric
What are Data Lakehouses? When and why should you use this design pattern? How are they different from Data Warehouses? This session will answer these questions and expand on how new architecture design patterns can help you solve some of your business problems and prepare for the future. You may have heard about Data Lakes and data warehouses, but as technology evolves, there are new design patterns like Data Lakehouses that you should take into account when building data solutions. ๐๐๐ง๐จ๐๐๐ฃ ๐๐ฝ๐๐๐- ๐๐๐๐ง๐ค๐จ๐ค๐๐ฉ ๐พ๐ค๐ข๐ข๐ช๐ฃ๐๐ฉ๐ฎ: https://bit.ly/3IAg7xT ๐๐๐ฃ๐ ๐๐๐๐ฃ: https://bit.ly/32tGkif ๐๐๐ก๐๐๐ง๐๐ข ๐พ๐๐๐ฃ๐ฃ๐๐ก: https://t.me/PersianPBIUG ๐๐ค๐ช๐๐ช๐๐: https://bit.ly/3hk20RL Language: Persian - English153Views0likes0CommentsIntroduction to Lakehouse in Microsoft Fabric
Join this session to learn about Lakehouse architecture in Microsoft Fabric. Microsoft Fabric is an end-to-end big data analytics platform that offers many capabilities including data integration, data engineering, data science, data lake, data warehouse, and many more, all in one unified SaaS model. In this session, you will learn how to create a lakehouse in Microsoft Fabric, load it with sample data using Notebooks/Pipelines, and work with its built-in SQL Endpoint as well as its default Power BI dataset which uses a brand-new storage mode called Direct Lake. The meeting will start at 5.30pm with refreshments. The presentation will start shortly after 6pm. Join our Meetup: https://www.meetup.com/madison-power-bi/ ***LOCATION*** We'll be meeting on the ground floor of the Baker Tilly offices in Madison: 4807 Innovate Ln, Madison, WI 53707. It's on the far east side - exit the interstate on US-151 towards Sun Prairie, then the 2nd exit on American Parkway. Take the first left onto Eastpark Blvd. The Baker Tilly building is 2 buildings after Cambria Suites on Eastpark Blvd. Enter through the main entrance at the front of the building - doors are locked but we'll have someone to let you in and they'll be a phone number to call if you arrive later. What3Words: ///handyman.navigating.mutate1.8KViews0likes0CommentsMeetup Dutch Fabric User Group
Agenda: 17.00 - 18.00 Walk-in + Dinner 18.00 -19.00 End-to-End CO2 Reporting with Fabric By Jordy Sels and Maria Lysenko 19.00 -19.30 Short break 19.30 - 20.30 Microsoft Fabric: Architecture, Implementation, and Future Standards By Ian Smith and Gijs Dekkers 20.30 - 21.00 Round-up and drinks Sessions & Speakers We will have amazing speakers lined-up for this meetup. Below you will find their session abstracts as well as speaker biographies. As always, we're looking for speakers. So, if you have an interesting story to share, please submit your session to our call for speakers. If you're a first-time speaker, don't worry! We are more than happy to help you taking your first steps in the wonderful world of public speaking. Also, for all sessions submitted and not selected, we will keep a list of all sessions for future events. End-to-End CO2 Reporting with Fabric By Jordy Sels and Maria Lysenko This presentation delves into leveraging Microsoft Fabric for ESG reporting, with a focus on CO2 emissions. It examines both the advantages and disadvantages of Fabric, demonstrated through a dummy dataset. Key highlights include data transformations from the silver to gold layer using built-in Jupyter notebooks to create processes that are auditor-friendly for external ESG reviews. The session also addresses the limitations of Copilot in generating visuals, underlining the need for a design sprint approach to ensure effective and impactful reporting solutions. Microsoft Fabric: Architecture, Implementation, and Future Standards By Ian Smith and Gijs Dekkers In the session we'll explore the architecture that powered our solution, the programming languages leveraged for development, and the innovative standards we established to guide future implementations. This session is ideal for data professionals, architects, and developers aiming to understand the practical deployment of Microsoft Fabric. This session showcases examples from real implementation's done for multiple customers. Can register online through Meetup: January 21st 2025 - Meetup Dutch Fabric User Group, Tue, Jan 21, 2025, 5:00 PM | Meetup138Views0likes0CommentsMicrosoft Fabric Workspace Design Best Practice
Hi everyone, ***Update*** Due to popular demand, we are adding another option for online if you can't make it today: https://events.teams.microsoft.com/event/c5448e16-0f76-4379-a648-53c7f63be22a@b7972088-f1b2-44d5-a586-9721edd6f8b3 *************** Weโre excited to invite you to a collaborative community discussion on Microsoft Fabric Workspace Design Best Practices! Whether you're just starting with Microsoft Fabric or scaling enterprise-wide deployments, designing your workspaces effectively is key to governance, collaboration, and performance. In this session, we'll explore practical strategies around: Workspace structuring for scalable data projects Access management & security alignment Organizing pipelines, notebooks, and Lakehouses Promoting collaboration across business units Aligning Fabric workspace design with Power BI and Purview Customer Presentation - Architecture and Practical Implementation of Microsoft Fabric at the Bank of Canada - Workspace Design and Organization - Pavel Aleman & Ramesh Paskarathas agenda : 1:30 - Doors open & Networking 2:00 - 2:30 - Technical Talk 2:30 - 3:00 - Pizza 3:00 - 4:00 - Bank of Canada Talk Huge thank you to Adastra for sponsoring this event!4.2KViews0likes9CommentsFabric + Databricks: Real-World Architecture Patterns
Join us at the Microsoft Office in Ottawa for a user group meetup exploring how Microsoft Fabric and Databricks can work together to deliver modern, scalable data architectures. This session will dive into real-world architecture patterns that bring these two platforms into playโcovering where each excels, how to integrate them effectively, and strategies for creating a unified data foundation that drives analytics, AI, and business insights. What you will gain: -A clear understanding of when to leverage Fabric vs. Databricks -Practical examples of hybrid architecture patterns in enterprise scenarios -Insights into governance, performance, and cost considerations when combining both tools -Networking opportunities with peers tackling similar challenges in data modernization Who should attend: Data engineers, architects, BI developers, AI/ML practitioners, and technology leaders looking to deepen their understanding of Microsoft Fabric and Databricks. Seats are limited, so secure your spot early, and come hungry for both data insights and pizza. Hosted by Revolution Data Platforms364Views0likes0CommentsPower BI Report Server Architecture Question
Hey All, We are planning a new architecture, and are considering switching to Power BI from another visualization app. We are also beginning a project to build a new Enterprise Data Warehouse. This new infrastructure ought to cover the following components: SSAS Power BI Report Server SQL Server Database Engine ReportServerDB for Power BI report Server. We have a 4 core SQL Server 2019 Enterprise License with Software Assurance. The current design is as follows: Server A: Hosts -- Power BI Report Server Server B: Hosts -- SQL server Database Engine, SSAS, ReportServerDB (Report Server Catalog) My understanding is that SQL Server Enterprise edition Software assurance provides us licensing for Power BI Report Server in addition to the other services that I mentioned. Will the license cover all servcies for Server A and B as described above? or does Power BI need to be installed on Server B as well? Lastly, Any idea how much overhead ReportServerDB (Report Server Catalog) will require? Our current setup utilizes Tableau, which has an internal Report Server Catalog deployed via PostgreSQL on the same server that Tableau is installed on. It would seem to me that a difference here is that Microsoft is pushing the Report Server Catalog off of Server A to Server B. Is that correct? or am I just completely misreading the documentation? thanks!602Views0likes1CommentHow to license splitting Power BI report server
Hi, We current have a single server SQL Server Enterprise Edition running SQL Server, SSAS and PowerBI in a 2 server AG cluster. The business wants to start moving reports from a different system to reporting services, so its not going to be feasible to continue running everything on a single server. My understanding is that if I split the PowerBI Report Server to its own server, it will mean we will need another Enterprise Edition license for the server. We do not want any cloud functionality so I believe the other licensing option is not the way to go. Would it be feasible to split the SQLServer service into its own server using the SQL Server Standard Edition instead, and having it in an AG cluster. Then Power BI and SSAS services will run on the existing Enterprise license on a separate AG cluster. Does this make sense? Apologies if I am using the wrong terminology, hopefully I am still able to convey what I am trying to do. TLDR Running a single server with SSIS, SSAS, SSRS & Power BI. Need to split things up accomodate increased usage, need advise on most cost effective and effective way to achive this. If things go well, may require additional report servers so scale out needs to be taken into account. Any advise would be appreciated. Thanks1.2KViews0likes2CommentsMany to Many Relationship between tables and show data in single Visualization - Power BI
Scenerio: I have two tables Table 1: ProductionCollection - It has product and collection amount. Product can repeat Table 2: ProductSales - It has product and sales amount. Product can repeat. Now I have to create a single visualization that can show product and Sales and collection amount side by side. ProductCollection and ProductSales table cannot be connected because of repeated product values.Solved16KViews0likes4CommentsBest practise architecture
I'm planning to install and configure Power BI Premium within my organization. I would like to have the following architecture, but would like your ideas about it. Are there any best practises besides the information on https://docs.microsoft.com/en-us/power-bi/report-server/capacity-planning (all virtual machines) 1. A stand-alone (web)server for installing Power BI Reportserver (server 1) 2. A stand-alone (or new instance on existing SQL Server) SQL server for the Reportserver databases (server 2) 3. A stand-alone SQL Server for the source databases (server 3) 4. A stand-alone SQL Server for the Datawarehouse and DataMarts (server 4) Where do I have to install the Power BI Data Gateway? I prefer to install it on a separate vm (server 5) because of the ports which should be opened to let the gateway work. What do you think about this? Is this ok or is it too much separated? Hosting the features on different machines will make sure CPU and memory are going to right resources, right. Last question: when we purchase Premium P1 we're licensed for 8 cores. Are those cores based on the reportserver server (server 1) or on the server where the reportserver databases (server 2) are located?Solved21KViews0likes6CommentsDynamic Exchange Rate architecture and DAX calculation in Power BI
I want to get my amount to change as per currency code selected dynamically. In my FactSales table I have currency and Amount. If user want to see that amount in any currency he select the currency from slicer and my excahnge rate will apply to that amount. I tried below DAX to get dynamic Exchange Rate but no luck: ExchangeRate = CALCULATE(MIN(ExchangeRate[ExcahngeRate]), FILTER(ExchangeRate, AND(AND(AND(MIN(FactSales[TransDate])>=MIN(ExchangeRate[ValidFrom]), MIN(FactSales[TransDate])<=IF(ISBLANK(MIN(ExchangeRate[ValidTo])), DATEVALUE("01-01-2070"), MIN(ExchangeRate[ValidTo]))), MIN(ExchangeRate[FromCurrencyCode]) = MIN(FactSales[CurrencyCode])), MIN(ExchangeRate[ToCurrencyCode]) = FIRSTNONBLANK(ExchangeRate[ToCurrencyCode],1)))) ExchangeRate = CALCULATE(MIN(ExchangeRate[ExcahngeRate]), FILTER(ExchangeRate, AND(AND(AND(MIN(FactSales[TransDate])>=MIN(ExchangeRate[ValidFrom]), MIN(FactSales[TransDate])<=IF(ISBLANK(MIN(ExchangeRate[ValidTo])), DATEVALUE("01-01-2070"), MIN(ExchangeRate[ValidTo]))), MIN(ExchangeRate[FromCurrencyCode]) = MIN(FactSales[CurrencyCode])), MIN(ExchangeRate[ToCurrencyCode]) = FIRSTNONBLANK(ExchangeRate[ToCurrencyCode],1)))) https://drive.google.com/file/d/1BCD3cycq-tNTc9xPEK458dn-BjJj9Qao/view?usp=sharingSolved6KViews0likes1Comment