dataflows
534 TopicsRomania Power BI and Modern Excel User Group Meeting - 2021 May
Description: Power Query is the data transformation engine in Power BI. However, instead of doing it in each Power BI Desktop file as part of the dataset, there is a better way to re-use the queries. Come to this session to learn about Dataflows as a way to re-use the Power Query transformations. You will see how Power Query helps a Power BI developer to have a better consistent query and one single version of the source code. You will learn how the data transformation layer of Power BI can be separated using dataflows. Dataflow takes your Power BI development to the next level; come to this session to learn all about it. Event ID:9017 Start Date & Time: 2021-05-27 12:00 PM EET End Date & Time: 2021-05-27 01:00 PM EET DUE TO TIME ZONE DIFFERENCES, THIS WILL BE A LUNCH-AND-LEARN SESSION STARTING AT 12.00 PM (EEST) Speaker: Reza Rad Speaker Bio: Speaker: Reza Rad Reza Rad is a Microsoft Regional Director, an Author, Trainer, Speaker and Consultant. He has a BSc in Computer engineering; he has more than 20 years’ experience in data analysis, BI, databases, programming, and development mostly on Microsoft technologies. He is a Microsoft Data Platform MVP for ten continuous years (from 2011 till now) for his dedication in Microsoft BI. Reza is an active blogger and co-founder of RADACAD. Reza is also co-founder and co-organizer of Difinity conference in New Zealand. His articles on different aspects of technologies, especially on MS BI, can be found on his blog: https://radacad.com/blog. He wrote some books on MS SQL BI and also is writing some others, He was also an active member on online technical forums such as MSDN and Experts-Exchange, and was a moderator of MSDN SQL Server forums, and is an MCP, MCSE, and MCITP of BI. He is the leader of the New Zealand Business Intelligence users group. He is also the author of very popular book Power BI from Rookie to Rock Star, which is free with more than 1700 pages of content and the Power BI Pro Architecture published by Apress. He is an International Speaker in Microsoft Ignite, Microsoft Business Applications Summit, Data Insight Summit, PASS Summit, SQL Saturday and user groups. And He is a Microsoft Certified Trainer. Speaker LinkedIn: https://www.linkedin.com/in/rezarad/,HampshirePowerBIUserGroup - 14th June - Power BI Pipelines, Dataflows
This is the meetup for the VIRTUAL event. << link provided shortly before the event >> Registration will open two weeks before the event VIRTUAL - SotonDataCloud - 14th June - Power BI Pipelines, Dataflows, Wed, Jun 14, 2023, 6:00 PM | Meetup Wednesday, May 31, 2023 6:00 PM Agenda (UK time) 18:00: Welcome and Intros 18:00: Odeta Jankaitienė - From Development to Production: The Benefits of Power BI Deployment Pipelines 18:30: Marthe Moengen - Power BI Dataflows - why should you care? 19:30: Rosie Djurovic - Powering Up Dataverse and Power BI with Azure Functions 20:00: Finish Session details: 1. Odeta Jankaitienė - From Development to Production: The Benefits of Power BI Deployment Pipelines In this session, Odeta will present the creation and usage of Power BI deployment pipelines for the seamless transition of Power BI solutions from development to production environments. Attendees will learn how deployment pipelines help to streamline and automate the deployment process, reduce errors, and improve collaboration between developers and end users. Odeta will also provide real-world examples of how organizations have leveraged Power BI deployment pipelines to accelerate business intelligence initiatives, increase agility, and improve overall operational efficiency. By the end of the presentation, attendees will have a comprehensive understanding of the benefits of Power BI deployment pipelines and how to implement them within their organizations. 2. Marthe Moengen - Power BI Dataflows - why should you care? Power BI Service is providing new solutions and ways to solve challenges. One of those features is Power BI Dataflows. So what is that, and why should you care? In this session, we will take a look at the Power BI Service-specific feature dataflows, and dig into how dataflows can improve the performance of how you consume, create and share business insights. What is the difference between dataflows and Power Query, how can you use dataflows to enable non-technical report developers and are there any AI features you can take advantage of? 3. Rosie Djurovic - Powering Up Dataverse and Power BI with Azure Functions Azure Functions give you the power to extend the capabilities of Dataverse and Power BI using code (you choose the language!) In this session I'll talk about how and why I use Azure Functions to run Python in the cloud. I'll demo - How to setup your Azure Function - Retrieve data from Dataverse - Trigger Power BI refresh This session will be ideal for beginners who have never used Azure Functions or experienced users who are interested in learning about other use cases. About Odeta Jankaitienė I have been working as a data analyst for 10 years and teaching others how to use SQL, Power BI, and R. I am passionate about data and sharing my knowledge with others. About Marthe Moengen 26-year-old digitalization geek from Oslo enjoying the sweet spot between analyst and developer. About Rosie Djurovic I am a BI Developer with experience of developing solutions using the Microsoft Power Platform, Power BI, Python and SQL. I am hugely grateful to the Data and BI community and hope that by sharing my experiences I can help others who are on similar journeys.209Views0likes0CommentsManaging Power BI Queries with Fabric - Dataflows Gen 2
Within current Power BI solutions there are many challenges that are required to be overcome, some of which are: Refreshes take a long time as a full refresh is required every time to capture any updates that happened to the source systems Any errors in any of the data sources you are pulling from will result in your semantic model refresh breaking It takes a very long time to make any changes to your data model as Power Query takes a long time to refresh your previews, given the large data sizes and complex transformations. With the use of Fabric and Dataflows Gen 2, these issues become less concerning as you will be able to manage the different data sources effectively and make your semantic model more stable. Plus of course more general Fabric news & updates!Start with Fabric Dataflows
In this session, dive into the world of Fabric Data Factory Dataflow and uncover valuable lessons learned. Fabric Data Factory Dataflow is a powerful tool designed to streamline data processing pipelines, facilitating efficient data transformation, and providing insights crucial for informed decision-making. During this session, participants will embark on a journey through real-world case studies and practical examples, exploring the nuances and intricacies of leveraging Fabric Data Factory Dataflow effectively.48Views0likes0CommentsSelf-service data prep in Microsoft Data Factory | Miguel Angel Escobar
A session jam packed with all the latest and the greatest that Data Factory inside of Microsoft Fabric has for you. From pipelines, to copy job and Dataflows - all in a single session showing you what's available today and what's to come later this Calendar year.65Views0likes0CommentsDataFlow with DataWarehouse in other Workspace Error
Hello, I have a dataflow in one workspace that I want to configure with a DataWarehouse destination in another workspace. However, I have the following warning: "Due to performance reasons, only Warehouses in the current workspace are shown." Has anyone had this problem before? Normally I should be able to write to any Data Warehouse (it doesn't matter which workspace, as long as I have the rights). Have a nice day,Solved2.8KViews1like6CommentsMigration from Azure synapse to Fabric
I am currently using Azure synapse analytics and mapping dataflows. I am looking at the possibility of upgrading to Microsoft Fabric. However, we spent a lot of time creating all dataflow in synapse analytics and it would be unfortunate to start from the ground up. We heard that Microsoft is looking at migration paths. In the mean time, I would like to know if there is a way to export all the dataflows from synapse analytics to Fabric. Thank you in advanceSolved9.4KViews3likes7CommentsCouldn't refresh the entity because of an issue with the mashup document
Hi , I am new with MS Fabric, contiuously practicing and able to create a dataflowgen2 with data destination warehouse/lakehouse and have a PowerBI connect to it. Now I have a dataflowgen2 that will create a new table based on the data it will get from datasource, but i am getting this error "Error Code: Mashup Exception Data Source Error, Error Details: Couldn't refresh the entity because of an issue with the mashup document MashupException.Error: DataSource.Error: Failed to insert a table., InnerException: Unable to create a table on the Lakehouse SQL catalog due to metadata refresh failure," What could be the reason of getting the issue?Solved92KViews0likes19Comments- 3.6KViews0likes1Comment
connecting dataflow to a lakehouse folder of files to combine them
I want to use dataflow gen2 to process a folder full of CSV files (all identical in structure) and load the combined and cleaned data in lakehouse table. The folder is in a lakehouse in the same premium workspace as the dataflow. miguel in Solved: Re: Can Dataflow Gen2 read from lakehouse "Files" ... - Microsoft Fabric Community says "You can use the combine files experience the same as with other file system views (SharePoint, data lake, folder and others). " Therefore I'm expecting to see a "Combine" button when i connect to the folder, but I do not. Am I doing something wrong? Details. 1. New dataflow gen2 2. Get data> More 3. OneLake data hub 4. Click on the lakehouse 5. browse to the folder. Note I can select files individual, or stay on the folder name. The only option for the folder is "Create", as shown: If I choose Create I get a table with a list of the file contents, as shown: Once I have that, I can drill down into one row at at time to get the csv file, but not sure how to process all of them efficiently (there will be dozens in production). Any advice, other than using a notebook instead .7.1KViews0likes3Comments