general
31 TopicsNotebook load data from a Lakehouse that's not default
Hey all, I've loaded my sources and my medallion stages into their own lakehouses for scalability and trying to keep things tidy from the get-go. I'm now in a position where it would be REALLY useful to, within a notebook, be able to pull data in from a source, run some SQL on it, and load it into a layer. Pretty standard simple transformation step. I can add those lakehouses to my notebook so they're both there, but I can't get data from any lakehouse that isnt the default for that notebook. If we can't get data from it, why can we add it? Is this somehting thats coming soon or am I doing something wrong? When I select 'load data' from a table in a lakehouse that isnt default to the notebook, it auto populates the cell, starting with the comment: # With Spark SQL, Please run the query onto the lakehouse which is from the same workspace as the current default lakehouse. df = spark.sql("SELECT * FROM SilverLayerLakehouse.myTable LIMIT 10") display(df) and trying to run that cell yields the error: AnalysisException: Table or view not found: SilverLayerLakehouse.myTable; line 1 pos 14; 'GlobalLimit 10 +- 'LocalLimit 10 +- 'Project [*] +- 'UnresolvedRelation [SilverLayerLakehouse, myTable], [], false If I switch it to default it runs fine, but I need to load from source and store in silver with some SQL in between. With 'One lake' I assumed my data was visible from anywhere and that was the whole idea behind it, but I can't seem to get my notebook to read anything from a different lake? Am I missing something, or is this going to be functionality further down the line?15KViews0likes5Comments🧵🤖Announcing: The Microsoft Fabric & AI Learning Hackathon!🤖🧵
📅September 16th - November 12th | Online 📊🦾Get ready for the Microsoft Fabric & AI Learning Hackathon! We’re calling all Data/AI Enthusiasts and Data/AI practitioners to join us for another exciting opportunity to upskill and build the next generation of Data + AI solutions with Microsoft Fabric! 🎉💰This event follows up on the recent Microsoft Fabric Global AI Hackathon held earlier this year where participants from all over the world upskilled their knowledge of the platform to create a variety of innovatitve project submissions. This time, we’re getting the word out just ahead the European Microsoft Fabric Conference where you can expect exciting new features and additions to be revealed, while giving participants a most excellent reason to try them out in this Hackathon! The contest will be even bigger and better than ever, this time coordinating the Hackathon through the DevPost Platform over a 7-week submission period and offering a total of $10,000 in prizes for the lucky winners! 👩🏭👷♂️The hackathon is open to anyone looking to expand their learning through a special Microsoft Learn Skills Challenge focused on Microsoft Fabric and apply their expertise to create a solution aligned to one of the five Hackathon prize categories. 💡🧠 Whether you are a beginner interested in learning something new, a seasoned maker looking to create the next big thing, or a professional developer/DB admin/PowerBI enthusiast that wants to expand your skillset by building with Microsoft Fabric – all are welcome! 🌟Want to join? Register now: https://microsoftfabric.devpost.com/ 📚For more information about the Hackathon, rules, categories, and prizes see: https://aka.ms/fabricaihackblog 👩🏭Need Support or help with your project ? Please join and ask questions here in the Microsoft Fabric Community Forums and DevPost Dischord! 🎉We can’t wait to see what you build!🎉
8.7KViews3likes3CommentsAttaching a file to outlook or teams activity in a pipeline
Hello again, I am trying to use a 'Teams activity' or an 'Outlook activity' at the end of a data pipeline to send a file generated durring the pipeline (in a Lakehouse), but I couldn't find how to attach something to these activities. Is it possbile? Or can I move this file from a lakehouse somewhere else in Fabric to be abble to share it through a link in an email or teams? Thanks!8.6KViews2likes5CommentsESG Data Model
Hello, I am not sure where to post this question but I hope that someone who can answer it finds it here. We are working on a pilot for ESG reporting with 'Sustainability data solutions in Microsoft Fabric'. In the documentation about the ESG data model they state the following: "The following resources can help you with data model exploration and understanding. You can get the data dictionary and PDF files in Sustainability data solutions in Microsoft Fabric (preview) and the sustainability data model template on Azure Synapse. Data dictionary Excel file: Contains data definitions and examples for all the tables and columns to help you understand how you can use each table for your sustainability use cases. Data model PDF files: These PDFs contain a subset of tables across each business area to help you understand how you can combine the tables to address your regulatory reporting needs across carbon emissions, water, waste, social, and governance areas. Synapse database template: A database template built for our data model on Azure Synapse that can help you explore and visualize all the tables and relationships in the model." (https://learn.microsoft.com/nl-nl/industry/sustainability/esg-data-model-intro) However, I am not able to find the excel/PDF files with the documentation. Does someone know where to find these files?6.6KViews0likes1CommentAnnouncing the Winners of "Hack Together: The Microsoft Fabric Global AI Hack"!
We are happy to announce the winners of the Microsoft Fabric Global AI Hack! We had a very difficult decision to narrow down all of the amazing submissions to a handful of winners. We were amazed by the overall quality of the submissions and want to thank each and every one of you for participating and taking the time to submit your projects. Winners have been notified using the email that was used during registration, please check your inbox for correspondence on how to proceed with receiving your prizes! Check the Microsoft Fabric Blog for more details: Announcing the winners of “HackTogether: The Microsoft Fabric Global AI Hack” | Microsoft Fabric Blog | Microsoft Fabric P.S. We understand that many of you found your way to this Hackathon as a means of flexing your skills to prepare for the DP-600 Fabric Analytics Engineer Certification. We just announced an AI Skills Challenge that will be launching on March 16, with pre-registration available today that will allow you to receive a FREE Microsoft Certification Exam voucher by completing a series of modules (including a specific Microsoft Fabric challenge!) Details are available on my LinkedIn (feel free to give me a follow if you'd like to say in touch!)9.2KViews6likes8CommentsBusiness central - How to change unit of measurement conversion rate under Item
Hello! I have my production BOM improved and vendors changed from time to time. All these changes will make the item unit of measurement conversion rate changed. How to change unit of measurement conversion rate under Item in Business central? Right now the system seems preventing me to change the conversation rate. Thank you!2.5KViews0likes0CommentsTo set criteria using Calculated columns.
CustIncome = SWITCH(TRUE(), DimCustomer[YearlyIncome] < 25,000, "LOW INCOME", DimCustomer[YearlyIncome] >= 25,000 && DimCustomer[YearlyIncome] <= 60,000 , "Middle Income", DimCustomer[YearlyIncome] >= 60,000 && DimCustomer[YearlyIncome] <= 100,000 , "Higher Income", DimCustomer[YearlyIncome] >= 100,000, "Very High Income") I have written this DAX code to set crteria for income in creating calculated column but, getting the following error: Function 'SWITCH' does not support comparing values of type True/False with values of type Text. Consider using the VALUE or FORMAT function to convert one of the values.2.5KViews0likes1CommentRun Script for all Lakehouse Files / Lakehouse files storage account key
I would like to use the Notebook to run the same script for all files stored in the Lakehouse files. How can this be done? If there´s a need to get the storage account key for lakehouse files, where can this be obtained?Solved12KViews1like4Comments