Fabric compute capacity exceeded its limits. How to know how much CU each dataflowgen2 consumes
Our dataflowgen2 got Failed status after exceeding the Fabric compute capacity limit At the moment, I'm trying to access Fabric Capacity Metrics to see if it can be viewed there but cant open it as well with message "Unable to load model due to reaching capacity limits" - How to know how much CU each activity(dataflowgen2,notebook,etc) in a datapipeline consume so we can avoid hitting the CU limit? - Do we have other way to view fabric capacity metrics?
How to Integrate Data from High-Speed Manufacturing Line into Microsoft Fabric
Hello, I need assistance with integrating data from our high-speed manufacturing line into Microsoft Fabric. Here are the specifics: Setup: High-speed manufacturing line using an industrial communication protocol (e.g., Profibus, Modbus, Ethernet/IP, PROFINET, or OPC UA). Goal: To extract data from this setup and load it into Microsoft Fabric services for further processing and analysis. Challenges: Understanding the best approach and tools to use for this integration, including any middleware required. Could anyone provide guidance or share experiences on: The best middleware or connectors for interfacing common industrial protocols with Microsoft Fabric services. Steps or best practices for setting up this integration. Any potential pitfalls to be aware of. Thank you!
CSV file to DataLake Table not converting properly
Hi All I have uploded a CSV file into a DataLake and created a table from it, but table columns values coming up differently from csv values: CSV: Site,FileUrl,Size,Created,Modified,Name,Author,Editor SiteName1 , /sites/SiteName1/Shared Documents/Barclays/Contracts/BarclaysContract 2013.pdf , 2.48953819274902 , 08/11/2015 09:41:20 , 08/11/2015 09:41:20 , BarclaysContract 2013.pdf , , SiteName1 , /sites/SiteName1/Shared Documents/Barclays/Contracts/Barclays Client Contract.pdf , 3.56038379669189 , 08/11/2015 09:41:13 , 08/11/2015 09:41:13 , Barclays Client Contract.pdf , , DataLake table: I know some file may contain commas and that could be cosing this issue, but majority are ok Is there any way to sort it? ThanksConnect to Lakehouse without MFA
HI Guys, I have a need to connect BrightGauge to Microsoft Lakehouse as an SQL connection. The problem is that BrightGauge cannot handle the modern authentication. Has anyone had luck connecting to a Lakehouse using legacy authentication database username and password?
Why lakehouses are not independent one of each other when Git is integrated?
Hi, I have integrated Git to a workspace and I have feature branch, development and main branch. If I'm on feature branch and if I make changes to the lakehouse using fabric notebooks the lakehouse will also be changed on development and main branch, why? Shouldn't lakehouses (delta parquet files) be independent one of each other according to the branches? Regards, IgorSELECT COUNT only gives 1000 in lakehouse query
Hi All May not be the right forum, but I couldnt find Lakehouse one so posting it here I have a Dataflow gen2 that adds few thousands rows to a datalake table everyday, and I tried to check he total quantity of rows with SELECT COUNT(*) sql query but it only shows 1000 rows 😞 Any idea how to remove that 1000 limit? Thanks
Lakehouse Add or Remove columns from table
Not sure if this is the right forum or not - but here is the issue. We are loading data to a Lakehouse using gen 2 data flows (for now they are just pointing at exisitn gen 1 dataflows then doing the lakehouse insert - we will recify this later on). Over time it is typical for columns to be added, removed and / or updated in a dataflow - with a datamart these changes are reflected automatically in the schema - however with a laehouse when adding a new column to the dtaflow i can see no way to bring that into the lakehouse. What do i need to do here - only options i can see are 1: import it as a new table but that seems to be very clunky as you would need to update queoroes / stored procedures on your sql end point to cater for this 2: Delete exisitng table in lakehouse and then add a new one with the same name. Am i missing something ?
