Fabric compute capacity exceeded its limits. How to know how much CU each dataflowgen2 consumes
Our dataflowgen2 got Failed status after exceeding the Fabric compute capacity limit At the moment, I'm trying to access Fabric Capacity Metrics to see if it can be viewed there but cant open it as well with message "Unable to load model due to reaching capacity limits" - How to know how much CU each activity(dataflowgen2,notebook,etc) in a datapipeline consume so we can avoid hitting the CU limit? - Do we have other way to view fabric capacity metrics?
Uisng Fabric jupyter notebook to load/push data from/to Snowflake
Hello Farbic Community I'm new to using Fabric and am exploring its capabilities. I understand that we can load data from Snowflake into a Fabric Notebook via Data Lakehouse. I'm curious if it's possible to use a Python script in a Fabric notebook to directly load data from Snowflake into the notebook without involving a data lakehouse. In addition to direct data import from Snowflake, I'm also interested in whether data can be pushed back to Snowflake. If direct data import/export to and from Snowflake isn't feasible with a Python script in a Fabric notebook, is it possible to accomplish this using Dataflow or Data Pipeline? I would appreciate any suggestions and guidance.
Handling Timeout Issues with GET Requests in Microsoft Fabric
Hello everyone! I'm facing an issue while trying to download a zip file from a URL using Microsoft Fabric. My goal is to analyze a CSV file contained within this zip using PySpark. However, I'm encountering a timeout error when making GET requests that take more than 172 seconds (2 minutes and 12 seconds). The error I receive in my notebook is as follows: ``` Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f007b0713c0>: Failed to establish a new connection: [Errno 101] Network is unreachable')': /suibase/distribuidorEnergia/creg015_certificados/comer59850_cert3m2024_id85532.sui MaxRetryError: HTTPConnectionPool(host='www.sui.gov.co', port=80): Max retries exceeded with url: /suibase/distribuidorEnergia/creg015_certificados/comer59850_cert3m2024_id85532.sui (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f007b070670>: Failed to establish a new connection: [Errno 101] Network is unreachable')) ``` This error occurs every 2 minutes and 12 seconds, which coincides with the time it takes for the request. Below is the Python code I'm using: ```python url="http://www.sui.gov.co/suibase/distribuidorEnergia/creg015_certificados/comer59850_cert3m2024_id85532.sui" import urllib3 from urllib3.util.timeout import Timeout # Create a PoolManager instance http = urllib3.PoolManager() # Specify connection timeout and read timeout separately connect_timeout = 420 # seconds to establish a connection read_timeout = 540 # seconds to wait for a response # Create a Timeout object with separate values timeout = Timeout(connect=connect_timeout, read=read_timeout) # Make a request with the specified timeout response = http.request('GET', url, timeout=timeout) print(response.status) print(response.data) ``` I would greatly appreciate any suggestions or solutions you can provide to help resolve this issue and successfully download the zip file. Thank you in advance for your assistance!
Appending Data to existing file in One Lake using APIs
Is it possible to append data to existing json file using One Lake (ADLS) APIs? I have been trying that using the standard ADLS APIs and getting the error - Am I missing something or is it not possible at all to append data to existing fil? The file is inside of a lakehouse.
Connect to Lakehouse without MFA
HI Guys, I have a need to connect BrightGauge to Microsoft Lakehouse as an SQL connection. The problem is that BrightGauge cannot handle the modern authentication. Has anyone had luck connecting to a Lakehouse using legacy authentication database username and password?
