Forum Discussion
Excel Files Extraction from SharePoint & Lakehouse File Sharing Issues
- 1 year ago
Hi Felpan ,
Thanks for the update.
The warning “Unverified HTTPS request is being made to...” typically appears when SSL certificate verification is disabled using verify=False in a requests call. While this can help bypass certificate issues during testing, it is not a secure long-term solution.
If you're using this approach:
response = requests.get(url, headers=headers, verify=False)Remove verify=False and ensure your system trusts the SSL certificate used by SharePoint or Graph API. You can also use the certifi package to include trusted CA bundles.
To temporarily suppress the warning during development:
import urllib3 urllib3.disable_warnings(urllib3.exceptions.InsecureRequestWarning)or:
import requests requests.packages.urllib3.disable_warnings()
Note: Suppressing HTTPS verification is not recommended for production environments. It's safer to ensure your system trusts the certificate or use a valid CA certificate bundle.Since you're working with SharePoint files via Graph API in Fabric notebooks, suppressing the warning may help temporarily, but securing the connection should be considered as a next step if you plan to move this into production.
Hope this helps. Please reach out for further assistance.
Please consider marking the helpful reply as Accepted Solution to assist others with similar issues. A kudos would also be greatly appreciated.
Thank you.
Hi Felpan ,
Tthis is a common challenge when working with large volumes of Excel files in SharePoint and trying to integrate them with Fabric Lakehouse.
Here’s a recommended approach that balances scalability and maintainability:
✅ Use Microsoft Graph API with Fabric Notebooks
Since you already have the Tenant ID, App ID, and Secret, you can authenticate using the client credentials flow and leverage the Microsoft Graph API to:
- List and download Excel files from SharePoint.
- Read each file using pandas or openpyxl in a Fabric Notebook.
- Consolidate the data into a Spark DataFrame.
- Write the final dataset to a Delta table in your Lakehouse.
This method is highly scalable and avoids the complexity of managing hundreds of Dataflow queries.
📁 Sharing Excel Files from Lakehouse
Files stored in the Lakehouse "Files" section cannot be opened directly in Excel unless OneLake File Explorer is installed. If your organization is hesitant to use it due to its preview status, consider these alternatives:
- Store editable Excel files in SharePoint or OneDrive, and use Fabric Pipelines or Notebooks to sync them to the Lakehouse.
- If users only need to view or analyze the data, connect Power BI or Excel directly to the Lakehouse using the SQL endpoint.
Let me know if you'd like a sample notebook or Graph API script to get started!