data science
156 TopicsStarting Data Science journey with Python - What is the next step after lists?
Hello everyone! I am a beginner starting my journey in Data Science. I have recently learned the basics of Python, including lists. Could anyone guide me on what I should learn next in Python for Data Science? Also, as a beginner, what is the best way to practice using Microsoft Fabric for Data Science? Thank you!161Views3likes5CommentsCertificate validation error between Fabric and Huggingface
Hi, I'm tyring to download a couple of transformer/sentence-transformer model weights into a notebook and I keep running into certificate mismatch issues between fabric and huggingface. I was wondering if anyone else has ran into this issue or if this is a known issue that Microsoft plans on handling in the very near future? Environment Microsoft Fabric Notebook (PySpark) Python 3.11 PyTorch 2.2.1 Canada tenant sentence-transformers==2.7.0 successfully installed What works Package installation succeeds %pip install sentence-transformers==2.7.0 Import succeeds from sentence_transformers import SentenceTransformer version check succeeds import torch import sentence_transformers print(torch.__version__) print(sentence_transformers.__version__) What fails from sentence_transformers import SentenceTransformer model = SentenceTransformer("all-MiniLM-L6-v2") Or Observations The notebook appears able to reach Hugging Face and download metadata files. For example, the following files are successfully cached: config.json config_sentence_transformers.json modules.json README.md sentence_bert_config.json However, the model weight file never downloads. The Hugging Face cache contains *.incomplete with a file size of 0 MB. Error The relevant error message appears to be "No CA certificates were loaded from the system" Is downloading Hugging Face model weights from Fabric notebooks currently supported? If so, is there a known issue with certificate validation? Is there a recommended workaround? If not. then is there a recommended approach for generating semantic text embeddings within Fabric notebooks utilizing some kind of ANN based algorithm instead of classic techniques such as TF-IDF or SVD followed by some type of clustering? The goal of this notebook is semantic clustering of approximately 500 short "type" descriptions for taxonomy development. Thanks!Solved28Views0likes1CommentConnecting Fabric Data Agent via Service Principal or Managed Identities
I am trying to build a webapp hosted in azure, with the Fabric Data Agent as a part of it. Locally I used interactive browser authentication to retrieve the user token, but some sources online mentioned that such connection will not work while it's on web. Are there any other way to establish a user connection to fabric data agent from my app? Can we use service principal or Managed Identities for authentication?Solved12KViews1like11CommentsHow are organizations using Microsoft Fabric for end-to-end Machine Learning pipelines?
I'm curious how companies are implementing complete ML workflows in Microsoft Fabric. Do you perform: Data ingestion Feature engineering Model training Model deployment Monitoring entirely inside Fabric, or do you combine Fabric with Azure ML, Databricks, or other platforms? I'd love to learn from real production experiences.Solved320Views4likes6CommentsData science roadmap
OneLake is often highlighted as one of the key capabilities of Microsoft Fabric, especially for centralizing and managing enterprise data. I'm interested in hearing from those who are using it in production environments. For those with hands-on experience: What challenges have you encountered while implementing or managing OneLake? Have you experienced any performance or scalability issues as your data volumes increased? How do you structure and organize data across workspaces, domains, or business units in a large enterprise? What governance, security, and access control practices have worked well for your organization? Are there any lessons learned or best practices you wish you had known before adopting OneLake? I'd love to hear about real-world experiences, whether positive or challenging. Your insights could be incredibly valuable for others planning or expanding their Microsoft Fabric adoption.Solved279Views2likes3CommentsWhat are the biggest challenges you've faced when moving from Synapse or Databricks to Fabric?
I'm currently learning Microsoft Fabric and would love to hear from professionals who have migrated from Azure Synapse or Databricks. Specifically: What were the biggest technical challenges during migration? Which workloads became easier in Fabric? Were there any unexpected limitations or trade-offs? Has Fabric reduced operational complexity compared to your previous platform? Would you recommend Fabric for new enterprise analytics projects today? I'm interested in real-world experiences and lessons learned from production environments. Thanks in advance for sharing your insights!Solved267Views1like5CommentsProduction Lessons
Hi everyone, Documentation often explains how features work, but production environments usually reveal unexpected challenges. For those who have deployed Microsoft Fabric in production: What was the biggest lesson you learned after go-live that you wish you had known earlier? Whether it relates to architecture, governance, performance, security, collaboration, or cost optimization, I'd really appreciate hearing your experience. Your insights could help many learners avoid common mistakes. Thank you!Solved209Views3likes4CommentsData Science tutorial on github with the Bank Churn Dataset is using a link that responds with 404
Hello everyone, It's just as the subject says. I tried to ingest the dataset into my lakehouse to work on it. The code ran and printed 'the files have been downloaded'. I kept refreshing and didn't see any files, so I checked the link using the requests library if the link responds with anything, I got <Response [404]>. Just letting people in the community know to save them some time. Hope this is resolved soon as it is in the official Microsoft Documentation here.Solved148Views0likes3CommentsPBI to data science
A sales forecasting model is built in Python. How would you present the results in Power BI? A fraud detection model produces a fraud probability score. How would you design a dashboard for business users? Customer churn predictions are generated daily. How would you create an executive dashboard? How would you visualize SHAP values or feature importance in Power BI? A model's accuracy drops from 92% to 80%. How would you build a dashboard to help investigate the issue?Solved116Views1like1Comment