ml model
43 TopicsCertificate validation error between Fabric and Huggingface
Hi, I'm tyring to download a couple of transformer/sentence-transformer model weights into a notebook and I keep running into certificate mismatch issues between fabric and huggingface. I was wondering if anyone else has ran into this issue or if this is a known issue that Microsoft plans on handling in the very near future? Environment Microsoft Fabric Notebook (PySpark) Python 3.11 PyTorch 2.2.1 Canada tenant sentence-transformers==2.7.0 successfully installed What works Package installation succeeds %pip install sentence-transformers==2.7.0 Import succeeds from sentence_transformers import SentenceTransformer version check succeeds import torch import sentence_transformers print(torch.__version__) print(sentence_transformers.__version__) What fails from sentence_transformers import SentenceTransformer model = SentenceTransformer("all-MiniLM-L6-v2") Or Observations The notebook appears able to reach Hugging Face and download metadata files. For example, the following files are successfully cached: config.json config_sentence_transformers.json modules.json README.md sentence_bert_config.json However, the model weight file never downloads. The Hugging Face cache contains *.incomplete with a file size of 0 MB. Error The relevant error message appears to be "No CA certificates were loaded from the system" Is downloading Hugging Face model weights from Fabric notebooks currently supported? If so, is there a known issue with certificate validation? Is there a recommended workaround? If not. then is there a recommended approach for generating semantic text embeddings within Fabric notebooks utilizing some kind of ANN based algorithm instead of classic techniques such as TF-IDF or SVD followed by some type of clustering? The goal of this notebook is semantic clustering of approximately 500 short "type" descriptions for taxonomy development. Thanks!Solved28Views0likes1CommentHow are organizations using Microsoft Fabric for end-to-end Machine Learning pipelines?
I'm curious how companies are implementing complete ML workflows in Microsoft Fabric. Do you perform: Data ingestion Feature engineering Model training Model deployment Monitoring entirely inside Fabric, or do you combine Fabric with Azure ML, Databricks, or other platforms? I'd love to learn from real production experiences.Solved320Views4likes6CommentsGetting Started with Machine Learning in Microsoft Fabric
Getting Started with Machine Learning in Microsoft Fabric Microsoft Fabric brings data engineering, data science, and analytics together in one unified platform, making it easier to build and manage machine learning solutions. With Fabric, you can: ✅ Prepare and transform data efficiently ✅ Build and train ML models using notebooks ✅ Track experiments and compare model performance ✅ Deploy models for real-world predictions ✅ Collaborate with your team in a single workspace Machine learning isn't just about creating accurate models—it's about turning data into actionable insights that drive better decisiSolved299Views3likes4CommentsWhat are the biggest limitations you've encountered with OneLake in production?
OneLake is one of the most interesting features of Microsoft Fabric. For those using it in production: What challenges have you faced? Are there any performance bottlenecks? How do you organize large enterprise datasets? Any best practices for governance and security? Looking forward to hearing real-world experiences.Solved225Views0likes5CommentsFabric Capacity
Hi everyone, Capacity planning seems to be one of the most important aspects of successfully running Microsoft Fabric in production. For those managing enterprise environments: How do you estimate the right Fabric capacity before deployment? Have you ever underestimated or overestimated your capacity needs? Which workloads consume the most resources in your environment? What monitoring practices help you avoid performance issues? I'd appreciate any practical advice or lessons learned. Thank you!Solved151Views0likes4CommentsNotebook Strategy
Hi everyone, Many organizations use Microsoft Fabric notebooks for data engineering, analytics, and machine learning. I'm curious about how experienced teams organize notebooks in large projects. Do you separate notebooks by business domain, pipeline stage, or individual developers? How do you manage reusable code, version control, documentation, and collaboration across multiple team members? If you've developed standards or best practices that improved maintainability, I'd really appreciate hearing about them. Looking forward to learning from your experience.Solved112Views1like2CommentsData Science/MLOps in AML vs MS Fabrics
Hi everyone, could someone explain the key differences between implementing MLOps in Azure Machine Learning Studio versus Microsoft Fabric? I am looking to understand the advantages and disadvantages of each. Additionally, which platform is generally preferred for standard data science workflows, and why?Solved1.6KViews4likes7CommentsAI Skills Fest 2026
🚀 Looking to build your AI and Data Science skills? Microsoft is hosting the AI Skills Fest 2026, a free global learning event packed with AI-focused training, expert-led sessions, hands-on activities, and learning paths for students, developers, data professionals, and business users. Participants can also earn digital badges and may qualify for certification opportunities. 📅 Event Dates: June 8–12, 2026 Whether you're just starting your Data Science journey or looking to expand your AI knowledge, this is a great opportunity to learn from Microsoft experts and the global community. 🔗 Register here: https://aiskillsnavigator.microsoft.com/events/AISF2026 Has anyone here joined? Which learning track are you exploring—AI, Data Science, Power BI, Fabric, or Machine Learning?1.3KViews1like1CommentValidation/optimisation options for AI features
Hello Are there any ways to validate or optimise the output of the Fabric AI models (sentiment analysis, classification etc)? We have noticed that the models sometimes output erroneous data - e.g. labelling a text as 'positive' instead of 'negative' - and we would like to make sure that the data sent to users is as accurate as possible. Are there any upcoming plans for this in the roadmap, or is it just expected behaviour that we have take into consideration? If there are any workaround we can try in the meantime, please let me know! ThanksSolved2KViews2likes5CommentsMLFlow - Not logging results of all epochs
I am trying to use MLFlow to log the results of my model training to do hyperparameter tuning however it is only logging the last val_loss & loss value in the experiment. Running in a Python 3.11 notebook with tensorflow: 2.18.0 mlflow: 3.8.1 pandas: 2.2.2 with mlflow.start_run() as run: mlflow.tensorflow.autolog() history, model = run_model(X_train, X_val) for epoch, (tr, vl) in enumerate( zip(history.history["loss"], history.history["val_loss"]) 😞 mlflow.log_metric("loss", tr, step=epoch) mlflow.log_metric("val_loss", vl, step=epoch) Then this is the only output in the experiment:Solved2.7KViews0likes6Comments