Microsoft Fabric Community Conference 2025, March 31 - April 2, Las Vegas, Nevada. Use code MSCUST for a $150 discount.
Register nowGet certified as a Fabric Data Engineer: Check your eligibility for a 50% exam voucher offer and join us for free live learning sessions to get prepared for Exam DP-700. Get started
Recently we announced the capability of creating Machine Learning models directly in PowerBI. This is powered by automated machine learning from Azure.
You can create an ML model based on your data with a few simple steps using this new capability, so this post aims to provide some light on the next steps, model performance and application, and provide a few tips about the reports.
Model performance
Each model type (Prediction/Classification/Forecasting) will provide you with a performance report once the it has been trained. This can be accessed by navigating to the ‘Machine learning models’ tab in your dataflow and clicking on the ‘View performance report and apply model’ button for your newly trained model.
When first accessed, the report will take roughly 10-15 minutes to refresh and load. When you create a machine learning model, an empty entity is created with a query to train the model. The entity is populated with content when dataflow is refreshed. Its only when you access the report first time, a report is created using the contents of the Model entity. On subsequent access, the report should not take as long to display.
Each report will contain several pages with the first one being a high-level overview of the model performance. Information includes how the model was tested and how the results should be interpreted.
If the model is Binary Prediction, the report will also provide the possibility of testing out different probability thresholds. This behavior allows you to select a threshold that makes sense for your business case, by balancing false positives with false negatives.
The second part of the report surfaces new perspective on the model performance through a variety of charts (Cumulative Gains, ROC curves, Residual error, Predicted vs Actual), depending on the selected model type.
The last part of the report provides a more in-depth view at the model itself, as well as how it was trained.
Model application
The model can be applied through the performance report by clicking on the ‘Apply now’ button and selecting the appropriate entity.
Certain entities will not show up in the dropdown, as the model cannot be applied on the entities created for the model training operation (Train/Test).
If your model is a binary prediction model, you will also be able to provide a threshold for the application. Ideally the threshold would be chosen based on the performance report, as described above.
Once the model has been applied, the dataflow will need to be refreshed so the new data can be scored.
Report modifications
Because the report is a standard PBIX report it can be downloaded and modified as any other report. Go to the workspace view and look for a report with a name that follows the following pattern <ModelType> report for <DataflowName>[MlModelName].
Once downloaded you can see that the actual model is a JSON payload with several properties. Look at the ‘Output’ table. All the other tables are derived from it. You will also see a number of parameters; these are used to connect to the model entity in the dataflow, and also describe some of the properties that have been set during attribute selection (LabelColumnName, EntityName).
At this point the report can be modified/enhanced as any other report.
When done, you can choose to upload the report back with the same name (this will overwrite the existing report and will also make the new report accessible from the 'View performance report' access point), or rename it and upload it, which will not overwrite the existing one.
Tips
Learn more
You can read more about creating machine learning models in Power BI and the model reports generated in Automated Machine Learning in Power BI.
You must be a registered user to add a comment. If you've already registered, sign in. Otherwise, register and sign in.