Key Influencers Impact is sometimes off/wrong

[bb9776]

Hi!

I recently started using the Key Influencers visual, and getting great insights. However, I've sometimes notied that the Impact is off by a couple orders of magnitutde. 

Example: 

In the visual below, we can see that when A is more than 30, the %metric is 0 is a bit less than 20%. The average is about 5%. Therefore, the true imapct should read "when A is more than 30, the likelihood of metric being 0 increases by 20%/5% ~ 4x". The impact in the visual however is 19.25x.

Same thing for the next biggest impact:

The impact here should be a little over 3x, but I'm getting 19.22x.

By the 3rd biggest impact, the visual is giving the correct Impact: 17.27%/3.69 = 4.68%, which is the average.

Bottom line - the visuals in the Key Influencers are correct (I double checked the numbers in the data), but the calculated Impact can be wrong at times.

Does anyone know how to troubleshoot this or how to work around this in Power BI Desktop?

Thanks for the help!

[Anonymous · Accepted solution]

Hi @bb9776 ,

Based on what you described, there are several steps we can take to troubleshoot the issues you are experiencing:

1. Ensure there are enough data points to support the analysis. "Key Influencers Impact" visual objects require a sufficient number of observations to identify meaningful patterns. If data is sparse for certain categories, the visual object may show skewed impact values.
2. Visual objects were analysed using logistic regression for categorisation and a Wald test with a p-value of 0.05 was used to determine whether the factors were influential. Make sure that the factors considered meet this statistical significance threshold. Otherwise, the calculated impact may not accurately reflect the true impact.
3. Visual objects analyse samples of up to 10,000 data points, and the sampling strategy may affect the accuracy of the impact values displayed. You may need to understand how the sample is plotted and whether it is representative of the entire data set.

If, after reviewing these factors, you are still experiencing problems, can you provide the following additional information.

• Which version of Power BI Desktop are you using?
• Does the dataset meet the recommended analysis size?
• Are the Key Influencing Factors visual object displaying any error messages or warnings?

Providing this information will help us further understand and resolve your issue.

How to Get Your Question Answered Quickly - Microsoft Fabric Community

If it does not help, please provide more details with your desired out put and pbix file without privacy information.

Best Regards,

Ada Wang

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.