Forum Discussion

guyscottsouth's avatar
guyscottsouth
Frequent Visitor
8 years ago

Significance testing

I have two unequally sized samples with similar varience and broadly normal distributions. What is the best way to perform a two tailed significance test to determine if the two means are significant...
Need Help
guyscottsouth's avatar
guyscottsouth
Frequent Visitor
6 years ago

The overall result could be anything really, but it's probably most easily demonstrated as:

 

Q: Did you revise for your exam?

A: Yes

A: No

 

The result for each group would be the mean average score of the 'Yes' cohort and the mean average score for the 'No' ohort.

In this case, one might expect the the 'Yes' cohort average test score to be significantly different from the 'No' cohort, where as posing the question:

 

Q: Are you taller than 5'10"?

 

is somewhat less likely to show a statisticaly significant effect

 

I hope that helps

Anonymous's avatar
Anonymous
Not applicable
6 years ago

Thank you very much, that makes sense.

 

I know this is from a few years back, but did you end up using .pbix file Dale shared? We've been working to reverse engineer it a bit for our purposes but have hit a few snags.

 

Or, alternatively, have you created or encountered other DAX-based approaches for sig. testing in Power BI?

  • guyscottsouth's avatar
    guyscottsouth
    Frequent Visitor
    6 years ago

    It was helpul, but I ended up going back and building something from first principles. What I would say is that the exercise is significantly easier in R or python, so I've subsequently used that