Re: determining if the difference in distributions of scores is statistically significant



Rupert,

You would use one of the many ANOVA (analysis of variance)
methods. I'm not sure from your question which of the differences you
are most interested in (that is, the difference between getting 5 and 4
right, 5 and 1 right, 4 and 0 right, etc; they are all different
questions). Also, if your unit of analysis is the group, then you will
need to administer the test to more than 4 groups to get a
statistically significant result; 25 would be the minimum I would feel
comfortable with. There are many good books on education statistics
that can tell you how to calculate an ANOVA for the questions you are
most interested in. Good luck!

David

Rupert wrote:
> Suppose you have a survey with 5 questions which you give to 4 groups
> and for each group you measure the distribution of who got 5 questions
> right, 4 questions right, 3 questions right, and so on. How would you
> determine whether the difference in distributions of scores is
> statistically significant?

.



Relevant Pages

  • Re: Women talk only 3.4% more than men
    ... statistically significant rather than that it was statistically ... really only matters when one gets to the extremes of the ... Presuming a normal distribution of ... Surely their temperament and happiness are the main variables? ...
    (uk.philosophy.humanism)
  • Re: Women talk only 3.4% more than men
    ... statistically significant rather than that it was statistically ... really only matters when one gets to the extremes of the ... Presuming a normal distribution of ... Surely their temperament and happiness are the main variables? ...
    (uk.philosophy.humanism)
  • Re: Analyzing asymmetrical non-normally distributed data?
    ... Social scientists tend to think of ANOVA as the particular ... still require symmetrical data distribution (and these are the only ... are diminished by rank transformation, ... don't get hung up on normality. ...
    (sci.stat.consult)
  • Re: Women talk only 3.4% more than men
    ... statistically significant rather than that it was statistically ... really only matters when one gets to the extremes of the ... Presuming a normal distribution of ... Also on experimental design. ...
    (uk.philosophy.humanism)
  • Re: Women talk only 3.4% more than men
    ... statistically significant rather than that it was statistically ... really only matters when one gets to the extremes of the ... Presuming a normal distribution of ... talkativeness it would really only make a difference at the extreme ...
    (uk.philosophy.humanism)