Sorting and testing multiple distributions



Hi,

I have 10 sample distributions of (benchmarking) values and want to sort
them and determine significance of differences. They are not normally
distributed and consist of the identical numbers of samples.

I was now thinking about different approaches to determine the order of the distributions and how to determine the significance of the differences:

(1) sort the distributions by their means (they are not normally
distributed, however) and test distributions that are subsequent in the
ordered list by e.g. Kendall's tau to determine significance.

(2) first test for homogeneity with H-test (Kruskal, Wallis) and then use
one of the approaches for multiple pairwise comparisons of mean ranks
(chi^2; Harter, 1960; Tukey-Kramer) that are proposed by my statistics book of choice (Sachs, Angewandte Statistik, [395]).

(3) test all pairs of distributions and use some multiple testing correction (Bonferroni, Benjamini, or similar).

For (1) I am not even sure if it is a sound approach at all. (2) and (3)
appear to be correct solutions, but I am not absolutely sure. If they are both correct which would be the best choice?

Does somebody have an advice? I would appreciate for any help. Thanks!

Philip

.



Relevant Pages

  • Re: non-recursive quicksort for 2-D arrays?
    ... On the average it uses stack in the log N range. ... Quick sort sorts all suspicious distributions significant faster than shell sort. ...
    (microsoft.public.vb.general.discussion)
  • Re: street litter
    ... In most distributions of this ... sort about 50% are above average and 50% below. ... Any decent book on ... statistics will confirm this. ...
    (uk.local.lincolnshire)
  • Re: street litter
    ... In most distributions of this ... sort about 50% are above average and 50% below. ... Any decent book on ... statistics will confirm this. ...
    (uk.local.lincolnshire)
  • Re: Random distributions (with a specific covariance?)
    ... I am trying to generate two random sample distributions from two ... different normal distributions, and I would like to not only be able to ... but also the covariance between the two resulting sample distributions. ... I've been using Matlab, but if you know other ways, please tell me! ...
    (sci.stat.consult)

Loading