Question of merging of variance

Dear group

I have a question which I actually thought was simple, but still
puzzles me.

In short, I wish to compute the total variance for two separate groups
from the same sample, knowing their size, means and individual
variances only. The groups are different in size, and thus I need some
kind of weighting.

I have found the below description at Wikipedia, but I am not sure
whether it holds, and it does not mention a technique for weighing.

Looking forward to hearing your thought.

Kind Regards,
Ole Dahl Rasmussen

- - -
Suppose that the observations can be partitioned into subgroups
according to some second variable. Then the variance of the total
group is equal to the mean of the variances of the subgroups plus the
variance of the means of the subgroups. This property is known as
variance decomposition or the law of total variance and plays an
important role in the analysis of variance. For example, suppose that
a group consists of a subgroup of men and an equally large subgroup of
women. Suppose that the men have a mean body length of 180 and that
the variance of their lengths is 100. Suppose that the women have a
mean length of 160 and that the variance of their lengths is 50. Then
the mean of the variances is (100 + 50) / 2 = 75; the variance of the
means is the variance of 180, 160 which is 100. Then, for the total
group of men and women combined, the variance of the body lengths will
be 75 + 100 = 175.

In a more general case, if the subgroups have unequal sizes, then they
must be weighted proportionally to their size in the computations of
the means and variances. The formula is also valid with more than two
groups, and even if the grouping variable is continuous.

The formula has as consequence that the variance in the total group
can not be smaller than the mean of the variances in the subgroups. In
general, if you combine subgroups with different means, then the
variance will become larger. In the above example, when the subgroups
are analyzed separately, then the variance is influenced only by the
man-man differences and the woman-woman differences. If the two groups
are combined, however, then the man-women differences enter into the
variance also.

.

Relevant Pages

  • Re: Question of merging of variance
    ... I wish to compute the total variance for two separate groups ... Suppose that the observations can be partitioned into subgroups ... mean length of 160 and that the variance of their lengths is 50. ... In a more general case, if the subgroups have unequal sizes, then they ...
    (sci.stat.edu)
  • Re: Question of merging of variance
    ... Suppose that the observations can be partitioned into subgroups ... variance of the means of the subgroups. ... weighted average of the variance to calculate the Within-variance (sum ... by weighting the sums of squares. ...
    (sci.stat.edu)
  • Re: Question of merging of variance
    ... Suppose that the observations can be partitioned into subgroups ... variance of the means of the subgroups. ... weighted average of the variance to calculate the Within-variance (sum ... by weighting the sums of squares. ...
    (sci.stat.edu)
Loading