Re: Weighted sum of squared normals question

From: Herman Rubin (hrubin_at_odds.stat.purdue.edu)
Date: 02/23/05


Date: 23 Feb 2005 14:00:25 -0500

In article <1109090264.820492.222960@f14g2000cwb.googlegroups.com>,
Ray Koopman <koopman@sfu.ca> wrote:
>Ray Koopman wrote:
>> Tom Diamond wrote:
>>> Hello,

>>> I know that a sum of squared normals N(0,1) follows the chi-square
>>> distribution with n degrees of freedom. What if the sum is weighted,
>>> i.e. we have to add a1*x1^2 + a2*x2^2 + ... + aN*xN^2, where x1, x2,
>>> ..., xN are normals N(0,1)?

>>> Tnx,

>>> Tom.

>> It's approximately chi-square, with

>> (a1 + a2 + ... + aN)^2
>> df = ------------------------.
>> a1^2 + a2^2 + ... + aN^2

>That's not quite right. It's approximately *proportional*
>to a chi-square variable. The constant of proportionality is

> a1^2 + a2^2 + ... + aN^2
>c = ------------------------.
> a1 + a2 + ... + aN

I doubt that this approximation is that good, especially in
the tails. For computational purposes, both the cdf and
density can be computed quite reasonably by using steepest
descent and related methods to invert the mgf.

There are statistics whose limiting distribution is that of
an infinite linear combination of squares of normals. In
that case, the idea of a chi-square approximation is very
much not appropriate. But even for chi-squared tests with
estimated parameters, complex variables for computation is
likely to be best.

-- 
This address is for information only.  I do not claim that these views
are those of the Statistics Department or of Purdue University.
Herman Rubin, Department of Statistics, Purdue University
hrubin@stat.purdue.edu         Phone: (765)494-6054   FAX: (765)494-0558


Relevant Pages

  • Re: Fishers Exact Test and Chi-square
    ... The probability distribution implicitly assumes continuous rather than ... chi-square or normal distribution would only give an approximation ... merely re-iterating that the chi-square statistic for a 2x2 contingency ... there at the least dozes and dozens of chi-square statistics. ...
    (sci.stat.consult)
  • Re: diehard and ent results quesion
    ... >>probability of rejecting a good generator. ... The question was about applying a chi-square test ... That's what makes the averaging suggestion so very bad. ... or most any introductory statistics text for ...
    (sci.crypt)
  • Re: Chi-square for binomial samples
    ... Most chi-square statistics that I have seen assume ... hypergeometric distribution. ... The row totals do ...
    (sci.stat.math)
  • Re: Chi squared -> p-value - Any formula??
    ... The corresponding approximation for the complementary cdf (i.e., ... the upper tail area) of a chi-square variable with 1 d.f. ... The claimed accuracy of the approximation for the standard normal cdf is somewhat better than that of the approximation Ken gave, and is also simpler to type, so I decided to try your approximation. ... the maximum fractional error in the p-values was 2.91%. ...
    (sci.stat.math)
  • Re: Fishers Exact Test and Chi-square
    ... 'best' value to calculate but chi-square is ... Chi-square approximation isn't great because the chi-square ... distribution is continuous but the cell counts are discrete. ... There can be no single exact distribution because the probabilities ...
    (sci.stat.consult)