Re: r-Squared Question



Jerry Dallal wrote:
> Reef Fish wrote:
> >
> > Jerry Dallal wrote:
> >>Netter et al., latest ed: R^2 = RegSS/TSS = 1-ResSS/TSS
> >
> >
> > I've taught from Neter et al (several editions) and R^2 was
> > always DEFINED as RegSS/TotSS. Yours must've been some "Netter". :-)
>
> Need a big net to catch a big fish.

LOL! http://www.ivydene1.co.uk/doug/dive/images/grouper.gif

>
> I am copying verbatim from the third edition, (the latest is at the office)

As you know, I am recalling EVERYTHING from my big Soft Disk as I had
given away all my statistics books to 10 libraries in China years ago.
>
> p 100:
>
> "Thus SSTO is a measure of uncertainty in predicting Y when X is not
> considered. Similarly, SSE measures the variation in the Y(i) when a
> regression model using the independent variable X is employed. A
> natural measure of the effect of X in reducing the variation in Y, i.e.,
> the uncertainty in predicting Y, is therefore:
>
> (3.71) r^2 = (SSTO-SSE)/SSTO = SSR/SSTO = 1-SSE/SSTO "

I must have recalled the MUCH BETTER definition of R^2 in the 1st
and 2nd editions, as SSReg/SSTot.
>
>
> Also, p 241:
>
> "The coefficient of multiple determination, denoted R^2, is defined as
> follows:
> (7.35) R^2 = SSR/SSTO = 1 - SSE/SSTO

That's better, as the definition.

Ah, this came FIRST, didn't it? (7.35). You were putting (7.71)
first in this post as if it were the definition when Neter et al
were just relating some of the ANOVA table entries to little r^2,
in the SIMPLE regression chapter, I presume, because the relation
applies ONLY to simple regression.


> It measures the proportionate reduction of total variation..."

That's an odd way to put it. To use the parallel of "% of
variation explained", but correcting the two errors, the better
expression would have been,

"It measures the proportion of total variation fitted by the
regression".


So, what happened to this:

JD> Kleinbaum et al,, latest: (RegSS-ResSS)/TotSS

RF> IMPOSSIBLE! It's WRONG. That's not R^2 at all. I assume it's
RF> your copying error.

or how YOU and the others got the R^2 = -.03 ?


I assume it's typo and carelessness respectively, but wanted to know
if otherwise.

-- Bob.

.

Relevant Pages

  • Re: theta = (XX)^-1*Xy
    ... This is better-known as the shrinkage estimator. ... I should have mentioned Ridge Regression also, ... -- Reef Fish Bob. ... But there is a lot of "contaiminated and missing data" ...
    (sci.stat.math)
  • Re: variation & mean level
    ... be fitted to a simple linear regression of Y vs X. ... Under the ordinary assumption of such regressions, the variation ... which lie more or less in a constant band parallel to the fitted line. ... heteroscedasticity. ...
    (sci.stat.math)
  • Re: r-Squared Question
    ... SSE measures the variation in the Ywhen a regression model using the independent variable X is employed. ... first in this post as if it were the definition when Neter et al were just relating some of the ANOVA table entries to little r^2, in the SIMPLE regression chapter, I presume, because the relation applies ONLY to simple regression. ... variation explained", but correcting the two errors, the better expression would have been, ...
    (sci.stat.math)
  • Re: Univariate Analysis
    ... Reef Fish wrote: ... Regression to meaning anything else other than what it is. ... Multivariate means that there are multiple dependent variables. ...
    (sci.stat.math)
  • Re: HELP: Non-linear regression problem
    ... How is the estimation of parameters different in nonlinear regression ... from linear regression, in terms of one require the CV and the other ... statistical reliability or variation of the estimate. ...
    (sci.stat.math)