Re: r-Squared Question



Reef Fish wrote:

Jerry Dallal wrote:

Reef Fish wrote:

Jerry Dallal wrote:


Reef Fish wrote:


Jerry Dallal wrote:

Rather it is usually defined
as 1-ResSS/TSS (or RegSS/TSS),


No.  But it's equivalent to the usual RegSS/TotSS because
RegSS + SSE (your ResSS) = TotSS.

Isn't that what "or" means, as in "3/6 or 1/2"?


My "no" was referring to "it is usually defined as".

I probably never read the book from which you got your
definition, because I've NEVER seen R^2 DEFINED as "1-ResSS/TSS)".


I'm willing to concede the point, but for the fun of it I pulled four texts from my shelf:


Draper & Smith, 2nd:  RegSS/TotSS, as "Percentage Variation Explained"

Netter et al., latest ed:  R^2 = RegSS/TSS = 1-ResSS/TSS

Kleinbaum et al,, latest: (RegSS-ResSS)/TotSS

Searle:  the square of the cc between observed and predicted!

If one uses the formal definition of R^2
to calculate it for this example, R^2 turns out to be -0.03, which says
the problem is with the model, not R^2.


This is your ERROR, Jerry.

The definition of Multiple R^2 CANNOT lead to a negative value!


I'm not sure what the issue is here. R^2 cannot lead to a negative value in the land of sanity and least squares.


Excuse me. Are we discussing statistics in Alice in Wonderland?

In this instance, yes!

Then why not tell it in Plain English that R^2 is a mathematical
quantity that CANNOT possibly take on a negative value UNLESS
someone is mangling it by introducing something improper!  I mentioned
the economist's use Adjusted R^2 as another example of Quackery.


Your follow-up did not clarify or rectify the issue that whatever the OP did, it was statistical NONSENSE.

You might look at it that way. You might also look at it as answering the question, "How does this measure work if applied to arbitrary models?" and leaving it to the reader to draw his/her own inference about R^2=-0.03.
.