Variance of Leave-One-Out Estimation.



Why is the variance of leave-one-out estimation
for regression and classification much higher
than that of k-fold XVAL (k << N)?

Does this cause the expected value of the MSE
to be higher?

Where can I find a mathematical proof?

Where can I find illustrative examples?

T!A,

Greg
.



Relevant Pages

  • Re: nonlinear regression for dummies
    ... > variance, chi-squared, and so forth. ... But the output of the regression ... is easier and simpler, ordinary least squares regression. ... you would learn that the ANOVA model ordinarily ...
    (sci.stat.edu)
  • Re: Need help understanding Homogeneity of Variance please
    ... What are the consequences of not having homogeneity of variance. ... regression, the assumption of homogeneity of variance is used as part ... The "unbiassedness" condition can ...
    (sci.stat.edu)
  • Re: test for trend
    ... > population on yearly basis and I want to test for a trend in my data. ... > I have plotted my estimates and done a simple regression and plotted ... > the same unknown variance. ... Depending on how long a time series you have, you might want to fit a time series model instead. ...
    (sci.stat.math)
  • Re: Lack of fit Test for a Nonlinear Regression
    ... I am working on a nonlinear regression. ... I am trying to obtain a lack of fit test for my nonlinear model. ... an estimate of the variance of the observation error. ...
    (sci.stat.math)
  • Re: A multiple regression stumper
    ... > variable in a standard multiple regression model. ... > of optimal weights that minimize the variance of e. ... > I would like to compute R2 for non-optimal sets of weights. ...
    (sci.stat.math)