Re: Calculating standard error of nonlinear regression coefficients



Jack Tomsky wrote:
> > I have implemented a simple nonlinear regression in
> > Excel using the solver to minimize the squared error
> > and obtain least squares estimates of the
> > coefficients. Can anyone tell me how to compute the
> > standard error of the coefficients, and/or suggest a
> > good reference?
> > Thanks,
> > Eric
>
>
> By nonlinear regression, I'm asuming that you mean nonlinear in the
regression coefficients.
>
> Let f(y_j) = f(b_1, ..., b_k; x_j1, ..., x_jk)
>
> The covariance matrix of the least-squares estimates of the b's is
approximately that when the model is linearized by
>
> f(y_j) = Sum[(df/db_i)*b_i] + const.
>
> The derivatives are then plugged into an n by k design matrix,
forming A, and the covariance matrix of the parameter estimates is
approximated by
>
> SIG(b) = sig^2*(A'A)^(-1).
>
> Excel has matrix multiplication and matrix inversion functions.
>
> Jack


Well, the linerization may introduce its own error. You can use
directly sum of squares to estimate error bounds for parameters - note
that the error bounds can be unsymmetric. There is a nice book where
you can find more detail

Seber, G.A.F. and Wild, C.J.
Nonlinear regression, (John Wiley & Sons. New York, 1989)

The computational procedure becomes more complicated though. I am not
sure that it can be done in Excel.

Evgenii Rudnyi

http://Evgenii.Rudnyi.Ru/

.



Relevant Pages

  • Re: R-squared formula
    ... These equations apply generally for ordinary least squares ... LINEST/LOGEST in Excel versions prior to 2003. ... > The Spearman Rank correlation coefficient is supposed (according to my stats ... >>or the array formula ...
    (microsoft.public.excel.charting)
  • Theoretical question: graph & trendlines in Excel
    ... trendline similar to the one being used in Excel graphs (basically I ... So far I've been able to find out that Excel uses the "least squares ... if I set an intercept in the "Options" tab (which is where my ...
    (microsoft.public.excel.programming)
  • How can I print a page of blank squares?
    ... and to check "show grids" from Print Preview. ... Print Prievew without something in the cells, ... numbers, but 100 squares? ... I've noticed Excel doesn't even print the lines around the cells (and they ...
    (microsoft.public.publisher)
  • Re: Wind power estimation
    ... you could almost do this one by hand once you got the sum of squares ... I would just use PROC NLMIXED or NLIN in SAS. ... EXCEL if all I wanted were the parameter estimates and not the other ... in named cells. ...
    (sci.stat.math)
  • Re: Calculating standard error of nonlinear regression coefficients
    ... > Excel using the solver to minimize the squared error ... > standard error of the coefficients, ... By nonlinear regression, I'm asuming that you mean nonlinear in the regression coefficients. ... Excel has matrix multiplication and matrix inversion functions. ...
    (sci.stat.math)