Re: How to compare if two fits are significantly different from each other




youngjin.michael@xxxxxxxxx wrote:
Hi,

I am looking for a means to determine how two fits are significantly
different from each other.
I have data and made two fits to my data using different fitting
functions. The question I have is how to determine whether one fit is
significantly better than the other one.

I thought about comparing their Chi sqaure values. This way, I could
say that which one is a better fit, but I could not say how much better
(significance) it is compare to the other one.

Can anyone help me with this problem?

Thanks in advance.

Young-Jin

The big problem with using chi-square statistics is that they're only
comparable if they have the same number of parameters in the fit (so
the DF of the chi-squares are the same). In that case, you can use them
as a measure of fit (though perhaps not the best measure - it depends
on what you're doing).

Nested models (i.e. where one model is a special case of the other) are
usually pretty easy to deal with, and there's lots of information
available about that.

Nonnested models are trickier. There are some statistics designed for
comparing non-nested models.

What two models are you comparing?

Glen

Glen

.



Relevant Pages

  • Re: Expedition.
    ... Why is it that no one will believe me when I say I am unfit? ... The thing is Roger, that it's all relative. ... compared with me you are incredibly fit. ... but by which standards are you comparing ...
    (uk.rec.walking)
  • Alhadin Ibrahim al Huseiny for instance the deal
    ... Rifaat, have a fit beginning. ... parting at first considerable, in extra, alongside weekly nests. ... Joaquim, still comparing, adapts almost never, as the ... While finances virtually stem ...
    (sci.crypt)
  • Re: how can one determine dat AIC values differ significantly?
    ... > I am comparing the fit of non-nested models. ... > One appropriate criterion is the Akaike Information Criterion. ... More information on model validation approaches and comparing "near ... Marc Schwartz ...
    (sci.stat.math)
  • Re: calcuating goodness of fit in the statistical tool box
    ... comparing my models? ... (I used normal, lognormal, and Weibull ... A single number cannot possibly tell you why/how a model doesn't fit as well as another. ... If you're already using DFITTOOL, take the opportunity to make plots of the PDF against the data, or better yet, CDFs or probability plots. ...
    (comp.soft-sys.matlab)