Re: Logistic Regression



In article <1116924076.543755.158480@xxxxxxxxxxxxxxxxxxxxxxxxxxxx>,
clemenr@xxxxxxxxxx writes

>When I apply my program to test problems, it usually quickly finds a
>very close fit, where my 10 "0" texts are assigned a probability very
>close to zero, and my 10 "1" texts are assigned a probability very
>close to one. However, sometimes, particularly when I have 10 or more
>dimensions, I either find a fit that assigns a probability of 0 to all
>texts, or simply fails to converge (sum of absolute values of
>differences to be added to the weights < 0.01) in any reasonable time.
>Usually convergence happens in a very short time.
[...]

If the classes are linearly separable, some of the weights will tend to
infinity. Are the weights at the end of a run very big?

--
Graham Jones
http://www.visiv.co.uk
Emails to graham@xxxxxxxxxxx may be deleted as spam
Please add a j just before the @ to ensure delivery

.



Relevant Pages

  • Logistic Regression
    ... words in training texts, ten per author. ... I start with a 0 vector for the initial set of weights. ... where my 10 "0" texts are assigned a probability very ... differences to be added to the weights < 0.01) in any reasonable time. ...
    (sci.stat.math)
  • Re: Logistic Regression
    ... where my 10 "0" texts are assigned a probability very ... I either find a fit that assigns a probability of 0 to all ... then you have what's known as "complete separation" and logistic regression ...
    (sci.stat.math)
  • Re: Letter to US Sen. Byron Dorgan re unpaid overtime
    ... >> By the way, Jos, Senator Dorgan is going to have a fit when confronted ... >> with the texts in this newsgroup. ...
    (comp.programming)
  • Re: Qestion!
    ... The probability of finding a good fit is low, ... As for uncertainty, I test the best ones on other similar problems to see ... > 1) What is the impact of probability in genetic algorithms? ...
    (comp.ai.genetic)
  • Re: chi-square test goodness of fit
    ... > probability of .99. ... isn't used in a particular way in Goodness of Fit testing, ... "The better the fit" is still true at the low-value extreme of ... where the (extremely rare) hypothesis ...
    (sci.stat.math)