Re: regression model selection
- From: Gordon Sande <g.sande@xxxxxxxxxxxxxxxx>
- Date: Wed, 27 Dec 2006 20:51:27 GMT
On 2006-12-27 16:38:49 -0400, "Beliavsky" <beliavsky@xxxxxxx> said:
If I have N candidate predictors and search all possible to subsets to
find M <= N predictors to use in a multiple linear regression model,
and I also include an intercept, effectively how many parameters do I
have in the model? The coefficients of predictors not selected are set
to zero. Only M+1 coefficients are estimated in the final model, but
there were N+1 potential coefficients in the model.
I want to plug in the # of parameters into an information criterion
such as AIC in order to choose a model, after having found the best
models with 1, 2, ..., N predictors.
If one of your predictors had been the constant then there would be no
need for the intercept. Otherwise said, the intercept is just an convenient
algebraic way of representing the constant predictor.
The rest is left as an exercise. If the difference of two of your predictors
is the constant then the exercise is not totally vacuous. In this last case
one would expect the intercept coefficient to be zero.
.
- References:
- regression model selection
- From: Beliavsky
- regression model selection
- Prev by Date: Re: Time Series
- Next by Date: Re: Comparing fractions (or proportions)
- Previous by thread: regression model selection
- Next by thread: Does anyone know of any share/freeware for CHAID?
- Index(es):
Relevant Pages
|
|
