Re: non normal distribution and regressions



On Apr 18, 11:39 am, Bruce Weaver <bwea...@xxxxxxxxxxxx> wrote:
joseph Frank wrote:
Hi,

If the distribution of y variable is not normal. (skewness equal to 1.1 and kurtosis to 8.2) can i run a simple linear regression of the y on x variables?
J

It is the residuals from your model (actual Y - predicted or fitted Y)
that should be approximately normal, not Y itself. A Q-Q plot of the
residuals is a good way to assess this.

One can do a regression where the distribution of residuals is non-
normal. One generalization is to assume that distribution is a finite
*mixture* of normals. A further generalization is a mixture of
regression models, in which the regression coefficients and not just
the properties of the residuals are allowed to differ across regimes.
The mixreg package of R implements this model. Googling "mixture
regression" produces relevant hits. Nonlinearity in the relationship
between a response and its predictors does not imply non-normality of
residuals, and non-normality of residuals does not by itself prove a
nonlinear relationship.


.



Relevant Pages

  • Re: stepwise regression by GENSTAT
    ... My handbook considers only stepwise regression as a method to select ... leaving behind only "random variation" in the residuals (residuals = ... to which subset of these to use as predictors. ...
    (sci.stat.math)
  • Re: Sensitivity/valdity of instrument: vade retro correlations? assumptions?
    ... but the residuals should be normal. ... it will be a mixture of normals (which may very well looked ... Nonparametric analysis ... The definition of a non-parametric effect size is another issue; ...
    (sci.stat.math)
  • The FINAL, FINAL KO and Check-Mate of m00es in Applied Simple Regression.
    ... The RESIDUALS are Normally distributed. ... fit the simple regression. ... Not the normality in the DATA for Y. As I said, ... Point 1 of m00es debunked. ...
    (sci.stat.math)
  • Re: Residual Plot Question
    ... > Regression residual is an etimate of e above. ... my "Linear Independence vs Stochastic Independence" post. ... To check the stochastic independence of the residuals, ... Your initial question was why its ok to plot the residuals against ...
    (sci.stat.math)
  • Re: Residual Plot Question
    ... > independence of the errors on the observed Xs in a multiple regression. ... residual against x plot has patterns may not violate the ... > To check the stochastic independence of the residuals, ...
    (sci.stat.math)