Re: Principle Components Analysis



On 7/26/2005 11:39 AM, RL wrote:
Hi I am trying to run a model with quantitative and qualitative factors. For
avoiding collinearity and making sure the factors are with same variance
before the model is run, should i do linear transformation first? Pls
advise.

Can i do that by using stat of SAS or is there any software that can help?

SAS PROC PRINCOMP will do this for you. The linear transformation to unit variance I believe is the default. You don't have to specifically tell SAS to do that transformation. (If you don't want it to do that transformation, use the COV option)


Ray Koopman has written an excellent response. I would like to add one thing to what Ray said. He said:

To preprocess an m-category variable, treat it as a set of m
dichotomous variables, and do a component analysis on those variables.
The will be m-1 components; you want them all, not just the largest
few. For future reference you will also need the m x m-1 matrix of
component loadings.

I have found (and others have agreed with me) that if you have m dichotomous variables in this situation, you don't want each one of them to have a variance of 1. You want the sum of the variances of the m dichotomous variables to be equal to 1, or equivalently each dichotomous variable to have a variance of 1/m. This requires some SAS programming, but the benefit is that the m-category variable is treated equally to a quantitative variable by Principal Components, sinc each now have a variance of 1.


--
Paige Miller
pmiller5@xxxxxxxxxxxxxxxx
http://paiges-page.net

It's nothing until I call it -- Bill Klem, NL Umpire
If you get the choice to sit it out or dance,
  I hope you dance -- Lee Ann Womack
.



Relevant Pages

  • Re: Help! SAS NLMIXED. The final Hessian matrix is not positive definite?
    ... I am currently running sas PROC NLMIXED to analyze my data. ... The final Hessian matrix is not positive definite, ... covariance matrix is not full rank and may be unreliable. ... show that var2 is a covarinace squared plus a variance. ...
    (sci.stat.math)
  • Re: Which type of variance?
    ... > Is there a simple explanation for knowing which type of variance (equal ... because it is more robust." ... where the pooled variance does better. ... the better test is to test after the transformation. ...
    (sci.stat.consult)
  • Re: Transforming data to normal
    ... The proper log-related transformation for proportions is the ... - You will look at your transformed data and compute their variance. ... To the best of my knowledge, the arcsin transformation for p is ...
    (sci.stat.math)
  • Principle Components Analysis
    ... avoiding collinearity and making sure the factors are with same variance ... Can i do that by using stat of SAS or is there any software that can help? ... Prev by Date: ...
    (sci.stat.math)
  • Re: Mean and Variance
    ... Actually what I want is the symbolic representation of the ... mean and the variance of the function? ... normal, with mean mux and variance vx, ... then we can think of it as a transformation ...
    (comp.soft-sys.matlab)