Re: PCA - separation and variance



On 7/3/2006 4:17 AM, shay@xxxxxxxxxxxxxxx wrote:
I have a multi-dimensional data set containing two different groups of
data I want to separate utilizing PCA. I observed (by eye) that a
certain set of variables gives me a good separation using the first
three PCs.

You are using fundamentally the wrong method. Use discriminant analysis here instead of PCA. Then you won't have to determine by eye which variables give you a good separation. You can use statistical methods and tests to determine which variables give you a good separation.

What is the correlation, if it at all exists, between the separation in
3D to the actual separation in the higher dimensioned plane? How does
the variance of the solution come into play? Can I say that the
separation on the higher dimensioned plane is as good as or perhaps
better/worse than the one in the 3D plane?

Since PCA is the wrong method to use here, i.e., it optimizes a criterion that can be unrelated to separation between groups, I would guess that there is no relationship between separation in 3D and separation in higher dimensions.

--
Paige Miller
pmiller5@xxxxxxxxxxxxxxxx

It's nothing until I call it -- Bill Klem, NL Umpire
If you get the choice to sit it out or dance,
I hope you dance -- Lee Ann Womack
.



Relevant Pages

  • Re: PCA - separation and variance
    ... I observed (by eye) that a ... and that this clustering is detectable by some ... 3D to the actual separation in the higher dimensioned plane? ...
    (sci.stat.edu)
  • Re: PCA - separation and variance
    ... certain set of variables gives me a good separation using the first ... The more PCs you have, ... That can be found comparing the squared eigenvalues of PCs against the sum of all squared eigenvalues. ... Leave a part of the data out before PCA and try to separate them. ...
    (sci.stat.math)
  • PCA - separation and variance
    ... I have a multi-dimensional data set containing two different groups of ... I observed (by eye) that a ... certain set of variables gives me a good separation using the first ... 3D to the actual separation in the higher dimensioned plane? ...
    (sci.stat.edu)
  • PCA - separation and variance
    ... I have a multi-dimensional data set containing two different groups of ... I observed (by eye) that a ... certain set of variables gives me a good separation using the first ... 3D to the actual separation in the higher dimensioned plane? ...
    (sci.stat.math)
  • PCA - separation and variance
    ... I have a multi-dimensional data set containing two different groups of ... I observed (by eye) that a ... certain set of variables gives me a good separation using the first ... 3D to the actual separation in the higher dimensioned plane? ...
    (sci.stat.consult)