Re: how to deal with the inversion problem of a huge sparse covariance matrix



On 26 Sep, 20:16, "Hua Wang" <ehw...@xxxxxxx> wrote:
Dear All,

I am processing some data using weighted least-squares (WLS) method. As you know, the solution of a system function A*x=b with weighting matrix P is that: x=inv(A'*P*A)*(A'*P*b);

I am solving the system function using Cholesky decomposition. The formula is:
w=cholinc(P,'0');
x=(w*A)\(w*b);

I am not sure whether the above method is possible for the back slash operator. But first of all, I met the problem of calculating weight matrix P from the covariance matrix C, i.e. P=inv(C). It is almost impossible to get the inverse of the huge sparse matrix C.

Could anybody give me some suggestions to solve such equation A*x=B, giving huge sparse covariance matrix C? It is urgent for me!

I'm a bit curious what kinds of situations occur where you
need to handle a huge sparse covariance matrix.

First of all, most processes of practical interest are
stationary. You don't need the long-term covariances,
which means that you can get away with a smaller covariance
matrix.

Second, the cyclostationary processes that do have some
significant long-term covariance can be handled by specialized
higher-order techniques, so you don't need the *covariance*
matrix.

The remaining processes, that are not stationary or cyclo-
stationary, would require all the covariance data to be
available, so you would not use a *sparse* covariance matrix.

All in all, I think you might want to look over the problem
statement, to see if there are other approaches than the naive
go-straight-ahead-and-implement-the-literal-expressions.

That particular approach is almost always wrong.

Rune
.



Relevant Pages

  • Re: EOF explained variance
    ... I forgot to say that I just considering curl ... magnitudes. ... % CALCULATE COVARIANCE MATRIX - C ...
    (comp.soft-sys.matlab)
  • Re: covariance
    ... >>People do things sometimes with two time series ... >the its state covariance matrix as below. ... >retrieve Paa and Pbb based on my dataset. ...
    (sci.stat.math)
  • Re: Principal Components (Hotelling of KL Transform) of 2 Band (Red and Green) Real Color Image
    ... would appear that it is indeed the covariance matrix that I should ... Masters warns that if the eigenvalues are nearly equal, then the eigenvectors are ill-defined; doesn't that mean a circularly-symmetrical data cloud? ...
    (sci.image.processing)
  • Re: how to deal with the inversion problem of a huge sparse
    ... need to handle a huge sparse covariance matrix. ... data are organized in clusters and variables are only correlated within a clusters. ... You don't need the long-term covariances, ...
    (comp.soft-sys.matlab)
  • Re: Covariance matrix for MUSIC
    ... I want to know as to how to create a covariance matrix. ... for the temporal MUSIC algorithm. ... use n as the temporal index and m as the spatial index). ...
    (comp.dsp)