optimal set of basis vectors



Hi all,
I have a vector space L with an inner product. The vector space L has
a set of linearly independent basis vectors
B = {bi}, i=1, ..., N,
i.e., each element w of L can be represented as a linear combination
of N basis vectors w=li.bi, where li is i-th real coeficient of the
linear combination. I also have a set of vectors V = {vi} and a number
M < N.

I would like to compute an orthogonal projection of vi to L0, where L0
is a subspace of L and the dimension of L0 is M. The general idea is
that I would like "approximate" the vectors vi by vectors vi', so that
vi' are elements of L0 which has a lower dimension than L. Then the
vectors vi' can be represented as a linear combination of M basis
vectors of L0.
The problem is that I don't know how to compute basis of L0. For
example I can choose M basis vectors from B but I would like to choose
such basis vectors which will lead to the best approximation of the
set V in L0.

To describe some real application. Let's have a set of 3D vectors V =
{vi} in E3 (analogy of aforementioned L where N = 3). Project vi using
orthogonal projection on some plane (the plane is a subspace of E3,
i.e., M = 2) so that the projection is closest possible with respect
to V. For example, we can project vectors vi to xy plane which will
yield some error, or we can project vectors vi to xz plane which will
yield another error. I would like to find such plane which would yeild
the smallest error. The question is how to find such plane, i.e., its
basis vectors. Of course I'm looking for some dimension indepedent
solution, this was just one instance of my problem.

I ask here because I think that this must be some classical problem of
linear algebra and I don't want to develop some ad hoc solution.

Thank you for any suggestions.

Jindra

.



Relevant Pages

  • Re: rank([X;Y]) < rank(X) + rank(Y)
    ... basis vectors for X. ... is embodied in some linear combination ... I purposely excluded orthogonalization because I wanted ... Therefore spanZ not only contains spanX and spanY, ...
    (comp.soft-sys.matlab)
  • Re: optimal set of basis vectors
    ... a set of linearly independent basis vectors ... each element w of L can be represented as a linear combination ... I would like to compute an orthogonal projection of vi to L0, ... orthogonal projection on some plane (the plane is a subspace of E3, ...
    (comp.graphics.algorithms)
  • Re: rank([X;Y]) < rank(X) + rank(Y)
    ... If by spanyou mean all possible linear ... basis vectors for X. ... We can rotate a set of orthogonal ... How do we find the intersection space? ...
    (comp.soft-sys.matlab)
  • Re: Create subspace from Basis : Maple
    ... I have the Basis vectors of a subspace. ... subspace (all possible linear combinations) from these basis vectors in ... Maple? ...
    (sci.math.symbolic)
  • Re: Obtaining 2d shape from perspective image
    ... perspective projection equation and use the depth values with those ... of the 3-space with a point on the projection plane. ... If this linear interpolation property is desired to be carried on to the ... any of the aforementioned metrics do well for hidden surface ...
    (comp.graphics.algorithms)