Re: Increasing the speed of importdata in Matlab

Hi,
I guess, your matrix comes as an ascii file? Do you know how it is
generated?
In this case, try to use a binary format for the matrix...
Otherwise try fscanf, but it will take a long time as well...

Titus

"Mohammad" <asgharzadeh.1@xxxxxxx> schrieb im Newsbeitrag
news:ef14d1d.-1@xxxxxxxxxxxxxxxxxxx
> Hi,
>
> I'm trying to read in a 3 Gbytes size file into Matlab. I wait for
> about a day or so, but still the code is running. I use the simple
> code below:
>
> A = importdata('A.dat');
>
> The file contains a matrix of 16384*16384 dimensions. I run the code
> on a 64 bits Linux system.
>
> Is there any way that I can improve the process of reading in the
> data?
>
> Thanks a lot,
> Mohammad


.

Relevant Pages

  • Re: how to save time loading data from file
    ... only were the loading some 250x faster, ... 20% disk space by storing the data on binary format. ... split the ascii file up into 10 files of 10M rows each. ... if you can't configure the oscilloscope to store ...
    (comp.soft-sys.matlab)
  • Re: Recognising file type (ascii/binary)
    ... >file or plain text ascii file? ... A practical test is to scan the first N bytes for a 0. ... http://mindprod.com Java custom programming, consulting and coaching. ...
    (comp.lang.java.programmer)
  • Re: how to save time loading data from file
    ... is to store the data on binary format. ... only were the loading some 250x faster, ... 20% disk space by storing the data on binary format. ... split the ascii file up into 10 files of 10M rows each. ...
    (comp.soft-sys.matlab)
  • Re: multiplication weirdness
    ... Javascript stores floating point values in a binary format, ... (Replace all crosses with dots in my emailaddress) ... Prev by Date: ...
    (comp.lang.javascript)
  • loading data from ascii file
    ... I have to read data from an ascii file which is several GB large. ... lines represent individual datapoints. ... Felix. ... Prev by Date: ...
    (comp.soft-sys.matlab)