about the efficiency of arrays of strings versus very long strings



We have some large comma-delimited files that we're trying to read in (anything up to 2Mb). There is all sorts of data in them, neatly formatted into sections.
 
configurations data,
test1 data
test2 data  etc etc
 
At the moment the system is designed around reading the string out as a spreadsheet string and converting to a 2D array of strings. Each cell is then searched/scanned for it's contents, providing indices for the 2D string array. The main whole array is subsetted and the data is extracted & converted into the correct data type.
 
Does this sound like an efficient way of dealing with large data sets? I am curious because I'm assuming that labview can't work out how much memory it'll need for an array of string, as each element can be of different length (unlike a number).
Would it be more efficient to search the whole string for the correct tag and then churn out a 2D array of offsets to index the string with?
.



Relevant Pages

  • Re: how to comparing enable indexing string with a string
    ... If the string does not match and you get a 0, thats an "output" too. ... This example would give an output of 2, because the string matches an element of the array. ...
    (comp.lang.labview)
  • Re: using string array to select single value
    ... After having spent so much time trying to get an array to accept string values without success, I had abandoned that idea to try a table. ... Now all I have to figure out is how to make it work in a 2 dimensional array and I think I'll be all set. ...
    (comp.lang.labview)
  • Re: VB6 LISTBOX problem
    ... of your array, sorts it, then puts the sorted data back into your ... array, in under 2 seconds.... ... Mid(Sorted, ofs, 1) = MyType.AString1 ... string is excellent, and avoids the noise of 47,000 separate string allocations. ...
    (microsoft.public.vb.general.discussion)
  • How to clean this string....
    ... I want to tranform an array of strings into one string. ... the real problem is that sometimes the string contains some spaces  but i want nothing at the end. ...
    (comp.lang.labview)
  • Re: how to comparing enable indexing string with a string
    ... I am sorry for not providing enough information but basically i want to compare a string with an array, the string is given from a flat sequencen structure before. ...
    (comp.lang.labview)