Re: compression of gaussian distribution?



Some counter-questions:

- Does the compression have to be exact, or is some (very small) deviation
between exact and compressed value allowed?
If it doesn't have to be 100% exact, you could do some things:
1. Transform the distribution so it is no longer gaussian, but approximately
linear
2. Quantise the values

- Is the order of values important?
If the order is not important, you can sort the values, and just code the
difference of previous vs current value (delta). Combined with quantisation
(see pt 2 above) this can bring considerable compression.

Nils

<budgetanime@xxxxxxxxxxxxxx> schreef in bericht
news:1131660187.425238.156640@xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx
> Hi,
>
> I have a set of data points stored as 32 bit integers. The data points
> form a gaussian distribution between 0 and some value. There is no
> correlation between consequtive data points. The higest value depends
> on parameters to the algorithm which generates the data points. The
> number of data points depends on input to the algorithm.
>
> I am able to find the mean and standard deviation.
>
>>>From this information is it possible to create a compression algorithm
> will compress these data points?
>
> A typical situation is that there is 6000 data points which range from
> 0 to 2^18.
>


.



Relevant Pages

  • Re: QI and MQ Coder: First real-life experiences
    ... bits from the exact fraction). ... understanding of even simple arihtmetic compression who cares. ... QI will also code much faster than your 64 bit coder ... it would be foolish to belive any other of your off tangent posts. ...
    (comp.compression)
  • Re: CHKDSK found errors
    ... compression you can select from, and selecting 0 yields uncompressed, ... When I selected "1" every time, the Acronis True Image software would ... Exact same size. ... Many times in all windows operating systems, ...
    (microsoft.public.windowsxp.newusers)
  • Re: D200 vs D300 at ISO 1600
    ... While jpeg compression is a lossy form of compression, ... case exact recovery has a precise and very easily measured meaning. ...
    (rec.photo.digital)
  • Re: compression of gaussian distribution?
    ... > Some counter-questions: ... > - Does the compression have to be exact, or is some deviation ... Unfortunetly lossless compression is needed, ...
    (comp.compression)
  • Re: Compression and crypto
    ... If lossless compression is used, the exact same. ... 1.5K using a perfect compression algorithm that is tuned to the exact ... A perfect compressor is one that minimizes average output length. ...
    (sci.crypt)