Re: Shannon's paper, and H as a lower bound on average code length.



On 27 Aug, 16:00, John <gilbe...@xxxxxxxxx> wrote:
On Aug 25, 2:19 pm, Thomas Richter <t...@xxxxxxxxxxxxxxxxx> wrote:

John schrieb:

Under certauincontraints he may have done, are you within the
constraints???

He shows for a given code that *that* code has H as a lower bound. But
what (from my understanding) he hasn't done is show that there is no
other code which can do better than H on average.

Your understanding is wrong.

Would you care to elaborate? Why does the statement:

"The converse part of the theorem, that C/H cannot be exceeded, may
be
proved by nothing that the entropy of the channel input per second is
equal to that of the source, since the transmitter must be non-
singular, and also this entropy cannot exceed the channel capacity.
Hence H' <= C and the number of symbols per second = H'/H <= C/H. "

establish H as the lowest bound on all uniquely decodable codes?



So long,
        Thomas- Hide quoted text -

- Show quoted text -

It doesn't it establishes channel capacity, so only applies to channel
codes, not ALL codes.

cheers
jacko
.



Relevant Pages

  • Re: ====>>> Cheap Marlboro cigarettes == lloyd
    ... Try Google, I have seen even better prices. ... codes. ... he doesn't care about you anyway. ...
    (alt.support.stop-smoking)
  • Re: A word processor question
    ... Alma Hromic Deckert wrote: ... I don't CARE that it doesn't show ... codes. ... I LIKE it that I can hit "italic" and it *comes up as italic on ...
    (rec.arts.sf.composition)
  • Re: Is "repertoire" the longest word you can type on the top row of a QWERTY keyboard??
    ... > In message, Jordan Abel ... >>> Would you care to r{peat that? ... News is not a ... codes doesn't mean i shouldn't use proper 7-bit codes on this 7-bit ...
    (alt.usage.english)
  • Re: does python have useless destructors?
    ... Donn Cave writes: ... > more care than we like if it needs to be 100% reliable. ... the wrong thing -- no forgetting to check return codes and so on. ...
    (comp.lang.python)
  • Re: content
    ... Right-clicking takes care only of the selected field. ... permanently display field results instead of field codes, ... > number and headings appear back in table of content. ...
    (microsoft.public.word.formatting.longdocs)