Re: same entropy between two probability distribution functions.

From: Robin Morphet (rm_at_rmjm.demon.co.uk)
Date: 01/24/05


Date: Mon, 24 Jan 2005 23:41:09 +0000

If you consider a histogram (unimodal for convenience) and then exchange
one of the central bars with one at the end of the distribution the
distribution could change markedly. However, the entropy would remain
the same. With a measure such as chi square the difference in shape
between the two distributions would register in most cases.

In message <35b9vbF4j8r48U1@individual.net>, Yan ZHANG
<buaanupt@sina.com> writes
>Thank you very much for your comments.
>
>Could you plz give more explanation why using the same entropy as the
>criteria is not a good idea?
>

-- 
Robin Morphet


Relevant Pages

  • Re: behavior as mapping
    ... estimating a probability distribution, the distribution ... sequence with equal probability - since you have microsecond temporal ... reduction of the entropy Pto the entropy P ... If there were 4 genes we would need 2 bits of binding site info. ...
    (comp.ai.philosophy)
  • Computational secure entropy extraction
    ... distilling entropy from an unknown distribution. ... there existed some universal entropy distiller that could be used on all input ... D is -secure if given that k is drawn from any distribution ... Let's define that a "hit" is the case ...
    (sci.crypt)
  • Re: behavior as mapping
    ... estimating a probability distribution, the distribution ... sequence with equal probability - since you have microsecond temporal ... reduction of the entropy Pto the entropy P ... If there were 4 genes we would need 2 bits of binding site info. ...
    (comp.ai.philosophy)
  • Re: new /dev/random
    ... >A c1,c2 entropy generator takes any input k and produces a string of ... >fixing any probability distribution it likes over those strings, ... >long as the entropy exceeds k. ... our mixer to do a good job with, we can then ask whether applying SHA1 ...
    (sci.crypt)
  • Re: new /dev/random
    ... > optimistic dreams for what one would like from an entropy distiller. ... SHA1 is a secure hash, though, which would also be very exciting. ... > to any such distribution yields pseudorandom outputs. ...
    (sci.crypt)