Re: Universal grammar

"Rob" == Rob Freeman <groups@xxxxxxxxxxxxxxxxxxx> writes:

Rob> LEE Sau Dan wrote:
>> >>>>> "Rob" == Rob Freeman <groups@xxxxxxxxxxxxxxxxxxx> writes:
>>
Rob> I think natural language (as a whole) is already
Rob> incompressible. That is what I mean when I say
Rob> "Incompressible strings can be our mathematical model for
Rob> human language." The mistake we have been making is trying to
Rob> compress them.
>> If there is no redandency in natrual lnaguages, then how come
>> we can do erorr-corrcetoin?

Rob> The robustness you demonstrate is inherent to any model based
Rob> on strings rather than logic, whether or not those strings
Rob> are incompressible.
[snipped]

Rob> We are not at odds really. This is what you are telling
Rob> me. Distributed representation is more robust than compressed
Rob> representation (rules.) This is all standard theory.

And why is that more robust? The key is: redundancy.


Rob> What imagining those strings are incompressible

Incompressible means no redundancy, because compression does its trick
by removing redundancy.


Rob> (taken over the whole language)

What does that mean? Can you state a more precise definition of that?


Rob> now brings us which is new, is the idea that any given
Rob> logical specification of language (grammar) is always
Rob> incomplete (because incompressible strings imply
Rob> incompleteness--Chaitin.)

Because we still haven't come up with a method to represent such
information completely and accurately.



--
Lee Sau Dan 李守敦 ~{@nJX6X~}

E-mail: danlee@xxxxxxxxxxxxxxxxxxxxxxxxxx
Home page: http://www.informatik.uni-freiburg.de/~danlee
.

Relevant Pages

  • Re: Universal grammar
    ... Rob> I think natural language is already ... Rob> incompressible. ... strings rather than logic, whether or not those strings are ... (because incompressible strings imply incompleteness--Chaitin.) ...
    (sci.lang)
  • Re: Brian Kernighan, maybe Im not worthy, maybe Im scum
    ... I've seen a fair amount of Rob Pike's code, and it looks pretty good to me. ... opinions, I respect those opinions enough to treat them seriously, because ... strings" - to C, they're just strings, and if the implementation wants ... interface appears in C Sharp as consisting of sbyte arrays. ...
    (comp.programming)
  • Re: New Insult Thread
    ... , Vera ... Rob - the person who wrote the above sentence. ... It derives from the custom in certain primary schools in the UK and US of letting a child take school pets home for the weekend to encourage his or her sense of responsibility. ... Geeg points out that she accuses Duckery, e.g., of having /no/ language for being drunk, and others of having to get drunk to /have/ language. ...
    (rec.arts.poems)
  • Re: GOD=G_uv Measure your IQ in 30 seconds
    ... Who said it was, asshole? ... Dont worry about how your respond to me or the language you use. ... >> stuck in the mind of our collective consciouse. ... Rob ...
    (sci.physics)
  • Re: GOD=G_uv Measure your IQ in 30 seconds
    ... Who said it was, asshole? ... Dont worry about how your respond to me or the language you use. ... >> stuck in the mind of our collective consciouse. ... Rob ...
    (sci.physics.relativity)
Quantcast