Re: Question on Chaitin



Timothy Murphy says...

>Taking the informational content (or entropy) H(A) of an axiomatic system A,
>one could identify A with the set of provable theorems in the system,
>and then define H(A) to be the minimal entropy of a Turing machine
>which outputs these theorems.
>(Here the entropy of a machine T is the length of the shortest string t
>such that U(ts) = T(s) for all s, where U is the chosen universal machine.)
>
>This ignores the ways in which the theorems are proved;
>and an alternative definition of H(A) would be that it is
>the minimal entropy of a machine which outputs proofs of the theorems.
>This is the same, up to a constant, as the entropy of a machine
>which given a provable theorem in the system
>will output a proof of that theorem.
>
>It is not clear to me that these two definitions
>will give the same value to H(A), up to a constant.

Definitely not. Two axiomatic systems A1 and A2 may have exactly the
same theorems, but wildly different axioms, so that it is
much harder to prove things in A2 than in A1.

I think that a mathematical theory is usually identified with its
set of theorems, regardless of how those theorems are proved. So
it's better to use the first definition, which doesn't care about
proofs.

I think that that is the reason that Chaitin's connecting complexity
with the "power" of a theory is misleading. ZFC is not much more
complex than PA, but it is much more powerful. There are certainly
much more complex theories than ZFC which are weaker than ZFC. Also,
any theory with an infinite number of theorems can of course prove
theorems of arbitrarily high complexity. So it's just false to say
that the complexity of a set of axioms limits the complexity of
what can be proved.

What is true is that if T is a consistent theory whose complexity is K,
then T cannot *prove* that any theorem has complexity much greater than K.
But there will be theorems of T with complexity much greater than K.

--
Daryl McCullough
Ithaca, NY

.



Relevant Pages

  • Re: Raatikainens Complexity Complex
    ... generate theorems given the axiom string. ... inference are actuated by a computer program (which is another ... Each XF contributes its own program-size complexity to ...
    (comp.theory)
  • Re: Raatikainens Complexity Complex
    ... generate theorems given the axiom string. ... inference are actuated by a computer program (which is another ... Each XF contributes its own program-size complexity to ...
    (sci.math)
  • Re: Raatikainens critique of Chaitin
    ... incompleteness theorems in Chaitin's work. ... that there is a model for Leibniz's infinite sequences of reasons. ... Omega, a number which is meaningful, yet random. ... INFINITE COMPLEXITY. ...
    (comp.theory)
  • Re: Raatikainens critique of Chaitin
    ... incompleteness theorems in Chaitin's work. ... that there is a model for Leibniz's infinite sequences of reasons. ... Omega, a number which is meaningful, yet random. ... INFINITE COMPLEXITY. ...
    (sci.math)
  • Re: Panu Raatikainens review of two of Chaitins books.
    ... >dependence between the complexity of a theory and its power to prove ... program of using complexity to understand incompleteness. ... to say that some theorems are "hard", and they can only be proved ... sentence that is hard to prove, because every true sentence S ...
    (comp.theory)