Everything2
Near Matches
Ignore Exact
Full Text
Everything2

Kolmogorov complexity

created by dg

(idea) by dg (11.3 mon) (print)   ?   (I like it!) Tue Sep 26 2000 at 4:23:41

The Kolmogorov complexity of a string of bits is the length of the smallest Turing machine program which produces the bit string as output. It is therefore somewhat dependent on one's choice of Turing machine, but since every Turing machine can be emulated by a universal Turing machine with a constant increase in program length this doesn't matter much.

-Back to the Transhumanist Terminology metanode


(thing) by enth (1.4 d) (print)   ?   (I like it!) 2 C!s Tue Oct 02 2001 at 18:54:55

Kolmogorov complexity is better described as the size of the algorithm needed to compute a given number. For the sake of comparison this is minimized -- the smallest possible algorithm is chosen for each computation to be measured. It's interesting because it describes the complexity of a number in a way that's completely independent from the number itself. Since it doesn't use any external measurements on the number, its much less prone to miscalculation than pattern-based methods of determining complexity. Also, a number doesn't even have to be computed to determine its Kolmogorov complexity, so its useful for comparing the complexities of huge numbers.

An often cited example is the comparison of a million digits of pi to a million statistically random digits. Pi has low Kolmogorov complexity as it can be specified by a short algorithm, whether it's Gauss's summation or one of the newer digit-specifying algorithms. On the other side of the spectrum, the million random digits can't be derived in any other way besides specifying them in their entirety. The algorithm used to compute pi doesn't change in size depending on how many digits are needed, it has a constant Kolmogorov complexity. Since the algorithm used to determine the random digits is in fact the digits themselves, it gets larger with each additional digit -- it has a linearly increasing Kolmogorov complexity. With this comparison we can tell that even though pi looks imposingly random to most methods of calculating complexity, it's much much less complex than a truly random number.

Also, modern measurements of Kolmogorov complexity don't necessarily use Turing machines at all. Since universal Turing machines are the common denominator of computation, they were used by Kolmogorov in his work. However, other ways of encoding algorithms, such as combinatory logic, are perfectly reasonable and have been successfully used for the purpose.


printable version
chaos

Transhumanist Terminology The Psychology of Randomness Kolmogorov-Arnold-Moser Theorem Universal Turing Machine
non-compressibility of random data How to solve any number sequence puzzle algorithmic information theory Turing Machine
combinator Fold Your Hands Child, You Walk Like a Peasant A random real is irrational Algorithm for calculating individual hexadecimal digits of pi
Teach Yourself Scheme: 14.4 Logic puzzles Algorithmic complexity Leonardo da Vinci Syndrome hypercomputation
The little grates at the top of my bedroom walls In Praise of Idleness infinity and human intuition pi
is pi normal? description number Everything Theory String
Y'know, if you log in, you can write something here, or contact authors directly on the site. Create a New User if you don't already have an account.
  Epicenter
Login
Password

password reminder
register

Everything2 Help

Cool Staff Picks
Nodes to live by:
George Washington
morphine
Two monks and a woman
DeLorean
The name that lasted a million years
Jazz Pianists
Kubla Khan
a method for everything
Curl
@
Dropload
Superman
The Orders of Roman Architecture
New Writeups
Vanish
The line between normal and not(place)
Vanish
insanity(thing)
beatrice
You've been slowly taking me over for nearly a year, do you know that?(idea)
Berek
YouTube(thing)
shaogo
How to Pretend to Have a Job(idea)
hapax
Les Provinciales(review)
zoeb
The Scene(review)
aneurin
Telephone Numbers for drama purposes(idea)
Alnilamski
Cosmicopolis(fiction)
eien_meru
measure(idea)
Dreamvirus
pussy willow(thing)
czeano
Three "T"s(idea)
UncleM
Vantage Point 2: Fractal Thread Count(idea)
LostPsion
First Fiction: Night(fiction)
Lysander Peregrine
How to Pretend to Have a Job(idea)
This page courtesy of The Everything Development Company