Isn't it remarkable that it takes Physics to explain why Deep Learning is so effective?
Let's get back to the one-dimensional Cellular Automaton proposed by Steven Wolfram to find out that even this simple model is sufficient for executing any algorithm, it is Turing complete. All that mixed with fragments of Digital Philosophy articulated on short videos.
www.cekrk.com
4. It takes Physics to explain why Deep Learning is so effective
src: www.adamwalanus.pl/2016/chaitin/160519-1804-19.jpg
https://youtu.be/QnEtNC8eFso?t=909 15:09
Remark during FQXi: Integrated Information in Brains, Machines
and Natural Language by Max Tegmark
5. ❏ Postulates a program for a universal computer that computes
the evolution of the universe
❏ Such computer could be a Turing machine or/(and) a cellular
automaton
❏ Below the Planck scale, there is an informational substrate that allows the
build-up of time, space, and energy * Wolfram, Stephen, A New Kind of Science, Chapter 9
Digital / Informational Physics
6. ❏ Gottfried Leibniz's Monadology reworked
❏ Use of Cellular Automaton
❏ Perceived reality as a result of computation
Digital Philosophy
7. 1940 Stanisław Ulam & John von Neumann - 2D, 29 states
Cellular automata invented by Stanislaw Ulam to simulate von Neumann's
theoretical self-reproducing constructions. Turing Complete
By Thane Plambeck
[https://www.flickr.com/photos/thane/20366
806/ [CC BY-SA 2.0 ]
1968 John Conway - 2D, 2 states
Game of Life . Turing Complete
1980+ Stephen Wolfram - 1D, 2 states
Elementary cellular automata, Universal CA
By Stephen Wolfram's PR team/Stephen
Faust [CC BY-SA 3.0]
8. Inventing Game of Life
src: www.adamwalanus.pl/2016/chaitin/160519-1804-19.jpg
https://youtu.be/R9Plq-D1gEk
Numberphile: Inventing Game of Life. With John Conway.
9. John Conway on his Game of Life
src: www.adamwalanus.pl/2016/chaitin/160519-1804-19.jpg
https://youtu.be/E8kUJL04ELA
Numberphile: Does John Conway hate his Game of Life?
10. Game of Life: Logic gates
src: www.adamwalanus.pl/2016/chaitin/160519-1804-19.jpg
https://youtu.be/vGWGeund3eA
11. Source: Wolfram, Steven. "New Kind of Science." https://www.wolframscience.com/nks/pages/p53--more-cellular-automata/image-xlarge.png
1D Cellular Automaton
12. Rule 110 is Turing complete
Proof published by Matthew Cook 2004.
https://www.wolframscience.com/nks/p684--the-rule-
110-cellular-automaton/
Rule 110
14. Seth Lloyd’s views
Physics of Information - information is related to
entropy. All things has finite countable amount of
information in them.
https://www.closertotruth.com/series/physics-information#video-49967
Photo by Dmitry Rozhkov [CC BY-SA 3.0
(https://creativecommons.org/licenses/by-sa/3.0)], via Wikimedia Commons
That the cosmos is a computer, not just as
metaphor..
https://www.closertotruth.com/series/the-cosmos-computer#video-49965
15. What Is Complexity in the Cosmos
src: www.adamwalanus.pl/2016/chaitin/160519-1804-19.jpg
https://youtu.be/xrXEQlvUpYI