THE GHOST IN THE MACHINE

Publicado 2022-07-09
Noam Chomsky discusses how the "mechanical philosophy" that originated in the 17th century with thinkers like Galileo, Descartes and Newton viewed the universe as a grand machine that could in principle be understood through science. However, Newton's discovery of gravity, which involved "action at a distance" rather than direct physical contact, undermined this mechanical view.

Full title: The Ghost in the Machine and the Limits of Human Understanding.

Please support us:
Patreon: www.patreon.com/mlst

Professor Noam Chomsky is the most significant thinker of our generation. Chomsky argues that since Newton, the goal of science has become more modest - rather than trying to understand the true nature of the universe, which may be beyond human comprehension, science aims to construct abstract models that are intelligible to us, even if the underlying reality remains a mystery. He suggests there may be inherent biological limits to human understanding, just as other animals have limits to their cognitive capacities.

The upshot is that we shouldn't necessarily expect a complete unification of scientific knowledge or for complex phenomena like mind and language to be fully explainable in terms of physics. Chomsky provocatively states that after Newton "exorcised the machine" by showing the mechanical philosophy was untenable, only the "ghost" of intelligibility was left in science, which now relies on human-constructed models rather than grasping the true essence of nature. Achieving a direct, intuitive understanding - "exorcising the ghost" - may simply lie beyond the cognitive horizons of the human species.

Panel:
Dr. Tim Scarfe
Dr. Keith Duggar
Dr. Walid Saba

Pod version: anchor.fm/machinelearningstreettalk/episodes/MLST-…
Transcript of Chomsky interview; whimsical.com/chomsky-transcript-WgFJLguL7JhzyNhsd…
Original corrupt recording: share.descript.com/view/N9KNaZTav27

00:00:00 Kick off
00:02:24 C1: LeCun's recent position paper on AI, JEPA, Schmidhuber, EBMs
00:48:38 C2: Emergent abilities in LLMs paper
00:51:32 C3: Empiricism
01:25:33 C4: Cognitive Templates
01:35:47 C5: The Ghost in the Machine
02:00:08 C6: Connectionism and Cognitive Architecture: A Critical Analysis by Fodor and Pylyshyn
02:20:12 C7: We deep-faked Chomsky
02:29:58 C8: Language
02:34:34 C9: Chomsky interview kick-off!
02:35:32 Q1: Large Language Models such as GPT-3
02:39:07 Q2: Connectionism and radical empiricism
02:44:37 Q3: Hybrid systems such as neurosymbolic
02:48:40 Q4: Computationalism silicon vs biological
02:53:21 Q5: Limits of human understanding
03:00:39 Q6: Semantics state-of-the-art
03:06:36 Q7: Universal grammar, I-Language, and language of thought
03:16:20 Q8: Profound and enduring misunderstandings
03:25:34 Q9: Greatest remaining mysteries science and philosophy
03:33:04 Debrief and 'Chuckles' from Chomsky

References;

LeCun Path to Autonomous AI paper
openreview.net/forum?id=BZ5a1r-kVsf

Tim’s marked up version:
acrobat.adobe.com/link/review?uri=urn:aaid:scds:US…

Emergent Abilities of Large Language Models [Wei et al] 2022
arxiv.org/abs/2206.07682

Connectionism and Cognitive Architecture: A Critical Analysis [Fodor, Pylyshyn] 1988
ruccs.rutgers.edu/images/personal-zenon-pylyshyn/d…

Ghost in the machine
psychology.fandom.com/wiki/Ghost_in_the_machine
forum.wordreference.com/threads/in-an-aristotelian…
news.ycombinator.com/item?id=26448901 (thanks to user tikwidd for your analysis)

Noam Chomsky in Greece: Philosophies of Democracy (1994) [Language chapter]
   • Noam Chomsky in Greece: Philosophies ...  

Richard Feynman clip
vimeo.com/340695809

Chomsky Bryan Magee BBC interview:
   • The Ideas of Chomsky - Bryan Magee & ...  

Randy Gallistel's work (question 3)
Helmholtz “NNs : they’ve damn slow”
Purkinje cells

Barbara Partee
   • "Math Does Not Represent" by Erik Curiel  

Iris Berent
cos.northeastern.edu/people/iris-berent/

Penrose Orch OR
en.wikipedia.org/wiki/Orchestrated_objective_reduc…
en.wikipedia.org/wiki/Shadows_of_the_Mind

Fodor “The Language of Thought”
www.amazon.com/Language-Thought/dp/0674510305

Least Effort
materias.df.uba.ar/dnla2019c1/files/2019/03/scalin…

structure dependence in grammar formation
www.jstor.org/stable/415004
www.amazon.com/Minimalist-Program-MIT-Press/dp/026…

three models
chomsky.info/wp-content/uploads/195609-.pdf
en.wikipedia.org/wiki/Transformational_grammar
www.amazon.com/Aspects-Theory-Syntax-Noam-Chomsky/…

Darwin's problem
chomsky.info/20140826/

Descartes's problem
en.wikipedia.org/wiki/Mind%E2%80%93body_problem

Control Theory
en.wikipedia.org/wiki/Control_(linguistics)

Todos los comentarios (21)
  • @richkoziol4219
    I love how people can get together and just talk and learn from each other it's absolutely beautiful.
  • @Self-Duality
    Beautifully conducted! Rare is it that Chomsky is asked and pressed on technical questions — the results are pure dynamite 🧨💥 Thank you!!!!
  • @SimonLMonsour
    Heroic effort! One of the richest Chomsky interviews around. Thank you so much. :)
  • @mthai66
    In the late 80s I was an undergrad making my spending money sitting on the floor of Dan Dennett's back office sorting through box after box of academic papers, reading them and then classifying them according to a list of subject topics (i.e., Connectionism, Chinese Room, etc) for a future library of cognitive studies. As a grown up manufacturing engineer I'm getting serious nostalgia here. I suggest you do one on the making of Do The Right Thing next just to complete the job lol. Edit: Thank you for treating Noam so respectfully, that was really heartwarming.
  • I don't know why this podcast popped into my feed, but I'm very glad it did. The amount of effort your team put into this single episode is remarkable and greatly appreciated. It wasn't easy for me to wade through the jargon and concepts of a field unknown to me; even so, it was nearly impossible to quit. Thank you, gentlemen and long live Chomsky!
  • @lambhead69
    brilliant save! master language splicing! wicked interview and great episode. thanks very much for all the hard work 🙂
  • Finally some people who actually seem to understand what Chomsky is talking about, as opposed to all the morons who talk about him all the time without any kind of understanding whatsoever. Absolutely amazing video!
  • @BoRisMc
    As a serious science podcast connoisseur, I gotta say the work you guys have put together here is truly extraordinary. Very impressed and honestly deeply humbled. Thanks and kudos!
  • @_tgwilson_
    What an episode!! Combining one of the worlds great public intellectuals with one of the worlds most insightful podcasts. Well done chaps.
  • Dude, ths is absolutely incredible. This kind of dedication is singular, and I've not seen quality of this kind on youtube in a long long time. This is beyond stimulating, there's something deeply beautiful about the quality of the work, and I can only say thank you.
  • Wonderful content! Keep up the great work as you do. I love all of your episodes. It's getting better and better every day.
  • @benjones1452
    Your respect for Chomsky and each other and your passion for clarity in this complex subject created something wonderful. This was accessible to me, and my family and we haven't stopped discussing rats in prime number mazes, the cognitive templates perhaps bestowed by survival though the action of genetics, the nature of empiricism finite points of data and useful abstractions and our symbolic approximations of the infinite, so much so that my daughter wants to know how to get onto you discord so that she can read more about all of this - much gratitude!
  • @XOPOIIIO
    I like the idea of blind spots in human cognition. Imaging that there are knowledge in the world, that is completely accessible to us, but we cannot comprehend, simply because of structure of our brain, which can never converge in it's learning of the concept. And I'm not meaning extremely complex concepts, but simple ones that's still incomprehensible.
  • @ShawnEmamjomeh
    What an incredible interview. For an outsider who knows nothing about the topic, to get a glimpse of such a beautiful mind distilling fundamental questions was revelatory. Your painstaking struggle to salvage the recording underscored your profound respect not just for Chomsky but for your audience. Thank you for this gift.
  • Amazing episode! The only thing better than chomskys point of view on things is the joy keiths face whenever chomsky makes a point
  • Phew, I was scared till the re-release! Massive respect and thanks for keeping these conversations, guests and everything the highest quality possible!