#93 Prof. MURRAY SHANAHAN - Consciousness, Embodiment, Language Models

2022-12-24に共有
Support us! www.patreon.com/mlst

Professor Murray Shanahan is a renowned researcher on sophisticated cognition and its implications for artificial intelligence. His 2016 article ‘Conscious Exotica’ explores the Space of Possible Minds, a concept first proposed by philosopher Aaron Sloman in 1984, which includes all the different forms of minds from those of other animals to those of artificial intelligence. Shanahan rejects the idea of an impenetrable realm of subjective experience and argues that the majority of the space of possible minds may be occupied by non-natural variants, such as the ‘conscious exotica’ of which he speaks. In his paper ‘Talking About Large Language Models’, Shanahan discusses the capabilities and limitations of large language models (LLMs). He argues that prompt engineering is a key element for advanced AI systems, as it involves exploiting prompt prefixes to adjust LLMs to various tasks. However, Shanahan cautions against ascribing human-like characteristics to these systems, as they are fundamentally different and lack a shared comprehension with humans. Even though LLMs can be integrated into embodied systems, it does not mean that they possess human-like language abilities. Ultimately, Shanahan concludes that although LLMs are formidable and versatile, we must be wary of over-simplifying their capacities and limitations.

Pod version (music removed): anchor.fm/machinelearningstreettalk/episodes/93-Pr…

[00:00:00] Introduction
[00:08:51] Consciousness and Consciousness Exotica
[00:34:59] Slightly Consciousness LLMs
[00:38:05] Embodiment
[00:51:32] Symbol Grounding
[00:54:13] Emergence
[00:57:09] Reasoning
[01:03:16] Intentional Stance
[01:07:06] Digression on Chomsky show and Andrew Lampinen
[01:10:31] Prompt Engineering

Find Murray online:
www.doc.ic.ac.uk/~mpsha/
twitter.com/mpshanahan?lang=en
scholar.google.co.uk/citations?user=00bnGpAAAAAJ&h…

MLST Discord: discord.gg/aNPkGUQtc5

References:

Conscious exotica [Aeon/Shannahan]
aeon.co/essays/beyond-humans-what-other-kinds-of-m…

Embodiment and the inner life [Shannahan]
www.amazon.co.uk/Embodiment-inner-life-Cognition-C…

The Technological Singularity [Shannahan]
mitpress.mit.edu/9780262527804/

Talking About Large Language Models [Murray Shanahan]
arxiv.org/abs/2212.03551

en.wikipedia.org/wiki/Global_workspace_theory [Bernard Baars]
In the Theater of Consciousness: The Workspace of the Mind [Bernard Baars]
www.amazon.co.uk/Theater-Consciousness-Workspace-M…

Consciousness and the Brain: Deciphering How the Brain Codes Our Thoughts [Stanislas Dehaene]
www.amazon.co.uk/Consciousness-Brain-Deciphering-C…

Roger Penrose On Why Consciousness Does Not Compute [nautil.us/STEVE PAULSON]
nautil.us/roger-penrose-on-why-consciousness-does-…
en.wikipedia.org/wiki/Orchestrated_objective_reduc…

Thomas Nagal - what is it like to be a bat?
warwick.ac.uk/fac/cross_fac/iatl/study/ugmodules/h…

Private Language [Ludwig Wittgenstein]
plato.stanford.edu/entries/private-language/

PHILOSOPHICAL INVESTIGATIONS [Ludwig Wittgenstein] (see §243 for Private Language argument)
static1.squarespace.com/static/54889e73e4b0a2c1f98…

Integrated information theory [Giulio Tononi]
en.wikipedia.org/wiki/Integrated_information_theor…

Being You: A New Science of Consciousness (The Sunday Times Bestseller) [Anil Seth]
www.amazon.co.uk/Being-You-Inside-Story-Universe/d…

Attention schema theory [Michael Graziano]
en.wikipedia.org/wiki/Attention_schema_theory

Rethinking Consciousness: A Scientific Theory of Subjective Experience [Michael Graziano]
www.amazon.co.uk/Rethinking-Consciousness-Scientif…

SayCan - Do As I Can, Not As I Say: Grounding Language in Robotic Affordances [Google/]
say-can.github.io/

THE SYMBOL GROUNDING PROBLEM [Stevan Harnad]
www.cs.ox.ac.uk/activities/ieg/elibrary/sources/ha…

Lewis Carroll Puzzles / Syllogisms
math.hawaii.edu/~hile/math100/logice.htm

In-context Learning and Induction Heads [Catherine Olsson et al / Anthropic]
transformer-circuits.pub/2022/in-context-learning-…