Yann LeCun: Meta’s New AI Model LLaMA; Why Elon is Wrong about AI; Open-source AI Models | E1014

Published 2023-05-15
Yann LeCun is VP & Chief AI Scientist at Meta and Silver Professor at NYU affiliated with the Courant Institute of Mathematical Sciences & the Center for Data Science. He was the founding Director of FAIR and of the NYU Center for Data Science. After a postdoc in Toronto he joined AT&T Bell Labs in 1988, and AT&T Labs in 1996 as Head of Image Processing Research. He joined NYU as a professor in 2003 and Meta/Facebook in 2013. He is the recipient of the 2018 ACM Turing Award for “conceptual and engineering breakthroughs that have made deep neural networks a critical component of computing”. Huge thanks to David Marcus for helping to make this happen.

------------------------------------------

Timestamps:

0:00 Introduction
0:32 Yann LeCun's Journey to Chief AI Scientist at Meta: A History of AI
6:25 The Rapid Progress of AI Today
12:31 Prophecies of Doom: Debunking AI Misconceptions
21:19 Open vs Closed-Models of AI; Where does the value go?
25:01 How does Meta win the AI race?
29:50 Incumbents vs Startups: Profiting in the AI Era
36:41 AI Will Create More Jobs Than It Destroys
43:36 Why Humans Love AI Doom Scenarios
45:40 Jeff Dean's Exit from Google & His AI Warning
51:38 Elon Musk Is Wrong About AI
54:40 Quick-Fire Round

------------------------------------------

In Today’s Episode with Yann LeCun:

1.) The Road to AI OG:

How did Yann first hear about machine learning and make his foray into the world of AI?
For 10 years plus, machine learning was in the shadows, how did Yann not get discouraged when the world did not appreciate the power of AI and ML?
What does Yann know now that he wishes he had known when he started his career in machine learning?

2.) The Next Five Years of AI: Hope or Horror:

Why does Yann believe it is nonsense that AI is dangerous?
Why does Yann think it is crazy to assume that AI will even want to dominate humans?
Why does Yann believe digital assistants will rule the world?
If digital assistants do rule the world, what interface wins? Search? Chat? What happens to Google when digital assistants rule the world?

3.) Will Anyone Have Jobs in a World of AI:

From speaking to many economists, why does Yann state “no economist thinks AI will replace jobs”?
What jobs does Yann expect to be created in the next generation of the AI economy?
What jobs does Yann believe are under more immediate threat/impact?
Why does Yann expect the speed of transition to be much slower than people anticipate?
Why does Yann believe Elon Musk is wrong to ask for the pausing of AI developments?

4.) Open or Closed: Who Wins:

Why does Yann know that the open model will beat the closed model?
Why is it superior for knowledge gathering and idea generation?
What are some core historical precedents that have proved this to be true?
What did Yann make of the leaked Google Memo last week?

5.) Startup vs Incumbent: Who Wins:

Who does Yann believe will win the next 5 years of AI; startups or incumbents?
How important are large models to winning in the next 12 months?
In what ways does regulation and legal stop incumbents? How has he seen this at Meta?
Has his role at Meta ever stopped him from being impartial? How does Yann deal with that?

------------------------------------------

Subscribe on Spotify:
open.spotify.com/show/3j2KMcZTtgTNBKwtZBMHvl?si=85…

Subscribe on Apple Podcasts:
podcasts.apple.com/us/podcast/the-twenty-minute-vc…

Follow Harry Stebbings on Twitter:
twitter.com/HarryStebbings

Follow Yann LeCun on Twitter:
twitter.com/ylecun

Follow 20VC on Instagram:
www.instagram.com/20vc_reels

Follow 20VC on TikTok:
www.tiktok.com/@20vc_tok

Visit our Website:
www.20vc.com/

Subscribe to our Newsletter:
www.thetwentyminutevc.com/contact

------------------------------------------

#YannLeCun #Meta #HarryStebbings

All Comments (21)
  • @michaelg3573
    I love hearing from the researchers that actually know how the systems work under the hood make prediction as opposed to people going off what they've read in sci-fi novels
  • @andrewwalker8985
    A whimsical description of Facebook breaking down the fabric of society with algorithmic newsfeeds
  • @adamkadmon6339
    It was a great show, and Yann made great points very well. But he still did not explain why he thinks that a super-smart AI, able to make its own subgoals, would not see increased control as a subgoal which would aid it in satisfying the other goals which it is given. I know of no mathematical or algorithmic strategy which rules out this undesirable side-effect. NOTE ADDED LATER : the following debate meanders a bit, but if you are interested in my critique, I get down to more technical details in the reply below entitled **THE PROPER CRITIQUE** .
  • @DuarteMolha
    His predictions are similar to those that said sequencing of the human genome would be the end of cancer and the internet would allow for and utopic world. Both are entirely too positive. Society is not ready for the advent of strong AI
  • @aprohith1
    This is an awesome conversation.! I love Yann's optimism on the positive impacts of AI.
  • @Edo9River
    What is the significance of some of the questions like, What is the time it took to get to the major breakthroughs..." really does it matter? Is this just a matter of appreciating what Mr LeCun did with his time in the lab? What effect does it have for us now?
  • @omarnomad
    One of the best interviews with Yann so far! It's really refreshing to hear a balanced optimistic opinion from the trenches. Thanks for sharing. PS. Nice touch to remove silences to create a more dynamic conversation. It was a nice detail. One mistake, it's not Jeff Dean who departed, it's Hinton. (Notes)
  • @JayMcKinsey
    In 1995 at the dawn of the Internet/Web it was already obvious that making web pages was a huge career path. We are at the same point in AI and no one can name any of these great new jobs.
  • @ViktorFerenczi
    Very good selection of discussion topics, congratulations for the host!
  • @Anna-mc3ll
    Thank you for sharing this very interesting conversation!
  • @therealb888
    I have a dumb question for the smart intro. How long before our smart AI assistants decide to take a promotion & become the boss?
  • @clarckkim
    First time i see this guy and see him speak, but i had a great respect for him and following his works since 2014
  • @robertweekes5783
    All his assumptions dismissing the dangers of AGI — he’s only thinking about GPT-4, not the ones after that 😂
  • @susymay7831
    Switzerland is well placed to do well over the coming decades. Of the large countries, I especially like the chances of the U.S. to do well over the coming decades.
  • @shyama5612
    I've enjoyed this talk immensely. Thank you harry.
  • Excellent interview, thanks to both of you. Learning to use tools is actually a big next step for AI, and we see it emerging into the mainstream with ChatGPT plugins. With regard to world models, I wonder if the Meta-verse will finally find a use as Llama descendants can use it to explore a limited physical world. Edit: Although more specialized physical models are probably a better choice.
  • @scottnetworking
    How does a person secure a patent or personal interest when everything is done "in the open?"
  • @Edo9River
    Just who will get these opportunities to be in control of AI? Isnt this exactly what was said about the early stages of Facebook and social media? Where is the historical comparisons that would eiter support parallels or show differences?
  • @hanskraut2018
    I love what Yann LeCun said. I totaly agree about people ignoring the real bad things in thr world and replace it for imagined bad risks that might or might not be real. Also the realization of indirect benefits like printing press and so on. Also the open source in meta makes me want to help them more