Yann LeCun on How to Fill the Gaps in Large Language Models
21,986
Publicado 2023-02-15
While large language models have made remarkable strides in natural language processing and understanding, they are still far from perfect. Yann LeCun points out that these models often cannot capture the nuances and complexities of language, leading to inaccuracies and errors.
To address this gap, Yann LeCun introduces his new joint embedding predictive architecture - a novel approach to language modelling that combines techniques from computer vision and natural language processing. This approach involves jointly embedding text and images, allowing for more accurate predictions and a better understanding of the relationships between original concepts and objects.
Craig Smith Twitter: twitter.com/craigss
Eye on A.I. Twitter: twitter.com/EyeOn_AI
Todos los comentarios (21)
-
why would you answer a phone call in the middle of an interview 29:00
-
Please turn off your phone the next time you do an interview. otherwise, great conversation with Yann LeCun.
-
I'm very confused by this channel. Some of the most brilliant minds in the industry are willing to come on the show. The interviewer knows what he's talking about and asks good questions. But then the whole thing gets cut up in a way that makes it extremely strenuous to watch and listen. And just to top it off, Yann LeCun, who takes a chunk out of his day to do this, gets told to hold on while the interviewer answers his phone?! Leaving the sound on it a rookie error but answering the damn thing while he's talking is just absurd. So you assume the whole thing gets pulled through (pourly performing) auto-cut software. But then it looks like somebody actually took the time to mark chapters in the video but the embarrassing moment of answering a phone is left in the video while there are about 20 cuts per second...🤯 End of rant. 😅 Amazing opportunity for quality content here but please leave the interview uncut and let inpatient people play it at double speed. And for the love of God turn off your phone during an interview 😄
-
Fantastic interview!
-
Can you use subtitles with action props to describe the next step in a movie that way it would be Language that’s directing the next event with something like that be possible?
-
Which paper is he mentioning on 51:59?
-
In my opinion visual input is just another form of modality, which is not necessarily more truthful than other forms. Good to have, but grounding solely based on visuals also have the same issue just as generative models
-
Why is there so many short-cuts
-
You don't need an emotion like fear if you can think quickly enough. Fear is a heuristic.
-
10:30 most of what we learn has nothing to do with language but rather common sense
-
What about taking Ai with you through a day with a human explaining everything that’s happening as it’s happening so that the AI can tag along with being a person with something like that work?
-
What did Beauregard want?
-
What's the architecture that he keeps referring to? Jon tiang architecture? Jon ting architecture? I couldn't understand, he was speaking really fast 😂
-
I think setting them goals is not a good idea. Sounds problematic.
-
Ali Taj Ghahramani.
-
Moral: researchers still have zero idea of how to build intelligence into machines. What a shock!
-
Reversible computing is the future.
-
mmhhmm mhhmm mhhmm mhhmmm mmhhmm mhhmm mhhhhhhmm mhmm mhmm mhhmmm mhmm mhmm
-
30 years living in the states and his accent still sounds like it's his first day lol (I'm French, don't hate me)
-
Mad libs
