Think Like a Nobel Prize Winner

Dr. David Sussillo (Meta Reality Labs, Stanford) explains why scaling transformers alone won't produce conscious AI — and why studying the brain may be the only way forward. Sussillo previously discussed neural computation online and is a leading voice in the RNN vs. transformer debate. David spent years training neural networks at Google Brain and now leads research at Meta Reality Labs. His verdict on the path to artificial consciousness might surprise you. We discuss why scaling transformers alone won't produce conscious AI, how recurrent neural networks differ from the transformer architectures powering today's LLMs, the FORCE algorithm he developed to train RNNs, what his work on Meta's EMG wristband reveals about AI and biological signals, Rich Sutton's Bitter Lesson and whether we're locked into a GPU-transformer paradigm, and why studying the brain may be the only way out of AI's current limitations. David is also the author of Emergence, a braided memoir that tells the story of his path from foster care to the frontier of neuroscience and AI research. 🔔 Subscribe for new episodes twice a week 🎧 Ad-free episodes + monthly live Q&A: patreon.com/drbriankeating ━━━━━━━━━━━━━━━━━━━━ TIMESTAMPS 00:00 Scale alone won't produce consciousness — here's why 00:25 The "bitter lesson": big data crushes every algorithmic invention 01:15 How hallucinations were discovered early at Google 05:00 The lock-in problem: why LLM + GPU may cap AI's ceiling 08:25 What Meta's neural wristband is actually trying to solve 11:20 Rich Sutton's bitter lesson explained 14:15 "More is Different" — why you can't reduce complexity upward 28:30 The book Emergence — two stories braided into one 36:00 Why mentorship matters more than intelligence for at-risk kids 47:00 Stability over intensity: what kids in foster care actually need ━━━━━━━━━━━━━━━━━━━━ ABOUT DAVID SUSSILLO 🌐 Research: Meta Reality Labs 🎓 Stanford / Columbia / Carnegie Mellon 📚 Emergence (memoir): https://www.amazon.com/Emergence-Memoir-Boyhood-Computation-Mysteries/dp/1538768577 🏄‍X: https://x.com/SussilloDavid ━━━━━━━━━━━━━━━━━━━━ INTO THE IMPOSSIBLE 11 Nobel Prize winners. 589+ episodes. Full video conversations with the world's most brilliant minds. Praised by Sean Carroll as offering "a first-hand account of how science happens at the very highest levels." 📚 Books by Brian Keating: Think Like a Nobel Prize Winner: https://a.co/d/03ezQFu Losing the Nobel Prize: http://amzn.to/2sa5UpA Follow Brian: 🏄‍X: https://twitter.com/DrBrianKeating 📝 Newsletter: http://briankeating.com/list 🎙️ Audio podcast: https://briankeating.com/podcast #AI #consciousness #neuralnetworks #transformers #RNN #metarealitylabs #stanford #science #podcast #briankeating #intotheimpossible ----------------------------------------------------------------------------------------- ➡️ Follow David Sussillo 🌐 Website / Research: Meta Reality Labs 📚 Emergence (memoir): https://www.amazon.com/Emergence-Memoir-Boyhood-Computation-Mysteries/dp/1538768577 🎓 Stanford / Columbia / Carnegie Mellon Alumni ✍️ Email: davidsussillo@gmail.com 🏄‍♂️ Twitter: https://x.com/SussilloDavid Join this channel to get access to perks like monthly Office Hours: https://www.youtube.com/channel/UCmXH_moPhfkqCk6S3b9RWuw/join 📚 Get my books: Think Like a Nobel Prize Winner, with productivity tips from 9 Nobel Prize winners: https://a.co/d/03ezQFu Focus Like a Nobel Prize Winner, with life-changing interviews with 9 Nobel Prizewinners: https://a.co/d/hi50U9U My tell-all cosmic memoir Losing the Nobel Prize: http://amzn.to/2sa5UpA The first-ever audiobook from Galileo: Dialogue Concerning the Two Chief World Systems: Ptolemaic and Copernican https://a.co/d/iZPi9Un Follow me to ask questions of my guests: 🏄‍♂️ Twitter: https://twitter.com/DrBrianKeating 🔔 Subscribe https://www.youtube.com/DrBrianKeating?sub_confirmation=1 📝 Join my mailing list; just click here http://briankeating.com/list ✍️ Detailed Blog posts here: https://briankeating.com/blog 🎙️ Listen on audio-only platforms: https://briankeating.com/podcast #universe #podcast #briankeating #intotheimpossible #science #astronomy #cosmology #cosmicmicrowavebackground #intotheimpossible #briankeating