Gemini Robotics – AI for the Physical World, with Keerthana and Ted of Google DeepMind

Gemini Robotics – AI for the Physical World, with Keerthana and Ted of Google DeepMind

In this engaging episode of the Cognitive Revolution, host Nathan Labenz welcomes guests Keerthana Gopalakrishnan and Ted Xiao to revisit significant advancements in robotics over the past year.


Watch Episode Here


Read Episode Description

In this engaging episode of the Cognitive Revolution, host Nathan Labenz welcomes guests Keerthana Gopalakrishnan and Ted Xiao to revisit significant advancements in robotics over the past year. Key themes discussed include the proliferation of new robotics companies, the emergence of humanoid robots, and the development of sophisticated foundation models. The conversation highlights the transformative potential of imitation learning, the evolution from simple lab-based tasks to complex, real-world deployments, and the critical role of hardware in pushing the boundaries of AI capabilities. With insights on various aspects of robot dexterity, safety, and the practical steps towards deploying robots in everyday environments, the episode provides a comprehensive overview of the current state and future directions of the robotics landscape.

Upcoming Major AI Events Featuring Nathan Labenz as a Keynote Speaker
https://www.imagineai.live/
https://adapta.org/adapta-summ...
https://itrevolution.com/produ...


SPONSORS:
ElevenLabs: ElevenLabs gives your app a natural voice. Pick from 5,000+ voices in 31 languages, or clone your own, and launch lifelike agents for support, scheduling, learning, and games. Full server and client SDKs, dynamic tools, and monitoring keep you in control. Start free at https://elevenlabs.io/cognitiv...

Oracle Cloud Infrastructure (OCI): Oracle Cloud Infrastructure offers next-generation cloud solutions that cut costs and boost performance. With OCI, you can run AI projects and applications faster and more securely for less. New U.S. customers can save 50% on compute, 70% on storage, and 80% on networking by switching to OCI before May 31, 2024. See if you qualify at https://oracle.com/cognitive

The AGNTCY: The AGNTCY is an open-source collective dedicated to building the Internet of Agents, enabling AI agents to communicate and collaborate seamlessly across frameworks. Join a community of engineers focused on high-quality multi-agent software and support the initiative at https://agntcy.org/?utm_campai...

Shopify: Shopify powers millions of businesses worldwide, handling 10% of U.S. e-commerce. With hundreds of templates, AI tools for product descriptions, and seamless marketing campaign creation, it's like having a design studio and marketing team in one. Start your $1/month trial today at https://shopify.com/cognitive

NetSuite: Over 41,000 businesses trust NetSuite by Oracle, the #1 cloud ERP, to future-proof their operations. With a unified platform for accounting, financial management, inventory, and HR, NetSuite provides real-time insights and forecasting to help you make quick, informed decisions. Whether you're earning millions or hundreds of millions, NetSuite empowers you to tackle challenges and seize opportunities. Download the free CFO's guide to AI and machine learning at https://netsuite.com/cognitive


PRODUCED BY:
https://aipodcast.ing

CHAPTERS:
(00:00) About the Episode
(04:05) Intro
(04:48) Imitation Learning and Humanoid Advancements
(06:21) Commercialization and Community Growth
(06:41) Comparing Robotics to Language Models
(08:11) Scaling and Fine-Tuning in Robotics
(12:30) Embodied Reasoning and ERQA Benchmark
(13:59) Gemini Robotics: Technical Insights (Part 1)
(19:07) Sponsors: ElevenLabs | Oracle Cloud Infrastructure (OCI)
(21:34) Gemini Robotics: Technical Insights (Part 2)
(22:39) Model Architecture and Distributed Systems (Part 1)
(30:45) Sponsors: The AGNTCY | Shopify | NetSuite
(35:07) Model Architecture and Distributed Systems (Part 2)
(37:17) Real-World Applications and Safety
(52:52) Failures and Safety Measures
(59:35) Current State of Robot Safety
(01:02:05) Deployment Challenges and Strategies
(01:04:44) Data Collection and Scaling in Robotics
(01:08:00) Synthetic vs. Real-World Data
(01:11:58) Future of Robotics and AI Integration
(01:28:05) Fine-Tuning and Task-Specific Performance
(01:34:26) Embodiments and Hardware Interplay
(01:37:44) Humanoids: The Next Frontier
(01:40:01) Future Prospects and Challenges
(01:47:52) Outro

SOCIAL LINKS:
Website: https://www.cognitiverevolutio...
Twitter (Podcast): https://x.com/cogrev_podcast
Twitter (Nathan): https://x.com/labenz
LinkedIn: https://linkedin.com/in/nathan...
Youtube: https://youtube.com/@Cognitive...
Apple: https://podcasts.apple.com/de/...
Spotify: https://open.spotify.com/show/...

Great! You’ve successfully signed up.

Welcome back! You've successfully signed in.

You've successfully subscribed to The Cognitive Revolution.

Success! Check your email for magic link to sign-in.

Success! Your billing info has been updated.

Your billing was not updated.