#123 Aidan Gomez: How AI Language Models Will Shape The Future

05/24/23 • 62 min

2 Listeners

Welcome to Eye on AI, the podcast that keeps you informed about the latest trends, obstacles, and possibilities in the realm of artificial intelligence. In this episode, we have the privilege of engaging in a thought-provoking discussion with Aidan Gomez, an exceptional AI developer and co-founder of Cohere. Aidan’s passion lies in enhancing the efficiency of massive neural networks and effectively deploying them in the real world. Drawing from his vast experience, which includes leading a team of researchers at For.ai and conducting groundbreaking research at Google Brain, Aidan provides us with unique insights and anecdotes that shed light on the AI landscape. During our conversation, Aidan explains his collaboration with the legendary Geoffrey Hinton and their remarkable project at Google Brain. We delve into the intricate architecture of AI systems, demystifying the construction of the transformative transformer algorithm. Aidan generously shares his knowledge on the creation of attention within these models and the complexities of scaling such systems. As we explore the fascinating domain of language models, Aidan discusses their learning process, bridging the gap between code and data. We uncover the immense potential of these models to suggest other large-scale counterparts. We gain invaluable insights into Aidan’s journey as a co-founder of Cohere, an innovative platform revolutionizing the utilization of language technology. Tune in to Eye on AI now to immerse yourself in a captivating conversation that will expand your understanding of this ever-develop field. (00:00) Preview (00:33) Introduction & sponsorship (02:00) Aidan's background with machine learning & AI (05:10) Geoffrey Hinton & Aidan Gomez working together (07:55) Aidan Gomez & Google Brain's project (12:53) Aidan's role in building AI architecture (15:25) How the transformer algorithm is built (18:25) How do you create attention? (20:40) How do you scale the model? (25:10) How language models learn from code and data (29:55) Did you know the potential of the project? (34:15) Can LLMs suggest other large models? (36:45) How Aidan Gomez started Cohere (41:10) How do people use Cohere? (46:50) Examples of language technology models (48:40) How Cohere handles hallucinations (52:53) The dangers of AI Craig Smith Twitter: https://twitter.com/craigss

Eye on A.I. Twitter: https://twitter.com/EyeOn_AI

Eye on A.I. Twitter: https://twitter.com/EyeOn_AI

Previous Episode

#122 Connor Leahy: Unveiling the Darker Side of AI

Welcome to Eye on AI, the podcast that explores the latest developments, challenges, and opportunities in the world of artificial intelligence. In this episode, we sit down with Connor Leahy, an AI researcher and co-founder of EleutherAI, to discuss the darker side of AI. Connor shares his insights on the current negative trajectory of AI, the challenges of keeping superintelligence in a sandbox, and the potential negative implications of large language models such as GPT4. He also discusses the problem of releasing AI to the public and the need for regulatory intervention to ensure alignment with human values. Throughout the podcast, Connor highlights the work of Conjecture, a project focused on advancing alignment in AI, and shares his perspectives on the stages of research and development of this critical issue. If you’re interested in understanding the ethical and social implications of AI and the efforts to ensure alignment with human values, this podcast is for you. So join us as we delve into the darker side of AI with Connor Leahy on Eye on AI. (00:00) Preview

(00:48) Connor Leahy’s background with EleutherAI & Conjecture

(03:05) Large language models applications with EleutherAI

(06:51) The current negative trajectory of AI

(08:46) How difficult is keeping super intelligence in a sandbox?

(12:35) How AutoGPT uses ChatGPT to run autonomously

(15:15) How GPT4 can be used out of context & negatively

(19:30) How OpenAI gives access to nefarious activities

(26:39) The problem with the race for AGI

(28:51) The goal of Conjecture and advancing alignment

(31:04) The problem with releasing AI to the public

(33:35) FTC complaint & government intervention in AI

(38:13) Technical implementation to fix the alignment issue

(44:34) How CoEm is fixing the alignment issue

(53:30) Stages of research and development of Conjecture

Craig Smith Twitter: https://twitter.com/craigss

Eye on A.I. Twitter: https://twitter.com/EyeOn_AI

Next Episode

#124 Sina Kian: Reshaping Privacy in the AI & Machine Learning Revolution

Welcome to episode #124 of the Eye on AI podcast, where we bring you the latest insights into the fascinating world of artificial intelligence. In this episode, Craig Smith is joined by Sina Kian, General Counsel and COO at Aleo, as they dive deep into the revolutionary realm of zero-knowledge proofs. Join us as we explore the incredible potential of zero-knowledge proofs in safeguarding sensitive data while leveraging it for machine learning and AI applications. Sina Kian provides shares how this innovative technology can reshape privacy, digital identity, and even social media authentication. During this conversation, we delve into the power of privacy-preserving blockchain technology and its far-reaching impact across industries. Discover how Aleo is at the forefront of making digital identity more secure and how it can be seamlessly integrated across platforms without compromising sensitive information. We examine the future of machine learning and AI, unraveling the role that digital identity plays in accessing products and content based on location. As we venture into the depths of the social media landscape, we also explore the risks and rewards associated with user data and privacy. Gain insights into how privacy-preserving technology can shield user information and authenticate data and content without compromising privacy. This conversation will discusses the potential of zero-knowledge proofs and privacy-preserving technology, offering a glimpse into how they will shape the future of machine learning and AI. (00:00) Preview

(00:41) Introduction

(02:28) Sina Kian's background in Aleo & blockchain

(05:49) Blockchain's integration with AI & machine learning

(11:48) How data is protected in blockchain technology

(12:25) Use cases of encryption with Aleo

(18:53) How Aleo works with an open source protocol

(24:13) Aleo's progress in developing its open source project

(31:13) Why social media platforms capture your data

(34:16) How can you find widespread adoption?

(35:43) How the government are getting involved in digital identity

(41:53) How data privacy integrates to Web 3.0

(45:15) Blockchain's implementation in the real world