How AI Language Models Will Shape The Future | Aidan Gomez | Eye on AI #123

Welcome to Eye on AI, the podcast that keeps you informed about the latest trends, obstacles, and possibilities in the realm of artificial intelligence. In this episode, we have the privilege of engaging in a thought-provoking discussion with Aidan Gomez, an exceptional AI developer and co-founder of Cohere. Aidan’s passion lies in enhancing the efficiency of massive neural networks and effectively deploying them in the real world. Drawing from his vast experience, which includes leading a team of researchers at For.ai and conducting groundbreaking research at Google Brain, Aidan provides us with unique insights and anecdotes that shed light on the AI landscape. During our conversation, Aidan explains his collaboration with the legendary Geoffrey Hinton and their remarkable project at Google Brain. We delve into the intricate architecture of AI systems, demystifying the construction of the transformative transformer algorithm. Aidan generously shares his knowledge on the creation of attention within these models and the complexities of scaling such systems. As we explore the fascinating domain of language models, Aidan discusses their learning process, bridging the gap between code and data. We uncover the immense potential of these models to suggest other large-scale counterparts. We gain invaluable insights into Aidan’s journey as a co-founder of Cohere, an innovative platform revolutionizing the utilization of language technology. Tune in to Eye on AI now to immerse yourself in a captivating conversation that will expand your understanding of this ever-develop field. 00:00 Preview 00:33 Introduction & sponsorship  02:00 Aidan's background with machine learning & AI 05:10 Geoffrey Hinton & Aidan Gomez working together  07:55 Aidan Gomez & Google Brain's project  12:53 Aidan's role in building AI architecture  15:25 How the transformer algorithm is built 18:25 How do you create attention? 20:40 How do you scale the model? 25:10 How language models learn from code and data 29:55 Did you know the potential of the project? 34:15 Can LLMs suggest other large models? 36:45 How Aidan Gomez started Cohere 41:10 How do people use Cohere? 46:50 Examples of language technology models  48:40 How Cohere handles hallucinations 52:53 The dangers of AI   Craig Smith Twitter: https://twitter.com/craigss Eye on A.I. Twitter: https://twitter.com/EyeOn_AI