"The Cognitive Revolution" | AI Builders, Researchers, and Live Player Analysis

We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com.

00:00 Coming Up

01:00 The Cognitive Revolution

01:20 Sponsor

01:39 Intro

02:09 Nathan’s path to AI

04:27 Founding Waymark

06:56 The future of AI is just starting

10:00 AI dramatically enhances human capabilities

10:50 Why we started The Cognitive Revolution and what to expect

14:55 Which guests will appear on the show and topics that will be discussed

18:59 Being replaced by an AI host

20:42 Unpacking the future of AI with “no new breakthroughs”

32:21 What’s underhyped and overhyped

43:46 The dangers of AI

44:51 Applying AI safely

52:19 Losing faith in technology

53:38 A new AI ecology

55:14 Facebook, Google and Open AI

58:00 Upside and downside case for AI

58:18 Sam Altman’s case for AI

01:09:25 Starting an AI company

01:18:22 Closing

01:18:46 Sponsor

SPONSORS: SHOPIFY | OMNEKY

Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitive

Thank you Omneky for sponsoring The Cognitive Revolution. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work, customized across all platforms, with a click of a button. Omneky combines generative AI and real time advertising data, to generate personalized experiences at scale.

RECOMMENDED PODCAST:

The HR industry is at a crossroads. What will it take to construct the next generation of incredible businesses – and where can people leaders have the most business impact? Hosts Nolan Church and Kelli Dragovich have been through it all, the highs and the lows – IPOs, layoffs, executive turnover, board meetings, culture changes, and more. With a lineup of industry vets and experts, Nolan and Kelli break down the nitty-gritty details, trade offs, and dynamics of constructing high performing companies. Through unfiltered conversations that can only happen between seasoned practitioners, Kelli and Nolan dive deep into the kind of leadership-level strategy that often happens behind closed doors. Check out the first episode with the architect of Netflix’s culture deck Patty McCord.

https://link.chtbl.com/hrheretics

Twitter:

@CogRev_Podcast

@eriktorenberg (Erik)

@labenz (Nathan)

Websites:

cognitivervolution.ai

waymark.com

This show is produced by Turpentine: a network of podcasts, newsletters, and more, covering technology, business, and culture — all from the perspective of industry insiders and experts. We’re launching new shows every week, and we’re looking for industry-leading sponsors — if you think that might be you and your company, email us at [email protected].

In this episode, Nathan sits down with Pablo Arredondo, VP of CoCounsel for Thomson Reuters. They discuss the evolution of legal research, how GPT-4 has changed legal practices, security and privacy in AI driven legal services, and more. Try the Brave search API for free for up to 2000 queries per month at https://brave.com/api

X/SOCIAL:

@labenz (Nathan)

@tweetatpablo (Pablo)

@casetext

LINKS:

Casetext: https://casetext.com/

Cognitive Revolution (new feed): https://cognitiverevolution.ai/

SPONSORS:

Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive

Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off www.omneky.com

The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://brave.com/api

ODF is where top founders get their start. Apply to join the next cohort and go from idea to conviction-fast. ODF has helped over 1000 companies like Traba, Levels and Finch get their start. Is it your turn? Go to http://beondeck.com/revolution to learn more.

💥 Access global engineering without the headache and at a fraction of the cost: head to choosesquad.com and mention “Turpentine” to skip the waitlist.

TIMESTAMPS

(00:00:00) Episode preview

(00:01:42) The evolution of legal research: From books to AI

(00:02:19) The game-changing impact of GPT-4 on legal practices

(00:04:01) Exploring the future of legal AI with Pablo Arredondo

(00:04:34) The birth and evolution of CaseText

(00:07:06) Revolutionizing legal research with AI and large language models

(00:14:42) The leap to GPT-4: A new era for legal tech

(00:16:42) Navigating the challenges and opportunities of AI in law

(00:27:41) The continuous evolution of AI in legal tech

(00:43:46) The importance of rigorous testing in AI deployment

(00:45:19) The importance of testing in legal tech

(00:45:46) Merging with Thomson Reuters: A new era of quality control

(00:46:49) Harnessing GPT-4 for legal document review

(00:48:27) Innovations in legal tech: Beyond GPT-4

(00:49:00) The evolution of legal research and document management

(00:49:54) Exploring the potential of AI in legal firms

(00:51:37) Security and privacy in AI-driven legal services

(00:52:43) The future of vector databases in legal tech

(00:54:10) AI-assisted legal assistance: A new frontier

(00:58:41) The pricing strategy and market response to AI legal tools

(01:10:18) The future of law and AI integration

(01:23:18) Reflections on being acquired by Thomson Reuters

(01:26:07) Closing thoughts: The impact of LLMs on justice

In this episode, Nathan sits down with tech lawyer Cecilia Zeniti, Founder & CEO of GC AI, the AI for in-house counsel. They discuss the origins of IP law in the US Constitution to promote creativity, the "fair use doctrine" and how OpenAI could argue ChatGPT is transformative, Google's patenting strategy around the transformer, and much more. If you need an ecommerce platform, check out our sponsor Shopify: https://shopify.com/cognitive for a $1/month trial period.

LINKS:

GC AI: https://getgc.ai/

Cecilia's Twitter/X: https://twitter.com/CeciliaZin

SPONSORS:

Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitive

Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off www.omneky.com

NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist.

X/SOCIALS:

@labenz (Nathan)

@CeciliaZin (Cecilia)

@CogRev_Podcast

TIMESTAMPS:

(00:04:30) - Introduction to Intellectual Property law

(00:07:30) - Overview of main types of intellectual property - patents, trademarks, copyrights

(00:10:30) - Could Google have patented the transformer? Google’s patent strategy

(00:16:30) - Claim construction and its parallel to LLMs

(00:17:17) - Sponsor: Shopify

(00:18:46) - Practical impact of open source on ability to enforce IP rights

(00:21:47) - Litigation, internal data privacy, and communication

(00:24:30) - Copyright law and fair use doctrine for transformative works

(00:30:22) - Sponsor: Netsuite | Omneky

(00:31:42) - Big tech company lawsuits when money starts shifting between incumbents and newcomers

(00:34:10) - When judges like a technology...

(00:34:57) - Scraping and LinkedIn’s suit

(00:38:50) - NYTimes vs OpenAI

(00:40:00) - Copyright, creators, and music industry licensing

(00:42:35) - Transformative nature of work and “fair use”

(00:50:29) - Limits on getting injunctions and ongoing royalties from courts

(00:56:39) - Legalities of other modalities, like DALL-E images of copyrighted IP

(01:01:00) - OpenAI’s opt-out for licensing on the text modality

(01:03:58) - OpenAI’s weak to strong generalization

(01:07:00) - Pharmaceuticals and software, AI doctors, public good balancing

(01:10:40) - Why licensed professionals aren’t pushing back against AI

(01:15:36) - Duty to use tools for efficiency to a client

(01:17:04) - Impact of open source and ability to find someone to sue

(01:20:30) - Forward-looking thoughts on what IP laws should be for AI

(01:27:38) - Overview of Cecilia's company GC AI for lawyers

This show is produced by Turpentine: a network of podcasts, newsletters, and more, covering technology, business, and culture — all from the perspective of industry insiders and experts. We’re launching new shows every week, and we’re looking for industry-leading sponsors — if you think that might be you and your company, email us at [email protected].

In this episode of The Cognitive Revolution, Nathan explores unconventional approaches to AI safety with Judd Rosenblatt and Mike Vaiana from AE Studio. Discover how this innovative company pivoted from brain-computer interfaces to groundbreaking AI alignment research, producing two notable results in cooperative and less deceptive AI systems. Join us for a deep dive into biologically-inspired approaches that offer hope for solving critical AI safety challenges.

Self-Modeling: https://arxiv.org/abs/2407.10188

Self-Other Distinction Minimization: https://www.alignmentforum.org/posts/hzt9gHpNwA2oHtwKX/self-other-overlap-a-neglected-approach-to-ai-alignment

Neglected approaches blog post: https://www.lesswrong.com/posts/qAdDzcBuDBLexb4fC/the-neglected-approaches-approach-ae-studio-s-alignment

Apply to join over 400 Founders and Execs in the Turpentine Network: https://www.turpentinenetwork.co/

SPONSORS:

WorkOS: Building an enterprise-ready SaaS app? WorkOS has got you covered with easy-to-integrate APIs for SAML, SCIM, and more. Join top startups like Vercel, Perplexity, Jasper & Webflow in powering your app with WorkOS. Enjoy a free tier for up to 1M users! Start now at https://bit.ly/WorkOS-Turpentine-Network

Weights & Biases Weave: Weights & Biases Weave is a lightweight AI developer toolkit designed to simplify your LLM app development. With Weave, you can trace and debug input, metadata and output with just 2 lines of code. Make real progress on your LLM development and visit the following link to get started with Weave today: https://wandb.me/cr

80,000 Hours: 80,000 Hours offers free one-on-one career advising for Cognitive Revolution listeners aiming to tackle global challenges, especially in AI. They connect high-potential individuals with experts, opportunities, and personalized career plans to maximize positive impact. Apply for a free call at https://80000hours.org/cognitiverevolution to accelerate your career and contribute to solving pressing AI-related issues.

Omneky: Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/

RECOMMENDED PODCAST:

This Won't Last - Eavesdrop on Keith Rabois, Kevin Ryan, Logan Bartlett, and Zach Weinberg's monthly backchannel ft their hottest takes on the future of tech, business, and venture capital.

Spotify: https://open.spotify.com/show/2HwSNeVLL1MXy0RjFPyOSz

CHAPTERS:

(00:00:00) About the Show

(00:00:22) Sponsors: WorkOS

(00:01:22) About the Episode

(00:05:18) Introduction and AE Studio Background

(00:11:37) Keys to Success in Building AE Studio

(00:16:57) Sponsors: Weights & Biases Weave | 80,000 Hours

(00:19:37) Universal Launcher and Productivity Gains

(00:24:44) 100x Productivity Increase Explanation

(00:31:46) Brain-Computer Interface and AI Alignment

(00:38:05) Sponsors: Omneky

(00:38:30) Current State of NeuroTech

(00:44:00) Survey on Neglected Approaches in AI Alignment

(00:50:41) Self-Modeling and Biological Inspiration

(00:57:48) Technical Details of Self-Modeling

(01:06:17) Self-Other Distinction Minimization

(01:12:44) Implementation in Language Models

(01:19:00) Compute Costs and Scaling Considerations

(01:24:27) Consciousness Concerns and Future Work

(01:40:24) Evaluating Neglected Approaches

(01:55:56) Closing Thoughts and Policy Considerations

(01:59:25) Outro

In this episode, we delve into the intricate world of AI inference with cofounders of Firework AI. Discover the strategies behind optimizing AI performance, the importance of balancing latency and throughput, and the nuances of different AI architectures from GPT-3 to Stable Diffusion. Learn about their partnership with Stability AI, their unique focus on reducing total cost of ownership, and their vision for a seamless developer experience.

RECOMMENDED PODCAST:

How Do You Use ChatGPT with Dan Shipper.

Dan Shipper talks to programmers, writers, founders, academics, tech executives, and others to walk through all of their ChatGPT use cases (including Nathan!). They even use ChatGPT together, live on the show. Listen to How Do You Use ChatGPT? from Dan Shipper and the team at Every, wherever you get your podcasts: https://link.chtbl.com/hdyuchatgpt

SPONSORS:

Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/

The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR

Plumb is a no-code AI app builder designed for product teams who care about quality and speed. What is taking you weeks to hand-code today can be done confidently in hours. Check out https://bit.ly/PlumbTCR for early access.

Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist.

CHAPTERS :

(00:00:00) Introduction

(00:08:34) Compute Stack

(00:19:23) Fireworks Product Philosophy

(00:24:11) Sponsors : Brave / Omneky

(00:25:40) Fine-tuning Strategy

(00:38:40) Sponsors : Plumb / Squad

(00:40:33) NVIDIA Stack Overview

(00:47:14) TensorFlow Triton Service

(00:55:25) Reduced Precision Advantages

(01:03:57) Different Deployment Scenarios

(01:08:27) Seeking Intuition on Sharding

(01:19:28) Announcing Stability AI Partnership

(01:32:00) Closing Remarks