Episode 10: Don't Be A Lawyer, ChatGPT. March 3, 2023

Explicit content warning

08/16/23 • 66 min

Alex and Emily are taking AI to court! Amid big claims about LLMs, a look at the facts about ChatGPT, legal expertise, and what the bar exam actually tells you about someone's ability to practice law--with help from Harvard legal and technology scholar Kendra Albert.
This episode was first recorded on March 3, 2023.
Watch the video of this episode on PeerTube.

References:
Social Science Research Network paper “written” by ChatGPT

Joe Wanzala, “ChatGPT is ideal for eDiscovery”

Legal applications for ChatGPT:
Shot: GPT-4 'could pass the. bar exam'
Chaser: ChatGPT had bigger dreams.

"AI for law"

“AI can legally run a company”

Wired: Generative AI Is Coming for the Lawyers

“This is a decision by a Colombian court in Cartagena (dated January, 30, 2023).
As far as we know, it is the first time that a judicial decision has been taken by explicitly resorting to #ChatGPT @sama @OpenAI. The Court poses a series of specific questions to #ChatGPT"

"Don't Be A Lawyer" song from "Crazy Ex-Girlfriend"

Rep. Ted Lieu introduces legislation written by an LLM

DoNotPay offers money to anyone willing to use their AI to argue in court

Fresh AI Hell:
Vanderbilt University responds to MSU shooting with e-mail written using ChatGPT

Science fiction magazine closes submissions due to LLM spam

The 1st International Workshop on Implicit Author Characterization from Texts for Search and Retrieval (IACT’23)

Check out future streams at on Twitch, Meanwhile, send us any AI Hell you see.
Our book, 'The AI Con,' comes out in May! Pre-order now.
Subscribe to our newsletter via Buttondown.

Bluesky: emilymbender.bsky.social
Mastodon: dair-community.social/@EmilyMBender

Alex

Music by Toby Menon.
Artwork by Naomi Pleasure-Park.
Production by Christie Taylor.

References:
Social Science Research Network paper “written” by ChatGPT

Joe Wanzala, “ChatGPT is ideal for eDiscovery”

Legal applications for ChatGPT:
Shot: GPT-4 'could pass the. bar exam'
Chaser: ChatGPT had bigger dreams.

"AI for law"

“AI can legally run a company”

Wired: Generative AI Is Coming for the Lawyers

"Don't Be A Lawyer" song from "Crazy Ex-Girlfriend"

Rep. Ted Lieu introduces legislation written by an LLM

DoNotPay offers money to anyone willing to use their AI to argue in court

Fresh AI Hell:
Vanderbilt University responds to MSU shooting with e-mail written using ChatGPT

Science fiction magazine closes submissions due to LLM spam

The 1st International Workshop on Implicit Author Characterization from Texts for Search and Retrieval (IACT’23)

Check out future streams at on Twitch, Meanwhile, send us any AI Hell you see.
Our book, 'The AI Con,' comes out in May! Pre-order now.
Subscribe to our newsletter via Buttondown.

Bluesky: emilymbender.bsky.social
Mastodon: dair-community.social/@EmilyMBender

Alex

Music by Toby Menon.
Artwork by Naomi Pleasure-Park.
Production by Christie Taylor.

Previous Episode

Episode 9: Call the AI Quack Doctor, February 17, 2023

Should the mathy-maths be telling doctors what might be wrong with you? And can they actually help train medical professionals to treat human patients? Alex and Emily discuss the not-so-real medical and healthcare applications of ChatGPT and other large language models.
Plus another round of fresh AI hell, featuring "charisma as a service," and other assorted reasons to tear your hair out.
This episode was first recorded on February 17th of 2023.
Watch the video of this episode on PeerTube.

References:
Glass.ai makes “diagnosis machine”:
https://twitter.com/AiBreakfast/status/1620128621821317125?t=Q6tTAOcGAoFJ3Ko9m4EC9g&s=19

Percy Liang claims 'PubMedGPT' can pass medical exams:
https://crfm.stanford.edu/2022/12/15/pubmedgpt.html
https://twitter.com/percyliang/status/1603469265583353856?s=20&t=SdWeINzUw92pbkTO8OAVqQ

Emily's reaction to the above:
https://twitter.com/emilymbender/status/1603766381807570944?s=20&t=SdWeINzUw92pbkTO8OAVqQ

ChatGPT gets 60 percent of questions right in US Medical Licensing Exam:
https://healthitanalytics.com/news/chatgpt-passes-us-medical-licensing-exam-without-clinician-input

An Apple Watch error is clogging up 911 lines:
https://www.nytimes.com/2023/02/03/health/apple-watch-911-emergency-call.html

ChatGPT-assisted diagnosis: Is the future suddenly here?
https://www.statnews.com/2023/02/13/chatgpt-assisted-diagnosis/

NVIDIA “eye contact” demo:
https://twitter.com/Jousefm2/status/1616878021280993284

“Theory of the mind":
https://twitter.com/LChoshen/status/1623575423652139015?t=Ohc9tzB09pAEddAReLc6mA&s=09

Check out future streams at on Twitch, Meanwhile, send us any AI Hell you see.
Our book, 'The AI Con,' comes out in May! Pre-order now.
Subscribe to our newsletter via Buttondown.

Bluesky: emilymbender.bsky.social
Mastodon: dair-community.social/@EmilyMBender

Alex

Music by Toby Menon.
Artwork by Naomi Pleasure-Park.
Production by Christie Taylor.

Next Episode

Episode 11: A GPT-4 Fanfiction Novella, April 7 2023

After a hype-y few weeks of AI happenings, Alex and Emily shovel the BS on GPT-4’s “system card,” its alleged “sparks of Artificial General Intelligence,” and a criti-hype heavy "AI pause" letter. Hint: for a good time, check the citations.

This episode originally aired on Friday, April 7, 2023.
You can also watch the video of this episode on PeerTube.

References:

GPT-4 system card: https://cdn.openai.com/papers/gpt-4-system-card.pdf
“Sparks of AGI” hype: https://twitter.com/SebastienBubeck/status/1638704164770332674
And the preprint from Bubeck et al.: https://arxiv.org/abs/2303.12712

“Pause AI” letter: https://futureoflife.org/open-letter/pause-giant-ai-experiments/

The “Sparks” paper points to this 1997 editorial in their definition of “intelligence”:
https://www1.udel.edu/educ/gottfredson/reprints/1997mainstream.pdf

Radiolab's miniseries, 'G': https://radiolab.org/series/radiolab-presents-g

Baria and Cross, "The brain is a computer is a brain.": https://arxiv.org/abs/2107.14042

Senator Chris Murphy buys the hype:
https://twitter.com/ChrisMurphyCT/status/1640186536825061376

Generative “AI” is making “police sketches”:
https://twitter.com/Wolven/status/1624299508371804161?t=DXyucCPYPAKNn8TtAo0xeg&s=19

More mathy math in policing:
https://www.cbsnews.com/colorado/news/aurora-police-new-ai-system-bodycam-footage/?utm_source=dlvr.it&utm_medium=twitter

User Research without the Users:
https://twitter.com/schock/status/1643392611560878086

DoNotPay is here to cancel your gym membership:
https://twitter.com/BrianBrackeen/status/1644193519496511488?s=20

Check out future streams at on Twitch, Meanwhile, send us any AI Hell you see.
Our book, 'The AI Con,' comes out in May! Pre-order now.
Subscribe to our newsletter via Buttondown.

Bluesky: emilymbender.bsky.social
Mastodon: dair-community.social/@EmilyMBender

Alex

Music by Toby Menon.
Artwork by Naomi Pleasure-Park.
Production by Christie Taylor.

Mystery AI Hype Theater 3000 - Episode 10: Don't Be A Lawyer, ChatGPT. March 3, 2023

Transcript

ALEX: Welcome everyone!...to Mystery AI Hype Theater 3000, where we seek catharsis in this age of AI hype! We find the worst of it and pop it with the sharpest needles we can find.

EMILY: Along the way, we learn to always read the footnotes. And each time we think we’ve reached peak AI hype -- the summit of bullshit mountain -- we discover there’s worse to come.

I’m Emily M. Bender, a professor of linguistics at the University of Washington.

ALEX: And I’m Alex Hanna,