Using motion capture tech to make TV shows for deaf children

You can read a transcript for this episode here.

Think back to your favorite childhood TV show—was it “Blue’s Clues”? “Little Bear”? “Winnie the Pooh”? Animated TV shows are important for kids because they can teach them to read, draw, spell, and talk. Plus, the ways these shows tell stories and create colorful, fictitious worlds can broaden children’s knowledge and capacity to imagine.

But children’s shows aren’t accessible to all deaf children, which means they could miss out on a common learning experience. Among other things, that can set kids back in learning both American Sign Language (ASL) and English language skills during their formative early childhood years.

Melissa Malzkuhn is third-generation Deaf and the founder and director of the Motion Light Lab at Gallaudet University in Washington, D.C. Her lab is creating ASL-focused children’s media that is made by and for the Deaf community, using motion capture technology, avatars, animation, and signing storytellers. She talks with Science Friday guest host Arielle Duhaime-Ross about ASL access in childhood, the science of learning, and how she’s creating “Here Comes Mavo!”—the first animated TV series with signing characters.

Many thanks to Jennifer Vold for interpreting and to Jenna Beacom for consulting on this segment.

Editor’s note: Regarding capitalization for “Deaf” and “deaf,” we believe this is an unsettled issue. For about 30 years, it was common to use capitalization to denote cultural deafness. In recent years, some national deaf organizations, like the National Deaf Center, have decided to use lowercase in their messaging to be more inclusive. Some individuals, however, prefer the capitalized version. We ask our guests to self-describe and capitalize at their request, and use “deaf” for non-self-describing communities.

Universe of Art is hosted and produced by D. Peterschmidt, who also wrote the music. The original segment was produced by Rasha Aridi. Our show art was illustrated by Abelle Hayford. Support for Science Friday’s science and arts coverage comes from the Alfred P. Sloan Foundation.

Do you have science-inspired art you’d like to share with us for a future episode? Send us an email or a voice memo to [email protected].