How AI is decoding whale communication : Short Wave Scientists are testing the limits of artificial intelligence when it comes to language learning. One recent challenge? Learning ... whale! Researchers are using machine learning to analyze and decode whale sounds — and it's just as complicated as it seems.

Curious about other mysteries of nature? Email us at shortwave@npr.org.

Sperm whale families talk a lot. Researchers are trying to decode what they're saying

  • Download
  • <iframe src="https://www.npr.org/player/embed/1198910024/1252241213" width="100%" height="290" frameborder="0" scrolling="no" title="NPR embedded audio player">
  • Transcript

EMILY KWONG, BYLINE: You're listening to SHORT WAVE...

(SOUNDBITE OF MUSIC)

KWONG: ...From NPR.

REGINA BARBER, HOST:

Hey, SHORT WAVErs. Regina Barber here. So when I think about whale songs, I think this.

(SOUNDBITE OF WHALE VOCALIZING)

BARBER: But not this.

(SOUNDBITE OF SPERM WHALE CLICKS)

BARBER: That's a family of sperm whales. Here today to tell us more about this whale conversation is NPR's climate correspondent, Lauren Sommer. Hey, Lauren. Welcome back.

LAUREN SOMMER, BYLINE: Hey, Gina.

BARBER: So, Lauren, I'm not going to lie - this whale chatter kind of sounds like bike spokes to me.

SOMMER: (Laughter) Yeah, I kind of get, like, Morse code combined with microwave popcorn.

BARBER: Microwave popcorn. I need to eat lunch.

SOMMER: (Laughter).

BARBER: OK, so hearing these sounds makes me wonder, like, are these whales really talking to each other? And, like, what are they saying?

SOMMER: Yeah, what is happening there? You're not alone in wondering that. It's kind of this age-old question, like, what are animals saying?

BARBER: Right, of course.

SOMMER: Yeah, and especially whales because sperm whales have big brains. They have close family groups, and they coordinate a lot. They dive together. They hunt together. They even babysit for each other.

BARBER: Aww.

SOMMER: Shane Gero, who is a sperm whale biologist who has spent years with these whales - he says he sees that kind of family dynamic all the time.

SHANE GERO: It's hard not to see cousins playing while chatting, to not see moms hand over to a babysitter and exchange a few words before sort of walking out the door, so to speak, to go eat in the deep ocean.

BARBER: Oh, my gosh. I can relate to this a lot as, like, the older-cousin babysitter and as a mom. But as someone who has listened to, like, a lot of audio, these sounds sound pretty complicated to decode. They have so many clicks.

SOMMER: Yeah, it sounds pretty messy. It's not easy for us to figure out, but that's where computers are coming in. Researchers are hoping artificial intelligence could tease out what the whales are saying, and as a first step, they figured out a sort of sperm whale alphabet.

BARBER: Ooh, OK - an alphabet? So I'm - this is starting to sound like a language.

SOMMER: Language. OK, that's the tricky word here. It's kind of a tough question. There's been a very heated debate for years about whether animals can have language or whether that's something special that only we humans can claim.

(SOUNDBITE OF MUSIC)

BARBER: So today on the show, how technology is helping us figure out the mysteries of animal communication - and if we could figure out what sperm whales are saying, should we try to talk to them? I'm Regina Barber and you're listening to SHORT WAVE, the science podcast from NPR.

(SOUNDBITE OF MUSIC)

BARBER: So, Lauren, sperm whales are somewhat famous for being, like, in "Moby Dick," but what are their lives actually like?

SOMMER: Yeah, so sperm whales are diverse.

(SOUNDBITE OF MUSIC)

SOMMER: They're the size of a school bus.

BARBER: Wow.

SOMMER: They kind of have, you know, those big foreheads, - you know, for lack of a better term, foreheads - and they spend most of their time diving in the deep ocean, searching for their favorite food, which is squid.

BARBER: Me too.

SOMMER: They can go thousands of feet below the surface, and so Shane told me they are in the dark a lot.

GERO: So sound is everything to sperm whales. In the darks of the deep ocean, these are places where sunlight never gets to, so they navigate their world through sound. Just like bats in the dark sky, they use echolocation...

(SOUNDBITE OF MUSIC)

GERO: ...And they use sound to stay in touch with one another and coordinate with the families in which they live.

BARBER: Wow. Yeah, it's also just hard to see underwater - right? - in general, so I can see how sound would rule almost, like, everything.

SOMMER: Yeah, and they live in these tight-knit groups. They're female-led, so there's grandmothers, mothers and daughters. They all stay together their entire lives. The males get to hang out until they're adolescents, and then they have to leave to head out on their own.

BARBER: Well, I totally would love watching, like, these whales' family dynamics.

SOMMER: Right, yeah, 'cause they live a long time, and Shane studies these whales in the Caribbean with the Dominica Sperm Whale Project. He knows these families, and they vocalize a lot. They have long exchanges with each other.

(SOUNDBITE OF SPERM WHALE CLICKS)

GERO: It's not rude in sperm whale society to talk at the same time and overlap one another.

BARBER: It sounds like an extended family, like, loud summer barbecue.

SOMMER: Yeah, a lot going on. It sounds kind of messy, but actually, all those clicks can be broken up into patterns of clicks, and they're ones that the whales use over and over. They're called codas.

GERO: One that's really common in the Caribbean is the one plus one plus three coda, which sounds like this.

(SOUNDBITE OF SPERM WHALE CLICKS)

GERO: You know, one plus one plus three.

BARBER: Sounds like a salsa dance.

SOMMER: Yeah, it's cha cha cha.

BARBER: Yes, cha, cha, cha cha cha.

SOMMER: Cha, cha, cha cha cha.

(SOUNDBITE OF SPERM WHALE CLICKS)

BARBER: Yeah, so what sounds like a whole bunch of, like, clicking is actually, like, these discrete units, these discrete chunks.

SOMMER: Yeah, all sort of strung together. And family groups can have dozens of these different codas. They all have a different number of clicks or a different pattern of clicks.

(SOUNDBITE OF SPERM WHALE CLICKS)

BARBER: Wow.

SOMMER: And researchers like Shane, you know, they've been recording these for years 'cause they've been trying to tease out the patterns and how the whales use them. And more recently, they teamed up with artificial intelligence researchers in a collaboration called Project CETI.

(SOUNDBITE OF MUSIC)

SOMMER: And their goal, using that technology, is to decode what the whales are saying.

(SOUNDBITE OF MUSIC)

BARBER: So AI has been learning human languages, and researchers are trying to, like, test the limits of what it could do, but learning whale seems really complicated.

SOMMER: For sure, yes. (Laughter) You know, they kind of took this first step where they used machine learning to analyze more than 9,000 recordings of sperm whales.

BARBER: Wow.

SOMMER: And Daniela Rus, who directs MIT's Computer Science and Artificial Intelligence Laboratory - she told me it was key to use computers because it could find clicks that humans couldn't find on their own.

DANIELA RUS: It really turned out that sperm whale communication was indeed not random or simplistic but rather structured in a very complex, combinatorial manner.

SOMMER: They found far more variation than researchers thought there was. Like, Shane says sometimes, it's the same coda, the same set of clicks, but they make it slightly longer.

GERO: So that one plus one plus three coda we talked about might be half a second long, or it might be 1.3 seconds long - nearly three times as long, right? And the same whale will make short ones and long ones, and different families will make short ones and long ones.

SOMMER: Which kind of sounds like this.

(SOUNDBITE OF SPERM WHALE CLICKS)

BARBER: That's subtle, right?

SOMMER: Yeah, to us humans, but whales actually pick up on these differences, and they even repeat them back to each other. So, you know, sometimes it's the tempo of the clicks that's different. Sometimes, the whales throw in an extra click at the end of the coda, Daniela says.

RUS: And this was very interesting. We started wondering, is this extra click sort of like the end of a sentence or something else?

SOMMER: In doing this analysis, they identified what they're calling the sperm whale phonetic alphabet...

(SOUNDBITE OF MUSIC)

SOMMER: ...Which catalogs all these variations.

BARBER: It's actually making me think, like, what if there's slang...

(LAUGHTER)

BARBER: ...With, like, the different family members? OK. If we're using, like, the word alphabet - that, again, makes me think of language - like, are all these different codas different words? Are they, like, parts of words, you know, like the sounds that make up an alphabet?

SOMMER: Right, and that's what's hard to figure out because the thing that researchers say is exciting is that these codas don't seem to be random.

RUS: They can be predicted by machine learning, in the same way in which you might predict the sequence of syllables or the sequence of words in a sentence.

SOMMER: She's saying there could be a possibility of recombining these codas to make meaning, and that's something we do as humans in language, right? We take sounds that don't really mean anything on their own, like short, right? SH-ORT becomes short, and we combine it to make something that has meaning.

BARBER: OK, but, like, just because you understand, like, the rhythm of the clicks doesn't mean you might understand, like, what they mean, so could scientists understand what the sperm whales mean? Like, how could they prove sperm whales are conveying complex things like language?

SOMMER: Yeah, that's really hard to do. Shane says they're working on recording sperm whales and observing their behavior at the same time to kind of build up a dataset, but, you know, it's kind of hard to know if you're capturing their world and what's important to a sperm whale in that moment.

GERO: If we only ever studied North American English-speaking society in the dentist's office, first of all, we'd walk away with the fact that the key part of their communication system is the word root canal, right? And we'd just be wrong because we didn't have a comprehensive picture.

BARBER: Yeah, I mean, that's a really good point, and those are two words in a dentist office I'm really actually scared of.

SOMMER: Yes, very much so, and it kind of just shows, like, we're used to looking at things in a very human-centric way. And people have been debating this animal-language question for a really long time.

(SOUNDBITE OF MUSIC)

SOMMER: It goes back, you know, 1970s. Researchers were teaching chimps and gorillas sign language, you might remember.

BARBER: Right, I remember, yeah.

SOMMER: Yeah, and the question was whether they were copying us or really using language the way we do, and there's a lot of other examples. Like, bees - you know, they do that special waggle dance in a hive. It tells other bees, like, how far are the flowers and what direction they are. And I talked to Taylor Hersh about this. She's a researcher at the Marine Mammal Institute at Oregon State University, and she studies sperm whales.

TAYLOR HERSH: Some of what they're doing may be totally different from our way of communicating, and we're probably never going to be able to fully grasp those differences. So I think there is value in seeing if patterns in animal communication mirror patterns in human language, but I think it's important to remember that perhaps just because we don't find evidence of something doesn't mean that that system isn't complex in ways that we don't understand.

BARBER: Right. Like, can our human brains comprehend whatever system these sperm whales have worked out for themselves? Like, it actually makes me think of, like, "Arrival," that film.

SOMMER: Oh, yeah.

BARBER: But all we really know is how our own language works, right? And that's, I guess, where we start.

SOMMER: Yeah, and researchers like Shane - he agreed that looking for those similarities is valuable.

GERO: You know, when we can talk about whales and how important their grandmothers are or how important being a good neighbor is or learning from different cultures is and the importance of cultural diversity in society, that really sort of resonates with people and can drive change in human behavior (laughter), in order to sort of protect the whales.

SOMMER: And, you know, sperm whales are still coming back from commercial whaling, where their numbers were just decimated. Today, they face threats like ship strikes and plastics in the ocean, so Shane said it's important to appreciate what they share with us because we have such a big impact on their world.

BARBER: So if artificial intelligence figures out sperm whale language, what's the next step? Like, are researchers hoping to talk to them?

SOMMER: Yeah, it's kind of an ethical question, right?

BARBER: OK.

SOMMER: Like, do you play some sounds back to sperm whales to try to say something to them? What does that do to them, especially if we don't really know exactly what we're saying to them?

BARBER: Right. Like, are we going to scare them? Like, I would be a little worried. And do we want to, like, hear what they say back to us, like, humans? They might not like us (laughter).

SOMMER: Yeah, we don't have a great track record (laughter).

BARBER: Right.

SOMMER: And, you know, everyone I talked to in reporting this - all these researchers told me they get asked a lot of what they would want to say to sperm whales. And Taylor told me, you know, she's not, like, raring to go on this.

HERSH: There's this implicit, like, do I have the right? What gives me the right to say anything to them?

SOMMER: I mean, sperm whales have been communicating with each other a lot longer than humans have, right?

BARBER: Wow.

SOMMER: They've been doing it before humans had language, so clearly, they've got it figured out on their own.

BARBER: Wow. Lauren, thank you so much for communicating all of this to all of us. Thank you so much.

SOMMER: Yeah, thanks.

(SOUNDBITE OF MUSIC)

BARBER: Before we head out, a quick shout out to our SHORT WAVE+ listeners. We appreciate you, and we thank you for being a subscriber. SHORT WAVE+ helps support our show, and if you're a regular listener, we'd love for you to join so you can enjoy the show without sponsor interruptions. Find out more at plus.npr.org/shortwave.

(SOUNDBITE OF MUSIC)

BARBER: This episode was produced by Rachel Carlson and edited by our showrunner, Rebecca Ramirez. Lauren checked the facts. Patrick Murray and Stacey Abbott were the audio engineers. Beth Donovan is our senior director, and Collin Campbell is our senior vice president of podcasting strategy. I'm Regina Barber. Thanks, as always, for listening to SHORT WAVE, the science podcast from NPR.

(SOUNDBITE OF MUSIC)

Copyright © 2024 NPR. All rights reserved. Visit our website terms of use and permissions pages at www.npr.org for further information.

NPR transcripts are created on a rush deadline by an NPR contractor. This text may not be in its final form and may be updated or revised in the future. Accuracy and availability may vary. The authoritative record of NPR’s programming is the audio record.