There’s a new AI that can tell you an animal’s whole lifestyle and what it looks like just by listening to it make a sound.
March 24, 2026
Original Paper
AnimalCLAP: Taxonomy-Aware Language-Audio Pretraining for Species Recognition and Trait Inference
arXiv · 2603.22053
The Takeaway
By training on thousands of hours of audio, the model learned to decode 'biological signatures' hidden in animal sounds. It can hear a bird's chirp and correctly estimate its body size and habitat, showing that an animal's voice effectively encodes its entire life history and biology.
From the abstract
Animal vocalizations provide crucial insights for wildlife assessment, particularly in complex environments such as forests, aiding species identification and ecological monitoring. Recent advances in deep learning have enabled automatic species classification from their vocalizations. However, classifying species unseen during training remains challenging. To address this limitation, we introduce AnimalCLAP, a taxonomy-aware language-audio framework comprising a new dataset and model that incor