There's black gold to be found on Dutch beaches: ancient fossils. But determining what you have found is no easy task. Researchers from Naturalis and other institutions have trained artificial intelligence to recognize fossils. Sometimes AI even outperforms professional experts, if the photos are good enough.
Thousandsof finds
Large numbers of fossils and archaeological finds are discovered on Dutch beaches and in the North Sea, particularly at the Zandmotor and the Maasvlakte. Many of these are spotted by enthusiastic amateur beachcombers or citizen scientists. They take a photo and upload it to platforms like Oervondstchecker.nl to learn what they have in their hands. However, identifying all those thousands of finds takes experts a lot of time.
AI forfossils
To lend experts a hand, researchers developed smart computer models (so-called convolutional neural networks, or CNNs). Naturalis has extensive experience with this technology: the institute aims to recognize all species and has spent years building recognition software for applications like the ObsIdentify app and the ARISE species recognition platform. Citizen scientists also collaborated on the study, alongside experts from institutions such as the National Museum of Antiquities and the Natural History Museum Rotterdam.
More than100,000 photos
The fossil AI systems were fed two massive datasets of images: over 46,000 standardized photos from museum and private collections, plus an additional 74,000 real-world photos uploaded by the public to Oervondstchecker.nl. The researchers then had both the trained AI models and ten human experts evaluate the exact same series of fossils.
Better thanthe experts?
The study revealed surprising results. When tested on clean, professional museum photos, the computer sometimes scored better and more accurately than human experts! Real-world photos, however, proved much trickier. A blurry photo taken on a beach towel with harsh shadows makes it significantly harder for a computer to discern key features.
Quality is essential
Furthermore, researchers discovered that human experts surprisingly often disagreed among themselves on the exact species a fossil belonged to. When human experts hesitate, the AI receives uncertain training data as well. "We see that data quality is essential—both the photos themselves and the identifications. It’s cool to see that with good data, AI can offer real added value," says Isaak Eijkelboom, an expert himself who hopes to complete his PhD research on digital fossil recognition soon.
Dreamteam
Does the rise of digital recognition mean fossil experts will soon be obsolete? Far from it! The researchers advocate for a "dream team" combining humans and AI. The computer can automatically recognize thousands of everyday finds at lightning speed, leaving experts with more time to focus on rare, complex, or unique discoveries. Anyone can now benefit from this research: the AI models have been made public. This makes the quest into our prehistoric past not only faster, but also much more accessible to everyone.
What's next?
Isaak Eijkelboom
For Eijkelboom, his work is nearly finished: his PhD defense is approaching, and the chapter on his AI was published this month in the journal PeerJ Computer Science.
Together with colleagues from the National Museum of Antiquities, he hopes to apply the models to archaeological finds as well—more on that later.
Moreinformation
- The models are available here. There are two models: one determines the element type (thigh bone or lower jaw?), and another judges the species (mammoth or deer?).
- Learn more about Naturalis work on AI here.
- Found something on the beach yourself and can't figure it out even with the AI? You can upload your find to Oervondstchecker, or email Natuurvraag@naturalis.nl.