GEMTELLIGENCE: Accelerating gemstone classification with deep learning

Abstract The value of luxury goods, particularly investment-grade gemstones, is influenced by their origin and authenticity, often resulting in differences worth millions of dollars. Traditional methods for determining gemstone origin and detecting treatments involve subjective visual inspections and a range of advanced analytical techniques. However, these approaches can be time-consuming, prone to inconsistencies, and lack automation. Here, we propose GEMTELLIGENCE, a novel deep learning approach enabling streamlined and consistent origin determination of gemstone origin and detection of treatments. GEMTELLIGENCE leverages convolutional and attention-based neural networks that combine the multi-modal heterogeneous data collected from multiple instruments. The algorithm attains predictive performance comparable to expensive laser-ablation inductively-coupled-plasma mass-spectrometry analysis and expert visual examination, while using input data from relatively inexpensive analytical methods. Our methodology represents an advancement in gemstone analysis, greatly enhancing automation and robustness throughout the analytical process pipeline.