Explainable Ceramic-Form Classification and Visual Retrieval of Chinese Ceramic Cultural Heritage Using DINOv2 and Morphological Feature Fusion

Résumé fourni par la source

The continued digitization of open museum collections provides new opportunities for the intelligent organization and visual discovery of cultural heritage. However, morphological similarity between ceramic forms, intra-class variation, and changing photographic conditions remain challenges for automated classification, model interpretation, and similar-object retrieval. This study uses 3305 Chinese ceramic objects from the open collection of The Metropolitan Museum of Art (The Met) to develop an explainable and traceable workflow for ceramic-form classification and visual retrieval. Museum metadata were standardized into 13 form categories, from which 2755 objects were used to establish a seven-class primary classification task. Explicit morphological features, handcrafted visual features, ResNet50 representations, DINOv2 representations, and morphology–deep feature fusion were evaluated under a unified data split and evaluation protocol. Explainable artificial intelligence (XAI) methods were further used to examine spatial model responses and feature attributions of explicit morphological variables, while different representations were evaluated for content-based visual retrieval. The results show that deep visual representations effectively support ceramic-form classification, with DINOv2 demonstrating comparatively stable performance across multiple random seeds. Morphology–deep feature fusion did not provide a consistent classification advantage over DINOv2-only, but the fused representation showed clearer complementary value in visual retrieval, achieving the highest Precision@5 (0.819) and mean average precision at 10 (mAP@10; 0.773). XAI analyses further indicated that structurally meaningful spatial responses and explicit geometric descriptors contributed to form discrimination. By linking classification, interpretation, and retrieval outputs to Object IDs and original collection records, the proposed workflow provides a practical computational approach for ceramic-form organization, similar-object discovery, and traceable visual retrieval in digital museum collections.