DH 2026

Daejeon, July 27–31

Wed, July 2916:30–18:00S048106
Short Paper

artresearch.net: Multimodal, Cross-archive Visual Search for Art History

Stefanie Schneider
Marburg University, Germany · stefanie.schneider@uni-marburg.de

Introduction

artresearch.net is the open research platform of the PHAROS consortium, designed to enable multimodal, cross-archive searches of art-historical photographs.

https://artresearch.net/, last accessed 26 April 2026.

Although many photo archives have digitized significant portions of their collections,

One example is the Arbeitsgemeinschaft kunsthistorischer Bildarchive und Fototheken (AKBF), founded in 2004, which is an association of image archives from German research and cultural institutions.

scholars conducting transnational, trans-institutional, or diachronic research questions still confront fragmented access and inconsistent description practices across portals. In this abstract, we argue that artresearch.net addresses this structural limitation by integrating photographic reproductions and their associated documentation from multiple institutions into a single, interoperable environment, and by providing multimodal retrieval methods that support both targeted lookup and exploratory discovery. Since its launch on November 3, 2025, early usage has underscored the demand for a shared research interface that enables comparative work across collections.

In November 2025, the platform attracted 12,065 unique visitors, 13,380 total visits, and 50,269 page views.

Background

PHAROS is an international consortium of 12 art-historical photo archives based in North America and Europe.

For the list of partner institutions, see https://artresearch.net/resource/Partners (last accessed 26 April 2026).

It emerged in 2013 from a shared recognition among leading international photo archives—such as the Frick Art Research Library

https://www.frick.org/library, last accessed 26 April 2026.

—that decades of art-historical photographic documentation were at risk of becoming inaccessible to new generations of scholars (Caraffa et al. 2020). These institutions, whose photographic holdings had long shaped the development of art history as a discipline, joined forces to address the necessity for consolidated digital access, and for more standardized approaches to the description, interoperability, and long-term stewardship of photo-archive metadata. In doing so, PHAROS recognizes photo archives not merely as repositories of reproductions—which frequently preserve visual evidence of artworks now lost, altered, or displaced – but as critical research laboratories in their own right.

Platform

artresearch.net provides unified access to the photographic collections and scholarly documentation held by PHAROS member institutions. The following sections outline the scope of the aggregated data and the technical infrastructure that underpins the platform, with particular attention to its multimodal search capacities.

(a)(b)

Figure 1. Frontend of artresearch.net. (a) The search view presents the results, accompanied by a faceted search panel. (b) The record view displays the image and its associated metadata, with each field attributed to the providing institution.

Corpus and Coverage

Although the individual member institutions differ in their collection profiles, documentation practices, and research priorities, the knowledge contained within their databases is fundamentally complementary: each archive engages, in its own way, with the same core entities—artworks, their photographic reproductions, and the scholarly contexts that surround them. To render this shared knowledge interoperable, data are ingested from a wide range of source formats, transformed into a shared data model, and—where necessary—reconciled against external authority vocabularies such as the Art & Architecture Thesaurus (AAT).

For a discussion of common usability challenges in entity reconciliation workflows, see Daquino / Kozlov / Mambelli (2026).

As of December 2025, the artresearch.net platform offers access to 2,260,131 photographs documenting 1,532,733 artworks, contributed by seven photo archives (Table 1). Additional collections are being integrated on an ongoing basis, with the long-term prospect of providing access to up to 31 million photographs. A core design principle is fine-grained provenance: for each metadata field in a record, the contributing institution is explicitly identified by a provider icon and a direct link to the original source record (Figure 1b).

InstitutionPhotographsArtworks
Bibliotheca Hertziana348,251273,704
Bildarchiv Foto Marburg769,375402,763
Fondazione Federico Zeri153,09885,616
Frick Art Research Library366,370259,923
Kunsthistorisches Institut in Florenz94,629131,219
RKD (Netherlands Institute for Art History)423,200301,628
Warburg Institute105,208105,208

Table 1. Descriptive statistics of the data provided in artresearch.net by PHAROS member institutions.

System Architecture

artresearch.net is built on ResearchSpace, an open-source semantic research environment originally developed by the British Museum. It leverages Linked Open Data (LOD) technologies to move toward more dynamic and context-rich modes of information discovery (Oldman / Tanase / Santschi 2019). Within artresearch.net, data are published in accordance with the CIDOC Conceptual Reference Model (CRM) ontology. Collections are transformed into RDF and made queryable through SPARQL endpoints, with RDF stored in a Blazegraph triplestore; an IIIF-compliant image server ensures the delivery of high-resolution images.

For further technical details, see Klic (2022).

The platform is released under the GPLv3 license and maintained on GitHub.

https://github.com/artresearch, last accessed 26 April 2026.

Multimodal Search

artresearch.net supports a wide range of scholarly practices—from locating specific artworks to uncovering previously unrecognized visual relationships across heterogeneous collections. To accommodate this diversity, the platform combines text-based and image-based search. Text Match identifies records in which query terms appear verbatim within metadata fields such as titles or artist names. Textual Similarity enables concept-driven and multilingual exploration by embedding textual metadata in a shared vector space. Extending this approach across modalities, Visual Similarity translates textual queries into visual embeddings, allowing users to retrieve artworks corresponding to described compositional, stylistic, or aesthetic features. Image-based search likewise distinguishes between exact and similarity-based modes. Visual Match detects near-identical reproductions by comparing digital fingerprints of images, supporting tasks such as cross-archive reconciliation. Visual Similarity retrieves artworks related to a given image in terms of style, palette, composition, or subject matter, enabling the identification of broader visual affinities rather than direct copies. Textual metadata are embedded using the Qwen3 model with 8 billion parameters (Yang et al. 2025). Cross-modal and image-based search rely on the NaFlex variant of the SigLIP 2 model with 400 million parameters (Tschannen et al. 2025). For near-exact image retrieval, similarity rankings are refined using RootSIFT feature matching (Arandjelovic / Zisserman 2012) with geometric verification via MAGSAC (Barath / Matas / Noskova 2019). To support interpretability, search results are labeled with indicators denoting the retrieval strategies employed (i.e., Text Match, Textual Similarity, Visual Match, or Visual Similarity), with records satisfying multiple criteria being prioritized in the ranking (Figure 1a).

See also https://artresearch.net/resource/search-help (last accessed 26 April 2026).

In practice, this design supports two workflows: (1) tracing changes in artworks over time by comparing variant photographs across institutions, and (2) reconstructing an object within their historical, material, and documentary contexts.

Future Research

Beyond retrieval, artresearch.net treats representation as a first-class research problem. Because the holdings of current PHAROS members are largely oriented towards European and North American cultural heritage, expanding this geographical and cultural scope—especially through engagement with photo archives focusing on non-Western art—is a central objective of the consortium. In parallel, artresearch.net intends to make structural biases analytically tractable by documenting collection histories, exposing asymmetries in representation, and developing tools that allow scholars to examine patterns of exclusion across collections. Concretely, this includes revealing coverage through facets (e.g., geography or period) and making unknown descriptive patterns visible for interpretation rather than treating them as noise. By doing so, artresearch.net contributes an infrastructure for multimodal, cross-archive research at a scale and granularity that is difficult to achieve through institutional portals.

Acknowledgements

artresearch.net was funded by the Samuel H. Kress Foundation, the Andrew W. Mellon Foundation, the Bibliotheca Hertziana, and the National Endowment for the Humanities.

References
  1. Arandjelovic, Relja / Zisserman, Andrew (2012): “Three Things Everyone Should Know to Improve Object Retrieval”, in: 2012 IEEE Conference on Computer Vision and Pattern Recognition. IEEE Computer Society: 2911–2918. DOI: 10.1109/CVPR.2012.6248018.
  2. Barath, Daniel / Matas, Jiri / Noskova, Jana (2019): “MAGSAC: Marginalizing Sample Consensus”, in: IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2019. Computer Vision Foundation / IEEE: 10197–10205. DOI: 10.1109/CVPR.2019.01044.
  3. Caraffa, Costanza / Pugh, Emily / Stuber, Tracy / Wood Ruby, Louisa (2020): “PHAROS: A Digital Research Space for Photo Archives”, in: Art Libraries Journal 45, 1: 2–11. DOI: 10.1017/alj.2019.34.
  4. Daquino, Marilena / Kozlov, Artem / Mambelli, Francesca (2026): “Many-to-many: Usability Challenges of Entity Reconciliation in Art History and Photographic Studies”, in: Journal of Documentation. Forthcoming.
  5. Klic, Lukas (2022): “Linked Open Images: Visual Similarity for the Semantic Web”, in: Semantic Web: Interoperability, Usability, Applicability 14, 2: 197–208. DOI: 10.3233/SW-212893.
  6. Oldman, Dominic / Tanase, Diana / Santschi, Stephanie (2019): “The Problem of Distance in Digital Art History: A ResearchSpace Case Study on Sequencing Hokusai Print Impressions to Form a Human Curated Network of Knowledge”, in: International Journal for Digital Art History 4: 5.29–5.45. DOI: 10.11588/dah.2019.4.72071.
  7. Tschannen, Michael / Gritsenko, Alexey A. / Wang, Xiao / Naeem, Muhammad Ferjad / Alabdulmohsin, Ibrahim / Parthasarathy, Nikhil / Evans, Talfan / Beyer, Lucas / Xia, Ye / Mustafa, Basil / Hénaff, Olivier J. / Harmsen, Jeremiah / Steiner, Andreas / Zhai, Xiaohua (2025): “SigLIP 2: Multilingual Vision-Language Encoders with Improved Semantic Understanding, Localization, and Dense Features”. arXiv:2502.14786.
  8. Yang, An / Li, Anfeng / Yang, Baosong / Zhang, Beichen / Hui, Binyuan / Zheng, Bo / Yu, Bowen / Gao, Chang / Huang, Chengen / Lv, Chenxu / Zheng, Chujie / Liu, Dayiheng / Zhou, Fan / Huang, Fei / Hu, Feng / Ge, Hao / Wei, Haoran / Lin, Huan / Tang, Jialong / Yang, Jian / Tu, Jianhong / Zhang, Jianwei / Yang, Jiaxi / Zhou, Jingren / Lin, Junyang / Dang, Kai / Bao, Keqin / Yang, Kexin / Yu, Le / Deng, Lianghao / Li, Mei / Xue, Mingfeng / Li, Mingze / Zhang, Pei / Wang, Peng / Zhu, Qin / Men, Rui / Gao, Ruize / Liu, Shixuan / Luo, Shuang / Li, Tianhao / Tang, Tianyi / Yin, Wenbiao / Ren, Xingzhang / Wang, Xinyu / Zhang, Xinyu / Ren, Xuancheng / Fan, Yang / Su, Yang / Zhang, Yichang / Zhang, Yinger / Wan, Yu / Liu, Yuqiong / Wang, Zekun / Cui, Zeyu / Zhang, Zhenru / Zhou, Zhipeng / Qiu, Zihan (2025): “Qwen3 Technical Report”. arXiv:2505.09388.