DH 2026

Daejeon, July 27–31

Wed, July 2914:00–15:30S037206-208
Long Paper

Motivations for Visual Art and Design Representation on the Early Web: A Case Study of Narod.ru using LLMs

Anna Kozlova
European University at St. Petersburg, Russian Federation · annakozlova@eu.spb.ru
Ilias Aslanov
European University at St. Petersburg, Russian Federation · iaslanov@eu.spb.ru
Evgeny Kotelnikov
European University at St. Petersburg, Russian Federation · kotelnikov.ev@gmail.com

1. Introduction

This research is part of the Narod.ru and Digital Heritage project (Aslanov et al. 2025), which preserves and studies websites of Narod.ru – a free hosting service active from 2003 to 2013.

Narod.ru was a free web hosting service launched in 2000 and widely used in Russian‑speaking and post‑Soviet communities. It allowed users to create personal websites without technical skills, becoming a significant platform for early digital self‑expression, amateur art, fan sites, and grassroots publishing. Although based in Russia, it was used not only by Russian speakers but also in several other countries. The period of its greatest activity, as identified by the authors, was from 2003 to 2013. Its popularity declined after the service was sold in 2013 to a new owner and with the rise of social networks.

Narod.ru represents a distinctive form of digital heritage: it contains over 1 million early websites

The authors classify Narod.ru hosting as an early web phenomenon (Web 1.0), since its popularity and sociocultural role were formed in the period preceding the dominance of Web 2.0 ideology and mass social networks.

preserving artifacts of internet culture of that period. These sites are partly accessible online, but this heritage is fragile. The risk of losing digital heritage is described in UNESCO’s Charter on the Preservation of Digital Heritage

UNESCO. Charter on the Preservation of Digital Heritage. 15 October 2003. <https://www.unesco.org/en/legal-affairs/charter-preservation-digital-heritage> [10.12.2025].

and is illustrated by projects such as the Archive Team’s preservation of Geocities, which enabled research on digital folklore in the One Terabyte of Kilobyte Age project

One terabyte of kilobyte age, Tumblr. <https://oneterabyteofkilobyteage.tumblr.com> [10.12.2025].

. Scholars have recently called for more systematic approaches to preserving and analysing such born-digital heritage, noting that big data's complexity requires new methodological frameworks (Winters 2017).

A major initiative to rescue disappearing sites is the Wayback Machine (Internet Archive). However, for a sample of 10,000 Narod.ru sites it contains snapshots of only 71.3% of homepages and 22.3% of subpages. Therefore, one of the core goals of the Narod.ru and Digital Heritage project is to preserve websites comprehensively rather than rely on partial archival captures (Aslanov et al. 2025).

Beyond preservation, the project aims to make this large and heterogeneous corpus analytically accessible by applying quantitative methods, interpreting aggregate patterns, selecting representative case studies, and developing approaches to structuring preserved web data.

In this paper, we focus on one of these analytical challenges and develop a methodology for extracting authors’ declared motivations for publishing art-related materials. We test this methodology on preserved Narod.ru websites assigned to the Visual Art & Design category. By motivation we mean declared reasons, goals, and expectations that led creators to sharing works, posting their own artworks, and organizing website content. Motivation is expressed through explicit author statements and through site structure (e.g., features for uploading artworks). It is reconstructed from digital traces and does not capture hidden motivations.

As the main tool for extracting motivations, this work uses large language models (LLMs). Modern LLMs are increasingly applied to modeling and analysing human behavior, including aspects of Theory of Mind relevant to motivation studies (Zhuang et al. 2024, Peters / Matz 2024, Xie et al. 2025). In our study, LLMs enable identification and interpretation of site authors’ motivations at a scale where manual annotation would be impractical.

The main contributions are:

  • preservation and annotation of 10,000 Narod.ru sites for their affiliation with the Visual Art & Design category;
  • evaluation of open LLMs for multi-label classification;
  • Identification of website creators’ declared motivations.

2. Thematic classification of websites

To identify authors’ declared motivations for creating visual art-related websites, we first extracted thematically relevant sites from the full dataset. The project uses Google’s topic taxonomy (Google Cloud 2025), which includes 27 top-level categories and the Visual Art & Design subcategory within Arts & Entertainment.

During the entire project, researchers retained a random sample of 10,000 websites hosted on Narod.ru. The study used texts from preserved pages, while site topics were determined from homepage texts. Before extracting Visual Art & Design sites, we first identified sites in the broader Arts & Entertainment class. Because processing the entire corpus with proprietary LLMs is costly, we used locally deployed open models framed as binary classifiers.

To verify classifier performance, we manually annotated randomly selected 400 websites, which provides sufficient reliability for estimating a proportion with a 95% confidence interval and ±5 percentage-point error (Lohr, 2019). Two annotators labeled sites for affiliation with the Arts & Entertainment category. Initial agreement measured by Krippendorff’s alpha (Krippendorff 2011) was 0.68; disagreements were resolved through joint discussion, resulting in full agreement. Ultimately, 50 of the 400 sites were assigned to the target class.

For classification, we tested the following open models available on our server with four RTX5090 GPUs: Qwen3-Next-80B-A3B-Instruct-FP8 (Qwen Team 2025b), Qwen3-30B-A3B-Instruct-2507 (Yang et al. 2025), Qwen3-4B-Instruct (Yang et al. 2025), QwQ-32B (Qwen Team 2025a), and Gemma-3-27b-it (Kamath et al. 2025). The models were prompted to decide whether each homepage belonged to Arts & Entertainment. The best result was achieved by QwQ-32B (macro-F1 = 0.897). Prompts and detailed results are available in the repository

Repository with supplementary materials <https://github.com/erwyn-montgomery/adho2026> [05.05.2026].

.

QwQ-32B was then applied to the full corpus and identified 1,219 Arts & Entertainment sites. From these, Visual Art & Design sites were extracted: the model classified 235 sites into this category, and manual validation confirmed 218 of them (92.8%).

3. Extracting motivation with LLMs

To extract website creators’ motivations, we concatenated texts from all pages of each website into a single document. Motivation extraction followed the text clustering as text classification approach (Huang, He 2024) and consisted of three stages: (1) collecting all potential motivation types; (2) aggregating these types into broader categories using an LLM; and (3) classifying websites into the resulting categories.

In total, we identified 74 motivation types, along with a separate category Not Enough Data to Extract Motivation. These types were aggregated using proprietary models gpt-5.1-high

OpenAI. Introducing GPT-5.1 for developers. 13 November 2025. <https://openai.com/index/gpt-5-1-for-developers> [10.12.2025].

, gemini-3-pro-preview

Google Cloud. “Gemini 3 Pro.” Google Cloud Documentation: Generative AI on Vertex AI. Last updated 14 December 2025. <https://docs.cloud.google.com/vertex-ai/generative-ai/docs/models/gemini/3-pro> [10.12.2025].

, and claude-opus-4.5

Anthropic. Introducing Claude Opus 4.5. 24 November 2025. <https://www.anthropic.com/news/claude-opus-4-5> [10.12.2025].

, selected for their strong performance in the LMArena

LLM Leaderboard – Best & Chat AI Models Compered <https://lmarena.ai/leaderboard/text> [10.12.2025].

ranking and public API

Openrouter <https://openrouter.ai> [10.12.2025].

availability. After manual validation, we adopted the 17-category scheme proposed by claude-opus-4.5. The full list of motivation categories and their descriptions is provided in the repository

Ibid

.

At the final stage, we applied 17 binary classifiers, one per motivation category. The LLM classification results were manually validated by the authors. After validation, the model correctly identified motivations for 92.7% of websites (202/218). Two categories (Copyright Protection and Information Resources about Animals) were identified as LLM errors: websites mentioned these topics but were not primarily devoted to them. The multi-label classification results for 202 websites are shown in Figure 1.

Figure 1. Distribution of websites across motivation categories

The most frequent motivation category is Personal Creativity and Self-Expression. Such sites primarily showcase personal artwork and are often combined with motivations to preserve works, sell them, or accept commissions. In cases involving commercial services, authors typically present portfolios to attract clients. Additional details are available in the repository

Ibid

.

4. Case analysis

We examine two websites assigned by the model to Personal Creativity and Self-Expression and Archiving and Documenting Creative Work to illustrate how digital traces support motivation inference.

4.1. Case: Curation to legitimize creativity

The website Paintings and Miniatures from Landscape Stones

The websites presented here and below are cited in an anonymized form for ethical reasons.

provides a clear example. On the homepage

Homepage text: “Hi! Did you come for a sensation? That’s hard these days. This site is no exception. And yet, come in. Perhaps you, too, will find something you have never seen before. And if your eyes open wide at what you see, then I have managed to surprise you. Good luck!”.

, the author compares their work to something sensational, expressing a desire to surprise and retain the viewer. This reveals a key motivation emotional exchange and self-affirmation through recognition. The site structure includes sections such as Favorite Works, Sculptures, Photographs, About Me, and My Achievements. Separating Favorite Works into a distinct category highlights different modes of categorization – by genre and by the author’s personal relationship to their works. This purposeful selection and organization echo the phenomenon of the homepage as a form of digital self-expression described in vernacular web research (Lialina, Espenschied 2009). The site functions not merely as a gallery but as a curatorial act aimed at eliciting an emotional response.

4.2. Case: Grassroots curation as a basis for community

The second case illustrates a hybrid motivation in which personal creativity underpins an educational project and community formation. The website Fiction and Fantasy was assigned the categories Archiving and Documenting Creative Work, Implementation of Cultural Projects, Personal Creativity and Self-Expression, Community Building and Fan Activities, and Popularization of Artists and Art Movements. These categories are reflected in the site’s structure and content

Website texts: “I just hope that what I like will be interesting to you as well,” “Biographies and bibliographies of the best (in my view) fiction writers,” “as I hope, many art galleries <...> created by you will be posted here,” “perhaps new Harrisons and Vallejos will begin their creative path from here?”, “…I dare assure you that in those rare minutes when laziness does not win, I work hard on what I promised.” “…say a few words about the site author, if he is worthy of your precious attention, and finally just chat on completely free topics, and acquire, if not like-minded people, then pen pals.”

.

The author’s main goal is to create a shared space for contemporary authors and introduce readers to works within a selected genre. At the same time, the author assumes the role of curator, selecting works based on personal taste and taking responsibility toward users. Hosting a library and a gallery supports assignment to additional categories. The motivations form a hierarchy: personal passion (self-expression) enables systematization and popularization, which in turn make community formation possible. The site becomes a digital third place organized around shared cultural interest rather than commerce or formal membership.

5. Conclusion

Labeling websites by topics and motivations enriches digital heritage objects and supports interdisciplinary research by enabling preliminary assessment, targeted sampling, and more efficient discovery of case studies, as our two cases demonstrate. In this study, LLMs identified Visual Art & Design websites and were then used to analyze authors’ declared motivations. The models demonstrated high effectiveness in both thematic classification (accuracy = 92.8%) and motivation extraction (accuracy = 92.7%), as confirmed by manual validation.

Modern LLMs can substantially reduce annotation effort while addressing questions of human motivation at scale. Future work may examine these results through the lens of participatory culture and fan curatorship (Jenkins 2006) focusing on amateurs’ practices of selection, classification, and public representation of digital objects within the early web’s limited technological environment. Our methodology also engages with broader discussions in web archive research, where scholars have identified similar challenges in corpus definition and curatorial infrastructure (Maemura et al. 2021). The proposed methodology can scale to other website archives and contribute to broader research on digital heritage.

References
  1. Aslanov, Ilias / Kozlova, Anna / Bibilov, Ivan / Kotelnikov, Evgeny (2025): “Thematic classification of Narod.ru hosting websites as part of the strategy for preserving early Internet sites“, International Journal of Open Information Technologies, vol 13, No 12 (2025), pp. 116-127.
  2. Google Cloud (2025): “Content Categories”, Google Cloud Documentation (2025a) (Cloud Natural Language API). Last updated 5 December 2025. <https://docs.cloud.google.com/natural-language/docs/categories> [10.12.2025].
  3. Huang, Chen / He, Guoxiu (2024): “Text Clustering as Classification with LLMs“. arXiv:2410.00927 <https://doi.org/10.48550/arXiv.2410.00927>.
  4. Jenkins, Henry (2006): “Fans, bloggers, and gamers: Exploring participatory culture“. New York University Press, 2006.
  5. Kamath, Aishwarya / Ferret Johan / Pathak, Shreya et al. (2025): “Gemma 3 Technical Report“. arXiv:2503.19786. 2025. <https://doi.org/10.48550/arXiv.2503.19786>.
  6. Krippendorff, Klaus (2011): “Computing Krippendorff’s Alpha-Reliability“, Departmental Papers (ASC), University of Pennsylvania.
  7. Lialina, Olia / Espenschied, Dragan (2009): “Digital Folklore: To Computer Users, with Love and Respect“. Merz Akademie, 2009.
  8. Lohr, Sharon (2019): “Sampling: Design and Analysis“. 2nd ed. CRC Press, 2019.
  9. Maemura, Emily / Worby, Nicholas / Milligan, Ian / Becker, Christoph (2021): „Go fish”: Conceptualising the challenges of engaging national web archives for digital research. International Journal of Digital Humanities 2(1-3): 43–63. DOI: 10.1007/s42803-021-00032-5.
  10. Peters, Heinrich / Matz, Sandra C (2024): “Large Language Models Can Infer Psychological Dispositions of Social Media Users“, PNAS Nexus. 2024. Vol. 3(6), p.231. <https://doi.org/10.1093/pnasnexus/pgae231>.
  11. Qwen Team (2025a): QwQ-32B: Embracing the Power of Reinforcement Learning. 6 March 2025. <https://qwenlm.github.io/blog/qwq-32b> [10.12.2025].
  12. Qwen Team (2025b): Qwen3-Next-80B-A3B. 10 September 2025. <https://qwen.ai/blog?id=4074cca80393150c248e508aa62983f9cb7d27cd> [10.12.2025].
  13. Winters, Jane (2017): "Tackling complexity in humanities big data: From parliamentary proceedings to the archived web", in: Hiltunen, Turo / McVeigh, Joe / Säily, Tanja (eds.): Big and Rich Data in English Corpus Linguistics: Methods and Explorations. Helsinki: Varieng, University of Helsinki, 123-145.
  14. Xie, Yutong / Mei, Qiaozhu  / Yuan, Walter / Jackson, Matthew O. (2025): “Using Large Language Models to Categorize Strategic Situations and Decipher Motivations behind Human Behaviors“, Proceedings of the National Academy of Sciences. 2025. 122, no. 35, e2512075122. <https://doi.org/10.1073/pnas.2512075122>.
  15. Yang, An / Li, Anfeng / Yang, Baosong et al. (2025): “Qwen3 Technical Report“. arXiv:2505.09388. 2025. <https://doi.org/10.48550/arXiv.2505.09388>.
  16. Zhuang, Chen / Wu, Jincenzi / Zhou, Jinfeng et al. (2024): "ToMBench: Benchmarking Theory of Mind in Large Language Models", arXiv:2402.15052. <https://doi.org/10.48550/arXiv.2402.15052>.