DH 2026

Daejeon, July 27–31

Poster

An AI-Annotated Large-Scale Dataset of Public-Domain Poems for Digital Humanities Research and Teaching

Kahyun Choi
University of Illinois Urbana-Champaign · kahyun@illinois.edu
Haining Wang
Indiana University School of Medicine · hw56@iu.edu

[DH-Heading1]

Introduction

[DH- Default]

Large-scale annotated poetry data is useful for computational poetry research and ML teaching, since poetry analysis cannot rely on text alone but requires interpretive metadata. However, such resources remain scarce, as existing datasets are typically small or not fully open for reproducibility (Kao & Jurafsky 2012; Haider et al. 2020; Khan et al. 2021; Choi 2023). This gap reflects a practical challenge: affordable crowdsourced annotation is unreliable, expert annotation is reliable but costly (Haider et al. 2020).

Generative AI has recently emerged as an alternative way for data annotation (Tan et al. 2024). Prior work suggests that these models tend to perform better when substantial contextual information is available, so they may also perform reasonably well on popular poems. Such poems often have extensive online documentation, including interpretations, poetry guides, and critical essays from sources like the Poetry Foundation and Poets.org, and this additional context may help generative models produce more accurate metadata (Sun et al. 2024; Kandpal et al. 2023).

Building on these observations, we introduce a dataset of 51,356 poems with interpretations, themes, emotions, and sentiment generated by AI. Although these annotations are not human-verified, the dataset may still support new directions in computational poetry analysis and provide lightweight material for hands-on machine learning exercises in DH classrooms.

[DH-Heading1]

Dataset Description

[DH- Default]

This dataset contains 51,356 unique English poems drawn from Project Gutenberg and the Poetry Foundation, spanning classical, historical, and contemporary works. For each poem, the dataset provides AI-generated interpretations and structured metadata, including emotions, sentiment, and themes. Emotion labels follow the NRC Emotion Lexicon (Mohammad & Turney 2013), sentiment is categorized as positive, neutral, or negative, and themes are provided both as open-vocabulary descriptors and as labels drawn from the top 50 themes appearing in the Poets.org.

[DH-Heading1]

Methodology

[DH- Default]

To build this dataset, we first merged the two poetry collections, removing duplicate poems while preserving all original metadata and text formatting to avoid losing structural information essential to poetic analysis. We then used gpt-4o-2024-05-13 to generate a structured interpretation for each poem. The prompting template, available in the project repository, was designed to elicit multi-dimensional literary analysis, including thematic insights, identification of literary devices, historical or cultural context, emotional tone and mood, and structural observations related to form. The total cost for generating interpretations was approximately $2,000. In a second step, we automatically derived categorical from the generated interpretations using an on-premises gpt-oss-120b.

Statistical Summary

The generated interpretations have an average length of about 665 words and frequently refer to a range of literary devices, including imagery, symbolism, and metaphor (Figure 1). As shown in Figure 2-a, sadness is the most common primary emotion (45.2%), followed by joy (20.6%) and fear (11.7%), while other emotions appear less frequently. Sentiment labels (Figure 2-b) similarly skew toward negative sentiment (56.8%), with positive (35.8%) and neutral (7.4%) sentiment occurring less often. Detailed statistics, additional tables, and sample data are provided in the project repository, available at https://anonymous.4open.science/r/C120D891AU/.

Figure 1. Top 10 most frequently appearing literacy devices in the generated interpretations.

Figure 2. Distribution of (a) primary emotion labels and (b) sentiment labels across poems

Potential Use Cases in DH

This dataset opens several use cases in DH.

  • Human-AI comparison in interpreting popular poems: AI-generated interpretations can be examined by human readers to assess their depth and limitations, enabling direct comparison between human close reading and machine-generated literary analysis.
  • Head and long-tail poem comparisons in generative AI interpretation generation: Because this dataset primarily consists of highly popular public-domain poems, it can serve as a contrast group for analyzing AI-generated interpretations of less popular or newly written poems that lack extensive online resources. This comparison supports the evaluation of how generative models perform with and without access to rich web-based auxiliary knowledge.
  • DH classroom use under constrained resources: Because poems are short texts and the dataset is lightweight, it enables large-scale literary analysis even in DH classrooms with limited computational resources, supporting hands-on modeling of emotions, sentiment, and themes.

Conclusion

We introduced a large-scale, open dataset of 51,356 English poems annotated with AI-generated interpretations, themes, emotions, and sentiment. While the dataset is not a human gold standard, it provides a transparent and reproducible resource for computational poetry research and DH education.

References
  1. Akgun, M., & Hosseini, H. (2025, July). AI education in a mirror: Challenges faced by academic and industry experts. In International Conference on Artificial Intelligence in Education (pp. 336-348). Cham: Springer Nature Switzerland.
  2. Choi, K. (2023). Computational thematic analysis of poetry via bimodal large language models. Association for Information Science and Technology (ASIS&T).
  3. Haider, T., Eger, S., Kim, E., Klinger, R., & Menninghaus, W. (2020). PO-EMO: Conceptualization, annotation, and modeling of aesthetic emotions in German and English poetry. arXiv preprint arXiv:2003.07723.
  4. Kandpal, N., Deng, H., Roberts, A., Wallace, E., & Raffel, C. (2023, July). Large language models struggle to learn long-tail knowledge. In International Conference on machine learning (pp. 15696-15707). PMLR.
  5. Kao, J., & Jurafsky, D. (2012, June). A computational analysis of style, affect, and imagery in contemporary poetry. In Proceedings of the NAACL-HLT 2012 workshop on computational linguistics for literature (pp. 8-17).
  6. Sun, K., Xu, Y., Zha, H., Liu, Y., & Dong, X. L. (2024, June). Head-to-tail: How knowledgeable are large language models (LLMs)? aka will LLMs replace knowledge graphs?. In Proceedings of the 2024 conference of the North American chapter of the association for computational linguistics: human language technologies (volume 1: long papers) (pp. 311-325).
  7. Tan, Z., Li, D., Wang, S., Beigi, A., Jiang, B., Bhattacharjee, A., ... & Liu, H. (2024). Large Language Models for Data Annotation and Synthesis: A Survey. In Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing (pp. 930-957).
  8. Wadsworth, F., Blaney, J., Springsteen, M., Coburn, B., Khanal, N., Rodgers, T., ... & Muknahallipatna, S. (2024). Frameworks and Challenges for Implementing Machine Learning Curriculum in Secondary Education. International Journal of Technology in Education and Science, 8(1), 164-181.)
  9. Zhu, M., Wang, G., Li, C., Wang, H., & Zhang, B. (2023). Artificial intelligence classification model for modern Chinese poetry in education. Sustainability, 15(6), 5265.