DH 2026

Daejeon, July 27–31

Thu, July 3013:40–15:10S018105
Long Paper

Improving Classical-Chinese Machine Translation Through Automatic Explicitation: A Digital-Humanities Approach to Historical Text Processing

Ting-Xuan Lin
National Central University, Taiwan; Academia Sinica, Taiwan · cynthia_lin@outlook.com
You-Chen Ou
National Taiwan University, Taiwan · ouchen916@gmail.com
Richard Tzong-Han Tsai
National Central University, Taiwan; Academia Sinica, Taiwan · thtsai@csie.ncu.edu.tw

Introduction

A critical bottleneck in the machine translation of Classical Chinese is zero anaphora, the pervasive omission of pronouns for established person entities. Even state-of-the-art (SOTA) Large Language Models (LLMs) struggle to link these zero pronouns to their antecedents, particularly within the long-context and interpretively-dense structures of historical text. This challenge persists because specialized models lack explicit coreference mechanisms (Cao et al., 2024; Yao et al., 2025), and the scarcity of annotated corpora makes supervised clustering infeasible. Furthermore, standard evaluation metrics assume a single ground truth, failing to account for the ambiguity inherent in classical philology (Moosavi & Strube, 2016; Wu et al., 2025).

We address these limitations by reframing the task not as labeling, but as referential explicitation. Grounded in translation theory (Vinay & Darbelnet, 1958), we treat coreference resolution as a source-side generative rewrite. We introduce Llama3-classical-ex, fine-tuned to materialize implicit references directly within the source text before translation. This approach transforms context-unaware inputs into explicit structures without requiring large-scale entity annotations.

We evaluate the impact of explicitation on translation quality using an LLM-as-a-Judge framework, rigorously assessing referential consistency and factual fidelity across diverse model families. Validated by alignment with human-expert judgement, our results demonstrate that resolving incomplete references prior to translation significantly reduces hallucinations. By prioritizing interpretable source rewrites, this pipeline offers a practical, Digital Humanities (DH)-oriented method for preserving the semantic integrity of under-represented cultural heritage texts.

Methodology

This research introduces a novel referential explicitation framework structured into a four-stage pipeline encompassing data synthesis, model optimization, and domain-aware validation, as illustrated in Figure 1.

Figure 1 The generic framework of the research.

Data Construction

To overcome the scarcity of annotated corpora, we construct a synthetic dataset using biographical texts from the History of Song and History of Ming via Wikisource

https://zh.wikisource.org/wiki/Wikisource

. Automating Gemini-2.5-pro (Comanici et al., 2025) via curated one-shot prompting, we generate parallel corpora where incomplete references and zero pronouns are resolved to full entity mentions. The annotation process adheres to strict philological guidelines to ensure historical and linguistic fidelity:

  • Ambiguity Resolution. Replacing indefinite pronouns (e.g., "he," "they") or partial names with the full entity name established at the first mention.
  • Zero Anaphora Restoration. Inserting full names into syntactic slots where subjects or objects were omitted.
  • Pro-drop Rule. Tailored to Chinese syntax, omitted subjects are retained if they share a subject with the preceding clause within the same sentence boundary; otherwise, the explicit name is restored to preserve context.
  • Emperor Mention Rule. To address naming variability, all emperor mentions were standardized to their unique dynastic "temple names" (e.g., Ming Yingzong).

The dataset comprises 579 paragraphs for training—automatically annotated following the above rules—and 143 paragraphs for testing, which are manually annotated by a human expert. (see Figure 2).

Figure 2 Length distribution of original (pre-EX) and explicitated (post-EX) paragraphs in the datasets.

Supervised Fine-Tuning (SFT)

We develop Llama3-classical-ex, a specialized model for paragraph-level referential explicitation. Starting with our domain-specific baseline (Llama3-classical

Baseline configuration: Built on the NiuTrans Open Source Classical Chinese Corpus. Continual Pre-training (CP) utilized monolingual texts. Supervised Fine-Tuning (SFT) employed a balanced 50/50 Classical-Mandarin bilingual dataset.

), we fine-tune the model on a composite dataset containing (1) a Classical-Mandarin bilingual corpus and (2) the synthetic referential explicitation dataset

Explicitation Training: The composite dataset integrates the baseline's bilingual Classical-Modern corpus with our 579 synthetically annotated paragraphs containing explicitations.

.

This joint training approach provides simultaneous supervision for translation and explicitation, mitigating catastrophic forgetting of general linguistic capabilities (Kirkpatrick et al., 2017). The model performs paragraph-level rewrites, explicitly embedding contextually implied references into the source text prior to translation to minimize information ambiguity.

Two-staged Evaluation

We employ a hybrid evaluation framework to rigorously benchmark translation improvements:

  • LLM-as-a-Judge. We conduct blind pairwise comparisons between translations generated from original texts ("Translation A") and explicitated texts ("Translation B") across diverse model families. Position bias was mitigated by swapping the order of candidates across two runs; any conflicting judgements are recorded as a Tie. Next, we task Gemini-2.5-pro to evaluate referential consistency and factual fidelity against a gold-standard reference translation annotated by a human expert (see Table 1).
  • Human Alignment. To validate the automated judge, a domain expert in Chinese History performed a blind review of 140 stratified translation pairs. A Wilcoxon signed-rank test confirms significant alignment between the human and LLM judge (p ≈ 0.002), establishing the automated metric as a reliable proxy for expert historical assessment (see Table 2).

Table 1 Comparative analysis on decisive rounds (Ndec). The full test set contains 143 samples per model (Ndec = 143 - Tie). Win rate is calculated over Ndec .The 95% C.I. and bootstrapped p-values (10k resamples) test the null hypothesis of 0.5 win rate.

Table 2 Alignment analysis on 140 stratified samples. Statistical significance is tested via the Wilcoxon Signed-Rank Test (H0 : Agreement 0.5, H1 : Agreement >0.5).

Error Analysis

To diagnose the limitations of generative explicitation, we conducted a granular taxonomic analysis on the 17 instances where the human expert strictly preferred the baseline (pre-EX) translation. We classified failure modes into four non-exclusive categories (Table 3), as a single erroneous rewrite often triggers cascading translation faults.

The most prevalent issue was Factual Error (70.6%), where the model confused identities or genealogical relationships not present in the source. This was often compounded by Semantic Imprecision (35.3%), where the model incorrectly resolved collective nouns (e.g., zhujiang, "generals") into specific single entities. Less frequently, we observed Omission (23.5%) of tactical details and Over-Explicitation (23.5%), where the recursive insertion of titles (e.g., "Ming Ming Daizong") degraded the stylistic quality of the output.

Table 3 Qualitative analysis of error propagation. Frequency is calculated over the failure subset (N = 17); and category counts are “non-exclusive”. Examples trace the generation from original Source (SRC) to the Explicitated intermediate (EXP) to the final Translation (TRANS).

Discussion

The explicitated inputs yield superior translation accuracy compared to the baseline, as validated by domain experts (65% alignment rate). The significant statistical alignment between the automated judge and human verdicts validates our scalable protocol for historical translation research.

While the framework proved robust, the error analysis highlights a trade-off: while explicitation resolves syntactic ambiguity, it introduces a risk of factual hallucination in complex contexts. The model occasionally "over-interprets" historical data, conflating kinship terms with personal names (see Table 3, Factual Error). However, the high overall win rates across models confirm that restoring critical context generally outweighs these edge cases. Future work will mitigate these errors by incorporating uncertainty estimation to suppress low-confidence rewrites.

Conclusion

This study addresses the persistent challenge of referential ambiguity in Classical Chinese translation by introducing a novel framework for source-side explicitation. By constructing a synthetic dataset from the History of Song and History of Ming and fine-tuning Llama3-classical-ex, we demonstrated that resolving zero anaphora and ambiguous entities prior to translation significantly enhances target text fidelity.

Our rigorous two-staged evaluation confirms the efficacy of this approach. The explicitated inputs yielded superior translations compared to the baseline across models, as validated by domain experts. Furthermore, the significant statistical alignment (p ≈ 0.002) between the automated LLM judge and human verdicts establishes the reliability of our evaluation pipeline, offering a scalable protocol for future historical translation research.

While the framework proved robust, our taxonomic error analysis highlighted specific limitations regarding semantic imprecision and identity conflation in complex genealogical contexts. These findings suggest that generative explicitation is a powerful but not infallible tool. Future work should focus on integrating uncertainty estimation mechanisms to filter low-confidence resolutions, thereby minimizing the propagation of factual errors in automated historical text processing.

References
  1. Cao, J., Peng, D., Zhang, P., Shi, Y., Liu, Y., Ding, K., & Jin, L. (2024). Tonggu: Mastering classical chinese understanding with knowledge-grounded large language models. Preprint, arXiv:2407.03937.
  2. Comanici, G., Bieber, E., Schaekermann, M., Pasupat, I., Sachdeva, N., Dhillon, I., ... & Others. (2025). Gemini 2.5: Pushing the frontier with advanced reasoning, multimodality, long context, and next generation agentic capabilities. Preprint, arXiv:2507.06261.
  3. Kirkpatrick, J., Pascanu, R., Rabinowitz, N. C., Veness, J., Desjardins, G., Rusu, A. A., ... & Hadsell, R. (2017). Overcoming catastrophic forgetting in neural networks. Proceedings of the National Academy of Sciences (PNAS), 114(13):3521–3526.
  4. Moosavi, N. S., & Strube, M. (2016). Which coreference evaluation metric do you trust? a proposal for a link-based entity aware metric. Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 632–642.
  5. Vinay, J.-P., & Darbelnet, J. (1958). Stylistique Comparee Du Francais Et De L’anglais. Didier, Paris, France.
  6. Wu, X., Li, H., Liu, H., Ji, X., Li, R., Chen, Y., & Zhang, Y. (2025). Uncovering the fragility of trustworthy llms through Chinese textual ambiguity. arXiv:2507.23121.
  7. Yao, X., Wang, M., Chen, B., & Zhao, X. (2025). Wenyangpt: A large language model for classical chinese tasks. Preprint, arXiv:2504.20609.