Daejeon, July 27–31
Digital humanities workflows remain anchored in infrastructures designed for English and other Latin-script languages. Domenico Fiormonte’s early critique of the digital humanities drew attention to the linguistic hierarchies embedded in the technical foundations of the field. He demonstrated how core infrastructural standards encoded a bias toward English and other Latin-script languages. See Domenico Fiormonte, “Towards a Cultural Critique of the Digital Humanities,” Historical Social Research 37, no. 3 (2012): 59–76. An abugida is a type of writing system in which each basic character represents a consonant with an inherent vowel, and additional marks modify that vowel.
This paper introduces Anvay, the first open-source topic-modelling environment built specifically for Bengali and grounded in the linguistic structure of the script. To my knowledge, there is currently no topic‑modelling environment designed for Bengali that integrates preprocessing, modelling, and visualization in a reproducible pipeline. Anvay v2.0 also includes experimental support for Hindi, Tamil, and English, allowing cross‑script comparison and adaptation to other abugidas. Anvay is available at: https://github.com/vinayakdasgupta/anvay
Topic modelling has always been a heuristic rather than a descriptive device. In the humanities, scholars have long argued that models reveal patterns only insofar as they are shaped by corpus construction and methodological choice. Jockers (2013) demonstrated how modelling can extend literary interpretation, while Underwood (2019) showed how preprocessing decisions can radically alter a model’s shape. Drucker (2014) reminded us that computational representations encode epistemological assumptions. A topic model becomes a reading practice encoded in software.
DH has responded by developing a rich ecosystem of tools. Command-line systems such as MALLET (McCallum 2002) and Gensim (Řehůřek and Sokja 2010) allow expert control over modelling pipelines; interface-based tools like Voyant (Rockwell and Sinclair n.d.), dfr-browser (Goldstone 2016) and jsLDA (Mimno n.d.) make topic exploration accessible to those uncomfortable with coding. Visualisation frameworks such as LDAvis (Sievert and Shirley 2014) and Topicwizard (Kardos et. al. 2025) allow users to read the output, while more recent embedding-based approaches such as BERTopic (Grootendorst 2022) promise semantic refinement. While transformer-based models have shown to be more accurate, the reasons not to choose such an approach are twofold: the first is to create a verifiable system that moves away from black-box operations. Second, this is designed as a lightweight, browser-based teaching tool for classrooms that can run on modest hardware.
Anvay is implemented as a lightweight Flask-based environment for Bengali topic modelling, built around script-sensitive preprocessing and interpretive visualisation. The system incorporates a custom Unicode normalisation pipeline (resolving conjunct consonants, zero-width joiners, and diacritic inconsistencies), a Bengali-specific tokenizer that preserves orthographic clusters, and a dictionary-driven stemmer tailored to Bengali verbal and nominal morphology. Topic modelling is performed via a modified version of gensim’s LDA (Blei et. al. 2003) with full parameter exposure, while interpretability is supported through multiple visualization libraries and document-level drilldowns linking topics back to sentences. Anvay’s workflow—normalisation, tokenisation, filtering, modelling, and visualisation—is designed for a browser interface (Figure 1). It performs all Bengali-specific processing automatically while allowing users to adjust parameters that shape the model. Because it avoids transformer-scale dependencies, it can run on modest machines and be deployed in classrooms without specialised hardware.
Figure 1: Workflow for Anvay
The pedagogical value of such visibility is considerable. As students interactively adjust tokenisation rules or stemming parameters, they see the effects across the resulting topics. This real-time, causal feedback demystifies the modelling pipeline and fosters a deeper understanding of how meaning is computationally constructed. In Indian classrooms—where DH training often requires overcoming both linguistic alienation from English-centric tools and technical hesitation—the ability to work directly and computationally in Bengali expands the possibilities of multilingual DH. This transparency is central to Anvay's design: as topic modelling becomes a visible and configurable process rather than a black box, it is supported by extensive documentation that includes interactive learning activities, parameter guides, and a step-by-step walkthrough. Users can experiment with a simulated topic model in both English and Bengali to grasp core concepts like stopwords and word-topic assignment. A detailed walkthrough with a sample corpus demonstrates how filtering choices shape thematic visibility, reinforcing the tool’s role as a critical learning environment. This documentation actively guides users from linguistic intuition to computational interpretation, grounding DH pedagogy in hands-on inquiry.
To illustrate these claims, the presentation will demonstrate the various aspects of the software. It will show the modelling in action using Rabindranath Tagore’s literary works. These texts, dense with compounds and inflectional variation, quickly reveal the limits of standard pipelines (see Table 1). For instance, the results from the analysis of 65 of Tagore’s dramatic texts provides interesting reading: a stock Gensim model produces a topic dominated by malformed fragments (চল, মহ, মর, পথ). These word fragments are split due to mishandling of zero-width joiners. Anvay produces a semantically coherent cluster that surfaces recurring oppositions in Tagore’s dramaturgy. The words that form the topic show interesting relationships: we can see contrasts of evil versus devotion (রাক্ষস vs. নিতাই), punishment versus liberation (দণ্ডে vs. লঘু), and ritual object versus sacrificial act (প্রতিমা vs. পিসে). The co-occurrence of বিপ্র with a named female figure (মালিনীর) hints at the entanglements of caste, gender, and ritual authority. These are recurring themes in Tagore’s dramatic works, where devotion collides with social hierarchy, and where ritual is both a burden and a release. The coherence of the resulting topics will be assessed through the human interpretability of top-term lists and their contextual fit within the plays, moving beyond purely algorithmic coherence or perplexity scores. This human-centric evaluation aligns with the critical DH practice of treating models as heuristic devices.
| Stock Gensim output | Anvay output |
| চল, মহ, মর, পথ, দয়, মত, ধন, সম, দন, রহ | রাক্ষস (demon), দণ্ডে (punishment), প্রতিমা (idol), গহনা (ornament), বিপ্র (Brahmin or sage), মালিনীর (of Malini), নিতাই (devotional figure), লঘু (liberation or trivial), পিসে (crushed), লাগিবে (will be needed) |
Table 1: Stock Tokenizer vs Custom Tokenizer
In conclusion, Anvay demonstrates that true translingual engagement in DH requires moving beyond surface translation to script-aware infrastructural reinvention. By making its pipeline transparent and interactive, it fosters a critical, hands-on pedagogy of modelling. This paper will present, through examples and demonstration, the theoretical rationale, architectural design, and pedagogical outcomes of Anvay, arguing for a script-centric paradigm in the development of multilingual digital humanities tools.