Paper Reading AI Learner

Hybrid Neural-LLM Pipeline for Morphological Glossing in Endangered Language Documentation: A Case Study of Jungar Tuvan

2026-03-01 05:03:11
Siyu Liang, Talant Mawkanuli, Gina-Anne Levow

Abstract

Interlinear glossed text (IGT) creation remains a major bottleneck in linguistic documentation and fieldwork, particularly for low-resource morphologically rich languages. We present a hybrid automatic glossing pipeline that combines neural sequence labeling with large language model (LLM) post-correction, evaluated on Jungar Tuvan, a low-resource Turkic language. Through systematic ablation studies, we show that retrieval-augmented prompting provides substantial gains over random example selection. We further find that morpheme dictionaries paradoxically hurt performance compared to providing no dictionary at all in most cases, and that performance scales approximately logarithmically with the number of few-shot examples. Most significantly, our two-stage pipeline combining a BiLSTM-CRF model with LLM post-correction yields substantial gains for most models, achieving meaningful reductions in annotation workload. Drawing on these findings, we establish concrete design principles for integrating structured prediction models with LLM reasoning in morphologically complex fieldwork contexts. These principles demonstrate that hybrid architectures offer a promising direction for computationally light solutions to automatic linguistic annotation in endangered language documentation.

Abstract (translated)

交叉线注释文本(IGT)的创建仍然是语言记录和实地研究中的一个主要瓶颈,尤其是在资源较少、形态丰富的语言中。我们提出了一种结合神经序列标注与大型语言模型(LLM)后校正的混合自动注解管道,并在一种低资源突厥语——楚瓦什图瓦尼语上对其进行了评估。通过系统的消融研究,我们发现检索增强提示比随机示例选择提供了显著的优势。此外,我们发现在大多数情况下,形态词典反而会损害性能,相比于不提供任何字典的情况。同时,我们还发现性能随着少量样本数量的增加近似对数增长。 最重要的是,我们的两阶段管道将BiLSTM-CRF模型与LLM后校正结合使用,在大多数模型中产生了显著的效果提升,实现了注释工作量的实质性减少。基于这些发现,我们在形态复杂的实地研究环境中建立了结构化预测模型和LLM推理集成的具体设计原则。这些原则表明,混合架构为濒危语言文档自动语言注解提供了有希望的方向,并且可以实现计算负担较轻的解决方案。

URL

https://arxiv.org/abs/2603.00923

PDF

https://arxiv.org/pdf/2603.00923.pdf


Tags
3D Action Action_Localization Action_Recognition Activity Adversarial Agent Attention Autonomous Bert Boundary_Detection Caption Chat Classification CNN Compressive_Sensing Contour Contrastive_Learning Deep_Learning Denoising Detection Dialog Diffusion Drone Dynamic_Memory_Network Edge_Detection Embedding Embodied Emotion Enhancement Face Face_Detection Face_Recognition Facial_Landmark Few-Shot Gait_Recognition GAN Gaze_Estimation Gesture Gradient_Descent Handwriting Human_Parsing Image_Caption Image_Classification Image_Compression Image_Enhancement Image_Generation Image_Matting Image_Retrieval Inference Inpainting Intelligent_Chip Knowledge Knowledge_Graph Language_Model LLM Matching Medical Memory_Networks Multi_Modal Multi_Task NAS NMT Object_Detection Object_Tracking OCR Ontology Optical_Character Optical_Flow Optimization Person_Re-identification Point_Cloud Portrait_Generation Pose Pose_Estimation Prediction QA Quantitative Quantitative_Finance Quantization Re-identification Recognition Recommendation Reconstruction Regularization Reinforcement_Learning Relation Relation_Extraction Represenation Represenation_Learning Restoration Review RNN Robot Salient Scene_Classification Scene_Generation Scene_Parsing Scene_Text Segmentation Self-Supervised Semantic_Instance_Segmentation Semantic_Segmentation Semi_Global Semi_Supervised Sence_graph Sentiment Sentiment_Classification Sketch SLAM Sparse Speech Speech_Recognition Style_Transfer Summarization Super_Resolution Surveillance Survey Text_Classification Text_Generation Time_Series Tracking Transfer_Learning Transformer Unsupervised Video_Caption Video_Classification Video_Indexing Video_Prediction Video_Retrieval Visual_Relation VQA Weakly_Supervised Zero-Shot