Paper Reading AI Learner

Improving Indigenous Language Machine Translation with Synthetic Data and Language-Specific Preprocessing

2026-01-06 16:06:42
Aashish Dhawan, Christopher Driggers-Ellis, Christan Grant, Daisy Zhe Wang

Abstract

Low-resource indigenous languages often lack the parallel corpora required for effective neural machine translation (NMT). Synthetic data generation offers a practical strategy for mitigating this limitation in data-scarce settings. In this work, we augment curated parallel datasets for indigenous languages of the Americas with synthetic sentence pairs generated using a high-capacity multilingual translation model. We fine-tune a multilingual mBART model on curated-only and synthetically augmented data and evaluate translation quality using chrF++, the primary metric used in recent AmericasNLP shared tasks for agglutinative languages. We further apply language-specific preprocessing, including orthographic normalization and noise-aware filtering, to reduce corpus artifacts. Experiments on Guarani--Spanish and Quechua--Spanish translation show consistent chrF++ improvements from synthetic data augmentation, while diagnostic experiments on Aymara highlight the limitations of generic preprocessing for highly agglutinative languages.

Abstract (translated)

低资源土著语言通常缺乏有效的神经机器翻译(NMT)所需的平行语料库。合成数据生成为在数据稀缺的情况下缓解这一限制提供了一种实用策略。在这项工作中,我们使用高容量的多语言翻译模型生成合成句子对,以增强美洲土著语言的经过整理的平行数据集。我们将多语言mBART模型针对仅包含经过整理的数据和通过合成增强的数据进行微调,并使用chrF++作为评估指标来衡量翻译质量,这是最近用于黏着语系语言的AmericasNLP共享任务的主要度量标准。我们进一步应用了特定于每种语言的预处理方法,包括正字法规范化和噪声感知过滤,以减少语料库中的伪影。在瓜拉尼语-西班牙语和克丘亚语-西班牙语翻译实验中显示,从合成数据增强中获得了chrF++的一致性改进,而艾马拉语的诊断性试验则突出了通用预处理方法对高度黏着语言的局限性。

URL

https://arxiv.org/abs/2601.03135

PDF

https://arxiv.org/pdf/2601.03135.pdf


Tags
3D Action Action_Localization Action_Recognition Activity Adversarial Agent Attention Autonomous Bert Boundary_Detection Caption Chat Classification CNN Compressive_Sensing Contour Contrastive_Learning Deep_Learning Denoising Detection Dialog Diffusion Drone Dynamic_Memory_Network Edge_Detection Embedding Embodied Emotion Enhancement Face Face_Detection Face_Recognition Facial_Landmark Few-Shot Gait_Recognition GAN Gaze_Estimation Gesture Gradient_Descent Handwriting Human_Parsing Image_Caption Image_Classification Image_Compression Image_Enhancement Image_Generation Image_Matting Image_Retrieval Inference Inpainting Intelligent_Chip Knowledge Knowledge_Graph Language_Model LLM Matching Medical Memory_Networks Multi_Modal Multi_Task NAS NMT Object_Detection Object_Tracking OCR Ontology Optical_Character Optical_Flow Optimization Person_Re-identification Point_Cloud Portrait_Generation Pose Pose_Estimation Prediction QA Quantitative Quantitative_Finance Quantization Re-identification Recognition Recommendation Reconstruction Regularization Reinforcement_Learning Relation Relation_Extraction Represenation Represenation_Learning Restoration Review RNN Robot Salient Scene_Classification Scene_Generation Scene_Parsing Scene_Text Segmentation Self-Supervised Semantic_Instance_Segmentation Semantic_Segmentation Semi_Global Semi_Supervised Sence_graph Sentiment Sentiment_Classification Sketch SLAM Sparse Speech Speech_Recognition Style_Transfer Summarization Super_Resolution Surveillance Survey Text_Classification Text_Generation Time_Series Tracking Transfer_Learning Transformer Unsupervised Video_Caption Video_Classification Video_Indexing Video_Prediction Video_Retrieval Visual_Relation VQA Weakly_Supervised Zero-Shot