Paper Reading AI Learner

Multi-Source Neural Machine Translation with Missing Data

2018-06-08 01:29:32
Yuta Nishimura, Katsuhito Sudoh, Graham Neubig, Satoshi Nakamura

Abstract

Multi-source translation is an approach to exploit multiple inputs (e.g. in two different languages) to increase translation accuracy. In this paper, we examine approaches for multi-source neural machine translation (NMT) using an incomplete multilingual corpus in which some translations are missing. In practice, many multilingual corpora are not complete due to the difficulty to provide translations in all of the relevant languages (for example, in TED talks, most English talks only have subtitles for a small portion of the languages that TED supports). Existing studies on multi-source translation did not explicitly handle such situations. This study focuses on the use of incomplete multilingual corpora in multi-encoder NMT and mixture of NMT experts and examines a very simple implementation where missing source translations are replaced by a special symbol <NULL>. These methods allow us to use incomplete corpora both at training time and test time. In experiments with real incomplete multilingual corpora of TED Talks, the multi-source NMT with the <NULL> tokens achieved higher translation accuracies measured by BLEU than those by any one-to-one NMT systems.

Abstract (translated)

多源翻译是一种利用多个输入(例如以两种不同语言)来提高翻译准确性的方法。在本文中,我们使用不完整的多语言语料库来研究多源神经机器翻译(NMT)的方法,其中一些翻译缺失。实际上,由于难以提供所有相关语言的翻译,许多多语种语料库并不完整(例如,在TED会谈中,大多数英语会话只有TED支持的一小部分语言的字幕)。关于多源翻译的现有研究没有明确处理这种情况。本研究重点关注在多编码器NMT和NMT专家混合使用不完整的多语种语料库,并检查一个非常简单的实现,其中缺少源翻译被特殊符号<NULL>替换。这些方法允许我们在训练时间和测试时间使用不完整的语料库。在使用TED会谈的真实不完全多语种语料库进行的实验中,具有<NULL>标记的多源NMT比任何一对一NMT系统所测量的BLEU测量的翻译准确度更高。

URL

https://arxiv.org/abs/1806.02525

PDF

https://arxiv.org/pdf/1806.02525.pdf


Tags
3D Action Action_Localization Action_Recognition Activity Adversarial Agent Attention Autonomous Bert Boundary_Detection Caption Chat Classification CNN Compressive_Sensing Contour Contrastive_Learning Deep_Learning Denoising Detection Dialog Diffusion Drone Dynamic_Memory_Network Edge_Detection Embedding Embodied Emotion Enhancement Face Face_Detection Face_Recognition Facial_Landmark Few-Shot Gait_Recognition GAN Gaze_Estimation Gesture Gradient_Descent Handwriting Human_Parsing Image_Caption Image_Classification Image_Compression Image_Enhancement Image_Generation Image_Matting Image_Retrieval Inference Inpainting Intelligent_Chip Knowledge Knowledge_Graph Language_Model Matching Medical Memory_Networks Multi_Modal Multi_Task NAS NMT Object_Detection Object_Tracking OCR Ontology Optical_Character Optical_Flow Optimization Person_Re-identification Point_Cloud Portrait_Generation Pose Pose_Estimation Prediction QA Quantitative Quantitative_Finance Quantization Re-identification Recognition Recommendation Reconstruction Regularization Reinforcement_Learning Relation Relation_Extraction Represenation Represenation_Learning Restoration Review RNN Salient Scene_Classification Scene_Generation Scene_Parsing Scene_Text Segmentation Self-Supervised Semantic_Instance_Segmentation Semantic_Segmentation Semi_Global Semi_Supervised Sence_graph Sentiment Sentiment_Classification Sketch SLAM Sparse Speech Speech_Recognition Style_Transfer Summarization Super_Resolution Surveillance Survey Text_Classification Text_Generation Tracking Transfer_Learning Transformer Unsupervised Video_Caption Video_Classification Video_Indexing Video_Prediction Video_Retrieval Visual_Relation VQA Weakly_Supervised Zero-Shot