Paper Reading AI Learner

Weakly Supervised Headline Dependency Parsing

2023-01-25 01:00:16
Adrian Benton, Tianze Shi, Ozan İrsoy, Igor Malioutov

Abstract

English news headlines form a register with unique syntactic properties that have been documented in linguistics literature since the 1930s. However, headlines have received surprisingly little attention from the NLP syntactic parsing community. We aim to bridge this gap by providing the first news headline corpus of Universal Dependencies annotated syntactic dependency trees, which enables us to evaluate existing state-of-the-art dependency parsers on news headlines. To improve English news headline parsing accuracies, we develop a projection method to bootstrap silver training data from unlabeled news headline-article lead sentence pairs. Models trained on silver headline parses demonstrate significant improvements in performance over models trained solely on gold-annotated long-form texts. Ultimately, we find that, although projected silver training data improves parser performance across different news outlets, the improvement is moderated by constructions idiosyncratic to outlet.

Abstract (translated)

英语新闻标题构成一个具有独特语义结构的寄存器,这一结构自20世纪30年代以来就在语言学文献中得到了记录。然而,英语新闻标题在NLP语义解析 community 中却出人意料地得到了较少的关注。我们的目标是通过提供 Universal Dependencies 注释语义依赖树的英语新闻标题语料库,来填补这一差距。这可以帮助我们评估现有的英语新闻标题依赖解析算法的性能。为了改善英语新闻标题的解析精度,我们开发了一种投影方法,从未标记的新闻标题-文章标题引伸出银训练数据。基于银标题解析的训练模型相比于仅基于 gold-annotated 长文本的训练模型,表现出了显著的性能提升。最终,我们发现,虽然投影的银训练数据改善了不同新闻机构之间的parser 性能,但由机构特有的构造子所限制的进步也在其中减弱了。

URL

https://arxiv.org/abs/2301.10371

PDF

https://arxiv.org/pdf/2301.10371.pdf


Tags
3D Action Action_Localization Action_Recognition Activity Adversarial Agent Attention Autonomous Bert Boundary_Detection Caption Chat Classification CNN Compressive_Sensing Contour Contrastive_Learning Deep_Learning Denoising Detection Dialog Diffusion Drone Dynamic_Memory_Network Edge_Detection Embedding Embodied Emotion Enhancement Face Face_Detection Face_Recognition Facial_Landmark Few-Shot Gait_Recognition GAN Gaze_Estimation Gesture Gradient_Descent Handwriting Human_Parsing Image_Caption Image_Classification Image_Compression Image_Enhancement Image_Generation Image_Matting Image_Retrieval Inference Inpainting Intelligent_Chip Knowledge Knowledge_Graph Language_Model Matching Medical Memory_Networks Multi_Modal Multi_Task NAS NMT Object_Detection Object_Tracking OCR Ontology Optical_Character Optical_Flow Optimization Person_Re-identification Point_Cloud Portrait_Generation Pose Pose_Estimation Prediction QA Quantitative Quantitative_Finance Quantization Re-identification Recognition Recommendation Reconstruction Regularization Reinforcement_Learning Relation Relation_Extraction Represenation Represenation_Learning Restoration Review RNN Salient Scene_Classification Scene_Generation Scene_Parsing Scene_Text Segmentation Self-Supervised Semantic_Instance_Segmentation Semantic_Segmentation Semi_Global Semi_Supervised Sence_graph Sentiment Sentiment_Classification Sketch SLAM Sparse Speech Speech_Recognition Style_Transfer Summarization Super_Resolution Surveillance Survey Text_Classification Text_Generation Tracking Transfer_Learning Transformer Unsupervised Video_Caption Video_Classification Video_Indexing Video_Prediction Video_Retrieval Visual_Relation VQA Weakly_Supervised Zero-Shot