Paper Reading AI Learner

BERT Post-Training for Review Reading Comprehension and Aspect-based Sentiment Analysis

2019-04-03 20:29:10
Hu Xu, Bing Liu, Lei Shu, Philip S. Yu

Abstract

Question-answering plays an important role in e-commerce as it allows potential customers to actively seek crucial information about products or services to help their purchase decision making. Inspired by the recent success of machine reading comprehension (MRC) on formal documents, this paper explores the potential of turning customer reviews into a large source of knowledge that can be exploited to answer user questions.~We call this problem Review Reading Comprehension (RRC). To the best of our knowledge, no existing work has been done on RRC. In this work, we first build an RRC dataset called ReviewRC based on a popular benchmark for aspect-based sentiment analysis. Since ReviewRC has limited training examples for RRC (and also for aspect-based sentiment analysis), we then explore a novel post-training approach on the popular language model BERT to enhance the performance of fine-tuning of BERT for RRC. To show the generality of the approach, the proposed post-training is also applied to some other review-based tasks such as aspect extraction and aspect sentiment classification in aspect-based sentiment analysis. Experimental results demonstrate that the proposed post-training is highly effective. The datasets and code are available at https://www.cs.uic.edu/~hxu/.

Abstract (translated)

问答在电子商务中起着重要的作用,因为它允许潜在客户积极寻求有关产品或服务的关键信息,以帮助他们做出购买决策。受正式文档机器阅读理解(MRC)最近取得成功的启发,本文探讨了将客户评论转化为可用于回答用户问题的大量知识源的潜力。~我们称之为问题回顾阅读理解(RRC)。据我们所知,目前还没有就RRC开展任何工作。在这项工作中,我们首先构建了一个RRC数据集,称为reviewrc,它基于一个流行的基于方面的情绪分析基准。由于reviewrc对rrc的训练示例有限(也用于基于方面的情感分析),因此我们在流行的语言模型bert上探索了一种新的后训练方法,以提高rrc的bert微调性能。为了说明这一方法的通用性,本文还将其应用于其他基于综述的任务,如基于方面的情绪分析中的方面提取和方面情绪分类。实验结果表明,所提出的岗位培训方法是有效的。数据集和代码可从https://www.cs.uic.edu/~hxu/获取。

URL

https://arxiv.org/abs/1904.02232

PDF

https://arxiv.org/pdf/1904.02232.pdf


Tags
3D Action Action_Localization Action_Recognition Activity Adversarial Agent Attention Autonomous Bert Boundary_Detection Caption Chat Classification CNN Compressive_Sensing Contour Contrastive_Learning Deep_Learning Denoising Detection Dialog Diffusion Drone Dynamic_Memory_Network Edge_Detection Embedding Embodied Emotion Enhancement Face Face_Detection Face_Recognition Facial_Landmark Few-Shot Gait_Recognition GAN Gaze_Estimation Gesture Gradient_Descent Handwriting Human_Parsing Image_Caption Image_Classification Image_Compression Image_Enhancement Image_Generation Image_Matting Image_Retrieval Inference Inpainting Intelligent_Chip Knowledge Knowledge_Graph Language_Model Matching Medical Memory_Networks Multi_Modal Multi_Task NAS NMT Object_Detection Object_Tracking OCR Ontology Optical_Character Optical_Flow Optimization Person_Re-identification Point_Cloud Portrait_Generation Pose Pose_Estimation Prediction QA Quantitative Quantitative_Finance Quantization Re-identification Recognition Recommendation Reconstruction Regularization Reinforcement_Learning Relation Relation_Extraction Represenation Represenation_Learning Restoration Review RNN Salient Scene_Classification Scene_Generation Scene_Parsing Scene_Text Segmentation Self-Supervised Semantic_Instance_Segmentation Semantic_Segmentation Semi_Global Semi_Supervised Sence_graph Sentiment Sentiment_Classification Sketch SLAM Sparse Speech Speech_Recognition Style_Transfer Summarization Super_Resolution Surveillance Survey Text_Classification Text_Generation Tracking Transfer_Learning Transformer Unsupervised Video_Caption Video_Classification Video_Indexing Video_Prediction Video_Retrieval Visual_Relation VQA Weakly_Supervised Zero-Shot