Bert

Bert

• 2020-11-25 Learning to Expand: Reinforced Pseudo-relevance Feedback Selection for Information-seeking Conversations    Haojie Pan, Cen Chen, Minghui Qiu, Liu Yang, Feng Ji, Jun Huang, Haiqing Chen arXiv_CL arXiv_CL  Bert  Pose  Quantitative  PDF
• 2020-11-24 Enhancing deep neural networks with morphological information    Matej Klemen, Luka Krsnik, Marko Robnik-Šikonja arXiv_CL arXiv_CL  Transformer  Recognition  Bert  RNN  Speech  Deep_Learning  Language_Model  PDF
• 2020-11-24 Experiments on transfer learning architectures for biomedical relation extraction    Walid Hafiane, Joel Legrand, Yannick Toussaint, Adrien Coulet arXiv_CL arXiv_CL  Segmentation  Transfer_Learning  Bert  Action  Relation  Relation_Extraction  Medical  PDF
• 2020-11-24 Zero-Shot Visual Slot Filling as Question Answering    Larry Heck, Simon Heck arXiv_AI arXiv_AI  Transfer_Learning  Bert  Zero-Shot  PDF
• 2020-11-24 Constraint Based Refinement of Optical Flow    Hirak Doshi, N. Uday Kiran arXiv_CV arXiv_CV  Bert  Regularization  Optical_Flow  PDF
• 2020-11-24 Tackling Domain-Specific Winograd Schemas with Knowledge-Based Reasoning and Machine Learning    Suk Joon Hong, Brandon Bennett arXiv_AI arXiv_AI  Transformer  Bert  Knowledge  Pose  PDF
• 2020-11-24 Picking BERT's Brain: Probing for Linguistic Dependencies in Contextualized Embeddings Using Representational Similarity Analysis    Michael A. Lepori, R. Thomas McCoy arXiv_CL arXiv_CL  Embedding  Bert  Salient  PDF
• 2020-11-24 Spatiotemporal Imaging with Diffeomorphic Optimal Transportation    Chong Chen arXiv_CV arXiv_CV  Reconstruction  Bert  Sparse  Pose  PDF
• 2020-11-23 Does BERT Understand Sentiment? Leveraging Comparisons Between Contextual and Non-Contextual Embeddings to Improve Aspect-Based Sentiment Models    Natesh Reddy, Pranaydeep Singh, Muktabh Mayank Srivastava arXiv_CL arXiv_CL  Embedding  Bert  Sentiment_Classification  Classification  Detection  Sentiment  Language_Model  PDF
• 2020-11-23 The Zero Resource Speech Benchmark 2021: Metrics and baselines for unsupervised spoken language modeling    Tu Anh Nguyen, Maureen de Seyssel, Patricia Rozé, Morgane Rivière, Evgeny Kharitonov, Alexei Baevski, Ewan Dunbar, Emmanuel Dupoux arXiv_CL arXiv_CL  Unsupervised  Bert  Zero-Shot  Represenation_Learning  RNN  Speech  Self-Supervised  Language_Model  PDF
• 2020-11-22 Locally Linear Embedding and its Variants: Tutorial and Survey    Benyamin Ghojogh, Ali Ghodsi, Fakhri Karray, Mark Crowley arXiv_CV arXiv_CV  Reconstruction  Embedding  OCR  Bert  Survey  PDF
• 2020-11-20 Self-Supervised learning with cross-modal transformers for emotion recognition    Aparna Khare, Srinivas Parthasarathy, Shiva Sundaram arXiv_CL arXiv_CL  Transformer  Embedding  Recognition  Bert  Speech  Self-Supervised  Emotion  Language_Model  PDF
• 2020-11-20 Fine-Tuning BERT for Sentiment Analysis of Vietnamese Reviews    Quoc Thai Nguyen, Thoai Linh Nguyen, Ngoc Hoang Luong, Quoc Hung Ngo arXiv_CL arXiv_CL  Transformer  Bert  Review  Pose  Classification  Deep_Learning  Sentiment  PDF
• 2020-11-19 Fact-level Extractive Summarization with Hierarchical Graph Mask on BERT    Ruifeng Yuan, Zili Wang, Wenjie Li arXiv_CL arXiv_CL  Bert  Salient  Pose  Summarization  PDF
• 2020-11-19 oLMpics -- On what Language Model Pre-training Captures    Alon Talmor, Yanai Elazar, Yoav Goldberg, Jonathan Berant arXiv_AI arXiv_AI  Bert  Zero-Shot  Pose  Language_Model  PDF
• 2020-11-18 Predicting metrical patterns in Spanish poetry with language models    Javier de la Rosa, Salvador Ros, Elena González-Blanco arXiv_CL arXiv_CL  Bert  Language_Model  PDF
• 2020-11-18 A Sequence-to-Sequence Approach to Dialogue State Tracking    Yue Feng, Yang Wang, Hang Li arXiv_AI arXiv_AI  Embedding  Tracking  Bert  Pose  Relation  Attention  PDF
• 2020-11-18 Palomino-Ochoa at SemEval-2020 Task 9: Robust System based on Transformer for Code-Mixed Sentiment Classification    Daniel Palomino, Jose Ochoa-Luna arXiv_CL arXiv_CL  Transformer  Transfer_Learning  Bert  Sentiment_Classification  Classification  Detection  Sentiment  Language_Model  PDF
• 2020-11-18 On the use of Self-supervised Pre-trained Acoustic and Linguistic Features for Continuous Speech Emotion Recognition    Manon Macary, Marie Tahon, Yannick Estève, Anthony Rousseau arXiv_CL arXiv_CL  Embedding  Recognition  Bert  Knowledge  Speech  Self-Supervised  Emotion  Action  Relation  Language_Model  PDF
• 2020-11-18 Do Fine-tuned Commonsense Language Models Really Generalize?    Mayank Kejriwal, Ke Shen arXiv_AI arXiv_AI  Transformer  Bert  Language_Model  PDF
• 2020-11-18 Diverse and Non-redundant Answer Set Extraction on Community QA based on DPPs    Shogo Fujita, Tomohide Shibata, Manabu Okumura arXiv_CL arXiv_CL  Bert  Pose  Action  QA  PDF
• 2020-11-18 Tie Your Embeddings Down: Cross-Modal Latent Spaces for End-to-end Spoken Language Understanding    Bhuvan Agrawal, Markus Müller, Martin Radfar, Samridhi Choudhary, Athanasios Mouchtaris, Siegfried Kunzmann arXiv_CL arXiv_CL  Embedding  Bert  Pose  PDF
• 2020-11-17 SIENA: Stochastic Multi-Expert Neural Patcher    Thai Le, Noseong Park, Dongwon Lee arXiv_CL arXiv_CL  Bert  RNN  Adversarial  Pose  PDF
• 2020-11-17 MVP-BERT: Redesigning Vocabularies for Chinese BERT and Multi-Vocab Pretraining    Wei Zhu arXiv_CL arXiv_CL  Segmentation  Bert  Pose  Language_Model  PDF
• 2020-11-17 Self-supervised Document Clustering Based on BERT with Data Augment    Haoxiang Shi, Cen Wang, Tetsuya Sakai arXiv_AI arXiv_AI  Unsupervised  Bert  Self-Supervised  Pose  Contrastive_Learning  PDF
• 2020-11-16 Don't Patronize Me! An Annotated Dataset with Patronizing and Condescending Language towards Vulnerable Communities    Carla Pérez-Almendros, Luis Espinosa-Anke, Steven Schockaert arXiv_CL arXiv_CL  Bert  Pose  Language_Model  PDF
• 2020-11-16 Beyond I.I.D.: Three Levels of Generalization for Question Answering on Knowledge Bases    Yu Gu, Sue Kase, Michelle Vanni, Brian Sadler, Percy Liang, Xifeng Yan, Yu Su arXiv_AI arXiv_AI  Embedding  Bert  Zero-Shot  Knowledge  Pose  QA  PDF
• 2020-11-16 IIT_kgp at FinCausal 2020, Shared Task 1: Causality Detection using Sentence Embeddings in Financial Reports    Arka Mitra, Harshvardhan Srivastava, Yugam Tiwari arXiv_CL arXiv_CL  Embedding  Bert  Detection  PDF
• 2020-11-15 Good proctor or 'Big Brother'? AI Ethics and Online Exam Supervision Technologies    Simon Coghlan, Tim Miller, Jeannie Paterson arXiv_AI arXiv_AI  Bert  Review  PDF
• 2020-11-14 CL-IMS @ DIACR-Ita: Volente o Nolente: BERT does not outperform SGNS on Semantic Change Detection    Severin Laicher, Gioia Baldissin, Enrique Castañeda, Dominik Schlechtweg, Sabine Schulte im Walde arXiv_CL arXiv_CL  Embedding  Bert  Detection  PDF
• 2020-11-14 ActBERT: Learning Global-Local Video-Text Representations    Linchao Zhu, Yi Yang arXiv_CV arXiv_CV  Transformer  Segmentation  Video_Caption  Bert  Represenation_Learning  Self-Supervised  Action  Relation  Caption  PDF
• 2020-11-14 Utilizing Bidirectional Encoder Representations from Transformers for Answer Selection    Md Tahmid Rahman Laskar, Enamul Hoque, Jimmy Xiangji Huang arXiv_CL arXiv_CL  Transformer  Bert  Language_Model  QA  PDF
• 2020-11-13 Sparse Representations of Positive Functions via Projected Pseudo-Mirror Descent    Abhishek Chakraborty, Ketan Rajawat, Alec Koppel arXiv_CV arXiv_CV  Bert  Optimization  Sparse  Matching  PDF
• 2020-11-13 Multi-Modal Emotion Detection with Transfer Learning    Amith Ananthram, Kailash Karthik Saravanakumar, Jessica Huynh, Homayoon Beigi arXiv_CL arXiv_CL  Embedding  Transfer_Learning  Bert  Speech  Emotion  Detection  PDF
• 2020-11-13 FLERT: Document-Level Features for Named Entity Recognition    Stefan Schweter, Alan Akbik arXiv_CL arXiv_CL  Transformer  Recognition  Bert  RNN  Prediction  Recommendation  PDF
• 2020-11-13 Arabic Dialect Identification Using BERT-Based Domain Adaptation    Ahmad Beltagy, Abdelrahman Wael, Omar ElSherief arXiv_CL arXiv_CL  Bert  Deep_Learning  PDF
• 2020-11-12 An Interpretable End-to-end Fine-tuning Approach for Long Clinical Text    Kexin Huang, Sankeerth Garapati, Alexander S. Rich arXiv_CL arXiv_CL  Bert  Text_Classification  Pose  Action  Classification  Prediction  Matching  PDF
• 2020-11-12 Biomedical Named Entity Recognition at Scale    Veysel Kocaman, David Talby arXiv_AI arXiv_AI  Embedding  Recognition  Bert  RNN  Action  Deep_Learning  Detection  Relation  Relation_Extraction  Medical  Inference  PDF
• 2020-11-12 Augmenting BERT Carefully with Underrepresented Linguistic Features    Aparna Balagopalan, Jekaterina Novikova arXiv_CL arXiv_CL  Transformer  Bert  Speech  Classification  Detection  PDF
• 2020-11-12 Identifying Depressive Symptoms from Tweets: Figurative Language Enabled Multitask Learning Framework    Shweta Yadav, Jainish Chauhan, Joy Prakash Sain, Krishnaprasad Thirunarayan, Amit Sheth, Jeremiah Schumm arXiv_CL arXiv_CL  Bert  Pose  Detection  Attention  PDF
• 2020-11-12 Author's Sentiment Prediction    Mohaddeseh Bastan, Mahnaz Koupaee, Youngseo Son, Richard Sicoli, Niranjan Balasubramanian arXiv_CL arXiv_CL  Bert  Pose  Classification  Sentiment  Prediction  PDF
• 2020-11-11 Multilingual Irony Detection with Dependency Syntax and Neural Models    Alessandra Teresa Cignarella, Valerio Basile, Manuela Sanguinetti, Cristina Bosco, Paolo Rosso, Farah Benamara arXiv_CL arXiv_CL  Embedding  Bert  Knowledge  Detection  PDF
• 2020-11-11 Recognizing More Emotions with Less Data Using Self-supervised Transfer Learning    Jonathan Boigne, Biman Liyanage, Ted Östrem arXiv_SD arXiv_SD  Transfer_Learning  Recognition  Bert  Knowledge  Speech  Self-Supervised  Pose  Emotion  Attention  PDF
• 2020-11-11 NIT COVID-19 at WNUT-2020 Task 2: Deep Learning Model RoBERTa for Identify Informative COVID-19 English Tweets    Jagadeesh M S, Alphonse P J A arXiv_CL arXiv_CL  Bert  Pose  Classification  Deep_Learning  PDF
• 2020-11-11 Towards Semi-Supervised Semantics Understanding from Speech    Cheng-I Lai, Jin Cao, Sravan Bodapati, Shang-Wen Li arXiv_AI arXiv_AI  Recognition  Bert  Speech  Self-Supervised  Pose  Speech_Recognition  Language_Model  PDF
• 2020-11-10 Detecting Social Media Manipulation in Low-Resource Languages    Samar Haider, Luca Luceri, Ashok Deb, Adam Badawy, Nanyun Peng, Emilio Ferrara arXiv_AI arXiv_AI  Embedding  Transfer_Learning  Bert  Knowledge  Pose  Detection  Activity  PDF
• 2020-11-10 UmBERTo-MTSA @ AcCompl-It: Improving Complexity and Acceptability Prediction with Multi-task Learning on Self-Supervised Annotations    Gabriele Sarti arXiv_CL arXiv_CL  Bert  Self-Supervised  Language_Model  Prediction  PDF
• 2020-11-10 To What Degree Can Language Borders Be Blurred In BERT-based Multilingual Spoken Language Understanding?    Quynh Do, Judith Gaspers, Tobias Roding, Melanie Bradford arXiv_AI arXiv_AI  Bert  Knowledge  Adversarial  Pose  PDF
• 2020-11-10 SelfDeco: Self-Supervised Monocular Depth Completion in Challenging Indoor Environments    Jaehoon Choi, Dongki Jung, Yonghan Lee, Deokhwa Kim, Dinesh Manocha, Donghwan Lee arXiv_CV arXiv_CV  Bert  Sparse  Self-Supervised  Face  PDF
• 2020-11-10 When Do You Need Billions of Words of Pretraining Data?    Yian Zhang, Alex Warstadt, Haau-Sing Li, Samuel R. Bowman arXiv_CL arXiv_CL  Transformer  Unsupervised  Bert  Knowledge  Pose  Language_Model  PDF
• 2020-11-10 Determining Question-Answer Plausibility in Crowdsourced Datasets Using Multi-Task Learning    Rachel Gardner, Maya Varma, Clare Zhu, Ranjay Krishna arXiv_AI arXiv_AI  Bert  Action  QA  PDF
• 2020-11-10 A Transfer Learning Approach for Dialogue Act Classification of GitHub Issue Comments    Ayesha Enayet, Gita Sukthankar arXiv_CL arXiv_CL  Transformer  Transfer_Learning  Bert  Classification  PDF
• 2020-11-09 Language Through a Prism: A Spectral Approach for Multiscale Language Representations    Alex Tamkin, Dan Jurafsky, Noah Goodman arXiv_CL arXiv_CL  Embedding  Bert  Speech  Pose  Classification  PDF
• 2020-11-09 EstBERT: A Pretrained Language-Specific BERT for Estonian    Hasan Tanvir, Claudia Kittask, Kairit Sirts arXiv_CL arXiv_CL  Transformer  Recognition  Bert  Text_Classification  Classification  PDF
• 2020-11-09 VisBERT: Hidden-State Visualizations for Transformers    Betty van Aken, Benjamin Winter, Alexander Löser, Felix A. Gers arXiv_CL arXiv_CL  Transformer  Bert  Attention  Inference  Prediction  PDF
• 2020-11-09 Catch the 'Tails' of BERT    Ziyang Luo arXiv_CL arXiv_CL  Embedding  Bert  Relation  PDF
• 2020-11-09 Character-level Representations Improve DRS-based Semantic Parsing Even in the Age of BERT    Rik van Noord, Antonio Toral, Johan Bos arXiv_CL arXiv_CL  Embedding  Bert  Language_Model  PDF
• 2020-11-09 BERT-JAM: Boosting BERT-Enhanced Neural Machine Translation with Joint Attention    Zhebin Zhang, Sai Wu, Dawei Jiang, Gang Chen arXiv_CL arXiv_CL  Transformer  Bert  Optimization  Pose  NMT  Attention  PDF
• 2020-11-09 CxGBERT: BERT meets Construction Grammar    Harish Tayyar Madabushi, Laurence Romain, Dagmar Divjak, Petar Milin arXiv_CL arXiv_CL  Bert  Deep_Learning  PDF
• 2020-11-06 Improving Machine Reading Comprehension with Single-choice Decision and Transfer Learning    Yufan Jiang, Shuangzhi Wu, Jing Gong, Yahui Cheng, Peng Meng, Weiliang Lin, Zhibo Chen, Mu li arXiv_CL arXiv_CL  Transfer_Learning  Bert  Knowledge  Classification  PDF
• 2020-11-06 Improving Prosody Modelling with Cross-Utterance BERT Embeddings for End-to-end Speech Synthesis    Guanghui Xu, Wei Song, Zhengchen Zhang, Chao Zhang, Xiaodong He, Bowen Zhou arXiv_SD arXiv_SD  Embedding  Bert  Speech  Pose  PDF
• 2020-11-05 CODER: Knowledge infused cross-lingual medical term embedding for term normalization    Zheng Yuan, Zhengyun Zhao, Sheng Yu arXiv_CL arXiv_CL  Embedding  Bert  Knowledge  Knowledge_Graph  Pose  Classification  Relation  Medical  PDF
• 2020-11-05 NUAA-QMUL at SemEval-2020 Task 8: Utilizing BERT and DenseNet for Internet Meme Emotion Analysis    Xiaoyu Guo, Jing Ma, Arkaitz Zubiaga arXiv_CL arXiv_CL  Embedding  Bert  Emotion  Classification  Sentiment  Image_Classification  PDF
• 2020-11-04 MTLB-STRUCT @PARSEME 2020: Capturing Unseen Multiword Expressions Using Multi-task Learning and Pre-trained Masked Language Models    Shiva Taslimipoor, Sara Bahaadini, Ekaterina Kochmar arXiv_CL arXiv_CL  Bert  Language_Model  Prediction  PDF
• 2020-11-04 Investigating Novel Verb Learning in BERT: Selectional Preference Classes and Alternation-Based Syntactic Generalization    Tristan Thrush, Ethan Wilcox, Roger Levy arXiv_CL arXiv_CL  Bert  Pose  Deep_Learning  Relation  Few-Shot  PDF
• 2020-11-04 A BERT-based Dual Embedding Model for Chinese Idiom Prediction    Minghuan Tan, Jing Jiang arXiv_CL arXiv_CL  Embedding  Bert  Pose  Prediction  Matching  PDF
• 2020-11-04 Prosodic Representation Learning and Contextual Sampling for Neural Text-to-Speech    Sri Karlapati, Ammar Abbas, Zack Hodari, Alexis Moinet, Arnaud Joly, Penny Karanasou, Thomas Drugman arXiv_CL arXiv_CL  Bert  Represenation_Learning  Speech  Pose  Attention  PDF
• 2020-11-04 Chinese Grammatical Correction Using BERT-based Pre-trained Model    Hongfei Wang, Michiki Kurosawa, Satoru Katsumata, Mamoru Komachi arXiv_CL arXiv_CL  Bert  PDF
• 2020-11-04 Probing Multilingual BERT for Genetic and Typological Signals    Taraka Rama, Lisa Beinborn, Steffen Eger arXiv_CL arXiv_CL  Bert  PDF
• 2020-11-03 Bertrand-DR: Improving Text-to-SQL using a Discriminative Re-ranker    Amol Kelkar, Rohan Relan, Vaishali Bhardwaj, Saurabh Vaichal, Chandra Khatri, Peter Relan arXiv_AI arXiv_AI  Bert  Pose  Relation  PDF
• 2020-11-03 Finding Friends and Flipping Frenemies: Automatic Paraphrase Dataset Augmentation Using Graph Theory    Hannah Chen, Yangfeng Ji, David Evans arXiv_CL arXiv_CL  Bert  Pose  PDF
• 2020-11-03 Tabular Transformers for Modeling Multivariate Time Series    Inkit Padhi, Yair Schiff, Igor Melnyk, Mattia Rigotti, Youssef Mroueh, Pierre Dognin, Jerret Ross, Ravi Nair, Erik Altman arXiv_AI arXiv_AI  Transformer  Bert  Pose  Action  Deep_Learning  Detection  PDF
• 2020-11-03 Towards Automated Anamnesis Summarization: BERT-based Models for Symptom Extraction    Anton Schäfer, Nils Blach, Oliver Rausch, Maximilian Warm, Nils Krüger arXiv_CL arXiv_CL  Bert  Pose  Action  Summarization  PDF
• 2020-11-03 XED: A Multilingual Dataset for Sentiment Analysis and Emotion Detection    Emily Öhman, Marc Pàmies, Kaisla Kajava, Jörg Tiedemann arXiv_CL arXiv_CL  Bert  Emotion  Detection  Sentiment  PDF
• 2020-11-03 CharBERT: Character-aware Pre-trained Language Model    Wentao Ma, Yiming Cui, Chenglei Si, Ting Liu, Shijin Wang, Guoping Hu arXiv_CL arXiv_CL  Embedding  Unsupervised  Bert  Text_Classification  Represenation_Learning  Adversarial  Pose  Action  Classification  Language_Model  PDF
• 2020-11-03 BioNerFlair: biomedical named entity recognition using flair embedding and sequence tagger    Harsh Patel arXiv_CL arXiv_CL  Transformer  Embedding  Recognition  OCR  Bert  RNN  Action  Medical  PDF
• 2020-11-03 Supervised Contrastive Learning for Pre-trained Language Model Fine-tuning    Beliz Gunel, Jingfei Du, Alexis Conneau, Ves Stoyanov arXiv_CL arXiv_CL  Unsupervised  Bert  Pose  Contrastive_Learning  Classification  Language_Model  PDF
• 2020-11-02 QMUL-SDS at SardiStance2020: Leveraging Network Interactions to Boost Performance on Stance Detection using Knowledge Graphs    Rabab Alkhalifa, Arkaitz Zubiaga arXiv_CL arXiv_CL  Embedding  Bert  RNN  Knowledge  Knowledge_Graph  Action  Detection  PDF
• 2020-11-02 Introducing various Semantic Models for Amharic: Experimentation and Evaluation with multiple Tasks and Datasets    Seid Muhie Yimam, Abinew Ali Ayele, Gopalakrishnan Venkatesh, Chris Biemann arXiv_CL arXiv_CL  Embedding  Bert  Language_Model  PDF
• 2020-11-02 DNN-Based Semantic Model for Rescoring N-best Speech Recognition List    Dominique Fohr, Irina Illina arXiv_CL arXiv_CL  Embedding  Recognition  Bert  RNN  Speech  Pose  Relation  Speech_Recognition  Language_Model  PDF
• 2020-11-02 A Closer Look at Linguistic Knowledge in Masked Language Models: The Case of Relative Clauses in American English    Marius Mosbach, Stefania Degaetano-Ortlieb, Marie-Pauline Krielke, Badr M. Abdullah, Dietrich Klakow arXiv_CL arXiv_CL  Transformer  Bert  Knowledge  Language_Model  Prediction  PDF
• 2020-11-02 On the Sentence Embeddings from Pre-trained Language Models    Bohan Li, Hao Zhou, Junxian He, Mingxuan Wang, Yiming Yang, Lei Li arXiv_CL arXiv_CL  Embedding  Unsupervised  Bert  Pose  Language_Model  PDF
• 2020-11-02 How Far Does BERT Look At:Distance-based Clustering and Analysis of BERTś Attention    Yue Guan, Jingwen Leng, Chao Li, Quan Chen, Minyi Guo arXiv_CL arXiv_CL  Transformer  Unsupervised  Bert  Pose  Attention  PDF
• 2020-11-02 Abstracting Influence Paths for Explaining BERT Models    Kaiji Lu, Zifan Wang, Piotr Mardziel, Anupam Datta arXiv_CL arXiv_CL  Bert  Action  Attention  PDF
• 2020-11-02 ABNIRML: Analyzing the Behavior of Neural IR Models    Sean MacAvaney, Sergey Feldman, Nazli Goharian, Doug Downey, Arman Cohan arXiv_CL arXiv_CL  Bert  Language_Model  PDF
• 2020-11-02 Liputan6: A Large-scale Indonesian Dataset for Text Summarization    Fajri Koto, Jey Han Lau, Timothy Baldwin arXiv_CL arXiv_CL  Bert  Pose  Summarization  Language_Model  PDF
• 2020-11-02 IndoLEM and IndoBERT: A Benchmark Dataset and Pre-trained Language Model for Indonesian NLP    Fajri Koto, Afshin Rahimi, Jey Han Lau, Timothy Baldwin arXiv_CL arXiv_CL  Bert  Language_Model  PDF
• 2020-11-01 Deconstruct to Reconstruct a Configurable Evaluation Metric for Open-Domain Dialogue Systems    Vitou Phy, Yang Zhao, Akiko Aizawa arXiv_AI arXiv_AI  Bert  Pose  Relation  PDF
• 2020-11-01 Transformer-based Multi-Aspect Modeling for Multi-Aspect Multi-Sentiment Analysis    Zhen Wu, Chengcan Ying, Xinyu Dai, Shujian Huang, Jiajun Chen arXiv_CL arXiv_CL  Transformer  Bert  Pose  Relation  Sentiment  PDF
• 2020-11-01 Investigation of BERT Model on Biomedical Relation Extraction Based on Revised Fine-tuning Mechanism    Peng Su, K. Vijay-Shanker arXiv_CL arXiv_CL  Transformer  Bert  Knowledge  Action  Classification  Relation  Relation_Extraction  Medical  PDF
• 2020-10-31 Neural Coreference Resolution for Arabic    Abdulrahman Aloraini, Juntao Yu, Massimo Poesio arXiv_CL arXiv_CL  Bert  Detection  Object_Detection  PDF
• 2020-10-31 Free the Plural: Unrestricted Split-Antecedent Anaphora Resolution    Juntao Yu, Nafise Sadat Moosavi, Silviu Paun, Massimo Poesio arXiv_CL arXiv_CL  Embedding  Transfer_Learning  Bert  Attention  PDF
• 2020-10-31 Understanding Pre-trained BERT for Aspect-based Sentiment Analysis    Hu Xu, Lei Shu, Philip S. Yu, Bing Liu arXiv_CL arXiv_CL  Unsupervised  Bert  Review  Self-Supervised  Sentiment  Attention  Language_Model  PDF
• 2020-10-30 Improving Dialogue Breakdown Detection with Semi-Supervised Learning    Nathan Ng, Marzyeh Ghassemi, Narendran Thangarajan, Jiacheng Pan, Qi Guo arXiv_CL arXiv_CL  Bert  Detection  PDF
• 2020-10-30 A Sui Generis QA Approach using RoBERTa for Adverse Drug Event Identification    Harshit Jain, Nishant Raj, Suyash Mishra arXiv_AI arXiv_AI  Bert  RNN  Memory_Networks  Action  Relation  Relation_Extraction  Attention  Medical  QA  PDF
• 2020-10-30 SLM: Learning a Discourse Language Representation with Sentence Unshuffling    Haejun Lee, Drew A. Hudson, Kangwook Lee, Christopher D. Manning arXiv_CL arXiv_CL  Transformer  Bert  Self-Supervised  Pose  Classification  Relation  Language_Model  PDF
• 2020-10-30 Target Word Masking for Location Metonymy Resolution    Haonan Li, Maria Vasardani, Martin Tomko, Timothy Baldwin arXiv_CL arXiv_CL  Bert  Pose  Classification  PDF
• 2020-10-29 Contextual BERT: Conditioning the Language Model Using a Global State    Timo I. Denk, Ana Peleteiro Ramallo arXiv_CL arXiv_CL  Bert  Language_Model  Prediction  PDF
• 2020-10-29 Combining Self-Training and Self-Supervised Learning for Unsupervised Disfluency Detection    Shaolei Wang, Zhongyuan Wang, Wanxiang Che, Ting Liu arXiv_CL arXiv_CL  Embedding  Unsupervised  Bert  Self-Supervised  Detection  PDF
• 2020-10-29 Multiple Sclerosis Severity Classification From Clinical Text    Alister D Costa, Stefan Denkovski, Michal Malyska, Sae Young Moon, Brandon Rufino, Zhen Yang, Taylor Killian, Marzyeh Ghassemi arXiv_CL arXiv_CL  Transformer  Embedding  Bert  Knowledge  Classification  Language_Model  Prediction  PDF
• 2020-10-28 Fusion Models for Improved Visual Captioning    Marimuthu Kalimuthu, Aditya Mogadala, Marius Mosbach, Dietrich Klakow arXiv_AI arXiv_AI  Image_Caption  Recognition  Bert  Speech  Pose  Speech_Recognition  Caption  Language_Model  PDF
• 2020-10-28 DeSMOG: Detecting Stance in Media On Global Warming    Yiwei Luo, Dallas Card, Dan Jurafsky arXiv_AI arXiv_AI  OCR  Bert  Detection  Attention  PDF
• 2020-10-28 Graph-based Topic Extraction from Vector Embeddings of Text Documents: Application to a Corpus of News Articles    M. Tarik Altuncu, Sophia N. Yaliraki, Mauricio Barahona arXiv_AI arXiv_AI  Transformer  Embedding  Unsupervised  Bert  Action  PDF
• 2020-10-28 Bayesian Methods for Semi-supervised Text Annotation    Kristian Miok, Gregor Pirs, Marko Robnik-Sikonja arXiv_CL arXiv_CL  Bert  Knowledge  Speech  Pose  Deep_Learning  Detection  Prediction  PDF
• 2020-10-28 A Chinese Text Classification Method With Low Hardware Requirement Based on Improved Model Concatenation    Yuanhao Zhuo arXiv_CL arXiv_CL  Bert  Text_Classification  RNN  Classification  PDF
• 2020-10-27 Unmasking Contextual Stereotypes: Measuring and Mitigating BERT's Gender Bias    Marion Bartl, Malvina Nissim, Albert Gatt arXiv_CL arXiv_CL  Embedding  Bert  Knowledge  Language_Model  PDF
• 2020-10-27 A Clarifying Question Selection System from NTES_ALONG in Convai3 Challenge    Wenjie Ou, Yue Lin arXiv_AI arXiv_AI  Bert  Pose  PDF
• 2020-10-27 MMFT-BERT: Multimodal Fusion Transformer with BERT Encodings for Visual Question Answering    Aisha Urooj Khan, Amir Mazaheri, Niels da Vitoria Lobo, Mubarak Shah arXiv_CV arXiv_CV  Transformer  Bert  Knowledge  Pose  VQA  QA  PDF
• 2020-10-27 To BERT or Not to BERT: Comparing Task-specific and Task-agnostic Semi-Supervised Approaches for Sequence Tagging    Kasturi Bhattacharjee, Miguel Ballesteros, Rishita Anubhai, Smaranda Muresan, Jie Ma, Faisal Ladhak, Yaser Al-Onaizan arXiv_CL arXiv_CL  Transformer  Bert  PDF
• 2020-10-26 Fine-grained Information Status Classification Using Discourse Context-Aware BERT    Yufang Hou arXiv_CL arXiv_CL  Recognition  Bert  Pose  Classification  PDF
• 2020-10-26 Semi-Supervised Spoken Language Understanding via Self-Supervised Speech and Language Model Pretraining    Cheng-I Lai, Yung-Sung Chuang, Hung-Yi Lee, Shang-Wen Li, James Glass arXiv_CL arXiv_CL  Unsupervised  Bert  Speech  Self-Supervised  Pose  Language_Model  PDF
• 2020-10-26 Dutch Humor Detection by Generating Negative Examples    Thomas Winters, Pieter Delobelle arXiv_AI arXiv_AI  Transformer  Recognition  Bert  Pose  Classification  Detection  Text_Generation  Language_Model  PDF
• 2020-10-26 UPB at SemEval-2020 Task 12: Multilingual Offensive Language Detection on Social Media by Fine-tuning a Variety of BERT-based Models    Mircea-Adrian Tanase, Dumitru-Clementin Cercel, Costing-Gabriel Chiru arXiv_CL arXiv_CL  Transformer  Bert  Pose  Detection  PDF
• 2020-10-26 Three computational models and its equivalence    Ciro Ivan Garcia Lopez arXiv_CL arXiv_CL  Bert  PDF
• 2020-10-25 Two-stage Textual Knowledge Distillation to Speech Encoder for Spoken Language Understanding    Seongbin Kim, Gyuwan Kim, Seongjin Shin, Sangmin Lee arXiv_CL arXiv_CL  Recognition  Bert  Knowledge  Speech  Pose  Speech_Recognition  PDF
• 2020-10-25 Contextualized Word Embeddings Encode Aspects of Human-Like Word Sense Knowledge    Sathvik Nair, Mahesh Srinivasan, Stephan Meylan arXiv_CL arXiv_CL  Embedding  Bert  Knowledge  PDF
• 2020-10-25 Commonsense knowledge adversarial dataset that challenges ELECTRA    Gongqi Lin, Yuan Miao, Xiaoyong Yang, Wenwu Ou, Lizhen Cui, Wei Guo, Chunyan Miao arXiv_CL arXiv_CL  Bert  Knowledge  Adversarial  QA  PDF
• 2020-10-25 CRAB: Class Representation Attentive BERT for Hate Speech Identification in Social Media    Sayyed M. Zahiri, Ali Ahmadvand arXiv_AI arXiv_AI  Embedding  Bert  Speech  Detection  PDF
• 2020-10-25 Discriminative Nearest Neighbor Few-Shot Intent Detection by Transferring Natural Language Inference    Jian-Guo Zhang, Kazuma Hashimoto, Wenhao Liu, Chien-Sheng Wu, Yao Wan, Philip S. Yu, Richard Socher, Caiming Xiong arXiv_AI arXiv_AI  Embedding  Bert  Pose  Classification  Detection  Few-Shot  Attention  Inference  PDF
• 2020-10-24 Pre-trained Summarization Distillation    Sam Shleifer, Alexander M. Rush arXiv_AI arXiv_AI  Transformer  Bert  Knowledge  Face  Classification  Summarization  PDF
• 2020-10-24 Causal Effects of Linguistic Properties    Reid Pryzant, Dallas Card, Dan Jurafsky, Victor Veitch, Dhanya Sridhar arXiv_AI arXiv_AI  Bert  Review  Pose  Sentiment  Language_Model  Prediction  PDF
• 2020-10-24 Unsupervised Paraphrase Generation via Dynamic Blocking    Tong Niu, Semih Yavuz, Yingbo Zhou, Huan Wang, Nitish Shirish Keskar, Caiming Xiong arXiv_CL arXiv_CL  Unsupervised  Bert  Pose  Face  Language_Model  Matching  PDF
• 2020-10-24 When Being Unseen from mBERT is just the Beginning: Handling New Languages With Multilingual Language Models    Benjamin Muller, Antonis Anastasopoulos, Benoît Sagot, Djamé Seddah arXiv_CL arXiv_CL  Transfer_Learning  Bert  Language_Model  PDF
• 2020-10-24 Weakly-supervised VisualBERT: Pre-training without Parallel Images and Captions    Liunian Harold Li, Haoxuan You, Zhecan Wang, Alireza Zareian, Shih-Fu Chang, Kai-Wei Chang arXiv_CV arXiv_CV  Recognition  Bert  Pose  Caption  PDF
• 2020-10-24 Cross-neutralising: Probing for joint encoding of linguistic information in multilingual models    Rochelle Choenni, Ekaterina Shutova arXiv_CL arXiv_CL  Bert  Pose  Relation  PDF
• 2020-10-24 Pre-training Text-to-Text Transformers for Concept-centric Common Sense    Wangchunshu Zhou, Dong-Ho Lee, Ravi Kiran Selvam, Seyeon Lee, Bill Yuchen Lin, Xiang Ren arXiv_AI arXiv_AI  Transformer  Bert  Knowledge  Knowledge_Graph  Self-Supervised  Pose  Relation  Language_Model  Prediction  PDF
• 2020-10-24 COUGH: A Challenge Dataset and Models for COVID-19 FAQ Retrieval    Xinliang Frederick Zhang, Heming Sun, Xiang Yue, Emmett Jesrani, Simon Lin, Huan Sun arXiv_CL arXiv_CL  Bert  PDF
• 2020-10-24 Multi-Domain Dialogue State Tracking -- A Purely Transformer-Based Generative Approach    Yan Zeng, Jian-Yun Nie arXiv_AI arXiv_AI  Transformer  Tracking  Bert  RNN  Pose  Ontology  Attention  Prediction  PDF
• 2020-10-24 Structure-Grounded Pretraining for Text-to-SQL    Xiang Deng, Ahmed Hassan Awadallah, Christopher Meek, Oleksandr Polozov, Huan Sun, Matthew Richardson arXiv_AI arXiv_AI  Bert  Weakly_Supervised  Prediction  PDF
• 2020-10-24 Char2Subword: Extending the Subword Embedding Space from Pre-trained Models Using Robust Character Compositionality    Gustavo Aguilar, Bryan McCann, Tong Niu, Nazneen Rajani, Nitish Keskar, Thamar Solorio arXiv_CL arXiv_CL  Transformer  Embedding  Bert  Adversarial  Pose  Language_Model  PDF
• 2020-10-23 Long Document Ranking with Query-Directed Sparse Transformer    Jyun-Yu Jiang, Chenyan Xiong, Chia-Jung Lee, Wei Wang arXiv_AI arXiv_AI  Transformer  Bert  Sparse  Few-Shot  Attention  Prediction  Matching  PDF
• 2020-10-23 Posterior Differential Regularization with f-divergence for Improving Model Robustness    Hao Cheng, Xiaodong Liu, Lis Pereira, Yaoliang Yu, Jianfeng Gao arXiv_CL arXiv_CL  Bert  Regularization  Adversarial  Pose  PDF
• 2020-10-23 Did You Ask a Good Question? A Cross-Domain Question Intention Classification Benchmark for Text-to-SQL    Yusen Zhang, Xiangyu Dong, Shuaichen Chang, Tao Yu, Peng Shi, Rui Zhang arXiv_CL arXiv_CL  Bert  Pose  Classification  PDF
• 2020-10-23 Topic Modeling with Contextualized Word Representation Clusters    Laure Thompson, David Mimno arXiv_CL arXiv_CL  Embedding  Bert  GAN  Language_Model  PDF
• 2020-10-23 DICT-MLM: Improved Multilingual Pre-Training using Bilingual Dictionaries    Aditi Chaudhary, Karthik Raman, Krishna Srinivasan, Jiecao Chen arXiv_CL arXiv_CL  Bert  Zero-Shot  Represenation_Learning  Pose  Language_Model  PDF
• 2020-10-23 On the Transformer Growth for Progressive BERT Training    Xiaotao Gu, Liyuan Liu, Hongkun Yu, Jing Li, Chen Chen, Jiawei Han arXiv_CL arXiv_CL  Transformer  Bert  Pose  PDF
• 2020-10-23 Multilingual BERT Post-Pretraining Alignment    Lin Pan, Chung-Wei Hang, Haode Qi, Abhishek Shah, Mo Yu, Saloni Potdar arXiv_CL arXiv_CL  Embedding  Bert  Zero-Shot  Pose  Contrastive_Learning  Language_Model  QA  PDF
• 2020-10-23 GiBERT: Introducing Linguistic Knowledge into BERT through a Lightweight Gated Injection Method    Nicole Peinelt, Marek Rei, Maria Liakata arXiv_CL arXiv_CL  Embedding  Unsupervised  Bert  Knowledge  Pose  Language_Model  PDF
• 2020-10-23 Understanding the Extent to which Summarization Evaluation Metrics Measure the Information Quality of Summaries    Daniel Deutsch, Dan Roth arXiv_CL arXiv_CL  Bert  Pose  Summarization  PDF
• 2020-10-23 HateBERT: Retraining BERT for Abusive Language Detection in English    Tommaso Caselli, Valerio Basile, Jelena Mitrović, Michael Granitzer arXiv_CL arXiv_CL  Bert  Speech  Detection  Language_Model  PDF
• 2020-10-23 BARThez: a Skilled Pretrained French Sequence-to-Sequence Model    Moussa Kamal Eddine, Antoine J.-P. Tixier, Michalis Vazirgiannis arXiv_CL arXiv_CL  Transfer_Learning  Bert  Knowledge  Self-Supervised  Summarization  Language_Model  PDF
• 2020-10-23 ST-BERT: Cross-modal Language Model Pre-training For End-to-end Spoken Language Understanding    Minjeong Kim, Gyuwan Kim, Sang-Woo Lee, Jung-Woo Ha arXiv_CL arXiv_CL  Bert  Speech  Pose  Language_Model  PDF
• 2020-10-23 Pre-trained Model for Chinese Word Segmentation with Meta Learning    Zhen Ke, Liang Shi, Erli Meng, Bin Wang, Xipeng Qiu arXiv_CL arXiv_CL  Segmentation  Bert  Knowledge  Pose  PDF
• 2020-10-23 ERNIE-Gram: Pre-Training with Explicitly N-Gram Masked Language Modeling for Natural Language Understanding    Dongling Xiao, Yu-Kun Li, Han Zhang, Yu Sun, Hao Tian, Hua Wu, Haifeng Wang arXiv_CL arXiv_CL  Bert  Represenation_Learning  Pose  Relation  Language_Model  Prediction  PDF
• 2020-10-22 Summarizing Utterances from Japanese Assembly Minutes using Political Sentence-BERT-based Method for QA Lab-PoliInfo-2 Task of NTCIR-15    Daiki Shirafuji, Hiromichi Kameya, Rafal Rzepka, Kenji Araki arXiv_CL arXiv_CL  Embedding  Bert  Summarization  QA  PDF
• 2020-10-22 Language Models are Open Knowledge Graphs    Chenguang Wang, Xiao Liu, Dawn Song arXiv_AI arXiv_AI  Unsupervised  Bert  Knowledge  Knowledge_Graph  Pose  Language_Model  PDF
• 2020-10-22 UniCase -- Rethinking Casing in Language Models    Rafal Powalski, Tomasz Stanislawek arXiv_AI arXiv_AI  Bert  Pose  Language_Model  PDF
• 2020-10-22 Rewriting Meaningful Sentences via Conditional BERT Sampling and an application on fooling text classifiers    Lei Xu, Ivan Ramirez, Kalyan Veeramachaneni arXiv_AI arXiv_AI  Bert  Adversarial  Pose  Prediction  PDF
• 2020-10-22 Self-alignment Pre-training for Biomedical Entity Representations    Fangyu Liu, Ehsan Shareghi, Zaiqiao Meng, Marco Basaldella, Nigel Collier arXiv_AI arXiv_AI  Bert  Knowledge  Self-Supervised  Pose  Relation  Medical  Language_Model  PDF
• 2020-10-22 Improving BERT Performance for Aspect-Based Sentiment Analysis    Akbar Karimi, Leonardo Rossi, Andrea Prati arXiv_CL arXiv_CL  Bert  Sentiment_Classification  Review  Pose  Action  Classification  Sentiment  Language_Model  PDF
• 2020-10-22 Adversarial Training for Aspect-Based Sentiment Analysis with BERT    Akbar Karimi, Leonardo Rossi, Andrea Prati, Katharina Full arXiv_CL arXiv_CL  Embedding  Bert  Sentiment_Classification  Regularization  Knowledge  Adversarial  Pose  Action  Classification  Sentiment  Language_Model  PDF
• 2020-10-22 Towards Fully Bilingual Deep Language Modeling    Li-Hsin Chang, Sampo Pyysalo, Jenna Kanerva, Filip Ginter arXiv_CL arXiv_CL  Bert  Language_Model  PDF
• 2020-10-22 Knowledge Distillation for BERT Unsupervised Domain Adaptation    Minho Ryu, Kichun Lee arXiv_CL arXiv_CL  Unsupervised  Bert  Sentiment_Classification  Knowledge  Adversarial  Pose  Classification  Sentiment  Language_Model  PDF
• 2020-10-22 Kwame: A Bilingual AI Teaching Assistant for Online SuaCode Courses    George Boateng arXiv_AI arXiv_AI  Bert  QA  PDF
• 2020-10-22 Distilling Dense Representations for Ranking using Tightly-Coupled Teachers    Sheng-Chieh Lin, Jheng-Hong Yang, Jimmy Lin arXiv_CL arXiv_CL  Bert  Sparse  Knowledge  Pose  Action  PDF
• 2020-10-21 Latte-Mix: Measuring Sentence Semantic Similarity with Latent Categorical Mixtures    M. Li, H. Bai, L. Tan, K. Xiong, M. Li, J. Lin arXiv_CL arXiv_CL  Embedding  Bert  Zero-Shot  Pose  Language_Model  PDF
• 2020-10-21 Detection of COVID-19 informative tweets using RoBERTa    Sirigireddy Dhanalaxmi, Rohit Agarwal, Aman Sinha arXiv_CL arXiv_CL  Bert  Detection  PDF
• 2020-10-21 Generalized Conditioned Dialogue Generation Based on Pre-trained Language Model    Yan Zeng, Jian-Yun Nie arXiv_AI arXiv_AI  Bert  Pose  Attention  Language_Model  PDF
• 2020-10-21 German's Next Language Model    Branden Chan, Stefan Schweter, Timo Möller arXiv_CL arXiv_CL  Recognition  Bert  Classification  Language_Model  PDF
• 2020-10-21 BERT for Joint Multichannel Speech Dereverberation with Spatial-aware Tasks    Yang Jiao arXiv_CL arXiv_CL  Transformer  Bert  Speech  Self-Supervised  Pose  PDF
• 2020-10-20 AutoMeTS: The Autocomplete for Medical Text Simplification    Hoang Van, David Kauchak, Gondy Leroy arXiv_CL arXiv_CL  Bert  Medical  Language_Model  Prediction  PDF
• 2020-10-20 Optimal Subarchitecture Extraction For BERT    Adrian de Wynter, Daniel J. Perry arXiv_CL arXiv_CL  NAS  Embedding  Bert  Action  PDF
• 2020-10-20 BERT2DNN: BERT Distillation with Massive Unlabeled Data for Online E-Commerce Search    Yunjiang Jiang, Yue Shang, Ziyang Liu, Hongwei Shen, Yun Xiao, Wei Xiong, Sulong Xu, Weipeng Yan, Di Jin arXiv_AI arXiv_AI  Transformer  Embedding  Bert  Knowledge  Pose  Sentiment  GAN  Prediction  PDF
• 2020-10-20 Open Question Answering over Tables and Text    Wenhu Chen, Ming-Wei Chang, Eva Schlinger, William Wang, William W. Cohen arXiv_AI arXiv_AI  Bert  Sparse  Pose  Attention  Inference  QA  PDF
• 2020-10-20 ConjNLI: Natural Language Inference Over Conjunctive Sentences    Swarnadeep Saha, Yixin Nie, Mohit Bansal arXiv_AI arXiv_AI  Bert  Knowledge  Adversarial  Pose  Inference  Language_Model  PDF
• 2020-10-20 CharacterBERT: Reconciling ELMo and BERT for Word-Level Open-Vocabulary Representations From Characters    Hicham El Boukkouri, Olivier Ferret, Thomas Lavergne, Hiroshi Noji, Pierre Zweigenbaum, Junichi Tsujii arXiv_CL arXiv_CL  Transformer  Bert  Pose  Medical  PDF
• 2020-10-20 UmlsBERT: Clinical Domain Knowledge Augmentation of Contextual Embeddings Using the Unified Medical Language System Metathesaurus    George Michalopoulos, Yuanxin Wang, Hussam Kaka, Helen Chen, Alex Wong arXiv_AI arXiv_AI  Embedding  Recognition  Bert  Knowledge  Medical  Inference  PDF
• 2020-10-20 A Benchmark for Lease Contract Review    Spyretta Leivaditi, Julien Rossi, Evangelos Kanoulas arXiv_CL arXiv_CL  Bert  Review  Action  Detection  Attention  Language_Model  PDF
• 2020-10-20 Text Classification of COVID-19 Press Briefings using BERT and Convolutional Neural Networks    Kakia Chatsiou arXiv_CL arXiv_CL  Transformer  Embedding  Bert  Text_Classification  Classification  CNN  Language_Model  PDF
• 2020-10-20 Performance of Transfer Learning Model vs. Traditional Neural Network in Low System Resource Environment    William Hui arXiv_CL arXiv_CL  Transfer_Learning  Bert  Text_Classification  Pose  Classification  PDF
• 2020-10-20 What makes multilingual BERT multilingual?    Chi-Liang Liu, Tsung-Yuan Hsu, Yung-Sung Chuang, Hung-yi Lee arXiv_CL arXiv_CL  Embedding  Bert  PDF
• 2020-10-20 Language Representation in Multilingual BERTand its applications to improve Cross-lingual Generalization    Chi-Liang Liu, Tsung-Yuan Hsu, Yung-Sung Chuang, Hung-yi Lee arXiv_AI arXiv_AI  Embedding  Unsupervised  Bert  Pose  PDF
• 2020-10-19 ColloQL: Robust Cross-Domain Text-to-SQL Over Search Queries    Karthik Radhakrishnan, Arvind Srikantan, Xi Victoria Lin arXiv_AI arXiv_AI  Bert  Knowledge  Relation  PDF
• 2020-10-19 ChemBERTa: Large-Scale Self-Supervised Pretraining for Molecular Property Prediction    Seyone Chithrananda, Gabe Grand, Bharath Ramsundar arXiv_CL arXiv_CL  Transformer  Bert  Represenation_Learning  Self-Supervised  Face  Attention  Prediction  PDF
• 2020-10-19 Cross-Lingual Transfer in Zero-Shot Cross-Language Entity Linking    Elliot Schumacher, James Mayfield, Mark Dredze arXiv_CL arXiv_CL  Bert  Zero-Shot  Knowledge  Pose  PDF
• 2020-10-19 Question Generation for Supporting Informational Query Intents    Xusen Yin, Jonathan May, Li Zhou, Kevin Small arXiv_CL arXiv_CL  Bert  QA  PDF
• 2020-10-19 An Empirical Study for Vietnamese Constituency Parsing with Pre-training    Tuan-Vi Tran, Xuan-Thien Pham, Duc-Vu Nguyen, Kiet Van Nguyen, Ngan Luu-Thuy Nguyen arXiv_CL arXiv_CL  Bert  Attention  Inference  PDF
• 2020-10-19 Drug Repurposing for COVID-19 via Knowledge Graph Completion    Rui Zhang, Dimitar Hristovski, Dalton Schutte, Andrej Kastrin, Marcelo Fiszman, Halil Kilicoglu arXiv_CL arXiv_CL  Bert  Knowledge  Knowledge_Graph  Pose  Relation  PDF
• 2020-10-19 Better Distractions: Transformer-based Distractor Generation and Multiple Choice Question Filtering    Jeroen Offerijns, Suzan Verberne, Tessa Verhoef arXiv_CL arXiv_CL  Transformer  Bert  Action  Attention  Text_Generation  Language_Model  QA  PDF
• 2020-10-19 Cold-start Active Learning through Self-supervised Language Modeling    Michelle Yuan, Hsuan-Tien Lin, Jordan Boyd-Graber arXiv_CL arXiv_CL  Bert  Text_Classification  Self-Supervised  Classification  Language_Model  PDF
• 2020-10-19 The RELX Dataset and Matching the Multilingual Blanks for Cross-Lingual Relation Classification    Abdullatif Köksal, Arzucan Özgür arXiv_CL arXiv_CL  Bert  Knowledge  Pose  Action  Classification  Relation  Matching  PDF
• 2020-10-19 BERTnesia: Investigating the capture and forgetting of knowledge in BERT    Jonas Wallat, Jaspreet Singh, Avishek Anand arXiv_CL arXiv_CL  Bert  Knowledge  Relation  Language_Model  PDF
• 2020-10-19 SciSummPip: An Unsupervised Scientific Paper Summarization Pipeline    Jiaxin Ju, Ming Liu, Longxiang Gao, Shirui Pan arXiv_CL arXiv_CL  Transformer  Unsupervised  Bert  Summarization  Language_Model  PDF
• 2020-10-18 Explaining and Improving Model Behavior with k Nearest Neighbor Representations    Nazneen Fatema Rajani, Ben Krause, Wengpeng Yin, Tong Niu, Richard Socher, Caiming Xiong arXiv_CL arXiv_CL  Bert  Salient  Adversarial  Pose  Attention  Inference  Prediction  PDF
• 2020-10-18 Towards Interpreting BERT for Reading Comprehension Based QA    Sahana Ramnath, Preksha Nema, Deep Sahni, Mitesh M. Khapra arXiv_AI arXiv_AI  Bert  Pose  Action  Prediction  QA  PDF
• 2020-10-17 Question Answering over Knowledge Base using Language Model Embeddings    Sai Sharath Japa, Rekabdar Banafsheh arXiv_CL arXiv_CL  Embedding  Bert  Knowledge  Pose  Ontology  Relation  Attention  CNN  Language_Model  PDF
• 2020-10-17 HABERTOR: An Efficient and Effective Deep Hatespeech Detector    Thanh Tran, Yifan Hu, Changwei Hu, Kevin Yen, Fei Tan, Kyumin Lee, Serim Park arXiv_AI arXiv_AI  Bert  Adversarial  Speech  Pose  Classification  Detection  Object_Detection  Language_Model  PDF
• 2020-10-17 Hierarchical Multitask Learning Approach for BERT    Çağla Aksoy, Alper Ahmetoğlu, Tunga Güngör arXiv_CL arXiv_CL  Embedding  Bert  Pose  Language_Model  Prediction  PDF
• 2020-10-17 Answer-checking in Context: A Multi-modal FullyAttention Network for Visual Question Answering    Hantao Huang, Tao Han, Wei Han, Deep Yap, Cheng-Ming Chiang arXiv_CV arXiv_CV  Image_Caption  Bert  Pose  Relation  VQA  Attention  QA  PDF
• 2020-10-17 Example-Driven Intent Prediction with Observers    Shikib Mehri, Mihail Eric, Dilek Hakkani-Tur arXiv_AI arXiv_AI  Bert  Pose  Classification  Few-Shot  Attention  Prediction  PDF
• 2020-10-17 TweetBERT: A Pretrained Language Representation Model for Twitter Text Analysis    Mohiuddin Md Abdul Qudar, Vijay Mago arXiv_CL arXiv_CL  Bert  Deep_Learning  Language_Model  PDF
• 2020-10-16 CoDA: Contrast-enhanced and Diversity-promoting Data Augmentation for Natural Language Understanding    Yanru Qu, Dinghan Shen, Yelong Shen, Sandra Sajeev, Jiawei Han, Weizhu Chen arXiv_CL arXiv_CL  Transformer  Bert  Regularization  Adversarial  Pose  Relation  GAN  PDF
• 2020-10-16 Generalized Intersection Algorithms with Fixpoints for Image Decomposition Learning    Robin Richter, Duy H. Thai, Stephan F. Huckemann arXiv_CV arXiv_CV  Bert  Denoising  PDF
• 2020-10-16 Linguistically-Informed Transformations : A Method forAutomatically Generating Contrast Sets    Chuanrong Li, Lin Shengshuo, Leo Z. Liu, Xinyi Wu, Xuhui Zhou, Shane Steinert-Threlkeld arXiv_CL arXiv_CL  Bert  Knowledge  Pose  Language_Model  PDF
• 2020-10-16 Delaying Interaction Layers in Transformer-based Encoders for Efficient Open Domain Question Answering    Wissam Siblini, Mohamed Challal, Charlotte Pasqual arXiv_CL arXiv_CL  Transformer  Bert  Pose  Face  Action  Attention  Language_Model  QA  PDF
• 2020-10-16 It's not Greek to mBERT: Inducing Word-Level Translations from Multilingual BERT    Hila Gonen, Shauli Ravfogel, Yanai Elazar, Yoav Goldberg arXiv_CL arXiv_CL  Bert  Pose  PDF
• 2020-10-16 Augmented SBERT: Data Augmentation Method for Improving Bi-Encoders for Pairwise Sentence Scoring Tasks    Nandan Thakur, Nils Reimers, Johannes Daxenberger, Iryna Gurevych arXiv_CL arXiv_CL  Bert  Attention  PDF
• 2020-10-16 Coarse-to-Fine Pre-training for Named Entity Recognition    Mengge Xue, Bowen Yu, Zhenyu Zhang, Tingwen Liu, Yue Zhang, Bin Wang arXiv_CL arXiv_CL  Recognition  Bert  Knowledge  Self-Supervised  Pose  PDF
• 2020-10-15 CXP949 at WNUT-2020 Task 2: Extracting Informative COVID-19 Tweets -- RoBERTa Ensembles and The Continued Relevance of Handcrafted Features    Calum Perrio, Harish Tayyar Madabushi arXiv_CL arXiv_CL  Transformer  Bert  Text_Classification  Classification  Language_Model  PDF
• 2020-10-15 Explicit Alignment Objectives for Multilingual Bidirectional Encoders    Junjie Hu, Melvin Johnson, Orhan Firat, Aditya Siddhant, Graham Neubig arXiv_AI arXiv_AI  Embedding  Transfer_Learning  Bert  Zero-Shot  Classification  PDF
• 2020-10-15 Fixed-Length Protein Embeddings using Contextual Lenses    Amir Shanehsazzadeh, David Belanger, David Dohan arXiv_CL arXiv_CL  Transformer  Embedding  Bert  Pose  Classification  Deep_Learning  Language_Model  PDF
• 2020-10-15 Response Selection for Multi-Party Conversations withDynamic Topic Tracking    Weishi Wang§, Shafiq Joty§, Steven C.H. Hoi arXiv_AI arXiv_AI  Tracking  Bert  Self-Supervised  Pose  PDF
• 2020-10-15 Unsupervised Bitext Mining and Translation via Self-trained Contextual Embeddings    Phillip Keung, Julian Salazar, Yichao Lu, Noah A. Smith arXiv_CL arXiv_CL  Embedding  Unsupervised  Bert  PDF
• 2020-10-15 A Transformer Based Pitch Sequence Autoencoder with MIDI Augmentation    Mingshuo Ding, Yinghao Ma arXiv_SD arXiv_SD  Transformer  Bert  Pose  Classification  Deep_Learning  Attention  Language_Model  PDF
• 2020-10-15 Does Chinese BERT Encode Word Structure?    Yile Wang, Leyang Cui, Yue Zhang arXiv_CL arXiv_CL  Bert  Knowledge  Attention  Inference  PDF
• 2020-10-15 Context-Guided BERT for Targeted Aspect-Based Sentiment Analysis    Zhengxuan Wu, Desmond C. Ong arXiv_AI arXiv_AI  Transformer  Bert  Pose  Sentiment  Attention  Inference  Language_Model  QA  PDF
• 2020-10-15 Neural Deepfake Detection with Factual Structure of Text    Wanjun Zhong, Duyu Tang, Zenan Xu, Ruize Wang, Nan Duan, Ming Zhou, Jiahai Wang, Jian Yin arXiv_CL arXiv_CL  Bert  Pose  Detection  Relation  Prediction  PDF
• 2020-10-15 TopicBERT for Energy Efficient Document Classification    Yatin Chaudhary, Pankaj Gupta, Khushbu Saxena, Vivek Kulkarni, Thomas Runkler, Hinrich Schütze arXiv_CL arXiv_CL  Bert  Classification  Attention  Language_Model  PDF
• 2020-10-14 Geometry matters: Exploring language examples at the decision boundary    Debajyoti Datta, Shashwat Kumar, Laura Barnes, Tom Fletcher arXiv_CL arXiv_CL  Bert  Review  Pose  PDF
• 2020-10-14 An Investigation on Different Underlying Quantization Schemes for Pre-trained Language Models    Zihan Zhao, Yuncong Liu, Lu Chen, Qi Liu, Rao Ma, Kai Yu arXiv_CL arXiv_CL  Quantization  Bert  Language_Model  PDF
• 2020-10-14 AutoADR: Automatic Model Design for Ad Relevance    Yiren Chen, Yaming Yang, Hong Sun, Yujing Wang, Yu Xu, Wei Shen, Rong Zhou, Yunhai Tong, Jing Bai, Ruofei Zhang arXiv_CL arXiv_CL  NAS  Bert  Knowledge  Pose  Attention  Language_Model  PDF
• 2020-10-14 Length-Adaptive Transformer: Train Once with Length Drop, Use Anytime with Search    Gyuwan Kim, Kyunghyun Cho arXiv_CL arXiv_CL  Transformer  Bert  Pose  Classification  Inference  PDF
• 2020-10-14 DA-Transformer: Distance-aware Transformer    Chuhan Wu, Fangzhao Wu, Yongfeng Huang arXiv_CL arXiv_CL  Transformer  Embedding  Bert  Pose  Relation  Attention  PDF
• 2020-10-14 No Rumours Please! A Multi-Indic-Lingual Approach for COVID Fake-Tweet Detection    Debanjana Kar, Mohit Bhardwaj, Suranjana Samanta, Amar Prakash Azad arXiv_CL arXiv_CL  Bert  Zero-Shot  Pose  Detection  PDF
• 2020-10-14 Learning Word Representations for Tunisian Sentiment Analysis    Abir Messaoudi, Hatem Haddad, Moez Ben HajHmida, Chayma Fourati, Abderrazak Ben Hamida arXiv_CL arXiv_CL  Unsupervised  Bert  Sentiment  CNN  Language_Model  PDF
• 2020-10-13 A Multi-Modal Method for Satire Detection using Textual and Visual Cues    Lily Li, Or Levi, Pedram Hosseini, David A. Broniatowski arXiv_AI arXiv_AI  Bert  Pose  Detection  CNN  PDF
• 2020-10-13 Probing for Multilingual Numerical Understanding in Transformer-Based Language Models    Devin Johnson, Denise Mak, Drew Barker, Lexi Loessberg-Zahl arXiv_CL arXiv_CL  Transformer  Embedding  Bert  Pose  Classification  Language_Model  PDF
• 2020-10-13 Pretrained Transformers for Text Ranking: BERT and Beyond    Jimmy Lin, Rodrigo Nogueira, Andrew Yates arXiv_CL arXiv_CL  Transformer  Bert  Self-Supervised  Survey  PDF
• 2020-10-13 Multilingual Argument Mining: Datasets and Analysis    Orith Toledo-Ronen, Matan Orbach, Yonatan Bilu, Artem Spector, Noam Slonim arXiv_AI arXiv_AI  Transfer_Learning  Bert  Relation  PDF
• 2020-10-13 Aspect-based Document Similarity for Research Papers    Malte Ostendorff, Terry Ruas, Till Blume, Bela Gipp, Georg Rehm arXiv_CL arXiv_CL  Transformer  Bert  RNN  Quantitative  Classification  Recommendation  PDF
• 2020-10-13 CAPT: Contrastive Pre-Training for LearningDenoised Sequence Representations    Fuli Luo, Pengcheng Yang, Shicheng Li, Xuancheng Ren, Xu Sun arXiv_CL arXiv_CL  Unsupervised  Bert  Self-Supervised  Pose  PDF
• 2020-10-13 Improving Text Generation Evaluation with Batch Centering and Tempered Word Mover Distance    Xi Chen, Nan Ding, Tomer Levinboim, Radu Soricut arXiv_CL arXiv_CL  Bert  Relation  Text_Generation  PDF
• 2020-10-13 Incorporating BERT into Parallel Sequence Decoding with Adapters    Junliang Guo, Zhirui Zhang, Linli Xu, Hao-Ran Wei, Boxing Chen, Enhong Chen arXiv_CL arXiv_CL  Bert  Pose  Text_Generation  Inference  Language_Model  PDF
• 2020-10-13 BERT-EMD: Many-to-Many Layer Mapping for BERT Compression with Earth Mover's Distance    Jianquan Li, Xiaokang Liu, Honghong Zhao, Ruifeng Xu, Min Yang, Yaohong Jin arXiv_CL arXiv_CL  Bert  Knowledge  Pose  Attention  Language_Model  Matching  PDF
• 2020-10-13 Model Selection for Cross-Lingual Transfer using a Learned Scoring Function    Yang Chen, Alan Ritter arXiv_CL arXiv_CL  Transformer  Transfer_Learning  Bert  Zero-Shot  Pose  PDF
• 2020-10-12 Zero-shot Entity Linking with Efficient Long Range Sequence Modeling    Zonghai Yao, Liangliang Cao, Huapu Pan arXiv_AI arXiv_AI  Embedding  Bert  Zero-Shot  Pose  PDF
• 2020-10-12 TextHide: Tackling Data Privacy in Language Understanding Tasks    Yangsibo Huang, Zhao Song, Danqi Chen, Kai Li, Sanjeev Arora arXiv_CL arXiv_CL  Bert  Pose  Language_Model  PDF
• 2020-10-12 Chatbot Interaction with Artificial Intelligence: Human Data Augmentation with T5 and Language Transformer Ensemble for Text Classification    Jordan J. Bird, Anikó Ekárt, Diego R. Faria arXiv_AI arXiv_AI  Transformer  Bert  Text_Classification  Face  Action  Classification  Deep_Learning  Attention  Prediction  QA  PDF
• 2020-10-12 SLEDGE-Z: A Zero-Shot Baseline for COVID-19 Literature Search    Sean MacAvaney, Arman Cohan, Nazli Goharian arXiv_CL arXiv_CL  Bert  Zero-Shot  Medical  PDF
• 2020-10-12 Multi-Stage Pre-training for Low-Resource Domain Adaptation    Rong Zhang, Revanth Gangi Reddy, Md Arafat Sultan, Vittorio Castelli, Anthony Ferritto, Radu Florian, Efsun Sarioglu Kayi, Salim Roukos, Avirup Sil, Todd Ward arXiv_CL arXiv_CL  Transfer_Learning  Bert  Detection  Language_Model  PDF
• 2020-10-12 Layer-wise Guided Training for BERT: Learning Incrementally Refined Document Representations    Nikolaos Manginas, Ilias Chalkidis, Prodromos Malakasiotis arXiv_CL arXiv_CL  Bert  Text_Classification  Pose  Classification  GAN  PDF
• 2020-10-12 EFSG: Evolutionary Fooling Sentences Generator    Marco Di Giovanni, Marco Brambilla arXiv_CL arXiv_CL  Bert  Adversarial  Classification  PDF
• 2020-10-12 Probing Pretrained Language Models for Lexical Semantics    Ivan Vulić, Edoardo Maria Ponti, Robert Litschko, Goran Glavaš, Anna Korhonen arXiv_CL arXiv_CL  Transformer  Bert  Knowledge  Action  Language_Model  PDF
• 2020-10-12 HUJI-KU at MRP~2020: Two Transition-based Neural Parsers    Ofir Arviv, Ruixiang Cui, Daniel Hershcovich arXiv_CL arXiv_CL  Embedding  Bert  PDF
• 2020-10-12 From Hero to Zéroe: A Benchmark of Low-Level Adversarial Attacks    Steffen Eger, Yannik Benz arXiv_CL arXiv_CL  Bert  Adversarial  Pose  PDF
• 2020-10-12 Improving Compositional Generalization in Semantic Parsing    Inbar Oren, Jonathan Herzig, Nitish Gupta, Matt Gardner, Jonathan Berant arXiv_CL arXiv_CL  Bert  Pose  Attention  PDF
• 2020-10-12 Predicting Clinical Trial Results by Implicit Evidence Integration    Qiao Jin, Chuanqi Tan, Mosha Chen, Xiaozhong Liu, Songfang Huang arXiv_CL arXiv_CL  Bert  Pose  Medical  Prediction  PDF
• 2020-10-12 Load What You Need: Smaller Versions of Multilingual BERT    Amine Abdaoui, Camille Pradel, Grégoire Sigel arXiv_AI arXiv_AI  Transformer  Embedding  Bert  Pose  PDF
• 2020-10-12 Social Commonsense Reasoning with Multi-Head Knowledge Attention    Debjit Paul, Anette Frank arXiv_CL arXiv_CL  Transformer  Bert  Knowledge  Pose  Attention  Inference  Prediction  PDF
• 2020-10-12 Counterfactual Variable Control for Robust and Interpretable Question Answering    Sicheng Yu, Yulei Niu, Shuohang Wang, Jing Jiang, Qianru Sun arXiv_CL arXiv_CL  Bert  Adversarial  Pose  Action  Relation  Inference  Prediction  QA  PDF
• 2020-10-12 Meta-Context Transformers for Domain-Specific Response Generation    Debanjana Kar, Suranjana Samanta, Amar Prakash Azad arXiv_CL arXiv_CL  Transformer  Bert  Pose  Attention  Language_Model  PDF
• 2020-10-12 A BERT-based Distractor Generation Scheme with Multi-tasking and Negative Answer Training Strategies    Ho-Lam Chung, Ying-Hong Chan, Yao-Chung Fan arXiv_AI arXiv_AI  Bert  PDF
• 2020-10-11 Learning Which Features Matter: RoBERTa Acquires a Preference for Linguistic Generalizations    Alex Warstadt, Yian Zhang, Haau-Sing Li, Haokun Liu, Samuel R. Bowman arXiv_CL arXiv_CL  Bert  Self-Supervised  Face  Classification  PDF
• 2020-10-11 Incremental Processing in the Age of Non-Incremental Encoders: An Empirical Assessment of Bidirectional Models for Incremental NLU    Brielen Madureira, David Schlangen arXiv_CL arXiv_CL  Transformer  Bert  RNN  Face  Language_Model  PDF
• 2020-10-11 Unsupervised Distillation of Syntactic Information from Contextualized Word Representations    Shauli Ravfogel, Yanai Elazar, Jacob Goldberger, Yoav Goldberg arXiv_CL arXiv_CL  Unsupervised  Bert  Few-Shot  PDF
• 2020-10-11 Data Agnostic RoBERTa-based Natural Language to SQL Query Generation    Debaditya Pal, Harsh Sharma, Kaustubh Chaudhari arXiv_AI arXiv_AI  Embedding  Bert  RNN  Knowledge  Deep_Learning  Relation  PDF
• 2020-10-11 Connecting the Dots Between Fact Verification and Fake News Detection    Qifei Li, Wangchunshu Zhou arXiv_AI arXiv_AI  Bert  Zero-Shot  Pose  Detection  Summarization  Language_Model  PDF
• 2020-10-11 Detecting Foodborne Illness Complaints in Multiple Languages Using English Annotations Only    Ziyi Liu, Giannis Karamanolakis, Daniel Hsu, Luis Gravano arXiv_CL arXiv_CL  Bert  Zero-Shot  Text_Classification  Review  Classification  Detection  Sentiment  PDF
• 2020-10-10 On the Importance of Adaptive Data Collection for Extremely Imbalanced Pairwise Tasks    Stephen Mussmann, Robin Jia, Percy Liang arXiv_CL arXiv_CL  Embedding  Bert  Classification  Detection  QA  PDF
• 2020-10-10 Second-Order Neural Dependency Parsing with Message Passing and End-to-End Training    Xinyu Wang, Kewei Tu arXiv_CL arXiv_CL  Embedding  Bert  Pose  PDF
• 2020-10-10 Compressing Transformer-Based Semantic Parsing Models using Compositional Code Embeddings    Prafull Prakash, Saurabh Kumar Shashidhar, Wenlong Zhao, Subendhu Rongali, Haidar Khan, Michael Kayser arXiv_CL arXiv_CL  Transformer  Embedding  Bert  Pose  PDF
• 2020-10-10 Beyond Language: Learning Commonsense from Images for Reasoning    Wanqing Cui, Yanyan Lan, Liang Pang, Jiafeng Guo, Xueqi Cheng arXiv_AI arXiv_AI  Bert  Knowledge  Pose  Relation  Language_Model  PDF
• 2020-10-10 Zero-Shot Translation Quality Estimation with Explicit Cross-Lingual Patterns    Lei Zhou, Liang Ding, Koichi Takeda arXiv_CL arXiv_CL  Bert  Zero-Shot  Pose  Matching  PDF
• 2020-10-10 Tag Recommendation for Online Q&A Communities based on BERT Pre-Training Technique    Navid Khezrian, Jafar Habibi, Issa Annamoradnejad arXiv_CL arXiv_CL  Bert  Pose  Classification  Deep_Learning  Recommendation  PDF
• 2020-10-10 Toward Micro-Dialect Identification in Diaglossic and Code-Switched Environments    Muhammad Abdul-Mageed, Chiyu Zhang, AbdelRahim Elmadany, Lyle Ungar arXiv_AI arXiv_AI  Bert  Pose  Language_Model  Prediction  PDF
• 2020-10-10 Information Extraction from Swedish Medical Prescriptions with Sig-Transformer Encoder    John Pougue Biyong, Bo Wang, Terry Lyons, Alejo J Nevado-Holgado arXiv_CL arXiv_CL  Transformer  Embedding  Bert  Pose  Action  Attention  Medical  Language_Model  Prediction  PDF
• 2020-10-10 Adversarial Self-Supervised Data-Free Distillation for Text Classification    Xinyin Ma, Yongliang Shen, Gongfan Fang, Chen Chen, Chenghao Jia, Weiming Lu arXiv_AI arXiv_AI  Transformer  Embedding  Bert  Text_Classification  Knowledge  Adversarial  Self-Supervised  Pose  Classification  Text_Generation  Language_Model  PDF
• 2020-10-09 ChrEn: Cherokee-English Machine Translation for Endangered Language Revitalization    Shiyue Zhang, Benjamin Frey, Mohit Bansal arXiv_AI arXiv_AI  Transformer  Transfer_Learning  Bert  RNN  Pose  NMT  Language_Model  PDF
• 2020-10-09 Grid Tagging Scheme for Aspect-oriented Fine-grained Opinion Extraction    Zhen Wu, Chengcan Ying, Fei Zhao, Zhifang Fan, Xinyu Dai, Rui Xia arXiv_CL arXiv_CL  Bert  RNN  Review  Pose  Action  Sentiment  Inference  PDF
• 2020-10-09 Toxic Language Detection in Social Media for Brazilian Portuguese: New Dataset and Multilingual Analysis    João A. Leite, Diego F. Silva, Kalina Bontcheva, Carolina Scarton arXiv_CL arXiv_CL  Bert  Speech  Pose  Classification  Detection  PDF
• 2020-10-09 Style Attuned Pre-training and Parameter Efficient Fine-tuning for Spoken Language Understanding    Jin Cao, Jun Wang, Wael Hamza, Kelly Vanee, Shang-Wen Li arXiv_AI arXiv_AI  Bert  Knowledge  Language_Model  PDF
• 2020-10-09 NutCracker at WNUT-2020 Task 2: Robustly Identifying Informative COVID-19 Tweets using Ensembling and Adversarial Training    Priyanshu Kumar, Aadarsh Singh arXiv_CL arXiv_CL  Bert  Adversarial  PDF
• 2020-10-08 Masked ELMo: An evolution of ELMo towards fully contextual RNN language models    Gregory Senay, Emmanuelle Salin arXiv_CL arXiv_CL  Transformer  Bert  Optimization  RNN  Language_Model  PDF
• 2020-10-08 Leveraging Unpaired Text Data for Training End-to-End Speech-to-Intent Systems    Yinghui Huang, Hong-Kwang Kuo, Samuel Thomas, Zvi Kons, Kartik Audhkhasi, Brian Kingsbury, Ron Hoory, Michael Picheny arXiv_CL arXiv_CL  Embedding  Transfer_Learning  Bert  Speech  Pose  Classification  PDF
• 2020-10-08 Evaluating the Effectiveness of Efficient Neural Architecture Search for Sentence-Pair Tasks    Ansel MacLaughlin, Jwala Dhamala, Anoop Kumar, Sriram Venkatapathy, Ragav Venkatesan, Rahul Gupta arXiv_CL arXiv_CL  NAS  Embedding  Bert  RNN  Classification  Detection  Image_Classification  Inference  Language_Model  PDF
• 2020-10-08 BERTering RAMS: What and How Much does BERT Already Know About Event Arguments? -- A Study on the RAMS Dataset    Varun Gangal, Eduard Hovy arXiv_AI arXiv_AI  Bert  Adversarial  Pose  Detection  Attention  PDF
• 2020-10-08 Injecting Word Information with Multi-Level Word Adapter for Chinese Spoken Language Understanding    Dechuang Teng, Libo Qin, Wanxiang Che, Sendong Zhao, Ting Liu arXiv_CL arXiv_CL  Bert  Pose  Detection  PDF
• 2020-10-08 On the importance of pre-training data volume for compact language models    Vincent Micheli, Martin D'Hoffschmidt, François Fleuret arXiv_CL arXiv_CL  Bert  Language_Model  PDF
• 2020-10-08 Improving Attention Mechanism with Query-Value Interaction    Chuhan Wu, Fangzhao Wu, Tao Qi, Yongfeng Huang arXiv_CL arXiv_CL  Transformer  Bert  Pose  Action  Attention  PDF
• 2020-10-08 Discriminatively-Tuned Generative Classifiers for Robust Natural Language Inference    Xiaoan Ding, Tianyu Liu, Baobao Chang, Zhifang Sui, Kevin Gimpel arXiv_CL arXiv_CL  Bert  Pose  Inference  PDF
• 2020-10-08 Infusing Disease Knowledge into BERT for Health Question Answering, Medical Inference and Disease Name Recognition    Yun He, Ziwei Zhu, Yin Zhang, Qin Chen, James Caverlee arXiv_CL arXiv_CL  Recognition  Bert  Knowledge  Pose  Medical  Inference  Language_Model  PDF
• 2020-10-08 Leveraging Discourse Rewards for Document-Level Neural Machine Translation    Inigo Jauregi Unanue, Nazanin Esmaili, Gholamreza Haffari, Massimo Piccardi arXiv_CL arXiv_CL  Reinforcement_Learning  Bert  Pose  PDF
• 2020-10-08 PARADE: A New Dataset for Paraphrase Identification Requiring Computer Science Domain Knowledge    Yun He, Zhuoer Wang, Yin Zhang, Ruihong Huang, James Caverlee arXiv_CL arXiv_CL  Bert  Knowledge  PDF
• 2020-10-07 Optimizing Transformers with Approximate Computing for Faster, Smaller and more Accurate NLP Models    Amrit Nagarajan, Sanchari Sen, Jacob R. Stevens, Anand Raghunathan arXiv_AI arXiv_AI  Transformer  Quantization  Transfer_Learning  Bert  Pose  Attention  Matching  PDF
• 2020-10-07 Detecting Fine-Grained Cross-Lingual Semantic Divergences without Supervision by Learning to Rank    Eleftheria Briakou, Marine Carpuat arXiv_CL arXiv_CL  Bert  Prediction  PDF
• 2020-10-07 Combining Deep Learning and String Kernels for the Localization of Swiss German Tweets    Mihaela Gaman, Radu Tudor Ionescu arXiv_CL arXiv_CL  Embedding  Bert  Memory_Networks  Pose  Deep_Learning  CNN  Prediction  PDF
• 2020-10-07 ELMo and BERT in semantic change detection for Russian    Julia Rodina, Yuliya Trofimova, Andrey Kutuzov, Ekaterina Artemova arXiv_CL arXiv_CL  Embedding  Unsupervised  Bert  Detection  PDF
• 2020-10-07 'I'd rather just go to bed': Understanding Indirect Answers    Annie Louis, Dan Roth, Filip Radlinski arXiv_CL arXiv_CL  Transfer_Learning  Bert  Inference  Language_Model  PDF
• 2020-10-07 Why do you think that? Exploring Faithful Sentence-Level Rationales Without Supervision    Max Glockner, Ivan Habernal, Iryna Gurevych arXiv_CL arXiv_CL  Reinforcement_Learning  Bert  Pose  Prediction  PDF
• 2020-10-07 Learning to Explain: Datasets and Models for Identifying Valid Reasoning Chains in Multihop Question-Answering    Harsh Jhamtani, Peter Clark arXiv_AI arXiv_AI  Bert  Prediction  QA  PDF
• 2020-10-07 Transfer Learning and Distant Supervision for Multilingual Transformer Models: A Study on African Languages    Michael A. Hedderich, David Adelani, Dawei Zhu, Jesujoba Alabi, Udia Markus, Dietrich Klakow arXiv_CL arXiv_CL  Transformer  Transfer_Learning  Bert  Classification  PDF
• 2020-10-07 VCDM: Leveraging Variational Bi-encoding and Deep Contextualized Word Representations for Improved Definition Modeling    Machel Reid, Edison Marrese-Taylor, Yutaka Matsuo arXiv_CL arXiv_CL  Embedding  Bert  Pose  Relation  Inference  PDF
• 2020-10-07 DiPair: Fast and Accurate Distillation for Trillion-Scale Text Matching and Pair Modeling    Jiecao Chen, Liu Yang, Karthik Raman, Michael Bendersky, Jung-Jung Yeh, Yun Zhou, Marc Najork, Danyang Cai, Ehsan Emadzadeh arXiv_CL arXiv_CL  Bert  Knowledge  Pose  Classification  Attention  Inference  Matching  PDF
• 2020-10-06 Exploring BERT's Sensitivity to Lexical Cues using Tests from Semantic Priming    Kanishka Misra, Allyson Ettinger, Julia Taylor Rayz arXiv_CL arXiv_CL  Bert  Prediction  PDF
• 2020-10-06 Intrinsic Probing through Dimension Selection    Lucas Torroba Hennigen, Adina Williams, Ryan Cotterell arXiv_CL arXiv_CL  Embedding  Bert  Pose  PDF
• 2020-10-06 Stepwise Extractive Summarization and Planning with Structured Transformers    Shashi Narayan, Joshua Maynez, Jakub Adamek, Daniele Pighin, Blaž Bratanič, Ryan McDonald arXiv_CL arXiv_CL  Transformer  Bert  Pose  Summarization  Text_Generation  PDF
• 2020-10-06 Neural Mask Generator: Learning to Generate Adaptive Word Maskings for Language Model Adaptation    Minki Kang, Moonsu Han, Sung Ju Hwang arXiv_AI arXiv_AI  Transformer  Reinforcement_Learning  Bert  Text_Classification  Regularization  Self-Supervised  Pose  Classification  Language_Model  PDF
• 2020-10-06 Analyzing Individual Neurons in Pre-trained Language Models    Nadir Durrani, Hassan Sajjad, Fahim Dalvi, Yonatan Belinkov arXiv_CL arXiv_CL  Bert  Knowledge  Attention  Language_Model  PDF
• 2020-10-06 BERT Knows Punta Cana is not just beautiful, it's gorgeous: Ranking Scalar Adjectives with Contextualised Representations    Aina Garí Soler, Marianna Apidianaki arXiv_CL arXiv_CL  Embedding  Bert  Knowledge  Pose  Detection  PDF
• 2020-10-06 Poison Attacks against Text Datasets with Conditional Adversarially Regularized Autoencoder    Alvin Chan, Yi Tay, Yew-Soon Ong, Aston Zhang arXiv_AI arXiv_AI  Bert  Text_Classification  Adversarial  Face  Classification  Inference  Prediction  PDF
• 2020-10-06 Incorporating Behavioral Hypotheses for Query Generation    Ruey-Cheng Chen, Chia-Jung Lee arXiv_CL arXiv_CL  Transformer  Bert  Pose  PDF
• 2020-10-06 On the Interplay Between Fine-tuning and Sentence-level Probing for Linguistic Knowledge in Pre-trained Transformers    Marius Mosbach, Anna Khokhlova, Michael A. Hedderich, Dietrich Klakow arXiv_CL arXiv_CL  Transformer  Embedding  Bert  Knowledge  PDF
• 2020-10-06 The Multilingual Amazon Reviews Corpus    Phillip Keung, Yichao Lu, György Szarvas, Noah A. Smith arXiv_CL arXiv_CL  Transfer_Learning  Bert  Zero-Shot  Text_Classification  Review  Pose  Classification  PDF
• 2020-10-06 Cross-Lingual Text Classification with Minimal Resources by Transferring a Sparse Teacher    Giannis Karamanolakis, Daniel Hsu, Luis Gravano arXiv_CL arXiv_CL  Bert  Text_Classification  Sparse  Represenation_Learning  Pose  Classification  PDF
• 2020-10-06 LEGAL-BERT: The Muppets straight out of Law School    Ilias Chalkidis, Manos Fergadiotis, Prodromos Malakasiotis, Nikolaos Aletras, Ion Androutsopoulos arXiv_CL arXiv_CL  Bert  Pose  PDF
• 2020-10-06 Do Explicit Alignments Robustly Improve Multilingual Encoders?    Shijie Wu, Mark Dredze arXiv_CL arXiv_CL  Unsupervised  Bert  Pose  PDF
• 2020-10-06 GRUEN for Evaluating Linguistic Quality of Generated Text    Wanzheng Zhu, Suma Bhat arXiv_CL arXiv_CL  Unsupervised  Bert  Pose  PDF
• 2020-10-06 Pretrained Language Model Embryology: The Birth of ALBERT    David C. Chiang, Sung-Feng Huang, Hung-yi Lee arXiv_CL arXiv_CL  Bert  Knowledge  Speech  Language_Model  PDF
• 2020-10-05 Mixup-Transfomer: Dynamic Data Augmentation for NLP Tasks    Lichao Sun, Congying Xia, Wenpeng Yin, Tingting Liang, Philip S. Yu, Lifang He arXiv_CL arXiv_CL  Transformer  Bert  Pose  Classification  Image_Classification  Language_Model  PDF
• 2020-10-05 InfoBERT: Improving Robustness of Language Models from An Information Theoretic Perspective    Boxin Wang, Shuohang Wang, Yu Cheng, Zhe Gan, Ruoxi Jia, Bo Li, Jingjing Liu arXiv_AI arXiv_AI  Bert  Represenation_Learning  Adversarial  Pose  Inference  Language_Model  QA  PDF
• 2020-10-05 Understanding bias in facial recognition technologies    David Leslie arXiv_CV arXiv_CV  Surveillance  Recognition  OCR  Bert  Face  Detection  Recommendation  PDF
• 2020-10-05 PAIR: Planning and Iterative Refinement in Pre-trained Transformers for Long Text Generation    Xinyu Hua, Lu Wang arXiv_CL arXiv_CL  Transformer  Bert  Pose  Text_Generation  PDF
• 2020-10-05 Self-training Improves Pre-training for Natural Language Understanding    Jingfei Du, Edouard Grave, Beliz Gunel, Vishrav Chaudhary, Onur Celebi, Michael Auli, Ves Stoyanov, Alexis Conneau arXiv_CL arXiv_CL  Embedding  Unsupervised  Bert  Text_Classification  Knowledge  Classification  Few-Shot  PDF
• 2020-10-05 Speakers Fill Lexical Semantic Gaps with Context    Tiago Pimentel, Rowan Hall Maudslay, Damián Blasi, Ryan Cotterell arXiv_CL arXiv_CL  Bert  Relation  PDF
• 2020-10-05 PublishInCovid19 at WNUT 2020 Shared Task-1: Entity Recognition in Wet Lab Protocols using Structured Learning Ensemble and Contextualised Embeddings    Janvijay Singh, Anshul Wadhawan arXiv_CL arXiv_CL  Embedding  Recognition  Bert  RNN  Pose  PDF
• 2020-10-05 X-SRL: A Parallel Cross-Lingual Semantic Role Labeling Dataset    Angel Daza, Anette Frank arXiv_CL arXiv_CL  Bert  Pose  PDF
• 2020-10-05 Quantum Computational Psychoanalysis -- Quantum logic approach to Bi-logic    Maksim Tomic arXiv_AI arXiv_AI  Bert  Pose  PDF
• 2020-10-05 PUM at SemEval-2020 Task 12: Aggregation of Transformer-based models' features for offensive language recognition    Piotr Janiszewski, Mateusz Skiba, Urszula Walińska arXiv_CL arXiv_CL  Transformer  Recognition  Bert  PDF
• 2020-10-05 A Pilot Study of Text-to-SQL Semantic Parsing for Vietnamese    Anh Tuan Nguyen, Mai Hoang Dao, Dat Quoc Nguyen arXiv_AI arXiv_AI  Segmentation  Bert  Language_Model  PDF
• 2020-10-05 Linguistic Profiling of a Neural Language Model    Alessio Miaschi, Dominique Brunato, Felice Dell'Orletta, Giulia Venturi arXiv_AI arXiv_AI  Bert  Knowledge  Classification  Language_Model  Prediction  PDF
• 2020-10-05 Non-trivial informational closure of a Bayesian hyperparameter    Martin Biehl, Ryota Kanai arXiv_AI arXiv_AI  Bert  Relation  PDF
• 2020-10-05 PMI-Masking: Principled masking of correlated spans    Yoav Levine, Barak Lenz, Opher Lieber, Omri Abend, Kevin Leyton-Brown, Moshe Tennenholtz, Yoav Shoham arXiv_CL arXiv_CL  Bert  Pose  Language_Model  PDF
• 2020-10-05 Pruning Redundant Mappings in Transformer Models via Spectral-Normalized Identity Prior    Zi Lin, Jeremiah Zhe Liu, Zi Yang, Nan Hua, Dan Roth arXiv_CL arXiv_CL  Transformer  Bert  Pose  Attention  PDF
• 2020-10-05 Unsupervised Reference-Free Summary Quality Evaluation via Contrastive Learning    Hanlu Wu, Tengfei Ma, Lingfei Wu, Tariro Manyumwa, Shouling Ji arXiv_CL arXiv_CL  Unsupervised  Bert  Pose  Contrastive_Learning  Summarization  PDF
• 2020-10-05 Improving AMR Parsing with Sequence-to-Sequence Pre-training    Dongqin Xu, Junhui Li, Muhua Zhu, Min Zhang, Guodong Zhou arXiv_CL arXiv_CL  Bert  Pose  Attention  PDF
• 2020-10-05 Second-Order NLP Adversarial Examples    John X. Morris arXiv_CL arXiv_CL  Bert  Adversarial  Pose  Language_Model  PDF
• 2020-10-05 How Effective is Task-Agnostic Data Augmentation for Pretrained Transformers?    Shayne Longpre, Yu Wang, Christopher DuBois arXiv_AI arXiv_AI  Transformer  Bert  Classification  PDF
• 2020-10-04 Reading Comprehension as Natural Language Inference: A Semantic Analysis    Anshuman Mishra, Dhruvesh Patel, Aparna Vijayakumar, Xiang Li, Pavan Kapanipathi, Kartik Talamadupula arXiv_AI arXiv_AI  Bert  Pose  Attention  Inference  QA  PDF
• 2020-10-04 On Losses for Modern Language Models    Stephane Aroca-Ouellette, Frank Rudzicz arXiv_CL arXiv_CL  Bert  Language_Model  Prediction  PDF
• 2020-10-04 An Empirical Study on Large-Scale Multi-Label Text Classification Including Few and Zero-Shot Labels    Ilias Chalkidis, Manos Fergadiotis, Sotiris Kotitsas, Prodromos Malakasiotis, Nikolaos Aletras, Ion Androutsopoulos arXiv_CL arXiv_CL  Transformer  Transfer_Learning  Bert  Zero-Shot  Text_Classification  Pose  Classification  Attention  PDF
• 2020-10-04 K-Adapter: Infusing Knowledge into Pre-Trained Models with Adapters    Ruize Wang, Duyu Tang, Nan Duan, Zhongyu Wei, Xuanjing Huang, Jianshu ji, Guihong Cao, Daxin Jiang, Ming Zhou arXiv_CL arXiv_CL  Bert  Knowledge  Pose  Classification  Relation  PDF
• 2020-10-03 Semantic Role Labeling Guided Multi-turn Dialogue ReWriter    Kun Xu, Haochen Tan, Linfeng Song, Han Wu, Haisong Zhang, Linqi Song, Dong Yu arXiv_AI arXiv_AI  Bert  Knowledge  Pose  PDF
• 2020-10-03 Personality Trait Detection Using Bagged SVM over BERT Word Embedding Ensembles    Amirmohammad Kazameini, Samin Fatehi, Yash Mehta, Sauleh Eetemadi, Erik Cambria arXiv_AI arXiv_AI  Embedding  Bert  Deep_Learning  Detection  Attention  Language_Model  Prediction  PDF
• 2020-10-03 Mining Knowledge for Natural Language Inference from Wikipedia Categories    Mingda Chen, Zewei Chu, Karl Stratos, Kevin Gimpel arXiv_CL arXiv_CL  Bert  Knowledge  Inference  PDF
• 2020-10-02 Cost-effective Selection of Pretraining Data: A Case Study of Pretraining BERT on Social Media    Xiang Dai, Sarvnaz Karimi, Ben Hachey, Cecile Paris arXiv_CL arXiv_CL  Bert  PDF
• 2020-10-02 LUKE: Deep Contextualized Entity Representations with Entity-aware Self-attention    Ikuya Yamada, Akari Asai, Hiroyuki Shindo, Hideaki Takeda, Yuji Matsumoto arXiv_CL arXiv_CL  Transformer  Recognition  Bert  Pose  Classification  Relation  Attention  Language_Model  PDF
• 2020-10-02 MultiCQA: Zero-Shot Transfer of Self-Supervised Text Matching Models on a Massive Scale    Andreas Rücklé, Jonas Pfeiffer, Iryna Gurevych arXiv_CL arXiv_CL  Bert  Zero-Shot  Self-Supervised  Pose  QA  Matching  PDF
• 2020-10-02 SST-BERT at SemEval-2020 Task 1: Semantic Shift Tracing by Clustering in BERT-based Embedding Spaces    K Vani, Sandra Mitrovic, Alessandro Antonucci, Fabio Rinaldi arXiv_AI arXiv_AI  Embedding  Unsupervised  Bert  Pose  Detection  PDF
• 2020-10-02 Which *BERT? A Survey Organizing Contextualized Encoders    Patrick Xia, Shijie Wu, Benjamin Van Durme arXiv_CL arXiv_CL  Bert  Represenation_Learning  Survey  GAN  PDF
• 2020-10-02 STIL -- Simultaneous Slot Filling, Translation, Intent Classification, and Language Identification: Initial Results using mBART on MultiATIS++    Jack G. M. FitzGerald arXiv_CL arXiv_CL  Bert  Pose  Classification  PDF
• 2020-10-01 Beyond The Text: Analysis of Privacy Statements through Syntactic and Semantic Role Labeling    Yan Shvartzshnaider, Ananth Balashankar, Vikas Patidar, Thomas Wies, Lakshminarayanan Subramanian arXiv_CL arXiv_CL  Bert  Knowledge  Pose  Action  PDF
• 2020-10-01 Learning Variational Word Masks to Improve the Interpretability of Neural Text Classifiers    Hanjie Chen, Yangfeng Ji arXiv_CL arXiv_CL  Bert  Text_Classification  RNN  Pose  Classification  Prediction  PDF
• 2020-10-01 Understanding tables with intermediate pre-training    Julian Martin Eisenschlos, Syrine Krichine, Thomas Müller arXiv_AI arXiv_AI  Bert  Classification  Prediction  QA  PDF
• 2020-10-01 Evaluating Multilingual BERT for Estonian    Claudia Kittask, Kirill Milintsevich, Kairit Sirts arXiv_CL arXiv_CL  Bert  Text_Classification  Classification  Language_Model  PDF
• 2020-10-01 Detecting White Supremacist Hate Speech using Domain Specific Word Embedding with Deep Learning and BERT    Hind Saleh Alatawi, Areej Maatog Alhothali, Kawthar Mustafa Moria arXiv_AI arXiv_AI  Embedding  Bert  RNN  Speech  Deep_Learning  Language_Model  PDF
• 2020-10-01 CoLAKE: Contextualized Language and Knowledge Embedding    Tianxiang Sun, Yunfan Shao, Xipeng Qiu, Qipeng Guo, Yaru Hu, Xuanjing Huang, Zheng Zhang arXiv_AI arXiv_AI  Transformer  Embedding  Bert  Knowledge  Knowledge_Graph  Pose  Language_Model  PDF
• 2020-10-01 Phonemer at WNUT-2020 Task 2: Sequence Classification Using COVID Twitter BERT and Bagging Ensemble Technique based on Plurality Voting    Anshul Wadhawan arXiv_CL arXiv_CL  Transformer  Bert  RNN  Pose  Classification  Deep_Learning  PDF
• 2020-10-01 Joint Persian Word Segmentation Correction and Zero-Width Non-Joiner Recognition Using BERT    Ehsan Doostmohammadi, Minoo Nassajian, Adel Rahimi arXiv_CL arXiv_CL  Segmentation  Recognition  Bert  PDF
• 2020-10-01 RRF102: Meeting the TREC-COVID Challenge with a 100+ Runs Ensemble    Michael Bendersky, Honglei Zhuang, Ji Ma, Shuguang Han, Keith Hall, Ryan McDonald arXiv_CL arXiv_CL  Bert  Pose  Medical  PDF
• 2020-10-01 Examining the rhetorical capacities of neural language models    Zining Zhu, Chuer Pan, Mohamed Abdalla, Frank Rudzicz arXiv_CL arXiv_CL  Transformer  Bert  Knowledge  Pose  Quantitative  Language_Model  PDF
• 2020-09-30 Extracting Concepts for Precision Oncology from the Biomedical Literature    Nicholas Greenspan, Yuqi Si, Kirk Roberts arXiv_AI arXiv_AI  Bert  Pose  Action  Medical  PDF
• 2020-09-30 A Tale of Two Linkings: Dynamically Gating between Schema Linking and Structural Linking for Text-to-SQL Parsing    Sanxing Chen, Aidan San, Xiaodong Liu, Yangfeng Ji arXiv_CL arXiv_CL  Bert  Pose  Relation  Prediction  PDF
• 2020-09-30 BERT for Monolingual and Cross-Lingual Reverse Dictionary    Hang Yan, Xiaonan Li, Xipeng Qiu arXiv_CL arXiv_CL  Embedding  Bert  Pose  PDF
• 2020-09-30 AUBER: Automated BERT Regularization    Hyun Dong Lee, Seongmin Lee, U Kang arXiv_AI arXiv_AI  Reinforcement_Learning  Bert  Regularization  Pose  Attention  PDF
• 2020-09-29 MaP: A Matrix-based Prediction Approach to Improve Span Extraction in Machine Reading Comprehension    Huaishao Luo, Yu Shi, Ming Gong, Linjun Shou, Tianrui Li arXiv_CL arXiv_CL  Bert  Pose  Action  Prediction  PDF
• 2020-09-29 Cross-lingual Alignment Methods for Multilingual BERT: A Comparative Study    Saurabh Kulshreshtha, José Luis Redondo-García, Ching-Yun Chang arXiv_CL arXiv_CL  Embedding  Recognition  Bert  Zero-Shot  Pose  PDF
• 2020-09-29 TEST_POSITIVE at W-NUT 2020 Shared Task-3: Joint Event Multi-task Learning for Slot Filling in Noisy Text    Chacha Chen, Chieh-Yang Huang, Yaqi Hou, Yang Shi, Enyan Dai, Jiaqi Wang arXiv_CL arXiv_CL  Recognition  Bert  Pose  Language_Model  Prediction  PDF
• 2020-09-29 Contrastive Distillation on Intermediate Representations for Language Model Compression    Siqi Sun, Zhe Gan, Yu Cheng, Yuwei Fang, Shuohang Wang, Jingjing Liu arXiv_CL arXiv_CL  Bert  Knowledge  Pose  Language_Model  PDF
• 2020-09-29 Parsing with Multilingual BERT, a Small Corpus, and a Small Treebank    Ethan C. Chau, Lucy H. Lin, Noah A. Smith arXiv_CL arXiv_CL  Bert  Pose  Relation  PDF
• 2020-09-29 Gender prediction using limited Twitter Data    Maaike Burghoorn, Maaike H.T. de Boer, Stephan Raaijmakers arXiv_AI arXiv_AI  Transformer  Embedding  Bert  Classification  Detection  Prediction  PDF
• 2020-09-29 GraPPa: Grammar-Augmented Pre-Training for Table Semantic Parsing    Tao Yu, Chien-Sheng Wu, Xi Victoria Lin, Bailin Wang, Yi Chern Tan, Xinyi Yang, Dragomir Radev, Richard Socher, Caiming Xiong arXiv_AI arXiv_AI  Bert  Weakly_Supervised  Language_Model  PDF
• 2020-09-29 HINT3: Raising the bar for Intent Detection in the Wild    Gaurav Arora, Chirag Jain, Manas Chaturvedi, Krupal Modi arXiv_CL arXiv_CL  Bert  Pose  Detection  Relation  QA  PDF
• 2020-09-29 Neural Retrieval for Question Answering with Cross-Attention Supervised Data Augmentation    Yinfei Yang, Ning Jin, Kuo Lin, Mandy Guo, Daniel Cer arXiv_CL arXiv_CL  Embedding  Bert  Classification  Attention  Matching  PDF
• 2020-09-28 DialoGLUE: A Natural Language Understanding Benchmark for Task-Oriented Dialogue    Shikib Mehri, Mihail Eric, Dilek Hakkani-Tur arXiv_AI arXiv_AI  Bert  Self-Supervised  PDF
• 2020-09-28 PIN: A Novel Parallel Interactive Network for Spoken Language Understanding    Peilin Zhou, Zhiqi Huang, Fenglin Liu, Yuexian Zou arXiv_CL arXiv_CL  Embedding  Bert  RNN  Pose  Detection  Relation  Language_Model  Prediction  PDF
• 2020-09-28 Similarity Detection Pipeline for Crawling a Topic Related Fake News Corpus    Inna Vogel, Jeong-Eun Choi, Meghana Meghana arXiv_CL arXiv_CL  Embedding  Bert  RNN  Knowledge  Pose  Detection  PDF
• 2020-09-28 Knowledge-Aware Procedural Text Understanding with Multi-Stage Training    Zhihan Zhang, Xiubo Geng, Tao Qin, Yunfang Wu, Daxin Jiang arXiv_AI arXiv_AI  Tracking  Bert  Knowledge  Pose  PDF
• 2020-09-28 A Simple and Efficient Ensemble Classifier Combining Multiple Neural Network Models on Social Media Datasets in Vietnamese    Huy Duc Huynh, Hang Thi-Thuy Do, Kiet Van Nguyen, Ngan Luu-Thuy Nguyen arXiv_CL arXiv_CL  Bert  Text_Classification  RNN  Pose  Classification  Deep_Learning  Sentiment  Attention  PDF
• 2020-09-28 Fancy Man Lauches Zippo at WNUT 2020 Shared Task-1: A Bert Case Model for Wet Lab Entity Extraction    Haoding Meng, Qingcheng Zeng, Xiaoyang Fang, Zhexin Liang arXiv_CL arXiv_CL  Transformer  Bert  RNN  Action  Deep_Learning  Attention  PDF
• 2020-09-27 Unsupervised Pre-training for Biomedical Question Answering    Vaishnavi Kommaraju, Karthick Gunasekaran, Kun Li, Trapit Bansal, Andrew McCallum, Ivana Williams, Ana-Maria Istrate arXiv_CL arXiv_CL  Unsupervised  Bert  Represenation_Learning  Pose  Medical  QA  PDF
• 2020-09-27 What does it mean to be language-agnostic? Probing multilingual sentence encoders for typological properties    Rochelle Choenni, Ekaterina Shutova arXiv_CL arXiv_CL  Bert  Pose  PDF
• 2020-09-27 TernaryBERT: Distillation-aware Ultra-low Bit BERT    Wei Zhang, Lu Hou, Yichun Yin, Lifeng Shang, Xiao Chen, Xin Jiang, Qun Liu arXiv_CL arXiv_CL  Transformer  Quantization  Bert  Knowledge  Pose  PDF
• 2020-09-26 Techniques to Improve Q&A Accuracy with Transformer-based models on Large Complex Documents    Chejui Liao, Tabish Maniar, Sravanajyothi N, Anantha Sharma arXiv_CL arXiv_CL  Transformer  Bert  PDF
• 2020-09-26 ARPA: Armenian Paraphrase Detection Corpus and Models    Arthur Malajyan, Karen Avetisyan, Tsolak Ghukasyan arXiv_CL arXiv_CL  Bert  Review  Detection  PDF
• 2020-09-25 BET: A Backtranslation Approach for Easy Data Augmentation in Transformer-based Paraphrase Identification Context    Jean-Philippe Corbeil, Hadi Abdi Ghadivel arXiv_CL arXiv_CL  Transformer  Bert  Deep_Learning  PDF
• 2020-09-25 A little goes a long way: Improving toxic language classification despite data scarcity    Mika Juuti, Tommi Gröndahl, Adrian Flanagan, N. Asokan arXiv_CL arXiv_CL  Transformer  Bert  Classification  Detection  PDF
• 2020-09-25 RecoBERT: A Catalog Language Model for Text-Based Recommendations    Itzik Malkiel, Oren Barkan, Avi Caciularu, Noam Razin, Ori Katz, Noam Koenigstein arXiv_CL arXiv_CL  Bert  Review  Self-Supervised  Inference  Language_Model  Recommendation  PDF
• 2020-09-25 An Unsupervised Sentence Embedding Method byMutual Information Maximization    Yan Zhang, Ruidan He, Zuozhu Liu, Kwan Hui Lim, Lidong Bing arXiv_CL arXiv_CL  Embedding  Unsupervised  Bert  Self-Supervised  Pose  PDF
• 2020-09-25 Revealing the Myth of Higher-Order Inference in Coreference Resolution    Liyan Xu, Jinho D. Choi arXiv_CL arXiv_CL  Bert  Represenation_Learning  Inference  PDF
• 2020-09-24 Adapting BERT for Word Sense Disambiguation with Gloss Selection Objective and Example Sentences    Boon Peng Yap, Andrew Koh Jin Jie, Eng Siong Chng arXiv_CL arXiv_CL  Transfer_Learning  Bert  Pose  Language_Model  PDF
• 2020-09-24 Feature Adaptation of Pre-Trained Language Models across Languages and Domains for Text Classification    Hai Ye, Qingyu Tan, Ruidan He, Juntao Li, Hwee Tou Ng, Lidong Bing arXiv_CL arXiv_CL  Unsupervised  Bert  Text_Classification  Review  Classification  Attention  Language_Model  PDF
• 2020-09-24 CogniFNN: A Fuzzy Neural Network Framework for Cognitive Word Embedding Evaluation    Xinping Liu, Zehong Cao, Son Tran arXiv_AI arXiv_AI  Embedding  Tracking  Bert  Pose  Prediction  PDF
• 2020-09-24 AnchiBERT: A Pre-Trained Model for Ancient ChineseLanguage Understanding and Generation    Huishuang Tian, Kexin Yang, Dayiheng Liu, Jiancheng Lv arXiv_CL arXiv_CL  Bert  Classification  Language_Model  PDF
• 2020-09-23 Improving Dialog Evaluation with a Multi-reference Adversarial Dataset and Large Scale Pretraining    Ananya B. Sai, Akash Kumar Mohankumar, Siddhartha Arora, Mitesh M. Khapra arXiv_CL arXiv_CL  Embedding  Bert  Adversarial  Pose  Relation  PDF
• 2020-09-23 X-LXMERT: Paint, Caption and Answer Questions with Multi-Modal Transformers    Jaemin Cho, Jiasen Lu, Dustin Schwenk, Hannaneh Hajishirzi, Aniruddha Kembhavi arXiv_AI arXiv_AI  Image_Caption  Transformer  Bert  VQA  Caption  Language_Model  PDF
• 2020-09-23 A Token-wise CNN-based Method for Sentence Compression    Weiwei Hou, Hanna Suominen, Piotr Koniusz, Sabrina Caldwell, Tom Gedeon arXiv_CL arXiv_CL  Transformer  Bert  RNN  Pose  CNN  PDF
• 2020-09-23 A Comparative Study on Structural and Semantic Properties of Sentence Embeddings    Alexander Kalinowski, Yuan An arXiv_CL arXiv_CL  Transformer  Embedding  Bert  Knowledge  Knowledge_Graph  Pose  Action  Relation  Relation_Extraction  PDF
• 2020-09-22 On Data Augmentation for Extreme Multi-label Classification    Danqing Zhang, Tao Li, Haiyang Zhang, Bing Yin arXiv_AI arXiv_AI  Bert  Pose  Classification  Attention  PDF
• 2020-09-22 Let's Stop Incorrect Comparisons in End-to-end Relation Extraction!    Bruno Taillé, Vincent Guigue, Geoffrey Scoutheeten, Patrick Gallinari arXiv_AI arXiv_AI  Bert  Pose  Action  Relation  Relation_Extraction  Language_Model  PDF
• 2020-09-22 AutoRC: Improving BERT Based Relation Classification Models via Architecture Search    Wei Zhu, Xiaoling Wang, Xipeng Qiu, Yuan Ni, Guotong Xie arXiv_CL arXiv_CL  NAS  Bert  Action  Classification  Deep_Learning  Relation  PDF
• 2020-09-22 Beat the AI: Investigating Adversarial Human Annotation for Reading Comprehension    Max Bartolo, Alastair Roberts, Johannes Welbl, Sebastian Riedel, Pontus Stenetorp arXiv_CL arXiv_CL  Bert  Adversarial  PDF
• 2020-09-22 GRACE: Gradient Harmonized and Cascaded Labeling for Aspect-based Sentiment Analysis    Huaishao Luo, Lei Ji, Tianrui Li, Nan Duan, Daxin Jiang arXiv_CL arXiv_CL  Bert  Sentiment_Classification  Pose  Action  Classification  Detection  Sentiment  Object_Detection  Attention  PDF
• 2020-09-22 Constructing interval variables via faceted Rasch measurement and multitask deep learning: a hate speech application    Chris J. Kennedy, Geoff Bacon, Alexander Sahn, Claudia von Vacano arXiv_CL arXiv_CL  Bert  Speech  Pose  Face  Survey  Deep_Learning  Prediction  PDF
• 2020-09-21 'When they say weed causes depression, but it's your fav antidepressant': Knowledge-aware Attention Framework for Relationship Extraction    Shweta Yadav, Usha Lokala, Raminta Daniulaityte, Krishnaprasad Thirunarayan, Francois Lamy, Amit Sheth arXiv_CL arXiv_CL  Bert  Knowledge  Ontology  Action  Deep_Learning  Relation  Attention  Medical  PDF
• 2020-09-21 Latin BERT: A Contextual Language Model for Classical Philology    David Bamman, Patrick J. Burns arXiv_CL arXiv_CL  Embedding  Bert  Speech  Language_Model  PDF
• 2020-09-21 WESSA at SemEval-2020 Task 9: Code-Mixed Sentiment Analysis using Transformers    Ahmed Sultan (WideBot), Mahmoud Salim (WideBot), Amina Gaber (WideBot), Islam El Hosary (WideBot) arXiv_AI arXiv_AI  Transformer  Transfer_Learning  Bert  Sentiment  Language_Model  PDF
• 2020-09-21 Profile Consistency Identification for Open-domain Dialogue Agents    Haoyu Song, Yan Wang, Wei-Nan Zhang, Zhengyu Zhao, Ting Liu, Xiaojiang Liu arXiv_CL arXiv_CL  Bert  Pose  Relation  PDF
• 2020-09-20 Persian Ezafe Recognition Using Transformers and Its Role in Part-Of-Speech Tagging    Ehsan Doostmohammadi, Minoo Nassajian, Adel Rahimi arXiv_CL arXiv_CL  Transformer  Recognition  Bert  Speech  PDF
• 2020-09-20 Dual-path CNN with Max Gated block for Text-Based Person Re-identification    Tinghuai Ma, Mingming Yang, Huan Rong, Yurong Qian, Yurong Qian, Yuan Tian, NajlaAl-Nabhan arXiv_CV arXiv_CV  Surveillance  Embedding  Person_Re-identification  Bert  Salient  Pose  Action  Classification  Attention  Re-identification  CNN  Language_Model  Matching  PDF
• 2020-09-19 BioALBERT: A Simple and Effective Pre-trained Language Model for Biomedical Named Entity Recognition    Usman Naseem, Matloob Khushi, Vinay Reddy, Sakthivel Rajendran, Imran Razzak, Jinman Kim arXiv_CL arXiv_CL  Transformer  Recognition  Bert  Self-Supervised  Pose  Medical  Language_Model  PDF
• 2020-09-19 Nominal Compound Chain Extraction: A New Task for Semantic-enriched Lexical Chain    Bobo Li, Hao Fei, Yafeng Ren, Donghong Ji arXiv_CL arXiv_CL  Bert  Pose  Face  Action  Detection  Prediction  PDF
• 2020-09-19 Prior Art Search and Reranking for Generated Patent Text    Jieh-Sheng Lee, Jieh Hsiang arXiv_CL arXiv_CL  Embedding  Bert  Knowledge  Pose  PDF
• 2020-09-18 Will it Unblend?    Yuval Pinter, Cassandra L. Jacobs, Jacob Eisenstein arXiv_AI arXiv_AI  Embedding  Bert  Language_Model  PDF
• 2020-09-18 FarsTail: A Persian Natural Language Inference Dataset    Hossein Amirkhani, Mohammad Azari Jafari, Azadeh Amirak, Zohreh Pourjafari, Soroush Faridan Jahromi, Zeinab Kouhkan arXiv_CL arXiv_CL  Embedding  Bert  Deep_Learning  Inference  Language_Model  PDF
• 2020-09-18 The birth of Romanian BERT    Stefan Daniel Dumitrescu, Andrei-Marius Avram, Sampo Pyysalo arXiv_CL arXiv_CL  Transformer  Bert  Language_Model  PDF
• 2020-09-18 fastHan: A BERT-based Joint Many-Task Toolkit for Chinese NLP    Zhichao Geng, Hang Yan, Xipeng Qiu, Xuanjing Huang arXiv_CL arXiv_CL  Segmentation  Recognition  Bert  Knowledge  Speech  Deep_Learning  PDF
• 2020-09-18 NEU at WNUT-2020 Task 2: Data Augmentation To Tell BERT That Death Is Not Necessarily Informative    Kumud Chauhan arXiv_CL arXiv_CL  Bert  Pose  PDF
• 2020-09-17 A Computational Approach to Understanding Empathy Expressed in Text-Based Mental Health Support    Ashish Sharma, Adam S. Miner, David C. Atkins, Tim Althoff arXiv_CL arXiv_CL  Bert  Face  Action  Prediction  PDF
• 2020-09-17 A Multimodal Memes Classification: A Survey and Open Research Issues    Tariq Habib Afridi, Aftab Alam, Muhammad Numan Khan, Jawad Khan, Young-Koo Lee arXiv_AI arXiv_AI  Image_Caption  Bert  Knowledge  Pose  Survey  Classification  VQA  Attention  Caption  QA  PDF
• 2020-09-17 GraphCodeBERT: Pre-training Code Representations with Data Flow    Daya Guo, Shuo Ren, Shuai Lu, Zhangyin Feng, Duyu Tang, Shujie Liu, Long Zhou, Nan Duan, Jian Yin, Daxin Jiang, Ming Zhou arXiv_CL arXiv_CL  Transformer  Bert  Detection  Relation  Attention  Summarization  Language_Model  PDF
• 2020-09-17 Compositional and Lexical Semantics in RoBERTa, BERT and DistilBERT: A Case Study on CoQA    Ieva Staliūnaitė, Ignacio Iacobacci arXiv_CL arXiv_CL  Embedding  Bert  Knowledge  Language_Model  QA  PDF
• 2020-09-17 DSC IIT-ISM at SemEval-2020 Task 6: Boosting BERT with Dependencies for Definition Extraction    Aadarsh Singh, Priyanshu Kumar, Aman Sinha arXiv_CL arXiv_CL  Transformer  Bert  Pose  Action  CNN  Language_Model  PDF
• 2020-09-17 Multi^2OIE: Multilingual Open Information Extraction based on Multi-Head Attention with BERT    Youngbin Ro, Yukyung Lee, Pilsung Kang arXiv_CL arXiv_CL  Transformer  Bert  Pose  Action  Attention  PDF
• 2020-09-17 Efficient Transformer-based Large Scale Language Representations using Hardware-friendly Block Structured Pruning    Bingbing Li, Zhenglun Kong, Tianyun Zhang, Ji Li, Zhengang Li, Hang Liu, Caiwen Ding arXiv_AI arXiv_AI  Transformer  Bert  Optimization  Knowledge  Pose  Language_Model  PDF
• 2020-09-17 Cross-Modal Alignment with Mixture Experts Neural Network for Intral-City Retail Recommendation    Po Li, Lei Li, Yan Fu, Jun Rong, Yu Zhang arXiv_CV arXiv_CV  Image_Caption  Transformer  Embedding  Bert  Pose  Action  Prediction  Recommendation  PDF
• 2020-09-16 Image Separation with Side Information: A Connected Auto-Encoders Based Approach    Wei Pu, Barak Sober, Nathan Daly, Zahra Sabetsarvestani, Catherine Higgitt, Ingrid Daubechies, Miguel R.D. Rodrigues arXiv_AI arXiv_AI  Bert  Self-Supervised  Pose  CNN  PDF
• 2020-09-16 Deep Learning Approaches for Extracting Adverse Events and Indications of Dietary Supplements from Clinical Text    Yadan Fan, Sicheng Zhou, Yifan Li, Rui Zhang arXiv_CL arXiv_CL  Transformer  Recognition  Bert  RNN  Knowledge  Action  Deep_Learning  Relation  Relation_Extraction  Attention  CNN  PDF
• 2020-09-16 RobBERT: a Dutch RoBERTa-based Language Model    Pieter Delobelle, Thomas Winters, Bettina Berendt arXiv_CL arXiv_CL  Bert  Language_Model  PDF
• 2020-09-16 SciBERT-based Semantification of Bioassays in the Open Research Knowledge Graph    Marco Anteghini, Jennifer D'Souza, Vitor A. P. Martins dos Santos, Sören Auer arXiv_AI arXiv_AI  Bert  Knowledge  Knowledge_Graph  Pose  PDF
• 2020-09-16 UNION: An Unreferenced Metric for Evaluating Open-ended Story Generation    Jian Guan, Minlie Huang arXiv_CL arXiv_CL  Bert  Pose  Text_Generation  PDF
• 2020-09-16 Solomon at SemEval-2020 Task 11: Ensemble Architecture for Fine-Tuned Propaganda Detection in News Articles    Mayank Raj, Ajay Jaiswal, Rohit R.R, Ankita Gupta, Sudeep Kumar Sahoo, Vertika Srivastava, Yeon Hyang Kim arXiv_AI arXiv_AI  Transformer  Bert  Classification  Detection  GAN  Prediction  PDF
• 2020-09-15 Augmented Natural Language for Generative Sequence Labeling    Ben Athiwaratkun, Cicero Nogueira dos Santos, Jason Krone, Bing Xiang arXiv_CL arXiv_CL  Recognition  Bert  Knowledge  Pose  Classification  Few-Shot  PDF
• 2020-09-15 BERT-QE: Contextualized Query Expansion for Document Re-ranking    Zhi Zheng, Kai Hui, Ben He, Xianpei Han, Le Sun, Andrew Yates arXiv_AI arXiv_AI  Bert  Pose  PDF
• 2020-09-15 Lessons Learned from Applying off-the-shelf BERT: There is no SilverBullet    Victor Makarenkov, Lior Rokach arXiv_AI arXiv_AI  Embedding  Bert  RNN  Classification  PDF
• 2020-09-15 Event Presence Prediction Helps Trigger Detection Across Languages    Parul Awasthy, Tahira Naseem, Jian Ni, Taesun Moon, Radu Florian arXiv_CL arXiv_CL  Transformer  Bert  Pose  Action  Classification  Detection  Prediction  PDF
• 2020-09-15 MLMLM: Link Prediction with Mean Likelihood Masked Language Model    Louis Clouatre, Philippe Trempe, Amal Zouaq, Sarath Chandar arXiv_AI arXiv_AI  Embedding  Bert  Knowledge  Pose  Language_Model  Prediction  PDF
• 2020-09-15 Achieving Real-Time Execution of Transformer-based Large-scale Models on Mobile with Compiler-aware Neural Architecture Optimization    Wei Niu, Zhenglun Kong, Geng Yuan, Weiwen Jiang, Jiexiong Guan, Caiwen Ding, Pu Zhao, Sijia Liu, Bin Ren, Yanzhi Wang arXiv_AI arXiv_AI  Transformer  NAS  Bert  Optimization  Pose  Language_Model  PDF
• 2020-09-14 Not-NUTs at W-NUT 2020 Task 2: A BERT-based System in Identifying Informative COVID-19 English Tweets    Thai Quoc Hoang, Phuong Thu Vu arXiv_CL arXiv_CL  Bert  Pose  PDF
• 2020-09-14 Can Fine-tuning Pre-trained Models Lead to Perfect NLP? A Study of the Generalizability of Relation Extraction    Ningyu Zhang, Luoqiu Li, Shumin Deng, Haiyang Yu, Xu Cheng, Wei Zhang, Huajun Chen arXiv_CL arXiv_CL  Bert  Adversarial  Pose  Action  Relation  Relation_Extraction  PDF
• 2020-09-13 Margin-Based Regularization and Selective Sampling in Deep Neural Networks    Berry Weinstein, Shai Fine, Yacov Hel-Or arXiv_AI arXiv_AI  Bert  Text_Classification  Regularization  Pose  Classification  CNN  Image_Classification  PDF
• 2020-09-13 BoostingBERT:Integrating Multi-Class Boosting into BERT for NLP Tasks    Tongwen Huang, Qingyun She, Junlin Zhang arXiv_AI arXiv_AI  Transformer  Bert  Knowledge  Pose  PDF
• 2020-09-12 Fine-tuning Pre-trained Contextual Embeddings for Citation Content Analysis in Scholarly Publication    Haihua Chen, Huyen Nguyen arXiv_AI arXiv_AI  Embedding  Bert  Pose  Deep_Learning  Sentiment  Recommendation  PDF
• 2020-09-12 Country Image in COVID-19 Pandemic: A Case Study of China    Huimin Chen, Zeyu Zhu, Fanchao Qi, Yining Ye, Zhiyuan Liu, Maosong Sun, Jianbin Jin arXiv_CL arXiv_CL  Bert  Knowledge  Action  Relation  Sentiment  PDF
• 2020-09-12 CIA_NITT at WNUT-2020 Task 2: Classification of COVID-19 Tweets Using Pre-trained Language Models    Yandrapati Prakash Babu, Rajagopal Eswari arXiv_CL arXiv_CL  Bert  Text_Classification  Classification  Language_Model  PDF
• 2020-09-11 Compressed Deep Networks: Goodbye SVD, Hello Robust Low-Rank Approximation    Murad Tukan, Alaa Maalouf, Matan Weksler, Dan Feldman arXiv_AI arXiv_AI  Embedding  Bert  Regularization  PDF
• 2020-09-11 UPB at SemEval-2020 Task 6: Pretrained Language Models for DefinitionExtraction    Andrei-Marius Avram, Dumitru-Clementin Cercel, Costin-Gabriel Chiru arXiv_AI arXiv_AI  Bert  Action  Classification  Relation  Language_Model  PDF
• 2020-09-11 A Comparison of LSTM and BERT for Small Corpus    Aysu Ezen-Can arXiv_CL arXiv_CL  Transformer  Transfer_Learning  Bert  Text_Classification  RNN  Face  Classification  Text_Generation  QA  PDF
• 2020-09-11 IndoNLU: Benchmark and Resources for Evaluating Indonesian Natural Language Understanding    Bryan Wilie, Karissa Vincentio, Genta Indra Winata, Samuel Cahyawijaya, Xiaohong Li, Zhi Yuan Lim, Sidik Soleman, Rahmad Mahendra, Pascale Fung, Syafri Bahar, Ayu Purwarianti arXiv_CL arXiv_CL  Bert  Classification  PDF
• 2020-09-11 UPB at SemEval-2020 Task 11: Propaganda Detection with Domain-Specific Trained BERT    Andrei Paraschiv, Dumitru-Clementin Cercel, Mihai Dascalu arXiv_CL arXiv_CL  Bert  Pose  Classification  Detection  GAN  PDF
• 2020-09-10 FILTER: An Enhanced Fusion Method for Cross-lingual Language Understanding    Yuwei Fang, Shuohang Wang, Zhe Gan, Siqi Sun, Jingjing Liu arXiv_CL arXiv_CL  Bert  Zero-Shot  Represenation_Learning  Knowledge  Pose  Classification  Inference  Language_Model  Prediction  PDF
• 2020-09-10 RadLex Normalization in Radiology Reports    Surabhi Datta, Jordan Godfrey-Stovall, Kirk Roberts arXiv_CL arXiv_CL  Bert  Pose  Action  Deep_Learning  Detection  Object_Detection  Language_Model  PDF
• 2020-09-10 Investigating Gender Bias in BERT    Rishabh Bhardwaj, Navonil Majumder, Soujanya Poria arXiv_CL arXiv_CL  Embedding  Bert  Text_Classification  Pose  Emotion  Classification  Sentiment  Language_Model  Prediction  PDF
• 2020-09-10 Modern Methods for Text Generation    Dimas Munoz Montesinos arXiv_CL arXiv_CL  Transformer  Bert  Text_Classification  Classification  Summarization  Text_Generation  PDF
• 2020-09-10 RVL-BERT: Visual Relationship Detection with Visual-Linguistic Knowledge from Pre-trained Representations    Meng-Jiun Chiou, Roger Zimmermann, Jiashi Feng arXiv_CV arXiv_CV  Transformer  Recognition  Bert  Salient  Knowledge  Self-Supervised  Pose  Quantitative  Detection  Relation  Object_Detection  Attention  Visual_Relation  PDF
• 2020-09-10 Do Response Selection Models Really Know What's Next? Utterance Manipulation Strategies for Multi-turn Response Selection    Taesun Whang, Dongyub Lee, Dongsuk Oh, Chanhee Lee, Kijong Han, Dong-hun Lee, Saebyeok Lee arXiv_AI arXiv_AI  Bert  Self-Supervised  Pose  Classification  Language_Model  Prediction  PDF
• 2020-09-10 Learning Universal Representations from Word to Sentence    Yian Li, Hai Zhao arXiv_CL arXiv_CL  Transformer  Embedding  Bert  Represenation_Learning  PDF
• 2020-09-09 Pay Attention when Required    Swetha Mandava, Szymon Migacz, Alex Fit Florea arXiv_CL arXiv_CL  Transformer  Bert  Pose  Attention  Language_Model  PDF
• 2020-09-09 Comparative Study of Language Models on Cross-Domain Data with Model Agnostic Explainability    Mayank Chhipa, Hrushikesh Mahesh Vazurkar, Abhijeet Kumar, Mridul Mishra arXiv_CL arXiv_CL  Transformer  Bert  Classification  Detection  Sentiment  Language_Model  PDF
• 2020-09-08 Brown University at TREC Deep Learning 2019    George Zerveas, Ruochen Zhang, Leila Kim, Carsten Eickhoff arXiv_CL arXiv_CL  Transformer  Bert  Face  Deep_Learning  Language_Model  Prediction  PDF
• 2020-09-08 ERNIE at SemEval-2020 Task 10: Learning Word Emphasis Selection by Pre-trained Language Model    Zhengjie Huang, Shikun Feng, Weiyue Su, Xuyi Chen, Shuohuan Wang, Jiaxiang Liu, Xuan Ouyang, Yu Sun arXiv_CL arXiv_CL  Unsupervised  Bert  Language_Model  PDF
• 2020-09-08 Simple is Better! Lightweight Data Augmentation for Low Resource Slot Filling and Intent Classification    Samuel Louvan, Bernardo Magnini arXiv_CL arXiv_CL  Bert  Classification  PDF
• 2020-09-07 UIT-HSE at WNUT-2020 Task 2: Exploiting CT-BERT for Identifying COVID-19 Information on the Twitter Social Network    Khiem Vinh Tran, Hao Phu Phan, Kiet Van Nguyen, Ngan Luu-Thuy Nguyen arXiv_CL arXiv_CL  Transformer  Bert  Pose  PDF
• 2020-09-07 Robust Digital Envelope Estimation Via Geometric Properties of an Arbitrary Real Signal    Carlos Tarjano, Valdecy Pereira arXiv_SD arXiv_SD  Recognition  Bert  Knowledge  Speech  Pose  Classification  Detection  Speech_Recognition  PDF
• 2020-09-07 E-BERT: A Phrase and Product Knowledge Enhanced Language Model for E-commerce    Denghui Zhang, Zixuan Yuan, Yanchi Liu, Fuzhen Zhuang, Hui Xiong arXiv_AI arXiv_AI  Reconstruction  Bert  Sentiment_Classification  Knowledge  Review  Pose  Action  Classification  Sentiment  Denoising  Attention  Language_Model  PDF
• 2020-09-06 UPB at SemEval-2020 Task 9: Identifying Sentiment in Code-Mixed Social Media Texts using Transformers and Multi-Task Learning    George-Eduard Zaharia, George-Alexandru Vlad, Dumitru-Clementin Cercel, Traian Rebedea, Costin-Gabriel Chiru arXiv_CL arXiv_CL  Transformer  Embedding  Bert  Action  Sentiment  PDF
• 2020-09-06 UPB at SemEval-2020 Task 8: Joint Textual and Visual Modeling in a Multi-Task Learning Architecture for Memotion Analysis    George-Alexandru Vlad, George-Eduard Zaharia, Dumitru-Clementin Cercel, Costin-Gabriel Chiru, Stefan Trausan-Matu arXiv_CL arXiv_CL  Image_Caption  Bert  Pose  Emotion  PDF
• 2020-09-06 EdinburghNLP at WNUT-2020 Task 2: Leveraging Transformers with Generalized Augmentation for Identifying Informativeness in COVID-19 Tweets    Nickil Maveli arXiv_CL arXiv_CL  Transformer  Embedding  Bert  Pose  GAN  PDF
• 2020-09-06 QiaoNing at SemEval-2020 Task 4: Commonsense Validation and Explanation system based on ensemble of language model    Pai Liu arXiv_AI arXiv_AI  Transfer_Learning  Bert  Language_Model  PDF
• 2020-09-05 Accenture at CheckThat! 2020: If you say so: Post-hoc fact-checking of claims using transformer-based models    Evan Williams, Paul Rodrigues, Valerie Novak arXiv_CL arXiv_CL  Transformer  Bert  Review  PDF
• 2020-09-03 Multi-Perspective Semantic Information Retrieval    Samarth Rawal, Chitta Baral arXiv_CL arXiv_CL  Bert  Deep_Learning  Medical  QA  PDF
• 2020-09-03 Biomedical named entity recognition using BERT in the machine reading comprehension framework    Cong Sun, Zhihao Yang, Lei Wang, Yin Zhang, Hongfei Lin, Jian Wang arXiv_CL arXiv_CL  Recognition  Bert  Knowledge  Medical  PDF
• 2020-09-03 A Comparison of Pre-trained Vision-and-Language Models for Multimodal Representation Learning across Medical Images and Reports    Yikuan Li, Hanyin Wang, Yuan Luo arXiv_CV arXiv_CV  Embedding  Bert  Represenation_Learning  RNN  Classification  VQA  Attention  Medical  Language_Model  PDF
• 2020-09-02 Comparative Evaluation of Pretrained Transfer Learning Models on Automatic Short Answer Grading    Sasi Kiran Gaddipati, Deebul Nair, Paul G. Plöger arXiv_CL arXiv_CL  Embedding  Transfer_Learning  Bert  Face  Relation  PDF
• 2020-09-01 Automatic Assignment of Radiology Examination Protocols Using Pre-trained Language Models with Knowledge Distillation    Wilson Lau, Laura Aaltonen, Martin Gunn, Meliha Yetisgen arXiv_CL arXiv_CL  Bert  Knowledge  Classification  Deep_Learning  Language_Model  PDF
• 2020-09-01 Sentimental LIAR: Extended Corpus and Deep Learning Models for Fake Claim Classification    Bibek Upadhayay, Vahid Behzadan arXiv_CL arXiv_CL  Unsupervised  Bert  Pose  Emotion  Classification  Deep_Learning  Detection  Sentiment  Language_Model  PDF
• 2020-08-31 A Bidirectional Tree Tagging Scheme for Jointly Extracting Overlapping Entities and Relations    Xukun Luo, Weijie Liu, Meng Ma, Ping Wang arXiv_CL arXiv_CL  Bert  RNN  Review  Pose  Action  Classification  Relation  PDF
• 2020-08-30 QMUL-SDS at CheckThat! 2020: Determining COVID-19 Tweet Check-Worthiness Using an Enhanced CT-BERT with Numeric Expressions    Rabab Alkhalifa, Theodore Yoong, Elena Kochkina, Arkaitz Zubiaga, Maria Liakata arXiv_CL arXiv_CL  Bert  Pose  PDF
• 2020-08-29 SocCogCom at SemEval-2020 Task 11: Characterizing and Detecting Propaganda using Sentence-Level Emotional Salience Features    Gangeshwar Krishnamurthy, Raj Kumar Gupta, Yinping Yang arXiv_CL arXiv_CL  Bert  Emotion  Face  Detection  Relation  GAN  PDF
• 2020-08-28 Knowledge Efficient Deep Learning for Natural Language Processing    Hai Wang arXiv_CL arXiv_CL  Unsupervised  Transfer_Learning  Bert  Weakly_Supervised  Knowledge  Pose  Deep_Learning  Language_Model  PDF
• 2020-08-28 Rethinking the objectives of extractive question answering    Martin Fajcik, Josef Jon, Santosh Kesiraju, Pavel Smrz arXiv_AI arXiv_AI  Bert  Pose  QA  PDF
• 2020-08-27 Repurposing TREC-COVID Annotations to Answer the Key Questions of CORD-19    Connor T. Heaton, Prasenjit Mitra arXiv_CL arXiv_CL  Bert  Pose  GAN  Medical  PDF
• 2020-08-27 Entity and Evidence Guided Relation Extraction for DocRED    Kevin Huang, Guangtao Wang, Tengyu Ma, Jing Huang arXiv_CL arXiv_CL  OCR  Bert  Pose  Action  Relation  Relation_Extraction  Attention  Language_Model  Prediction  PDF
• 2020-08-27 GREEK-BERT: The Greeks visiting Sesame Street    John Koutsikakis, Ilias Chalkidis, Prodromos Malakasiotis, Ion Androutsopoulos arXiv_CL arXiv_CL  Transformer  Embedding  Recognition  Bert  Speech  Inference  Language_Model  PDF
• 2020-08-27 Query Focused Multi-document Summarisation of Biomedical Texts    Diego Molla, Christopher Jones, Vincent Nguyen arXiv_CL arXiv_CL  Embedding  Reinforcement_Learning  Bert  RNN  Classification  Medical  PDF
• 2020-08-27 AMBERT: A Pre-trained Language Model with Multi-Grained Tokenization    Xinsong Zhang, Hang Li arXiv_CL arXiv_CL  Bert  Pose  Language_Model  PDF
• 2020-08-26 Language Models and Word Sense Disambiguation: An Overview and Analysis    Daniel Loureiro, Kiamehr Rezaee, Mohammad Taher Pilehvar, Jose Camacho-Collados arXiv_CL arXiv_CL  Transformer  Bert  Knowledge  Action  Quantitative  Language_Model  PDF
• 2020-08-25 Conceptualized Representation Learning for Chinese Biomedical Text Mining    Ningyu Zhang, Qianghuai Jia, Kangping Yin, Liang Dong, Feng Gao, Nengwei Hua arXiv_CL arXiv_CL  Bert  Represenation_Learning  Pose  Medical  Language_Model  PDF
• 2020-08-24 Prediction of ICD Codes with Clinical BERT Embeddings and Text Augmentation with Label Balancing using MIMIC-III    Brent Biseda, Gaurav Desai, Haifeng Lin, Anish Philip arXiv_AI arXiv_AI  Embedding  Bert  Prediction  PDF
• 2020-08-24 Knowledge-Empowered Representation Learning for Chinese Medical Reading Comprehension: Task, Model and Resources    Taolin Zhang, Chengyu Wang, Minghui Qiu, Bite Yang, Xiaofeng He, Jun Huang arXiv_AI arXiv_AI  Bert  Represenation_Learning  Knowledge  Pose  Medical  Language_Model  PDF
• 2020-08-24 YNU-HPCC at SemEval-2020 Task 11: LSTM Network for Detection of Propaganda Techniques in News Articles    Jiaxu Dao arXiv_CL arXiv_CL  Bert  RNN  Deep_Learning  Detection  GAN  PDF
• 2020-08-24 syrapropa at SemEval-2020 Task 11: BERT-based Models Design For Propagandistic Technique and Span Detection    Jinfen Li, Lu Xiao arXiv_CL arXiv_CL  Bert  Pose  Classification  Detection  GAN  PDF
• 2020-08-22 DUTH at SemEval-2020 Task 11: BERT with Entity Mapping for Propaganda Classification    Anastasios Bairaktaris, Symeon Symeonidis, Avi Arampatzis arXiv_CL arXiv_CL  Recognition  OCR  Bert  Classification  Detection  GAN  PDF
• 2020-08-22 CyberWallE at SemEval-2020 Task 11: An Analysis of Feature Engineering for Ensemble Models for Propaganda Detection    Verena Blaschke, Maxim Korniyenko, Sam Tureski arXiv_CL arXiv_CL  Embedding  Bert  RNN  Classification  Detection  GAN  PDF
• 2020-08-22 HinglishNLP: Fine-tuned Language Models for Hinglish Sentiment Detection    Meghana Bhange, Nirant Kasliwal arXiv_CL arXiv_CL  Transformer  Bert  Pose  Detection  Sentiment  Language_Model  PDF
• 2020-08-22 FAT ALBERT: Finding Answers in Large Texts using Semantic Similarity Attention Layer based on BERT    Omar Mossad, Amgad Ahmed, Anandharaju Raju, Hari Karthikeyan, Zayed Ahmed arXiv_CL arXiv_CL  Transformer  Bert  Pose  Classification  Deep_Learning  Attention  Summarization  QA  PDF
• 2020-08-22 Applications of BERT Based Sequence Tagging Models on Chinese Medical Text Attributes Extraction    Gang Zhao, Teng Zhang, Chenxiao Wang, Ping Lv, Ji Wu arXiv_CL arXiv_CL  Bert  RNN  Action  Attention  Medical  PDF
• 2020-08-21 Team DoNotDistribute at SemEval-2020 Task 11: Features, Finetuning, and Data Augmentation in Neural Models for Propaganda Detection in News Articles    Michael Kranzlein, Shabnam Behzad, Nazli Goharian arXiv_CL arXiv_CL  Bert  Classification  Detection  GAN  PDF
• 2020-08-21 Fine-tune BERT for E-commerce Non-Default Search Ranking    Yunjiang Jiang, Yue Shang, Hongwei Shen, Wen-Yun Yang, Yun Xiao arXiv_CL arXiv_CL  Bert  Pose  Prediction  Matching  PDF
• 2020-08-21 Abstractive Summarization of Spoken andWritten Instructions with BERT    Alexandra Savelieva, Bryan Au-Yeung, Vasanth Ramani arXiv_AI arXiv_AI  Segmentation  Transfer_Learning  Bert  Speech  Summarization  PDF
• 2020-08-21 Adapting Event Extractors to Medical Data: Bridging the Covariate Shift    Aakanksha Naik, Jill Lehman, Carolyn Rose arXiv_CL arXiv_CL  Bert  Adversarial  Action  Medical  Language_Model  PDF
• 2020-08-20 Inducing Language-Agnostic Multilingual Representations    Wei Zhao, Steffen Eger, Johannes Bjerva, Isabelle Augenstein arXiv_CL arXiv_CL  Embedding  Bert  Zero-Shot  Action  PDF
• 2020-08-20 Do Syntax Trees Help Pre-trained Transformers Extract Information?    Devendra Singh Sachan, Yuhao Zhang, Peng Qi, William Hamilton arXiv_CL arXiv_CL  Transformer  Recognition  Bert  Pose  Action  Relation  Relation_Extraction  Attention  PDF
• 2020-08-20 An Experimental Study of Deep Neural Network Models for Vietnamese Multiple-Choice Reading Comprehension    Son T. Luu, Kiet Van Nguyen, Anh Gia-Tuan Nguyen, Ngan Luu-Thuy Nguyen arXiv_CL arXiv_CL  Embedding  Bert  PDF
• 2020-08-20 Assigning function to protein-protein interactions: a weakly supervised BioBERT based approach using PubMed abstracts    Aparna Elangovan, Melissa Davis, Karin Verspoor arXiv_CL arXiv_CL  Bert  Weakly_Supervised  Knowledge  Review  Action  Deep_Learning  Relation  Medical  PDF
• 2020-08-19 UoB at SemEval-2020 Task 12: Boosting BERT with Corpus Level Information    Wah Meng Lim, Harish Tayyar Madabushi arXiv_CL arXiv_CL  Bert  Detection  Language_Model  PDF
• 2020-08-18 Ranking Clarification Questions via Natural Language Inference    Vaibhav Kumar, Vikas Raunak, Jamie Callan arXiv_AI arXiv_AI  Bert  Action  Inference  QA  PDF
• 2020-08-17 Stock Index Prediction with Multi-task Learning and Word Polarity Over Time    Yue Zhou, Kerstin Voigt arXiv_CL arXiv_CL  Bert  Pose  Sentiment  Prediction  PDF
• 2020-08-17 BUT-FIT at SemEval-2020 Task 4: Multilingual commonsense    Josef Jon, Martin Fajčík, Martin Dočekal, Pavel Smrž arXiv_CL arXiv_CL  Bert  Pose  Relation  PDF
• 2020-08-16 DCR-Net: A Deep Co-Interactive Relation Network for Joint Dialog Act Recognition and Sentiment Classification    Libo Qin, Wanxiang Che, Yangming Li, Minheng Ni, Ting Liu arXiv_CL arXiv_CL  Transformer  Recognition  Bert  Sentiment_Classification  Knowledge  Pose  Action  Classification  Relation  Sentiment  PDF
• 2020-08-16 DeVLBert: Learning Deconfounded Visio-Linguistic Representations    Shengyu Zhang, Tan Jiang, Tan Wang, Kun Kuang, Zhou Zhao, Jianke Zhu, Jin Yu, Hongxia Yang, Fei Wu arXiv_CV arXiv_CV  Bert  Zero-Shot  Image_Retrieval  Pose  Quantitative  Relation  VQA  PDF
• 2020-08-16 TopicBERT: A Transformer transfer learning based memory-graph approach for multimodal streaming social media topic detection    Meysam Asgari-Chenaghlu, Mohammad-Reza Feizi-Derakhshi, Leili farzinvash, Mohammad-Ali Balafar, Cina Motamed arXiv_AI arXiv_AI  Transformer  Tracking  Unsupervised  Transfer_Learning  Recognition  Bert  Pose  Detection  Relation  PDF
• 2020-08-15 Jointly Fine-Tuning 'BERT-like' Self Supervised Models to Improve Multimodal Speech Emotion Recognition    Shamane Siriwardhana, Andrew Reis, Rivindu Weerasekera, Suranga Nanayakkara arXiv_CL arXiv_CL  Recognition  Bert  Speech  Emotion  PDF
• 2020-08-14 Quantification of BERT Diagnosis Generalizability Across Medical Specialties Using Semantic Dataset Distance    Mihir P. Khambete, William Su, Juan Garcia, Joseph Lehar, Martin Kang, Marcus A. Badgeley arXiv_CL arXiv_CL  Bert  Pose  Quantitative  Deep_Learning  Sentiment  GAN  Medical  PDF
• 2020-08-14 Hate Speech Detection and Racial Bias Mitigation in Social Media based on BERT model    Marzieh Mozafari, Reza Farahbakhsh, Noel Crespi arXiv_CL arXiv_CL  Transfer_Learning  Bert  Regularization  Speech  Pose  Detection  Language_Model  PDF
• 2020-08-14 A Hybrid BERT and LightGBM based Model for Predicting Emotion GIF Categories on Twitter    Ye Bi, Shuo Wang, Zhongrui Fan arXiv_CL arXiv_CL  Transformer  Bert  Pose  Emotion  Matching  PDF
• 2020-08-13 ANDES at SemEval-2020 Task 12: A jointly-trained BERT multilingual model for offensive language detection    Juan Manuel Pérez, Aymé Arango, Franco Luque arXiv_CL arXiv_CL  Bert  Zero-Shot  Pose  Detection  Few-Shot  PDF
• 2020-08-13 MICE: Mining Idioms with Contextual Embeddings    Tadej Škvorc, Polona Gantar, Marko Robnik-Šikonja arXiv_CL arXiv_CL  Embedding  Bert  Pose  PDF
• 2020-08-13 Large-scale Transfer Learning for Low-resource Spoken Language Understanding    Xueli Jia, Jianzong Wang, Zhiyong Zhang, Ning Cheng, Jing Xiao arXiv_CL arXiv_CL  Transformer  Transfer_Learning  Enhancement  Recognition  Bert  Speech  Pose  Action  Attention  Speech_Recognition  PDF
• 2020-08-12 Variance-reduced Language Pretraining via a Mask Proposal Network    Liang Chen, Tianyuan Zhang, Di He, Guolin Ke, Liwei Wang, Tie-Yan Liu arXiv_CL arXiv_CL  Bert  Optimization  Self-Supervised  Pose  PDF
• 2020-08-12 Compression of Deep Learning Models for Text: A Survey    Manish Gupta, Puneet Agrawal arXiv_AI arXiv_AI  Transformer  Quantization  Bert  RNN  Knowledge  Survey  Deep_Learning  GAN  PDF
• 2020-08-11 LTIatCMU at SemEval-2020 Task 11: Incorporating Multi-Level Features for Multi-Granular Propaganda Span Identification    Sopan Khosla, Rishabh Joshi, Ritam Dutt, Alan W Black, Yulia Tsvetkov arXiv_CL arXiv_CL  Bert  Represenation_Learning  RNN  Knowledge  Classification  GAN  PDF
• 2020-08-11 Learning Stereo Matchability in Disparity Regression Networks    Jingyang Zhang, Yao Yao, Zixin Luo, Shiwei Li, Tianwei Shen, Tian Fang, Long Quan arXiv_CV arXiv_CV  3D  Bert  Pose  Inference  Matching  PDF
• 2020-08-11 Hybrid Ranking Network for Text-to-SQL    Qin Lyu, Kaushik Chakrabarti, Shobhit Hathi, Souvik Kundu, Jianwen Zhang, Zheng Chen arXiv_CL arXiv_CL  Bert  Pose  Language_Model  PDF
• 2020-08-10 GANBERT: Generative Adversarial Networks with Bidirectional Encoder Representations from Transformers for MRI to PET synthesis    Hoo-Chang Shin, Alvin Ihsani, Swetha Mandava, Sharath Turuvekere Sreenivas, Christopher Forster, Jiook Cha, Alzheimer's Disease Neuroimaging Initiative arXiv_CV arXiv_CV  Transformer  Bert  Adversarial  Pose  GAN  Medical  Prediction  PDF
• 2020-08-10 SemEval-2020 Task 9: Overview of Sentiment Analysis of Code-Mixed Tweets    Parth Patwa, Gustavo Aguilar, Sudipta Kar, Suraj Pandey, Srinivas PYKL, Björn Gambäck, Tanmoy Chakraborty, Thamar Solorio, Amitava Das arXiv_CL arXiv_CL  Bert  Sentiment  PDF
• 2020-08-10 FireBERT: Hardening BERT-based classifiers against adversarial attack    Gunnar Mein, Kevin Hartman, Andrew Morris arXiv_CL arXiv_CL  Embedding  Bert  Review  Adversarial  Face  PDF
• 2020-08-10 KR-BERT: A Small-Scale Korean-Specific Language Model    Sangah Lee, Hansol Jang, Yunmee Baik, Hyopil Shin arXiv_CL arXiv_CL  Embedding  Bert  Language_Model  PDF
• 2020-08-10 Does BERT Solve Commonsense Task via Commonsense Knowledge?    Leyang Cui, Sijie Cheng, Yu Wu, Yue Zhang arXiv_CL arXiv_CL  Bert  Knowledge  Pose  Attention  Language_Model  Prediction  QA  PDF
• 2020-08-09 Distilling the Knowledge of BERT for Sequence-to-Sequence ASR    Hayato Futami, Hirofumi Inaguma, Sei Ueno, Masato Mimura, Shinsuke Sakai, Tatsuya Kawahara arXiv_CL arXiv_CL  Transformer  Recognition  Bert  Knowledge  Speech  Pose  Attention  Speech_Recognition  Inference  Language_Model  PDF
• 2020-08-09 Fast and Accurate Neural CRF Constituency Parsing    Yu Zhang, Houquan Zhou, Zhenghua Li arXiv_CL arXiv_CL  Bert  Pose  Deep_Learning  Attention  PDF
• 2020-08-07 SemEval-2020 Task 10: Emphasis Selection for Written Text in Visual Media    Amirreza Shirani, Franck Dernoncourt, Nedim Lipka, Paul Asente, Jose Echevarria, Thamar Solorio arXiv_CL arXiv_CL  Bert  Speech  PDF
• 2020-08-06 A general solution to the preferential selection model    Jake Ryland Williams, Diana Solano-Oropeza, Jacob R. Hunsberger arXiv_CL arXiv_CL  Bert  Action  PDF
• 2020-08-06 aschern at SemEval-2020 Task 11: It Takes Three to Tango: RoBERTa, CRF, and Transfer Learning    Anton Chernyavskiy, Dmitry Ilvovsky, Preslav Nakov arXiv_AI arXiv_AI  Transfer_Learning  Bert  Classification  Detection  GAN  PDF
• 2020-08-06 ConvBERT: Improving BERT with Span-based Dynamic Convolution    Zihang Jiang, Weihao Yu, Daquan Zhou, Yunpeng Chen, Jiashi Feng, Shuicheng Yan arXiv_CL arXiv_CL  Bert  Pose  Attention  Language_Model  PDF
• 2020-08-06 DeText: A Deep Text Ranking Framework with BERT    Weiwei Guo, Xiaowei Liu, Sida Wang, Huiji Gao, Ananth Sankar, Zimeng Yang, Qi Guo, Liang Zhang, Bo Long, Bee-Chung Chen, Deepak Agarwal arXiv_CL arXiv_CL  Embedding  Bert  Deep_Learning  Relation  PDF
• 2020-08-05 Trove: Ontology-driven weak supervision for medical entity classification    Jason A. Fries, Ethan Steinberg, Saelig Khattar, Scott L. Fleming, Jose Posada, Alison Callahan, Nigam H. Shah arXiv_CL arXiv_CL  Bert  Weakly_Supervised  Ontology  Classification  Medical  Language_Model  PDF
• 2020-08-04 I-AID: Identifying Actionable Information from Disaster-related Tweets    Hamada M. Zahera, Rricha Jalota, Mohamed A. Sherif, Axel N. Ngomo