Bert

Bert

• 2021-05-17 Pay Attention to MLPs    Hanxiao Liu, Zihang Dai, David R. So, Quoc V. Le arXiv_CV arXiv_CV  Transformer  Bert  Pose  Deep_Learning  Attention  PDF
• 2021-05-16 How is BERT surprised? Layerwise detection of linguistic anomalies    Bai Li, Zining Zhu, Guillaume Thomas, Yang Xu, Frank Rudzicz arXiv_CL arXiv_CL  Transformer  Bert  Detection  Relation  Language_Model  PDF
• 2021-05-15 DirectQE: Direct Pretraining for Machine Translation Quality Estimation    Qu Cui, Shujian Huang, Jiahuan Li, Xiang Geng, Zaixiang Zheng, Guoping Huang, Jiajun Chen arXiv_CL arXiv_CL  Bert  Pose  Detection  Object_Detection  PDF
• 2021-05-15 Lexicon Enhanced Chinese Sequence Labelling Using BERT Adapter    Wei Liu, Xiyan Fu, Yue Zhang, Wenming Xiao arXiv_CL arXiv_CL  Segmentation  Recognition  Bert  Knowledge  Speech  Pose  PDF
• 2021-05-15 The Low-Dimensional Linear Geometry of Contextualized Word Representations    Evan Hernandez, Jacob Andreas arXiv_CL arXiv_CL  Bert  Relation  PDF
• 2021-05-14 BERT Busters: Outlier LayerNorm Dimensions that Disrupt BERT    Olga Kovaleva, Saurabh Kulshreshtha, Anna Rogers, Anna Rumshisky arXiv_CL arXiv_CL  Transformer  Bert  PDF
• 2021-05-14 Counterfactual Interventions Reveal the Causal Effect of Relative Clause Representations on Agreement Prediction    Shauli Ravfogel, Grusha Prasad, Tal Linzen, Yoav Goldberg arXiv_CL arXiv_CL  Bert  Pose  Language_Model  Prediction  PDF
• 2021-05-14 Classifying Long Clinical Documents with Pre-trained Transformers    Xin Su, Timothy Miller, Xiyu Ding, Majid Afshar, Dmitriy Dligach arXiv_CL arXiv_CL  Transformer  Bert  Language_Model  PDF
• 2021-05-14 Out-of-Manifold Regularization in Contextual Embedding Space for Text Classification    Seonghyeon Lee, Dongha Lee, Hwanjo Yu arXiv_AI arXiv_AI  Embedding  Bert  Text_Classification  Regularization  Pose  Classification  PDF
• 2021-05-14 DaLAJ - a dataset for linguistic acceptability judgments for Swedish: Format, baseline, sharing    Elena Volodina, Yousuf Ali Mohammed, Julia Klezl arXiv_CL arXiv_CL  Embedding  Bert  Classification  PDF
• 2021-05-13 Distilling BERT for low complexity network training    Bansidhar Mangalwedhekar arXiv_CL arXiv_CL  Bert  RNN  Sentiment  Attention  Inference  PDF
• 2021-05-13 Are Larger Pretrained Language Models Uniformly Better? Comparing Performance at the Instance Level    Ruiqi Zhong, Dhruba Ghosh, Dan Klein, Jacob Steinhardt arXiv_AI arXiv_AI  Bert  Language_Model  Prediction  PDF
• 2021-05-12 Better than BERT but Worse than Baseline    Boxiang Liu, Jiaji Huang, Xingyu Cai, Kenneth Church arXiv_CL arXiv_CL  Bert  PDF
• 2021-05-12 Go Beyond Plain Fine-tuning: Improving Pretrained Models for Social Commonsense    Ting-Yun Chang, Yang Liu, Karthik Gopalakrishnan, Behnam Hedayatnia, Pei Zhou, Dilek Hakkani-Tur arXiv_CL arXiv_CL  Bert  Pose  Emotion  Language_Model  QA  PDF
• 2021-05-12 MATE-KD: Masked Adversarial TExt, a Companion to Knowledge Distillation    Ahmad Rashid, Vasileios Lioutas, Mehdi Rezagholizadeh arXiv_CL arXiv_CL  Bert  Knowledge  Adversarial  Language_Model  PDF
• 2021-05-12 Playing Codenames with Language Graphs and Word Embeddings    Divya Koyyalagunta, Anna Sun, Rachel Lea Draelos, Cynthia Rudin arXiv_AI arXiv_AI  Embedding  Bert  Pose  Relation  Language_Model  PDF
• 2021-05-12 Kleister: Key Information Extraction Datasets Involving Long Documents with Complex Layouts    Tomasz Stanisławek, Filip Graliński, Anna Wróblewska, Dawid Lipiński, Agnieszka Kaliska, Paulina Rosalska, Bartosz Topolski, Przemysław Biecek arXiv_CL arXiv_CL  Bert  Pose  Action  GAN  PDF
• 2021-05-12 Building a Question and Answer System for News Domain    Sandipan Basu, Aravind Gaddala, Pooja Chetan, Garima Tiwari, Narayana Darapaneni, Sadwik Parvathaneni, Anwesh Reddy Paduri arXiv_AI arXiv_AI  Transformer  Embedding  Transfer_Learning  Bert  RNN  Attention  PDF
• 2021-05-12 BertGCN: Transductive Text Classification by Combining GCN and BERT    Yuxiao Lin, Yuxian Meng, Xiaofei Sun, Qinghong Han, Kun Kuang, Jiwei Li, Fei Wu arXiv_CL arXiv_CL  Bert  Text_Classification  Pose  Classification  PDF
• 2021-05-12 Priberam at MESINESP Multi-label Classification of Medical Texts Task    Ruben Cardoso, Zita Marinho, Afonso Mendes, Sebastião Miranda arXiv_CL arXiv_CL  Bert  Classification  Medical  Recommendation  PDF
• 2021-05-12 Priberam Labs at the NTCIR-15 SHINRA2020-ML: Classification Task    Ruben Cardoso, Afonso Mendes, Andre Lamurias arXiv_CL arXiv_CL  Embedding  Bert  Zero-Shot  Knowledge  Pose  Ontology  Classification  GAN  PDF
• 2021-05-12 Evaluating Gender Bias in Natural Language Inference    Shanya Sharma, Manan Dey, Koustuv Sinha arXiv_CL arXiv_CL  Bert  Pose  Detection  Inference  Prediction  PDF
• 2021-05-12 OCHADAI-KYODAI at SemEval-2021 Task 1: Enhancing ModelGeneralization and Robustness for Lexical Complexity Prediction    Yuki Taya, Lis Kanashiro Pereira, Fei Cheng, Ichiro Kobayashi arXiv_CL arXiv_CL  Transformer  Bert  Adversarial  Pose  Prediction  PDF
• 2021-05-12 UIUC_BioNLP at SemEval-2021 Task 11: A Cascade of Neural Models for Structuring Scholarly NLP Contributions    Haoyang Liu, M. Janina Sarol, Halil Kilicoglu arXiv_CL arXiv_CL  Recognition  Bert  Pose  Action  Classification  PDF
• 2021-05-11 Addressing 'Documentation Debt' in Machine Learning Research: A Retrospective Datasheet for BookCorpus    Jack Bandy, Nicholas Vincent arXiv_CL arXiv_CL  Bert  Sparse  Language_Model  PDF
• 2021-05-11 Integrating extracted information from bert and multiple embedding methods with the deep neural network for humour detection    Rida Miraj, Masaki Aono arXiv_AI arXiv_AI  Embedding  Bert  Pose  Detection  Language_Model  PDF
• 2021-05-11 BERT is to NLP what AlexNet is to CV: Can Pre-Trained Language Models Identify Analogies?    Asahi Ushio, Luis Espinosa-Anke, Steven Schockaert, Jose Camacho-Collados arXiv_CL arXiv_CL  Transformer  Embedding  Unsupervised  Bert  Knowledge  Relation  Attention  Language_Model  PDF
• 2021-05-11 Role of Artificial Intelligence in Detection of Hateful Speech for Hinglish Data on Social Media    Ananya Srivastava, Mohammed Hasan, Bhargav Yagnik, Rahee Walambe, Ketan Kotecha arXiv_CL arXiv_CL  Transformer  Embedding  Bert  Speech  Pose  Detection  Language_Model  PDF
• 2021-05-11 Benchmarking down-scaled pre-trained language models    M. Aßenmacher, P. Schulze, C. Heumann arXiv_CL arXiv_CL  Transformer  Bert  Language_Model  PDF
• 2021-05-10 Assessing the Syntactic Capabilities of Transformer-based Multilingual Language Models    Laura Pérez-Mayos, Alba Táboas García, Simon Mille, Leo Wanner arXiv_CL arXiv_CL  Transformer  Bert  Optimization  Language_Model  PDF
• 2021-05-10 R2D2: Relational Text Decoding with Transformers    Aryan Arbabi, Mingqiu Wang, Laurent El Shafey, Nan Du, Izhak Shafran arXiv_CL arXiv_CL  Transformer  Bert  Pose  Action  Relation  Attention  Text_Generation  Medical  PDF
• 2021-05-10 Automatic Classification of Human Translation and Machine Translation: A Study from the Perspective of Lexical Diversity    Yingxue Fu, Mark-Jan Nederhof arXiv_CL arXiv_CL  Bert  Classification  Relation  Attention  PDF
• 2021-05-10 SRLF: A Stance-aware Reinforcement Learning Framework for Content-based Rumor Detection on Social Media    Chunyuan Yuan, Wanhui Qian, Qianwen Ma, Wei Zhou, Songlin Hu arXiv_AI arXiv_AI  Reinforcement_Learning  Bert  Pose  Detection  PDF
• 2021-05-09 Which transformer architecture fits my data? A vocabulary bottleneck in self-attention    Noam Wies, Yoav Levine, Daniel Jannai, Amnon Shashua arXiv_CL arXiv_CL  Transformer  Embedding  Bert  Attention  PDF
• 2021-05-09 FNet: Mixing Tokens with Fourier Transforms    James Lee-Thorp, Joshua Ainslie, Ilya Eckstein, Santiago Ontanon arXiv_CL arXiv_CL  Transformer  Bert  Text_Classification  Classification  Relation  Attention  Matching  PDF
• 2021-05-08 Enhancing Transformers with Gradient Boosted Decision Trees for NLI Fine-Tuning    Benjamin Minixhofer, Milan Gritta, Ignacio Iacobacci arXiv_CL arXiv_CL  Transformer  Transfer_Learning  Bert  Classification  Inference  Language_Model  PDF
• 2021-05-08 NLP-IIS@UT at SemEval-2021 Task 4: Machine Reading Comprehension using the Long Document Transformer    Hossein Basafa, Sajad Movahedi, Ali Ebrahimi, Azadeh Shakery, Heshaam Faili arXiv_CL arXiv_CL  Transformer  Bert  Pose  Language_Model  PDF
• 2021-05-07 Understanding by Understanding Not: Modeling Negation in Language Models    Arian Hosseini, Siva Reddy, Dzmitry Bahdanau, R Devon Hjelm, Alessandro Sordoni, Aaron Courville arXiv_CL arXiv_CL  Bert  Pose  Language_Model  PDF
• 2021-05-07 Empirical Evaluation of Pre-trained Transformers for Human-Level NLP: The Role of Sample Size and Dimensionality    Adithya V Ganesan, Matthew Matero, Aravind Reddy Ravula, Huy Vu, H. Andrew Schwartz arXiv_CL arXiv_CL  Transformer  Embedding  Bert  Pose  Language_Model  PDF
• 2021-05-07 Adapting by Pruning: A Case Study on BERT    Yang Gao, Nicolo Colombo, Wei Wang arXiv_CL arXiv_CL  Bert  Pose  PDF
• 2021-05-06 Aligning Subtitles in Sign Language Videos    Hannah Bull, Triantafyllos Afouras, Gül Varol, Samuel Albanie, Liliane Momeni, Andrew Zisserman arXiv_CV arXiv_CV  Transformer  Embedding  Recognition  Bert  Pose  Attention  Prediction  PDF
• 2021-05-06 Adapting Monolingual Models: Data can be Scarce when Language Similarity is High    Wietse de Vries, Martijn Bartelds, Malvina Nissim, Martijn Wieling arXiv_CL arXiv_CL  Transformer  Transfer_Learning  Bert  Zero-Shot  PDF
• 2021-05-06 Introducing Information Retrieval for Biomedical Informatics Students    Sanya B. Taneja, Richard D. Boyce, William T. Reynolds, Denis Newman-Griffis arXiv_CL arXiv_CL  Bert  Medical  Language_Model  PDF
• 2021-05-06 Bird's Eye: Probing for Linguistic Graph Structures with a Simple Information-Theoretic Approach    Yifan Hou, Mrinmaya Sachan arXiv_CL arXiv_CL  Bert  Pose  PDF
• 2021-05-06 TABBIE: Pretrained Representations of Tabular Data    Hiroshi Iida, Dung Thai, Varun Manjunatha, Mohit Iyyer arXiv_CL arXiv_CL  Embedding  Bert  Represenation_Learning  Self-Supervised  Detection  Language_Model  Prediction  PDF
• 2021-05-06 Exploring Explicit and Implicit Visual Relationships for Image Captioning    Zeliang Song, Xiaofei Zhou arXiv_CV arXiv_CV  Image_Caption  Transformer  Bert  Salient  Pose  Action  Relation  Visual_Relation  Caption  CNN  PDF
• 2021-05-05 Rare Disease Identification from Clinical Notes with Ontologies and Weak Supervision    Hang Dong, Víctor Suárez-Paniagua, Huayu Zhang, Minhong Wang, Emma Whitfield, Honghan Wu arXiv_CL arXiv_CL  Transformer  Bert  Pose  Ontology  Face  Medical  Matching  PDF
• 2021-05-04 HerBERT: Efficiently Pretrained Transformer-based Language Model for Polish    Robert Mroczkowski, Piotr Rybak, Alina Wróblewska, Ireneusz Gawlik arXiv_CL arXiv_CL  Transformer  Bert  Knowledge  Pose  Language_Model  PDF
• 2021-05-03 Unreasonable Effectiveness of Rule-Based Heuristics in Solving Russian SuperGLUE Tasks    Tatyana Iazykova, Denis Kapelyushnik, Olga Bystrova, Andrey Kutuzov arXiv_CL arXiv_CL  Bert  Language_Model  Recommendation  PDF
• 2021-05-03 Goldilocks: Just-Right Tuning of BERT for Technology-Assisted Review    Eugene Yang, Sean MacAvaney, David D. Lewis, Ophir Frieder arXiv_CL arXiv_CL  Transformer  Bert  Text_Classification  Review  Classification  Language_Model  PDF
• 2021-05-03 Leveraging Deep Representations of Radiology Reports in Survival Analysis for Predicting Heart Failure Patient Mortality    Hyun Gi Lee, Evan Sholle, Ashley Beecy, Subhi Al'Aref, Yifan Peng arXiv_CL arXiv_CL  Bert  Action  Prediction  PDF
• 2021-05-03 Looking for COVID-19 misinformation in multilingual social media texts    Raj Ratn Pranesh, Mehrdad Farokhnejad, Ambesh Shekhar, Genoveva Vargas-Solar arXiv_CL arXiv_CL  Bert  Pose  PDF
• 2021-05-02 Larger-Scale Transformers for Multilingual Masked Language Modeling    Naman Goyal, Jingfei Du, Myle Ott, Giri Anantharaman, Alexis Conneau arXiv_CL arXiv_CL  Transformer  Bert  Language_Model  PDF
• 2021-05-02 Augmenting Sequential Recommendation with Pseudo-Prior Items via Reversely Pre-training Transformer    Zhiwei Liu, Ziwei Fan, Yu Wang, Philip S. Yu arXiv_AI arXiv_AI  Transformer  Bert  Pose  Relation  Recommendation  PDF
• 2021-05-02 MathBERT: A Pre-Trained Model for Mathematical Formula Understanding    Shuai Peng, Ke Yuan, Liangcai Gao, Zhi Tang arXiv_AI arXiv_AI  Bert  Knowledge  Pose  Classification  PDF
• 2021-05-01 When to Fold'em: How to answer Unanswerable questions    Marshall Ho, Zhipeng Zhou, Judith He arXiv_CL arXiv_CL  Bert  Language_Model  QA  PDF
• 2021-05-01 MRCBert: A Machine Reading ComprehensionApproach for Unsupervised Summarization    Saurabh Jain, Guokai Tang, Lim Sze Chi arXiv_AI arXiv_AI  Unsupervised  Transfer_Learning  Bert  Review  Summarization  PDF
• 2021-04-30 Paraphrastic Representations at Scale    John Wieting, Kevin Gimpel, Graham Neubig, Taylor Berg-Kirkpatrick arXiv_CL arXiv_CL  Unsupervised  Bert  Inference  PDF
• 2021-04-30 BERT Meets Relational DB: Contextual Representations of Relational Databases    Siddhant Arora, Vinayak Gupta, Garima Gaur, Srikanta Bedathur arXiv_CL arXiv_CL  Embedding  Bert  Represenation_Learning  Relation  Attention  PDF
• 2021-04-30 Chop Chop BERT: Visual Question Answering by Chopping VisualBERT's Heads    Chenyu Gao, Qi Zhu, Peng Wang, Qi Wu arXiv_CV arXiv_CV  Transformer  Bert  VQA  Attention  QA  PDF
• 2021-04-29 The Interspeech Zero Resource Speech Challenge 2021: Spoken language modelling    Ewan Dunbar, Mathieu Bernard, Nicolas Hamilakis, Tu Anh Nguyen, Maureen de Seyssel, Patricia Rozé, Morgane Rivière, Eugene Kharitonov, Emmanuel Dupoux arXiv_AI arXiv_AI  Bert  RNN  Speech  Language_Model  PDF
• 2021-04-29 Let's Play Mono-Poly: BERT Can Reveal Words' Polysemy Level and Partitionability into Senses    Aina Garí Soler, Marianna Apidianaki arXiv_CL arXiv_CL  Embedding  Bert  Knowledge  Pose  Language_Model  PDF
• 2021-04-28 Multi-Task Learning of Query Intent and Named Entities using Transfer Learning    Shalin Shah, Ryan Siskind arXiv_CL arXiv_CL  Transfer_Learning  Recognition  Bert  Deep_Learning  PDF
• 2021-04-28 Improving BERT Model Using Contrastive Learning for Biomedical Relation Extraction    Peng Su, Yifan Peng, K. Vijay-Shanker arXiv_CL arXiv_CL  Bert  Knowledge  Contrastive_Learning  Action  Relation  Relation_Extraction  Medical  Prediction  PDF
• 2021-04-28 Societal Biases in Retrieved Contents: Measurement Framework and Adversarial Mitigation for BERT Rankers    Navid Rekabsaz, Simone Kopeinik, Markus Schedl arXiv_AI arXiv_AI  Bert  Adversarial  Pose  Deep_Learning  PDF
• 2021-04-28 MelBERT: Metaphor Detection via Contextualized Late Interaction using Metaphorical Identification Theories    Minjin Choi, Sunkyung Lee, Eunseong Choi, Heesoo Park, Junhyuk Lee, Dongwon Lee, Jongwuk Lee arXiv_CL arXiv_CL  Bert  Pose  Action  Detection  PDF
• 2021-04-28 AraStance: A Multi-Country and Multi-Domain Dataset of Arabic Stance Detection for Fact Checking    Tariq Alhindi, Amal Alabdulkarim, Ali Alshehri, Muhammad Abdul-Mageed, Preslav Nakov arXiv_CL arXiv_CL  Bert  Detection  Prediction  PDF
• 2021-04-27 Semi-supervised Interactive Intent Labeling    Saurav Sahay, Eda Okur, Nagib Hakim, Lama Nachman arXiv_CL arXiv_CL  Embedding  Enhancement  Bert  PDF
• 2021-04-27 UoT-UWF-PartAI at SemEval-2021 Task 5: Self Attention Based Bi-GRU with Multi-Embedding Representation for Toxicity Highlighter    Hamed Babaei Giglou, Taher Rahgooy, Mostafa Rahgouy, Jafar Razmara arXiv_CL arXiv_CL  Embedding  Bert  Pose  Detection  Attention  PDF
• 2021-04-26 Computational Performance of Deep Reinforcement Learning to find Nash Equilibria    Christoph Graf, Viktor Zobernig, Johannes Schmidt, Claude Klöckl arXiv_AI arXiv_AI  Reinforcement_Learning  Bert  Pose  Action  PDF
• 2021-04-26 Phrase break prediction with bidirectional encoder representations in Japanese text-to-speech synthesis    Kosuke Futamata, Byeongseon Park, Ryuichi Yamamoto, Kentaro Tachibana arXiv_CL arXiv_CL  Bert  RNN  Speech  Pose  Language_Model  Prediction  PDF
• 2021-04-25 Potential Idiomatic Expression -English: Corpus for Classes of Idioms    Tosin P. Adewumi, Saleha Javed, Roshanak Vadoodi, Aparajita Tripathy, Konstantina Nikolaidou, Foteini Liwicki, Marcus Liwicki arXiv_CL arXiv_CL  Bert  Knowledge  Speech  Classification  PDF
• 2021-04-24 Extract then Distill: Efficient and Effective Task-Agnostic BERT Distillation    Cheng Chen, Yichun Yin, Lifeng Shang, Zhi Wang, Xin Jiang, Xiao Chen, Qun Liu arXiv_CL arXiv_CL  Bert  Knowledge  Pose  PDF
• 2021-04-23 Playing Lottery Tickets with Vision and Language    Zhe Gan, Yen-Chun Chen, Linjie Li, Tianlong Chen, Yu Cheng, Shuohang Wang, Jingjing Liu arXiv_CV arXiv_CV  Transformer  Bert  Adversarial  VQA  QA  Matching  PDF
• 2021-04-23 Towards Trustworthy Deception Detection: Benchmarking Model Robustness across Domains, Modalities, and Languages    Maria Glenski, Ellyn Ayton, Robin Cosbey, Dustin Arendt, Svitlana Volkova arXiv_CL arXiv_CL  Embedding  Bert  Text_Classification  RNN  Classification  Detection  PDF
• 2021-04-23 Claim Detection in Biomedical Twitter Posts    Amelie Wührl, Roman Klinger arXiv_CL arXiv_CL  Embedding  Transfer_Learning  Bert  Classification  Detection  Medical  PDF
• 2021-04-23 QMUL-SDS at SCIVER: Step-by-Step Binary Classification for Scientific Claim Verification    Xia Zeng, Arkaitz Zubiaga arXiv_CL arXiv_CL  Bert  Pose  Classification  Prediction  PDF
• 2021-04-23 Optimizing small BERTs trained for German NER    Jochen Zöllner, Konrad Sperfeld, Christoph Wick, Roger Labahn arXiv_AI arXiv_AI  Bert  Pose  Language_Model  PDF
• 2021-04-23 Multimodal Fusion with BERT and Attention Mechanism for Fake News Detection    Nguyen Manh Duc Tuan, Pham Quang Nhat Minh arXiv_CL arXiv_CL  Bert  Pose  Detection  Relation  Attention  PDF
• 2021-04-23 Literature review on vulnerability detection using NLP technology    Jiajie Wu arXiv_AI arXiv_AI  Bert  Review  Face  Survey  Detection  PDF
• 2021-04-23 BERT-CoQAC: BERT-based Conversational Question Answering in Context    Munazza Zaib, Dai Hoang Tran, Subhash Sagar, Adnan Mahmood, Wei E. Zhang, Quan Z. Sheng arXiv_CL arXiv_CL  Bert  Pose  Language_Model  QA  PDF
• 2021-04-22 On Geodesic Distances and Contextual Embedding Compression for Text Classification    Rishi Jha, Kai Mihata arXiv_CL arXiv_CL  Transformer  Embedding  Bert  Text_Classification  Pose  Classification  PDF
• 2021-04-22 COVID-19 and Big Data: Multi-faceted Analysis for Spatio-temporal Understanding of the Pandemic with Social Media Conversations    Shayan Fazeli, Davina Zamanzadeh, Anaelia Ovalle, Thu Nguyen, Gilbert Gee, Majid Sarrafzadeh arXiv_CL arXiv_CL  Tracking  Bert  Pose  Face  Attention  PDF
• 2021-04-21 Disfluency Detection with Unlabeled Data and Small BERT Models    Johann C. Rocholl, Vicky Zayats, Daniel D. Walker, Noah B. Murad, Aaron Schneider, Daniel J. Liebling arXiv_CL arXiv_CL  Recognition  Bert  Speech  Detection  Speech_Recognition  Inference  PDF
• 2021-04-21 Using CNNs for AD classification based on spatial correlation of BOLD signals during the observation    Nazanin Beheshti, Lennart Johnsson arXiv_CV arXiv_CV  Bert  Classification  Relation  CNN  PDF
• 2021-04-21 Improving BERT Pretraining with Syntactic Supervision    Giorgos Tziafas, Konstantinos Kogkalidis, Gijs Wijnholds, Michael Moortgat arXiv_CL arXiv_CL  Transformer  Unsupervised  Bert  PDF
• 2021-04-21 PALI at SemEval-2021 Task 2: Fine-Tune XLM-RoBERTa for Word in Context Disambiguation    Shuyi Xie, Jian Ma, Haiqin Yang, Lianxin Jiang, Yang Mo, Jianping Shen arXiv_AI arXiv_AI  Embedding  Bert  Adversarial  Prediction  PDF
• 2021-04-21 Sattiy at SemEval-2021 Task 9: An Ensemble Solution for Statement Verification and Evidence Finding with Tables    Xiaoyi Ruan, Meizhi Jin, Jian Ma, Haiqin Yang, Lianxin Jiang, Yang Mo, Mengyuan Zhou arXiv_AI arXiv_AI  Bert  Language_Model  PDF
• 2021-04-21 Discriminative Self-training for Punctuation Prediction    Qian Chen, Wen Wang, Mengzhe Chen, Qinglin Zhang arXiv_CL arXiv_CL  Recognition  Bert  Speech  Pose  Speech_Recognition  Prediction  PDF
• 2021-04-20 UIT-ISE-NLP at SemEval-2021 Task 5: Toxic Spans Detection with BiLSTM-CRF and Toxic Bert Comment Classification    Son T. Luu, Ngan Luu-Thuy Nguyen arXiv_CL arXiv_CL  Bert  RNN  Classification  Detection  PDF
• 2021-04-20 Measuring Shifts in Attitudes Towards COVID-19 Measures in Belgium Using Multilingual BERT    Kristen Scott, Pieter Delobelle, Bettina Berendt arXiv_CL arXiv_CL  Bert  PDF
• 2021-04-20 X-METRA-ADA: Cross-lingual Meta-Transfer Learning Adaptation to Natural Language Understanding and Question Answering    Meryem M'hamdi, Doo Soon Kim, Franck Dernoncourt, Trung Bui, Xiang Ren, Jonathan May arXiv_CL arXiv_CL  Transfer_Learning  Bert  Zero-Shot  Optimization  Pose  Attention  PDF
• 2021-04-20 Efficient pre-training objectives for Transformers    Luca Di Liello, Matteo Gabburo, Alessandro Moschitti arXiv_CL arXiv_CL  Transformer  Bert  Pose  PDF
• 2021-04-19 Modeling 'Newsworthiness' for Lead-Generation Across Corpora    Alexander Spangher, Nanyun Peng, Jonathan May, Emilio Ferrara arXiv_CL arXiv_CL  Bert  Pose  PDF
• 2021-04-19 Neural Language Models with Distant Supervision to Identify Major Depressive Disorder from Clinical Notes    Bhavani Singh Agnikula Kshatriya, Nicolas A Nunez, Manuel Gardea- Resendez, Euijung Ryu, Brandon J Coombes, Sunyang Fu, Mark A Frye, Joanna M Biernacka, Yanshan Wang arXiv_AI arXiv_AI  Transformer  Unsupervised  Bert  Text_Classification  Pose  Classification  Language_Model  PDF
• 2021-04-19 Operationalizing a National Digital Library: The Case for a Norwegian Transformer Model    Per E Kummervold, Javier de la Rosa, Freddy Wetjen, Svein Arne Brygfjeld arXiv_CL arXiv_CL  Transformer  Recognition  OCR  Bert  Optical_Character  Classification  Language_Model  PDF
• 2021-04-19 PyPlutchik: visualising and comparing emotion-annotated corpora    Alfonso Semeraro, Salvatore Vilella, Giancarlo Ruffo arXiv_CL arXiv_CL  Bert  Pose  Emotion  Detection  PDF
• 2021-04-19 Understanding Chinese Video and Language via Contrastive Multimodal Pre-Training    Chenyi Lei, Shixian Luo, Yong Liu, Wanggui He, Jiamang Wang, Guoxin Wang, Haihong Tang, Chunyan Miao, Houqiang Li arXiv_CV arXiv_CV  Bert  Pose  Contrastive_Learning  Relation  Language_Model  PDF
• 2021-04-19 Probing for Bridging Inference in Transformer Language Models    Onkar Pandit, Yufang Hou arXiv_CL arXiv_CL  Transformer  Bert  Relation  Attention  Inference  Language_Model  Prediction  PDF
• 2021-04-19 BERTić -- The Transformer Language Model for Bosnian, Croatian, Montenegrin and Serbian    Nikola Ljubešić, Davor Lauc arXiv_CL arXiv_CL  Transformer  Recognition  Bert  Speech  Face  Language_Model  Prediction  PDF
• 2021-04-19 BigGreen at SemEval-2021 Task 1: Lexical Complexity Prediction with Assembly Models    Aadil Islam, Weicheng Ma, Soroush Vosoughi arXiv_AI arXiv_AI  Transformer  Bert  Attention  Prediction  PDF
• 2021-04-19 Sentiment Classification in Swahili Language Using Multilingual BERT    Gati L. Martin, Medard E. Mswahili, Young-Seob Jeong arXiv_CL arXiv_CL  Bert  Sentiment_Classification  Review  Speech  Emotion  Classification  Sentiment  PDF
• 2021-04-18 Language in a Box: Grounding Language Learning in Real-World Human-Machine Interaction    Federico Bianchi, Ciro Greco, Jacopo Tagliabue arXiv_CL arXiv_CL  Unsupervised  Bert  Zero-Shot  Action  Inference  Language_Model  PDF
• 2021-04-18 SimCSE: Simple Contrastive Learning of Sentence Embeddings    Tianyu Gao, Xingcheng Yao, Danqi Chen arXiv_CL arXiv_CL  Embedding  Unsupervised  Bert  Contrastive_Learning  Relation  Inference  PDF
• 2021-04-18 FedNLP: A Research Platform for Federated Learning in Natural Language Processing    Bill Yuchen Lin, Chaoyang He, Zihang Zeng, Hulin Wang, Yufen Huang, Mahdi Soltanolkotabi, Xiang Ren, Salman Avestimehr arXiv_AI arXiv_AI  Transformer  Bert  Text_Classification  Face  Classification  GAN  Language_Model  PDF
• 2021-04-18 Keyphrase Generation with Fine-Grained Evaluation-Guided Reinforcement Learning    Yichao Luo, Yige Xu, Jiacheng Ye, Xipeng Qiu, Qi Zhang arXiv_CL arXiv_CL  Reinforcement_Learning  Bert  Pose  Prediction  PDF
• 2021-04-18 Zero-shot Cross-lingual Transfer of Neural Machine Translation with Multilingual Pretrained Encoders    Guanhua Chen, Shuming Ma, Yun Chen, Li Dong, Dongdong Zhang, Jia Pan, Wenping Wang, Furu Wei arXiv_CL arXiv_CL  Bert  Zero-Shot  Pose  NMT  PDF
• 2021-04-18 CEAR: Cross-Entity Aware Reranker for Knowledge Base Completion    Keshav Kolluru, Mayank Singh Chauhan, Yatin Nandwani, Parag Singla, Mausam arXiv_CL arXiv_CL  Embedding  Bert  Knowledge  Attention  Language_Model  Prediction  PDF
• 2021-04-18 Rethinking Network Pruning -- under the Pre-train and Fine-tune Paradigm    Dongkuan Xu, Ian E.H. Yen, Jinxi Zhao, Zhibin Xiao arXiv_AI arXiv_AI  Transformer  Bert  Sparse  Knowledge  CNN  Language_Model  Prediction  PDF
• 2021-04-18 Dual-View Distilled BERT for Sentence Embedding    Xingyi Cheng arXiv_AI arXiv_AI  Embedding  Bert  Pose  Action  Attention  Matching  PDF
• 2021-04-18 When Does Pretraining Help? Assessing Self-Supervised Learning for Law and the CaseHOLD Dataset    Lucia Zheng, Neel Guha, Brandon R. Anderson, Peter Henderson, Daniel E. Ho arXiv_CL arXiv_CL  Transformer  Embedding  Bert  RNN  Self-Supervised  PDF
• 2021-04-18 Worst of Both Worlds: Biases Compound in Pre-trained Vision-and-Language Models    Tejas Srinivasan, Yonatan Bisk arXiv_CL arXiv_CL  Bert  Attention  Language_Model  PDF
• 2021-04-17 DiS-ReX: A Multilingual Dataset for Distantly Supervised Relation Extraction    Abhyuday Bhartiya, Kartikeya Badola, Mausam arXiv_CL arXiv_CL  Bert  Pose  Action  Relation  Relation_Extraction  Attention  PDF
• 2021-04-17 IITP in COLIEE@ICAIL 2019: Legal Information Retrieval usingBM25 and BERT    Baban Gain, Dibyanayan Bandyopadhyay, Tanik Saikh, Asif Ekbal arXiv_AI arXiv_AI  Bert  Action  Deep_Learning  PDF
• 2021-04-17 Improving Zero-Shot Cross-Lingual Transfer Learning via Robust Training    Kuan-Hao Huang, Wasi Uddin Ahmad, Nanyun Peng, Kai-Wei Chang arXiv_CL arXiv_CL  Embedding  Transfer_Learning  Bert  Zero-Shot  Text_Classification  Adversarial  Pose  Classification  Language_Model  PDF
• 2021-04-17 UPB at SemEval-2021 Task 5: Virtual Adversarial Training for Toxic Spans Detection    Andrei Paraschiv, Dumitru-Clementin Cercel, Mihai Dascalu arXiv_CL arXiv_CL  Transformer  Bert  Adversarial  Detection  PDF
• 2021-04-17 Emotion Classification in a Resource Constrained Language Using Transformer-based Approach    Avishek Das, Omar Sharif, Mohammed Moshiul Hoque, Iqbal H. Sarker arXiv_CL arXiv_CL  Transformer  Bert  RNN  Pose  Emotion  Classification  PDF
• 2021-04-17 Multi-source Neural Topic Modeling in Multi-view Embedding Spaces    Pankaj Gupta, Yatin Chaudhary, Hinrich Schütze arXiv_AI arXiv_AI  Embedding  Bert  Sparse  Knowledge  Medical  PDF
• 2021-04-17 The Topic Confusion Task: A Novel Scenario for Authorship Attribution    Malik H. Altakrori (1 and 3), Jackie Chi Kit Cheung (1 and 3), Benjamin C. M. Fung (2 and 3) ((1) School of Computer Science -McGill University, (2) School of Information Studies-McGill University, (3) Mila) arXiv_CL arXiv_CL  Bert  Speech  Pose  Language_Model  PDF
• 2021-04-17 Learning to Share by Masking the Non-shared for Multi-domain Sentiment Classification    Jianhua Yuan, Yanyan Zhao, Bing Qin, Ting Liu arXiv_CL arXiv_CL  Bert  Sentiment_Classification  Knowledge  Pose  Classification  Sentiment  PDF
• 2021-04-17 Frequency-based Distortions in Contextualized Word Embeddings    Kaitlyn Zhou, Kawin Ethayarajh, Dan Jurafsky arXiv_CL arXiv_CL  Embedding  Bert  Relation  PDF
• 2021-04-17 A multilabel approach to morphosyntactic probing    Naomi Tachikawa Shapiro, Amandalynne Paullada, Shane Steinert-Threlkeld arXiv_CL arXiv_CL  Embedding  Bert  Zero-Shot  Language_Model  PDF
• 2021-04-17 Hierarchical Transformer Networks for Longitudinal Clinical Document Classification    Yuqi Si, Kirk Roberts arXiv_CL arXiv_CL  Transformer  Bert  Pose  Classification  Prediction  PDF
• 2021-04-17 Identifying the Limits of Cross-Domain Knowledge Transfer for Pretrained Models    Zhengxuan Wu, Nelson F. Liu, Christopher Potts arXiv_CL arXiv_CL  Embedding  Bert  RNN  Knowledge  Classification  Language_Model  PDF
• 2021-04-16 BERT memorisation and pitfalls in low-resource scenarios    Michael Tänzer, Sebastian Ruder, Marek Rei arXiv_CL arXiv_CL  Recognition  Bert  Pose  Few-Shot  PDF
• 2021-04-16 Membership Inference Attack Susceptibility of Clinical Language Models    Abhyuday Jagannatha, Bhanu Pratap Singh Rawat, Hong Yu arXiv_CL arXiv_CL  Bert  Medical  Inference  Language_Model  PDF
• 2021-04-16 Capturing Row and Column Semantics in Transformer Based Question Answering over Tables    Michael Glass, Mustafa Canim, Alfio Gliozzo, Saneem Chemmengath, Rishav Chakravarti, Avi Sil, Feifei Pan, Samarth Bharadwaj, Nicolas Rodolfo Fauceglia arXiv_AI arXiv_AI  Transformer  Embedding  Bert  Pose  Action  QA  PDF
• 2021-04-16 AMMU -- A Survey of Transformer-based Biomedical Pretrained Language Models    Katikapalli Subramanyam Kalyan, Ajit Rajasekharan, Sivanesan Sangeetha arXiv_AI arXiv_AI  Transformer  Embedding  Transfer_Learning  Bert  Self-Supervised  Survey  Medical  Language_Model  PDF
• 2021-04-16 Data Augmentation for Voice-Assistant NLU using BERT-based Interchangeable Rephrase    Akhila Yerukola, Mason Bretan, Hongxia Jin arXiv_CL arXiv_CL  Bert  Classification  Attention  PDF
• 2021-04-16 Editing Factual Knowledge in Language Models    Nicola De Cao, Wilker Aziz, Ivan Titov arXiv_AI arXiv_AI  Bert  Optimization  Knowledge  Inference  Language_Model  Prediction  PDF
• 2021-04-16 Towards Variable-Length Textual Adversarial Attacks    Junliang Guo, Zhirui Zhang, Linlin Zhang, Linli Xu, Boxing Chen, Enhong Chen, Weihua Luo arXiv_CL arXiv_CL  Bert  Adversarial  Pose  Classification  PDF
• 2021-04-16 Temporal Adaptation of BERT and Performance on Downstream Document Classification: Insights from Social Media    Paul Röttger, Janet B. Pierrehumbert arXiv_CL arXiv_CL  Bert  Pose  Classification  Language_Model  PDF
• 2021-04-16 Fast, Effective and Self-Supervised: Transforming Masked LanguageModels into Universal Lexical and Sentence Encoders    Fangyu Liu, Ivan Vulić, Anna Korhonen, Nigel Collier arXiv_AI arXiv_AI  Bert  Knowledge  Self-Supervised  Pose  Contrastive_Learning  Language_Model  PDF
• 2021-04-16 BERT2Code: Can Pretrained Language Models be Leveraged for Code Search?    Abdullah Al Ishtiaq, Masum Hasan, Md. Mahim Anjum Haque, Kazi Sajeed Mehrab, Tanveer Muttaqueen, Tahmid Hasan, Anindya Iqbal, Rifat Shahriyar arXiv_CL arXiv_CL  Embedding  Bert  Relation  Language_Model  PDF
• 2021-04-16 Probing Across Time: What Does RoBERTa Know and When?    Leo Z. Liu, Yizhong Wang, Jungo Kasai, Hannaneh Hajishirzi, Noah A. Smith arXiv_CL arXiv_CL  Bert  Knowledge  Action  Language_Model  PDF
• 2021-04-16 Are Classes Clusters?    Kees Varekamp arXiv_CL arXiv_CL  Embedding  Unsupervised  Bert  Text_Classification  Review  Pose  Classification  PDF
• 2021-04-15 Sublanguage: A Serious Issue Affects Pretrained Models in Legal Domain    Ha-Thanh Nguyen, Le-Minh Nguyen arXiv_AI arXiv_AI  Bert  Knowledge  Pose  Deep_Learning  PDF
• 2021-04-15 Does BERT Pretrained on Clinical Notes Reveal Sensitive Data?    Eric Lehman, Sarthak Jain, Karl Pichotta, Yoav Goldberg, Byron C. Wallace arXiv_AI arXiv_AI  Transformer  Bert  PDF
• 2021-04-15 How to Train BERT with an Academic Budget    Peter Izsak, Moshe Berchansky, Omer Levy arXiv_AI arXiv_AI  Bert  Optimization  Action  Language_Model  PDF
• 2021-04-15 Are Multilingual BERT models robust? A Case Study on Adversarial Attacks for Multilingual Question Answering    Sara Rosenthal, Mihaela Bornea, Avirup Sil arXiv_CL arXiv_CL  Bert  Adversarial  QA  PDF
• 2021-04-15 SINA-BERT: A pre-trained Language Model for Analysis of Medical Texts in Persian    Nasrin Taghizadeh, Ehsan Doostmohammadi, Elham Seifossadat, Hamid R. Rabiee, Maedeh S. Tahaei arXiv_CL arXiv_CL  Bert  Sentiment  Medical  Language_Model  PDF
• 2021-04-15 Rethinking Automatic Evaluation in Sentence Simplification    Thomas Scialom, Louis Martin, Jacopo Staiano, Éric Villemonte de la Clergerie, Benoît Sagot arXiv_CL arXiv_CL  Bert  Pose  Relation  Summarization  PDF
• 2021-04-15 A Sample-Based Training Method for Distantly Supervised Relation Extraction with Pre-Trained Transformers    Mehrdad Nasser, Mohamad Bagher Sajadi, Behrouz Minaei-Bidgoli arXiv_AI arXiv_AI  Transformer  Bert  Pose  Action  Relation  Relation_Extraction  Prediction  PDF
• 2021-04-15 Privacy-Adaptive BERT for Natural Language Understanding    Chen Qu, Weize Kong, Liu Yang, Mingyang Zhang, Michael Bendersky, Marc Najork arXiv_CL arXiv_CL  Embedding  Bert  Knowledge  Pose  Language_Model  PDF
• 2021-04-15 UIT-E10dot3 at SemEval-2021 Task 5: Toxic Spans Detection with Named Entity Recognition and Question-Answering Approaches    Phu Gia Hoang, Luan Thanh Nguyen, Kiet Van Nguyen arXiv_CL arXiv_CL  Recognition  Bert  Detection  PDF
• 2021-04-15 BERT based Transformers lead the way in Extraction of Health Information from Social Media    Sidharth R, Abhiraj Tiwari, Parthivi Choubey, Saisha Kashyap, Sahil Khose, Kumud Lakara, Nishesh Singh, Ujjwal Verma arXiv_CL arXiv_CL  Transformer  Bert  Action  Classification  PDF
• 2021-04-15 NT5?! Training T5 to Perform Numerical Reasoning    Peng-Jian Yang, Ying Ting Chen, Yuechan Chen, Daniel Cer arXiv_CL arXiv_CL  Bert  PDF
• 2021-04-15 Emotion Dynamics Modeling via BERT    Haiqin Yang, Jianping Shen arXiv_AI arXiv_AI  Recognition  Bert  Represenation_Learning  RNN  Pose  Emotion  PDF
• 2021-04-15 TorontoCL at CMCL 2021 Shared Task: RoBERTa with Multi-Stage Fine-Tuning for Eye-Tracking Prediction    Bai Li, Frank Rudzicz arXiv_CL arXiv_CL  Transformer  Tracking  Bert  Prediction  PDF
• 2021-04-15 Lattice-BERT: Leveraging Multi-Granularity Representations in Chinese Pre-trained Language Models    Yuxuan Lai, Yijia Liu, Yansong Feng, Songfang Huang, Dongyan Zhao arXiv_CL arXiv_CL  Transformer  Bert  Pose  Attention  Language_Model  Prediction  PDF
• 2021-04-15 UHD-BERT: Bucketed Ultra-High Dimensional Sparse Representations for Full Ranking    Kyoung-Rok Jang, Junmo Kang, Giwon Hong, Sung-Hyon Myaeng, Joohee Park, Taewon Yoon, Heecheol Seo arXiv_CL arXiv_CL  Embedding  Bert  Sparse  Pose  Language_Model  Matching  PDF
• 2021-04-14 Annealing Knowledge Distillation    Aref Jafari, Mehdi Rezagholizadeh, Pranav Sharma, Ali Ghodsi arXiv_CL arXiv_CL  Bert  Knowledge  Pose  Classification  Image_Classification  Inference  PDF
• 2021-04-14 Disentangling Representations of Text by Masking Transformers    Xiongyi Zhang, Jan-Willem van de Meent, Byron C. Wallace arXiv_CL arXiv_CL  Transformer  Bert  Sparse  Review  Adversarial  Pose  Sentiment  PDF
• 2021-04-14 On the Robustness of Goal Oriented Dialogue Systems to Real-world Noise    Jason Krone, Sailik Sengupta, Saab Mansoor arXiv_AI arXiv_AI  Bert  Classification  PDF
• 2021-04-14 An Interpretability Illusion for BERT    Tolga Bolukbasi, Adam Pearce, Ann Yuan, Andy Coenen, Emily Reif, Fernanda Viégas, Martin Wattenberg arXiv_CL arXiv_CL  Embedding  Bert  PDF
• 2021-04-14 Static Embeddings as Efficient Knowledge Bases?    Philipp Dufter, Nora Kassner, Hinrich Schütze arXiv_CL arXiv_CL  Embedding  Bert  Knowledge  Pose  Language_Model  Matching  PDF
• 2021-04-14 Dependency Parsing based Semantic Representation Learning with Graph Neural Network for Enhancing Expressiveness of Text-to-Speech    Yixuan Zhou, Changhe Song, Jingbei Li, Zhiyong Wu, Helen Meng arXiv_CL arXiv_CL  Transformer  Embedding  Bert  Represenation_Learning  Speech  Pose  Relation  PDF
• 2021-04-14 Revisiting Light Field Rendering with Deep Anti-Aliasing Neural Network    Gaochang Wu, Yebin Liu, Lu Fang, Tianyou Chai arXiv_CV arXiv_CV  Reconstruction  Bert  Optimization  Pose  Deep_Learning  PDF
• 2021-04-14 Towards BERT-based Automatic ICD Coding: Limitations and Opportunities    Damian Pascual, Sandro Luck, Roger Wattenhofer arXiv_AI arXiv_AI  Transformer  Bert  Classification  Medical  PDF
• 2021-04-13 Large-Scale Contextualised Language Modelling for Norwegian    Andrey Kutuzov, Jeremy Barnes, Erik Velldal, Lilja Øvrelid, Stephan Oepen arXiv_CL arXiv_CL  Bert  Language_Model  PDF
• 2021-04-13 BERT Embeddings Can Track Context in Conversational Search    Rafael Ferreira, David Semedo, Joao Magalhaes arXiv_CL arXiv_CL  Transformer  Embedding  Tracking  Bert  Pose  Action  PDF
• 2021-04-13 Zhestyatsky at SemEval-2021 Task 2: ReLU over Cosine Similarity for BERT Fine-tuning    Boris Zhestiankin, Maria Ponomareva arXiv_CL arXiv_CL  Bert  Language_Model  PDF
• 2021-04-13 Mediators in Determining what Processing BERT Performs First    Aviv Slobodkin, Leshem Choshen, Omri Abend arXiv_CL arXiv_CL  Bert  Prediction  PDF
• 2021-04-13 Understanding Transformers for Bot Detection in Twitter    Andres Garcia-Silva, Cristian Berrio, Jose Manuel Gomez-Perez arXiv_CL arXiv_CL  Transformer  Bert  Classification  Detection  Language_Model  PDF
• 2021-04-13 UPB at SemEval-2021 Task 7: Adversarial Multi-Task Learning for Detecting and Rating Humor and Offense    Răzvan-Alexandru Smădu, Dumitru-Clementin Cercel, Mihai Dascalu arXiv_AI arXiv_AI  Transformer  Embedding  Bert  Text_Classification  RNN  Adversarial  Classification  PDF
• 2021-04-13 Semantic maps and metrics for science Semantic maps and metrics for science using deep transformer encoders    Brendan Chambers, James Evans arXiv_AI arXiv_AI  Transformer  Embedding  Bert  Face  PDF
• 2021-04-13 Discourse Probing of Pretrained Language Models    Fajri Koto, Jey Han Lau, Timothy Baldwin arXiv_CL arXiv_CL  Bert  Relation  Language_Model  PDF
• 2021-04-12 BERT based freedom to operate patent analysis    Michael Freunek, André Bodmer arXiv_CL arXiv_CL  Bert  PDF
• 2021-04-12 Fighting the COVID-19 Infodemic with a Holistic BERT Ensemble    Giorgos Tziafas, Konstantinos Kogkalidis, Tommaso Caselli arXiv_CL arXiv_CL  Transformer  Bert  Detection  Prediction  PDF
• 2021-04-12 WHOSe Heritage: Classification of UNESCO World Heritage 'Outstanding Universal Value' Documents with Smoothed Labels    Nan Bai, Renqian Luo, Pirouz Nourian, Ana Pereira Roders arXiv_CL arXiv_CL  Bert  Knowledge  Classification  Relation  PDF
• 2021-04-12 Fine-Tuning Transformers for Identifying Self-Reporting Potential Cases and Symptoms of COVID-19 in Tweets    Max Fleming, Priyanka Dondeti, Caitlin N. Dreisbach, Adam Poliak arXiv_CL arXiv_CL  Transformer  Bert  PDF
• 2021-04-12 Multilingual Language Models Predict Human Reading Behavior    Nora Hollenstein, Federico Pirovano, Ce Zhang, Lena Jäger, Lisa Beinborn arXiv_CL arXiv_CL  Transformer  Tracking  Bert  Language_Model  PDF
• 2021-04-12 Learning to Remove: Towards Isotropic Pre-trained BERT Embedding    Yuxin Liang, Rui Cao, Jie Zheng, Jie Ren, Ling Gao arXiv_CL arXiv_CL  Embedding  Bert  Pose  Language_Model  PDF
• 2021-04-11 One Ring to Rule Them All: a simple solution to multi-view 3D-Reconstruction of shapes with unknown BRDF via a small Recurrent ResNet    Ziang Cheng, Hongdong Li, Richard Hartley, Yinqiang Zheng, Imari Sato arXiv_CV arXiv_CV  Reconstruction  3D  Bert  Optimization  Pose  Face  PDF
• 2021-04-11 Does syntax matter? A strong baseline for Aspect-based Sentiment Analysis with RoBERTa    Junqi Dai, Hang Yan, Tianxiang Sun, Pengfei Liu, Xipeng Qiu arXiv_CL arXiv_CL  Bert  Sentiment  PDF
• 2021-04-11 Innovative Bert-based Reranking Language Models for Speech Recognition    Shih-Hsuan Chiu, Berlin Chen arXiv_CL arXiv_CL  Transformer  Unsupervised  Recognition  Bert  RNN  Speech  Pose  Speech_Recognition  Language_Model  Prediction  PDF
• 2021-04-11 UniDrop: A Simple yet Effective Technique to Improve Transformer without Extra Cost    Zhen Wu, Lijun Wu, Qi Meng, Yingce Xia, Shufang Xie, Tao Qin, Xinyu Dai, Tie-Yan Liu arXiv_CL arXiv_CL  Transformer  Bert  Text_Classification  Regularization  Pose  Classification  PDF
• 2021-04-10 FreSaDa: A French Satire Data Set for Cross-Domain Satire Detection    Radu Tudor Ionescu, Adrian Gabriel Chifu arXiv_CL arXiv_CL  Embedding  Unsupervised  Bert  Pose  Classification  Detection  PDF
• 2021-04-10 Non-autoregressive Transformer-based End-to-end ASR using BERT    Fu-Hao Yu, Kuan-Yu Chen arXiv_CL arXiv_CL  Transformer  Recognition  Bert  Speech  Pose  Attention  Speech_Recognition  Inference  Language_Model  PDF
• 2021-04-10 MIPT-NSU-UTMN at SemEval-2021 Task 5: Ensembling Learning with Pre-trained Language Models for Toxic Spans Detection    Mikhail Kotyushev, Anna Glazkova, Dmitry Morozov arXiv_AI arXiv_AI  Bert  Detection  Language_Model  PDF
• 2021-04-10 ZS-BERT: Towards Zero-Shot Relation Extraction with Attribute Representation Learning    Chih-Yao Chen, Cheng-Te Li arXiv_CL arXiv_CL  Embedding  Bert  Zero-Shot  Represenation_Learning  Knowledge  Pose  Action  Classification  Relation  Relation_Extraction  Prediction  PDF
• 2021-04-09 Text2Chart: A Multi-Staged Chart Generator from Natural Language Text    Md. Mahinur Rashid, Hasin Kawsar Jahan, Annysha Huzzat, Riyasaat Ahmed Rahul, Tamim Bin Zakir, Farhana Meem, Md. Saddam Hossain Mukta, Swakkhar Shatabda arXiv_CL arXiv_CL  Embedding  Bert  RNN  Pose  Prediction  PDF
• 2021-04-09 Explaining Neural Network Predictions on Sentence Pairs via Learning Word-Group Masks    Hanjie Chen, Song Feng, Jatin Ganhotra, Hui Wan, Chulaka Gunasekara, Sachindra Joshi, Yangfeng Ji arXiv_CL arXiv_CL  Bert  Pose  Action  Relation  Attention  Inference  Prediction  PDF
• 2021-04-09 KI-BERT: Infusing Knowledge Context for Better Language and Domain Understanding    Keyur Faldu, Amit Sheth, Prashant Kikani, Hemang Akabari arXiv_AI arXiv_AI  Transformer  Embedding  Bert  Knowledge  Knowledge_Graph  Pose  Deep_Learning  Relation  Attention  PDF
• 2021-04-09 Transformers: 'The End of History' for NLP?    Anton Chernyavskiy, Dmitry Ilvovsky, Preslav Nakov arXiv_CL arXiv_CL  Transformer  Segmentation  Bert  Pose  PDF
• 2021-04-09 BERT-based Chinese Text Classification for Emergency Domain with a Novel Loss Function    Zhongju Wang, Long Wang, Chao Huang, Xiong Luo arXiv_AI arXiv_AI  Transformer  Bert  Text_Classification  Optimization  Pose  Classification  PDF
• 2021-04-09 Know What and Know Where: An Object-and-Room Informed Sequential BERT for Indoor Vision-Language Navigation    Yuankai Qi, Zizheng Pan, Yicong Hong, Ming-Hsuan Yang, Anton van den Hengel, Qi Wu arXiv_CV arXiv_CV  Bert  Pose  Matching  PDF
• 2021-04-08 AlephBERT:A Hebrew Large Pre-Trained Language Model to Start-off your Hebrew NLP Application With    Amit Seker, Elron Bandel, Dan Bareket, Idan Brusilovsky, Refael Shaked Greenfeld, Reut Tsarfaty arXiv_CL arXiv_CL  Segmentation  Recognition  Bert  Speech  Sentiment  Language_Model  PDF
• 2021-04-08 COVID-19 Named Entity Recognition for Vietnamese    Thinh Hung Truong, Mai Hoang Dao, Dat Quoc Nguyen arXiv_CL arXiv_CL  Segmentation  Recognition  Bert  Language_Model  PDF
• 2021-04-08 Probing BERT in Hyperbolic Spaces    Boli Chen, Yao Fu, Guangwei Xu, Pengjun Xie, Chuanqi Tan, Mosha Chen, Liping Jing arXiv_CL arXiv_CL  Embedding  Bert  Pose  Sentiment  PDF
• 2021-04-08 Uppsala NLP at SemEval-2021 Task 2: Multilingual Language Models for Fine-tuning and Feature Extraction in Word-in-Context Disambiguation    Huiling You, Xingran Zhu, Sara Stymne arXiv_CL arXiv_CL  Bert  Action  Language_Model  PDF
• 2021-04-08 Layer Reduction: Accelerating Conformer-Based Self-Supervised Model via Layer Consistency    Jinchuan Tian, Rongzhi Gu, Helin Wang, Yuexian Zou arXiv_CL arXiv_CL  Transformer  Embedding  Recognition  Bert  Speech  Self-Supervised  Pose  Classification  Speech_Recognition  Inference  PDF
• 2021-04-08 Lone Pine at SemEval-2021 Task 5: Fine-Grained Detection of Hate Speech Using BERToxic    Yakoob Khan, Weicheng Ma, Soroush Vosoughi arXiv_CL arXiv_CL  Bert  Speech  Pose  Detection  PDF
• 2021-04-07 Interpreting Verbal Metaphors by Paraphrasing    Rui Mao, Chenghua Lin, Frank Guerin arXiv_CL arXiv_CL  Unsupervised  Bert  PDF
• 2021-04-07 Speak or Chat with Me: End-to-End Spoken Language Understanding System with Flexible Inputs    Sujeong Cha, Wangrui Hou, Hyun Jung, My Phung, Michael Picheny, Hong-Kwang Kuo, Samuel Thomas, Edmilson Morais arXiv_CL arXiv_CL  Embedding  Recognition  Bert  Speech  Pose  Classification  Speech_Recognition  PDF
• 2021-04-07 Combining Pre-trained Word Embeddings and Linguistic Features for Sequential Metaphor Identification    Rui Mao, Chenghua Lin, Frank Guerin arXiv_CL arXiv_CL  Embedding  Bert  RNN  Speech  PDF
• 2021-04-07 BreakingBERT@IITK at SemEval-2021 Task 9 : Statement Verification and Evidence Finding with Tables    Aditya Jindal, Ankur Gupta, Jaya Srivastava, Preeti Menghwani, Vijit Malik, Vishesh Kaushik, Ashutosh Modi arXiv_CL arXiv_CL  Bert  Pose  Inference  Prediction  PDF
• 2021-04-07 Better Neural Machine Translation by Extracting Linguistic Information from BERT    Hassan S. Shavarani, Anoop Sarkar arXiv_CL arXiv_CL  Transformer  Embedding  Bert  NMT  PDF
• 2021-04-06 MuSLCAT: Multi-Scale Multi-Level Convolutional Attention Transformer for Discriminative Music Modeling on Raw Waveforms    Kai Middlebrook, Shyam Sudhakaran, David Guy Brizan arXiv_SD arXiv_SD  Transformer  Recognition  Bert  Pose  Action  Attention  CNN  PDF
• 2021-04-06 hBert + BiasCorp -- Fighting Racism on the Web    Olawale Onabola, Zhuang Ma, Yang Xie, Benjamin Akera, Abdulrahman Ibraheem, Jia Xue, Dianbo Liu, Yoshua Bengio arXiv_CL arXiv_CL  Bert  PDF
• 2021-04-05 Semantic Distance: A New Metric for ASR Performance Analysis Towards Spoken Language Understanding    Suyoun Kim, Abhinav Arora, Duc Le, Ching-Feng Yeh, Christian Fuegen, Ozlem Kalinli, Michael L. Seltzer arXiv_CL arXiv_CL  Transformer  Embedding  Recognition  Bert  Speech  Pose  Speech_Recognition  Language_Model  PDF
• 2021-04-05 Exploring Transformers in Emotion Recognition: a comparison of BERT, DistillBERT, RoBERTa, XLNet and ELECTRA    Diogo Cortiz arXiv_CL arXiv_CL  Transformer  Recognition  Bert  Emotion  Language_Model  PDF
• 2021-04-05 Intent detection and slot filling for Vietnamese    Mai Hoang Dao, Thinh Hung Truong, Dat Quoc Nguyen arXiv_CL arXiv_CL  Embedding  Bert  Pose  Detection  Attention  PDF
• 2021-04-05 What's the best place for an AI conference, Vancouver or ______: Why completing comparative questions is difficult    Avishai Zagoury, Einat Minkov, Idan Szpektor, William W. Cohen arXiv_CL arXiv_CL  Bert  Knowledge  Action  Language_Model  PDF
• 2021-04-05 BBAEG: Towards BERT-based Biomedical Adversarial Example Generation for Text Classification    Ishani Mondal arXiv_CL arXiv_CL  Bert  Text_Classification  Review  Adversarial  Pose  Classification  Deep_Learning  Medical  Language_Model  Prediction  PDF
• 2021-04-05 WhiteningBERT: An Easy Unsupervised Sentence Embedding Approach    Junjie Huang, Duyu Tang, Wanjun Zhong, Shuai Lu, Linjun Shou, Ming Gong, Daxin Jiang, Nan Duan arXiv_CL arXiv_CL  Embedding  Unsupervised  Bert  Matching  PDF
• 2021-04-04 Improving Pretrained Models for Zero-shot Multi-label Text Classification through Reinforced Label Hierarchy Reasoning    Hui Liu, Danqing Zhang, Bing Yin, Xiaodan Zhu arXiv_CL arXiv_CL  Bert  Zero-Shot  Text_Classification  Pose  Classification  Inference  Prediction  Matching  PDF
• 2021-04-04 KnowGraph@IITK at SemEval-2021 Task 11: Building KnowledgeGraph for NLP Research    Shashank Shailabh, Sajal Chaurasia, Ashutosh Modi arXiv_CL arXiv_CL  Transformer  Bert  RNN  Knowledge  Knowledge_Graph  Pose  Action  Language_Model  Prediction  PDF
• 2021-04-04 MCL@IITK at SemEval-2021 Task 2: Multilingual and Cross-lingual Word-in-Context Disambiguation using Augmented Data, Signals, and Transformers    Rohan Gupta, Jay Mundra, Deepak Mahajan, Ashutosh Modi arXiv_CL arXiv_CL  Transformer  Bert  Zero-Shot  Pose  Classification  Language_Model  PDF
• 2021-04-04 ReCAM@IITK at SemEval-2021 Task 4: BERT and ALBERT based Ensemble for Abstract Word Prediction    Abhishek Mittal, Ashutosh Modi arXiv_AI arXiv_AI  Bert  Language_Model  Prediction  PDF
• 2021-04-03 Exploring the Role of BERT Token Representations to Explain Sentence Probing Results    Hosein Mohebbi, Ali Modarressi, Mohammad Taher Pilehvar arXiv_CL arXiv_CL  Bert  Knowledge  Classification  PDF
• 2021-04-03 Unsupervised Domain Adaptation with Global and Local Graph Neural Networks in Limited Labeled Data Scenario: Application to Disaster Management    Samujjwal Ghosh, Subhadeep Maji, Maunendra Sankar Desarkar arXiv_CL arXiv_CL  Unsupervised  Bert  Pose  Action  Classification  PDF
• 2021-04-03 MMBERT: Multimodal BERT Pretraining for Improved Medical VQA    Yash Khare, Viraj Bagal, Minesh Mathew, Adithi Devi, U Deva Priyakumar, CV Jawahar arXiv_CV arXiv_CV  Transformer  Bert  Self-Supervised  Pose  VQA  Attention  Medical  Caption  Language_Model  QA  PDF
• 2021-04-03 Counts@IITK at SemEval-2021 Task 8: SciBERT Based Entity And Semantic Relation Extraction For Scientific Data    Akash Gangwar, Sabhay Jain, Shubham Sourav, Ashutosh Modi arXiv_CL arXiv_CL  Embedding  Bert  Action  Classification  Relation  Relation_Extraction  PDF
• 2021-04-02 The Coronavirus is a Bioweapon: Analysing Coronavirus Fact-Checked Stories    Lynnette Hui Xian Ng, Kathleen M. Carley arXiv_CL arXiv_CL  Bert  PDF
• 2021-04-02 IITK@LCP at SemEval 2021 Task 1: Classification for Lexical Complexity Regression Task    Neil Rajiv Shirude, Sagnik Mukherjee, Tushar Shandhilya, Ananta Mukherjee, Ashutosh Modi arXiv_CL arXiv_CL  Bert  Classification  Prediction  PDF
• 2021-04-01 Effect of Radiology Report Labeler Quality on Deep Learning Models for Chest X-Ray Interpretation    Saahil Jain, Akshay Smit, Andrew Y. Ng, Pranav Rajpurkar arXiv_CV arXiv_CV  Bert  Classification  Deep_Learning  Image_Classification  PDF
• 2021-04-01 PhySG: Inverse Rendering with Spherical Gaussians for Physics-based Material Editing and Relighting    Kai Zhang, Fujun Luan, Qianqian Wang, Kavita Bala, Noah Snavely arXiv_CV arXiv_CV  Reconstruction  Bert  PDF
• 2021-04-01 HLE-UPC at SemEval-2021 Task 5: Multi-Depth DistilBERT for Toxic Spans Detection    Rafel Palliser, Albert Rial arXiv_AI arXiv_AI  Embedding  Bert  Pose  Quantitative  Detection  PDF
• 2021-03-31 Analysis on Image Set Visual Question Answering    Abhinav Khattar, Aviral Joshi, Har Simrat Singh, Pulkit Goel, Rohit Prakash Barnwal arXiv_CV arXiv_CV  Bert  Regularization  Adversarial  VQA  QA  PDF
• 2021-03-31 A Statistical Analysis of Summarization Evaluation Metrics using Resampling Methods    Daniel Deutsch, Rotem Dror, Dan Roth arXiv_CL arXiv_CL  Bert  Pose  Relation  Summarization  QA  PDF
• 2021-03-31 Quantum Optimization for Training Quantum Neural Networks    Yidong Liao, Min-Hsiu Hsieh, Chris Ferrie arXiv_AI arXiv_AI  Bert  Optimization  PDF
• 2021-03-30 Grounding Dialogue Systems via Knowledge Graph Aware Decoding with Pre-trained Transformers    Debanjan Chaudhuri, Md Rashad Al Hasan Rony, Jens Lehmann arXiv_CL arXiv_CL  Transformer  Bert  Knowledge  Knowledge_Graph  Pose  Action  Relation  Inference  PDF
• 2021-03-30 Kaleido-BERT: Vision-Language Pre-training on Fashion Domain    Mingchen Zhuge, Dehong Gao, Deng-Ping Fan, Linbo Jin, Ben Chen, Haoming Zhou, Minghui Qiu, Ling Shao arXiv_CV arXiv_CV  Transformer  Recognition  Bert  Image_Retrieval  Self-Supervised  Relation  Caption  PDF
• 2021-03-30 Grounding Open-Domain Instructions to Automate Web Support Tasks    Nancy Xu, Sam Masling, Michael Du, Giovanni Campagna, Larry Heck, James Landay, Monica S Lam arXiv_CL arXiv_CL  Bert  RNN  Action  PDF
• 2021-03-29 Contextual Text Embeddings for Twi    Paul Azunre, Salomey Osei, Salomey Addo, Lawrence Asamoah Adu-Gyamfi, Stephen Moore, Bernard Adabankah, Bernard Opoku, Clara Asare-Nyarko, Samuel Nyarko, Cynthia Amoaba, Esther Dansoa Appiah, Felix Akwerh, Richard Nii Lante Lawson, Joel Budu, Emmanuel Debrah, Nana Boateng, Wisdom Ofori, Edwin Buabeng-Munkoh, Franklin Adjei, Isaac Kojo Essel Ampomah, Joseph Otoo, Reindorf Borkor, Standylove Birago Mensah, Lucien Mensah, Mark Amoako Marcel, Anokye Acheampong Amponsah, James Ben Hayfron-Acquah arXiv_AI arXiv_AI  Transformer  Embedding  Recognition  Bert  Sentiment_Classification  Knowledge  Speech  Face  NMT  Classification  Sentiment  Language_Model  PDF
• 2021-03-29 eDarkTrends: Harnessing Social Media Trends in Substance use disorders for Opioid Listings on Cryptomarket    Usha Lokala, Francois Lamy, Triyasha Ghosh Dastidar, Kaushik Roy, Raminta Daniulaityte, Srinivasan Parthasarathy, Amit Sheth arXiv_AI arXiv_AI  Bert  Ontology  Emotion  Action  Deep_Learning  Relation  Sentiment  PDF
• 2021-03-29 Retraining DistilBERT for a Voice Shopping Assistant by Using Universal Dependencies    Pratik Jayarao, Arpit Sharma arXiv_AI arXiv_AI  Bert  Detection  Sentiment  Language_Model  PDF
• 2021-03-29 Towards High Fidelity Monocular Face Reconstruction with Rich Reflectance using Self-supervised Learning and Ray Tracing    Abdallah Dib, Cedric Thebault, Junghyun Ahn, Philippe-Henri Gosselin, Christian Theobalt, Louis Chevallier arXiv_CV arXiv_CV  Reconstruction  Bert  Optimization  Self-Supervised  Pose  Face  PDF
• 2021-03-29 Whitening Sentence Representations for Better Semantics and Faster Retrieval    Jianlin Su, Jiarun Cao, Weijie Liu, Yangyiwen Ou arXiv_AI arXiv_AI  Bert  PDF
• 2021-03-28 PnG BERT: Augmented BERT on Phonemes and Graphemes for Neural TTS    Ye Jia, Heiga Zen, Jonathan Shen, Yu Zhang, Yonghui Wu arXiv_CL arXiv_CL  Bert  Speech  Self-Supervised  PDF
• 2021-03-27 Machine Learning Meets Natural Language Processing -- The story so far    N.-I. Galanis, P. Vafiadis, K.-G. Mirzaev, G.A. Papakostas arXiv_AI arXiv_AI  Transformer  Bert  Attention  PDF
• 2021-03-27 Unsupervised Self-Training for Sentiment Analysis of Code-Switched Data    Akshat Gupta, Sargam Menghani, Sai Krishna Rallabandi, Alan W Black arXiv_CL arXiv_CL  Unsupervised  Bert  Zero-Shot  Review  Pose  Face  Sentiment  PDF
• 2021-03-26 Composable Learning with Sparse Kernel Representations    Ekaterina Tolstaya, Ethan Stump, Alec Koppel, Alejandro Ribeiro arXiv_RO arXiv_RO  Reinforcement_Learning  Bert  Sparse  Pose  Action  PDF
• 2021-03-26 A Benchmark Study of Machine Learning Models for Online Fake News Detection    Junaed Younus Khan, Md. Tawkat Islam Khondaker, Sadia Afroz, Gias Uddin, Anindya Iqbal arXiv_CL arXiv_CL  Bert  Knowledge  Deep_Learning  Detection  Language_Model  PDF
• 2021-03-25 FDLP-Spectrogram: Capturing Speech Dynamics in Spectrograms for End-to-end Automatic Speech Recognition    Samik Sadhu, Hynek Hermansky arXiv_SD arXiv_SD  Recognition  Bert  Speech  Pose  Speech_Recognition  Prediction  PDF
• 2021-03-25 Visual Grounding Strategies for Text-Only Natural Language Processing    Damien Sileo arXiv_CL arXiv_CL  Bert  Image_Retrieval  Pose  Classification  VQA  Language_Model  PDF
• 2021-03-25 Bertinho: Galician BERT Representations    David Vilares, Marcos Garcia, Carlos Gómez-Rodríguez arXiv_CL arXiv_CL  Transformer  Recognition  Bert  Pose  Classification  PDF
• 2021-03-25 K-XLNet: A General Method for Combining Explicit Knowledge with Language Model Pretraining    Ruiqing Yan, Lanchang Sun, Fang Wang, Xiaoming Zhang arXiv_AI arXiv_AI  Transformer  Bert  Knowledge  Knowledge_Graph  Pose  Face  Language_Model  PDF
• 2021-03-25 Predicting Directionality in Causal Relations in Text    Pedram Hosseini, David A. Broniatowski, Mona Diab arXiv_AI arXiv_AI  Transformer  Bert  Relation  Language_Model  PDF
• 2021-03-25 BERT4SO: Neural Sentence Ordering by Fine-tuning BERT    Yutao Zhu, Jian-Yun Nie, Kun Zhou, Shengchao Liu, Pan Du arXiv_CL arXiv_CL  Embedding  Bert  Optimization  Pose  Action  PDF
• 2021-03-24 A Survey of Multimedia Technologies and Robust Algorithms    Zijian Kuang, Xinran Tie arXiv_CV arXiv_CV  Tracking  Recognition  Bert  Pose  Survey  Deep_Learning  Medical  PDF
• 2021-03-24 Czert -- Czech BERT-like Model for Language Representation    Jakub Sido, Ondřej Pražák, Pavel Přibáň, Jan Pašek, Michal Seják, Miloslav Konopík arXiv_CL arXiv_CL  Bert  PDF
• 2021-03-23 Complex Factoid Question Answering with a Free-Text Knowledge Graph    Chen Zhao, Chenyan Xiong, Xin Qian, Jordan Boyd-Graber arXiv_CL arXiv_CL  Bert  Memory_Networks  Knowledge  Knowledge_Graph  Relation  PDF
• 2021-03-23 The NLP Cookbook: Modern Recipes for Transformer based Deep Learning Architectures    Sushant Singh, Ausif Mahmood arXiv_CL arXiv_CL  Transformer  Quantization  Transfer_Learning  Bert  Knowledge  Action  Deep_Learning  Attention  Inference  Language_Model  PDF
• 2021-03-23 Repairing Pronouns in Translation with BERT-Based Post-Editing    Reid Pryzant, Melvin Johnson, Hideto Kazawa arXiv_CL arXiv_CL  Bert  NMT  Prediction  PDF
• 2021-03-23 Variable Name Recovery in Decompiled Binary Code using Constrained Masked Language Modeling    Pratyay Banerjee, Kuntal Kumar Pal, Fish Wang, Chitta Baral arXiv_CL arXiv_CL  Transformer  Bert  Pose  Language_Model  Prediction  PDF
• 2021-03-23 SAFEval: Summarization Asks for Fact-based Evaluation    Thomas Scialom, Paul-Alexis Dray, Patrick Gallinari, Sylvain Lamprier, Benjamin Piwowarski, Jacopo Staiano, Alex Wang arXiv_CL arXiv_CL  Bert  Pose  Relation  Summarization  PDF
• 2021-03-23 Are Neural Language Models Good Plagiarists? A Benchmark for Neural Paraphrase Detection    Jan Philip Wahle, Terry Ruas, Norman Meuschke, Bela Gipp arXiv_AI arXiv_AI  Transformer  Bert  Pose  Classification  Detection  Language_Model  PDF
• 2021-03-23 TMR: Evaluating NER Recall on Tough Mentions    Jingxuan Tu, Constantine Lignos arXiv_AI arXiv_AI  Recognition  Bert  Pose  PDF
• 2021-03-22 Tiny Transformers for Environmental Sound Classification at the Edge    David Elliott, Carlos E. Otero, Steven Wyatt, Evan Martino arXiv_SD arXiv_SD  Transformer  Bert  Action  Classification  PDF
• 2021-03-22 Leveraging Spatial and Photometric Context for Calibrated Non-Lambertian Photometric Stereo    David Honzátko, Engin Türetken, Pascal Fua, L. Andrea Dunbar arXiv_CV arXiv_CV  Bert  Pose  Face  CNN  Inference  PDF
• 2021-03-22 Open Domain Question Answering over Tables via Dense Retrieval    Jonathan Herzig, Thomas Müller, Syrine Krichene, Julian Martin Eisenschlos arXiv_CL arXiv_CL  Bert  QA  PDF
• 2021-03-22 BERT: A Review of Applications in Natural Language Processing and Understanding    M. V. Koroteev arXiv_AI arXiv_AI  Bert  Review  Survey  Deep_Learning  Attention  Language_Model  PDF
• 2021-03-22 Bridging the gap between supervised classification and unsupervised topic modelling for social-media assisted crisis management    Mikael Brunila, Rosie Zhao, Andrei Mircea, Sam Lumley, Renee Sieber arXiv_CL arXiv_CL  Embedding  Unsupervised  Bert  Knowledge  Classification  Attention  PDF
• 2021-03-21 TextFlint: Unified Multilingual Robustness Evaluation Toolkit for Natural Language Processing    Tao Gui, Xiao Wang, Qi Zhang, Qin Liu, Yicheng Zou, Xin Zhou, Rui Zheng, Chong Zhang, Qinzhuo Wu, Jiacheng Ye, Zexiong Pang, Yongxin Zhang, Zhengyan Li, Ruotian Ma, Zichu Fei, Ruijian Cai, Jun Zhao, Xinwu Hu, Zhiheng Yan, Yiding Tan, Yuan Hu, Qiyuan Bian, Zhihua Liu, Bolin Zhu, Shan Qin, Xiaoyu Xing, Jinlan Fu, Yue Zhang, Minlong Peng, Xiaoqing Zheng, Yaqian Zhou, Zhongyu Wei, Xipeng Qiu, Xuanjing Huang arXiv_AI arXiv_AI  Recognition  Bert  Sentiment_Classification  Adversarial  Pose  Classification  Deep_Learning  Sentiment  Inference  Prediction  PDF
• 2021-03-21 L3CubeMahaSent: A Marathi Tweet-based Sentiment Analysis Dataset    Atharva Kulkarni, Meet Mandhane, Manali Likhitkar, Gayatri Kshirsagar, Raviraj Joshi arXiv_CL arXiv_CL  Bert  RNN  Classification  Deep_Learning  Sentiment  PDF
• 2021-03-21 ROSITA: Refined BERT cOmpreSsion with InTegrAted techniques    Yuanxin Liu, Zheng Lin, Fengcheng Yuan arXiv_CL arXiv_CL  Bert  Knowledge  Face  Attention  Language_Model  PDF
• 2021-03-21 NameRec*: Highly Accurate and Fine-grained Person Name Recognition    Rui Zhang, Yimeng Dai, Shijie Liu arXiv_CL arXiv_CL  Embedding  Recognition  Bert  Pose  Relation  Inference  PDF
• 2021-03-19 BERTSurv: BERT-Based Survival Models for Predicting Outcomes of Trauma Patients    Yun Zhao, Qinghang Hong, Xinlu Zhang, Yu Deng, Yuqing Wang, Linda Petzold arXiv_AI arXiv_AI  Transformer  Bert  Deep_Learning  Relation  Attention  Medical  Prediction  PDF
• 2021-03-19 MuRIL: Multilingual Representations for Indian Languages    Simran Khanuja, Diksha Bansal, Sarvesh Mehtani, Savya Khosla, Atreyee Dey, Balaji Gopalan, Dilip Kumar Margam, Pooja Aggarwal, Rajiv Teja Nagipogu, Shachi Dave, Shruti Gupta, Subhash Chandra Bose Gali, Vish Subramanian, Partha Talukdar arXiv_CL arXiv_CL  Bert  Pose  Language_Model  PDF
• 2021-03-19 Cost-effective Deployment of BERT Models in Serverless Environment    Katarína Benešová, Andrej Švec, Marek Šuppa arXiv_CL arXiv_CL  Bert  Knowledge  Sentiment  PDF
• 2021-03-18 GPT Understands, Too    Xiao Liu, Yanan Zheng, Zhengxiao Du, Ming Ding, Yujie Qian, Zhilin Yang, Jie Tang arXiv_CL arXiv_CL  Embedding  Bert  Knowledge  Few-Shot  PDF
• 2021-03-18 All NLP Tasks Are Generation Tasks: A General Pretraining Framework    Zhengxiao Du, Yujie Qian, Xiao Liu, Ming Ding, Jiezhong Qiu, Zhilin Yang, Jie Tang arXiv_AI arXiv_AI  Bert  Pose  Classification  Language_Model  PDF
• 2021-03-18 Contextual Biasing of Language Models for Speech Recognition in Goal-Oriented Conversational Agents    Ashish Shenoy, Sravan Bodapati, Katrin Kirchhoff arXiv_CL arXiv_CL  Embedding  Recognition  Bert  RNN  Speech  Pose  Face  Action  Speech_Recognition  Inference  Language_Model  QA  PDF
• 2021-03-18 Constructive and Toxic Speech Detection for Open-domain Social Media Comments in Vietnamese    Luan Thanh Nguyen, Kiet Van Nguyen, Ngan Luu-Thuy Nguyen arXiv_AI arXiv_AI  Transfer_Learning  Bert  Speech  Pose  Detection  PDF
• 2021-03-18 Model Extraction and Adversarial Transferability, Your BERT is Vulnerable!    Xuanli He, Lingjuan Lyu, Qiongkai Xu, Lichao Sun arXiv_CL arXiv_CL  Bert  Text_Classification  Knowledge  Adversarial  Action  Classification  Text_Generation  Language_Model  PDF
• 2021-03-17 UniParma @ SemEval 2021 Task 5: Toxic Spans Detection Using CharacterBERT and Bag-of-Words Model    Akbar Karimi, Leonardo Rossi, Andrea Prati arXiv_CL arXiv_CL  Embedding  Bert  Detection  Language_Model  PDF
• 2021-03-17 Code Word Detection in Fraud Investigations using a Deep-Learning Approach    Youri van der Zee, Jan C. Scholtes, Marcel Westerhoud, Julien Rossi arXiv_AI arXiv_AI  Bert  Review  Face  Detection  GAN  Language_Model  PDF
• 2021-03-17 Investigating Monolingual and Multilingual BERTModels for Vietnamese Aspect Category Detection    Dang Van Thin, Lac Si Le, Vu Xuan Hoang, Ngan Luu-Thuy Nguyen arXiv_CL arXiv_CL  Bert  Knowledge  Review  Pose  Detection  Sentiment  Language_Model  PDF
• 2021-03-16 KGSynNet: A Novel Entity Synonyms Discovery Framework with Knowledge Graph    Yiying Yang, Xi Yin, Haiqin Yang, Xingjian Fei, Hao Peng, Kaijie Zhou, Kunfeng Lai, Jianping Shen arXiv_AI arXiv_AI  Embedding  Bert  Knowledge  Knowledge_Graph  Pose  Face  Matching  PDF
• 2021-03-15 Category Aware Explainable Conversational Recommendation    Nikolaos Kondylidis, Jie Zou, Evangelos Kanoulas arXiv_AI arXiv_AI  Bert  Knowledge  Prediction  Recommendation  PDF
• 2021-03-15 A Study of Automatic Metrics for the Evaluation of Natural Language Explanations    Miruna Clinciu, Arash Eshghi, Helen Hastie arXiv_AI arXiv_AI  Embedding  Bert  Relation  Autonomous  PDF
• 2021-03-14 AngryBERT: Joint Learning Target and Emotion for Hate Speech Detection    Md Rabiul Awal, Rui Cao, Roy Ka-Wei Lee, Sandra Mitrovic arXiv_CL arXiv_CL  Bert  Sentiment_Classification  Speech  Emotion  Action  Classification  Detection  Sentiment  PDF
• 2021-03-13 Multilingual Code-Switching for Zero-Shot Cross-Lingual Intent Prediction and Slot Filling    Jitin Krishnan, Antonios Anastasopoulos, Hemant Purohit, Huzefa Rangwala arXiv_CL arXiv_CL  Transformer  Bert  Zero-Shot  Pose  Prediction  PDF
• 2021-03-12 Explaining and Improving BERT Performance on Lexical Semantic Change Detection    Severin Laicher, Sinan Kurtyigit, Dominik Schlechtweg, Jonas Kuhn, Sabine Schulte im Walde arXiv_CL arXiv_CL  Embedding  Bert  Detection  PDF
• 2021-03-12 Comparing the Performance of NLP Toolkits and Evaluation measures in Legal Tech    Muhammad Zohaib Khan arXiv_CL arXiv_CL  Unsupervised  Bert  Classification  Language_Model  PDF
• 2021-03-12 Is BERT a Cross-Disciplinary Knowledge Learner? A Surprising Finding of Pre-trained Models' Transferability    Wei-Tsung Kao, Hung-Yi Lee arXiv_CL arXiv_CL  Bert  Text_Classification  Knowledge  Classification  PDF
• 2021-03-12 Inductive Relation Prediction by BERT    Hanwen Zha, Zhiyu Chen, Xifeng Yan arXiv_CL arXiv_CL  Embedding  Bert  Knowledge  Knowledge_Graph  Pose  Relation  Few-Shot  Inference  Language_Model  Prediction  PDF
• 2021-03-11 CANINE: Pre-training an Efficient Tokenization-Free Encoder for Language Representation    Jonathan H. Clark, Dan Garrette, Iulia Turc, John Wieting arXiv_CL arXiv_CL  Transformer  Bert  QA  PDF
• 2021-03-11 Evaluation of Morphological Embeddings for the Russian Language    Vitaly Romanov, Albina Khusainova arXiv_CL arXiv_CL  Embedding  Bert  PDF
• 2021-03-11 Does the Magic of BERT Apply to Medical Code Assignment? A Quantitative Study    Shaoxiong Ji, Matti Hölttä, Pekka Marttinen arXiv_CL arXiv_CL  Unsupervised  Transfer_Learning  Bert  Pose  Action  Quantitative  Attention  Medical  Language_Model  Prediction  PDF
• 2021-03-11 Towards Multi-Sense Cross-Lingual Alignment of Contextual Embeddings    Linlin Liu, Thien Hai Nguyen, Shafiq Joty, Lidong Bing, Luo Si arXiv_AI arXiv_AI  Embedding  Bert  Sentiment_Classification  Zero-Shot  Pose  Classification  Sentiment  PDF
• 2021-03-11 LightMBERT: A Simple Yet Effective Method for Multilingual BERT Distillation    Xiaoqi Jiao, Yichun Yin, Lifeng Shang, Xin Jiang, Xiao Chen, Linlin Li, Fang Wang, Qun Liu arXiv_CL arXiv_CL  Bert  Pose  Language_Model  PDF
• 2021-03-11 FairFil: Contrastive Neural Debiasing Method for Pretrained Text Encoders    Pengyu Cheng, Weituo Hao, Siyang Yuan, Shijing Si, Lawrence Carin arXiv_CL arXiv_CL  Embedding  Bert  Pose  Contrastive_Learning  Relation  PDF
• 2021-03-11 Self-supervised Text-to-SQL Learning with Header Alignment Training    Donggyu Kim, Seanie Lee arXiv_CL arXiv_CL  Bert  Knowledge  Self-Supervised  Pose  Deep_Learning  PDF
• 2021-03-10 ReportAGE: Automatically extracting the exact age of Twitter users based on self-reports in tweets    Ari Z. Klein, Arjun Magge, Graciela Gonzalez-Hernandez arXiv_CL arXiv_CL  Bert  Action  Classification  Detection  Prediction  PDF
• 2021-03-10 Interpretable bias mitigation for textual data: Reducing gender bias in patient notes while maintaining classification performance    Joshua R. Minot, Nicholas Cheney, Marc Maier, Danne C. Elbers, Christopher M. Danforth, Peter Sheridan Dodds arXiv_CL arXiv_CL  Bert  Classification  Relation  Medical  Language_Model  PDF
• 2021-03-09 Combining Context-Free and Contextualized Representations for Arabic Sarcasm Detection and Sentiment Identification    Amey Hengle, Atharva Kshirsagar, Shaily Desai, Manisha Marathe arXiv_CL arXiv_CL  Transformer  Bert  Pose  Face  Detection  Sentiment  Language_Model  PDF
• 2021-03-09 BERTese: Learning to Speak to BERT    Adi Haviv, Jonathan Berant, Amir Globerson arXiv_CL arXiv_CL  Bert  Knowledge  Pose  Action  Language_Model  PDF
• 2021-03-08 Few-Shot Learning of an Interleaved Text Summarization Model by Pretraining with Synthetic Data    Sanjeev Kumar Karn, Francine Chen, Yan-Ying Chen, Ulli Waltinger, Hinrich Schuetze arXiv_CL arXiv_CL  Transformer  Bert  Pose  Few-Shot  Summarization  PDF
• 2021-03-08 Fast and Effective Biomedical Entity Linking Using a Dual Encoder    Rajarshi Bhowmik, Karl Stratos, Gerard de Melo arXiv_CL arXiv_CL  Bert  Pose  Detection  Medical  PDF
• 2021-03-08 Language Models have a Moral Dimension    Patrick Schramowski, Cigdem Turan, Nico Andersen, Constantin Rothkopf, Kristian Kersting arXiv_CL arXiv_CL  Transformer  Embedding  Bert  Knowledge  Face  Language_Model  PDF
• 2021-03-08 MCR-Net: A Multi-Step Co-Interactive Relation Network for Unanswerable Questions on Machine Reading Comprehension    Wei Peng, Yue Hu, Jing Yu, Luxi Xing, Yuqiang Xie, Zihao Zhu, Yajing Sun arXiv_CL arXiv_CL  Bert  Pose  Action  Relation  PDF
• 2021-03-08 'Sharks are not the threat humans are': Argument Component Segmentation in School Student Essays    Tariq Alhindi, Debanjan Ghosh arXiv_CL arXiv_CL  Segmentation  Bert  RNN  Classification  Deep_Learning  PDF
• 2021-03-07 Automatic Difficulty Classification of Arabic Sentences    Nouran Khallaf, Serge Sharoff arXiv_CL arXiv_CL  Embedding  Bert  Classification  Relation  PDF
• 2021-03-07 Empathetic BERT2BERT Conversational Model: Learning Arabic Language Generation with Little Data    Tarek Naous, Wissam Antoun, Reem A. Mahmoud, Hazem Hajj arXiv_CL arXiv_CL  Transformer  Bert  Knowledge  Pose  Language_Model  PDF
• 2021-03-07 Syntax-BERT: Improving Pre-trained Transformers with Syntax Trees    Jiangang Bai, Yujing Wang, Yiren Chen, Yaming Yang, Jing Bai, Jing Yu, Yunhai Tong arXiv_CL arXiv_CL  Transformer  Bert  Language_Model  PDF
• 2021-03-06 Improving Zero-Shot Entity Retrieval through Effective Dense Representations    Eleni Partalidou, Despina Christou, Grigorios Tsoumakas arXiv_CL arXiv_CL  Bert  Zero-Shot  Knowledge  Pose  PDF
• 2021-03-05 MalBERT: Using Transformers for Cybersecurity and Malicious Software Detection    Abir Rahali, Moulay A. Akhloufi arXiv_AI arXiv_AI  Transformer  Bert  Pose  Deep_Learning  Detection  Attention  PDF
• 2021-03-05 Fine-tuning Pretrained Multilingual BERT Model for Indonesian Aspect-based Sentiment Analysis    Annisa Nurul Azhar, Masayu Leylia Khodra arXiv_CL arXiv_CL  Bert  Review  Classification  Sentiment  PDF
• 2021-03-04 A Systematic Evaluation of Transfer Learning and Pseudo-labeling with BERT-based Ranking Models    Iurii Mokrii, Leonid Boytsov, Pavel Braslavski arXiv_CL arXiv_CL  Transfer_Learning  Bert  Zero-Shot  Few-Shot  PDF
• 2021-03-04 Hardware Acceleration of Fully Quantized BERT for Efficient Natural Language Processing    Zejian Liu, Gang Li, Jian Cheng arXiv_CL arXiv_CL  Transformer  Bert  Pose  PDF
• 2021-03-03 Stay on Topic, Please: Aligning User Comments to the Content of a News Article    Jumanah Alshehri, Marija Stanojevic, Eduard Dragut, Zoran Obradovic arXiv_CL arXiv_CL  Embedding  Bert  Pose  Classification  Relation  PDF
• 2021-03-03 OAG-BERT: Pre-train Heterogeneous Entity-augmented Academic Language Model    Xiao Liu, Da Yin, Xingjian Zhang, Kai Su, Kan Wu, Hongxia Yang, Jie Tang arXiv_CL arXiv_CL  Embedding  Bert  Zero-Shot  Knowledge  Review  Pose  Inference  Language_Model  Prediction  Recommendation  PDF
• 2021-03-03 Few-shot Learning for Slot Tagging with Attentive Relational Network    Cennet Oguz, Ngoc Thang Vu arXiv_CL arXiv_CL  Embedding  Bert  Pose  Relation  Few-Shot  Attention  PDF
• 2021-03-02 AraBERT and Farasa Segmentation Based Approach For Sarcasm and Sentiment Detection in Arabic Tweets    Anshul Wadhawan arXiv_CL arXiv_CL  Transformer  Segmentation  Bert  Detection  Sentiment  PDF
• 2021-03-02 Hate Towards the Political Opponent: A Twitter Corpus Study of the 2020 US Elections on the Basis of Offensive Speech and Stance Detection    Lara Grimminger, Roman Klinger arXiv_CL arXiv_CL  OCR  Bert  Speech  Detection  PDF
• 2021-03-01 BERT based patent novelty search by training claims to their own description    André Bodmer, Michael Freunek arXiv_CL arXiv_CL  Bert  PDF
• 2021-03-01 Adapting MARBERT for Improved Arabic Dialect Identification: Submission to the NADI 2021 Shared Task    Badr AlKhamissi, Mohamed Gabr, Muhammad ElNokrashy, Khaled Essam arXiv_CL arXiv_CL  Bert  PDF
• 2021-03-01 Vyākarana: A Colorless Green Benchmark for Syntactic Evaluation in Indic Languages    Rajaswa Patil, Jasleen Dhillon, Siddhant Mahurkar, Saumitra Kulkarni, Manav Malhotra, Veeky Baths arXiv_CL arXiv_CL  Bert  Language_Model  Prediction  PDF
• 2021-03-01 Combat COVID-19 Infodemic Using Explainable Natural Language Processing Models    Jackie Ayoub, X. Jessie Yang, Feng Zhou arXiv_CL arXiv_CL  Transformer  Bert  Pose  Deep_Learning  Detection  Prediction  PDF
• 2021-03-01 BERT-based knowledge extraction method of unstructured domain text    Wang Zijia, Li Ye, Zhu Zhongkai arXiv_CL arXiv_CL  Bert  Knowledge  Knowledge_Graph  Pose  Action  Relation  PDF
• 2021-02-28 NLP-CUET@DravidianLangTech-EACL2021: Investigating Visual and Textual Features to Identify Trolls from Multimodal Social Media Memes    Eftekhar Hossain, Omar Sharif, Mohammed Moshiul Hoque arXiv_CV arXiv_CV  Bert  GAN  Caption  PDF
• 2021-02-28 NLP-CUET@LT-EDI-EACL2021: Multilingual Code-Mixed Hope Speech Detection using Cross-lingual Representation Learner    Eftekhar Hossain, Omar Sharif, Mohammed Moshiul Hoque arXiv_CL arXiv_CL  Transformer  Bert  Speech  Pose  Deep_Learning  Detection  CNN  PDF
• 2021-02-28 NLP-CUET@DravidianLangTech-EACL2021: Offensive Language Detection from Multilingual Code-Mixed Text using Transformers    Omar Sharif, Eftekhar Hossain, Mohammed Moshiul Hoque arXiv_CL arXiv_CL  Transformer  Surveillance  Bert  RNN  Pose  Deep_Learning  Detection  Attention  PDF
• 2021-02-27 Transformers with Competitive Ensembles of Independent Mechanisms    Alex Lamb, Di He, Anirudh Goyal, Guolin Ke, Chien-Feng Liao, Mirco Ravanelli, Yoshua Bengio arXiv_AI arXiv_AI  Transformer  Enhancement  Bert  Speech  Pose  Deep_Learning  Attention  PDF
• 2021-02-27 COVID-19 Tweets Analysis through Transformer Language Models    Abdul Hameed Azeemi, Adeel Waheed arXiv_CL arXiv_CL  Transformer  Bert  Pose  Classification  Sentiment  Language_Model  PDF
• 2021-02-26 Multi-task transfer learning for finding actionable information from crisis-related messages on social media    Congcong Wang, David Lillis arXiv_CL arXiv_CL  Transformer  Transfer_Learning  Bert  Pose  Action  Classification  Prediction  PDF
• 2021-02-25 PharmKE: Knowledge Extraction Platform for Pharmaceutical Texts using Transfer Learning    Nasi Jofche, Kostadin Mishev, Riste Stojanov, Milos Jovanovik, Dimitar Trajanov arXiv_CL arXiv_CL  Transfer_Learning  Recognition  Bert  Text_Classification  Knowledge  Knowledge_Graph  Pose  Action  Classification  Deep_Learning  Relation  PDF
• 2021-02-25 Emotion-Aware, Emotion-Agnostic, or Automatic: Corpus Creation Strategies to Obtain Cognitive Event Appraisal Annotations    Jan Hofmann, Enrica Troiano, Roman Klinger arXiv_CL arXiv_CL  Bert  Knowledge  Emotion  Attention  PDF
• 2021-02-25 IIE-NLP-Eyas at SemEval-2021 Task 4: Enhancing PLM for ReCAM with Special Tokens, Re-Ranking, Siamese Encoders and Back Translation    Yuqiang Xie, Luxi Xing, Wei Peng, Yue Hu arXiv_CL arXiv_CL  Bert  Prediction  PDF
• 2021-02-25 Sentiment Analysis of Persian-English Code-mixed Texts    Nazanin Sabri, Ali Edalat, Behnam Bahrak arXiv_CL arXiv_CL  Embedding  Bert  Detection  Sentiment  PDF
• 2021-02-25 BERT-based Acronym Disambiguation with Multiple Training Strategies    Chunguang Pan, Bingyan Song, Shengguang Wang, Zhipeng Luo arXiv_CL arXiv_CL  Bert  Adversarial  Pose  Classification  PDF
• 2021-02-24 RoBERTa-wwm-ext Fine-Tuning for Chinese Text Classification    Zhuo Xu arXiv_CL arXiv_CL  Transformer  Embedding  Bert  Text_Classification  Pose  Classification  Language_Model  PDF
• 2021-02-24 Task-Specific Pre-Training and Cross Lingual Transfer for Code-Switched Data    Akshat Gupta, Sai Krishna Rallabandi, Alan Black arXiv_CL arXiv_CL  Bert  Zero-Shot  Sentiment  PDF
• 2021-02-24 Re-Evaluating GermEval17 Using German Pre-Trained Language Models    M. Aßenmacher, A. Corvonato, C. Heumann arXiv_CL arXiv_CL  Transformer  Bert  Face  Relation  Language_Model  PDF
• 2021-02-24 LRG at SemEval-2021 Task 4: Improving Reading Comprehension with Abstract Words using Augmentation, Linguistic Features and Voting    Abheesht Sharma, Harshit Pandey, Gunjan Chhablani, Yash Bhartia, Tirtharaj Dash arXiv_CL arXiv_CL  Transformer  Bert  Pose  Language_Model  Prediction  PDF
• 2021-02-24 NLRG at SemEval-2021 Task 5: Toxic Spans Detection Leveraging BERT-based Token Classification and Span Prediction Techniques    Gunjan Chhablani, Yash Bhartia, Abheesht Sharma, Harshit Pandey, Shan Suthaharan arXiv_CL arXiv_CL  Bert  RNN  Classification  Detection  Prediction  PDF
• 2021-02-24 Multi-Task Attentive Residual Networks for Argument Mining    Andrea Galassi, Marco Lippi, Paolo Torroni arXiv_AI arXiv_AI  Bert  Knowledge  Pose  Attention  Prediction  PDF
• 2021-02-24 From Universal Language Model to Downstream Task: Improving RoBERTa-Based Vietnamese Hate Speech Detection    Quang Huu Pham, Viet Anh Nguyen, Linh Bao Doan, Ngoc N. Tran, Ta Minh Thanh arXiv_CL arXiv_CL  Transformer  Bert  Text_Classification  Speech  Pose  Classification  Detection  Language_Model  PDF
• 2021-02-24 Hopeful_Men@LT-EDI-EACL2021: Hope Speech Detection Using Indic Transliteration and Transformers    Ishan Sanjeev Upadhyay, Nikhil E, Anshul Wadhawan, Radhika Mamidi arXiv_CL arXiv_CL  Transformer  Embedding  Bert  RNN  Speech  Detection  PDF
• 2021-02-23 Factorization of Fact-Checks for Low Resource Indian Languages    Shivangi Singhal, Rajiv Ratn Shah, Ponnurangam Kumaraguru arXiv_CL arXiv_CL  Bert  Pose  Detection  PDF
• 2021-02-23 Automated Quality Assessment of Cognitive Behavioral Therapy Sessions Through Highly Contextualized Language Representations    Nikolaos Flemotomos, Victor R. Martinez, Zhuohao Chen, Torrey A. Creed, David C. Atkins, Shrikanth Narayanan arXiv_CL arXiv_CL  Recognition  Bert  Pose  Action  Language_Model  PDF
• 2021-02-23 Robust and Transferable Anomaly Detection in Log Data using Pre-Trained Language Models    Harold Ott, Jasmin Bogatinovski, Alexander Acker, Sasho Nedelkoski, Odej Kao arXiv_CL arXiv_CL  Embedding  Bert  Pose  Detection  Language_Model  PDF
• 2021-02-23 Minimally-Supervised Structure-Rich Text Categorization via Learning on Text-Rich Networks    Xinyang Zhang, Chenwei Zhang, Luna Xin Dong, Jingbo Shang, Jiawei Han arXiv_CL arXiv_CL  Bert  Optimization  Pose  Face  GAN  PDF
• 2021-02-23 VisualCheXbert: Addressing the Discrepancy Between Radiology Report Labels and Image Labels    Saahil Jain, Akshay Smit, Steven QH Truong, Chanh DT Nguyen, Minh-Thanh Huynh, Mudit Jain, Victoria A. Young, Andrew Y. Ng, Matthew P. Lungren, Pranav Rajpurkar arXiv_CV arXiv_CV  Bert  Action  Medical  PDF
• 2021-02-22 Parallelizing Legendre Memory Unit Training    Narsimha Chilkuri, Chris Eliasmith arXiv_AI arXiv_AI  Transformer  Bert  RNN  Pose  Sentiment  Inference  PDF
• 2021-02-22 MixUp Training Leads to Reduced Overfitting and Improved Calibration for the Transformer Architecture    Wancong Zhang, Ieshan Vaidya arXiv_CL arXiv_CL  Transformer  Embedding  Bert  Pose  PDF
• 2021-02-22 Generating Human Readable Transcript for Automatic Speech Recognition with Pre-trained Language Model    Junwei Liao, Yu Shi, Ming Gong, Linjun Shou, Sefik Eskimez, Liyang Lu, Hong Qu, Michael Zeng arXiv_CL arXiv_CL  Recognition  Bert  Speech  Pose  Action  Speech_Recognition  Language_Model  PDF
• 2021-02-22 RUBERT: A Bilingual Roman Urdu BERT Using Cross Lingual Transfer Learning    Usama Khalid, Mirza Omer Beg, Muhammad Umair Arshad arXiv_CL arXiv_CL  Transfer_Learning  Bert  Pose  Language_Model  PDF
• 2021-02-22 Using Prior Knowledge to Guide BERT's Attention in Semantic Textual Matching Tasks    Tingyu Xia, Yue Wang, Yuan Tian, Yi Chang arXiv_AI arXiv_AI  Transformer  Bert  Salient  Knowledge  Pose  Attention  Matching  PDF
• 2021-02-22 Subword Pooling Makes a Difference    Judit Ács, Ákos Kádár, András Kornai arXiv_CL arXiv_CL  Bert  RNN  Attention  PDF
• 2021-02-22 Evaluating Contextualized Language Models for Hungarian    Judit Ács, Dániel Lévai, Dávid Márk Nemeskey, András Kornai arXiv_CL arXiv_CL  Bert  Language_Model  PDF
• 2021-02-22 ReINTEL Challenge 2020: Exploiting Transfer Learning Modelsfor Reliable Intelligence Identification on Vietnamese Social Network Sites    Kim Thi-Thanh Nguyen, Kiet Nguyen Van arXiv_CL arXiv_CL  Transfer_Learning  Bert  Speech  Pose  GAN  PDF
• 2021-02-21 Pre-Training BERT on Arabic Tweets: Practical Considerations    Ahmed Abdelali, Sabit Hassan, Hamdy Mubarak, Kareem Darwish, Younes Samih arXiv_AI arXiv_AI  Transformer  Segmentation  Bert  QA  PDF
• 2021-02-21 Web-based Application for Detecting Indonesian Clickbait Headlines using IndoBERT    Muhammad Noor Fakhruzzaman, Sie Wildan Gunawan arXiv_AI arXiv_AI  Bert  Pose  Language_Model  PDF
• 2021-02-21 Automatic Code Generation using Pre-Trained Language Models    Luis Perez, Lizi Ottens, Sudharshan Viswanathan arXiv_CL arXiv_CL  Bert  Pose  Language_Model  PDF
• 2021-02-19 Using Transformer based Ensemble Learning to classify Scientific Articles    Sohom Ghosh, Ankush Chopra arXiv_CL arXiv_CL  Transformer  Bert  Review  Prediction  PDF
• 2021-02-19 Towards Emotion Recognition in Hindi-English Code-Mixed Data: A Transformer Based Approach    Anshul Wadhawan, Akshita Aggarwal arXiv_CL arXiv_CL  Transformer  Embedding  Recognition  Bert  RNN  Emotion  Action  Deep_Learning  Detection  Sentiment  Attention  Language_Model  PDF
• 2021-02-19 Back to Prior Knowledge: Joint Event Causality Extraction via Convolutional Semantic Infusion    Zijian Wang, Hao Wang, Xiangfeng Luo, Jianqi Gao arXiv_AI arXiv_AI  Bert  Knowledge  Pose  Action  CNN  Language_Model  PDF
• 2021-02-19 Dialect Identification in Nuanced Arabic Tweets Using Farasa Segmentation and AraBERT    Anshul Wadhawan arXiv_CL arXiv_CL  Transformer  Segmentation  Bert  PDF
• 2021-02-19 Learning Dynamic BERT via Trainable Gate Variables and a Bi-modal Regularizer    Seohyeong Jeong, Nojun Kwak arXiv_AI arXiv_AI  Bert  Pose  Inference  PDF
• 2021-02-18 UnibucKernel: Geolocating Swiss-German Jodels Using Ensemble Learning    Mihaela Gaman, Sebastian Cojocariu, Radu Tudor Ionescu arXiv_CL arXiv_CL  Transformer  Embedding  Bert  Prediction  PDF
• 2021-02-18 Training Microsoft News Recommenders with Pretrained Language Models in the Loop    Shitao Xiao, Zheng Liu, Yingxia Shao, Tao Di, Xing Xie arXiv_AI arXiv_AI  Bert  Pose  Language_Model  Recommendation  PDF
• 2021-02-18 Stochastic Spatio-Temporal Optimization for Control and Co-Design of Systems in Robotics and Applied Physics    Ethan N. Evans, Andrew P. Kendall, Evangelos A. Theodorou arXiv_RO arXiv_RO  Bert  Optimization  Pose  PDF
• 2021-02-18 Understanding algorithmic collusion with experience replay    Bingyan Han arXiv_AI arXiv_AI  Bert  PDF
• 2021-02-17 Metrical Tagging in the Wild: Building and Annotating Poetry Corpora with Rhythmic Features    Thomas Haider arXiv_CL arXiv_CL  Embedding  Bert  RNN  Emotion  Relation  PDF
• 2021-02-17 SciDr at SDU-2020: IDEAS -- Identifying and Disambiguating Everyday Acronyms for Scientific Domain    Aadarsh Singh, Priyanshu Kumar arXiv_CL arXiv_CL  Bert  Prediction  PDF
• 2021-02-17 Leveraging Query Resolution and Reading Comprehension for Conversational Passage Retrieval    Svitlana Vakulenko, Nikos Voskarides, Zhucheng Tu, Shayne Longpre arXiv_CL arXiv_CL  Bert  Classification  PDF
• 2021-02-16 Non-Autoregressive Text Generation with Pre-trained Language Models    Yixuan Su, Deng Cai, Yan Wang, David Vandyke, Simon Baker, Piji Li, Nigel Collier arXiv_CL arXiv_CL  Bert  Pose  Attention  Summarization  Text_Generation  Inference  Language_Model  Prediction  PDF
• 2021-02-16 Exploring Transformers in Natural Language Generation: GPT, BERT, and XLNet    M. Onat Topal, Anil Bas, Imke van Heerden arXiv_CL arXiv_CL  Transformer  Bert  RNN  Attention  Summarization  Text_Generation  Language_Model  PDF
• 2021-02-16 A Mental Trespass? Unveiling Truth, Exposing Thoughts and Threatening Civil Liberties with Non-Invasive AI Lie Detection    Taylan Sen, Kurtis Haut, Denis Lomakin, Ehsan Hoque arXiv_AI arXiv_AI  Bert  Review  Pose  Survey  Detection  PDF
• 2021-02-16 Have Attention Heads in BERT Learned Constituency Grammar?    Ziyang Luo arXiv_CL arXiv_CL  Bert  Quantitative  Attention  Inference  Language_Model  PDF
• 2021-02-15 Within-Document Event Coreference with BERT-Based Contextualized Representations    Shafiuddin Rehan Ahmed, James H. Martin arXiv_AI arXiv_AI  Bert  Knowledge  Action  PDF
• 2021-02-15 Overview of the TREC 2020 deep learning track    Nick Craswell, Bhaskar Mitra, Emine Yilmaz, Daniel Campos arXiv_AI arXiv_AI  Bert  Deep_Learning  PDF
• 2021-02-15 Improved Customer Transaction Classification using Semi-Supervised Knowledge Distillation    Rohan Sukumaran arXiv_CL arXiv_CL  Bert  Knowledge  Pose  Action  Classification  PDF
• 2021-02-15 Fast End-to-End Speech Recognition via Non-Autoregressive Models and Cross-Modal Knowledge Transferring from BERT    Ye Bai, Jiangyan Yi, Jianhua Tao, Zhengkun Tian, Zhengqi Wen, Shuai Zhang arXiv_AI arXiv_AI  Transfer_Learning  Recognition  Bert  Knowledge  Speech  Pose  Classification  Relation  Attention  Speech_Recognition  Inference  Language_Model  Prediction  PDF
• 2021-02-15 DOBF: A Deobfuscation Pre-Training Objective for Programming Languages    Baptiste Roziere, Marie-Anne Lachaux, Marc Szafraniec, Guillaume Lample arXiv_CL arXiv_CL  Unsupervised  Bert  Self-Supervised  Language_Model  PDF
• 2021-02-15 BERT's output layer recognizes all hidden layers? Some Intriguing Phenomena and a simple way to boost BERT    Wei-Tsung Kao, Tsung-Han Wu, Po-Han Chi, Chun-Cheng Hsieh, Hung-Yi Lee arXiv_CL arXiv_CL  Transformer  Bert  Pose  PDF
• 2021-02-14 indicnlp@kgp at DravidianLangTech-EACL2021: Offensive Language Identification in Dravidian Languages    Kushal Kedia, Abhilash Nandy arXiv_CL arXiv_CL  Transformer  Transfer_Learning  Bert  Text_Classification  RNN  Classification  PDF
• 2021-02-12 Characterizing English Variation across Social Media Communities with BERT    Li Lucy, David Bamman arXiv_CL arXiv_CL  Bert  PDF
• 2021-02-12 Exploring Classic and Neural Lexical Translation Models for Information Retrieval: Interpretability, Effectiveness, and Efficiency Benefits    Leonid Boytsov, Zico Kolter arXiv_CL arXiv_CL  Embedding  Bert  PDF
• 2021-02-12 Optimizing Inference Performance of Transformers on CPUs    Dave Dice, Alex Kogan arXiv_AI arXiv_AI  Transformer  Bert  Optimization  Pose  Face  Attention  Inference  PDF
• 2021-02-11 Less is More: ClipBERT for Video-and-Language Learning via Sparse Sampling    Jie Lei, Linjie Li, Luowei Zhou, Zhe Gan, Tamara L. Berg, Mohit Bansal, Jingjing Liu arXiv_CV arXiv_CV  Bert  Sparse  Pose  Activity  Language_Model  Video_Retrieval  PDF
• 2021-02-09 NewsBERT: Distilling Pre-trained Language Model for Intelligent News Application    Chuhan Wu, Fangzhao Wu, Yang Yu, Tao Qi, Yongfeng Huang, Qi Liu arXiv_CL arXiv_CL  Bert  Knowledge  Pose  Language_Model  Recommendation  PDF
• 2021-02-09 CodeXGLUE: A Machine Learning Benchmark Dataset for Code Understanding and Generation    Shuai Lu, Daya Guo, Shuo Ren, Junjie Huang, Alexey Svyatkovskiy, Ambrosio Blanco, Colin Clement, Dawn Drain, Daxin Jiang, Duyu Tang, Ge Li, Lidong Zhou, Linjun Shou, Long Zhou, Michele Tufano, Ming Gong, Ming Zhou, Nan Duan, Neel Sundaresan, Shao Kun Deng, Shengyu Fu, Shujie Liu arXiv_CL arXiv_CL  Bert  PDF
• 2021-02-09 Transfer Learning Approach for Arabic Offensive Language Detection System -- BERT-Based Model    Fatemah Husain, Ozlem Uzuner arXiv_CL arXiv_CL  Transformer  Transfer_Learning  Bert  Knowledge  Detection  PDF
• 2021-02-09 Joint Intent Detection and Slot Filling with Wheel-Graph Attention Networks    Pengfei Wei, Bi Zeng, Wenxiong Liao arXiv_AI arXiv_AI  Transformer  Bert  Pose  Deep_Learning  Detection  Attention  PDF
• 2021-02-07 Meta-Learning with Neural Tangent Kernels    Yufan Zhou, Zhenyi Wang, Jiayi Xian, Changyou Chen, Jinhui Xu arXiv_AI arXiv_AI  Bert  Optimization  Adversarial  Pose  PDF
• 2021-02-07 Spoiler Alert: Using Natural Language Processing to Detect Spoilers in Book Reviews    Allen Bao, Marshall Ho, Saarthak Sangamnerkar arXiv_CL arXiv_CL  Bert  RNN  Review  Detection  Language_Model  PDF
• 2021-02-06 The Arc of the Data Scientific Universe    David Leslie arXiv_AI arXiv_AI  OCR  Bert  GAN  PDF
• 2021-02-05 RpBERT: A Text-image Relation Propagation-based BERT Model for Multimodal NER    Lin Sun, Jiquan Wang, Kai Zhang, Yindu Su, Fangsheng Weng arXiv_CL arXiv_CL  Recognition  Bert  Pose  Relation  Attention  PDF
• 2021-02-03 Bootstrapping Multilingual AMR with Contextual Word Alignments    Janaki Sheth, Young-Suk Lee, Ramon Fernandez Astudillo, Tahira Naseem, Radu Florian, Salim Roukos, Todd Ward arXiv_AI arXiv_AI  Transformer  Embedding  Bert  Weakly_Supervised  PDF
• 2021-02-03 Neural Transfer Learning with Transformers for Social Science Text Analysis    Sandra Wankmüller arXiv_CL arXiv_CL  Transformer  Transfer_Learning  Bert  Deep_Learning  Prediction  PDF
• 2021-02-03 HeBERT & HebEMO: a Hebrew BERT Model and a Tool for Polarity Analysis and Emotion Recognition    Avihay Chriqui, Inbal Yahav arXiv_CL arXiv_CL  Transformer  Recognition  Bert  Pose  Emotion  Classification  Detection  Sentiment  Language_Model  PDF
• 2021-02-02 Clickbait Headline Detection in Indonesian News Sites using Multilingual Bidirectional Encoder Representations from Transformers    Muhammad N. Fakhruzzaman, Saidah Z. Jannah, Ratih A. Ningrum, Indah Fahmiyah arXiv_CL arXiv_CL  Transformer  Embedding  Bert  Text_Classification  Pose  Classification  Detection  Language_Model  PDF
• 2021-02-01 Generative Spoken Language Modeling from Raw Audio    Kushal Lakhotia, Evgeny Kharitonov, Wei-Ning Hsu, Yossi Adi, Adam Polyak, Benjamin Bolte, Tu-Anh Nguyen, Jade Copet, Alexei Baevski, Adelrahman Mohamed, Emmanuel Dupoux arXiv_CL arXiv_CL  Unsupervised  Bert  Zero-Shot  Speech  Language_Model  PDF
• 2021-02-01 Improving Distantly-Supervised Relation Extraction through BERT-based Label & Instance Embeddings    Despina Christou, Grigorios Tsoumakas arXiv_CL arXiv_CL  Transformer  Embedding  Bert  Pose  Action  Relation  Relation_Extraction  Attention  PDF
• 2021-02-01 SJ_AJ@DravidianLangTech-EACL2021: Task-Adaptive Pre-Training of Multilingual BERT models for Offensive Language Identification    Sai Muralidhar Jayanthi, Akshat Gupta arXiv_CL arXiv_CL  Bert  Language_Model  PDF
• 2021-02-01 Text-to-hashtag Generation using Seq2seq Learning    Augusto Camargo, Wesley Carvalho, Felipe Peressim arXiv_CL arXiv_CL  Bert  RNN  Review  Quantitative  PDF
• 2021-02-01 Metric-Type Identification for Multi-Level Header Numerical Tables in Scientific Papers    Lya Hulliyyatus Suadaa, Hidetaka Kamigaito, Manabu Okumura, Hiroya Takamura arXiv_CL arXiv_CL  Bert  Pose  Action  Classification  Caption  PDF
• 2021-02-01 Multilingual LAMA: Investigating Knowledge in Multilingual Pretrained Language Models    Nora Kassner, Philipp Dufter, Hinrich Schütze arXiv_CL arXiv_CL  Bert  Knowledge  Language_Model  Prediction  PDF
• 2021-02-01 Scaling Federated Learning for Fine-tuning of Large Language Models    Agrin Hilmkil, Sebastian Callh, Matteo Barbieri, Leon René Sütfeld, Edvin Listo Zec, Olof Mogren arXiv_CL arXiv_CL  Transformer  Bert  Text_Classification  Review  Classification  Sentiment  Language_Model  PDF
• 2021-02-01 Phoneme-BERT: Joint Language Modelling of Phoneme Sequence and ASR Transcript    Mukuntha Narayanan Sundararaman, Ayush Kumar, Jithendra Vepa arXiv_CL arXiv_CL  Bert  Pose  Classification  Sentiment  Language_Model  PDF
• 2021-02-01 Hierarchical Ranking for Answer Selection    Hang Gao, Mengting Hu, Renhong Cheng, Tiegang Gao arXiv_CL arXiv_CL  Bert  Optimization  Pose  QA  PDF
• 2021-01-31 Extending Neural Keyword Extraction with TF-IDF tagset matching    Boshko Koloski, Senja Pollak, Blaž Škrlj, Matej Martinc arXiv_CL arXiv_CL  Transformer  Unsupervised  Bert  RNN  Action  Recommendation  Matching  PDF
• 2021-01-30 Speech Recognition by Simply Fine-tuning BERT    Wen-Chin Huang, Chia-Hua Wu, Shang-Bao Luo, Kuan-Yu Chen, Hsin-Min Wang, Tomoki Toda arXiv_CL arXiv_CL  Recognition  Bert  Speech  Pose  Speech_Recognition  Language_Model  PDF
• 2021-01-30 EmpathBERT: A BERT-based Framework for Demographic-aware Empathy Prediction    Bhanu Prakash Reddy Guda, Aparna Garimella, Niyati Chhaya arXiv_CL arXiv_CL  Bert  Pose  Deep_Learning  Prediction  PDF
• 2021-01-30 ShufText: A Simple Black Box Approach to Evaluate the Fragility of Text Classification Models    Rutuja Taware, Shraddha Varat, Gaurav Salunke, Chaitanya Gawande, Geetanjali Kale, Rahul Khengare, Raviraj Joshi arXiv_CL arXiv_CL  Transformer  Bert  Text_Classification  RNN  Pose  Classification  Deep_Learning  Sentiment  Language_Model  PDF
• 2021-01-30 Learning From How Human Correct    Tong Guo arXiv_CL arXiv_CL  Bert  Text_Classification  Classification  Deep_Learning  PDF
• 2021-01-30 Adversarially learning disentangled speech representations for robust multi-factor voice conversion    Jie Wang, Jingbei Li, Xintao Zhao, Zhiyong Wu, Helen Meng arXiv_SD arXiv_SD  Style_Transfer  Bert  Represenation_Learning  Adversarial  Speech  Pose  Relation  Prediction  PDF
• 2021-01-29 NLPBK at VLSP-2020 shared task: Compose transformer pretrained models for Reliable Intelligence Identification on Social network    Thanh Chinh Nguyen, Van Nha Nguyen arXiv_CL arXiv_CL  Transformer  Bert  Pose  PDF
• 2021-01-29 Fine-tuning BERT-based models for Plant Health Bulletin Classification    Shufan Jiang (CRESTIC, ISEP), Rafael Angarita (ISEP), Stephane Cormier (CRESTIC), Francis Rousseaux (CRESTIC) arXiv_CL arXiv_CL  Transformer  Bert  Represenation_Learning  Knowledge  Pose  Classification  Deep_Learning  Language_Model  PDF
• 2021-01-28 BERTa'u: Ita'u BERT for digital customer service    Paulo Finardi, José Dié Viegas, Gustavo T. Ferreira, Alex F. Mansano, Vinicius F. Caridá arXiv_AI arXiv_AI  Bert  Pose  Face  Deep_Learning  Sentiment  Language_Model  QA  PDF
• 2021-01-28 Weakly Supervised Neuro-Symbolic Module Networks for Numerical Reasoning    Amrita Saha, Shafiq Joty, Steven C.H. Hoi arXiv_CL arXiv_CL  Reinforcement_Learning  Bert  Weakly_Supervised  Pose  Action  Language_Model  Matching  PDF
• 2021-01-27 Dexterous Manipulation Primitives for the Real Robot Challenge    Claire Chen, Krishnan Srinivasan, Jeffrey Zhang, Junwu Zhang arXiv_RO arXiv_RO  Bert  Optimization  Pose  PDF
• 2021-01-27 Scheduled Sampling in Vision-Language Pretraining with Decoupled Encoder-Decoder Network    Yehao Li, Yingwei Pan, Ting Yao, Jingwen Chen, Tao Mei arXiv_CV arXiv_CV  Bert  Pose  GAN  PDF
• 2021-01-27 On the Evolution of Syntactic Information Encoded by BERT's Contextualized Representations    Laura Perez-Mayos, Roberto Carlini, Miguel Ballesteros, Leo Wanner arXiv_CL arXiv_CL  Bert  Knowledge  Language_Model  PDF
• 2021-01-27 KoreALBERT: Pretraining a Lite BERT Model for Korean Language Understanding    Hyunjae Lee, Jaewoong Yoon, Bonggyu Hwang, Seongho Joe, Seungjai Min, Youngjune Gwon arXiv_CL arXiv_CL  Bert  Represenation_Learning  Prediction  PDF
• 2021-01-26 CLiMP: A Benchmark for Chinese Language Model Evaluation    Beilei Xiang, Changbing Yang, Yu Li, Alex Warstadt, Katharina Kann arXiv_CL arXiv_CL  Bert  RNN  Knowledge  Language_Model  PDF
• 2021-01-26 Named Entity Recognition in the Style of Object Detection    Bing Li arXiv_CL arXiv_CL  Recognition  Bert  Pose  Detection  Object_Detection  Prediction  PDF
• 2021-01-26 Cross-Lingual Named Entity Recognition Using Parallel Corpus: A New Approach Using XLM-RoBERTa Alignment    Bing Li, Yujie He, Wenjin Xu arXiv_CL arXiv_CL  Unsupervised  Recognition  Bert  Zero-Shot  Pose  PDF
• 2021-01-26 First Align, then Predict: Understanding the Cross-Lingual Ability of Multilingual BERT    Benjamin Muller, Yanai Elazar, Benoît Sagot, Djamé Seddah arXiv_CL arXiv_CL  Bert  Zero-Shot  Language_Model  PDF
• 2021-01-26 Deep Subjecthood: Higher-Order Grammatical Features in Multilingual BERT    Isabel Papadimitriou, Ethan A. Chi, Richard Futrell, Kyle Mahowald arXiv_CL arXiv_CL  Embedding  Bert  Zero-Shot  Pose  Action  Classification  PDF
• 2021-01-26 Muppet: Massive Multi-task Representations with Pre-Finetuning    Armen Aghajanyan, Anchit Gupta, Akshat Shrivastava, Xilun Chen, Luke Zettlemoyer, Sonal Gupta arXiv_CL arXiv_CL  Bert  Pose  Language_Model  Prediction  PDF
• 2021-01-26 Attention Can Reflect Syntactic Structure    Vinit Ravishankar, Artur Kulmizev, Mostafa Abdou, Anders Søgaard, Joakim Nivre arXiv_CL arXiv_CL  Transformer  Bert  Pose  Relation  Attention  PDF
• 2021-01-26 Regulatory Compliance through Doc2Doc Information Retrieval: A case study in EU/UK legislation where text similarity has limitations    Ilias Chalkidis, Manos Fergadiotis, Nikolaos Manginas, Eva Katakalou, Prodromos Malakasiotis arXiv_CL arXiv_CL  Bert  Classification  Relation  GAN  PDF
• 2021-01-26 Analyzing Zero-shot Cross-lingual Transfer in Supervised NLP Tasks    Hyunjin Choi, Judong Kim, Seongho Joe, Seungjai Min, Youngjune Gwon arXiv_AI arXiv_AI  Transformer  Embedding  Bert  Zero-Shot  Sentiment  Language_Model  PDF
• 2021-01-26 Evaluation of BERT and ALBERT Sentence Embedding Performance on Downstream NLP Tasks    Hyunjin Choi, Judong Kim, Seongho Joe, Youngjune Gwon arXiv_AI arXiv_AI  Embedding  Bert  Inference  Language_Model  PDF
• 2021-01-25 A Hybrid Approach to Measure Semantic Relatedness in Biomedical Concepts    Katikapalli Subramanyam Kalyan, Sivanesan Sangeetha arXiv_CL arXiv_CL  Bert  Knowledge  Ontology  Relation  Medical  PDF
• 2021-01-25 Scaffolded Gait Learning of a Quadruped Robot with Bayesian Optimization    Keyan Zhai, Chu'an Li, Andre Rosendo arXiv_RO arXiv_RO  Bert  Optimization  Pose  Relation  Contour  PDF
• 2021-01-25 EGFI: Drug-Drug Interaction Extraction and Generation with Fusion of Enriched Entity and Sentence Information    Lei Huang, Jiecong Lin, Xiangtao Li, Linqi Song, Ka-Chun Wong arXiv_CL arXiv_CL  Bert  Knowledge  Pose  Action  Classification  Relation  Attention  Medical  Language_Model  PDF
• 2021-01-24 RomeBERT: Robust Training of Multi-Exit BERT    Shijie Geng, Peng Gao, Zuohui Fu, Yongfeng Zhang arXiv_CL arXiv_CL  Bert  Pose  Inference  PDF
• 2021-01-24 Stereotype and Skew: Quantifying Gender Bias in Pre-trained and Fine-tuned Language Models    Daniel de Vassimon Manela, David Errington, Thomas Fisher, Boris van Breugel, Pasquale Minervini arXiv_AI arXiv_AI  Bert  Pose  Relation  Language_Model  PDF
• 2021-01-24 Does Dialog Length matter for Next Response Selection task? An Empirical Study    Jatin Ganhotra, Sachindra Joshi arXiv_CL arXiv_CL  Transformer  Bert  Attention  PDF
• 2021-01-24 WangchanBERTa: Pretraining transformer-based Thai Language Models    Lalita Lowphansirikul, Charin Polpanumas, Nawat Jantrakulchai, Sarana Nutanong arXiv_CL arXiv_CL  Transformer  Bert  Classification  Language_Model  PDF
• 2021-01-23 Training Multilingual Pre-trained Language Model with Byte-level Subwords    Junqiu Wei, Qun Liu, Yinpeng Guo, Xin Jiang arXiv_CL arXiv_CL  Bert  Language_Model  PDF
• 2021-01-22 BERT Transformer model for Detecting Arabic GPT2 Auto-Generated Tweets    Fouzi Harrag, Maria Debbah, Kareem Darwish, Ahmed Abdelali arXiv_CL arXiv_CL  Transformer  Embedding  Transfer_Learning  Bert  RNN  Knowledge  Pose  Language_Model  PDF
• 2021-01-22 Drug and Disease Interpretation Learning with Biomedical Entity Representation Transformer    Zulfat Miftahutdinov, Artur Kadurin, Roman Kudrin, Elena Tutubalina arXiv_CL arXiv_CL  Transformer  Embedding  Bert  Zero-Shot  Knowledge  Pose  Medical  PDF
• 2021-01-22 Extracting Lifestyle Factors for Alzheimer's Disease from Clinical Notes Using Deep Learning with Weak Supervision    Zitao Shen (1), Yoonkwon Yi (1), Anusha Bompelli (2), Fang Yu (3), Yanshan Wang (4), Rui Zhang (2 and 5) ((1) College of Science & Engineering, University of Minnesota, (2) Department of Pharmaceutical Care & Health Systems, University of Minnesota, (3) Edson College of Nursing and Health Innovation, Arizona State University, (4) Department of AI & Informatics, Mayo Clinic, (5) Institute for Health Informatics, University of Minnesota) arXiv_CL arXiv_CL  Transformer  Bert  Pose  Deep_Learning  Medical  Activity  PDF
• 2021-01-22 The heads hypothesis: A unifying statistical approach towards understanding multi-headed attention in BERT    Madhura Pande, Aakriti Budhraja, Preksha Nema, Pratyush Kumar, Mitesh M. Khapra arXiv_AI arXiv_AI  Transformer  Bert  Pose  Classification  Relation  Attention  Inference  PDF
• 2021-01-22 A multi-perspective combined recall and rank framework for Chinese procedure terminology normalization    Ming Liang, Kui Xue, Tong Ruan arXiv_CL arXiv_CL  Bert  Knowledge  Pose  Classification  Medical  PDF
• 2021-01-22 AdaBERT: Task-Adaptive BERT Compression with Differentiable Neural Architecture Search    Daoyuan Chen, Yaliang Li, Minghui Qiu, Zhen Wang, Bofang Li, Bolin Ding, Hongbo Deng, Jun Huang, Wei Lin, Jingren Zhou arXiv_CL arXiv_CL  NAS  Bert  Knowledge  Pose  Inference  Language_Model  PDF
• 2021-01-22 Multilingual Pre-Trained Transformers and Convolutional NN Classification Models for Technical Domain Identification    Suman Dowlagar, Radhika Mamidi arXiv_CL arXiv_CL  Transformer  Transfer_Learning  Bert  Text_Classification  Classification  CNN  PDF
• 2021-01-22 HASOCOne@FIRE-HASOC2020: Using BERT and Multilingual BERT models for Hate Speech Detection    Suman Dowlagar, Radhika Mamidi arXiv_CL arXiv_CL  Transfer_Learning  Bert  Speech  Pose  Detection  PDF
• 2021-01-21 Distilling Large Language Models into Tiny and Effective Students using pQRNN    Prabhu Kaliamoorthi, Aditya Siddhant, Edward Li, Melvin Johnson arXiv_AI arXiv_AI  Transformer  Embedding  Bert  RNN  Pose  Language_Model  PDF
• 2021-01-21 Generative Autoencoder Kernels on Deep Learning for Brain Activity Analysis    Gokhan Altan, Yakup Kutlu arXiv_AI arXiv_AI  Unsupervised  Bert  Optimization  Pose  Classification  Deep_Learning  Activity  PDF
• 2021-01-21 Analysis of Basic Emotions in Texts Based on BERT Vector Representation    A. Artemov, A. Veselovskiy, I. Khasenevich, I. Bolokhov arXiv_CL arXiv_CL  Bert  Emotion  GAN  PDF
• 2021-01-21 ParaSCI: A Large Scientific Paraphrase Dataset for Longer Paraphrase Generation    Qingxiu Dong, Xiaojun Wan, Yue Cao arXiv_CL arXiv_CL  Bert  Pose  PDF
• 2021-01-21 Evaluating Multilingual Text Encoders for Unsupervised Cross-Lingual Retrieval    Robert Litschko, Ivan Vulić, Simone Paolo Ponzetto, Goran Glavaš arXiv_CL arXiv_CL  Transformer  Embedding  Unsupervised  Bert  Represenation_Learning  Pose  PDF
• 2021-01-20 The Diagnosis of Asthma using Hilbert-Huang Transform and Deep Learning on Lung Sounds    Gökhan Altan, Yakup Kutlu, Adnan Özhan Pekmezci, Serkan Nural arXiv_SD arXiv_SD  Bert  Pose  Classification  Deep_Learning  PDF
• 2021-01-20 Classifying Scientific Publications with BERT -- Is Self-Attention a Feature Selection Method?    Andres Garcia-Silva, Jose Manuel Gomez-Perez arXiv_AI arXiv_AI  Transformer  Bert  Text_Classification  Classification  Attention  PDF
• 2021-01-20 Learning to Augment for Data-Scarce Domain BERT Knowledge Distillation    Lingyun Feng, Minghui Qiu, Yaliang Li, Hai-Tao Zheng, Ying Shen arXiv_CL arXiv_CL  Bert  Knowledge  Pose  Language_Model  PDF
• 2021-01-20 Divide and Conquer: An Ensemble Approach for Hostile Post Detection in Hindi    Varad Bhatnagar, Prince Kumar, Sairam Moghili, Pushpak Bhattacharyya arXiv_CL arXiv_CL  Bert  Pose  Face  Classification  Detection  PDF
• 2021-01-20 WeChat AI's Submission for DSTC9 Interactive Dialogue Evaluation Track    Zekang Li, Zongjia Li, Jinchao Zhang, Yang Feng, Jie Zhou arXiv_AI arXiv_AI  Bert  Knowledge  Pose  Action  Language_Model  PDF
• 2021-01-19 Situation and Behavior Understanding by Trope Detection on Films    Chen-Hsi Chang, Hung-Ting Su, Juiheng Hsu, Yu-Siang Wang, Yu-Cheng Chang, Zhe Yu Liu, Ya-Liang Chang, Wen-Feng Cheng, Ke-Jyun Wang, Winston H. Hsu arXiv_AI arXiv_AI  Embedding  Bert  Deep_Learning  Detection  Relation  Attention  Inference  Prediction  PDF
• 2021-01-18 Automatic punctuation restoration with BERT models    Attila Nagy, Bence Bial, Judit Ács arXiv_CL arXiv_CL  Bert  Restoration  PDF
• 2021-01-18 Can a Fruit Fly Learn Word Embeddings?    Yuchen Liang, Chaitanya K. Ryali, Benjamin Hoover, Leopold Grinberg, Saket Navlakha, Mohammed J. Zaki, Dmitry Krotov arXiv_CL arXiv_CL  Embedding  Bert  Sparse  Action  Classification  Relation  PDF
• 2021-01-18 Joint Energy-based Model Training for Better Calibrated Natural Language Understanding Models    Tianxing He, Bryan McCann, Caiming Xiong, Ehsan Hosseini-Asl arXiv_AI arXiv_AI  Bert  Language_Model  PDF
• 2021-01-17 Fusing Wav2vec2.0 and BERT into End-to-end Model for Low-resource Speech Recognition    Cheng Yi, Shiyu Zhou, Bo Xu arXiv_CL arXiv_CL  Recognition  Bert  Speech  Self-Supervised  Pose  Attention  Speech_Recognition  PDF
• 2021-01-16 Transformer-Based Models for Question Answering on COVID19    Hillary Ngai, Yoona Park, John Chen, Mahboobeh Parsapoor (Mah Parsa) arXiv_CL arXiv_CL  Transformer  Bert  Pose  QA  PDF
• 2021-01-15 Grid Search Hyperparameter Benchmarking of BERT, ALBERT, and LongFormer on DuoRC    Alex John Quijano, Sam Nguyen, Juanita Ordonez arXiv_CL arXiv_CL  Bert  Pose  Face  Language_Model  PDF
• 2021-01-15 TextGNN: Improving Text Encoder via Graph Neural Network in Sponsored Search    Jason Zhu, Yanling Cui, Yuming Liu, Hao Sun, Xue Li, Markus Pelger, Liangjie Zhang, Tianqi Yan, Ruofei Zhang, Huasha Zhao arXiv_CL arXiv_CL  Transformer  Bert  Pose  PDF
• 2021-01-15 Walk in Wild: An Ensemble Approach for Hostility Detection in Hindi Posts    Chander Shekhar, Bhavya Bagla, Kaushal Kumar Maurya, Maunendra Sankar Desarkar arXiv_CL arXiv_CL  Bert  Pose  Classification  Detection  PDF
• 2021-01-15 Hostility Detection and Covid-19 Fake News Detection in Social Media    Ayush Gupta, Rohan Sukumaran, Kevin John, Sundeep Teki arXiv_AI arXiv_AI  Embedding  Bert  Detection  Object_Detection  PDF
• 2021-01-15 KDLSQ-BERT: A Quantized Bert Combining Knowledge Distillation with Learned Step Size Quantization    Jing Jin, Cai Liang, Tiancheng Wu, Liqin Zou, Zhiliang Gan arXiv_AI arXiv_AI  Transformer  Quantization  Bert  Knowledge  Pose  Inference  Language_Model  PDF
• 2021-01-14 Stacked DeBERT: All Attention in Incomplete Data for Text Classification    Gwenaelle Cunha Sergio, Minho Lee arXiv_CL arXiv_CL  Transformer  Reconstruction  Embedding  Bert  Text_Classification  Speech  Pose  Classification  Sentiment  Denoising  Attention  QA  PDF
• 2021-01-14 Estimation of the Frequency of Occurrence of Italian Phonemes in Text    Javi Arango, Alex DeCaprio, Sunwoo Baik, Luca De Nardis, Stefanie Shattuck-Hufnagel, Maria Gabriella Di Benedetto arXiv_SD arXiv_SD  Bert  Pose  PDF
• 2021-01-14 Transformer-based Language Model Fine-tuning Methods for COVID-19 Fake News Detection    Ben Chen, Bin Chen, Dehong Gao, Qijin Chen, Chengfu Huo, Xiaonan Meng, Weijun Ren, Yang Zhou arXiv_AI arXiv_AI  Transformer  OCR  Bert  Knowledge  Adversarial  Pose  Quantitative  Detection  Language_Model  PDF
• 2021-01-14 ECOL: Early Detection of COVID Lies Using Content, Prior Knowledge and Source Information    Ipek Baris, Zeyd Boukhers arXiv_CL arXiv_CL  Bert  Knowledge  Pose  Detection  Language_Model  PDF
• 2021-01-14 WER-BERT: Automatic WER Estimation with BERT in a Balanced Ordinal Classification Paradigm    Akshay Krishna Sheshadri, Anvesh Rao Vijjini, Sukhdeep Kharbanda arXiv_CL arXiv_CL  Recognition  Bert  Speech  Pose  Classification  Speech_Recognition  PDF
• 2021-01-13 Coarse and Fine-Grained Hostility Detection in Hindi Posts using Fine Tuned Multilingual Embeddings    Arkadipta De, Venkatesh E, Kaushal Kumar Maurya, Maunendra Sankar Desarkar arXiv_CL arXiv_CL  Transformer  Embedding  Bert  Pose  Face  Classification  Detection  PDF
• 2021-01-13 LaDiff ULMFiT: A Layer Differentiated training approach for ULMFiT    Mohammed Azhan, Mohammad Ahmad arXiv_CL arXiv_CL  Bert  Pose  Deep_Learning  Detection  PDF
• 2021-01-13 Experimental Evaluation of Deep Learning models for Marathi Text Classification    Atharva Kulkarni, Meet Mandhane, Manali Likhitkar, Gayatri Kshirsagar, Jayashree Jagdale, Raviraj Joshi arXiv_CL arXiv_CL  Embedding  Bert  Text_Classification  RNN  Classification  Deep_Learning  Attention  PDF
• 2021-01-12 Of Non-Linearity and Commutativity in BERT    Sumu Zhao, Damian Pascual, Gino Brunner, Roger Wattenhofer arXiv_AI arXiv_AI  Transformer  Bert  Pose  Action  Attention  PDF
• 2021-01-12 Quantum Cognitively Motivated Decision Fusion for Video Sentiment Analysis    Dimitris Gkoumas, Qiuchi Li, Shahram Dehdashti, Massimo Melucci, Yijun Yu, Dawei Song arXiv_AI arXiv_AI  Bert  Pose  Sentiment  PDF
• 2021-01-12 On the Calibration and Uncertainty of Neural Learning to Rank Models    Gustavo Penha, Claudia Hauff arXiv_CL arXiv_CL  Bert  Pose  PDF
• 2021-01-12 Neural Contract Element Extraction Revisited    Ilias Chalkidis, Manos Fergadiotis, Prodromos Malakasiotis, Ion Androutsopoulos arXiv_CL arXiv_CL  Transformer  Embedding  Bert  RNN  Action  Language_Model  PDF
• 2021-01-11 BERT-GT: Cross-sentence n-ary relation extraction with BERT and Graph Transformer    Po-Ting Lai, Zhiyong Lu arXiv_CL arXiv_CL  Transformer  Bert  RNN  Pose  Action  Relation  Relation_Extraction  Attention  Medical  PDF
• 2021-01-11 Automating the Compilation of Potential Core-Outcomes for Clinical Trials    Shwetha Bharadwaj, Melanie Laffin arXiv_CL arXiv_CL  Embedding  Unsupervised  Bert  Classification  PDF
• 2021-01-11 A More Efficient Chinese Named Entity Recognition base on BERT and Syntactic Analysis    Xiao Fu, Guijun Zhang arXiv_CL arXiv_CL  Transformer  Segmentation  Recognition  Bert  Speech  Pose  PDF
• 2021-01-11 AT-BERT: Adversarial Training BERT for Acronym Identification Winning Solution for SDU@AAAI-21    Danqing Zhu, Wangli Lin, Yang Zhang, Qiwei Zhong, Guanxiong Zeng, Weilin Wu, Jiayu Tang arXiv_CL arXiv_CL  Unsupervised  Bert  Adversarial  Pose  Language_Model  PDF
• 2021-01-10 Cisco at AAAI-CAD21 shared task: Predicting Emphasis in Presentation Slides using Contextualised Embeddings    Sreyan Ghosh, Sonal Kumar, Harsh Jalan, Hemant Yadav, Rajiv Ratn Shah arXiv_CL arXiv_CL  Transformer  Embedding  Bert  RNN  Pose  PDF
• 2021-01-10 Detecting Hostile Posts using Relational Graph Convolutional Network    Sarthak, Shikhar Shukla, Govind Mittal, Karm Veer Arya arXiv_AI arXiv_AI  Bert  Pose  Classification  Detection  Relation  CNN  PDF
• 2021-01-10 BERT & Family Eat Word Salad: Experiments with Text Understanding    Ashim Gupta, Giorgi Kvernadze, Vivek Srikumar arXiv_AI arXiv_AI  Bert  Prediction  PDF
• 2021-01-09 Learning Better Sentence Representation with Syntax Information    Chen Yang (University of Science and Technology of China) arXiv_CL arXiv_CL  Transformer  Bert  Text_Classification  RNN  Knowledge  Pose  Action  Classification  Relation  Sentiment  Relation_Extraction  Language_Model  PDF
• 2021-01-08 Misspelling Correction with Pre-trained Contextual Language Model    Yifei Hu, Xiaonan Jing, Youlim Ko, Julia Taylor Rayz arXiv_CL arXiv_CL  Embedding  Bert  Adversarial  Language_Model  PDF
• 2021-01-08 Contextual Non-Local Alignment over Full-Scale Representation for Text-Based Person Search    Chenyang Gao, Guanyu Cai, Xinyang Jiang, Feng Zheng, Jun Zhang, Yifei Gong, Pai Peng, Xiaowei Guo, Xing Sun arXiv_CV arXiv_CV  Bert  Pose  Attention  PDF
• 2021-01-07 Homonym Identification using BERT -- Using a Clustering Approach    Rohan Saha arXiv_CL arXiv_CL  Embedding  Bert  Pose  Language_Model  PDF
• 2021-01-07 Exploring Text-transformers in AAAI 2021 Shared Task: COVID-19 Fake News Detection in English    Xiangyang Li, Yu Xia, Xiang Long, Zheng Li, Sujian Li arXiv_AI arXiv_AI  Transformer  Bert  Pose  Detection  Language_Model  PDF
• 2021-01-07 Applying Transfer Learning for Improving Domain-Specific Search Experience Using Query to Question Similarity    Ankush Chopra, Shruti Agrawal, Sohom Ghosh arXiv_CL arXiv_CL  Embedding  Transfer_Learning  Bert  RNN  Language_Model  QA  PDF
• 2021-01-06 EfficientQA : a RoBERTa Based Phrase-Indexed Question-Answering System    Sofian Chaybouti arXiv_CL arXiv_CL  Bert  Language_Model  QA  PDF
• 2021-01-05 PhoNLP: A joint multi-task learning model for Vietnamese part-of-speech tagging, named entity recognition and dependency parsing    Linh The Nguyen, Dat Quoc Nguyen arXiv_CL arXiv_CL  Recognition  Bert  Speech  Language_Model  PDF
• 2021-01-05 I-BERT: Integer-only BERT Quantization    Sehoon Kim, Amir Gholami, Zhewei Yao, Michael W. Mahoney, Kurt Keutzer arXiv_CL arXiv_CL  Transformer  Quantization  Bert  Pose  Inference  PDF
• 2021-01-04 Transformers and Transfer Learning for Improving Portuguese Semantic Role Labeling    Sofia Oliveira, Daniel Loureiro, Alípio Jorge arXiv_CL arXiv_CL  Transformer  Transfer_Learning  Bert  Pose  PDF
• 2021-01-04 Improving reference mining in patents with BERT    Ken Voskuil, Suzan Verberne arXiv_CL arXiv_CL  Bert  Pose  Relation  PDF
• 2021-01-04 A Joint Training Dual-MRC Framework for Aspect Based Sentiment Analysis    Yue Mao, Yi Shen, Chao Yu, Longjun Cai arXiv_AI arXiv_AI  Bert  Sentiment_Classification  Pose  Action  Classification  Sentiment  PDF
• 2021-01-02 Baleen: Robust Multi-Hop Reasoning at Scale via Condensed Retrieval    Omar Khattab, Christopher Potts, Matei Zaharia arXiv_CL arXiv_CL  Bert  Knowledge  Pose  Action  PDF
• 2021-01-02 Superbizarre Is Not Superb: Improving BERT's Interpretations of Complex Words with Derivational Morphology    Valentin Hofmann, Janet B. Pierrehumbert, Hinrich Schütze arXiv_CL arXiv_CL  Segmentation  Bert  Language_Model  PDF
• 2021-01-02 Lex-BERT: Enhancing BERT based NER with lexicons    Wei Zhu, Daniel Cheung arXiv_CL arXiv_CL  Transformer  Embedding  Recognition  Bert  PDF
• 2021-01-02 What all do audio transformer models hear? Probing Acoustic Representations for Language Delivery and its Structure    Jui Shah, Yaman Kumar Singla, Changyou Chen, Rajiv Ratn Shah arXiv_CL arXiv_CL  Transformer  Embedding  Bert  Speech  Face  PDF
• 2021-01-02 Modeling Fine-Grained Entity Types with Box Embeddings    Yasumasa Onoe, Michael Boratko, Greg Durrett arXiv_AI arXiv_AI  Embedding  Bert  Ontology  Face  Relation  Prediction  PDF
• 2021-01-01 BanglaBERT: Combating Embedding Barrier for Low-Resource Language Understanding    Abhik Bhattacharjee, Tahmid Hasan, Kazi Samin, M. Sohel Rahman, Anindya Iqbal, Rifat Shahriyar arXiv_CL arXiv_CL  Embedding  Bert  Self-Supervised  Classification  Language_Model  PDF
• 2021-01-01 On Explaining Your Explanations of BERT: An Empirical Study with Sequence Classification    Zhengxuan Wu, Desmond C. Ong arXiv_CL arXiv_CL  Bert  Pose  Classification  Sentiment  Attention  Language_Model  PDF
• 2021-01-01 Transformer based Automatic COVID-19 Fake News Detection System    Sunil Gundapu, Radhika Mamid arXiv_CL arXiv_CL  Transformer  Bert  Detection  PDF
• 2020-12-31 EarlyBERT: Efficient BERT Training via Early-bird Lottery Tickets    Xiaohan Chen, Yu Cheng, Shuohang Wang, Zhe Gan, Zhangyang Wang, Jingjing Liu arXiv_AI arXiv_AI  Bert  Pose  Inference  Language_Model  PDF
• 2020-12-31 KART: Privacy Leakage Framework of Language Models Pre-trained with Clinical Records    Yuta Nakamura (1 and 2), Shouhei Hanaoka (3), Yukihiro Nomura (4), Naoto Hayashi (4), Osamu Abe (1 and 3), Shuntaro Yada (2), Shoko Wakamiya (2), Eiji Aramaki (2) ((1) The University of Tokyo, (2) Nara Institute of Science and Technology, (3) The Department of Radiology, The University of Tokyo Hospital, (4) The Department of Computational Diagnostic Radiology and Preventive Medicine, The University of Tokyo Hospital) arXiv_CL arXiv_CL  Bert  Knowledge  Medical  Language_Model  PDF
• 2020-12-31 MiniLMv2: Multi-Head Self-Attention Relation Distillation for Compressing Pretrained Transformers    Wenhui Wang, Hangbo Bao, Shaohan Huang, Li Dong, Furu Wei arXiv_CL arXiv_CL  Transformer  Bert  Knowledge  Action  Relation  Attention  PDF
• 2020-12-31 Conditional Generation of Temporally-ordered Event Sequences    Shih-Ting Lin, Nathanael Chambers, Greg Durrett arXiv_CL arXiv_CL  Bert  Knowledge  Relation  Denoising  Inference  PDF
• 2020-12-31 BinaryBERT: Pushing the Limit of BERT Quantization    Haoli Bai, Wei Zhang, Lu Hou, Lifeng Shang, Jing Jin, Xin Jiang, Qun Liu, Michael Lyu, Irwin King arXiv_CL arXiv_CL  Quantization  Bert  Pose  Language_Model  PDF
• 2020-12-31 Better Robustness by More Coverage: Adversarial Training with Mixup Augmentation for Robust Fine-tuning    Chenglei Si, Zhengyan Zhang, Fanchao Qi, Zhiyuan Liu, Yasheng Wang, Qun Liu, Maosong Sun arXiv_CL arXiv_CL  Bert  Text_Classification  Adversarial  Pose  Classification  Language_Model  PDF
• 2020-12-31 CoCoLM: COmplex COmmonsense Enhanced Language Model    Changlong Yu, Hongming Zhang, Yangqiu Song, Wilfred Ng arXiv_CL arXiv_CL  Bert  Knowledge  Knowledge_Graph  Pose  Relation  Language_Model  PDF
• 2020-12-31 UNKs Everywhere: Adapting Multilingual Language Models to New Scripts    Jonas Pfeiffer, Ivan Vulić, Iryna Gurevych, Sebastian Ruder arXiv_CL arXiv_CL  Embedding  Bert  Knowledge  Pose  Language_Model  PDF
• 2020-12-31 Linear-Time WordPiece Tokenization    Xinying Song, Alex Salcianu, Yang Song, Dave Dopson, Denny Zhou arXiv_CL arXiv_CL  Bert  Knowledge  Pose  Face  Inference  Matching  PDF
• 2020-12-31 An Experimental Evaluation of Transformer-based Language Models in the Biomedical Domain    Paul Grouchy, Shobhit Jain, Michael Liu, Kuhan Wang, Max Tian, Nidhi Arora, Hillary Ngai, Faiza Khan Khattak, Elham Dolatabadi, Sedef Akinli Kocak arXiv_CL arXiv_CL  Transformer  Bert  Medical  Language_Model  QA  PDF
• 2020-12-31 Unified Mandarin TTS Front-end Based on Distilled BERT Model    Yang Zhang, Liqun Deng, Yasheng Wang arXiv_CL arXiv_CL  Bert  Knowledge  Speech  Pose  Language_Model  Prediction  PDF
• 2020-12-30 Optimizing Deeper Transformers on Small Datasets: An Application on Text-to-SQL Semantic Parsing    Peng Xu, Wei Yang, Wenjie Zi, Keyi Tang, Chengyang Huang, Jackie Chi Kit Cheung, Yanshuai Cao arXiv_CL arXiv_CL  Transformer  Bert  Relation  Prediction  PDF
• 2020-12-30 Deriving Contextualised Semantic Features from BERT Embeddings    Jacob Turton, David Vinson, Robert Elliott Smith arXiv_CL arXiv_CL  Transformer  Embedding  Bert  Pose  PDF
• 2020-12-30 Unnatural Language Inference    Koustuv Sinha, Prasanna Parthasarathi, Joelle Pineau, Adina Williams arXiv_CL arXiv_CL  Transformer  Bert  Pose  Inference  PDF
• 2020-12-30 DEER: A Data Efficient Language Model for Event Temporal Reasoning    Rujun Han, Xiang Ren, Nanyun Peng arXiv_CL arXiv_CL  Bert  Knowledge  Pose  Action  Relation  Language_Model  PDF
• 2020-12-30 SemGloVe: Semantic Co-occurrences for GloVe from BERT    Leilei Gan, Zhiyang Teng, Yue Zhang, Linchao Zhu, Fei Wu, Yi Yang arXiv_AI arXiv_AI  Embedding  Bert  Pose  Attention  Language_Model  PDF
• 2020-12-30 Out of Order: How important is the sequential order of words in a sentence in Natural Language Understanding tasks?    Thang M. Pham, Trung Bui, Long Mai, Anh Nguyen arXiv_AI arXiv_AI  Embedding  Bert  Sentiment  Inference  Prediction  PDF
• 2020-12-30 Improving BERT with Syntax-aware Local Attention    Zhongli Li, Qingyu Zhou, Chao Li, Ke Xu, Yunbo Cao arXiv_CL arXiv_CL  Transformer  Bert  Pose  Classification  Attention  Language_Model  PDF
• 2020-12-30 Enhancing Pre-trained Language Model with Lexical Simplification    Rongzhou Bao, Jiayi Wang, Zhuosheng Zhang, Hai Zhao arXiv_CL arXiv_CL  Bert  Text_Classification  Pose  Classification  Language_Model  PDF
• 2020-12-29 CMV-BERT: Contrastive multi-vocab pretraining of BERT    Wei Zhu, Daniel Cheung arXiv_CL arXiv_CL  Bert  Pose  Contrastive_Learning  Language_Model  PDF
• 2020-12-29 Accelerating Pre-trained Language Models via Calibrated Cascade    Lei Li, Yankai Lin, Shuhuai Ren, Deli Chen, Xuancheng Ren, Peng Li, Jie Zhou, Xu Sun arXiv_CL arXiv_CL  Bert  Knowledge