Bert

Bert

• 2021-02-24 Task-Specific Pre-Training and Cross Lingual Transfer for Code-Switched Data    Akshat Gupta, Sai Krishna Rallabandi, Alan Black arXiv_CL arXiv_CL  Bert  Zero-Shot  Sentiment  PDF
• 2021-02-24 Re-Evaluating GermEval17 Using German Pre-Trained Language Models    M. Aßenmacher, A. Corvonato, C. Heumann arXiv_CL arXiv_CL  Transformer  Bert  Face  Relation  Language_Model  PDF
• 2021-02-24 LRG at SemEval-2021 Task 4: Improving Reading Comprehension with Abstract Words using Augmentation, Linguistic Features and Voting    Abheesht Sharma, Harshit Pandey, Gunjan Chhablani, Yash Bhartia, Tirtharaj Dash arXiv_CL arXiv_CL  Transformer  Bert  Pose  Language_Model  Prediction  PDF
• 2021-02-24 NLRG at SemEval-2021 Task 5: Toxic Spans Detection Leveraging BERT-based Token Classification and Span Prediction Techniques    Gunjan Chhablani, Yash Bhartia, Abheesht Sharma, Harshit Pandey, Shan Suthaharan arXiv_CL arXiv_CL  Bert  RNN  Classification  Detection  Prediction  PDF
• 2021-02-24 Multi-Task Attentive Residual Networks for Argument Mining    Andrea Galassi, Marco Lippi, Paolo Torroni arXiv_AI arXiv_AI  Bert  Knowledge  Pose  Attention  Prediction  PDF
• 2021-02-24 From Universal Language Model to Downstream Task: Improving RoBERTa-Based Vietnamese Hate Speech Detection    Quang Huu Pham, Viet Anh Nguyen, Linh Bao Doan, Ngoc N. Tran, Ta Minh Thanh arXiv_CL arXiv_CL  Transformer  Bert  Text_Classification  Speech  Pose  Classification  Detection  Language_Model  PDF
• 2021-02-24 Hopeful_Men@LT-EDI-EACL2021: Hope Speech Detection Using Indic Transliteration and Transformers    Ishan Sanjeev Upadhyay, Nikhil E, Anshul Wadhawan, Radhika Mamidi arXiv_CL arXiv_CL  Transformer  Embedding  Bert  RNN  Speech  Detection  PDF
• 2021-02-23 Factorization of Fact-Checks for Low Resource Indian Languages    Shivangi Singhal, Rajiv Ratn Shah, Ponnurangam Kumaraguru arXiv_CL arXiv_CL  Bert  Pose  Detection  PDF
• 2021-02-23 Automated Quality Assessment of Cognitive Behavioral Therapy Sessions Through Highly Contextualized Language Representations    Nikolaos Flemotomos, Victor R. Martinez, Zhuohao Chen, Torrey A. Creed, David C. Atkins, Shrikanth Narayanan arXiv_CL arXiv_CL  Recognition  Bert  Pose  Action  Language_Model  PDF
• 2021-02-23 Robust and Transferable Anomaly Detection in Log Data using Pre-Trained Language Models    Harold Ott, Jasmin Bogatinovski, Alexander Acker, Sasho Nedelkoski, Odej Kao arXiv_CL arXiv_CL  Embedding  Bert  Pose  Detection  Language_Model  PDF
• 2021-02-23 Minimally-Supervised Structure-Rich Text Categorization via Learning on Text-Rich Networks    Xinyang Zhang, Chenwei Zhang, Luna Xin Dong, Jingbo Shang, Jiawei Han arXiv_CL arXiv_CL  Bert  Optimization  Pose  Face  GAN  PDF
• 2021-02-23 VisualCheXbert: Addressing the Discrepancy Between Radiology Report Labels and Image Labels    Saahil Jain, Akshay Smit, Steven QH Truong, Chanh DT Nguyen, Minh-Thanh Huynh, Mudit Jain, Victoria A. Young, Andrew Y. Ng, Matthew P. Lungren, Pranav Rajpurkar arXiv_CV arXiv_CV  Bert  Action  Medical  PDF
• 2021-02-22 Parallelizing Legendre Memory Unit Training    Narsimha Chilkuri, Chris Eliasmith arXiv_AI arXiv_AI  Transformer  Bert  RNN  Pose  Sentiment  Inference  PDF
• 2021-02-22 MixUp Training Leads to Reduced Overfitting and Improved Calibration for the Transformer Architecture    Wancong Zhang, Ieshan Vaidya arXiv_CL arXiv_CL  Transformer  Embedding  Bert  Pose  PDF
• 2021-02-22 Generating Human Readable Transcript for Automatic Speech Recognition with Pre-trained Language Model    Junwei Liao, Yu Shi, Ming Gong, Linjun Shou, Sefik Eskimez, Liyang Lu, Hong Qu, Michael Zeng arXiv_CL arXiv_CL  Recognition  Bert  Speech  Pose  Action  Speech_Recognition  Language_Model  PDF
• 2021-02-22 RUBERT: A Bilingual Roman Urdu BERT Using Cross Lingual Transfer Learning    Usama Khalid, Mirza Omer Beg, Muhammad Umair Arshad arXiv_CL arXiv_CL  Transfer_Learning  Bert  Pose  Language_Model  PDF
• 2021-02-22 Using Prior Knowledge to Guide BERT's Attention in Semantic Textual Matching Tasks    Tingyu Xia, Yue Wang, Yuan Tian, Yi Chang arXiv_AI arXiv_AI  Transformer  Bert  Salient  Knowledge  Pose  Attention  Matching  PDF
• 2021-02-22 Subword Pooling Makes a Difference    Judit Ács, Ákos Kádár, András Kornai arXiv_CL arXiv_CL  Bert  RNN  Attention  PDF
• 2021-02-22 Evaluating Contextualized Language Models for Hungarian    Judit Ács, Dániel Lévai, Dávid Márk Nemeskey, András Kornai arXiv_CL arXiv_CL  Bert  Language_Model  PDF
• 2021-02-22 ReINTEL Challenge 2020: Exploiting Transfer Learning Modelsfor Reliable Intelligence Identification on Vietnamese Social Network Sites    Kim Thi-Thanh Nguyen, Kiet Nguyen Van arXiv_CL arXiv_CL  Transfer_Learning  Bert  Speech  Pose  GAN  PDF
• 2021-02-21 Pre-Training BERT on Arabic Tweets: Practical Considerations    Ahmed Abdelali, Sabit Hassan, Hamdy Mubarak, Kareem Darwish, Younes Samih arXiv_AI arXiv_AI  Transformer  Segmentation  Bert  QA  PDF
• 2021-02-21 Web-based Application for Detecting Indonesian Clickbait Headlines using IndoBERT    Muhammad Noor Fakhruzzaman, Sie Wildan Gunawan arXiv_AI arXiv_AI  Bert  Pose  Language_Model  PDF
• 2021-02-21 Automatic Code Generation using Pre-Trained Language Models    Luis Perez, Lizi Ottens, Sudharshan Viswanathan arXiv_CL arXiv_CL  Bert  Pose  Language_Model  PDF
• 2021-02-19 Using Transformer based Ensemble Learning to classify Scientific Articles    Sohom Ghosh, Ankush Chopra arXiv_CL arXiv_CL  Transformer  Bert  Review  Prediction  PDF
• 2021-02-19 Towards Emotion Recognition in Hindi-English Code-Mixed Data: A Transformer Based Approach    Anshul Wadhawan, Akshita Aggarwal arXiv_CL arXiv_CL  Transformer  Embedding  Recognition  Bert  RNN  Emotion  Action  Deep_Learning  Detection  Sentiment  Attention  Language_Model  PDF
• 2021-02-19 Back to Prior Knowledge: Joint Event Causality Extraction via Convolutional Semantic Infusion    Zijian Wang, Hao Wang, Xiangfeng Luo, Jianqi Gao arXiv_AI arXiv_AI  Bert  Knowledge  Pose  Action  CNN  Language_Model  PDF
• 2021-02-19 Dialect Identification in Nuanced Arabic Tweets Using Farasa Segmentation and AraBERT    Anshul Wadhawan arXiv_CL arXiv_CL  Transformer  Segmentation  Bert  PDF
• 2021-02-19 Learning Dynamic BERT via Trainable Gate Variables and a Bi-modal Regularizer    Seohyeong Jeong, Nojun Kwak arXiv_AI arXiv_AI  Bert  Pose  Inference  PDF
• 2021-02-18 UnibucKernel: Geolocating Swiss-German Jodels Using Ensemble Learning    Mihaela Gaman, Sebastian Cojocariu, Radu Tudor Ionescu arXiv_CL arXiv_CL  Transformer  Embedding  Bert  Prediction  PDF
• 2021-02-18 Training Microsoft News Recommenders with Pretrained Language Models in the Loop    Shitao Xiao, Zheng Liu, Yingxia Shao, Tao Di, Xing Xie arXiv_AI arXiv_AI  Bert  Pose  Language_Model  Recommendation  PDF
• 2021-02-18 Stochastic Spatio-Temporal Optimization for Control and Co-Design of Systems in Robotics and Applied Physics    Ethan N. Evans, Andrew P. Kendall, Evangelos A. Theodorou arXiv_RO arXiv_RO  Bert  Optimization  Pose  PDF
• 2021-02-18 Understanding algorithmic collusion with experience replay    Bingyan Han arXiv_AI arXiv_AI  Bert  PDF
• 2021-02-17 Metrical Tagging in the Wild: Building and Annotating Poetry Corpora with Rhythmic Features    Thomas Haider arXiv_CL arXiv_CL  Embedding  Bert  RNN  Emotion  Relation  PDF
• 2021-02-17 SciDr at SDU-2020: IDEAS -- Identifying and Disambiguating Everyday Acronyms for Scientific Domain    Aadarsh Singh, Priyanshu Kumar arXiv_CL arXiv_CL  Bert  Prediction  PDF
• 2021-02-17 Leveraging Query Resolution and Reading Comprehension for Conversational Passage Retrieval    Svitlana Vakulenko, Nikos Voskarides, Zhucheng Tu, Shayne Longpre arXiv_CL arXiv_CL  Bert  Classification  PDF
• 2021-02-16 Non-Autoregressive Text Generation with Pre-trained Language Models    Yixuan Su, Deng Cai, Yan Wang, David Vandyke, Simon Baker, Piji Li, Nigel Collier arXiv_CL arXiv_CL  Bert  Pose  Attention  Summarization  Text_Generation  Inference  Language_Model  Prediction  PDF
• 2021-02-16 Exploring Transformers in Natural Language Generation: GPT, BERT, and XLNet    M. Onat Topal, Anil Bas, Imke van Heerden arXiv_CL arXiv_CL  Transformer  Bert  RNN  Attention  Summarization  Text_Generation  Language_Model  PDF
• 2021-02-16 A Mental Trespass? Unveiling Truth, Exposing Thoughts and Threatening Civil Liberties with Non-Invasive AI Lie Detection    Taylan Sen, Kurtis Haut, Denis Lomakin, Ehsan Hoque arXiv_AI arXiv_AI  Bert  Review  Pose  Survey  Detection  PDF
• 2021-02-16 Have Attention Heads in BERT Learned Constituency Grammar?    Ziyang Luo arXiv_CL arXiv_CL  Bert  Quantitative  Attention  Inference  Language_Model  PDF
• 2021-02-15 Within-Document Event Coreference with BERT-Based Contextualized Representations    Shafiuddin Rehan Ahmed, James H. Martin arXiv_AI arXiv_AI  Bert  Knowledge  Action  PDF
• 2021-02-15 Overview of the TREC 2020 deep learning track    Nick Craswell, Bhaskar Mitra, Emine Yilmaz, Daniel Campos arXiv_AI arXiv_AI  Bert  Deep_Learning  PDF
• 2021-02-15 Improved Customer Transaction Classification using Semi-Supervised Knowledge Distillation    Rohan Sukumaran arXiv_CL arXiv_CL  Bert  Knowledge  Pose  Action  Classification  PDF
• 2021-02-15 Fast End-to-End Speech Recognition via Non-Autoregressive Models and Cross-Modal Knowledge Transferring from BERT    Ye Bai, Jiangyan Yi, Jianhua Tao, Zhengkun Tian, Zhengqi Wen, Shuai Zhang arXiv_AI arXiv_AI  Transfer_Learning  Recognition  Bert  Knowledge  Speech  Pose  Classification  Relation  Attention  Speech_Recognition  Inference  Language_Model  Prediction  PDF
• 2021-02-15 DOBF: A Deobfuscation Pre-Training Objective for Programming Languages    Baptiste Roziere, Marie-Anne Lachaux, Marc Szafraniec, Guillaume Lample arXiv_CL arXiv_CL  Unsupervised  Bert  Self-Supervised  Language_Model  PDF
• 2021-02-15 BERT's output layer recognizes all hidden layers? Some Intriguing Phenomena and a simple way to boost BERT    Wei-Tsung Kao, Tsung-Han Wu, Po-Han Chi, Chun-Cheng Hsieh, Hung-Yi Lee arXiv_CL arXiv_CL  Transformer  Bert  Pose  PDF
• 2021-02-14 indicnlp@kgp at DravidianLangTech-EACL2021: Offensive Language Identification in Dravidian Languages    Kushal Kedia, Abhilash Nandy arXiv_CL arXiv_CL  Transformer  Transfer_Learning  Bert  Text_Classification  RNN  Classification  PDF
• 2021-02-12 Characterizing English Variation across Social Media Communities with BERT    Li Lucy, David Bamman arXiv_CL arXiv_CL  Bert  PDF
• 2021-02-12 Exploring Classic and Neural Lexical Translation Models for Information Retrieval: Interpretability, Effectiveness, and Efficiency Benefits    Leonid Boytsov, Zico Kolter arXiv_CL arXiv_CL  Embedding  Bert  PDF
• 2021-02-12 Optimizing Inference Performance of Transformers on CPUs    Dave Dice, Alex Kogan arXiv_AI arXiv_AI  Transformer  Bert  Optimization  Pose  Face  Attention  Inference  PDF
• 2021-02-11 Less is More: ClipBERT for Video-and-Language Learning via Sparse Sampling    Jie Lei, Linjie Li, Luowei Zhou, Zhe Gan, Tamara L. Berg, Mohit Bansal, Jingjing Liu arXiv_CV arXiv_CV  Bert  Sparse  Pose  Activity  Language_Model  Video_Retrieval  PDF
• 2021-02-09 NewsBERT: Distilling Pre-trained Language Model for Intelligent News Application    Chuhan Wu, Fangzhao Wu, Yang Yu, Tao Qi, Yongfeng Huang, Qi Liu arXiv_CL arXiv_CL  Bert  Knowledge  Pose  Language_Model  Recommendation  PDF
• 2021-02-09 CodeXGLUE: A Machine Learning Benchmark Dataset for Code Understanding and Generation    Shuai Lu, Daya Guo, Shuo Ren, Junjie Huang, Alexey Svyatkovskiy, Ambrosio Blanco, Colin Clement, Dawn Drain, Daxin Jiang, Duyu Tang, Ge Li, Lidong Zhou, Linjun Shou, Long Zhou, Michele Tufano, Ming Gong, Ming Zhou, Nan Duan, Neel Sundaresan, Shao Kun Deng, Shengyu Fu, Shujie Liu arXiv_CL arXiv_CL  Bert  PDF
• 2021-02-09 Transfer Learning Approach for Arabic Offensive Language Detection System -- BERT-Based Model    Fatemah Husain, Ozlem Uzuner arXiv_CL arXiv_CL  Transformer  Transfer_Learning  Bert  Knowledge  Detection  PDF
• 2021-02-09 Joint Intent Detection and Slot Filling with Wheel-Graph Attention Networks    Pengfei Wei, Bi Zeng, Wenxiong Liao arXiv_AI arXiv_AI  Transformer  Bert  Pose  Deep_Learning  Detection  Attention  PDF
• 2021-02-07 Meta-Learning with Neural Tangent Kernels    Yufan Zhou, Zhenyi Wang, Jiayi Xian, Changyou Chen, Jinhui Xu arXiv_AI arXiv_AI  Bert  Optimization  Adversarial  Pose  PDF
• 2021-02-07 Spoiler Alert: Using Natural Language Processing to Detect Spoilers in Book Reviews    Allen Bao, Marshall Ho, Saarthak Sangamnerkar arXiv_CL arXiv_CL  Bert  RNN  Review  Detection  Language_Model  PDF
• 2021-02-06 The Arc of the Data Scientific Universe    David Leslie arXiv_AI arXiv_AI  OCR  Bert  GAN  PDF
• 2021-02-05 RpBERT: A Text-image Relation Propagation-based BERT Model for Multimodal NER    Lin Sun, Jiquan Wang, Kai Zhang, Yindu Su, Fangsheng Weng arXiv_CL arXiv_CL  Recognition  Bert  Pose  Relation  Attention  PDF
• 2021-02-03 Bootstrapping Multilingual AMR with Contextual Word Alignments    Janaki Sheth, Young-Suk Lee, Ramon Fernandez Astudillo, Tahira Naseem, Radu Florian, Salim Roukos, Todd Ward arXiv_AI arXiv_AI  Transformer  Embedding  Bert  Weakly_Supervised  PDF
• 2021-02-03 Neural Transfer Learning with Transformers for Social Science Text Analysis    Sandra Wankmüller arXiv_CL arXiv_CL  Transformer  Transfer_Learning  Bert  Deep_Learning  Prediction  PDF
• 2021-02-03 HeBERT & HebEMO: a Hebrew BERT Model and a Tool for Polarity Analysis and Emotion Recognition    Avihay Chriqui, Inbal Yahav arXiv_CL arXiv_CL  Transformer  Recognition  Bert  Pose  Emotion  Classification  Detection  Sentiment  Language_Model  PDF
• 2021-02-02 Clickbait Headline Detection in Indonesian News Sites using Multilingual Bidirectional Encoder Representations from Transformers    Muhammad N. Fakhruzzaman, Saidah Z. Jannah, Ratih A. Ningrum, Indah Fahmiyah arXiv_CL arXiv_CL  Transformer  Embedding  Bert  Text_Classification  Pose  Classification  Detection  Language_Model  PDF
• 2021-02-01 Generative Spoken Language Modeling from Raw Audio    Kushal Lakhotia, Evgeny Kharitonov, Wei-Ning Hsu, Yossi Adi, Adam Polyak, Benjamin Bolte, Tu-Anh Nguyen, Jade Copet, Alexei Baevski, Adelrahman Mohamed, Emmanuel Dupoux arXiv_CL arXiv_CL  Unsupervised  Bert  Zero-Shot  Speech  Language_Model  PDF
• 2021-02-01 Improving Distantly-Supervised Relation Extraction through BERT-based Label & Instance Embeddings    Despina Christou, Grigorios Tsoumakas arXiv_CL arXiv_CL  Transformer  Embedding  Bert  Pose  Action  Relation  Relation_Extraction  Attention  PDF
• 2021-02-01 SJ_AJ@DravidianLangTech-EACL2021: Task-Adaptive Pre-Training of Multilingual BERT models for Offensive Language Identification    Sai Muralidhar Jayanthi, Akshat Gupta arXiv_CL arXiv_CL  Bert  Language_Model  PDF
• 2021-02-01 Text-to-hashtag Generation using Seq2seq Learning    Augusto Camargo, Wesley Carvalho, Felipe Peressim arXiv_CL arXiv_CL  Bert  RNN  Review  Quantitative  PDF
• 2021-02-01 Metric-Type Identification for Multi-Level Header Numerical Tables in Scientific Papers    Lya Hulliyyatus Suadaa, Hidetaka Kamigaito, Manabu Okumura, Hiroya Takamura arXiv_CL arXiv_CL  Bert  Pose  Action  Classification  Caption  PDF
• 2021-02-01 Multilingual LAMA: Investigating Knowledge in Multilingual Pretrained Language Models    Nora Kassner, Philipp Dufter, Hinrich Schütze arXiv_CL arXiv_CL  Bert  Knowledge  Language_Model  Prediction  PDF
• 2021-02-01 Scaling Federated Learning for Fine-tuning of Large Language Models    Agrin Hilmkil, Sebastian Callh, Matteo Barbieri, Leon René Sütfeld, Edvin Listo Zec, Olof Mogren arXiv_CL arXiv_CL  Transformer  Bert  Text_Classification  Review  Classification  Sentiment  Language_Model  PDF
• 2021-02-01 Phoneme-BERT: Joint Language Modelling of Phoneme Sequence and ASR Transcript    Mukuntha Narayanan Sundararaman, Ayush Kumar, Jithendra Vepa arXiv_CL arXiv_CL  Bert  Pose  Classification  Sentiment  Language_Model  PDF
• 2021-02-01 Hierarchical Ranking for Answer Selection    Hang Gao, Mengting Hu, Renhong Cheng, Tiegang Gao arXiv_CL arXiv_CL  Bert  Optimization  Pose  QA  PDF
• 2021-01-31 Extending Neural Keyword Extraction with TF-IDF tagset matching    Boshko Koloski, Senja Pollak, Blaž Škrlj, Matej Martinc arXiv_CL arXiv_CL  Transformer  Unsupervised  Bert  RNN  Action  Recommendation  Matching  PDF
• 2021-01-30 Speech Recognition by Simply Fine-tuning BERT    Wen-Chin Huang, Chia-Hua Wu, Shang-Bao Luo, Kuan-Yu Chen, Hsin-Min Wang, Tomoki Toda arXiv_CL arXiv_CL  Recognition  Bert  Speech  Pose  Speech_Recognition  Language_Model  PDF
• 2021-01-30 EmpathBERT: A BERT-based Framework for Demographic-aware Empathy Prediction    Bhanu Prakash Reddy Guda, Aparna Garimella, Niyati Chhaya arXiv_CL arXiv_CL  Bert  Pose  Deep_Learning  Prediction  PDF
• 2021-01-30 ShufText: A Simple Black Box Approach to Evaluate the Fragility of Text Classification Models    Rutuja Taware, Shraddha Varat, Gaurav Salunke, Chaitanya Gawande, Geetanjali Kale, Rahul Khengare, Raviraj Joshi arXiv_CL arXiv_CL  Transformer  Bert  Text_Classification  RNN  Pose  Classification  Deep_Learning  Sentiment  Language_Model  PDF
• 2021-01-30 Learning From How Human Correct    Tong Guo arXiv_CL arXiv_CL  Bert  Text_Classification  Classification  Deep_Learning  PDF
• 2021-01-30 Adversarially learning disentangled speech representations for robust multi-factor voice conversion    Jie Wang, Jingbei Li, Xintao Zhao, Zhiyong Wu, Helen Meng arXiv_SD arXiv_SD  Style_Transfer  Bert  Represenation_Learning  Adversarial  Speech  Pose  Relation  Prediction  PDF
• 2021-01-29 NLPBK at VLSP-2020 shared task: Compose transformer pretrained models for Reliable Intelligence Identification on Social network    Thanh Chinh Nguyen, Van Nha Nguyen arXiv_CL arXiv_CL  Transformer  Bert  Pose  PDF
• 2021-01-29 Fine-tuning BERT-based models for Plant Health Bulletin Classification    Shufan Jiang (CRESTIC, ISEP), Rafael Angarita (ISEP), Stephane Cormier (CRESTIC), Francis Rousseaux (CRESTIC) arXiv_CL arXiv_CL  Transformer  Bert  Represenation_Learning  Knowledge  Pose  Classification  Deep_Learning  Language_Model  PDF
• 2021-01-28 BERTa'u: Ita'u BERT for digital customer service    Paulo Finardi, José Dié Viegas, Gustavo T. Ferreira, Alex F. Mansano, Vinicius F. Caridá arXiv_AI arXiv_AI  Bert  Pose  Face  Deep_Learning  Sentiment  Language_Model  QA  PDF
• 2021-01-28 Weakly Supervised Neuro-Symbolic Module Networks for Numerical Reasoning    Amrita Saha, Shafiq Joty, Steven C.H. Hoi arXiv_CL arXiv_CL  Reinforcement_Learning  Bert  Weakly_Supervised  Pose  Action  Language_Model  Matching  PDF
• 2021-01-27 Dexterous Manipulation Primitives for the Real Robot Challenge    Claire Chen, Krishnan Srinivasan, Jeffrey Zhang, Junwu Zhang arXiv_RO arXiv_RO  Bert  Optimization  Pose  PDF
• 2021-01-27 Scheduled Sampling in Vision-Language Pretraining with Decoupled Encoder-Decoder Network    Yehao Li, Yingwei Pan, Ting Yao, Jingwen Chen, Tao Mei arXiv_CV arXiv_CV  Bert  Pose  GAN  PDF
• 2021-01-27 On the Evolution of Syntactic Information Encoded by BERT's Contextualized Representations    Laura Perez-Mayos, Roberto Carlini, Miguel Ballesteros, Leo Wanner arXiv_CL arXiv_CL  Bert  Knowledge  Language_Model  PDF
• 2021-01-27 KoreALBERT: Pretraining a Lite BERT Model for Korean Language Understanding    Hyunjae Lee, Jaewoong Yoon, Bonggyu Hwang, Seongho Joe, Seungjai Min, Youngjune Gwon arXiv_CL arXiv_CL  Bert  Represenation_Learning  Prediction  PDF
• 2021-01-26 CLiMP: A Benchmark for Chinese Language Model Evaluation    Beilei Xiang, Changbing Yang, Yu Li, Alex Warstadt, Katharina Kann arXiv_CL arXiv_CL  Bert  RNN  Knowledge  Language_Model  PDF
• 2021-01-26 Named Entity Recognition in the Style of Object Detection    Bing Li arXiv_CL arXiv_CL  Recognition  Bert  Pose  Detection  Object_Detection  Prediction  PDF
• 2021-01-26 Cross-Lingual Named Entity Recognition Using Parallel Corpus: A New Approach Using XLM-RoBERTa Alignment    Bing Li, Yujie He, Wenjin Xu arXiv_CL arXiv_CL  Unsupervised  Recognition  Bert  Zero-Shot  Pose  PDF
• 2021-01-26 First Align, then Predict: Understanding the Cross-Lingual Ability of Multilingual BERT    Benjamin Muller, Yanai Elazar, Benoît Sagot, Djamé Seddah arXiv_CL arXiv_CL  Bert  Zero-Shot  Language_Model  PDF
• 2021-01-26 Deep Subjecthood: Higher-Order Grammatical Features in Multilingual BERT    Isabel Papadimitriou, Ethan A. Chi, Richard Futrell, Kyle Mahowald arXiv_CL arXiv_CL  Embedding  Bert  Zero-Shot  Pose  Action  Classification  PDF
• 2021-01-26 Muppet: Massive Multi-task Representations with Pre-Finetuning    Armen Aghajanyan, Anchit Gupta, Akshat Shrivastava, Xilun Chen, Luke Zettlemoyer, Sonal Gupta arXiv_CL arXiv_CL  Bert  Pose  Language_Model  Prediction  PDF
• 2021-01-26 Attention Can Reflect Syntactic Structure    Vinit Ravishankar, Artur Kulmizev, Mostafa Abdou, Anders Søgaard, Joakim Nivre arXiv_CL arXiv_CL  Transformer  Bert  Pose  Relation  Attention  PDF
• 2021-01-26 Regulatory Compliance through Doc2Doc Information Retrieval: A case study in EU/UK legislation where text similarity has limitations    Ilias Chalkidis, Manos Fergadiotis, Nikolaos Manginas, Eva Katakalou, Prodromos Malakasiotis arXiv_CL arXiv_CL  Bert  Classification  Relation  GAN  PDF
• 2021-01-26 Analyzing Zero-shot Cross-lingual Transfer in Supervised NLP Tasks    Hyunjin Choi, Judong Kim, Seongho Joe, Seungjai Min, Youngjune Gwon arXiv_AI arXiv_AI  Transformer  Embedding  Bert  Zero-Shot  Sentiment  Language_Model  PDF
• 2021-01-26 Evaluation of BERT and ALBERT Sentence Embedding Performance on Downstream NLP Tasks    Hyunjin Choi, Judong Kim, Seongho Joe, Youngjune Gwon arXiv_AI arXiv_AI  Embedding  Bert  Inference  Language_Model  PDF
• 2021-01-25 A Hybrid Approach to Measure Semantic Relatedness in Biomedical Concepts    Katikapalli Subramanyam Kalyan, Sivanesan Sangeetha arXiv_CL arXiv_CL  Bert  Knowledge  Ontology  Relation  Medical  PDF
• 2021-01-25 Scaffolded Gait Learning of a Quadruped Robot with Bayesian Optimization    Keyan Zhai, Chu'an Li, Andre Rosendo arXiv_RO arXiv_RO  Bert  Optimization  Pose  Relation  Contour  PDF
• 2021-01-25 EGFI: Drug-Drug Interaction Extraction and Generation with Fusion of Enriched Entity and Sentence Information    Lei Huang, Jiecong Lin, Xiangtao Li, Linqi Song, Ka-Chun Wong arXiv_CL arXiv_CL  Bert  Knowledge  Pose  Action  Classification  Relation  Attention  Medical  Language_Model  PDF
• 2021-01-24 RomeBERT: Robust Training of Multi-Exit BERT    Shijie Geng, Peng Gao, Zuohui Fu, Yongfeng Zhang arXiv_CL arXiv_CL  Bert  Pose  Inference  PDF
• 2021-01-24 Stereotype and Skew: Quantifying Gender Bias in Pre-trained and Fine-tuned Language Models    Daniel de Vassimon Manela, David Errington, Thomas Fisher, Boris van Breugel, Pasquale Minervini arXiv_AI arXiv_AI  Bert  Pose  Relation  Language_Model  PDF
• 2021-01-24 Does Dialog Length matter for Next Response Selection task? An Empirical Study    Jatin Ganhotra, Sachindra Joshi arXiv_CL arXiv_CL  Transformer  Bert  Attention  PDF
• 2021-01-24 WangchanBERTa: Pretraining transformer-based Thai Language Models    Lalita Lowphansirikul, Charin Polpanumas, Nawat Jantrakulchai, Sarana Nutanong arXiv_CL arXiv_CL  Transformer  Bert  Classification  Language_Model  PDF
• 2021-01-23 Training Multilingual Pre-trained Language Model with Byte-level Subwords    Junqiu Wei, Qun Liu, Yinpeng Guo, Xin Jiang arXiv_CL arXiv_CL  Bert  Language_Model  PDF
• 2021-01-22 BERT Transformer model for Detecting Arabic GPT2 Auto-Generated Tweets    Fouzi Harrag, Maria Debbah, Kareem Darwish, Ahmed Abdelali arXiv_CL arXiv_CL  Transformer  Embedding  Transfer_Learning  Bert  RNN  Knowledge  Pose  Language_Model  PDF
• 2021-01-22 Drug and Disease Interpretation Learning with Biomedical Entity Representation Transformer    Zulfat Miftahutdinov, Artur Kadurin, Roman Kudrin, Elena Tutubalina arXiv_CL arXiv_CL  Transformer  Embedding  Bert  Zero-Shot  Knowledge  Pose  Medical  PDF
• 2021-01-22 Extracting Lifestyle Factors for Alzheimer's Disease from Clinical Notes Using Deep Learning with Weak Supervision    Zitao Shen (1), Yoonkwon Yi (1), Anusha Bompelli (2), Fang Yu (3), Yanshan Wang (4), Rui Zhang (2 and 5) ((1) College of Science & Engineering, University of Minnesota, (2) Department of Pharmaceutical Care & Health Systems, University of Minnesota, (3) Edson College of Nursing and Health Innovation, Arizona State University, (4) Department of AI & Informatics, Mayo Clinic, (5) Institute for Health Informatics, University of Minnesota) arXiv_CL arXiv_CL  Transformer  Bert  Pose  Deep_Learning  Medical  Activity  PDF
• 2021-01-22 The heads hypothesis: A unifying statistical approach towards understanding multi-headed attention in BERT    Madhura Pande, Aakriti Budhraja, Preksha Nema, Pratyush Kumar, Mitesh M. Khapra arXiv_AI arXiv_AI  Transformer  Bert  Pose  Classification  Relation  Attention  Inference  PDF
• 2021-01-22 A multi-perspective combined recall and rank framework for Chinese procedure terminology normalization    Ming Liang, Kui Xue, Tong Ruan arXiv_CL arXiv_CL  Bert  Knowledge  Pose  Classification  Medical  PDF
• 2021-01-22 AdaBERT: Task-Adaptive BERT Compression with Differentiable Neural Architecture Search    Daoyuan Chen, Yaliang Li, Minghui Qiu, Zhen Wang, Bofang Li, Bolin Ding, Hongbo Deng, Jun Huang, Wei Lin, Jingren Zhou arXiv_CL arXiv_CL  NAS  Bert  Knowledge  Pose  Inference  Language_Model  PDF
• 2021-01-22 Multilingual Pre-Trained Transformers and Convolutional NN Classification Models for Technical Domain Identification    Suman Dowlagar, Radhika Mamidi arXiv_CL arXiv_CL  Transformer  Transfer_Learning  Bert  Text_Classification  Classification  CNN  PDF
• 2021-01-22 HASOCOne@FIRE-HASOC2020: Using BERT and Multilingual BERT models for Hate Speech Detection    Suman Dowlagar, Radhika Mamidi arXiv_CL arXiv_CL  Transfer_Learning  Bert  Speech  Pose  Detection  PDF
• 2021-01-21 Distilling Large Language Models into Tiny and Effective Students using pQRNN    Prabhu Kaliamoorthi, Aditya Siddhant, Edward Li, Melvin Johnson arXiv_AI arXiv_AI  Transformer  Embedding  Bert  RNN  Pose  Language_Model  PDF
• 2021-01-21 Generative Autoencoder Kernels on Deep Learning for Brain Activity Analysis    Gokhan Altan, Yakup Kutlu arXiv_AI arXiv_AI  Unsupervised  Bert  Optimization  Pose  Classification  Deep_Learning  Activity  PDF
• 2021-01-21 Analysis of Basic Emotions in Texts Based on BERT Vector Representation    A. Artemov, A. Veselovskiy, I. Khasenevich, I. Bolokhov arXiv_CL arXiv_CL  Bert  Emotion  GAN  PDF
• 2021-01-21 ParaSCI: A Large Scientific Paraphrase Dataset for Longer Paraphrase Generation    Qingxiu Dong, Xiaojun Wan, Yue Cao arXiv_CL arXiv_CL  Bert  Pose  PDF
• 2021-01-21 Evaluating Multilingual Text Encoders for Unsupervised Cross-Lingual Retrieval    Robert Litschko, Ivan Vulić, Simone Paolo Ponzetto, Goran Glavaš arXiv_CL arXiv_CL  Transformer  Embedding  Unsupervised  Bert  Represenation_Learning  Pose  PDF
• 2021-01-20 The Diagnosis of Asthma using Hilbert-Huang Transform and Deep Learning on Lung Sounds    Gökhan Altan, Yakup Kutlu, Adnan Özhan Pekmezci, Serkan Nural arXiv_SD arXiv_SD  Bert  Pose  Classification  Deep_Learning  PDF
• 2021-01-20 Classifying Scientific Publications with BERT -- Is Self-Attention a Feature Selection Method?    Andres Garcia-Silva, Jose Manuel Gomez-Perez arXiv_AI arXiv_AI  Transformer  Bert  Text_Classification  Classification  Attention  PDF
• 2021-01-20 Learning to Augment for Data-Scarce Domain BERT Knowledge Distillation    Lingyun Feng, Minghui Qiu, Yaliang Li, Hai-Tao Zheng, Ying Shen arXiv_CL arXiv_CL  Bert  Knowledge  Pose  Language_Model  PDF
• 2021-01-20 Divide and Conquer: An Ensemble Approach for Hostile Post Detection in Hindi    Varad Bhatnagar, Prince Kumar, Sairam Moghili, Pushpak Bhattacharyya arXiv_CL arXiv_CL  Bert  Pose  Face  Classification  Detection  PDF
• 2021-01-20 WeChat AI's Submission for DSTC9 Interactive Dialogue Evaluation Track    Zekang Li, Zongjia Li, Jinchao Zhang, Yang Feng, Jie Zhou arXiv_AI arXiv_AI  Bert  Knowledge  Pose  Action  Language_Model  PDF
• 2021-01-19 Situation and Behavior Understanding by Trope Detection on Films    Chen-Hsi Chang, Hung-Ting Su, Juiheng Hsu, Yu-Siang Wang, Yu-Cheng Chang, Zhe Yu Liu, Ya-Liang Chang, Wen-Feng Cheng, Ke-Jyun Wang, Winston H. Hsu arXiv_AI arXiv_AI  Embedding  Bert  Deep_Learning  Detection  Relation  Attention  Inference  Prediction  PDF
• 2021-01-18 Automatic punctuation restoration with BERT models    Attila Nagy, Bence Bial, Judit Ács arXiv_CL arXiv_CL  Bert  Restoration  PDF
• 2021-01-18 Can a Fruit Fly Learn Word Embeddings?    Yuchen Liang, Chaitanya K. Ryali, Benjamin Hoover, Leopold Grinberg, Saket Navlakha, Mohammed J. Zaki, Dmitry Krotov arXiv_CL arXiv_CL  Embedding  Bert  Sparse  Action  Classification  Relation  PDF
• 2021-01-18 Joint Energy-based Model Training for Better Calibrated Natural Language Understanding Models    Tianxing He, Bryan McCann, Caiming Xiong, Ehsan Hosseini-Asl arXiv_AI arXiv_AI  Bert  Language_Model  PDF
• 2021-01-17 Fusing Wav2vec2.0 and BERT into End-to-end Model for Low-resource Speech Recognition    Cheng Yi, Shiyu Zhou, Bo Xu arXiv_CL arXiv_CL  Recognition  Bert  Speech  Self-Supervised  Pose  Attention  Speech_Recognition  PDF
• 2021-01-16 Transformer-Based Models for Question Answering on COVID19    Hillary Ngai, Yoona Park, John Chen, Mahboobeh Parsapoor (Mah Parsa) arXiv_CL arXiv_CL  Transformer  Bert  Pose  QA  PDF
• 2021-01-15 Grid Search Hyperparameter Benchmarking of BERT, ALBERT, and LongFormer on DuoRC    Alex John Quijano, Sam Nguyen, Juanita Ordonez arXiv_CL arXiv_CL  Bert  Pose  Face  Language_Model  PDF
• 2021-01-15 TextGNN: Improving Text Encoder via Graph Neural Network in Sponsored Search    Jason Zhu, Yanling Cui, Yuming Liu, Hao Sun, Xue Li, Markus Pelger, Liangjie Zhang, Tianqi Yan, Ruofei Zhang, Huasha Zhao arXiv_CL arXiv_CL  Transformer  Bert  Pose  PDF
• 2021-01-15 Walk in Wild: An Ensemble Approach for Hostility Detection in Hindi Posts    Chander Shekhar, Bhavya Bagla, Kaushal Kumar Maurya, Maunendra Sankar Desarkar arXiv_CL arXiv_CL  Bert  Pose  Classification  Detection  PDF
• 2021-01-15 Hostility Detection and Covid-19 Fake News Detection in Social Media    Ayush Gupta, Rohan Sukumaran, Kevin John, Sundeep Teki arXiv_AI arXiv_AI  Embedding  Bert  Detection  Object_Detection  PDF
• 2021-01-15 KDLSQ-BERT: A Quantized Bert Combining Knowledge Distillation with Learned Step Size Quantization    Jing Jin, Cai Liang, Tiancheng Wu, Liqin Zou, Zhiliang Gan arXiv_AI arXiv_AI  Transformer  Quantization  Bert  Knowledge  Pose  Inference  Language_Model  PDF
• 2021-01-14 Stacked DeBERT: All Attention in Incomplete Data for Text Classification    Gwenaelle Cunha Sergio, Minho Lee arXiv_CL arXiv_CL  Transformer  Reconstruction  Embedding  Bert  Text_Classification  Speech  Pose  Classification  Sentiment  Denoising  Attention  QA  PDF
• 2021-01-14 Estimation of the Frequency of Occurrence of Italian Phonemes in Text    Javi Arango, Alex DeCaprio, Sunwoo Baik, Luca De Nardis, Stefanie Shattuck-Hufnagel, Maria Gabriella Di Benedetto arXiv_SD arXiv_SD  Bert  Pose  PDF
• 2021-01-14 Transformer-based Language Model Fine-tuning Methods for COVID-19 Fake News Detection    Ben Chen, Bin Chen, Dehong Gao, Qijin Chen, Chengfu Huo, Xiaonan Meng, Weijun Ren, Yang Zhou arXiv_AI arXiv_AI  Transformer  OCR  Bert  Knowledge  Adversarial  Pose  Quantitative  Detection  Language_Model  PDF
• 2021-01-14 ECOL: Early Detection of COVID Lies Using Content, Prior Knowledge and Source Information    Ipek Baris, Zeyd Boukhers arXiv_CL arXiv_CL  Bert  Knowledge  Pose  Detection  Language_Model  PDF
• 2021-01-14 WER-BERT: Automatic WER Estimation with BERT in a Balanced Ordinal Classification Paradigm    Akshay Krishna Sheshadri, Anvesh Rao Vijjini, Sukhdeep Kharbanda arXiv_CL arXiv_CL  Recognition  Bert  Speech  Pose  Classification  Speech_Recognition  PDF
• 2021-01-13 Coarse and Fine-Grained Hostility Detection in Hindi Posts using Fine Tuned Multilingual Embeddings    Arkadipta De, Venkatesh E, Kaushal Kumar Maurya, Maunendra Sankar Desarkar arXiv_CL arXiv_CL  Transformer  Embedding  Bert  Pose  Face  Classification  Detection  PDF
• 2021-01-13 LaDiff ULMFiT: A Layer Differentiated training approach for ULMFiT    Mohammed Azhan, Mohammad Ahmad arXiv_CL arXiv_CL  Bert  Pose  Deep_Learning  Detection  PDF
• 2021-01-13 Experimental Evaluation of Deep Learning models for Marathi Text Classification    Atharva Kulkarni, Meet Mandhane, Manali Likhitkar, Gayatri Kshirsagar, Jayashree Jagdale, Raviraj Joshi arXiv_CL arXiv_CL  Embedding  Bert  Text_Classification  RNN  Classification  Deep_Learning  Attention  PDF
• 2021-01-12 Of Non-Linearity and Commutativity in BERT    Sumu Zhao, Damian Pascual, Gino Brunner, Roger Wattenhofer arXiv_AI arXiv_AI  Transformer  Bert  Pose  Action  Attention  PDF
• 2021-01-12 Quantum Cognitively Motivated Decision Fusion for Video Sentiment Analysis    Dimitris Gkoumas, Qiuchi Li, Shahram Dehdashti, Massimo Melucci, Yijun Yu, Dawei Song arXiv_AI arXiv_AI  Bert  Pose  Sentiment  PDF
• 2021-01-12 On the Calibration and Uncertainty of Neural Learning to Rank Models    Gustavo Penha, Claudia Hauff arXiv_CL arXiv_CL  Bert  Pose  PDF
• 2021-01-12 Neural Contract Element Extraction Revisited    Ilias Chalkidis, Manos Fergadiotis, Prodromos Malakasiotis, Ion Androutsopoulos arXiv_CL arXiv_CL  Transformer  Embedding  Bert  RNN  Action  Language_Model  PDF
• 2021-01-11 BERT-GT: Cross-sentence n-ary relation extraction with BERT and Graph Transformer    Po-Ting Lai, Zhiyong Lu arXiv_CL arXiv_CL  Transformer  Bert  RNN  Pose  Action  Relation  Relation_Extraction  Attention  Medical  PDF
• 2021-01-11 Automating the Compilation of Potential Core-Outcomes for Clinical Trials    Shwetha Bharadwaj, Melanie Laffin arXiv_CL arXiv_CL  Embedding  Unsupervised  Bert  Classification  PDF
• 2021-01-11 A More Efficient Chinese Named Entity Recognition base on BERT and Syntactic Analysis    Xiao Fu, Guijun Zhang arXiv_CL arXiv_CL  Transformer  Segmentation  Recognition  Bert  Speech  Pose  PDF
• 2021-01-11 AT-BERT: Adversarial Training BERT for Acronym Identification Winning Solution for SDU@AAAI-21    Danqing Zhu, Wangli Lin, Yang Zhang, Qiwei Zhong, Guanxiong Zeng, Weilin Wu, Jiayu Tang arXiv_CL arXiv_CL  Unsupervised  Bert  Adversarial  Pose  Language_Model  PDF
• 2021-01-10 Cisco at AAAI-CAD21 shared task: Predicting Emphasis in Presentation Slides using Contextualised Embeddings    Sreyan Ghosh, Sonal Kumar, Harsh Jalan, Hemant Yadav, Rajiv Ratn Shah arXiv_CL arXiv_CL  Transformer  Embedding  Bert  RNN  Pose  PDF
• 2021-01-10 Detecting Hostile Posts using Relational Graph Convolutional Network    Sarthak, Shikhar Shukla, Govind Mittal, Karm Veer Arya arXiv_AI arXiv_AI  Bert  Pose  Classification  Detection  Relation  CNN  PDF
• 2021-01-10 BERT & Family Eat Word Salad: Experiments with Text Understanding    Ashim Gupta, Giorgi Kvernadze, Vivek Srikumar arXiv_AI arXiv_AI  Bert  Prediction  PDF
• 2021-01-09 Learning Better Sentence Representation with Syntax Information    Chen Yang (University of Science and Technology of China) arXiv_CL arXiv_CL  Transformer  Bert  Text_Classification  RNN  Knowledge  Pose  Action  Classification  Relation  Sentiment  Relation_Extraction  Language_Model  PDF
• 2021-01-08 Misspelling Correction with Pre-trained Contextual Language Model    Yifei Hu, Xiaonan Jing, Youlim Ko, Julia Taylor Rayz arXiv_CL arXiv_CL  Embedding  Bert  Adversarial  Language_Model  PDF
• 2021-01-08 Contextual Non-Local Alignment over Full-Scale Representation for Text-Based Person Search    Chenyang Gao, Guanyu Cai, Xinyang Jiang, Feng Zheng, Jun Zhang, Yifei Gong, Pai Peng, Xiaowei Guo, Xing Sun arXiv_CV arXiv_CV  Bert  Pose  Attention  PDF
• 2021-01-07 Homonym Identification using BERT -- Using a Clustering Approach    Rohan Saha arXiv_CL arXiv_CL  Embedding  Bert  Pose  Language_Model  PDF
• 2021-01-07 Exploring Text-transformers in AAAI 2021 Shared Task: COVID-19 Fake News Detection in English    Xiangyang Li, Yu Xia, Xiang Long, Zheng Li, Sujian Li arXiv_AI arXiv_AI  Transformer  Bert  Pose  Detection  Language_Model  PDF
• 2021-01-07 Applying Transfer Learning for Improving Domain-Specific Search Experience Using Query to Question Similarity    Ankush Chopra, Shruti Agrawal, Sohom Ghosh arXiv_CL arXiv_CL  Embedding  Transfer_Learning  Bert  RNN  Language_Model  QA  PDF
• 2021-01-06 EfficientQA : a RoBERTa Based Phrase-Indexed Question-Answering System    Sofian Chaybouti arXiv_CL arXiv_CL  Bert  Language_Model  QA  PDF
• 2021-01-05 PhoNLP: A joint multi-task learning model for Vietnamese part-of-speech tagging, named entity recognition and dependency parsing    Linh The Nguyen, Dat Quoc Nguyen arXiv_CL arXiv_CL  Recognition  Bert  Speech  Language_Model  PDF
• 2021-01-05 I-BERT: Integer-only BERT Quantization    Sehoon Kim, Amir Gholami, Zhewei Yao, Michael W. Mahoney, Kurt Keutzer arXiv_CL arXiv_CL  Transformer  Quantization  Bert  Pose  Inference  PDF
• 2021-01-04 Transformers and Transfer Learning for Improving Portuguese Semantic Role Labeling    Sofia Oliveira, Daniel Loureiro, Alípio Jorge arXiv_CL arXiv_CL  Transformer  Transfer_Learning  Bert  Pose  PDF
• 2021-01-04 Improving reference mining in patents with BERT    Ken Voskuil, Suzan Verberne arXiv_CL arXiv_CL  Bert  Pose  Relation  PDF
• 2021-01-04 A Joint Training Dual-MRC Framework for Aspect Based Sentiment Analysis    Yue Mao, Yi Shen, Chao Yu, Longjun Cai arXiv_AI arXiv_AI  Bert  Sentiment_Classification  Pose  Action  Classification  Sentiment  PDF
• 2021-01-02 Baleen: Robust Multi-Hop Reasoning at Scale via Condensed Retrieval    Omar Khattab, Christopher Potts, Matei Zaharia arXiv_CL arXiv_CL  Bert  Knowledge  Pose  Action  PDF
• 2021-01-02 Superbizarre Is Not Superb: Improving BERT's Interpretations of Complex Words with Derivational Morphology    Valentin Hofmann, Janet B. Pierrehumbert, Hinrich Schütze arXiv_CL arXiv_CL  Segmentation  Bert  Language_Model  PDF
• 2021-01-02 Lex-BERT: Enhancing BERT based NER with lexicons    Wei Zhu, Daniel Cheung arXiv_CL arXiv_CL  Transformer  Embedding  Recognition  Bert  PDF
• 2021-01-02 What all do audio transformer models hear? Probing Acoustic Representations for Language Delivery and its Structure    Jui Shah, Yaman Kumar Singla, Changyou Chen, Rajiv Ratn Shah arXiv_CL arXiv_CL  Transformer  Embedding  Bert  Speech  Face  PDF
• 2021-01-02 Modeling Fine-Grained Entity Types with Box Embeddings    Yasumasa Onoe, Michael Boratko, Greg Durrett arXiv_AI arXiv_AI  Embedding  Bert  Ontology  Face  Relation  Prediction  PDF
• 2021-01-01 BanglaBERT: Combating Embedding Barrier for Low-Resource Language Understanding    Abhik Bhattacharjee, Tahmid Hasan, Kazi Samin, M. Sohel Rahman, Anindya Iqbal, Rifat Shahriyar arXiv_CL arXiv_CL  Embedding  Bert  Self-Supervised  Classification  Language_Model  PDF
• 2021-01-01 On Explaining Your Explanations of BERT: An Empirical Study with Sequence Classification    Zhengxuan Wu, Desmond C. Ong arXiv_CL arXiv_CL  Bert  Pose  Classification  Sentiment  Attention  Language_Model  PDF
• 2021-01-01 Transformer based Automatic COVID-19 Fake News Detection System    Sunil Gundapu, Radhika Mamid arXiv_CL arXiv_CL  Transformer  Bert  Detection  PDF
• 2020-12-31 EarlyBERT: Efficient BERT Training via Early-bird Lottery Tickets    Xiaohan Chen, Yu Cheng, Shuohang Wang, Zhe Gan, Zhangyang Wang, Jingjing Liu arXiv_AI arXiv_AI  Bert  Pose  Inference  Language_Model  PDF
• 2020-12-31 KART: Privacy Leakage Framework of Language Models Pre-trained with Clinical Records    Yuta Nakamura (1 and 2), Shouhei Hanaoka (3), Yukihiro Nomura (4), Naoto Hayashi (4), Osamu Abe (1 and 3), Shuntaro Yada (2), Shoko Wakamiya (2), Eiji Aramaki (2) ((1) The University of Tokyo, (2) Nara Institute of Science and Technology, (3) The Department of Radiology, The University of Tokyo Hospital, (4) The Department of Computational Diagnostic Radiology and Preventive Medicine, The University of Tokyo Hospital) arXiv_CL arXiv_CL  Bert  Knowledge  Medical  Language_Model  PDF
• 2020-12-31 MiniLMv2: Multi-Head Self-Attention Relation Distillation for Compressing Pretrained Transformers    Wenhui Wang, Hangbo Bao, Shaohan Huang, Li Dong, Furu Wei arXiv_CL arXiv_CL  Transformer  Bert  Knowledge  Action  Relation  Attention  PDF
• 2020-12-31 Conditional Generation of Temporally-ordered Event Sequences    Shih-Ting Lin, Nathanael Chambers, Greg Durrett arXiv_CL arXiv_CL  Bert  Knowledge  Relation  Denoising  Inference  PDF
• 2020-12-31 BinaryBERT: Pushing the Limit of BERT Quantization    Haoli Bai, Wei Zhang, Lu Hou, Lifeng Shang, Jing Jin, Xin Jiang, Qun Liu, Michael Lyu, Irwin King arXiv_CL arXiv_CL  Quantization  Bert  Pose  Language_Model  PDF
• 2020-12-31 Better Robustness by More Coverage: Adversarial Training with Mixup Augmentation for Robust Fine-tuning    Chenglei Si, Zhengyan Zhang, Fanchao Qi, Zhiyuan Liu, Yasheng Wang, Qun Liu, Maosong Sun arXiv_CL arXiv_CL  Bert  Text_Classification  Adversarial  Pose  Classification  Language_Model  PDF
• 2020-12-31 CoCoLM: COmplex COmmonsense Enhanced Language Model    Changlong Yu, Hongming Zhang, Yangqiu Song, Wilfred Ng arXiv_CL arXiv_CL  Bert  Knowledge  Knowledge_Graph  Pose  Relation  Language_Model  PDF
• 2020-12-31 UNKs Everywhere: Adapting Multilingual Language Models to New Scripts    Jonas Pfeiffer, Ivan Vulić, Iryna Gurevych, Sebastian Ruder arXiv_CL arXiv_CL  Embedding  Bert  Knowledge  Pose  Language_Model  PDF
• 2020-12-31 Linear-Time WordPiece Tokenization    Xinying Song, Alex Salcianu, Yang Song, Dave Dopson, Denny Zhou arXiv_CL arXiv_CL  Bert  Knowledge  Pose  Face  Inference  Matching  PDF
• 2020-12-31 An Experimental Evaluation of Transformer-based Language Models in the Biomedical Domain    Paul Grouchy, Shobhit Jain, Michael Liu, Kuhan Wang, Max Tian, Nidhi Arora, Hillary Ngai, Faiza Khan Khattak, Elham Dolatabadi, Sedef Akinli Kocak arXiv_CL arXiv_CL  Transformer  Bert  Medical  Language_Model  QA  PDF
• 2020-12-31 Unified Mandarin TTS Front-end Based on Distilled BERT Model    Yang Zhang, Liqun Deng, Yasheng Wang arXiv_CL arXiv_CL  Bert  Knowledge  Speech  Pose  Language_Model  Prediction  PDF
• 2020-12-30 Optimizing Deeper Transformers on Small Datasets: An Application on Text-to-SQL Semantic Parsing    Peng Xu, Wei Yang, Wenjie Zi, Keyi Tang, Chengyang Huang, Jackie Chi Kit Cheung, Yanshuai Cao arXiv_CL arXiv_CL  Transformer  Bert  Relation  Prediction  PDF
• 2020-12-30 Deriving Contextualised Semantic Features from BERT Embeddings    Jacob Turton, David Vinson, Robert Elliott Smith arXiv_CL arXiv_CL  Transformer  Embedding  Bert  Pose  PDF
• 2020-12-30 Unnatural Language Inference    Koustuv Sinha, Prasanna Parthasarathi, Joelle Pineau, Adina Williams arXiv_CL arXiv_CL  Transformer  Bert  Pose  Inference  PDF
• 2020-12-30 DEER: A Data Efficient Language Model for Event Temporal Reasoning    Rujun Han, Xiang Ren, Nanyun Peng arXiv_CL arXiv_CL  Bert  Knowledge  Pose  Action  Relation  Language_Model  PDF
• 2020-12-30 SemGloVe: Semantic Co-occurrences for GloVe from BERT    Leilei Gan, Zhiyang Teng, Yue Zhang, Linchao Zhu, Fei Wu, Yi Yang arXiv_AI arXiv_AI  Embedding  Bert  Pose  Attention  Language_Model  PDF
• 2020-12-30 Out of Order: How important is the sequential order of words in a sentence in Natural Language Understanding tasks?    Thang M. Pham, Trung Bui, Long Mai, Anh Nguyen arXiv_AI arXiv_AI  Embedding  Bert  Sentiment  Inference  Prediction  PDF
• 2020-12-30 Improving BERT with Syntax-aware Local Attention    Zhongli Li, Qingyu Zhou, Chao Li, Ke Xu, Yunbo Cao arXiv_CL arXiv_CL  Transformer  Bert  Pose  Classification  Attention  Language_Model  PDF
• 2020-12-30 Enhancing Pre-trained Language Model with Lexical Simplification    Rongzhou Bao, Jiayi Wang, Zhuosheng Zhang, Hai Zhao arXiv_CL arXiv_CL  Bert  Text_Classification  Pose  Classification  Language_Model  PDF
• 2020-12-29 CMV-BERT: Contrastive multi-vocab pretraining of BERT    Wei Zhu, Daniel Cheung arXiv_CL arXiv_CL  Bert  Pose  Contrastive_Learning  Language_Model  PDF
• 2020-12-29 Accelerating Pre-trained Language Models via Calibrated Cascade    Lei Li, Yankai Lin, Shuhuai Ren, Deli Chen, Xuancheng Ren, Peng Li, Jie Zhou, Xu Sun arXiv_CL arXiv_CL  Bert  Knowledge  Pose  Inference  Language_Model  Prediction  PDF
• 2020-12-28 A Paragraph-level Multi-task Learning Model for Scientific Fact-Verification    Xiangci Li, Gully Burns, Nanyun Peng arXiv_CL arXiv_CL  Embedding  Bert  Pose  Prediction  PDF
• 2020-12-28 DeepHateExplainer: Explainable Hate Speech Detection in Under-resourced Bengali Language    Md. Rezaul Karim, Sumon Kanti Dey, Bharathi Raja Chakravarthi arXiv_CL arXiv_CL  Transformer  Embedding  Bert  RNN  Speech  Pose  Detection  PDF
• 2020-12-28 BURT: BERT-inspired Universal Representation from Learning Meaningful Segment    Yian Li, Hai Zhao arXiv_CL arXiv_CL  Embedding  Bert  Represenation_Learning  Language_Model  Matching  PDF
• 2020-12-28 Action Recognition with Kernel-based Graph Convolutional Networks    Hichem Sahbi arXiv_CV arXiv_CV  Recognition  Bert  Pose  Action_Recognition  Action  Deep_Learning  CNN  PDF
• 2020-12-28 Syntax-Enhanced Pre-trained Model    Zenan Xu, Daya Guo, Duyu Tang, Qinliang Su, Linjun Shou, Ming Gong, Wanjun Zhong, Xiaojun Quan, Nan Duan, Daxin Jiang arXiv_CL arXiv_CL  Transformer  Bert  Classification  Relation  Attention  PDF
• 2020-12-27 ALP-KD: Attention-Based Layer Projection for Knowledge Distillation    Peyman Passban, Yimeng Wu, Mehdi Rezagholizadeh, Qun Liu arXiv_CL arXiv_CL  Bert  Knowledge  Pose  Attention  Prediction  PDF
• 2020-12-27 ARBERT & MARBERT: Deep Bidirectional Transformers for Arabic    Muhammad Abdul-Mageed, AbdelRahim Elmadany, El Moatez Billah Nagoudi arXiv_CL arXiv_CL  Transformer  Bert  Pose  Classification  Language_Model  PDF
• 2020-12-27 An Embarrassingly Simple Model for Dialogue Relation Extraction    Fuzhao Xue, Aixin Sun, Hao Zhang, Eng Siong Chng arXiv_CL arXiv_CL  Bert  Pose  Action  Classification  Relation  Relation_Extraction  PDF
• 2020-12-27 Inserting Information Bottlenecks for Attribution in Transformers    Zhiying Jiang, Raphael Tang, Ji Xin, Jimmy Lin arXiv_CL arXiv_CL  Transformer  Bert  Quantitative  Prediction  PDF
• 2020-12-26 Learning Inter- and Intra-frame Representations for Non-Lambertian Photometric Stereo    Yanlong Cao, Binjie Ding, Zewei He, Jiangxin Yang, Jingxi Chen, Yanpeng Cao, Xin Li arXiv_CV arXiv_CV  Bert  Sparse  Pose  Face  Action  CNN  PDF
• 2020-12-25 Fine-grained Emotion and Intent Learning in Movie Dialogues    Anuradha Welivita, Yubo Xie, Pearl Pu arXiv_CL arXiv_CL  Bert  Pose  Emotion  Action  Classification  PDF
• 2020-12-24 To what extent do human explanations of model behavior align with actual model behavior?    Grusha Prasad, Yixin Nie, Mohit Bansal, Robin Jia, Douwe Kiela, Adina Williams arXiv_CL arXiv_CL  Transformer  Bert  Survey  Inference  PDF
• 2020-12-24 Co-GAT: A Co-Interactive Graph Attention Network for Joint Dialog Act Recognition and Sentiment Classification    Libo Qin, Zhouyang Li, Wanxiang Che, Minheng Ni, Ting Liu arXiv_CL arXiv_CL  Recognition  Bert  Sentiment_Classification  Pose  Action  Classification  Sentiment  Attention  PDF
• 2020-12-24 Sentence-Based Model Agnostic NLP Interpretability    Yves Rychener, Xavier Renard, Djamé Seddah, Pascal Frossard, Marcin Detyniecki arXiv_CL arXiv_CL  Bert  PDF
• 2020-12-23 Detecting Hate Speech in Memes Using Multimodal Deep Learning Approaches: Prize-winning solution to Hateful Memes Challenge    Riza Velioglu, Jewgeni Rose arXiv_AI arXiv_AI  Bert  Speech  Pose  Deep_Learning  Caption  PDF
• 2020-12-23 Bridging Textual and Tabular Data for Cross-Domain Text-to-SQL Semantic Parsing    Xi Victoria Lin, Richard Socher, Caiming Xiong arXiv_AI arXiv_AI  Bert  Relation  Attention  PDF
• 2020-12-22 Simple-QE: Better Automatic Quality Estimation for Text Simplification    Reno Kriz, Marianna Apidianaki, Chris Callison-Burch arXiv_CL arXiv_CL  Bert  Pose  Summarization  PDF
• 2020-12-22 Seeing past words: Testing the cross-modal capabilities of pretrained V&L models    Letitia Parcalabescu, Albert Gatt, Anette Frank, Iacer Calixto arXiv_CV arXiv_CV  Bert  Zero-Shot  Pose  PDF
• 2020-12-22 ActionBert: Leveraging User Actions for Semantic Understanding of User Interfaces    Zecheng He, Srinivas Sunkara, Xiaoxue Zang, Ying Xu, Lijuan Liu, Nevan Wichers, Gabriel Schubiner, Ruby Lee, Jindong Chen arXiv_AI arXiv_AI  Bert  Pose  Face  Action  Classification  PDF
• 2020-12-22 Applying wav2vec2.0 to Speech Recognition in various low-resource languages    Cheng Yi, Jianzhong Wang, Ning Cheng, Shiyu Zhou, Bo Xu arXiv_CL arXiv_CL  Recognition  Bert  Speech  Speech_Recognition  PDF
• 2020-12-22 g2tmn at Constraint@AAAI2021: Exploiting CT-BERT and Ensembling Learning for COVID-19 Fake News Detection    Anna Glazkova, Maksim Glazkov, Timofey Trifonov arXiv_CL arXiv_CL  Transformer  Bert  Pose  Detection  PDF
• 2020-12-22 Learning to Retrieve Entity-Aware Knowledge and Generate Responses with Copy Mechanism for Task-Oriented Dialogue Systems    Chao-Hong Tan, Xiaoyu Yang, Zi'ou Zheng, Tianda Li, Yufei Feng, Jia-Chen Gu, Quan Liu, Dan Liu, Zhen-Hua Ling, Xiaodan Zhu arXiv_AI arXiv_AI  Bert  Knowledge  Pose  Detection  Language_Model  PDF
• 2020-12-22 Undivided Attention: Are Intermediate Layers Necessary for BERT?    Sharath Nittur Sridhar, Anthony Sarah arXiv_AI arXiv_AI  Bert  Sentiment  Attention  Inference  PDF
• 2020-12-22 Intrinsic Dimensionality Explains the Effectiveness of Language Model Fine-Tuning    Armen Aghajanyan, Luke Zettlemoyer, Sonal Gupta arXiv_CL arXiv_CL  Gradient_Descent  Bert  Regularization  Language_Model  PDF
• 2020-12-22 Improved Biomedical Word Embeddings in the Transformer Era    jiho Noh, Ramakanth Kavuluru arXiv_CL arXiv_CL  Transformer  Embedding  Bert  Pose  Classification  Relation  Medical  PDF
• 2020-12-21 SChuBERT: Scholarly Document Chunks with BERT-encoding boost Citation Count Prediction    Thomas van Dongen, Gideon Maillette de Buy Wenniger, Lambert Schomaker arXiv_CL arXiv_CL  Bert  Pose  Prediction  PDF
• 2020-12-21 Leveraging ParsBERT and Pretrained mT5 for Persian Abstractive Text Summarization    Mehrdad Farahani, Mohammad Gharachorloo, Mohammad Manthouri arXiv_CL arXiv_CL  Transformer  Bert  Pose  Summarization  PDF
• 2020-12-21 BERTChem-DDI : Improved Drug-Drug Interaction Prediction from text using Chemical Structure Information    Ishani Mondal arXiv_AI arXiv_AI  Embedding  Bert  Knowledge  Pose  Action  Relation  Relation_Extraction  Medical  Language_Model  Prediction  PDF
• 2020-12-21 Domain specific BERT representation for Named Entity Recognition of lab protocol    Tejas Vaidhya, Ayush Kaushal arXiv_CL arXiv_CL  Embedding  Recognition  Bert  GAN  Medical  PDF
• 2020-12-21 Towards Incorporating Entity-specific Knowledge Graph Information in Predicting Drug-Drug Interactions    Ishani Mondal arXiv_AI arXiv_AI  Embedding  Bert  Knowledge  Knowledge_Graph  Pose  Action  Classification  Relation  Medical  Language_Model  PDF
• 2020-12-21 A Graph Reasoning Network for Multi-turn Response Selection via Customized Pre-training    Yongkang Liu, Shi Feng, Daling Wang, Kaisong Song, Feiliang Ren, Yifei Zhang arXiv_AI arXiv_AI  Bert  Pose  Attention  Inference  Prediction  QA  Matching  PDF
• 2020-12-20 A hybrid deep-learning approach for complex biochemical named entity recognition    Jian Liu, Lei Gao, Sujie Guo, Rui Ding, Xin Huang, Long Ye, Qinghua Meng, Asef Nazari, Dhananjay Thiruvady arXiv_CL arXiv_CL  Transformer  Recognition  Bert  RNN  Pose  Action  Deep_Learning  Relation  Relation_Extraction  Attention  Medical  PDF
• 2020-12-18 An Empirical Study of Using Pre-trained BERT Models for Vietnamese Relation Extraction Task at VLSP 2020    Pham Quang Nhat Minh arXiv_CL arXiv_CL  Bert  Pose  Action  Relation  Relation_Extraction  GAN  PDF
• 2020-12-18 On Modality Bias in the TVQA Dataset    Thomas Winterbottom, Sarah Xiao, Alistair McLean, Noura Al Moubayed arXiv_AI arXiv_AI  Embedding  Bert  Pose  VQA  QA  PDF
• 2020-12-18 Leveraging Event Specific and Chunk Span features to Extract COVID Events from tweets    Ayush Kaushal, Tejas Vaidhya arXiv_CL arXiv_CL  Bert  Action  Classification  Attention  PDF
• 2020-12-17 BERT Goes Shopping: Comparing Distributional Models for Product Representations    Federico Bianchi, Bingqing Yu, Jacopo Tagliabue arXiv_CL arXiv_CL  Embedding  Bert  Pose  Language_Model  PDF
• 2020-12-17 MIX : a Multi-task Learning Approach to Solve Open-Domain Question Answering    Sofian Chaybouti, Achraf Saghe, Aymen Shabou arXiv_CL arXiv_CL  Bert  Deep_Learning  PDF
• 2020-12-17 COVID-19 Emotion Monitoring as a Tool to Increase Preparedness for Disease Outbreaks in Developing Regions    Santiago Cortes, Juan Muñoz, David Betancur, Mauricio Toro arXiv_CL arXiv_CL  Transformer  Bert  Emotion  PDF
• 2020-12-17 MASKER: Masked Keyword Regularization for Reliable Text Classification    Seung Jun Moon, Sangwoo Mo, Kimin Lee, Jaeho Lee, Jinwoo Shin arXiv_CL arXiv_CL  Bert  Text_Classification  Regularization  Pose  Classification  Detection  Sentiment  Inference  Language_Model  Prediction  PDF
• 2020-12-17 Literature Retrieval for Precision Medicine with Neural Matching and Faceted Summarization    Jiho Noh, Ramakanth Kavuluru arXiv_CL arXiv_CL  Bert  Face  Action  Summarization  Matching  PDF
• 2020-12-16 R$^2$-Net: Relation of Relation Learning Network for Sentence Semantic Matching    Kun Zhang, Le Wu, Guangyi Lv, Meng Wang, Enhong Chen, Shulan Ruan arXiv_AI arXiv_AI  Bert  Self-Supervised  Pose  Action  Classification  Relation  Matching  PDF
• 2020-12-16 A Lightweight Neural Model for Biomedical Entity Linking    Lihu Chen, Gaël Varoquaux, Fabian M. Suchanek arXiv_CL arXiv_CL  Bert  Knowledge  Pose  Action  Attention  Medical  PDF
• 2020-12-16 Focusing More on Conflicts with Mis-Predictions Helps Language Pre-Training    Chen Xing, Wencong Xiao, Yong Li, Wei Lin arXiv_CL arXiv_CL  Transformer  Unsupervised  Bert  Pose  Detection  Object_Detection  Attention  Prediction  PDF
• 2020-12-15 A Closer Look at the Robustness of Vision-and-Language Pre-trained Models    Linjie Li, Zhe Gan, Jingjing Liu arXiv_CV arXiv_CV  Transformer  Embedding  Bert  Adversarial  Pose  PDF
• 2020-12-15 Pre-Training Transformers as Energy-Based Cloze Models    Kevin Clark, Minh-Thang Luong, Quoc V. Le, Christopher D. Manning arXiv_CL arXiv_CL  Transformer  Recognition  Bert  Represenation_Learning  Speech  Pose  Speech_Recognition  Language_Model  PDF
• 2020-12-15 Object-based attention for spatio-temporal reasoning: Outperforming neuro-symbolic models with flexible distributed architectures    David Ding, Felix Hill, Adam Santoro, Matt Botvinick arXiv_AI arXiv_AI  Bert  Pose  Action  Attention  PDF
• 2020-12-15 Objective-Based Hierarchical Clustering of Deep Embedding Vectors    Stanislav Naumov, Grigory Yaroslavtsev, Dmitrii Avdiukhin arXiv_AI arXiv_AI  Embedding  Bert  Pose  PDF
• 2020-12-15 MeisterMorxrc at SemEval-2020 Task 9: Fine-Tune Bert and Multitask Learning for Sentiment Analysis of Code-Mixed Tweets    Qi Wu, Peng Wang, Chenghao Huang arXiv_CL arXiv_CL  Transformer  Bert  Text_Classification  Classification  Sentiment  PDF
• 2020-12-15 Traditional IR rivals neural models on the MS~MARCO Document Ranking Leaderboard    Leonid Boytsov arXiv_CL arXiv_CL  Transformer  Bert  PDF
• 2020-12-14 Vartani Spellcheck -- Automatic Context-Sensitive Spelling Correction of OCR-generated Hindi Text Using BERT and Levenshtein Distance    Aditya Pal, Abhijit Mustafi arXiv_AI arXiv_AI  Transformer  Recognition  OCR  Bert  Optical_Character  Pose  Detection  Language_Model  PDF
• 2020-12-14 LRC-BERT: Latent-representation Contrastive Knowledge Distillation for Natural Language Understanding    Hao Fu, Shaojun Zhou, Qihong Yang, Junjie Tang, Guiquan Liu, Kaikui Liu, Xiaolong Li arXiv_AI arXiv_AI  Bert  Knowledge  Pose  Contrastive_Learning  Inference  PDF
• 2020-12-13 KVL-BERT: Knowledge Enhanced Visual-and-Linguistic BERT for Visual Commonsense Reasoning    Dandan Song, Siyi Ma, Zhanchen Sun, Sicheng Yang, Lejian Liao arXiv_AI arXiv_AI  Transformer  Embedding  Bert  Knowledge  Pose  Attention  PDF
• 2020-12-13 MiniVLM: A Smaller and Faster Vision-Language Model    Jianfeng Wang, Xiaowei Hu, Pengchuan Zhang, Xiujun Li, Lijuan Wang, Lei Zhang, Jianfeng Gao, Zicheng Liu arXiv_CV arXiv_CV  Transformer  Bert  Pose  Action  Caption  Inference  Language_Model  PDF
• 2020-12-13 Discriminative Pre-training for Low Resource Title Compression in Conversational Grocery    Snehasish Mukherjee, Phaniram Sayapaneni, Shankar Subramanya arXiv_AI arXiv_AI  Embedding  Bert  RNN  Pose  Detection  PDF
• 2020-12-12 GDPNet: Refining Latent Multi-View Graph for Relation Extraction    Fuzhao Xue, Aixin Sun, Hao Zhang, Eng Siong Chng arXiv_CL arXiv_CL  Bert  Pose  Action  Relation  Relation_Extraction  Prediction  PDF
• 2020-12-12 Yelp Review Rating Prediction: Machine Learning and Deep Learning Models    Zefang Liu arXiv_CL arXiv_CL  Transformer  Bert  Review  Classification  Deep_Learning  Prediction  PDF
• 2020-12-11 Improving Task-Agnostic BERT Distillation with Layer Mapping Search    Xiaoqi Jiao, Huating Chang, Yichun Yin, Lifeng Shang, Xin Jiang, Xiao Chen, Linlin Li, Fang Wang, Qun Liu arXiv_CL arXiv_CL  Bert  Knowledge  Pose  PDF
• 2020-12-10 A Practical Approach towards Causality Mining in Clinical Text using Active Transfer Learning    Musarrat Hussain, Fahad Ahmed Satti, Jamil Hussain, Taqdir Ali, Syed Imran Ali, Hafiz Syed Muhammad Bilal, Gwang Hoon Park, Sungyoung Lee arXiv_AI arXiv_AI  Embedding  Transfer_Learning  Bert  Knowledge  Action  Detection  Relation  Medical  Matching  PDF
• 2020-12-10 Causal-BERT : Language models for causality detection between events expressed in text    Vivek Khetan, Roshni Ramnani, Mayuresh Anand, Shubhashis Sengupta, Andrew E.Fano arXiv_AI arXiv_AI  Bert  Pose  Action  Detection  Relation  Language_Model  Matching  PDF
• 2020-12-09 Cross-lingual Word Sense Disambiguation using mBERT Embeddings with Syntactic Dependencies    Xingran Zhu arXiv_CL arXiv_CL  Embedding  Bert  Pose  Classification  Relation  PDF
• 2020-12-09 Kernel Anomalous Change Detection for Remote Sensing Imagery    José A. Padrón-Hidalgo, Valero Laparra, Nathan Longbotham, Gustau Camps-Valls arXiv_CV arXiv_CV  Bert  Detection  Contour  Object_Detection  PDF
• 2020-12-08 Do Mass Media Shape Public Opinion toward China? Quantitative Evidence on New York Times with Deep Learning    Junming Huang, Gavin Cook, Yu Xie arXiv_CL arXiv_CL  Bert  Survey  Quantitative  Deep_Learning  PDF
• 2020-12-08 Discourse Parsing of Contentious, Non-Convergent Online Discussions    Stepan Zakharov, Omri Hadar, Tovit Hakak, Dina Grossman, Yifat Ben-David Kolikant, Oren Tsur arXiv_CL arXiv_CL  Embedding  Bert  Pose  Classification  Detection  PDF
• 2020-12-08 Efficient Estimation of Influence of a Training Instance    Sosuke Kobayashi, Sho Yokoi, Jun Suzuki, Kentaro Inui arXiv_CV arXiv_CV  Bert  Pose  Classification  Prediction  PDF
• 2020-12-07 NeRD: Neural Reflectance Decomposition from Image Collections    Mark Boss, Raphael Braun, Varun Jampani, Jonathan T. Barron, Ce Liu, Hendrik P.A. Lensch arXiv_CV arXiv_CV  Bert  Pose  PDF
• 2020-12-07 Detecting Insincere Questions from Text: A Transfer Learning Approach    Ashwin Rachha, Gaurav Vanmane arXiv_AI arXiv_AI  Transformer  Transfer_Learning  Bert  Knowledge  Action  Classification  PDF
• 2020-12-07 KgPLM: Knowledge-guided Language Model Pre-training via Generative and Discriminative Learning    Bin He, Xin Jiang, Jinghui Xiao, Qun Liu arXiv_AI arXiv_AI  Bert  Zero-Shot  Knowledge  Language_Model  QA  PDF
• 2020-12-07 Dartmouth CS at WNUT-2020 Task 2: Informative COVID-19 Tweet Classification Using BERT    Dylan Whang, Soroush Vosoughi arXiv_CL arXiv_CL  Embedding  Bert  Classification  PDF
• 2020-12-07 An Empirical Survey of Unsupervised Text Representation Methods on Twitter Data    Lili Wang, Chongyang Gao, Jason Wei, Weicheng Ma, Ruibo Liu, Soroush Vosoughi arXiv_CL arXiv_CL  Transformer  Unsupervised  Bert  Survey  Language_Model  PDF
• 2020-12-05 Pre-training Protein Language Models with Label-Agnostic Binding Pairs Enhances Performance in Downstream Tasks    Modestas Filipavicius, Matteo Manica, Joris Cadow, Maria Rodriguez Martinez arXiv_CL arXiv_CL  Transformer  Bert  Self-Supervised  Classification  Attention  Language_Model  Prediction  PDF
• 2020-12-05 Enhanced Offensive Language Detection Through Data Augmentation    Ruibo Liu, Guangxuan Xu, Soroush Vosoughi arXiv_CL arXiv_CL  Transformer  Bert  RNN  Classification  Detection  Attention  PDF
• 2020-12-04 Playing Text-Based Games with Common Sense    Sahith Dambekodi, Spencer Frazier, Prithviraj Ammanabrolu, Mark O. Riedl arXiv_AI arXiv_AI  Reinforcement_Learning  Bert  Knowledge  Action  Inference  Language_Model  PDF
• 2020-12-04 Modelling General Properties of Nouns by Selectively Averaging Contextualised Embeddings    Na Li, Zied Bouraoui, Jose Camacho Collados, Luis Espinosa-Anke, Qing Gu, Steven Schockaert arXiv_AI arXiv_AI  Embedding  Bert  Knowledge  Pose  Language_Model  PDF
• 2020-12-04 Automated Detection of Cyberbullying Against Women and Immigrants and Cross-domain Adaptability    Thushari Atapattu, Mahen Herath, Georgia Zhang, Katrina Falkner arXiv_CL arXiv_CL  Bert  Speech  Detection  Recommendation  PDF
• 2020-12-04 Pre-trained language models as knowledge bases for Automotive Complaint Analysis    V. D. Viellieber, M. Aßenmacher arXiv_CL arXiv_CL  Bert  Knowledge  Language_Model  PDF
• 2020-12-04 Fine-tuning BERT for Low-Resource Natural Language Understanding via Active Learning    Daniel Grießhaber, Johannes Maucher, Ngoc Thang Vu arXiv_CL arXiv_CL  Transformer  Bert  Knowledge  Language_Model  PDF
• 2020-12-04 Spread Mechanism and Influence Measurement of Online Rumors during COVID-19 Epidemic in China    Yiou Lin, Hang Lei, Yu Deng arXiv_CL arXiv_CL  Bert  Pose  Deep_Learning  PDF
• 2020-12-04 A Benchmark Dataset for Understandable Medical Language Translation    Junyu Luo, Zifei Zheng, Hanzhong Ye, Muchao Ye, Yaqing Wang, Quanzeng You, Cao Xiao, Fenglong Ma arXiv_CL arXiv_CL  Bert  Pose  Deep_Learning  Summarization  Medical  PDF
• 2020-12-03 BERT-hLSTMs: BERT and Hierarchical LSTMs for Visual Storytelling    Jing Su, Qingyun Dai, Frank Guerin, Mian Zhou arXiv_CV arXiv_CV  Transformer  Embedding  Bert  RNN  Pose  PDF
• 2020-12-03 GottBERT: a pure German Language Model    Raphael Scheible, Fabian Thomczyk, Patric Tippmann, Victor Jaravine, Martin Boeker arXiv_CL arXiv_CL  Transformer  Recognition  Bert  Text_Classification  Optimization  Classification  Language_Model  PDF
• 2020-12-03 Sentiment analysis in Bengali via transfer learning using multi-lingual BERT    Khondoker Ittehadul Islam, Md. Saiful Islam, Md Ruhul Amin arXiv_CL arXiv_CL  Transfer_Learning  Bert  Sentiment_Classification  Pose  Classification  Deep_Learning  Sentiment  PDF
• 2020-12-03 DialogBERT: Discourse-Aware Response Generation via Learning to Recover and Rank Utterances    Xiaodong Gu, Kang Min Yoo, Jung-Woo Ha arXiv_AI arXiv_AI  Transformer  Bert  Pose  Quantitative  Attention  Language_Model  PDF
• 2020-12-03 Adapt-and-Adjust: Overcoming the Long-Tail Problem of Multilingual Speech Recognition    Genta Indra Winata, Guangsen Wang, Caiming Xiong, Steven Hoi arXiv_AI arXiv_AI  Transformer  Recognition  Bert  Speech  Pose  Speech_Recognition  Inference  Language_Model  PDF
• 2020-12-03 Federated Learning with Diversified Preference for Humor Recognition    Xu Guo, Pengwei Xing, Siwei Feng, Boyang Li, Chunyan Miao arXiv_CL arXiv_CL  Recognition  Bert  Pose  Action  Language_Model  PDF
• 2020-12-03 Circles are like Ellipses, or Ellipses are like Circles? Measuring the Degree of Asymmetry of Static and Contextual Embeddings and the Implications to Representation Learning    Wei Zhang, Murray Campbell, Yang Yu, Sadhana Kumaravel arXiv_AI arXiv_AI  Embedding  Bert  Text_Classification  Represenation_Learning  Classification  Language_Model  PDF
• 2020-12-02 Exploiting BERT to improve aspect-based sentiment analysis performance on Persian language    H. Jafarian, A. H. Taghavi, A. Javaheri, R. Rawassizadeh arXiv_CL arXiv_CL  Bert  Sentiment  Attention  Inference  PDF
• 2020-12-02 A Framework and Dataset for Abstract Art Generation via CalligraphyGAN    Jinggang Zhuo, Ling Fan, Harry Jiannan Wang arXiv_CV arXiv_CV  Image_Caption  Bert  Adversarial  Deep_Learning  Detection  Object_Detection  GAN  Caption  Language_Model  PDF
• 2020-12-01 Pose-based Sign Language Recognition using GCN and BERT    Anirudh Tunga, Sai Vidyaranya Nuthalapati, Juan Wachs arXiv_CV arXiv_CV  Transformer  Recognition  Bert  Pose  Action  CNN  Prediction  PDF
• 2020-12-01 ClimaText: A Dataset for Climate Change Topic Detection    Francesco S. Varini, Jordan Boyd-Graber, Massimiliano Ciaramita, Markus Leippold arXiv_AI arXiv_AI  Bert  Detection  Sentiment  Summarization  PDF
• 2020-12-01 Pre-Trained Image Processing Transformer    Hanting Chen, Yunhe Wang, Tianyu Guo, Chang Xu, Yiping Deng, Zhenhua Liu, Siwei Ma, Chunjing Xu, Chao Xu, Wen Gao arXiv_CV arXiv_CV  Transformer  Super_Resolution  Bert  Contrastive_Learning  Deep_Learning  Denoising  PDF
• 2020-11-30 Multi-Modal Detection of Alzheimer's Disease from Speech and Text    Amish Mittal, Sourav Sahoo, Arnhav Datar, Juned Kadiwala, Hrithwik Shalu, Jimson Mathew arXiv_CL arXiv_CL  Embedding  Recognition  Bert  Speech  Pose  Classification  Deep_Learning  Detection  Speech_Recognition  CNN  Prediction  PDF
• 2020-11-30 Multimodal Pretraining Unmasked: Unifying the Vision and Language BERTs    Emanuele Bugliarello, Ryan Cotterell, Naoaki Okazaki, Desmond Elliott arXiv_CV arXiv_CV  Embedding  Bert  Pose  PDF
• 2020-11-30 Fake News Detection in Social Media using Graph Neural Networks and NLP Techniques: A COVID-19 Use-case    Abdullah Hamid, Nasrullah Shiekh, Naina Said, Kashif Ahmad, Asma Gul, Laiq Hassan, Ala Al-Fuqaha arXiv_CL arXiv_CL  Embedding  Bert  Pose  Classification  Detection  PDF
• 2020-11-30 Flood Detection via Twitter Streams using Textual and Visual Features    Firoj Alam, Zohaib Hassan, Kashif Ahmad, Asma Gul, Michael Reiglar, Nicola Conci, Ala AL-Fuqaha arXiv_CV arXiv_CV  Transformer  Bert  Pose  Detection  PDF
• 2020-11-30 Floods Detection in Twitter Text and Images    Naina Said, Kashif Ahmad, Asma Gul, Nasir Ahmad, Ala Al-Fuqaha arXiv_CV arXiv_CV  Bert  Pose  Classification  Detection  PDF
• 2020-11-29 Improved Semantic Role Labeling using Parameterized Neighborhood Memory Adaptation    Ishan Jindal, Ranit Aharonov, Siddhartha Brahma, Huaiyu Zhu, Yunyao Li arXiv_CL arXiv_CL  Embedding  Bert  Pose  Prediction  PDF
• 2020-11-29 Coarse-to-Fine Memory Matching for Joint Retrieval and Classification    Allen Schmaltz, Andrew Beam arXiv_CL arXiv_CL  Bert  Knowledge  Classification  Inference  Language_Model  Matching  PDF
• 2020-11-29 A Novel Sentiment Analysis Engine for Preliminary Depression Status Estimation on Social Media    Sudhir Kumar Suman, Hrithwik Shalu, Lakshya A Agrawal, Archit Agrawal, Juned Kadiwala arXiv_CL arXiv_CL  Bert  Pose  Deep_Learning  Detection  Sentiment  PDF
• 2020-11-28 EdgeBERT: Optimizing On-Chip Inference for Multi-Task NLP    Thierry Tambe, Coleman Hooper, Lillian Pentecost, En-Yu Yang, Marco Donato, Victor Sanh, Alexander M. Rush, David Brooks, Gu-Yeon Wei arXiv_CL arXiv_CL  Transformer  Embedding  Quantization  Bert  Attention  Inference  Language_Model  PDF
• 2020-11-28 Transformer Query-Target Knowledge Discovery : Drug Discovery from CORD-19    Leo K. Tam, Xiaosong Wang, Daguang Xu arXiv_CL arXiv_CL  Transformer  Bert  Knowledge  Language_Model  Prediction  PDF
• 2020-11-28 Understanding How BERT Learns to Identify Edits    Samuel Stevens, Yu Su arXiv_CL arXiv_CL  Transformer  Bert  Pose  Classification  Attention  Language_Model  PDF
• 2020-11-27 FFCI: A Framework for Interpretable Automatic Evaluation of Summarization    Fajri Koto, Jey Han Lau, Timothy Baldwin arXiv_CL arXiv_CL  Bert  Pose  Relation  Summarization  Language_Model  Prediction  QA  PDF
• 2020-11-27 Relation Clustering in Narrative Knowledge Graphs    Simone Mellace, K Vani, Alessandro Antonucci arXiv_AI arXiv_AI  Transformer  Unsupervised  Bert  Knowledge  Knowledge_Graph  Action  Relation  PDF
• 2020-11-27 Progressively Stacking 2.0: A Multi-stage Layerwise Training Method for BERT Training Speedup    Cheng Yang, Shengnan Wang, Chao Yang, Yuechuan Li, Ru He, Jingqiao Zhang arXiv_CL arXiv_CL  Bert  Pose  Language_Model  PDF
• 2020-11-27 CoRe: An Efficient Coarse-refined Training Framework for BERT    Cheng Yang, Shengnan Wang, Yuechuan Li, Chao Yang, Ming Yan, Jingqiao Zhang, Fangquan Lin arXiv_CL arXiv_CL  Bert  Pose  Attention  PDF
• 2020-11-27 Chinese Medical Question Answer Matching Based on Interactive Sentence Representation Learning    Xiongtao Cui, Jungang Han arXiv_CL arXiv_CL  Bert  Represenation_Learning  Pose  Deep_Learning  Medical  QA  Matching  PDF
• 2020-11-26 Two Stage Transformer Model for COVID-19 Fake News Detection and Fact Checking    Rutvik Vijjali, Prathyush Potluri, Siddharth Kumar, Sundeep Teki arXiv_CL arXiv_CL  Transformer  Bert  Knowledge  Detection  PDF
• 2020-11-26 Molecular representation learning with language models and domain-relevant auxiliary tasks    Benedek Fabian, Thomas Edlich, Héléna Gaspar, Marwin Segler, Joshua Meyers, Marco Fiscato, Mohamed Ahmed arXiv_AI arXiv_AI  Transformer  Bert  Represenation_Learning  Self-Supervised  Language_Model  PDF
• 2020-11-26 Encoding Syntactic Constituency Paths for Frame-Semantic Parsing with Graph Convolutional Networks    Emanuele Bastianelli, Andrea Vanzo, Oliver Lemon arXiv_CL arXiv_CL  Bert  CNN  PDF
• 2020-11-26 Transformer-Based Models for Automatic Identification of Argument Relations: A Cross-Domain Evaluation    Ramon Ruiz-Dolz, Stella Heras, Jose Alemany, Ana García-Fornes arXiv_CL arXiv_CL  Transformer  Bert  Relation  PDF
• 2020-11-26 A Recurrent Vision-and-Language BERT for Navigation    Yicong Hong, Qi Wu, Yuankai Qi, Cristian Rodriguez-Opazo, Stephen Gould arXiv_CV arXiv_CV  Transformer  Bert  Pose  Attention  PDF
• 2020-11-25 Learning to Expand: Reinforced Pseudo-relevance Feedback Selection for Information-seeking Conversations    Haojie Pan, Cen Chen, Minghui Qiu, Liu Yang, Feng Ji, Jun Huang, Haiqing Chen arXiv_CL arXiv_CL  Bert  Pose  Quantitative  PDF
• 2020-11-24 Enhancing deep neural networks with morphological information    Matej Klemen, Luka Krsnik, Marko Robnik-Šikonja arXiv_CL arXiv_CL  Transformer  Recognition  Bert  RNN  Speech  Deep_Learning  Language_Model  PDF
• 2020-11-24 Experiments on transfer learning architectures for biomedical relation extraction    Walid Hafiane, Joel Legrand, Yannick Toussaint, Adrien Coulet arXiv_CL arXiv_CL  Segmentation  Transfer_Learning  Bert  Action  Relation  Relation_Extraction  Medical  PDF
• 2020-11-24 Zero-Shot Visual Slot Filling as Question Answering    Larry Heck, Simon Heck arXiv_AI arXiv_AI  Transfer_Learning  Bert  Zero-Shot  PDF
• 2020-11-24 Constraint Based Refinement of Optical Flow    Hirak Doshi, N. Uday Kiran arXiv_CV arXiv_CV  Bert  Regularization  Optical_Flow  PDF
• 2020-11-24 Tackling Domain-Specific Winograd Schemas with Knowledge-Based Reasoning and Machine Learning    Suk Joon Hong, Brandon Bennett arXiv_AI arXiv_AI  Transformer  Bert  Knowledge  Pose  PDF
• 2020-11-24 Picking BERT's Brain: Probing for Linguistic Dependencies in Contextualized Embeddings Using Representational Similarity Analysis    Michael A. Lepori, R. Thomas McCoy arXiv_CL arXiv_CL  Embedding  Bert  Salient  PDF
• 2020-11-24 Spatiotemporal Imaging with Diffeomorphic Optimal Transportation    Chong Chen arXiv_CV arXiv_CV  Reconstruction  Bert  Sparse  Pose  PDF
• 2020-11-23 Does BERT Understand Sentiment? Leveraging Comparisons Between Contextual and Non-Contextual Embeddings to Improve Aspect-Based Sentiment Models    Natesh Reddy, Pranaydeep Singh, Muktabh Mayank Srivastava arXiv_CL arXiv_CL  Embedding  Bert  Sentiment_Classification  Classification  Detection  Sentiment  Language_Model  PDF
• 2020-11-23 The Zero Resource Speech Benchmark 2021: Metrics and baselines for unsupervised spoken language modeling    Tu Anh Nguyen, Maureen de Seyssel, Patricia Rozé, Morgane Rivière, Evgeny Kharitonov, Alexei Baevski, Ewan Dunbar, Emmanuel Dupoux arXiv_CL arXiv_CL  Unsupervised  Bert  Zero-Shot  Represenation_Learning  RNN  Speech  Self-Supervised  Language_Model  PDF
• 2020-11-22 Locally Linear Embedding and its Variants: Tutorial and Survey    Benyamin Ghojogh, Ali Ghodsi, Fakhri Karray, Mark Crowley arXiv_CV arXiv_CV  Reconstruction  Embedding  OCR  Bert  Survey  PDF
• 2020-11-20 Self-Supervised learning with cross-modal transformers for emotion recognition    Aparna Khare, Srinivas Parthasarathy, Shiva Sundaram arXiv_CL arXiv_CL  Transformer  Embedding  Recognition  Bert  Speech  Self-Supervised  Emotion  Language_Model  PDF
• 2020-11-20 Fine-Tuning BERT for Sentiment Analysis of Vietnamese Reviews    Quoc Thai Nguyen, Thoai Linh Nguyen, Ngoc Hoang Luong, Quoc Hung Ngo arXiv_CL arXiv_CL  Transformer  Bert  Review  Pose  Classification  Deep_Learning  Sentiment  PDF
• 2020-11-20 Data-Informed Global Sparseness in Attention Mechanisms for Deep Neural Networks    Ileana Rugina, Rumen Dangovski, Li Jing, Preslav Nakov, Marin Soljačić arXiv_CL arXiv_CL  Bert  Sparse  Attention  Inference  Language_Model  Prediction  PDF
• 2020-11-19 Fact-level Extractive Summarization with Hierarchical Graph Mask on BERT    Ruifeng Yuan, Zili Wang, Wenjie Li arXiv_CL arXiv_CL  Bert  Salient  Pose  Summarization  PDF
• 2020-11-19 oLMpics -- On what Language Model Pre-training Captures    Alon Talmor, Yanai Elazar, Yoav Goldberg, Jonathan Berant arXiv_AI arXiv_AI  Bert  Zero-Shot  Pose  Language_Model  PDF
• 2020-11-18 Predicting metrical patterns in Spanish poetry with language models    Javier de la Rosa, Salvador Ros, Elena González-Blanco arXiv_CL arXiv_CL  Bert  Language_Model  PDF
• 2020-11-18 A Sequence-to-Sequence Approach to Dialogue State Tracking    Yue Feng, Yang Wang, Hang Li arXiv_AI arXiv_AI  Embedding  Tracking  Bert  Pose  Relation  Attention  PDF
• 2020-11-18 Palomino-Ochoa at SemEval-2020 Task 9: Robust System based on Transformer for Code-Mixed Sentiment Classification    Daniel Palomino, Jose Ochoa-Luna arXiv_CL arXiv_CL  Transformer  Transfer_Learning  Bert  Sentiment_Classification  Classification  Detection  Sentiment  Language_Model  PDF
• 2020-11-18 On the use of Self-supervised Pre-trained Acoustic and Linguistic Features for Continuous Speech Emotion Recognition    Manon Macary, Marie Tahon, Yannick Estève, Anthony Rousseau arXiv_CL arXiv_CL  Embedding  Recognition  Bert  Knowledge  Speech  Self-Supervised  Emotion  Action  Relation  Language_Model  PDF
• 2020-11-18 Do Fine-tuned Commonsense Language Models Really Generalize?    Mayank Kejriwal, Ke Shen arXiv_AI arXiv_AI  Transformer  Bert  Language_Model  PDF
• 2020-11-18 Diverse and Non-redundant Answer Set Extraction on Community QA based on DPPs    Shogo Fujita, Tomohide Shibata, Manabu Okumura arXiv_CL arXiv_CL  Bert  Pose  Action  QA  PDF
• 2020-11-18 Tie Your Embeddings Down: Cross-Modal Latent Spaces for End-to-end Spoken Language Understanding    Bhuvan Agrawal, Markus Müller, Martin Radfar, Samridhi Choudhary, Athanasios Mouchtaris, Siegfried Kunzmann arXiv_CL arXiv_CL  Embedding  Bert  Pose  PDF
• 2020-11-17 SIENA: Stochastic Multi-Expert Neural Patcher    Thai Le, Noseong Park, Dongwon Lee arXiv_CL arXiv_CL  Bert  RNN  Adversarial  Pose  PDF
• 2020-11-17 MVP-BERT: Redesigning Vocabularies for Chinese BERT and Multi-Vocab Pretraining    Wei Zhu arXiv_CL arXiv_CL  Segmentation  Bert  Pose  Language_Model  PDF
• 2020-11-17 Self-supervised Document Clustering Based on BERT with Data Augment    Haoxiang Shi, Cen Wang, Tetsuya Sakai arXiv_AI arXiv_AI  Unsupervised  Bert  Self-Supervised  Pose  Contrastive_Learning  PDF
• 2020-11-16 Don't Patronize Me! An Annotated Dataset with Patronizing and Condescending Language towards Vulnerable Communities    Carla Pérez-Almendros, Luis Espinosa-Anke, Steven Schockaert arXiv_CL arXiv_CL  Bert  Pose  Language_Model  PDF
• 2020-11-16 It's a Thin Line Between Love and Hate: Using the Echo in Modeling Dynamics of Racist Online Communities    Eyal Arviv, Simo Hanouna, Oren Tsur arXiv_CL arXiv_CL  Transformer  Reconstruction  Tracking  Bert  RNN  Speech  Pose  Detection  PDF
• 2020-11-16 Beyond I.I.D.: Three Levels of Generalization for Question Answering on Knowledge Bases    Yu Gu, Sue Kase, Michelle Vanni, Brian Sadler, Percy Liang, Xifeng Yan, Yu Su arXiv_AI arXiv_AI  Embedding  Bert  Zero-Shot  Knowledge  Pose  QA  PDF
• 2020-11-16 IIT_kgp at FinCausal 2020, Shared Task 1: Causality Detection using Sentence Embeddings in Financial Reports    Arka Mitra, Harshvardhan Srivastava, Yugam Tiwari arXiv_CL arXiv_CL  Embedding  Bert  Detection  PDF
• 2020-11-15 Good proctor or 'Big Brother'? AI Ethics and Online Exam Supervision Technologies    Simon Coghlan, Tim Miller, Jeannie Paterson arXiv_AI arXiv_AI  Bert  Review  PDF
• 2020-11-14 CL-IMS @ DIACR-Ita: Volente o Nolente: BERT does not outperform SGNS on Semantic Change Detection    Severin Laicher, Gioia Baldissin, Enrique Castañeda, Dominik Schlechtweg, Sabine Schulte im Walde arXiv_CL arXiv_CL  Embedding  Bert  Detection  PDF
• 2020-11-14 ActBERT: Learning Global-Local Video-Text Representations    Linchao Zhu, Yi Yang arXiv_CV arXiv_CV  Transformer  Segmentation  Video_Caption  Bert  Represenation_Learning  Self-Supervised  Action  Relation  Caption  PDF
• 2020-11-14 Utilizing Bidirectional Encoder Representations from Transformers for Answer Selection    Md Tahmid Rahman Laskar, Enamul Hoque, Jimmy Xiangji Huang arXiv_CL arXiv_CL  Transformer  Bert  Language_Model  QA  PDF
• 2020-11-13 Sparse Representations of Positive Functions via Projected Pseudo-Mirror Descent    Abhishek Chakraborty, Ketan Rajawat, Alec Koppel arXiv_CV arXiv_CV  Bert  Optimization  Sparse  Matching  PDF
• 2020-11-13 Multi-Modal Emotion Detection with Transfer Learning    Amith Ananthram, Kailash Karthik Saravanakumar, Jessica Huynh, Homayoon Beigi arXiv_CL arXiv_CL  Embedding  Transfer_Learning  Bert  Speech  Emotion  Detection  PDF
• 2020-11-13 FLERT: Document-Level Features for Named Entity Recognition    Stefan Schweter, Alan Akbik arXiv_CL arXiv_CL  Transformer  Recognition  Bert  RNN  Prediction  Recommendation  PDF
• 2020-11-13 Arabic Dialect Identification Using BERT-Based Domain Adaptation    Ahmad Beltagy, Abdelrahman Wael, Omar ElSherief arXiv_CL arXiv_CL  Bert  Deep_Learning  PDF
• 2020-11-12 An Interpretable End-to-end Fine-tuning Approach for Long Clinical Text    Kexin Huang, Sankeerth Garapati, Alexander S. Rich arXiv_CL arXiv_CL  Bert  Text_Classification  Pose  Action  Classification  Prediction  Matching  PDF
• 2020-11-12 Biomedical Named Entity Recognition at Scale    Veysel Kocaman, David Talby arXiv_AI arXiv_AI  Embedding  Recognition  Bert  RNN  Action  Deep_Learning  Detection  Relation  Relation_Extraction  Medical  Inference  PDF
• 2020-11-12 Augmenting BERT Carefully with Underrepresented Linguistic Features    Aparna Balagopalan, Jekaterina Novikova arXiv_CL arXiv_CL  Transformer  Bert  Speech  Classification  Detection  PDF
• 2020-11-12 Identifying Depressive Symptoms from Tweets: Figurative Language Enabled Multitask Learning Framework    Shweta Yadav, Jainish Chauhan, Joy Prakash Sain, Krishnaprasad Thirunarayan, Amit Sheth, Jeremiah Schumm arXiv_CL arXiv_CL  Bert  Pose  Detection  Attention  PDF
• 2020-11-12 Author's Sentiment Prediction    Mohaddeseh Bastan, Mahnaz Koupaee, Youngseo Son, Richard Sicoli, Niranjan Balasubramanian arXiv_CL arXiv_CL  Bert  Pose  Classification  Sentiment  Prediction  PDF
• 2020-11-11 Multilingual Irony Detection with Dependency Syntax and Neural Models    Alessandra Teresa Cignarella, Valerio Basile, Manuela Sanguinetti, Cristina Bosco, Paolo Rosso, Farah Benamara arXiv_CL arXiv_CL  Embedding  Bert  Knowledge  Detection  PDF
• 2020-11-11 Recognizing More Emotions with Less Data Using Self-supervised Transfer Learning    Jonathan Boigne, Biman Liyanage, Ted Östrem arXiv_SD arXiv_SD  Transfer_Learning  Recognition  Bert  Knowledge  Speech  Self-Supervised  Pose  Emotion  Attention  PDF
• 2020-11-11 NIT COVID-19 at WNUT-2020 Task 2: Deep Learning Model RoBERTa for Identify Informative COVID-19 English Tweets    Jagadeesh M S, Alphonse P J A arXiv_CL arXiv_CL  Bert  Pose  Classification  Deep_Learning  PDF
• 2020-11-11 Towards Semi-Supervised Semantics Understanding from Speech    Cheng-I Lai, Jin Cao, Sravan Bodapati, Shang-Wen Li arXiv_AI arXiv_AI  Recognition  Bert  Speech  Self-Supervised  Pose  Speech_Recognition  Language_Model  PDF
• 2020-11-10 A New Framework for Registration of Semantic Point Clouds from Stereo and RGB-D Cameras    Ray Zhang, Tzu-Yuan Lin, Chien Erh Lin, Steven A. Parkison, William Clark, Jessy W. Grizzle, Ryan M. Eustice, Maani Ghaffari arXiv_CV arXiv_CV  Point_Cloud  Bert  Optimization  Pose  PDF
• 2020-11-10 Detecting Social Media Manipulation in Low-Resource Languages    Samar Haider, Luca Luceri, Ashok Deb, Adam Badawy, Nanyun Peng, Emilio Ferrara arXiv_AI arXiv_AI  Embedding  Transfer_Learning  Bert  Knowledge  Pose  Detection  Activity  PDF
• 2020-11-10 UmBERTo-MTSA @ AcCompl-It: Improving Complexity and Acceptability Prediction with Multi-task Learning on Self-Supervised Annotations    Gabriele Sarti arXiv_CL arXiv_CL  Bert  Self-Supervised  Language_Model  Prediction  PDF
• 2020-11-10 To What Degree Can Language Borders Be Blurred In BERT-based Multilingual Spoken Language Understanding?    Quynh Do, Judith Gaspers, Tobias Roding, Melanie Bradford arXiv_AI arXiv_AI  Bert  Knowledge  Adversarial  Pose  PDF
• 2020-11-10 SelfDeco: Self-Supervised Monocular Depth Completion in Challenging Indoor Environments    Jaehoon Choi, Dongki Jung, Yonghan Lee, Deokhwa Kim, Dinesh Manocha, Donghwan Lee arXiv_CV arXiv_CV  Bert  Sparse  Self-Supervised  Face  PDF
• 2020-11-10 When Do You Need Billions of Words of Pretraining Data?    Yian Zhang, Alex Warstadt, Haau-Sing Li, Samuel R. Bowman arXiv_CL arXiv_CL  Transformer  Unsupervised  Bert  Knowledge  Pose  Language_Model  PDF
• 2020-11-10 Determining Question-Answer Plausibility in Crowdsourced Datasets Using Multi-Task Learning    Rachel Gardner, Maya Varma, Clare Zhu, Ranjay Krishna arXiv_AI arXiv_AI  Bert  Action  QA  PDF
• 2020-11-10 A Transfer Learning Approach for Dialogue Act Classification of GitHub Issue Comments    Ayesha Enayet, Gita Sukthankar arXiv_CL arXiv_CL  Transformer  Transfer_Learning  Bert  Classification  PDF
• 2020-11-09 Language Through a Prism: A Spectral Approach for Multiscale Language Representations    Alex Tamkin, Dan Jurafsky, Noah Goodman arXiv_CL arXiv_CL  Embedding  Bert  Speech  Pose  Classification  PDF
• 2020-11-09 EstBERT: A Pretrained Language-Specific BERT for Estonian    Hasan Tanvir, Claudia Kittask, Kairit Sirts arXiv_CL arXiv_CL  Transformer  Recognition  Bert  Text_Classification  Classification  PDF
• 2020-11-09 VisBERT: Hidden-State Visualizations for Transformers    Betty van Aken, Benjamin Winter, Alexander Löser, Felix A. Gers arXiv_CL arXiv_CL  Transformer  Bert  Attention  Inference  Prediction  PDF
• 2020-11-09 Catch the 'Tails' of BERT    Ziyang Luo arXiv_CL arXiv_CL  Embedding  Bert  Relation  PDF
• 2020-11-09 Character-level Representations Improve DRS-based Semantic Parsing Even in the Age of BERT    Rik van Noord, Antonio Toral, Johan Bos arXiv_CL arXiv_CL  Embedding  Bert  Language_Model  PDF
• 2020-11-09 BERT-JAM: Boosting BERT-Enhanced Neural Machine Translation with Joint Attention    Zhebin Zhang, Sai Wu, Dawei Jiang, Gang Chen arXiv_CL arXiv_CL  Transformer  Bert  Optimization  Pose  NMT  Attention  PDF
• 2020-11-09 CxGBERT: BERT meets Construction Grammar    Harish Tayyar Madabushi, Laurence Romain, Dagmar Divjak, Petar Milin arXiv_CL arXiv_CL  Bert  Deep_Learning  PDF
• 2020-11-06 Improving Machine Reading Comprehension with Single-choice Decision and Transfer Learning    Yufan Jiang, Shuangzhi Wu, Jing Gong, Yahui Cheng, Peng Meng, Weiliang Lin, Zhibo Chen, Mu li arXiv_CL arXiv_CL  Transfer_Learning  Bert  Knowledge  Classification  PDF
• 2020-11-06 Improving Prosody Modelling with Cross-Utterance BERT Embeddings for End-to-end Speech Synthesis    Guanghui Xu, Wei Song, Zhengchen Zhang, Chao Zhang, Xiaodong He, Bowen Zhou arXiv_SD arXiv_SD  Embedding  Bert  Speech  Pose  PDF
• 2020-11-05 CODER: Knowledge infused cross-lingual medical term embedding for term normalization    Zheng Yuan, Zhengyun Zhao, Sheng Yu arXiv_CL arXiv_CL  Embedding  Bert  Knowledge  Knowledge_Graph  Pose  Classification  Relation  Medical  PDF
• 2020-11-05 NUAA-QMUL at SemEval-2020 Task 8: Utilizing BERT and DenseNet for Internet Meme Emotion Analysis    Xiaoyu Guo, Jing Ma, Arkaitz Zubiaga arXiv_CL arXiv_CL  Embedding  Bert  Emotion  Classification  Sentiment  Image_Classification  PDF
• 2020-11-04 MTLB-STRUCT @PARSEME 2020: Capturing Unseen Multiword Expressions Using Multi-task Learning and Pre-trained Masked Language Models    Shiva Taslimipoor, Sara Bahaadini, Ekaterina Kochmar arXiv_CL arXiv_CL  Bert  Language_Model  Prediction  PDF
• 2020-11-04 Investigating Novel Verb Learning in BERT: Selectional Preference Classes and Alternation-Based Syntactic Generalization    Tristan Thrush, Ethan Wilcox, Roger Levy arXiv_CL arXiv_CL  Bert  Pose  Deep_Learning  Relation  Few-Shot  PDF
• 2020-11-04 A BERT-based Dual Embedding Model for Chinese Idiom Prediction    Minghuan Tan, Jing Jiang arXiv_CL arXiv_CL  Embedding  Bert  Pose  Prediction  Matching  PDF
• 2020-11-04 Prosodic Representation Learning and Contextual Sampling for Neural Text-to-Speech    Sri Karlapati, Ammar Abbas, Zack Hodari, Alexis Moinet, Arnaud Joly, Penny Karanasou, Thomas Drugman arXiv_CL arXiv_CL  Bert  Represenation_Learning  Speech  Pose  Attention  PDF
• 2020-11-04 Chinese Grammatical Correction Using BERT-based Pre-trained Model    Hongfei Wang, Michiki Kurosawa, Satoru Katsumata, Mamoru Komachi arXiv_CL arXiv_CL  Bert  PDF
• 2020-11-04 Probing Multilingual BERT for Genetic and Typological Signals    Taraka Rama, Lisa Beinborn, Steffen Eger arXiv_CL arXiv_CL  Bert  PDF
• 2020-11-03 Bertrand-DR: Improving Text-to-SQL using a Discriminative Re-ranker    Amol Kelkar, Rohan Relan, Vaishali Bhardwaj, Saurabh Vaichal, Chandra Khatri, Peter Relan arXiv_AI arXiv_AI  Bert  Pose  Relation  PDF
• 2020-11-03 Finding Friends and Flipping Frenemies: Automatic Paraphrase Dataset Augmentation Using Graph Theory    Hannah Chen, Yangfeng Ji, David Evans arXiv_CL arXiv_CL  Bert  Pose  PDF
• 2020-11-03 Tabular Transformers for Modeling Multivariate Time Series    Inkit Padhi, Yair Schiff, Igor Melnyk, Mattia Rigotti, Youssef Mroueh, Pierre Dognin, Jerret Ross, Ravi Nair, Erik Altman arXiv_AI arXiv_AI  Transformer  Bert  Pose  Action  Deep_Learning  Detection  PDF
• 2020-11-03 Towards Automated Anamnesis Summarization: BERT-based Models for Symptom Extraction    Anton Schäfer, Nils Blach, Oliver Rausch, Maximilian Warm, Nils Krüger arXiv_CL arXiv_CL  Bert  Pose  Action  Summarization  PDF
• 2020-11-03 XED: A Multilingual Dataset for Sentiment Analysis and Emotion Detection    Emily Öhman, Marc Pàmies, Kaisla Kajava, Jörg Tiedemann arXiv_CL arXiv_CL  Bert  Emotion  Detection  Sentiment  PDF
• 2020-11-03 CharBERT: Character-aware Pre-trained Language Model    Wentao Ma, Yiming Cui, Chenglei Si, Ting Liu, Shijin Wang, Guoping Hu arXiv_CL arXiv_CL  Embedding  Unsupervised  Bert  Text_Classification  Represenation_Learning  Adversarial  Pose  Action  Classification  Language_Model  PDF
• 2020-11-03 BioNerFlair: biomedical named entity recognition using flair embedding and sequence tagger    Harsh Patel arXiv_CL arXiv_CL  Transformer  Embedding  Recognition  OCR  Bert  RNN  Action  Medical  PDF
• 2020-11-03 Supervised Contrastive Learning for Pre-trained Language Model Fine-tuning    Beliz Gunel, Jingfei Du, Alexis Conneau, Ves Stoyanov arXiv_CL arXiv_CL  Unsupervised  Bert  Pose  Contrastive_Learning  Classification  Language_Model  PDF
• 2020-11-02 QMUL-SDS at SardiStance2020: Leveraging Network Interactions to Boost Performance on Stance Detection using Knowledge Graphs    Rabab Alkhalifa, Arkaitz Zubiaga arXiv_CL arXiv_CL  Embedding  Bert  RNN  Knowledge  Knowledge_Graph  Action  Detection  PDF
• 2020-11-02 Introducing various Semantic Models for Amharic: Experimentation and Evaluation with multiple Tasks and Datasets    Seid Muhie Yimam, Abinew Ali Ayele, Gopalakrishnan Venkatesh, Chris Biemann arXiv_CL arXiv_CL  Embedding  Bert  Language_Model  PDF
• 2020-11-02 DNN-Based Semantic Model for Rescoring N-best Speech Recognition List    Dominique Fohr, Irina Illina arXiv_CL arXiv_CL  Embedding  Recognition  Bert  RNN  Speech  Pose  Relation  Speech_Recognition  Language_Model  PDF
• 2020-11-02 A Closer Look at Linguistic Knowledge in Masked Language Models: The Case of Relative Clauses in American English    Marius Mosbach, Stefania Degaetano-Ortlieb, Marie-Pauline Krielke, Badr M. Abdullah, Dietrich Klakow arXiv_CL arXiv_CL  Transformer  Bert  Knowledge  Language_Model  Prediction  PDF
• 2020-11-02 On the Sentence Embeddings from Pre-trained Language Models    Bohan Li, Hao Zhou, Junxian He, Mingxuan Wang, Yiming Yang, Lei Li arXiv_CL arXiv_CL  Embedding  Unsupervised  Bert  Pose  Language_Model  PDF
• 2020-11-02 How Far Does BERT Look At:Distance-based Clustering and Analysis of BERTś Attention    Yue Guan, Jingwen Leng, Chao Li, Quan Chen, Minyi Guo arXiv_CL arXiv_CL  Transformer  Unsupervised  Bert  Pose  Attention  PDF
• 2020-11-02 Abstracting Influence Paths for Explaining BERT Models    Kaiji Lu, Zifan Wang, Piotr Mardziel, Anupam Datta arXiv_CL arXiv_CL  Bert  Action  Attention  PDF
• 2020-11-02 ABNIRML: Analyzing the Behavior of Neural IR Models    Sean MacAvaney, Sergey Feldman, Nazli Goharian, Doug Downey, Arman Cohan arXiv_CL arXiv_CL  Bert  Language_Model  PDF
• 2020-11-02 Liputan6: A Large-scale Indonesian Dataset for Text Summarization    Fajri Koto, Jey Han Lau, Timothy Baldwin arXiv_CL arXiv_CL  Bert  Pose  Summarization  Language_Model  PDF
• 2020-11-02 IndoLEM and IndoBERT: A Benchmark Dataset and Pre-trained Language Model for Indonesian NLP    Fajri Koto, Afshin Rahimi, Jey Han Lau, Timothy Baldwin arXiv_CL arXiv_CL  Bert  Language_Model  PDF
• 2020-11-01 Deconstruct to Reconstruct a Configurable Evaluation Metric for Open-Domain Dialogue Systems    Vitou Phy, Yang Zhao, Akiko Aizawa arXiv_AI arXiv_AI  Bert  Pose  Relation  PDF
• 2020-11-01 Transformer-based Multi-Aspect Modeling for Multi-Aspect Multi-Sentiment Analysis    Zhen Wu, Chengcan Ying, Xinyu Dai, Shujian Huang, Jiajun Chen arXiv_CL arXiv_CL  Transformer  Bert  Pose  Relation  Sentiment  PDF
• 2020-11-01 Investigation of BERT Model on Biomedical Relation Extraction Based on Revised Fine-tuning Mechanism    Peng Su, K. Vijay-Shanker arXiv_CL arXiv_CL  Transformer  Bert  Knowledge  Action  Classification  Relation  Relation_Extraction  Medical  PDF
• 2020-10-31 Neural Coreference Resolution for Arabic    Abdulrahman Aloraini, Juntao Yu, Massimo Poesio arXiv_CL arXiv_CL  Bert  Detection  Object_Detection  PDF
• 2020-10-31 Free the Plural: Unrestricted Split-Antecedent Anaphora Resolution    Juntao Yu, Nafise Sadat Moosavi, Silviu Paun, Massimo Poesio arXiv_CL arXiv_CL  Embedding  Transfer_Learning  Bert  Attention  PDF
• 2020-10-31 Understanding Pre-trained BERT for Aspect-based Sentiment Analysis    Hu Xu, Lei Shu, Philip S. Yu, Bing Liu arXiv_CL arXiv_CL  Unsupervised  Bert  Review  Self-Supervised  Sentiment  Attention  Language_Model  PDF
• 2020-10-30 Improving Dialogue Breakdown Detection with Semi-Supervised Learning    Nathan Ng, Marzyeh Ghassemi, Narendran Thangarajan, Jiacheng Pan, Qi Guo arXiv_CL arXiv_CL  Bert  Detection  PDF
• 2020-10-30 A Sui Generis QA Approach using RoBERTa for Adverse Drug Event Identification    Harshit Jain, Nishant Raj, Suyash Mishra arXiv_AI arXiv_AI  Bert  RNN  Memory_Networks  Action  Relation  Relation_Extraction  Attention  Medical  QA  PDF
• 2020-10-30 SLM: Learning a Discourse Language Representation with Sentence Unshuffling    Haejun Lee, Drew A. Hudson, Kangwook Lee, Christopher D. Manning arXiv_CL arXiv_CL  Transformer  Bert  Self-Supervised  Pose  Classification  Relation  Language_Model  PDF
• 2020-10-30 Target Word Masking for Location Metonymy Resolution    Haonan Li, Maria Vasardani, Martin Tomko, Timothy Baldwin arXiv_CL arXiv_CL  Bert  Pose  Classification  PDF
• 2020-10-29 Contextual BERT: Conditioning the Language Model Using a Global State    Timo I. Denk, Ana Peleteiro Ramallo arXiv_CL arXiv_CL  Bert  Language_Model  Prediction  PDF
• 2020-10-29 Combining Self-Training and Self-Supervised Learning for Unsupervised Disfluency Detection    Shaolei Wang, Zhongyuan Wang, Wanxiang Che, Ting Liu arXiv_CL arXiv_CL  Embedding  Unsupervised  Bert  Self-Supervised  Detection  PDF
• 2020-10-29 Multiple Sclerosis Severity Classification From Clinical Text    Alister D Costa, Stefan Denkovski, Michal Malyska, Sae Young Moon, Brandon Rufino, Zhen Yang, Taylor Killian, Marzyeh Ghassemi arXiv_CL arXiv_CL  Transformer  Embedding  Bert  Knowledge  Classification  Language_Model  Prediction  PDF
• 2020-10-28 Fusion Models for Improved Visual Captioning    Marimuthu Kalimuthu, Aditya Mogadala, Marius Mosbach, Dietrich Klakow arXiv_AI arXiv_AI  Image_Caption  Recognition  Bert  Speech  Pose  Speech_Recognition  Caption  Language_Model  PDF
• 2020-10-28 DeSMOG: Detecting Stance in Media On Global Warming    Yiwei Luo, Dallas Card, Dan Jurafsky arXiv_AI arXiv_AI  OCR  Bert  Detection  Attention  PDF
• 2020-10-28 Graph-based Topic Extraction from Vector Embeddings of Text Documents: Application to a Corpus of News Articles    M. Tarik Altuncu, Sophia N. Yaliraki, Mauricio Barahona arXiv_AI arXiv_AI  Transformer  Embedding  Unsupervised  Bert  Action  PDF
• 2020-10-28 Bayesian Methods for Semi-supervised Text Annotation    Kristian Miok, Gregor Pirs, Marko Robnik-Sikonja arXiv_CL arXiv_CL  Bert  Knowledge  Speech  Pose  Deep_Learning  Detection  Prediction  PDF
• 2020-10-28 A Chinese Text Classification Method With Low Hardware Requirement Based on Improved Model Concatenation    Yuanhao Zhuo arXiv_CL arXiv_CL  Bert  Text_Classification  RNN  Classification  PDF
• 2020-10-27 Unmasking Contextual Stereotypes: Measuring and Mitigating BERT's Gender Bias    Marion Bartl, Malvina Nissim, Albert Gatt arXiv_CL arXiv_CL  Embedding  Bert  Knowledge  Language_Model  PDF
• 2020-10-27 A Clarifying Question Selection System from NTES_ALONG in Convai3 Challenge    Wenjie Ou, Yue Lin arXiv_AI arXiv_AI  Bert  Pose  PDF
• 2020-10-27 MMFT-BERT: Multimodal Fusion Transformer with BERT Encodings for Visual Question Answering    Aisha Urooj Khan, Amir Mazaheri, Niels da Vitoria Lobo, Mubarak Shah arXiv_CV arXiv_CV  Transformer  Bert  Knowledge  Pose  VQA  QA  PDF
• 2020-10-27 To BERT or Not to BERT: Comparing Task-specific and Task-agnostic Semi-Supervised Approaches for Sequence Tagging    Kasturi Bhattacharjee, Miguel Ballesteros, Rishita Anubhai, Smaranda Muresan, Jie Ma, Faisal Ladhak, Yaser Al-Onaizan arXiv_CL arXiv_CL  Transformer  Bert  PDF
• 2020-10-26 Fine-grained Information Status Classification Using Discourse Context-Aware BERT    Yufang Hou arXiv_CL arXiv_CL  Recognition  Bert  Pose  Classification  PDF
• 2020-10-26 Semi-Supervised Spoken Language Understanding via Self-Supervised Speech and Language Model Pretraining    Cheng-I Lai, Yung-Sung Chuang, Hung-Yi Lee, Shang-Wen Li, James Glass arXiv_CL arXiv_CL  Unsupervised  Bert  Speech  Self-Supervised  Pose  Language_Model  PDF
• 2020-10-26 Dutch Humor Detection by Generating Negative Examples    Thomas Winters, Pieter Delobelle arXiv_AI arXiv_AI  Transformer  Recognition  Bert  Pose  Classification  Detection  Text_Generation  Language_Model  PDF
• 2020-10-26 UPB at SemEval-2020 Task 12: Multilingual Offensive Language Detection on Social Media by Fine-tuning a Variety of BERT-based Models    Mircea-Adrian Tanase, Dumitru-Clementin Cercel, Costing-Gabriel Chiru arXiv_CL arXiv_CL  Transformer  Bert  Pose  Detection  PDF
• 2020-10-26 Three computational models and its equivalence    Ciro Ivan Garcia Lopez arXiv_CL arXiv_CL  Bert  PDF
• 2020-10-25 Two-stage Textual Knowledge Distillation to Speech Encoder for Spoken Language Understanding    Seongbin Kim, Gyuwan Kim, Seongjin Shin, Sangmin Lee arXiv_CL arXiv_CL  Recognition  Bert  Knowledge  Speech  Pose  Speech_Recognition  PDF
• 2020-10-25 Contextualized Word Embeddings Encode Aspects of Human-Like Word Sense Knowledge    Sathvik Nair, Mahesh Srinivasan, Stephan Meylan arXiv_CL arXiv_CL  Embedding  Bert  Knowledge  PDF
• 2020-10-25 Commonsense knowledge adversarial dataset that challenges ELECTRA    Gongqi Lin, Yuan Miao, Xiaoyong Yang, Wenwu Ou, Lizhen Cui, Wei Guo, Chunyan Miao arXiv_CL arXiv_CL  Bert  Knowledge  Adversarial  QA  PDF
• 2020-10-25 CRAB: Class Representation Attentive BERT for Hate Speech Identification in Social Media    Sayyed M. Zahiri, Ali Ahmadvand arXiv_AI arXiv_AI  Embedding  Bert  Speech  Detection  PDF
• 2020-10-25 Discriminative Nearest Neighbor Few-Shot Intent Detection by Transferring Natural Language Inference    Jian-Guo Zhang, Kazuma Hashimoto, Wenhao Liu, Chien-Sheng Wu, Yao Wan, Philip S. Yu, Richard Socher, Caiming Xiong arXiv_AI arXiv_AI  Embedding  Bert  Pose  Classification  Detection  Few-Shot  Attention  Inference  PDF
• 2020-10-24 Pre-trained Summarization Distillation    Sam Shleifer, Alexander M. Rush arXiv_AI arXiv_AI  Transformer  Bert  Knowledge  Face  Classification  Summarization  PDF
• 2020-10-24 Causal Effects of Linguistic Properties    Reid Pryzant, Dallas Card, Dan Jurafsky, Victor Veitch, Dhanya Sridhar arXiv_AI arXiv_AI  Bert  Review  Pose  Sentiment  Language_Model  Prediction  PDF
• 2020-10-24 Unsupervised Paraphrase Generation via Dynamic Blocking    Tong Niu, Semih Yavuz, Yingbo Zhou, Huan Wang, Nitish Shirish Keskar, Caiming Xiong arXiv_CL arXiv_CL  Unsupervised  Bert  Pose  Face  Language_Model  Matching  PDF
• 2020-10-24 When Being Unseen from mBERT is just the Beginning: Handling New Languages With Multilingual Language Models    Benjamin Muller, Antonis Anastasopoulos, Benoît Sagot, Djamé Seddah arXiv_CL arXiv_CL  Transfer_Learning  Bert  Language_Model  PDF
• 2020-10-24 Weakly-supervised VisualBERT: Pre-training without Parallel Images and Captions    Liunian Harold Li, Haoxuan You, Zhecan Wang, Alireza Zareian, Shih-Fu Chang, Kai-Wei Chang arXiv_CV arXiv_CV  Recognition  Bert  Pose  Caption  PDF
• 2020-10-24 Cross-neutralising: Probing for joint encoding of linguistic information in multilingual models    Rochelle Choenni, Ekaterina Shutova arXiv_CL arXiv_CL  Bert  Pose  Relation  PDF
• 2020-10-24 Pre-training Text-to-Text Transformers for Concept-centric Common Sense    Wangchunshu Zhou, Dong-Ho Lee, Ravi Kiran Selvam, Seyeon Lee, Bill Yuchen Lin, Xiang Ren arXiv_AI arXiv_AI  Transformer  Bert  Knowledge  Knowledge_Graph  Self-Supervised  Pose  Relation  Language_Model  Prediction  PDF
• 2020-10-24 COUGH: A Challenge Dataset and Models for COVID-19 FAQ Retrieval    Xinliang Frederick Zhang, Heming Sun, Xiang Yue, Emmett Jesrani, Simon Lin, Huan Sun arXiv_CL arXiv_CL  Bert  PDF
• 2020-10-24 Multi-Domain Dialogue State Tracking -- A Purely Transformer-Based Generative Approach    Yan Zeng, Jian-Yun Nie arXiv_AI arXiv_AI  Transformer  Tracking  Bert  RNN  Pose  Ontology  Attention  Prediction  PDF
• 2020-10-24 Structure-Grounded Pretraining for Text-to-SQL    Xiang Deng, Ahmed Hassan Awadallah, Christopher Meek, Oleksandr Polozov, Huan Sun, Matthew Richardson arXiv_AI arXiv_AI  Bert  Weakly_Supervised  Prediction  PDF
• 2020-10-24 Char2Subword: Extending the Subword Embedding Space from Pre-trained Models Using Robust Character Compositionality    Gustavo Aguilar, Bryan McCann, Tong Niu, Nazneen Rajani, Nitish Keskar, Thamar Solorio arXiv_CL arXiv_CL  Transformer  Embedding  Bert  Adversarial  Pose  Language_Model  PDF
• 2020-10-23 Long Document Ranking with Query-Directed Sparse Transformer    Jyun-Yu Jiang, Chenyan Xiong, Chia-Jung Lee, Wei Wang arXiv_AI arXiv_AI  Transformer  Bert  Sparse  Few-Shot  Attention  Prediction  Matching  PDF
• 2020-10-23 Posterior Differential Regularization with f-divergence for Improving Model Robustness    Hao Cheng, Xiaodong Liu, Lis Pereira, Yaoliang Yu, Jianfeng Gao arXiv_CL arXiv_CL  Bert  Regularization  Adversarial  Pose  PDF
• 2020-10-23 Did You Ask a Good Question? A Cross-Domain Question Intention Classification Benchmark for Text-to-SQL    Yusen Zhang, Xiangyu Dong, Shuaichen Chang, Tao Yu, Peng Shi, Rui Zhang arXiv_CL arXiv_CL  Bert  Pose  Classification  PDF
• 2020-10-23 Topic Modeling with Contextualized Word Representation Clusters    Laure Thompson, David Mimno arXiv_CL arXiv_CL  Embedding  Bert  GAN  Language_Model  PDF
• 2020-10-23 DICT-MLM: Improved Multilingual Pre-Training using Bilingual Dictionaries    Aditi Chaudhary, Karthik Raman, Krishna Srinivasan, Jiecao Chen arXiv_CL arXiv_CL  Bert  Zero-Shot  Represenation_Learning  Pose  Language_Model  PDF
• 2020-10-23 On the Transformer Growth for Progressive BERT Training    Xiaotao Gu, Liyuan Liu, Hongkun Yu, Jing Li, Chen Chen, Jiawei Han arXiv_CL arXiv_CL  Transformer  Bert  Pose  PDF
• 2020-10-23 Multilingual BERT Post-Pretraining Alignment    Lin Pan, Chung-Wei Hang, Haode Qi, Abhishek Shah, Mo Yu, Saloni Potdar arXiv_CL arXiv_CL  Embedding  Bert  Zero-Shot  Pose  Contrastive_Learning  Language_Model  QA  PDF
• 2020-10-23 GiBERT: Introducing Linguistic Knowledge into BERT through a Lightweight Gated Injection Method    Nicole Peinelt, Marek Rei, Maria Liakata arXiv_CL arXiv_CL  Embedding  Unsupervised  Bert  Knowledge  Pose  Language_Model  PDF
• 2020-10-23 Understanding the Extent to which Summarization Evaluation Metrics Measure the Information Quality of Summaries    Daniel Deutsch, Dan Roth arXiv_CL arXiv_CL  Bert  Pose  Summarization  PDF
• 2020-10-23 HateBERT: Retraining BERT for Abusive Language Detection in English    Tommaso Caselli, Valerio Basile, Jelena Mitrović, Michael Granitzer arXiv_CL arXiv_CL  Bert  Speech  Detection  Language_Model  PDF
• 2020-10-23 BARThez: a Skilled Pretrained French Sequence-to-Sequence Model    Moussa Kamal Eddine, Antoine J.-P. Tixier, Michalis Vazirgiannis arXiv_CL arXiv_CL  Transfer_Learning  Bert  Knowledge  Self-Supervised  Summarization  Language_Model  PDF
• 2020-10-23 ST-BERT: Cross-modal Language Model Pre-training For End-to-end Spoken Language Understanding    Minjeong Kim, Gyuwan Kim, Sang-Woo Lee, Jung-Woo Ha arXiv_CL arXiv_CL  Bert  Speech  Pose  Language_Model  PDF
• 2020-10-23 Pre-trained Model for Chinese Word Segmentation with Meta Learning    Zhen Ke, Liang Shi, Erli Meng, Bin Wang, Xipeng Qiu arXiv_CL arXiv_CL  Segmentation  Bert  Knowledge  Pose  PDF
• 2020-10-23 ERNIE-Gram: Pre-Training with Explicitly N-Gram Masked Language Modeling for Natural Language Understanding    Dongling Xiao, Yu-Kun Li, Han Zhang, Yu Sun, Hao Tian, Hua Wu, Haifeng Wang arXiv_CL arXiv_CL  Bert  Represenation_Learning  Pose  Relation  Language_Model  Prediction  PDF
• 2020-10-22 Summarizing Utterances from Japanese Assembly Minutes using Political Sentence-BERT-based Method for QA Lab-PoliInfo-2 Task of NTCIR-15    Daiki Shirafuji, Hiromichi Kameya, Rafal Rzepka, Kenji Araki arXiv_CL arXiv_CL  Embedding  Bert  Summarization  QA  PDF
• 2020-10-22 Language Models are Open Knowledge Graphs    Chenguang Wang, Xiao Liu, Dawn Song arXiv_AI arXiv_AI  Unsupervised  Bert  Knowledge  Knowledge_Graph  Pose  Language_Model  PDF
• 2020-10-22 UniCase -- Rethinking Casing in Language Models    Rafal Powalski, Tomasz Stanislawek arXiv_AI arXiv_AI  Bert  Pose  Language_Model  PDF
• 2020-10-22 Rewriting Meaningful Sentences via Conditional BERT Sampling and an application on fooling text classifiers    Lei Xu, Ivan Ramirez, Kalyan Veeramachaneni arXiv_AI arXiv_AI  Bert  Adversarial  Pose  Prediction  PDF
• 2020-10-22 Self-alignment Pre-training for Biomedical Entity Representations    Fangyu Liu, Ehsan Shareghi, Zaiqiao Meng, Marco Basaldella, Nigel Collier arXiv_AI arXiv_AI  Bert  Knowledge  Self-Supervised  Pose  Relation  Medical  Language_Model  PDF
• 2020-10-22 Improving BERT Performance for Aspect-Based Sentiment Analysis    Akbar Karimi, Leonardo Rossi, Andrea Prati arXiv_CL arXiv_CL  Bert  Sentiment_Classification  Review  Pose  Action  Classification  Sentiment  Language_Model  PDF
• 2020-10-22 Adversarial Training for Aspect-Based Sentiment Analysis with BERT    Akbar Karimi, Leonardo Rossi, Andrea Prati, Katharina Full arXiv_CL arXiv_CL  Embedding  Bert  Sentiment_Classification  Regularization  Knowledge  Adversarial  Pose  Action  Classification  Sentiment  Language_Model  PDF
• 2020-10-22 Towards Fully Bilingual Deep Language Modeling    Li-Hsin Chang, Sampo Pyysalo, Jenna Kanerva, Filip Ginter arXiv_CL arXiv_CL  Bert  Language_Model  PDF
• 2020-10-22 Knowledge Distillation for BERT Unsupervised Domain Adaptation    Minho Ryu, Kichun Lee arXiv_CL arXiv_CL  Unsupervised  Bert  Sentiment_Classification  Knowledge  Adversarial  Pose  Classification  Sentiment  Language_Model  PDF
• 2020-10-22 Kwame: A Bilingual AI Teaching Assistant for Online SuaCode Courses    George Boateng arXiv_AI arXiv_AI  Bert  QA  PDF
• 2020-10-22 Distilling Dense Representations for Ranking using Tightly-Coupled Teachers    Sheng-Chieh Lin, Jheng-Hong Yang, Jimmy Lin arXiv_CL arXiv_CL  Bert  Sparse  Knowledge  Pose  Action  PDF
• 2020-10-21 Latte-Mix: Measuring Sentence Semantic Similarity with Latent Categorical Mixtures    M. Li, H. Bai, L. Tan, K. Xiong, M. Li, J. Lin arXiv_CL arXiv_CL  Embedding  Bert  Zero-Shot  Pose  Language_Model  PDF
• 2020-10-21 Detection of COVID-19 informative tweets using RoBERTa    Sirigireddy Dhanalaxmi, Rohit Agarwal, Aman Sinha arXiv_CL arXiv_CL  Bert  Detection  PDF
• 2020-10-21 Generalized Conditioned Dialogue Generation Based on Pre-trained Language Model    Yan Zeng, Jian-Yun Nie arXiv_AI arXiv_AI  Bert  Pose  Attention  Language_Model  PDF
• 2020-10-21 German's Next Language Model    Branden Chan, Stefan Schweter, Timo Möller arXiv_CL arXiv_CL  Recognition  Bert  Classification  Language_Model  PDF
• 2020-10-21 BERT for Joint Multichannel Speech Dereverberation with Spatial-aware Tasks    Yang Jiao arXiv_CL arXiv_CL  Transformer  Bert  Speech  Self-Supervised  Pose  PDF
• 2020-10-20 AutoMeTS: The Autocomplete for Medical Text Simplification    Hoang Van, David Kauchak, Gondy Leroy arXiv_CL arXiv_CL  Bert  Medical  Language_Model  Prediction  PDF
• 2020-10-20 Optimal Subarchitecture Extraction For BERT    Adrian de Wynter, Daniel J. Perry arXiv_CL arXiv_CL  NAS  Embedding  Bert  Action  PDF
• 2020-10-20 BERT2DNN: BERT Distillation with Massive Unlabeled Data for Online E-Commerce Search    Yunjiang Jiang, Yue Shang, Ziyang Liu, Hongwei Shen, Yun Xiao, Wei Xiong, Sulong Xu, Weipeng Yan, Di Jin arXiv_AI arXiv_AI  Transformer  Embedding  Bert  Knowledge  Pose  Sentiment  GAN  Prediction  PDF
• 2020-10-20 Open Question Answering over Tables and Text    Wenhu Chen, Ming-Wei Chang, Eva Schlinger, William Wang, William W. Cohen arXiv_AI arXiv_AI  Bert  Sparse  Pose  Attention  Inference  QA  PDF
• 2020-10-20 ConjNLI: Natural Language Inference Over Conjunctive Sentences    Swarnadeep Saha, Yixin Nie, Mohit Bansal arXiv_AI arXiv_AI  Bert  Knowledge  Adversarial  Pose  Inference  Language_Model  PDF
• 2020-10-20 CharacterBERT: Reconciling ELMo and BERT for Word-Level Open-Vocabulary Representations From Characters    Hicham El Boukkouri, Olivier Ferret, Thomas Lavergne, Hiroshi Noji, Pierre Zweigenbaum, Junichi Tsujii arXiv_CL arXiv_CL  Transformer  Bert  Pose  Medical  PDF
• 2020-10-20 UmlsBERT: Clinical Domain Knowledge Augmentation of Contextual Embeddings Using the Unified Medical Language System Metathesaurus    George Michalopoulos, Yuanxin Wang, Hussam Kaka, Helen Chen, Alex Wong arXiv_AI arXiv_AI  Embedding  Recognition  Bert  Knowledge  Medical  Inference  PDF
• 2020-10-20 A Benchmark for Lease Contract Review    Spyretta Leivaditi, Julien Rossi, Evangelos Kanoulas arXiv_CL arXiv_CL  Bert  Review  Action  Detection  Attention  Language_Model  PDF
• 2020-10-20 Text Classification of COVID-19 Press Briefings using BERT and Convolutional Neural Networks    Kakia Chatsiou arXiv_CL arXiv_CL  Transformer  Embedding  Bert  Text_Classification  Classification  CNN  Language_Model  PDF
• 2020-10-20 Performance of Transfer Learning Model vs. Traditional Neural Network in Low System Resource Environment    William Hui arXiv_CL arXiv_CL  Transfer_Learning  Bert  Text_Classification  Pose  Classification  PDF
• 2020-10-20 What makes multilingual BERT multilingual?    Chi-Liang Liu, Tsung-Yuan Hsu, Yung-Sung Chuang, Hung-yi Lee arXiv_CL arXiv_CL  Embedding  Bert  PDF
• 2020-10-20 Language Representation in Multilingual BERTand its applications to improve Cross-lingual Generalization    Chi-Liang Liu, Tsung-Yuan Hsu, Yung-Sung Chuang, Hung-yi Lee arXiv_AI arXiv_AI  Embedding  Unsupervised  Bert  Pose  PDF
• 2020-10-19 ColloQL: Robust Cross-Domain Text-to-SQL Over Search Queries    Karthik Radhakrishnan, Arvind Srikantan, Xi Victoria Lin arXiv_AI arXiv_AI  Bert  Knowledge  Relation  PDF
• 2020-10-19 ChemBERTa: Large-Scale Self-Supervised Pretraining for Molecular Property Prediction    Seyone Chithrananda, Gabe Grand, Bharath Ramsundar arXiv_CL arXiv_CL  Transformer  Bert  Represenation_Learning  Self-Supervised  Face  Attention  Prediction  PDF
• 2020-10-19 Cross-Lingual Transfer in Zero-Shot Cross-Language Entity Linking    Elliot Schumacher, James Mayfield, Mark Dredze arXiv_CL arXiv_CL  Bert  Zero-Shot  Knowledge  Pose  PDF
• 2020-10-19 Question Generation for Supporting Informational Query Intents    Xusen Yin, Jonathan May, Li Zhou, Kevin Small arXiv_CL arXiv_CL  Bert  QA  PDF
• 2020-10-19 An Empirical Study for Vietnamese Constituency Parsing with Pre-training    Tuan-Vi Tran, Xuan-Thien Pham, Duc-Vu Nguyen, Kiet Van Nguyen, Ngan Luu-Thuy Nguyen arXiv_CL arXiv_CL  Bert  Attention  Inference  PDF
• 2020-10-19 Drug Repurposing for COVID-19 via Knowledge Graph Completion    Rui Zhang, Dimitar Hristovski, Dalton Schutte, Andrej Kastrin, Marcelo Fiszman, Halil Kilicoglu arXiv_CL arXiv_CL  Bert  Knowledge  Knowledge_Graph  Pose  Relation  PDF
• 2020-10-19 Better Distractions: Transformer-based Distractor Generation and Multiple Choice Question Filtering    Jeroen Offerijns, Suzan Verberne, Tessa Verhoef arXiv_CL arXiv_CL  Transformer  Bert  Action  Attention  Text_Generation  Language_Model  QA  PDF
• 2020-10-19 Cold-start Active Learning through Self-supervised Language Modeling    Michelle Yuan, Hsuan-Tien Lin, Jordan Boyd-Graber arXiv_CL arXiv_CL  Bert  Text_Classification  Self-Supervised  Classification  Language_Model  PDF
• 2020-10-19 The RELX Dataset and Matching the Multilingual Blanks for Cross-Lingual Relation Classification    Abdullatif Köksal, Arzucan Özgür arXiv_CL arXiv_CL  Bert  Knowledge  Pose  Action  Classification  Relation  Matching  PDF
• 2020-10-19 BERTnesia: Investigating the capture and forgetting of knowledge in BERT    Jonas Wallat, Jaspreet Singh, Avishek Anand arXiv_CL arXiv_CL  Bert  Knowledge  Relation  Language_Model  PDF
• 2020-10-19 SciSummPip: An Unsupervised Scientific Paper Summarization Pipeline    Jiaxin Ju, Ming Liu, Longxiang Gao, Shirui Pan arXiv_CL arXiv_CL  Transformer  Unsupervised  Bert  Summarization  Language_Model  PDF
• 2020-10-18 Explaining and Improving Model Behavior with k Nearest Neighbor Representations    Nazneen Fatema Rajani, Ben Krause, Wengpeng Yin, Tong Niu, Richard Socher, Caiming Xiong arXiv_CL arXiv_CL  Bert  Salient  Adversarial  Pose  Attention  Inference  Prediction  PDF
• 2020-10-18 Towards Interpreting BERT for Reading Comprehension Based QA    Sahana Ramnath, Preksha Nema, Deep Sahni, Mitesh M. Khapra arXiv_AI arXiv_AI  Bert  Pose  Action  Prediction  QA  PDF
• 2020-10-17 Question Answering over Knowledge Base using Language Model Embeddings    Sai Sharath Japa, Rekabdar Banafsheh arXiv_CL arXiv_CL  Embedding  Bert  Knowledge  Pose  Ontology  Relation  Attention  CNN  Language_Model  PDF
• 2020-10-17 HABERTOR: An Efficient and Effective Deep Hatespeech Detector    Thanh Tran, Yifan Hu, Changwei Hu, Kevin Yen, Fei Tan, Kyumin Lee, Serim Park arXiv_AI arXiv_AI  Bert  Adversarial  Speech  Pose  Classification  Detection  Object_Detection  Language_Model  PDF
• 2020-10-17 Hierarchical Multitask Learning Approach for BERT    Çağla Aksoy, Alper Ahmetoğlu, Tunga Güngör arXiv_CL arXiv_CL  Embedding  Bert  Pose  Language_Model  Prediction  PDF
• 2020-10-17 Answer-checking in Context: A Multi-modal FullyAttention Network for Visual Question Answering    Hantao Huang, Tao Han, Wei Han, Deep Yap, Cheng-Ming Chiang arXiv_CV arXiv_CV  Image_Caption  Bert  Pose  Relation  VQA  Attention  QA  PDF
• 2020-10-17 Example-Driven Intent Prediction with Observers    Shikib Mehri, Mihail Eric, Dilek Hakkani-Tur arXiv_AI arXiv_AI  Bert  Pose  Classification  Few-Shot  Attention  Prediction  PDF
• 2020-10-17 TweetBERT: A Pretrained Language Representation Model for Twitter Text Analysis    Mohiuddin Md Abdul Qudar, Vijay Mago arXiv_CL arXiv_CL  Bert  Deep_Learning  Language_Model  PDF
• 2020-10-16 CoDA: Contrast-enhanced and Diversity-promoting Data Augmentation for Natural Language Understanding    Yanru Qu, Dinghan Shen, Yelong Shen, Sandra Sajeev, Jiawei Han, Weizhu Chen arXiv_CL arXiv_CL  Transformer  Bert  Regularization  Adversarial  Pose  Relation  GAN  PDF
• 2020-10-16 Generalized Intersection Algorithms with Fixpoints for Image Decomposition Learning    Robin Richter, Duy H. Thai, Stephan F. Huckemann arXiv_CV arXiv_CV  Bert  Denoising  PDF
• 2020-10-16 Linguistically-Informed Transformations : A Method forAutomatically Generating Contrast Sets    Chuanrong Li, Lin Shengshuo, Leo Z. Liu, Xinyi Wu, Xuhui Zhou, Shane Steinert-Threlkeld arXiv_CL arXiv_CL  Bert  Knowledge  Pose  Language_Model  PDF
• 2020-10-16 Delaying Interaction Layers in Transformer-based Encoders for Efficient Open Domain Question Answering    Wissam Siblini, Mohamed Challal, Charlotte Pasqual arXiv_CL arXiv_CL  Transformer  Bert  Pose  Face  Action  Attention  Language_Model  QA  PDF
• 2020-10-16 It's not Greek to mBERT: Inducing Word-Level Translations from Multilingual BERT    Hila Gonen, Shauli Ravfogel, Yanai Elazar, Yoav Goldberg arXiv_CL arXiv_CL  Bert  Pose  PDF
• 2020-10-16 Augmented SBERT: Data Augmentation Method for Improving Bi-Encoders for Pairwise Sentence Scoring Tasks    Nandan Thakur, Nils Reimers, Johannes Daxenberger, Iryna Gurevych arXiv_CL arXiv_CL  Bert  Attention  PDF
• 2020-10-16 Coarse-to-Fine Pre-training for Named Entity Recognition    Mengge Xue, Bowen Yu, Zhenyu Zhang, Tingwen Liu, Yue Zhang, Bin Wang arXiv_CL arXiv_CL  Recognition  Bert  Knowledge  Self-Supervised  Pose  PDF
• 2020-10-15 CXP949 at WNUT-2020 Task 2: Extracting Informative COVID-19 Tweets -- RoBERTa Ensembles and The Continued Relevance of Handcrafted Features    Calum Perrio, Harish Tayyar Madabushi arXiv_CL arXiv_CL  Transformer  Bert  Text_Classification  Classification  Language_Model  PDF
• 2020-10-15 Explicit Alignment Objectives for Multilingual Bidirectional Encoders    Junjie Hu, Melvin Johnson, Orhan Firat, Aditya Siddhant, Graham Neubig arXiv_AI arXiv_AI  Embedding  Transfer_Learning  Bert  Zero-Shot  Classification  PDF
• 2020-10-15 Fixed-Length Protein Embeddings using Contextual Lenses    Amir Shanehsazzadeh, David Belanger, David Dohan arXiv_CL arXiv_CL  Transformer  Embedding  Bert  Pose  Classification  Deep_Learning  Language_Model  PDF
• 2020-10-15 Response Selection for Multi-Party Conversations withDynamic Topic Tracking    Weishi Wang§, Shafiq Joty§, Steven C.H. Hoi arXiv_AI arXiv_AI  Tracking  Bert  Self-Supervised  Pose  PDF
• 2020-10-15 Unsupervised Bitext Mining and Translation via Self-trained Contextual Embeddings    Phillip Keung, Julian Salazar, Yichao Lu, Noah A. Smith arXiv_CL arXiv_CL  Embedding  Unsupervised  Bert  PDF
• 2020-10-15 A Transformer Based Pitch Sequence Autoencoder with MIDI Augmentation    Mingshuo Ding, Yinghao Ma arXiv_SD arXiv_SD  Transformer  Bert  Pose  Classification  Deep_Learning  Attention  Language_Model  PDF
• 2020-10-15 Does Chinese BERT Encode Word Structure?    Yile Wang, Leyang Cui, Yue Zhang arXiv_CL arXiv_CL  Bert  Knowledge  Attention  Inference  PDF
• 2020-10-15 Context-Guided BERT for Targeted Aspect-Based Sentiment Analysis    Zhengxuan Wu, Desmond C. Ong arXiv_AI arXiv_AI  Transformer  Bert  Pose  Sentiment  Attention  Inference  Language_Model  QA  PDF
• 2020-10-15 Neural Deepfake Detection with Factual Structure of Text    Wanjun Zhong, Duyu Tang, Zenan Xu, Ruize Wang, Nan Duan, Ming Zhou, Jiahai Wang, Jian Yin arXiv_CL arXiv_CL  Bert  Pose  Detection  Relation  Prediction  PDF
• 2020-10-15 TopicBERT for Energy Efficient Document Classification    Yatin Chaudhary, Pankaj Gupta, Khushbu Saxena, Vivek Kulkarni, Thomas Runkler, Hinrich Schütze arXiv_CL arXiv_CL  Bert  Classification  Attention  Language_Model  PDF
• 2020-10-14 Geometry matters: Exploring language examples at the decision boundary    Debajyoti Datta, Shashwat Kumar, Laura Barnes, Tom Fletcher arXiv_CL arXiv_CL  Bert