Language_Model

2021-05-17 Stage-wise Fine-tuning for Graph-to-Text Generation Qingyun Wang, Semih Yavuz, Victoria Lin, Heng Ji, Nazneen Rajani arXiv_AI arXiv_AI Embedding Knowledge Knowledge_Graph Pose Text_Generation Language_Model PDF
2021-05-17 Sentence Similarity Based on Contexts Xiaofei Sun, Yuxian Meng, Xiang Ao, Fei Wu, Tianwei Zhang, Jiwei Li, Chun Fan arXiv_CL arXiv_CL Unsupervised Pose Face Language_Model PDF
2021-05-16 Doc2Dict: Information Extraction as Text Generation Benjamin Townsend, Eamon Ito-Fisher, Lily Zhang, Madison May arXiv_AI arXiv_AI Transformer Action Text_Generation Language_Model PDF
2021-05-16 How is BERT surprised? Layerwise detection of linguistic anomalies Bai Li, Zining Zhu, Guillaume Thomas, Yang Xu, Frank Rudzicz arXiv_CL arXiv_CL Transformer Bert Detection Relation Language_Model PDF
2021-05-16 The interplay between morphological typology and script on a novel multi-layer Algerian dialect corpus Samia Touileb, Jeremy Barnes arXiv_CL arXiv_CL Speech Relation Sentiment Language_Model PDF
2021-05-15 From Masked Language Modeling to Translation: Non-English Auxiliary Tasks Improve Zero-shot Spoken Language Understanding Rob van der Goot, Ibrahim Sharaf, Aizhan Imankulova, Ahmet Üstün, Marija Stepanović, Alan Ramponi, Siti Oryza Khairunnisa, Mamoru Komachi, Barbara Plank arXiv_CL arXiv_CL Embedding Zero-Shot Pose Classification Detection Language_Model PDF
2021-05-15 A Cognitive Regularizer for Language Modeling Jason Wei, Clara Meister, Ryan Cotterell arXiv_CL arXiv_CL Regularization Action Language_Model PDF
2021-05-14 Counterfactual Interventions Reveal the Causal Effect of Relative Clause Representations on Agreement Prediction Shauli Ravfogel, Grusha Prasad, Tal Linzen, Yoav Goldberg arXiv_CL arXiv_CL Bert Pose Language_Model Prediction PDF
2021-05-14 Generating Empathetic Responses with a Large Scale Dialog Dataset Yubo Xie, Pearl Pu arXiv_CL arXiv_CL Emotion Action Language_Model PDF
2021-05-14 Classifying Long Clinical Documents with Pre-trained Transformers Xin Su, Timothy Miller, Xiyu Ding, Majid Afshar, Dmitriy Dligach arXiv_CL arXiv_CL Transformer Bert Language_Model PDF
2021-05-14 Joint Retrieval and Generation Training for Grounded Text Generation Yizhe Zhang, Siqi Sun, Xiang Gao, Yuwei Fang, Chris Brockett, Michel Galley, Jianfeng Gao, Bill Dolan arXiv_AI arXiv_AI Pose Text_Generation Language_Model PDF
2021-05-13 Not All Memories are Created Equal: Learning to Forget by Expiring Sainbayar Sukhbaatar, Da Ju, Spencer Poff, Stephen Roller, Arthur Szlam, Jason Weston, Angela Fan arXiv_AI arXiv_AI Transformer Reinforcement_Learning Pose Attention Language_Model PDF
2021-05-13 Retrieval-Free Knowledge-Grounded Dialogue Response Generation with Adapters Yan Xu, Etsuko Ishii, Zihan Liu, Genta Indra Winata, Dan Su, Andrea Madotto, Pascale Fung arXiv_AI arXiv_AI Knowledge Pose Language_Model PDF
2021-05-13 Towards Human-Free Automatic Quality Evaluation of German Summarization Neslihan Iskender, Oleg Vasilyev, Tim Polzehl, John Bohannon, Sebastian Möller arXiv_CL arXiv_CL Pose GAN Summarization Language_Model PDF
2021-05-13 Are Larger Pretrained Language Models Uniformly Better? Comparing Performance at the Instance Level Ruiqi Zhong, Dhruba Ghosh, Dan Klein, Jacob Steinhardt arXiv_AI arXiv_AI Bert Language_Model Prediction PDF
2021-05-12 Go Beyond Plain Fine-tuning: Improving Pretrained Models for Social Commonsense Ting-Yun Chang, Yang Liu, Karthik Gopalakrishnan, Behnam Hedayatnia, Pei Zhou, Dilek Hakkani-Tur arXiv_CL arXiv_CL Bert Pose Emotion Language_Model QA PDF
2021-05-12 MATE-KD: Masked Adversarial TExt, a Companion to Knowledge Distillation Ahmad Rashid, Vasileios Lioutas, Mehdi Rezagholizadeh arXiv_CL arXiv_CL Bert Knowledge Adversarial Language_Model PDF
2021-05-12 Playing Codenames with Language Graphs and Word Embeddings Divya Koyyalagunta, Anna Sun, Rachel Lea Draelos, Cynthia Rudin arXiv_AI arXiv_AI Embedding Bert Pose Relation Language_Model PDF
2021-05-12 How Reliable are Model Diagnostics? Vamsi Aribandi, Yi Tay, Donald Metzler arXiv_CL arXiv_CL Language_Model Recommendation PDF
2021-05-12 StutterNet: Stuttering Detection Using Time Delay Neural Network Shakeel A. Sheikh, Md Sahidullah, Fabrice Hirsch, Slim Ouni arXiv_SD arXiv_SD Recognition Speech Pose Deep_Learning Detection Speech_Recognition Language_Model PDF
2021-05-12 Incorporating Commonsense Knowledge Graph in Pretrained Models for Social Commonsense Tasks Ting-Yun Chang, Yang Liu, Karthik Gopalakrishnan, Behnam Hedayatnia, Pei Zhou, Dilek Hakkani-Tur arXiv_CL arXiv_CL Knowledge Knowledge_Graph Pose Relation Language_Model QA PDF
2021-05-11 One-shot Compositional Data Generation for Low Resource Handwritten Text Recognition Mohamed Ali Souibgui, Ali Furkan Biten, Sounak Dey, Alicia Fornés, Yousri Kessentini, Lluis Gomez, Dimosthenis Karatzas, Josep Lladós arXiv_CV arXiv_CV Segmentation Handwriting Recognition Pose Quantitative Language_Model PDF
2021-05-11 Addressing 'Documentation Debt' in Machine Learning Research: A Retrospective Datasheet for BookCorpus Jack Bandy, Nicholas Vincent arXiv_CL arXiv_CL Bert Sparse Language_Model PDF
2021-05-11 Integrating extracted information from bert and multiple embedding methods with the deep neural network for humour detection Rida Miraj, Masaki Aono arXiv_AI arXiv_AI Embedding Bert Pose Detection Language_Model PDF
2021-05-11 Joint Text and Label Generation for Spoken Language Understanding Yang Li, Ben Athiwaratkun, Cicero Nogueira dos Santos, Bing Xiang arXiv_CL arXiv_CL Regularization Knowledge Pose Classification Language_Model PDF
2021-05-11 BERT is to NLP what AlexNet is to CV: Can Pre-Trained Language Models Identify Analogies? Asahi Ushio, Luis Espinosa-Anke, Steven Schockaert, Jose Camacho-Collados arXiv_CL arXiv_CL Transformer Embedding Unsupervised Bert Knowledge Relation Attention Language_Model PDF
2021-05-11 Role of Artificial Intelligence in Detection of Hateful Speech for Hinglish Data on Social Media Ananya Srivastava, Mohammed Hasan, Bhargav Yagnik, Rahee Walambe, Ketan Kotecha arXiv_CL arXiv_CL Transformer Embedding Bert Speech Pose Detection Language_Model PDF
2021-05-11 Benchmarking down-scaled pre-trained language models M. Aßenmacher, P. Schulze, C. Heumann arXiv_CL arXiv_CL Transformer Bert Language_Model PDF
2021-05-10 Assessing the Syntactic Capabilities of Transformer-based Multilingual Language Models Laura Pérez-Mayos, Alba Táboas García, Simon Mille, Leo Wanner arXiv_CL arXiv_CL Transformer Bert Optimization Language_Model PDF
2021-05-10 Language Acquisition is Embodied, Interactive, Emotive: a Research Proposal Casey Kennington arXiv_CL arXiv_CL Transformer Sketch Review Emotion Language_Model PDF
2021-05-10 Self-Guided Curriculum Learning for Neural Machine Translation Lei Zhou, Liang Ding, Kevin Duh, Ryohei Sasano, Koichi Takeda arXiv_AI arXiv_AI Transformer Knowledge Pose NMT Language_Model PDF
2021-05-10 Speech2Slot: An End-to-End Knowledge-based Slot Filling from Speech Pengwei Wang, Xin Ye, Xiaohuan Zhou, Jinghui Xie, Hao Wang arXiv_AI arXiv_AI Recognition Knowledge Speech Pose Detection Object_Detection Speech_Recognition Language_Model Matching PDF
2021-05-10 REPT: Bridging Language Models and Machine Reading Comprehensionvia Retrieval-Based Pre-training Fangkai Jiao, Yangyang Guo, Yilin Niu, Feng Ji, Feng-Lin Li, Liqiang Nie arXiv_CL arXiv_CL Self-Supervised Pose Action Language_Model PDF
2021-05-10 Matching Visual Features to Hierarchical Semantic Topics for Image Paragraph Captioning Dandan Guo, Ruiying Lu, Bo Chen, Zequn Zeng, Mingyuan Zhou arXiv_CV arXiv_CV Transformer RNN Pose Action Relation Caption Inference Language_Model Matching PDF
2021-05-10 ExpMRC: Explainability Evaluation for Machine Reading Comprehension Yiming Cui, Ting Liu, Wanxiang Che, Zhigang Chen, Shijin Wang arXiv_AI arXiv_AI Unsupervised Pose Language_Model Prediction PDF
2021-05-09 DocSCAN: Unsupervised Text Classification via Learning from Neighbors Dominik Stammbach, Elliott Ash arXiv_CL arXiv_CL Unsupervised Text_Classification Pose Classification Sentiment Language_Model PDF
2021-05-09 Dispatcher: A Message-Passing Approach To Language Modelling Alberto Cetoli arXiv_CL arXiv_CL Pose Attention Language_Model PDF
2021-05-09 Lawformer: A Pre-trained Language Model for Chinese Legal Long Documents Chaojun Xiao, Xueyu Hu, Zhiyuan Liu, Cunchao Tu, Maosong Sun arXiv_CL arXiv_CL Language_Model Prediction PDF
2021-05-08 Enhancing Transformers with Gradient Boosted Decision Trees for NLI Fine-Tuning Benjamin Minixhofer, Milan Gritta, Ignacio Iacobacci arXiv_CL arXiv_CL Transformer Transfer_Learning Bert Classification Inference Language_Model PDF
2021-05-08 NLP-IIS@UT at SemEval-2021 Task 4: Machine Reading Comprehension using the Long Document Transformer Hossein Basafa, Sajad Movahedi, Ali Ebrahimi, Azadeh Shakery, Heshaam Faili arXiv_CL arXiv_CL Transformer Bert Pose Language_Model PDF
2021-05-08 e-ViL: A Dataset and Benchmark for Natural Language Explanations in Vision-Language Tasks Maxime Kayser, Oana-Maria Camburu, Leonard Salewski, Cornelius Emde, Virginie Do, Zeynep Akata, Thomas Lukasiewicz arXiv_CV arXiv_CV Embedding Pose Text_Generation Language_Model Prediction PDF
2021-05-07 Understanding by Understanding Not: Modeling Negation in Language Models Arian Hosseini, Siva Reddy, Dzmitry Bahdanau, R Devon Hjelm, Alessandro Sordoni, Aaron Courville arXiv_CL arXiv_CL Bert Pose Language_Model PDF
2021-05-07 Is Incoherence Surprising? Targeted Evaluation of Coherence Prediction from Language Models Anne Beyer, Sharid Loáiciga, David Schlangen arXiv_CL arXiv_CL Knowledge Action Relation Language_Model Prediction PDF
2021-05-07 Empirical Evaluation of Pre-trained Transformers for Human-Level NLP: The Role of Sample Size and Dimensionality Adithya V Ganesan, Matthew Matero, Aravind Reddy Ravula, Huy Vu, H. Andrew Schwartz arXiv_CL arXiv_CL Transformer Embedding Bert Pose Language_Model PDF
2021-05-07 Are Pre-trained Convolutions Better than Pre-trained Transformers? Yi Tay, Mostafa Dehghani, Jai Gupta, Dara Bahri, Vamsi Aribandi, Zhen Qin, Donald Metzler arXiv_CL arXiv_CL Transformer CNN Language_Model PDF
2021-05-07 The Shadowy Lives of Emojis: An Analysis of a Hacktivist Collective's Use of Emojis on Twitter Keenan Jones, Jason R. C. Nurse, Shujun Li arXiv_CL arXiv_CL Pose Emotion Relation Language_Model PDF
2021-05-07 CO-NNECT: A Framework for Revealing Commonsense Knowledge Paths as Explicitations of Implicit Knowledge in Texts Maria Becker, Katharina Korfhage, Debjit Paul, Anette Frank arXiv_CL arXiv_CL Knowledge Relation Language_Model Prediction PDF
2021-05-07 On-the-Fly Controlled Text Generation with Experts and Anti-Experts Alisa Liu, Maarten Sap, Ximing Lu, Swabha Swayamdipta, Chandra Bhagavatula, Noah A. Smith, Yejin Choi arXiv_CL arXiv_CL Pose Sentiment Text_Generation Language_Model PDF
2021-05-06 Do language models learn typicality judgments from text? Kanishka Misra, Allyson Ettinger, Julia Taylor Rayz arXiv_CL arXiv_CL Knowledge Pose Language_Model PDF
2021-05-06 Graph-based Multilingual Product Retrieval in E-commerce Search Hanqing Lu, Youna Hu, Tong Zhao, Tony Wu, Yiwei Song, Bing Yin arXiv_CL arXiv_CL Transformer Pose Action Attention Language_Model PDF
2021-05-06 On the logistical difficulties and findings of Jopara Sentiment Analysis Marvin M. Agüero-Torales, David Vilares, Antonio G. López-Herrera arXiv_CL arXiv_CL Transformer Sentiment Language_Model PDF
2021-05-06 Computer-Aided Design as Language Yaroslav Ganin, Sergey Bartunov, Yujia Li, Ethan Keller, Stefano Saliceti arXiv_CV arXiv_CV 3D Sketch Pose Language_Model PDF
2021-05-06 Introducing Information Retrieval for Biomedical Informatics Students Sanya B. Taneja, Richard D. Boyce, William T. Reynolds, Denis Newman-Griffis arXiv_CL arXiv_CL Bert Medical Language_Model PDF
2021-05-06 What's in the Box? An Analysis of Undesirable Content in the Common Crawl Corpus Alexandra (Sasha) Luccioni, Joseph D. Viviano arXiv_CL arXiv_CL Speech Language_Model PDF
2021-05-06 GraphFormers: GNN-nested Language Models for Linked Text Representation Junhan Yang, Zheng Liu, Shitao Xiao, Chaozhuo Li, Guangzhong Sun, Xing Xie arXiv_AI arXiv_AI Transformer Embedding Enhancement Pose Language_Model Recommendation PDF
2021-05-06 TABBIE: Pretrained Representations of Tabular Data Hiroshi Iida, Dung Thai, Varun Manjunatha, Mohit Iyyer arXiv_CL arXiv_CL Embedding Bert Represenation_Learning Self-Supervised Detection Language_Model Prediction PDF
2021-05-06 XeroAlign: Zero-Shot Cross-lingual Transformer Alignment Milan Gritta, Ignacio Iacobacci arXiv_CL arXiv_CL Transformer Embedding Zero-Shot Text_Classification Adversarial Classification Language_Model PDF
2021-05-06 Handwritten Mathematical Expression Recognition with Bidirectionally Trained Transformer Wenqi Zhao, Liangcai Gao, Zuoyu Yan, Shuai Peng, Lin Du, Ziyin Zhang arXiv_CV arXiv_CV Transformer Recognition RNN Attention Language_Model PDF
2021-05-05 Rethinking Search: Making Experts out of Dilettantes Donald Metzler, Yi Tay, Dara Bahri, Marc Najork arXiv_CL arXiv_CL Language_Model PDF
2021-05-04 HerBERT: Efficiently Pretrained Transformer-based Language Model for Polish Robert Mroczkowski, Piotr Rybak, Alina Wróblewska, Ireneusz Gawlik arXiv_CL arXiv_CL Transformer Bert Knowledge Pose Language_Model PDF
2021-05-04 Inferring the Reader: Guiding Automated Story Generation with Commonsense Reasoning Xiangyu Peng, Siyan Li, Sarah Wiegreffe, Mark Riedl arXiv_CL arXiv_CL Transformer Action Inference Language_Model PDF
2021-05-03 Unreasonable Effectiveness of Rule-Based Heuristics in Solving Russian SuperGLUE Tasks Tatyana Iazykova, Denis Kapelyushnik, Olga Bystrova, Andrey Kutuzov arXiv_CL arXiv_CL Bert Language_Model Recommendation PDF
2021-05-03 Textual Analysis of Communications in COVID-19 Infected Community on Social Media Yuhan Liu, Yuhan Gao, Zhifan Nan, Long Chen arXiv_CL arXiv_CL Emotion Classification Language_Model PDF
2021-05-03 Scalar Adjective Identification and Multilingual Ranking Aina Garí Soler, Marianna Apidianaki arXiv_CL arXiv_CL Classification Relation Inference Language_Model PDF
2021-05-03 Goldilocks: Just-Right Tuning of BERT for Technology-Assisted Review Eugene Yang, Sean MacAvaney, David D. Lewis, Ophir Frieder arXiv_CL arXiv_CL Transformer Bert Text_Classification Review Classification Language_Model PDF
2021-05-03 On the limit of English conversational speech recognition Zoltán Tüske, George Saon, Brian Kingsbury arXiv_CL arXiv_CL Embedding Recognition RNN Speech Pose Attention Speech_Recognition Language_Model PDF
2021-05-03 Impact of Gender Debiased Word Embeddings in Language Modeling Christine R. Basta, Marta R. Costa-jussà arXiv_CL arXiv_CL Embedding Language_Model PDF
2021-05-02 Larger-Scale Transformers for Multilingual Masked Language Modeling Naman Goyal, Jingfei Du, Myle Ott, Giri Anantharaman, Alexis Conneau arXiv_CL arXiv_CL Transformer Bert Language_Model PDF
2021-05-01 When to Fold'em: How to answer Unanswerable questions Marshall Ho, Zhipeng Zhou, Judith He arXiv_CL arXiv_CL Bert Language_Model QA PDF
2021-05-01 Hidden Backdoors in Human-Centric Language Models Shaofeng Li, Hui Liu, Tian Dong, Benjamin Zi Hao Zhao, Minhui Xue, Haojin Zhu, Jialiang Lu arXiv_CL arXiv_CL Embedding Pose NMT Detection Language_Model QA PDF
2021-04-30 Evaluating Groundedness in Dialogue Systems: The BEGIN Benchmark Nouha Dziri, Hannah Rashkin, Tal Linzen, David Reitter arXiv_CL arXiv_CL Knowledge Adversarial Action Relation Inference Language_Model PDF
2021-04-30 An analysis of full-size Russian complexly NER labelled corpus of Internet user reviews on the drugs based on deep learning and language neural nets Alexander Sboev, Sanna Sboeva, Ivan Moloshnikov, Artem Gryaznov, Roman Rybka, Alexander Naumov, Anton Selivanov, Gleb Rylkov, Viacheslav Ilyin arXiv_AI arXiv_AI Recognition Review Action Deep_Learning Relation Relation_Extraction Language_Model PDF
2021-04-30 Mitigating Political Bias in Language Models Through Reinforced Calibration Ruibo Liu, Chenyan Jia, Jason Wei, Guangxuan Xu, Lili Wang, Soroush Vosoughi arXiv_AI arXiv_AI Embedding Reinforcement_Learning Pose Language_Model PDF
2021-04-29 The Interspeech Zero Resource Speech Challenge 2021: Spoken language modelling Ewan Dunbar, Mathieu Bernard, Nicolas Hamilakis, Tu Anh Nguyen, Maureen de Seyssel, Patricia Rozé, Morgane Rivière, Eugene Kharitonov, Emmanuel Dupoux arXiv_AI arXiv_AI Bert RNN Speech Language_Model PDF
2021-04-29 Let's Play Mono-Poly: BERT Can Reveal Words' Polysemy Level and Partitionability into Senses Aina Garí Soler, Marianna Apidianaki arXiv_CL arXiv_CL Embedding Bert Knowledge Pose Language_Model PDF
2021-04-29 Entailment as Few-Shot Learner Sinong Wang, Han Fang, Madian Khabsa, Hanzi Mao, Hao Ma arXiv_AI arXiv_AI Unsupervised Pose Contrastive_Learning Few-Shot Language_Model PDF
2021-04-29 MOROCCO: Model Resource Comparison Framework Valentin Malykh, Alexander Kukushkin, Ekaterina Artemova, Vladislav Mikhailov, Maria Tikhonova, Tatiana Shavrina arXiv_CL arXiv_CL Inference Language_Model PDF
2021-04-27 Improved and Efficient Text Adversarial Attacks using Target Information Mahmoud Hossam, Trung Le, He Zhao, Viet Huynh, Dinh Phung arXiv_AI arXiv_AI Adversarial Language_Model PDF
2021-04-27 Named Entity Recognition and Linking Augmented with Large-Scale Structured Data Paweł Rychlikowski, Bartłomiej Najdecki, Adrian Łańcucki, Adam Kaczmarek arXiv_CL arXiv_CL Embedding Unsupervised Recognition Language_Model PDF
2021-04-27 Extractive and Abstractive Explanations for Fact-Checking and Evaluation of News Ashkan Kazemi, Zehua Li, Verónica Pérez-Rosas, Rada Mihalcea arXiv_CL arXiv_CL Unsupervised Action Language_Model PDF
2021-04-26 Accounting for Agreement Phenomena in Sentence Comprehension with Transformer Language Models: Effects of Similarity-based Interference on Surprisal and Attention Soo Hyun Ryu, Richard L. Lewis arXiv_CL arXiv_CL Transformer Review Self-Supervised Relation Attention Language_Model PDF
2021-04-26 Morph Call: Probing Morphosyntactic Content of Multilingual Transformers Vladislav Mikhailov, Oleg Serikov, Ekaterina Artemova arXiv_CL arXiv_CL Transformer Knowledge Pose Detection Language_Model PDF
2021-04-26 Teaching a Massive Open Online Course on Natural Language Processing Ekaterina Artemova, Murat Apishev, Veronika Sarkisyan, Sergey Aksenov, Denis Kirjanov, Oleg Serikov arXiv_CL arXiv_CL Transformer Pose Language_Model PDF
2021-04-26 Phrase break prediction with bidirectional encoder representations in Japanese text-to-speech synthesis Kosuke Futamata, Byeongseon Park, Ryuichi Yamamoto, Kentaro Tachibana arXiv_CL arXiv_CL Bert RNN Speech Pose Language_Model Prediction PDF
2021-04-26 PanGu-$alpha$: Large-scale Autoregressive Pretrained Chinese Language Models with Auto-parallel Computation Wei Zeng, Xiaozhe Ren, Teng Su, Hui Wang, Yi Liao, Zhiwei Wang, Xin Jiang, ZhenZhang Yang, Kaisheng Wang, Xiaoda Zhang, Chen Li, Ziyan Gong, Yifan Yao, Xinjing Huang, Jun Wang, Jianfeng Yu, Qi Guo, Yue Yu, Yan Zhang, Jin Wang, Hengtao Tao, Dasen Yan, Zexuan Yi, Fang Peng, Fangqing Jiang, Han Zhang, Lingfeng Deng, Yehong Zhang, Zhe Lin, Chao Zhang, Shaojie Zhang, Mingyue Guo, Shanzhi Gu, Gaojun Fan, Yaowei Wang, Xuefeng Jin, Qun Liu, Yonghong Tian arXiv_CL arXiv_CL Zero-Shot Pose Few-Shot Summarization Language_Model PDF
2021-04-25 Reranking Machine Translation Hypotheses with Structured and Web-based Language Models Wen Wang, Andreas Stolcke, Jing Zheng arXiv_CL arXiv_CL Knowledge Language_Model PDF
2021-04-25 XLM-T: A Multilingual Language Model Toolkit for Twitter Francesco Barbieri, Luis Espinosa Anke, Jose Camacho-Collados arXiv_CL arXiv_CL Sentiment Attention Language_Model PDF
2021-04-23 Optimizing small BERTs trained for German NER Jochen Zöllner, Konrad Sperfeld, Christoph Wick, Roger Labahn arXiv_AI arXiv_AI Bert Pose Language_Model PDF
2021-04-23 BERT-CoQAC: BERT-based Conversational Question Answering in Context Munazza Zaib, Dai Hoang Tran, Subhash Sagar, Adnan Mahmood, Wei E. Zhang, Quan Z. Sheng arXiv_CL arXiv_CL Bert Pose Language_Model QA PDF
2021-04-23 Transfer training from smaller language model Han Zhang arXiv_CL arXiv_CL Transformer Language_Model PDF
2021-04-22 Fast Text-Only Domain Adaptation of RNN-Transducer Prediction Network Janne Pylkkönen (1), Antti Ukkonen (1 and 2), Juho Kilpikoski (1), Samu Tamminen (1), Hannes Heikinheimo (1) ((1) Speechly, (2) Department of Computer Science, University of Helsinki, Finland) arXiv_CL arXiv_CL Recognition RNN Regularization Speech Pose Speech_Recognition Language_Model Prediction PDF
2021-04-22 Low Anisotropy Sense Retrofitting : Towards Isotropic and Sense Enriched Representations Geetanjali Bihani, Julia Taylor Rayz arXiv_CL arXiv_CL Pose Language_Model PDF
2021-04-22 A Short Survey of Pre-trained Language Models for Conversational AI-A NewAge in NLP Munazza Zaib, Quan Z. Sheng, Wei Emma Zhang arXiv_AI arXiv_AI Embedding Face Survey Relation Sentiment Language_Model PDF
2021-04-22 Provable Limitations of Acquiring Meaning from Ungrounded Form: What will Future Language Models Understand? William Merrill, Yoav Goldberg, Roy Schwartz, Noah A. Smith arXiv_CL arXiv_CL Relation Language_Model PDF
2021-04-21 Extracting Adverse Drug Events from Clinical Notes Darshini Mahendran, Bridget T. McInnes arXiv_CL arXiv_CL Action Deep_Learning Relation Relation_Extraction Language_Model PDF
2021-04-21 On Sampling-Based Training Criteria for Neural Language Modeling Yingbo Gao, David Thulke, Alexander Gerstenberger, Khoa Viet Tran, Ralf Schlüter, Hermann Ney arXiv_CL arXiv_CL Recognition Speech Pose Speech_Recognition Language_Model PDF
2021-04-21 Should we Stop Training More Monolingual Models, and Simply Use Machine Translation Instead? Tim Isbister, Fredrik Carlsson, Magnus Sahlgren arXiv_CL arXiv_CL Language_Model PDF
2021-04-21 Sattiy at SemEval-2021 Task 9: An Ensemble Solution for Statement Verification and Evidence Finding with Tables Xiaoyi Ruan, Meizhi Jin, Jian Ma, Haiqin Yang, Lianxin Jiang, Yang Mo, Mengyuan Zhou arXiv_AI arXiv_AI Bert Language_Model PDF
2021-04-21 Pre-training for Spoken Language Understanding with Joint Textual and Phonetic Representation Learning Qian Chen, Wen Wang, Qinglin Zhang arXiv_CL arXiv_CL Recognition Represenation_Learning Speech Pose Relation Speech_Recognition Language_Model PDF
2021-04-21 Improving Biomedical Pretrained Language Models with Knowledge Zheng Yuan, Yijia Liu, Chuanqi Tan, Songfang Huang, Fei Huang arXiv_CL arXiv_CL Recognition Knowledge Pose Action Detection Relation Relation_Extraction Medical Language_Model PDF
2021-04-21 'What's The Context?' : Long Context NLM Adaptation for ASR Rescoring in Conversational Agents Ashish Shenoy, Sravan Bodapati, Monica Sunkara, Srikanth Ronanki, Katrin Kirchhoff arXiv_CL arXiv_CL Transformer RNN Speech Pose Classification Attention Language_Model PDF
2021-04-20 Analyzing COVID-19 Tweets with Transformer-based Language Models Philip Feldman, Sim Tiwari, Charissa S. L. Cheah, James R. Foulds, Shimei Pan arXiv_CL arXiv_CL Transformer Language_Model PDF
2021-04-20 Modeling Event Plausibility with Consistent Conceptual Abstraction Ian Porada, Kaheer Suleman, Adam Trischler, Jackie Chi Kit Cheung arXiv_CL arXiv_CL Transformer Knowledge Action Relation Language_Model PDF
2021-04-20 Efficient Retrieval Optimized Multi-task Learning Hengxin Fun, Sunil Gandhi, Sujith Ravi arXiv_CL arXiv_CL Optimization Knowledge Self-Supervised Pose Language_Model QA PDF
2021-04-20 Differentiable Model Compression via Pseudo Quantization Noise Alexandre Défossez, Yossi Adi, Gabriel Synnaeve arXiv_AI arXiv_AI Transformer Quantization Pose Classification Image_Classification Language_Model PDF
2021-04-20 Text-Aware Predictive Monitoring of Business Processes Marco Pegoraro, Merih Seran Uysal, David Benedikt Georgi, Wil M.P. van der Aalst arXiv_AI arXiv_AI RNN Pose Activity Language_Model Prediction PDF
2021-04-20 RoFormer: Enhanced Transformer with Rotary Position Embedding Jianlin Su, Yu Lu, Shengfeng Pan, Bo Wen, Yunfeng Liu arXiv_AI arXiv_AI Transformer Embedding Pose Attention Language_Model PDF
2021-04-20 Frustratingly Easy Edit-based Linguistic Steganography with a Masked Language Model Honai Ueoka, Yugo Murawaki, Sadao Kurohashi arXiv_CL arXiv_CL Pose Detection GAN Language_Model PDF
2021-04-20 Subsentence Extraction from Text Using Coverage-Based Deep Learning Language Models JongYoon Lim, Inkyu Sa, Ho Seok Ahn, Norina Gasteiger, Sanghyub John Lee, Bruce MacDonald arXiv_CL arXiv_CL Pose Action Deep_Learning Sentiment Language_Model Prediction PDF
2021-04-19 When FastText Pays Attention: Efficient Estimation of Word Representations using Constrained Positional Weighting Vít Novotný, Michal Štefánik, Eniafe Festus Ayetiran, Petr Sojka arXiv_CL arXiv_CL Sparse Pose Attention Language_Model PDF
2021-04-19 Neural Language Models with Distant Supervision to Identify Major Depressive Disorder from Clinical Notes Bhavani Singh Agnikula Kshatriya, Nicolas A Nunez, Manuel Gardea- Resendez, Euijung Ryu, Brandon J Coombes, Sunyang Fu, Mark A Frye, Joanna M Biernacka, Yanshan Wang arXiv_AI arXiv_AI Transformer Unsupervised Bert Text_Classification Pose Classification Language_Model PDF
2021-04-19 Refining Targeted Syntactic Evaluation of Language Models Benjamin Newman, Kai-Siang Ang, Julia Gong, John Hewitt arXiv_CL arXiv_CL Knowledge Pose Language_Model PDF
2021-04-19 Operationalizing a National Digital Library: The Case for a Norwegian Transformer Model Per E Kummervold, Javier de la Rosa, Freddy Wetjen, Svein Arne Brygfjeld arXiv_CL arXiv_CL Transformer Recognition OCR Bert Optical_Character Classification Language_Model PDF
2021-04-19 ELECTRAMed: a new pre-trained language representation model for biomedical NLP Giacomo Miolo, Giulio Mantoan, Carlotta Orsenigo arXiv_CL arXiv_CL Recognition Knowledge Pose Medical Language_Model PDF
2021-04-19 Understanding Chinese Video and Language via Contrastive Multimodal Pre-Training Chenyi Lei, Shixian Luo, Yong Liu, Wanggui He, Jiamang Wang, Guoxin Wang, Haihong Tang, Chunyan Miao, Houqiang Li arXiv_CV arXiv_CV Bert Pose Contrastive_Learning Relation Language_Model PDF
2021-04-19 Probing for Bridging Inference in Transformer Language Models Onkar Pandit, Yufang Hou arXiv_CL arXiv_CL Transformer Bert Relation Attention Inference Language_Model Prediction PDF
2021-04-19 Federated Word2Vec: Leveraging Federated Learning to Encourage Collaborative Representation Learning Daniel Garcia Bernal, Lodovico Giaretta, Sarunas Girdzijauskas, Magnus Sahlgren arXiv_CL arXiv_CL Represenation_Learning GAN Language_Model PDF
2021-04-19 BERTić -- The Transformer Language Model for Bosnian, Croatian, Montenegrin and Serbian Nikola Ljubešić, Davor Lauc arXiv_CL arXiv_CL Transformer Recognition Bert Speech Face Language_Model Prediction PDF
2021-04-18 Towards Open-World Text-Guided Face Image Generation and Manipulation Weihao Xia, Yujiu Yang, Jing-Hao Xue, Baoyuan Wu arXiv_CV arXiv_CV Segmentation Semantic_Segmentation Sketch Pose Face GAN Language_Model PDF
2021-04-18 Language in a Box: Grounding Language Learning in Real-World Human-Machine Interaction Federico Bianchi, Ciro Greco, Jacopo Tagliabue arXiv_CL arXiv_CL Unsupervised Bert Zero-Shot Action Inference Language_Model PDF
2021-04-18 GPT3Mix: Leveraging Large-scale Language Models for Text Augmentation Kang Min Yoo, Dongju Park, Jaewook Kang, Sang-Woo Lee, Woomyeong Park arXiv_AI arXiv_AI Knowledge Pose Classification Few-Shot Inference Language_Model PDF
2021-04-18 FedNLP: A Research Platform for Federated Learning in Natural Language Processing Bill Yuchen Lin, Chaoyang He, Zihang Zeng, Hulin Wang, Yufen Huang, Mahdi Soltanolkotabi, Xiang Ren, Salman Avestimehr arXiv_AI arXiv_AI Transformer Bert Text_Classification Face Classification GAN Language_Model PDF
2021-04-18 Lifelong Learning of Few-shot Learners across NLP Tasks Xisen Jin, Mohammad Rostami, Xiang Ren arXiv_CL arXiv_CL Knowledge Pose Few-Shot Language_Model PDF
2021-04-18 SalKG: Learning From Knowledge Graph Explanations for Commonsense Reasoning Aaron Chan, Soumya Sanyal, Boyuan Long, Jiashu Xu, Tanishq Gupta, Xiang Ren arXiv_CL arXiv_CL Salient Knowledge Knowledge_Graph Pose Language_Model Prediction QA PDF
2021-04-18 Misinfo Belief Frames: A Case Study on Covid & Climate News Saadia Gabriel, Skyler Hallinan, Maarten Sap, Pemi Nguyen, Franziska Roesner, Eunsol Choi, Yejin Choi arXiv_CL arXiv_CL Pose Action Inference Language_Model PDF
2021-04-18 Fantastically Ordered Prompts and Where to Find Them: Overcoming Few-Shot Prompt Order Sensitivity Yao Lu, Max Bartolo, Alastair Moore, Sebastian Riedel, Pontus Stenetorp arXiv_AI arXiv_AI Text_Classification Classification Few-Shot Language_Model PDF
2021-04-18 Constrained Language Models Yield Few-Shot Semantic Parsers Richard Shin, Christopher H. Lin, Sam Thomson, Charles Chen, Subhro Roy, Emmanouil Antonios Platanios, Adam Pauls, Dan Klein, Jason Eisner, Benjamin Van Durme arXiv_CL arXiv_CL Few-Shot Language_Model PDF
2021-04-18 Documenting the English Colossal Clean Crawled Corpus Jesse Dodge, Maarten Sap, Ana Marasovic, William Agnew, Gabriel Ilharco, Dirk Groeneveld, Matt Gardner arXiv_AI arXiv_AI OCR Salient Face Language_Model PDF
2021-04-18 Go Forth and Prosper: Language Modeling with Ancient Textual History Rik Koncel-Kedziorski, Noah A. Smith arXiv_CL arXiv_CL Language_Model PDF
2021-04-18 CEAR: Cross-Entity Aware Reranker for Knowledge Base Completion Keshav Kolluru, Mayank Singh Chauhan, Yatin Nandwani, Parag Singla, Mausam arXiv_CL arXiv_CL Embedding Bert Knowledge Attention Language_Model Prediction PDF
2021-04-18 Extract, Denoise, and Enforce: Evaluating and Predicting Lexical Constraints for Conditional Text Generation Yuning Mao, Wenchang Ma, Deren Lei, Xiang Ren arXiv_CL arXiv_CL Pose Action Denoising Text_Generation Language_Model PDF
2021-04-18 Embedding-Enhanced Giza++: Improving Alignment in Low- and High- Resource Scenarios Using Embedding Space Geometry Kelly Marchisio, Conghao Xiong, Philipp Koehn arXiv_CL arXiv_CL Embedding Language_Model PDF
2021-04-18 CoreQuisite: Circumstantial Preconditions of Common Sense Knowledge Ehsan Qasemi, Filip Ilievski, Muhao Chen, Pedro Szekely arXiv_CL arXiv_CL Knowledge Pose Language_Model PDF
2021-04-18 Knowledge Neurons in Pretrained Transformers Damai Dai, Li Dong, Yaru Hao, Zhifang Sui, Furu Wei arXiv_CL arXiv_CL Transformer Knowledge Pose Relation Language_Model PDF
2021-04-18 The Power of Scale for Parameter-Efficient Prompt Tuning Brian Lester, Rami Al-Rfou, Noah Constant arXiv_CL arXiv_CL Pose Few-Shot Language_Model PDF
2021-04-18 Linguistic dependencies and statistical dependence Jacob Louis Hoover, Alessandro Sordoni, Wenyu Du, Timothy J. O'Donnell arXiv_CL arXiv_CL Relation Language_Model PDF
2021-04-18 Rethinking Network Pruning -- under the Pre-train and Fine-tune Paradigm Dongkuan Xu, Ian E.H. Yen, Jinxi Zhao, Zhibin Xiao arXiv_AI arXiv_AI Transformer Bert Sparse Knowledge CNN Language_Model Prediction PDF
2021-04-18 'Average' Approximates 'First Principal Component'? An Empirical Analysis on Representations from Neural Language Models Zihan Wang, Chengyu Dong, Jingbo Shang arXiv_CL arXiv_CL Language_Model PDF
2021-04-18 Worst of Both Worlds: Biases Compound in Pre-trained Vision-and-Language Models Tejas Srinivasan, Yonatan Bisk arXiv_CL arXiv_CL Bert Attention Language_Model PDF
2021-04-17 Explaining Answers with Entailment Trees Bhavana Dalvi, Peter Jansen, Oyvind Tafjord, Zhengnan Xie, Hannah Smith, Leighanna Pipatanangkura, Peter Clark arXiv_AI arXiv_AI Pose Language_Model QA PDF
2021-04-17 Improving Zero-Shot Cross-Lingual Transfer Learning via Robust Training Kuan-Hao Huang, Wasi Uddin Ahmad, Nanyun Peng, Kai-Wei Chang arXiv_CL arXiv_CL Embedding Transfer_Learning Bert Zero-Shot Text_Classification Adversarial Pose Classification Language_Model PDF
2021-04-17 Zero-shot Slot Filling with DPR and RAG Michael Glass, Gaetano Rossiello, Alfio Gliozzo arXiv_AI arXiv_AI Zero-Shot Knowledge Knowledge_Graph Action Language_Model PDF
2021-04-17 Transductive Learning for Abstractive News Summarization Arthur Bražinskas, Mengwen Liu, Ramesh Nallapati, Sujith Ravi, Markus Dreyer arXiv_AI arXiv_AI Pose Summarization Inference Language_Model PDF
2021-04-17 Crossing the Conversational Chasm: A Primer on Multilingual Task-Oriented Dialogue Systems Evgeniia Razumovskaia, Goran Glavaš, Olga Majewska, Anna Korhonen, Ivan Vulić arXiv_CL arXiv_CL Few-Shot Language_Model PDF
2021-04-17 Combating Temporal Drift in Crisis with Adapted Embeddings Kevin Stowe, Iryna Gurevych arXiv_CL arXiv_CL Embedding Classification Language_Model PDF
2021-04-17 The Topic Confusion Task: A Novel Scenario for Authorship Attribution Malik H. Altakrori (1 and 3), Jackie Chi Kit Cheung (1 and 3), Benjamin C. M. Fung (2 and 3) ((1) School of Computer Science -McGill University, (2) School of Information Studies-McGill University, (3) Mila) arXiv_CL arXiv_CL Bert Speech Pose Language_Model PDF
2021-04-17 A multilabel approach to morphosyntactic probing Naomi Tachikawa Shapiro, Amandalynne Paullada, Shane Steinert-Threlkeld arXiv_CL arXiv_CL Embedding Bert Zero-Shot Language_Model PDF
2021-04-17 Neural Path Hunter: Reducing Hallucination in Dialogue Systems via Path Grounding Nouha Dziri, Andrea Madotto, Osmar Zaiane, Avishek Joey Bose arXiv_CL arXiv_CL Knowledge Knowledge_Graph Pose Language_Model PDF
2021-04-17 Are Word Embedding Methods Stable and Should We Care About It? Angana Borah, Manash Pratim Barman, Amit Awekar arXiv_CL arXiv_CL Embedding Represenation_Learning Language_Model PDF
2021-04-17 Identifying the Limits of Cross-Domain Knowledge Transfer for Pretrained Models Zhengxuan Wu, Nelson F. Liu, Christopher Potts arXiv_CL arXiv_CL Embedding Bert RNN Knowledge Classification Language_Model PDF
2021-04-16 Enriching a Model's Notion of Belief using a Persistent Memory Nora Kassner, Oyvind Tafjord, Hinrich Schutze, Peter Clark arXiv_AI arXiv_AI Knowledge Language_Model PDF
2021-04-16 Bayesian Active Learning with Pretrained Language Models Katerina Margatina, Loic Barrault, Nikolaos Aletras arXiv_CL arXiv_CL Pose Language_Model PDF
2021-04-16 Surface Form Competition: Why the Highest Probability Answer Isn't Always Right Ari Holtzman, Peter West, Vered Schwartz, Yejin Choi, Luke Zettlemoyer arXiv_CL arXiv_CL Zero-Shot Face Language_Model PDF
2021-04-16 Does language help generalization in vision models? Benjamin Devillers, Romain Bielawski, Bhavin Choski, Rufin VanRullen arXiv_AI arXiv_AI Image_Caption Unsupervised Zero-Shot Few-Shot Caption Language_Model PDF
2021-04-16 Membership Inference Attack Susceptibility of Clinical Language Models Abhyuday Jagannatha, Bhanu Pratap Singh Rawat, Hong Yu arXiv_CL arXiv_CL Bert Medical Inference Language_Model PDF
2021-04-16 Text2App: A Framework for Creating Android Apps from Text Descriptions Masum Hasan, Kazi Sajeed Mehrab, Wasi Uddin Ahmad, Rifat Shahriyar arXiv_AI arXiv_AI Survey Action Language_Model PDF
2021-04-16 AMMU -- A Survey of Transformer-based Biomedical Pretrained Language Models Katikapalli Subramanyam Kalyan, Ajit Rajasekharan, Sivanesan Sangeetha arXiv_AI arXiv_AI Transformer Embedding Transfer_Learning Bert Self-Supervised Survey Medical Language_Model PDF
2021-04-16 Is Your Language Model Ready for Dense Representation Fine-tuning? Luyu Gao, Jamie Callan arXiv_CL arXiv_CL Transformer Embedding Optimization Knowledge Pose Language_Model PDF
2021-04-16 proScript: Partially Ordered Scripts Generation via Pre-trained Language Models Keisuke Sakaguchi, Chandra Bhagavatula, Ronan Le Bras, Niket Tandon, Peter Clark, Yejin Choi arXiv_CL arXiv_CL Knowledge GAN Language_Model Prediction PDF
2021-04-16 What to Pre-Train on? Efficient Intermediate Task Selection Clifton Poth, Jonas Pfeiffer, Andreas Rücklé, Iryna Gurevych arXiv_CL arXiv_CL Embedding Transfer_Learning Pose Classification Few-Shot Language_Model PDF
2021-04-16 Word2rate: training and evaluating multiple word embeddings as statistical transitions Gary Phua, Shaowei Lin, Dario Poletti arXiv_CL arXiv_CL Embedding Pose Sentiment Language_Model Prediction PDF
2021-04-16 Editing Factual Knowledge in Language Models Nicola De Cao, Wilker Aziz, Ivan Titov arXiv_AI arXiv_AI Bert Optimization Knowledge Inference Language_Model Prediction PDF
2021-04-16 Back to Square One: Bias Detection, Training and Commonsense Disentanglement in the Winograd Schema Yanai Elazar, Hongming Zhang, Yoav Goldberg, Dan Roth arXiv_CL arXiv_CL Zero-Shot Knowledge Pose Detection Language_Model PDF
2021-04-16 Temporal Adaptation of BERT and Performance on Downstream Document Classification: Insights from Social Media Paul Röttger, Janet B. Pierrehumbert arXiv_CL arXiv_CL Bert Pose Classification Language_Model PDF
2021-04-16 LU-BZU at SemEval-2021 Task 2: Word2Vec and Lemma2Vec performance in Arabic Word-in-Context disambiguation Moustafa Al-Hajj, Mustafa Jarrar arXiv_CL arXiv_CL Embedding Language_Model PDF
2021-04-16 Effect of Vision-and-Language Extensions on Natural Language Understanding in Vision-and-Language Models Taichi Iki, Akiko Aizawa arXiv_AI arXiv_AI Language_Model PDF
2021-04-16 Fast, Effective and Self-Supervised: Transforming Masked LanguageModels into Universal Lexical and Sentence Encoders Fangyu Liu, Ivan Vulić, Anna Korhonen, Nigel Collier arXiv_AI arXiv_AI Bert Knowledge Self-Supervised Pose Contrastive_Learning Language_Model PDF
2021-04-16 BERT2Code: Can Pretrained Language Models be Leveraged for Code Search? Abdullah Al Ishtiaq, Masum Hasan, Md. Mahim Anjum Haque, Kazi Sajeed Mehrab, Tanveer Muttaqueen, Tahmid Hasan, Anindya Iqbal, Rifat Shahriyar arXiv_CL arXiv_CL Embedding Bert Relation Language_Model PDF
2021-04-16 Language Models are Few-Shot Butlers Vincent Micheli, François Fleuret arXiv_CL arXiv_CL Reinforcement_Learning Few-Shot Language_Model PDF
2021-04-16 Probing Across Time: What Does RoBERTa Know and When? Leo Z. Liu, Yizhong Wang, Jungo Kasai, Hannaneh Hajishirzi, Noah A. Smith arXiv_CL arXiv_CL Bert Knowledge Action Language_Model PDF
2021-04-16 A Masked Segmental Language Model for Unsupervised Natural Language Segmentation C.M. Downey, Fei Xia, Gina-Anne Levow, Shane Steinert-Threlkeld arXiv_CL arXiv_CL Transformer Segmentation Unsupervised Speech Pose Attention Language_Model PDF
2021-04-15 Detecting Polarized Topics in COVID-19 News Using Partisanship-aware Contextualized Topic Embeddings Zihao He, Negar Mokhberian, Antonio Camara, Andres Abeliuk, Kristina Lerman arXiv_CL arXiv_CL Embedding Pose Language_Model PDF
2021-04-15 Rethinking Text Line Recognition Models Daniel Hernandez Diaz, Siyang Qin, Reeve Ingle, Yasuhisa Fujii, Alessandro Bissacco arXiv_CV arXiv_CV Transformer Recognition RNN Pose Classification Attention Language_Model PDF
2021-04-15 How to Train BERT with an Academic Budget Peter Izsak, Moshe Berchansky, Omer Levy arXiv_AI arXiv_AI Bert Optimization Action Language_Model PDF
2021-04-15 AdaPrompt: Adaptive Prompt-based Finetuning for Relation Extraction Xiang Chen, Xin Xie, Ningyu Zhang, Jiahuan Yan, Shumin Deng, Chuanqi Tan, Fei Huang, Luo Si, Huajun Chen arXiv_AI arXiv_AI Represenation_Learning Pose Action Relation Few-Shot Relation_Extraction Language_Model PDF
2021-04-15 Bilingual alignment transfers to multilingual alignment for unsupervised parallel text mining Chih-chan Tien, Shane Steinert-Threlkeld arXiv_CL arXiv_CL Unsupervised Pose Language_Model PDF
2021-04-15 Time-Stamped Language Model: Teaching Language Models to Understand the Flow of Events Hossein Rajaby Faghihi, Parisa Kordjamshidi arXiv_AI arXiv_AI Transformer Tracking Pose Language_Model Prediction QA PDF
2021-04-15 SINA-BERT: A pre-trained Language Model for Analysis of Medical Texts in Persian Nasrin Taghizadeh, Ehsan Doostmohammadi, Elham Seifossadat, Hamid R. Rabiee, Maedeh S. Tahaei arXiv_CL arXiv_CL Bert Sentiment Medical Language_Model PDF
2021-04-15 Syntactic Perturbations Reveal Representational Correlates of Hierarchical Phrase Structure in Pretrained Language Models Matteo Alleman, Jonathan Mamou, Miguel A Del Rio, Hanlin Tang, Yoon Kim, SueYeon Chung arXiv_CL arXiv_CL Transformer Deep_Learning Language_Model PDF
2021-04-15 Generating Datasets with Pretrained Language Models Timo Schick, Hinrich Schütze arXiv_CL arXiv_CL Embedding Unsupervised Language_Model PDF
2021-04-15 Quantifying Gender Bias Towards Politicians in Cross-Lingual Language Models Karolina Stańczak, Sagnik Ray Choudhury, Tiago Pimentel, Ryan Cotterell, Isabelle Augenstein arXiv_CL arXiv_CL Language_Model PDF
2021-04-15 Privacy-Adaptive BERT for Natural Language Understanding Chen Qu, Weize Kong, Liu Yang, Mingyang Zhang, Michael Bendersky, Marc Najork arXiv_CL arXiv_CL Embedding Bert Knowledge Pose Language_Model PDF
2021-04-15 Unmasking the Mask -- Evaluating Social Biases in Masked Language Models Masahiro Kaneko, Danushka Bollegala arXiv_CL arXiv_CL Embedding Pose Relation Attention Language_Model Prediction PDF
2021-04-15 Effect of Post-processing on Contextualized Word Representations Hassan Sajjad, Firoj Alam, Fahim Dalvi, Nadir Durrani arXiv_AI arXiv_AI Embedding Classification Relation Language_Model PDF
2021-04-15 Pseudo Zero Pronoun Resolution Improves Zero Anaphora Resolution Ryuto Konno, Shun Kiyono, Yuichiroh Matsubayashi, Hiroki Ouchi, Kentaro Inui arXiv_CL arXiv_CL Knowledge Pose Relation Language_Model PDF
2021-04-15 Integration of Pre-trained Networks with Continuous Token Interface for End-to-End Spoken Language Understanding Seunghyun Seo, Donghyun Kwak, Bowon Lee arXiv_AI arXiv_AI Embedding Knowledge Pose Face Classification Language_Model PDF
2021-04-15 Regularizing Models via Pointwise Mutual Information for Named Entity Recognition Minbyul Jeong, Jaewoo Kang arXiv_AI arXiv_AI Recognition Pose Medical Language_Model PDF
2021-04-15 Text Guide: Improving the quality of long text classification by a text selection method based on feature importance Krzysztof Fiok (1), Waldemar Karwowski (1), Edgar Gutierrez (1) (2), Mohammad Reza Davahli (1), Maciej Wilamowski (3), Tareq Ahram (1), Awad Al-Juaid (4), Jozef Zurada (5) ((1) Department of Industrial Engineering and Management Systems, University of Central Florida, USA, (2) Center for Latin-American Logistics Innovation, LOGyCA, Bogota, Colombia (3) Faculty of Economic Sciences, University of Warsaw, Warsaw, Poland (4) Department of Industrial Engineering, College of Engineering, Taif University, Saudi Arabia (5) Business School, University of Louisville, USA) arXiv_AI arXiv_AI Transformer Text_Classification Optimization Pose Classification Attention Language_Model PDF
2021-04-15 Lattice-BERT: Leveraging Multi-Granularity Representations in Chinese Pre-trained Language Models Yuxuan Lai, Yijia Liu, Yansong Feng, Songfang Huang, Dongyan Zhao arXiv_CL arXiv_CL Transformer Bert Pose Attention Language_Model Prediction PDF
2021-04-15 UHD-BERT: Bucketed Ultra-High Dimensional Sparse Representations for Full Ranking Kyoung-Rok Jang, Junmo Kang, Giwon Hong, Sung-Hyon Myaeng, Joohee Park, Taewon Yoon, Heecheol Seo arXiv_CL arXiv_CL Embedding Bert Sparse Pose Language_Model Matching PDF
2021-04-15 COIL: Revisit Exact Lexical Match in Information Retrieval with Contextualized Inverted List Luyu Gao, Zhuyun Dai, Jamie Callan arXiv_CL arXiv_CL Language_Model Matching PDF
2021-04-14 Static Embeddings as Efficient Knowledge Bases? Philipp Dufter, Nora Kassner, Hinrich Schütze arXiv_CL arXiv_CL Embedding Bert Knowledge Pose Language_Model Matching PDF
2021-04-14 UDALM: Unsupervised Domain Adaptation through Language Modeling Constantinos Karouzos, Georgios Paraskevopoulos, Alexandros Potamianos arXiv_CL arXiv_CL Unsupervised Review Adversarial Classification Relation Sentiment Language_Model PDF
2021-04-14 IGA : An Intent-Guided Authoring Assistant Simeng Sun, Wenlong Zhao, Varun Manjunatha, Rajiv Jain, Vlad Morariu, Franck Dernoncourt, Balaji Vasan Srinivasan, Mohit Iyyer arXiv_CL arXiv_CL Language_Model PDF
2021-04-14 UPB at SemEval-2021 Task 1: Combining Deep Learning and Hand-Crafted Features for Lexical Complexity Prediction George-Eduard Zaharia, Dumitru-Clementin Cercel, Mihai Dascalu arXiv_CL arXiv_CL Transformer Embedding Deep_Learning Relation CNN Language_Model Prediction PDF
2021-04-14 TSDAE: Using Transformer-based Sequential Denoising Auto-Encoder for Unsupervised Sentence Embedding Learning Kexin Wang, Nils Reimers, Iryna Gurevych arXiv_CL arXiv_CL Transformer Embedding Unsupervised Knowledge Pose Denoising Language_Model PDF
2021-04-14 Event Detection as Question Answering with Entity Information Emanuela Boros, Jose G. Moreno, Antoine Doucet arXiv_CL arXiv_CL Pose Action Detection Language_Model QA PDF
2021-04-14 K-PLUG: Knowledge-injected Pre-trained Language Model for Natural Language Understanding and Generation in E-Commerce Song Xu, Haoran Li, Peng Yuan, Yujia Wang, Youzheng Wu, Xiaodong He, Ying Liu, Bowen Zhou arXiv_CL arXiv_CL Transformer Knowledge Self-Supervised Pose Summarization Language_Model PDF
2021-04-14 The Surprising Performance of Simple Baselines for Misinformation Detection Kellin Pelrine, Jacob Danovitch, Reihaneh Rabbany arXiv_CL arXiv_CL Transformer RNN Pose Detection Language_Model PDF
2021-04-14 Distributed Word Representation in Tsetlin Machine Rohan Kumar Yadav, Lei Jiao, Ole-Christoffer Granmo, Morten Goodwin arXiv_AI arXiv_AI Recognition Text_Classification Pose Classification Sentiment Language_Model PDF
2021-04-14 Natural-Language Multi-Agent Simulations of Argumentative Opinion Dynamics Gregor Betz arXiv_AI arXiv_AI Language_Model PDF
2021-04-14 Large-Scale Self- and Semi-Supervised Learning for Speech Translation Changhan Wang, Anne Wu, Juan Pino, Alexei Baevski, Michael Auli, Alexis Conneau arXiv_CL arXiv_CL Speech Language_Model PDF
2021-04-14 Masked Language Modeling and the Distributional Hypothesis: Order Word Matters Pre-training for Little Koustuv Sinha, Robin Jia, Dieuwke Hupkes, Joelle Pineau, Adina Williams, Douwe Kiela arXiv_CL arXiv_CL Knowledge Pose Language_Model PDF
2021-04-14 Learning How to Ask: Querying LMs with Mixtures of Soft Prompts Guanghui Qin, Jason Eisner arXiv_CL arXiv_CL Embedding Gradient_Descent Knowledge Few-Shot Language_Model PDF
2021-04-14 AR-LSAT: Investigating Analytical Reasoning of Text Wanjun Zhong, Siyuan Wang, Duyu Tang, Zenan Xu, Daya Guo, Jiahai Wang, Jian Yin, Ming Zhou, Nan Duan arXiv_CL arXiv_CL Transformer Knowledge Language_Model PDF
2021-04-14 Zero-Resource Multi-Dialectal Arabic Natural Language Understanding Muhammad Khalifa, Hesham Hassan, Aly Fahmy arXiv_CL arXiv_CL Recognition Zero-Shot Speech Pose Detection Language_Model PDF
2021-04-13 Should Semantic Vector Composition be Explicit? Can it be Linear Dominic Widdows, Kristen Howell, Trevor Cohen arXiv_AI arXiv_AI Pose Survey Language_Model PDF
2021-04-13 EAT: Enhanced ASR-TTS for Self-supervised Speech Recognition Murali Karthick Baskar, Lukáš Burget, Shinji Watanabe, Ramon Fernandez Astudillo, Jan "Honza'' Černocký arXiv_AI arXiv_AI Recognition Speech Self-Supervised Pose Attention Speech_Recognition Language_Model PDF
2021-04-13 Large-Scale Contextualised Language Modelling for Norwegian Andrey Kutuzov, Jeremy Barnes, Erik Velldal, Lilja Øvrelid, Stephan Oepen arXiv_CL arXiv_CL Bert Language_Model PDF
2021-04-13 Zhestyatsky at SemEval-2021 Task 2: ReLU over Cosine Similarity for BERT Fine-tuning Boris Zhestiankin, Maria Ponomareva arXiv_CL arXiv_CL Bert Language_Model PDF
2021-04-13 Detoxifying Language Models Risks Marginalizing Minority Voices Albert Xu, Eshaan Pathak, Eric Wallace, Suchin Gururangan, Maarten Sap, Dan Klein arXiv_CL arXiv_CL Pose Relation Text_Generation Language_Model PDF
2021-04-13 QA-GNN: Reasoning with Language Models and Knowledge Graphs for Question Answering Michihiro Yasunaga, Hongyu Ren, Antoine Bosselut, Percy Liang, Jure Leskovec arXiv_CL arXiv_CL Knowledge Knowledge_Graph Pose Language_Model QA PDF
2021-04-13 Multilingual Transfer Learning for Code-Switched Language and Speech Neural Modeling Genta Indra Winata arXiv_CL arXiv_CL Embedding Transfer_Learning Knowledge Speech Pose Language_Model PDF
2021-04-13 Understanding Transformers for Bot Detection in Twitter Andres Garcia-Silva, Cristian Berrio, Jose Manuel Gomez-Perez arXiv_CL arXiv_CL Transformer Bert Classification Detection Language_Model PDF
2021-04-13 What's in your Head? Emergent Behaviour in Multi-Task Transformer Models Mor Geva, Uri Katz, Aviv Ben-Arie, Jonathan Berant arXiv_CL arXiv_CL Transformer Action Summarization Language_Model Prediction PDF
2021-04-13 Transformer-based Methods for Recognizing Ultra Fine-grained Entities Emanuela Boros, Antoine Doucet arXiv_CL arXiv_CL Transformer Recognition Action Language_Model PDF
2021-04-13 Structural analysis of an all-purpose question answering model Vincent Micheli, Quentin Heinrich, François Fleuret, Wacim Belblidia arXiv_CL arXiv_CL Transformer Pose Attention Language_Model PDF
2021-04-13 CLEVR_HYP: A Challenge Dataset and Baselines for Visual Question Answering with Hypothetical Actions over Images Shailaja Keyur Sampat, Akshay Kumar, Yezhou Yang, Chitta Baral arXiv_CV arXiv_CV Pose Action VQA Language_Model QA PDF
2021-04-13 Experiments of ASR-based mispronunciation detection for children and adult English learners Nina Hosseini-Kivanani, Roberto Gretter, Marco Matassoni, Giuseppe Daniele Falavigna arXiv_CL arXiv_CL Recognition Speech Detection Speech_Recognition Language_Model PDF
2021-04-13 Restoring and Mining the Records of the Joseon Dynasty via Neural Language Modeling and Machine Translation Kyeongpil Kang, Kyohoon Jin, Soyoung Yang, Sujin Jang, Jaegul Choo, Yougbin Kim arXiv_AI arXiv_AI Attention Language_Model PDF
2021-04-13 Discourse Probing of Pretrained Language Models Fajri Koto, Jey Han Lau, Timothy Baldwin arXiv_CL arXiv_CL Bert Relation Language_Model PDF
2021-04-12 Relational world knowledge representation in contextual language models: A review Tara Safavi, Danai Koutra arXiv_AI arXiv_AI Knowledge Review Self-Supervised Pose Relation Language_Model PDF
2021-04-12 SpartQA: : A Textual Question Answering Benchmark for Spatial Reasoning Roshanak Mirzaee, Hossein Rajaby Faghihi, Qiang Ning, Parisa Kordjmashidi arXiv_AI arXiv_AI Pose Language_Model QA PDF
2021-04-12 Evaluating Saliency Methods for Neural Language Models Shuoyang Ding, Philipp Koehn arXiv_CL arXiv_CL Salient Quantitative Language_Model Prediction PDF
2021-04-12 Paragraph-level Simplification of Medical Texts Ashwin Devaraj, Iain J. Marshall, Byron C. Wallace, Junyi Jessy Li arXiv_CL arXiv_CL Transformer Pose Medical Language_Model PDF
2021-04-12 On the Inductive Bias of Masked Language Modeling: From Statistical to Syntactic Dependencies Tianyi Zhang, Tatsunori Hashimoto arXiv_AI arXiv_AI Unsupervised Classification Language_Model PDF
2021-04-12 Investigating Methods to Improve Language Model Integration for Attention-based Encoder-Decoder ASR Models Mohammad Zeineldeen, Aleksandr Glushko, Wilfried Michel, Albert Zeyer, Ralf Schlüter, Hermann Ney arXiv_CL arXiv_CL Pose Attention Language_Model PDF
2021-04-12 Multilingual Language Models Predict Human Reading Behavior Nora Hollenstein, Federico Pirovano, Ce Zhang, Lena Jäger, Lisa Beinborn arXiv_CL arXiv_CL Transformer Tracking Bert Language_Model PDF
2021-04-12 Building a Swedish Open-Domain Conversational Language Model Tobias Norlund, Agnes Stenbom arXiv_CL arXiv_CL Knowledge Language_Model PDF
2021-04-12 Learning to Remove: Towards Isotropic Pre-trained BERT Embedding Yuxin Liang, Rui Cao, Jie Zheng, Jie Ren, Ling Gao arXiv_CL arXiv_CL Embedding Bert Pose Language_Model PDF
2021-04-12 Factual Probing Is MASK: Learning vs. Learning to Recall Zexuan Zhong, Dan Friedman, Danqi Chen arXiv_CL arXiv_CL Embedding Pose Language_Model Prediction PDF
2021-04-12 SuperSim: a test set for word similarity and relatedness in Swedish Simon Hengchen, Nina Tahmasebi arXiv_CL arXiv_CL Pose Language_Model PDF
2021-04-12 Estimating Subjective Crowd-Evaluations as an Additional Objective to Improve Natural Language Generation Jakob Nyberg, Ramesh Manuvinakurike, Maike Paetzel-Prüsmann arXiv_CL arXiv_CL Language_Model PDF
2021-04-11 Disentangling Semantics and Syntax in Sentence Embeddings with Pre-trained Language Models James Y. Huang, Kuan-Hao Huang, Kai-Wei Chang arXiv_CL arXiv_CL Embedding Unsupervised Language_Model PDF
2021-04-11 Innovative Bert-based Reranking Language Models for Speech Recognition Shih-Hsuan Chiu, Berlin Chen arXiv_CL arXiv_CL Transformer Unsupervised Recognition Bert RNN Speech Pose Speech_Recognition Language_Model Prediction PDF
2021-04-10 Non-autoregressive Transformer-based End-to-end ASR using BERT Fu-Hao Yu, Kuan-Yu Chen arXiv_CL arXiv_CL Transformer Recognition Bert Speech Pose Attention Speech_Recognition Inference Language_Model PDF
2021-04-10 NLI Data Sanity Check: Assessing the Effect of Data Corruption on Model Performance Aarne Talman, Marianna Apidianaki, Stergios Chatzikyriakidis, Jörg Tiedemann arXiv_CL arXiv_CL Pose Inference Language_Model Prediction PDF
2021-04-10 MIPT-NSU-UTMN at SemEval-2021 Task 5: Ensembling Learning with Pre-trained Language Models for Toxic Spans Detection Mikhail Kotyushev, Anna Glazkova, Dmitry Morozov arXiv_AI arXiv_AI Bert Detection Language_Model PDF
2021-04-10 Not All Attention Is All You Need Hongqiu Wu, Hai Zhao, Min Zhang arXiv_CL arXiv_CL Recognition Classification Attention Inference Language_Model PDF
2021-04-10 Meta-tuning Language Models to Answer Prompts Better Ruiqi Zhong, Kristy Lee, Zheng Zhang, Dan Klein arXiv_AI arXiv_AI Zero-Shot Review Pose Classification Sentiment Language_Model QA PDF
2021-04-09 Lookup-Table Recurrent Language Models for Long Tail Speech Recognition W. Ronny Huang, Tara N. Sainath, Cal Peyser, Shankar Kumar, David Rybach, Trevor Strohman arXiv_CL arXiv_CL Embedding Recognition Sparse RNN Speech Speech_Recognition Language_Model PDF
2021-04-09 Language model fusion for streaming end to end speech recognition Rodrigo Cabrera, Xiaofeng Liu, Mohammadreza Ghodsi, Zebulun Matteson, Eugene Weinstein, Anjuli Kannan arXiv_CL arXiv_CL Recognition RNN Speech Pose Speech_Recognition Language_Model PDF
2021-04-09 Efficient Large-Scale Language Model Training on GPU Clusters Deepak Narayanan, Mohammad Shoeybi, Jared Casper, Patrick LeGresley, Mostofa Patwary, Vijay Korthikanti, Dmitri Vainbrand, Prethvi Kashinkunti, Julie Bernauer, Bryan Catanzaro, Amar Phanishayee, Matei Zaharia arXiv_CL arXiv_CL Pose Quantitative Language_Model PDF
2021-04-09 Fill-in-the-blank as a Challenging Video Understanding Evaluation Framework Santiago Castro, Ruoyao Wang, Pingxuan Huang, Ian Stewart, Nan Liu, Jonathan Stroud, Rada Mihalcea arXiv_CV arXiv_CV Video_Caption Pose Caption Language_Model PDF
2021-04-08 AlephBERT:A Hebrew Large Pre-Trained Language Model to Start-off your Hebrew NLP Application With Amit Seker, Elron Bandel, Dan Bareket, Idan Brusilovsky, Refael Shaked Greenfeld, Reut Tsarfaty arXiv_CL arXiv_CL Segmentation Recognition Bert Speech Sentiment Language_Model PDF
2021-04-08 Deep Indexed Active Learning for Matching Heterogeneous Entity Representations Arjit Jain, Sunita Sarawagi, Prithviraj Sen arXiv_AI arXiv_AI Transformer Embedding Pose Language_Model Matching PDF
2021-04-08 Machine Learning Based on Natural Language Processing to Detect Cardiac Failure in Clinical Narratives Thanh-Dung Le, Rita Noumeir, Jerome Rambaud, Guillaume Sans, Philippe Jouvet arXiv_CL arXiv_CL Embedding Represenation_Learning Pose Classification Language_Model PDF
2021-04-08 COVID-19 Named Entity Recognition for Vietnamese Thinh Hung Truong, Mai Hoang Dao, Dat Quoc Nguyen arXiv_CL arXiv_CL Segmentation Recognition Bert Language_Model PDF
2021-04-08 Uppsala NLP at SemEval-2021 Task 2: Multilingual Language Models for Fine-tuning and Feature Extraction in Word-in-Context Disambiguation Huiling You, Xingran Zhu, Sara Stymne arXiv_CL arXiv_CL Bert Action Language_Model PDF
2021-04-08 Video Question Answering with Phrases via Semantic Roles Arka Sadhu, Kan Chen, Ram Nevatia arXiv_CV arXiv_CV Video_Caption Pose Activity Language_Model QA PDF
2021-04-08 WNARS: WFST based Non-autoregressive Streaming End-to-End Speech Recognition Zhichao Wang, Wenwen Yang, Pan Zhou, Wei Chen arXiv_CL arXiv_CL Recognition RNN Knowledge Speech Pose Attention Speech_Recognition Language_Model PDF
2021-04-08 Revisiting Simple Neural Probabilistic Language Models Simeng Sun, Mohit Iyyer arXiv_CL arXiv_CL Transformer Embedding Optimization Attention Language_Model PDF
2021-04-08 Nutribullets Hybrid: Multi-document Health Summarization Darsh J Shah, Lili Yu, Tao Lei, Regina Barzilay arXiv_CL arXiv_CL Face Relation Summarization Language_Model PDF
2021-04-07 Pushing the Limits of Non-Autoregressive Speech Recognition Edwin G. Ng, Chung-Cheng Chiu, Yu Zhang, William Chan arXiv_CL arXiv_CL Recognition Speech Speech_Recognition Language_Model PDF
2021-04-07 Seeing Out of tHe bOx: End-to-End Pre-training for Vision-Language Representation Learning Zhicheng Huang, Zhaoyang Zeng, Yupan Huang, Bei Liu, Dongmei Fu, Jianlong Fu arXiv_CV arXiv_CV Transformer Represenation_Learning Salient Pose Action CNN Inference Language_Model PDF
2021-04-07 Librispeech Transducer Model with Internal Language Model Prior Correction Albert Zeyer, André Merboldt, Wilfried Michel, Ralf Schlüter, Hermann Ney arXiv_AI arXiv_AI Speech Action Language_Model PDF
2021-04-07 Darts-Conformer: Towards Efficient Gradient-Based Neural Architecture Search For End-to-End ASR Xian Shi, Pan Zhou, Wei Chen, Lei Xie arXiv_SD arXiv_SD NAS Knowledge Pose Classification Attention Image_Classification Language_Model PDF
2021-04-07 Interpreting A Pre-trained Model Is A Key For Model Architecture Optimization: A Case Study On Wav2Vec 2.0 Liu Chen, Meysam Asgari arXiv_CL arXiv_CL Transformer NAS Optimization Speech Pose Attention Language_Model PDF
2021-04-06 Blow the Dog Whistle: A Chinese Dataset for Cant Understanding with Common Sense and World Knowledge Canwen Xu, Wangchunshu Zhou, Tao Ge, Ke Xu, Julian McAuley, Furu Wei arXiv_AI arXiv_AI Embedding Knowledge Pose Quantitative Language_Model PDF
2021-04-06 LT-LM: a novel non-autoregressive language model for single-shot lattice rescoring Anton Mitrofanov, Mariya Korenevskaya, Ivan Podluzhny, Yuri Khokhlov, Aleksandr Laptev, Andrei Andrusenko, Aleksei Ilin, Maxim Korenevsky, Ivan Medennikov, Aleksei Romanenko arXiv_CL arXiv_CL Transformer Recognition RNN Speech Pose Speech_Recognition Language_Model PDF
2021-04-06 Extremely Low Footprint End-to-End ASR System for Smart Device Zhifu Gao, Yiwu Yao, Shiliang Zhang, Jun Yang, Ming Lei, Ian McLoughlin arXiv_SD arXiv_SD Transformer Quantization Recognition Speech Pose Attention Speech_Recognition Language_Model PDF
2021-04-05 Contextualized Streaming End-to-End Speech Recognition with Trie-Based Deep Biasing and Shallow Fusion Duc Le, Mahaveer Jain, Gil Keren, Suyoun Kim, Yangyang Shi, Jay Mahadeokar, Julian Chan, Yuan Shangguan, Christian Fuegen, Ozlem Kalinli, Yatharth Saraf, Michael L. Seltzer arXiv_CL arXiv_CL Recognition Speech Speech_Recognition Language_Model PDF
2021-04-05 Semantic Distance: A New Metric for ASR Performance Analysis Towards Spoken Language Understanding Suyoun Kim, Abhinav Arora, Duc Le, Ching-Feng Yeh, Christian Fuegen, Ozlem Kalinli, Michael L. Seltzer arXiv_CL arXiv_CL Transformer Embedding Recognition Bert Speech Pose Speech_Recognition Language_Model PDF
2021-04-05 SpeechStew: Simply Mix All Available Speech Recognition Data to Train One Large Neural Network William Chan, Daniel Park, Chris Lee, Yu Zhang, Quoc Le, Mohammad Norouzi arXiv_CL arXiv_CL Transfer_Learning Recognition Speech Speech_Recognition Language_Model PDF
2021-04-05 Exploring Transformers in Emotion Recognition: a comparison of BERT, DistillBERT, RoBERTa, XLNet and ELECTRA Diogo Cortiz arXiv_CL arXiv_CL Transformer Recognition Bert Emotion Language_Model PDF
2021-04-05 What's the best place for an AI conference, Vancouver or ______: Why completing comparative questions is difficult Avishai Zagoury, Einat Minkov, Idan Szpektor, William W. Cohen arXiv_CL arXiv_CL Bert Knowledge Action Language_Model PDF
2021-04-05 Annotating Columns with Pre-trained Language Models Yoshihiko Suhara, Jinfeng Li, Yuliang Li, Dan Zhang, Çağatay Demiralp, Chen Chen, Wang-Chiew Tan arXiv_CL arXiv_CL Relation Language_Model Prediction PDF
2021-04-05 BBAEG: Towards BERT-based Biomedical Adversarial Example Generation for Text Classification Ishani Mondal arXiv_CL arXiv_CL Bert Text_Classification Review Adversarial Pose Classification Deep_Learning Medical Language_Model Prediction PDF
2021-04-05 COVID-19 sentiment analysis via deep learning during the rise of novel cases Rohitash Chandra, Aswin Krishna arXiv_CL arXiv_CL Embedding Sentiment_Classification RNN Review Emotion Classification Deep_Learning Sentiment Language_Model PDF
2021-04-05 Towards Automated Psychotherapy via Language Modeling Houjun Liu arXiv_CL arXiv_CL Transformer Language_Model PDF
2021-04-04 A Context-Dependent Gated Module for Incorporating Symbolic Semantics into Event Coreference Resolution Tuan Lai, Heng Ji, Trung Bui, Quan Hung Tran, Franck Dernoncourt, Walter Chang arXiv_CL arXiv_CL Pose Action Language_Model PDF
2021-04-04 Recommending Metamodel Concepts during Modeling Activities with Pre-Trained Language Models Martin Weyssow, Houari Sahraoui, Eugene Syriani arXiv_CL arXiv_CL Knowledge Pose Deep_Learning Relation Language_Model Recommendation PDF
2021-04-04 KnowGraph@IITK at SemEval-2021 Task 11: Building KnowledgeGraph for NLP Research Shashank Shailabh, Sajal Chaurasia, Ashutosh Modi arXiv_CL arXiv_CL Transformer Bert RNN Knowledge Knowledge_Graph Pose Action Language_Model Prediction PDF
2021-04-04 TransfoRNN: Capturing the Sequential Information in Self-Attention Representations for Language Modeling Tze Yuang Chong, Xuyang Wang, Lin Yang, Junjie Wang arXiv_CL arXiv_CL Transformer Recognition RNN Speech Pose Attention Speech_Recognition Language_Model PDF
2021-04-04 MCL@IITK at SemEval-2021 Task 2: Multilingual and Cross-lingual Word-in-Context Disambiguation using Augmented Data, Signals, and Transformers Rohan Gupta, Jay Mundra, Deepak Mahajan, Ashutosh Modi arXiv_CL arXiv_CL Transformer Bert Zero-Shot Pose Classification Language_Model PDF
2021-04-04 IITK@Detox at SemEval-2021 Task 5: Semi-Supervised Learning and Dice Loss for Toxic Spans Detection Archit Bansal, Abhay Kaushik, Ashutosh Modi arXiv_CL arXiv_CL Transformer Pose Detection Language_Model PDF
2021-04-04 ReCAM@IITK at SemEval-2021 Task 4: BERT and ALBERT based Ensemble for Abstract Word Prediction Abhishek Mittal, Ashutosh Modi arXiv_AI arXiv_AI Bert Language_Model Prediction PDF
2021-04-04 IndT5: A Text-to-Text Transformer for 10 Indigenous Languages El Moatez Billah Nagoudi, Wei-Rui Chen, Muhammad Abdul-Mageed, Hasan Cavusogl arXiv_CL arXiv_CL Transformer Language_Model PDF
2021-04-03 MMBERT: Multimodal BERT Pretraining for Improved Medical VQA Yash Khare, Viraj Bagal, Minesh Mathew, Adithi Devi, U Deva Priyakumar, CV Jawahar arXiv_CV arXiv_CV Transformer Bert Self-Supervised Pose VQA Attention Medical Caption Language_Model QA PDF
2021-04-03 On-the-Fly Aligned Data Augmentation for Sequence-to-Sequence ASR Tsz Kin Lam, Mayumi Ohta, Shigehiko Schamoni, Stefan Riezler arXiv_CL arXiv_CL Recognition Speech Pose Speech_Recognition Language_Model PDF
2021-04-02 Humor@IITK at SemEval-2021 Task 7: Large Language Models for Quantifying Humor and Offensiveness Aishwarya Gupta, Avik Pal, Bholeshwar Khurana, Lakshay Tyagi, Ashutosh Modi arXiv_CL arXiv_CL Knowledge Detection Language_Model Recommendation PDF
2021-04-01 CURIE: An Iterative Querying Approach for Reasoning About Situations Dheeraj Rajagopal, Aman Madaan, Niket Tandon, Yiming Yang, Shrimai Prabhumoye, Abhilasha Ravichander, Peter Clark, Eduard Hovy arXiv_CL arXiv_CL Knowledge Pose Language_Model QA PDF
2021-04-01 Action-Based Conversations Dataset: A Corpus for Building More In-Depth Task-Oriented Dialogue Systems Derek Chen, Howard Chen, Yi Yang, Alex Lin, Zhou Yu arXiv_CL arXiv_CL Tracking Pose Action Language_Model PDF
2021-04-01 'TL;DR:' Out-of-Context Adversarial Text Summarization and Hashtag Recommendation Peter Jachim, Filipo Sharevski, Emma Pieroni arXiv_CL arXiv_CL Adversarial Summarization Text_Generation Language_Model Recommendation PDF
2021-04-01 Low-Resource Language Modelling of South African Languages Stuart Mesham, Luc Hayward, Jared Shapiro, Jan Buys arXiv_CL arXiv_CL Transformer RNN Language_Model PDF
2021-04-01 Canonical and Surface Morphological Segmentation for Nguni Languages Tumi Moeng, Sheldon Reay, Aaron Daniels, Jan Buys arXiv_CL arXiv_CL Transformer Segmentation Unsupervised RNN Face Attention Language_Model PDF
2021-04-01 UC2: Universal Cross-lingual Cross-modal Vision-and-Language Pre-training Mingyang Zhou, Luowei Zhou, Shuohang Wang, Yu Cheng, Linjie Li, Zhou Yu, Jingjing Liu arXiv_CV arXiv_CV Embedding Represenation_Learning Pose VQA Caption Language_Model Matching PDF
2021-04-01 Detecting over/under-translation errors for determining adequacy in human translations Prabhakar Gupta, Ridha Juneja, Anil Nelakanti, Tamojit Chatterjee arXiv_CL arXiv_CL Embedding Classification Language_Model PDF
2021-03-31 Multi-Encoder Learning and Stream Fusion for Transformer-Based End-to-End Automatic Speech Recognition Timo Lohrenz, Zhengyang Li, Tim Fingscheidt arXiv_CL arXiv_CL Transformer Recognition Speech Attention Speech_Recognition Inference Language_Model PDF
2021-03-31 Few-shot learning through contextual data augmentation Farid Arthaud, Rachel Bawden, Alexandra Birch arXiv_CL arXiv_CL Pose Few-Shot Language_Model PDF
2021-03-30 BASE Layers: Simplifying Training of Large, Sparse Models Mike Lewis, Shruti Bhosale, Tim Dettmers, Naman Goyal, Luke Zettlemoyer arXiv_CL arXiv_CL Sparse Action Inference Language_Model PDF
2021-03-30 AfriKI: Machine-in-the-Loop Afrikaans Poetry Generation Imke van Heerden, Anil Bas arXiv_CL arXiv_CL RNN Knowledge Pose Text_Generation Language_Model PDF
2021-03-30 XRJL-HKUST at SemEval-2021 Task 4: WordNet-Enhanced Dual Multi-head Co-Attention for Reading Comprehension of Abstract Meaning Yuxin Jiang, Ziyi Shou, Qijun Wang, Hao Wu, Fangzhen Lin arXiv_CL arXiv_CL Knowledge Relation Attention Language_Model PDF
2021-03-30 Symbolic Music Generation with Diffusion Models Gautam Mittal, Jesse Engel, Curtis Hawthorne, Ian Simon arXiv_SD arXiv_SD Embedding Language_Model PDF
2021-03-30 Self-supervised Image-text Pre-training With Mixed Data In Chest X-rays Xiaosong Wang, Ziyue Xu, Leo Tam, Dong Yang, Daguang Xu arXiv_CV arXiv_CV Transformer Weakly_Supervised Self-Supervised Pose Classification Medical Language_Model PDF
2021-03-29 Contextual Text Embeddings for Twi Paul Azunre, Salomey Osei, Salomey Addo, Lawrence Asamoah Adu-Gyamfi, Stephen Moore, Bernard Adabankah, Bernard Opoku, Clara Asare-Nyarko, Samuel Nyarko, Cynthia Amoaba, Esther Dansoa Appiah, Felix Akwerh, Richard Nii Lante Lawson, Joel Budu, Emmanuel Debrah, Nana Boateng, Wisdom Ofori, Edwin Buabeng-Munkoh, Franklin Adjei, Isaac Kojo Essel Ampomah, Joseph Otoo, Reindorf Borkor, Standylove Birago Mensah, Lucien Mensah, Mark Amoako Marcel, Anokye Acheampong Amponsah, James Ben Hayfron-Acquah arXiv_AI arXiv_AI Transformer Embedding Recognition Bert Sentiment_Classification Knowledge Speech Face NMT Classification Sentiment Language_Model PDF
2021-03-29 Entity Context Graph: Learning Entity Representations fromSemi-Structured Textual Sources on the Web Kalpa Gunaratna, Yu Wang, Hongxia Jin arXiv_CL arXiv_CL Embedding Knowledge Knowledge_Graph Pose Action Relation Language_Model Recommendation PDF
2021-03-29 Text Normalization for Low-Resource Languages of Africa Andrew Zupon, Evan Crew, Sandy Ritchie arXiv_CL arXiv_CL Language_Model PDF
2021-03-29 Shrinking Bigfoot: Reducing wav2vec 2.0 footprint Zilun Peng, Akshay Budhkar, Ilana Tuil, Jason Levy, Parinaz Sobhani, Raphael Cohen, Jumana Nassour arXiv_CL arXiv_CL Recognition Knowledge Speech Speech_Recognition Inference Language_Model PDF
2021-03-29 Retraining DistilBERT for a Voice Shopping Assistant by Using Universal Dependencies Pratik Jayarao, Arpit Sharma arXiv_AI arXiv_AI Bert Detection Sentiment Language_Model PDF
2021-03-29 Changing the Mind of Transformers for Topically-Controllable Language Generation Haw-Shiuan Chang, Jiaming Yuan, Mohit Iyyer, Andrew McCallum arXiv_CL arXiv_CL Transformer Self-Supervised Text_Generation Language_Model PDF
2021-03-28 'Just because you are right, doesn't mean I am wrong': Overcoming a Bottleneck in the Development and Evaluation of Open-Ended Visual Question Answering Tasks Man Luo, Shailaja Keyur Sampat, Riley Tallman, Yankai Zeng, Manuha Vancha, Akarshan Sajja, Chitta Baral arXiv_CL arXiv_CL Pose VQA Language_Model QA PDF
2021-03-27 You Can Do Better! If You Elaborate the Reason When Making Prediction Dongfang Li, Jingcong Tao, Qingcai Chen, Baotian Hu arXiv_CL arXiv_CL Pose Medical Inference Language_Model Prediction PDF
2021-03-26 Correcting Automated and Manual Speech Transcription Errors using Warped Language Models Mahdi Namazifar, John Malik, Li Erran Li, Gokhan Tur, Dilek Hakkani Tür arXiv_CL arXiv_CL Speech Pose Language_Model PDF
2021-03-26 Functorial Language Models Alexis Toumi, Alex Koziell-Pipe arXiv_CL arXiv_CL Language_Model PDF
2021-03-26 BART based semantic correction for Mandarin automatic speech recognition system Yun Zhao, Xuerui Yang, Jinchao Wang, Yongyu Gao, Chao Yan, Yuanfu Zhou arXiv_CL arXiv_CL Transformer Recognition Speech Pose Speech_Recognition Language_Model PDF
2021-03-26 A Benchmark Study of Machine Learning Models for Online Fake News Detection Junaed Younus Khan, Md. Tawkat Islam Khondaker, Sadia Afroz, Gias Uddin, Anindya Iqbal arXiv_CL arXiv_CL Bert Knowledge Deep_Learning Detection Language_Model PDF
2021-03-25 Visual Grounding Strategies for Text-Only Natural Language Processing Damien Sileo arXiv_CL arXiv_CL Bert Image_Retrieval Pose Classification VQA Language_Model PDF
2021-03-25 K-XLNet: A General Method for Combining Explicit Knowledge with Language Model Pretraining Ruiqing Yan, Lanchang Sun, Fang Wang, Xiaoming Zhang arXiv_AI arXiv_AI Transformer Bert Knowledge Knowledge_Graph Pose Face Language_Model PDF
2021-03-25 An Approach to Improve Robustness of NLP Systems against ASR Errors Tong Cui, Jinghui Xiao, Liangyou Li, Xin Jiang, Qun Liu arXiv_CL arXiv_CL Recognition Speech Speech_Recognition Language_Model PDF
2021-03-25 Predicting Directionality in Causal Relations in Text Pedram Hosseini, David A. Broniatowski, Mona Diab arXiv_AI arXiv_AI Transformer Bert Relation Language_Model PDF
2021-03-24 Are Multilingual Models Effective in Code-Switching? Genta Indra Winata, Samuel Cahyawijaya, Zihan Liu, Zhaojiang Lin, Andrea Madotto, Pascale Fung arXiv_CL arXiv_CL Embedding Recognition Speech Inference Language_Model PDF
2021-03-24 FastMoE: A Fast Mixture-of-Expert Training System Jiaao He, Jiezhong Qiu, Aohan Zeng, Zhilin Yang, Jidong Zhai, Jie Tang arXiv_CL arXiv_CL Transformer Face Language_Model PDF
2021-03-24 Drug Recommendation System based on Sentiment Analysis of Drug Reviews using Machine Learning Satvik Garg arXiv_AI arXiv_AI Review Classification Sentiment Medical Language_Model Recommendation PDF
2021-03-24 Thinking Aloud: Dynamic Context Generation Improves Zero-Shot Reasoning Performance of GPT-2 Gregor Betz, Kyle Richardson, Christian Voigt arXiv_CL arXiv_CL Zero-Shot Text_Generation Inference Language_Model PDF
2021-03-24 UNICORN on RAINBOW: A Universal Commonsense Reasoning Model on a New Multitask Benchmark Nicholas Lourie, Ronan Le Bras, Chandra Bhagavatula, Yejin Choi arXiv_CL arXiv_CL Transfer_Learning Knowledge Knowledge_Graph Pose Language_Model QA PDF
2021-03-23 The NLP Cookbook: Modern Recipes for Transformer based Deep Learning Architectures Sushant Singh, Ausif Mahmood arXiv_CL arXiv_CL Transformer Quantization Transfer_Learning Bert Knowledge Action Deep_Learning Attention Inference Language_Model PDF
2021-03-23 Variable Name Recovery in Decompiled Binary Code using Constrained Masked Language Modeling Pratyay Banerjee, Kuntal Kumar Pal, Fish Wang, Chitta Baral arXiv_CL arXiv_CL Transformer Bert Pose Language_Model Prediction PDF
2021-03-23 Are Neural Language Models Good Plagiarists? A Benchmark for Neural Paraphrase Detection Jan Philip Wahle, Terry Ruas, Norman Meuschke, Bela Gipp arXiv_AI arXiv_AI Transformer Bert Pose Classification Detection Language_Model PDF
2021-03-23 Detecting Hate Speech with GPT-3 Ke-Li Chiu, Rohan Alexander arXiv_CL arXiv_CL Speech Detection Few-Shot Language_Model PDF
2021-03-23 Hallucination of speech recognition errors with sequence to sequence learning Prashant Serai, Vishal Sunder, Eric Fosler-Lussier arXiv_CL arXiv_CL Recognition Speech Speech_Recognition Language_Model PDF
2021-03-22 Improving and Simplifying Pattern Exploiting Training Derek Tam, Rakesh R Menon, Mohit Bansal, Shashank Srivastava, Colin Raffel arXiv_AI arXiv_AI Few-Shot Language_Model PDF
2021-03-22 BERT: A Review of Applications in Natural Language Processing and Understanding M. V. Koroteev arXiv_AI arXiv_AI Bert Review Survey Deep_Learning Attention Language_Model PDF
2021-03-22 Nutri-bullets: Summarizing Health Studies by Composing Segments Darsh J Shah, Lili Yu, Tao Lei, Regina Barzilay arXiv_CL arXiv_CL Pose Summarization Language_Model PDF
2021-03-22 Identifying Machine-Paraphrased Plagiarism Jan Philip Wahle, Terry Ruas, Tomáš Foltýnek, Norman Meuschke, Bela Gipp arXiv_AI arXiv_AI Embedding Classification Detection Language_Model Matching PDF
2021-03-21 ROSITA: Refined BERT cOmpreSsion with InTegrAted techniques Yuanxin Liu, Zheng Lin, Fengcheng Yuan arXiv_CL arXiv_CL Bert Knowledge Face Attention Language_Model PDF
2021-03-20 Attribute Alignment: Controlling Text Generation from Pre-trained Language Models Dian Yu, Kenji Sagae, Zhou Yu arXiv_CL arXiv_CL Pose Sentiment Text_Generation Language_Model PDF
2021-03-19 Play the Shannon Game With Language Models: A Human-Free Approach to Summary Evaluation Nicholas Egan, Oleg Vasilyev, John Bohannon arXiv_CL arXiv_CL Pose Language_Model PDF
2021-03-19 MuRIL: Multilingual Representations for Indian Languages Simran Khanuja, Diksha Bansal, Sarvesh Mehtani, Savya Khosla, Atreyee Dey, Balaji Gopalan, Dilip Kumar Margam, Pooja Aggarwal, Rajiv Teja Nagipogu, Shachi Dave, Shruti Gupta, Subhash Chandra Bose Gali, Vish Subramanian, Partha Talukdar arXiv_CL arXiv_CL Bert Pose Language_Model PDF
2021-03-19 Controllable Generation from Pre-trained Language Models via Inverse Prompting Xu Zou, Da Yin, Qingyang Zhong, Hongxia Yang, Zhilin Yang, Jie Tang arXiv_AI arXiv_AI Pose Text_Generation Language_Model QA PDF
2021-03-18 Improving the Lexical Ability of Pretrained Language Models for Unsupervised Neural Machine Translation Alexandra Chronopoulou, Dario Stojanovski, Alexander Fraser arXiv_CL arXiv_CL Embedding Unsupervised NMT Language_Model PDF
2021-03-18 All NLP Tasks Are Generation Tasks: A General Pretraining Framework Zhengxiao Du, Yujie Qian, Xiao Liu, Ming Ding, Jiezhong Qiu, Zhilin Yang, Jie Tang arXiv_AI arXiv_AI Bert Pose Classification Language_Model PDF
2021-03-18 Contextual Biasing of Language Models for Speech Recognition in Goal-Oriented Conversational Agents Ashish Shenoy, Sravan Bodapati, Katrin Kirchhoff arXiv_CL arXiv_CL Embedding Recognition Bert RNN Speech Pose Face Action Speech_Recognition Inference Language_Model QA PDF
2021-03-18 Evaluating Document Coherence Modelling Aili Shen, Meladel Mistica, Bahar Salehi, Hang Li, Timothy Baldwin, Jianzhong Qi arXiv_AI arXiv_AI Pose Detection Language_Model PDF
2021-03-18 Model Extraction and Adversarial Transferability, Your BERT is Vulnerable! Xuanli He, Lingjuan Lyu, Qiongkai Xu, Lichao Sun arXiv_CL arXiv_CL Bert Text_Classification Knowledge Adversarial Action Classification Text_Generation Language_Model PDF
2021-03-17 Advancing RNN Transducer Technology for Speech Recognition George Saon, Zoltan Tueske, Daniel Bolanos, Brian Kingsbury arXiv_CL arXiv_CL Recognition RNN Speech Pose Speech_Recognition Language_Model Prediction PDF
2021-03-17 Transformer-based ASR Incorporating Time-reduction Layer and Fine-tuning with Self-Knowledge Distillation Md Akmal Haidar, Chao Xing, Mehdi Rezagholizadeh arXiv_AI arXiv_AI Transformer Recognition Knowledge Speech Pose Attention Speech_Recognition Inference Language_Model PDF
2021-03-17 Value-aware Approximate Attention Ankit Gupta, Jonathan Berant arXiv_CL arXiv_CL Transformer Sparse Pose Attention Language_Model PDF
2021-03-17 Set-to-Sequence Methods in Machine Learning: a Review Mateusz Jurewicz, Leon Strømberg-Derczynski arXiv_AI arXiv_AI Optimization Represenation_Learning Review Language_Model Prediction PDF
2021-03-17 UniParma @ SemEval 2021 Task 5: Toxic Spans Detection Using CharacterBERT and Bag-of-Words Model Akbar Karimi, Leonardo Rossi, Andrea Prati arXiv_CL arXiv_CL Embedding Bert Detection Language_Model PDF
2021-03-17 Code Word Detection in Fraud Investigations using a Deep-Learning Approach Youri van der Zee, Jan C. Scholtes, Marcel Westerhoud, Julien Rossi arXiv_AI arXiv_AI Bert Review Face Detection GAN Language_Model PDF
2021-03-17 ENCONTER: Entity Constrained Progressive Sequence Generation via Insertion-based Transformer Lee-Hsun Hsieh, Yang-Yin Lee, Ee-Peng Lim arXiv_AI arXiv_AI Transformer Pose Language_Model PDF
2021-03-17 Towards Few-Shot Fact-Checking via Perplexity Nayeon Lee, Yejin Bang, Andrea Madotto, Madian Khabsa, Pascale Fung arXiv_CL arXiv_CL Transfer_Learning Pose Few-Shot Attention Language_Model PDF
2021-03-17 Investigating Monolingual and Multilingual BERTModels for Vietnamese Aspect Category Detection Dang Van Thin, Lac Si Le, Vu Xuan Hoang, Ngan Luu-Thuy Nguyen arXiv_CL arXiv_CL Bert Knowledge Review Pose Detection Sentiment Language_Model PDF
2021-03-16 Structural Adapters in Pretrained Language Models for AMR-to-text Generation Leonardo F. R. Ribeiro, Yue Zhang, Iryna Gurevych arXiv_CL arXiv_CL Knowledge Pose Action Text_Generation Language_Model PDF
2021-03-16 An Asynchronous WFST-Based Decoder For Automatic Speech Recognition Hang Lv, Zhehuai Chen, Hainan Xu, Daniel Povey, Lei Xie, Sanjeev Khudanpur arXiv_SD arXiv_SD Recognition Speech Pose Speech_Recognition Language_Model PDF
2021-03-16 Multilingual Multimodal Pre-training for Zero-Shot Cross-Lingual Transfer of Vision-Language Models Po-Yao Huang, Mandela Patrick, Junjie Hu, Graham Neubig, Florian Metze, Alexander Hauptmann arXiv_CV arXiv_CV Transformer Embedding Zero-Shot Pose Language_Model PDF
2021-03-16 Robustly Optimized and Distilled Training for Natural Language Understanding Haytham ElFadeel, Stan Peshterliev arXiv_CL arXiv_CL Transformer Knowledge Pose Inference Language_Model PDF
2021-03-15 Double Articulation Analyzer with Prosody for Unsupervised Word and Phoneme Discovery Yasuaki Okuda, Ryo Ozaki, Tadahiro Taniguchi arXiv_AI arXiv_AI Segmentation Unsupervised Speech Pose Inference Language_Model PDF
2021-03-14 Claim Verification using a Multi-GAN based Model Amartya Hatua, Arjun Mukherjee, Rakesh M. Verma arXiv_AI arXiv_AI Pose GAN Language_Model PDF
2021-03-14 Learning a Word-Level Language Model with Sentence-Level Noise Contrastive Estimation for Contextual Sentence Probability Estimation Heewoong Park, Sukhyun Cho, Jonghun Park arXiv_CL arXiv_CL RNN Pose Language_Model PDF
2021-03-13 Embedding Calibration for Music Semantic Similarity using Auto-regressive Transformer Xinran Zhang, Maosong Sun, Jiafeng Liu, Xiaobing Li arXiv_CL arXiv_CL Transformer Embedding Represenation_Learning Language_Model PDF
2021-03-13 Improving Diversity of Neural Text Generation via Inverse Probability Weighting Xinran Zhang, Maosong Sun, Jiafeng Liu, Xiaobing Li arXiv_CL arXiv_CL Pose Text_Generation Language_Model PDF
2021-03-12 Privacy Regularization: Joint Privacy-Utility Optimization in Language Models Fatemehsadat Mireshghallah, Huseyin A. Inan, Marcello Hasegawa, Victor Rühle, Taylor Berg-Kirkpatrick, Robert Sim arXiv_CL arXiv_CL Optimization Regularization Language_Model PDF
2021-03-12 Cooperative Learning of Zero-Shot Machine Reading Comprehension Hongyin Luo, Seunghak Yu, James Glass arXiv_AI arXiv_AI Embedding Reinforcement_Learning Zero-Shot Pose Action Language_Model PDF
2021-03-12 Comparing the Performance of NLP Toolkits and Evaluation measures in Legal Tech Muhammad Zohaib Khan arXiv_CL arXiv_CL Unsupervised Bert Classification Language_Model PDF
2021-03-12 Inductive Relation Prediction by BERT Hanwen Zha, Zhiyu Chen, Xifeng Yan arXiv_CL arXiv_CL Embedding Bert Knowledge Knowledge_Graph Pose Relation Few-Shot Inference Language_Model Prediction PDF
2021-03-12 Improving Authorship Verification using Linguistic Divergence Yifan Zhang, Dainis Boumber, Marjan Hosseinia, Fan Yang, Arjun Mukherjee arXiv_CL arXiv_CL Unsupervised Knowledge Pose Language_Model Matching PDF
2021-03-12 Bilingual Dictionary-based Language Model Pretraining for Neural Machine Translation Yusen Lin, Jiayong Lin, Shuaicheng Zhang, Haoying Dai arXiv_AI arXiv_AI Transformer Pose Language_Model PDF
2021-03-11 Learning Feature Weights using Reward Modeling for Denoising Parallel Corpora Gaurav Kumar, Philipp Koehn, Sanjeev Khudanpur arXiv_CL arXiv_CL NMT Denoising Language_Model PDF
2021-03-11 MERMAID: Metaphor Generation with Symbolism and Discriminative Decoding Tuhin Chakrabarty, Xurui Zhang, Smaranda Muresan, Nanyun Peng arXiv_CL arXiv_CL Pose Inference Language_Model PDF
2021-03-11 ENTRUST: Argument Reframing with Language Models and Entailment Tuhin Chakrabarty, Christopher Hidey, Smaranda Muresan arXiv_AI arXiv_AI Pose Text_Generation Language_Model PDF
2021-03-11 The Interplay of Variant, Size, and Task Type in Arabic Pre-trained Language Models Go Inoue, Bashar Alhafni, Nurpeiis Baimukan, Houda Bouamor, Nizar Habash arXiv_CL arXiv_CL Language_Model PDF
2021-03-11 Evaluation of Morphological Embeddings for English and Russian Languages Vitaly Romanov, Albina Khusainova arXiv_CL arXiv_CL Embedding Language_Model PDF
2021-03-11 Does the Magic of BERT Apply to Medical Code Assignment? A Quantitative Study Shaoxiong Ji, Matti Hölttä, Pekka Marttinen arXiv_CL arXiv_CL Unsupervised Transfer_Learning Bert Pose Action Quantitative Attention Medical Language_Model Prediction PDF
2021-03-11 Read Like Humans: Autonomous, Bidirectional and Iterative Language Modeling for Scene Text Recognition Shancheng Fang, Hongtao Xie, Yuxin Wang, Zhendong Mao, Yongdong Zhang arXiv_CV arXiv_CV Recognition Knowledge Pose Scene_Text Autonomous Language_Model Prediction PDF
2021-03-11 Topical Language Generation using Transformers Rohola Zandie, Mohammad H. Mahoor arXiv_AI arXiv_AI Transformer Sentiment Text_Generation Language_Model PDF
2021-03-11 LightMBERT: A Simple Yet Effective Method for Multilingual BERT Distillation Xiaoqi Jiao, Yichun Yin, Lifeng Shang, Xin Jiang, Xiao Chen, Linlin Li, Fang Wang, Qun Liu arXiv_CL arXiv_CL Bert Pose Language_Model PDF
2021-03-10 Relational Weight Priors in Neural Networks for Abstract Pattern Learning and Language Modelling Radha Kopparti, Tillman Weyde arXiv_AI arXiv_AI RNN Pose Deep_Learning Relation Language_Model Prediction PDF
2021-03-10 Variable-rate discrete representation learning Sander Dieleman, Charlie Nash, Jesse Engel, Karen Simonyan arXiv_CL arXiv_CL Transformer Reconstruction Unsupervised Represenation_Learning Salient Speech Pose Language_Model PDF
2021-03-10 Team Phoenix at WASSA 2021: Emotion Analysis on News Stories with Pre-Trained Language Models Yash Butala, Kanishk Singh, Adarsh Kumar, Shrey Shrivastava arXiv_CL arXiv_CL Pose Emotion Action Detection Language_Model Prediction PDF
2021-03-10 Interpretable bias mitigation for textual data: Reducing gender bias in patient notes while maintaining classification performance Joshua R. Minot, Nicholas Cheney, Marc Maier, Danne C. Elbers, Christopher M. Danforth, Peter Sheridan Dodds arXiv_CL arXiv_CL Bert Classification Relation Medical Language_Model PDF
2021-03-09 Combining Context-Free and Contextualized Representations for Arabic Sarcasm Detection and Sentiment Identification Amey Hengle, Atharva Kshirsagar, Shaily Desai, Manisha Marathe arXiv_CL arXiv_CL Transformer Bert Pose Face Detection Sentiment Language_Model PDF
2021-03-09 Comparing Approaches to Dravidian Language Identification Tommi Jauhiainen, Tharindu Ranasinghe, Marcos Zampieri arXiv_AI arXiv_AI Transformer Text_Classification Classification Deep_Learning GAN Language_Model PDF
2021-03-09 BERTese: Learning to Speak to BERT Adi Haviv, Jonathan Berant, Amir Globerson arXiv_CL arXiv_CL Bert Knowledge Pose Action Language_Model PDF
2021-03-08 AfriVEC: Word Embedding Models for African Languages. Case Study of Fon and Nobiin Bonaventure F. P. Dossou, Mohammed Sabry arXiv_AI arXiv_AI Embedding Transfer_Learning Knowledge Relation Language_Model PDF
2021-03-08 A Parallelizable Lattice Rescoring Strategy with Neural Language Models Ke Li, Daniel Povey, Sanjeev Khudanpur arXiv_CL arXiv_CL Recognition Speech Pose Speech_Recognition Language_Model PDF
2021-03-08 Text Simplification by Tagging Kostiantyn Omelianchuk, Vipul Raheja, Oleksandr Skurzhanskyi arXiv_CL arXiv_CL Transformer Inference Language_Model PDF
2021-03-08 Language Models have a Moral Dimension Patrick Schramowski, Cigdem Turan, Nico Andersen, Constantin Rothkopf, Kristian Kersting arXiv_CL arXiv_CL Transformer Embedding Bert Knowledge Face Language_Model PDF
2021-03-07 Empathetic BERT2BERT Conversational Model: Learning Arabic Language Generation with Little Data Tarek Naous, Wissam Antoun, Reem A. Mahmoud, Hazem Hajj arXiv_CL arXiv_CL Transformer Bert Knowledge Pose Language_Model PDF
2021-03-07 Syntax-BERT: Improving Pre-trained Transformers with Syntax Trees Jiangang Bai, Yujing Wang, Yiren Chen, Yaming Yang, Jing Bai, Jing Yu, Yunhai Tong arXiv_CL arXiv_CL Transformer Bert Language_Model PDF
2021-03-07 MTLHealth: A Deep Learning System for Detecting Disturbing Contentin Student Essays Joseph Valencia, Erin Yao arXiv_CL arXiv_CL Transformer Deep_Learning Detection Language_Model PDF
2021-03-06 Extracting Semantic Process Information from the Natural Language in Event Logs Adrian Rebmann, Han van der Aa arXiv_AI arXiv_AI Quantitative Classification GAN Language_Model PDF
2021-03-05 Causal Attention for Vision-Language Tasks Xu Yang, Hanwang Zhang, Guojun Qi, Jianfei Cai arXiv_CV arXiv_CV Transformer Knowledge Relation Attention Language_Model PDF
2021-03-04 Advances in Multi-turn Dialogue Comprehension: A Survey Zhuosheng Zhang, Hai Zhao arXiv_AI arXiv_AI Review Survey Deep_Learning Language_Model PDF
2021-03-04 A Survey on Spoken Language Understanding: Recent Advances and New Frontiers Libo Qin, Tianbao Xie, Wanxiang Che, Ting Liu arXiv_CL arXiv_CL Review Survey GAN Language_Model PDF
2021-03-03 Malware Classification with Word Embedding Features Aparna Sunil Kale, Fabio Di Troia, Mark Stamp arXiv_CL arXiv_CL Embedding Classification CNN Language_Model PDF
2021-03-03 OAG-BERT: Pre-train Heterogeneous Entity-augmented Academic Language Model Xiao Liu, Da Yin, Xingjian Zhang, Kai Su, Kan Wu, Hongxia Yang, Jie Tang arXiv_CL arXiv_CL Embedding Bert Zero-Shot Knowledge Review Pose Inference Language_Model Prediction Recommendation PDF
2021-03-03 Random Feature Attention Hao Peng, Nikolaos Pappas, Dani Yogatama, Roy Schwartz, Noah A. Smith, Lingpeng Kong arXiv_CL arXiv_CL Transformer Text_Classification Pose Action Classification Attention Language_Model PDF
2021-03-02 The Rediscovery Hypothesis: Language Models Need to Meet Linguistics Vassilina Nikoulina, Maxat Tezekbayev, Nuradil Kozhakhmet, Madina Babazhanova, Matthias Gallé, Zhenisbek Assylbekov arXiv_CL arXiv_CL Knowledge Language_Model Prediction PDF
2021-03-02 Decomposing lexical and compositional syntax and semantics with deep language models Charlotte Caucheteux, Alexandre Gramfort, Jean-Remi King arXiv_CL arXiv_CL Transformer Speech Pose Activity Language_Model PDF
2021-03-02 Unsupervised Word Segmentation with Bi-directional Neural Language Model Lihao Wang, Zongyi Li, Xiaoqing Zheng arXiv_CL arXiv_CL Segmentation Unsupervised Pose Language_Model PDF
2021-03-01 OmniNet: Omnidirectional Representations from Transformers Yi Tay, Mostafa Dehghani, Vamsi Aribandi, Jai Gupta, Philip Pham, Zhen Qin, Dara Bahri, Da-Cheng Juan, Donald Metzler arXiv_AI arXiv_AI Transformer Recognition Pose Few-Shot Attention Language_Model PDF
2021-03-01 Vyākarana: A Colorless Green Benchmark for Syntactic Evaluation in Indic Languages Rajaswa Patil, Jasleen Dhillon, Siddhant Mahurkar, Saumitra Kulkarni, Manav Malhotra, Veeky Baths arXiv_CL arXiv_CL Bert Language_Model Prediction PDF
2021-03-01 Long Document Summarization in a Low Resource Setting using Pretrained Language Models Ahsaas Bajaj, Pavitra Dangati, Kalpesh Krishna, Pradhiksha Ashok Kumar, Rheeya Uppaal, Bradford Windsor, Eliot Brenner, Dominic Dotterrer, Rajarshi Das, Andrew McCallum arXiv_CL arXiv_CL Salient Detection Summarization Language_Model PDF
2021-02-28 RuSentEval: Linguistic Source, Encoder Force! Vladislav Mikhailov, Ekaterina Taktasheva, Elina Sigdel, Ekaterina Artemova arXiv_CL arXiv_CL Transformer Knowledge Language_Model PDF
2021-02-28 Topic Modelling Meets Deep Neural Networks: A Survey He Zhao, Dinh Phung, Viet Huynh, Yuan Jin, Lan Du, Wray Buntine arXiv_CL arXiv_CL Knowledge Review Survey Text_Generation Language_Model PDF
2021-02-28 Self-Diagnosis and Self-Debiasing: A Proposal for Reducing Corpus-Based Bias in NLP Timo Schick, Sahana Udupa, Hinrich Schütze arXiv_CL arXiv_CL Pose Language_Model PDF
2021-02-27 COVID-19 Tweets Analysis through Transformer Language Models Abdul Hameed Azeemi, Adeel Waheed arXiv_CL arXiv_CL Transformer Bert Pose Classification Sentiment Language_Model PDF
2021-02-26 Learning Chess Blindfolded: Evaluating Language Models on State Tracking Shubham Toshniwal, Sam Wiseman, Karen Livescu, Kevin Gimpel arXiv_AI arXiv_AI Transformer Tracking Pose Attention Language_Model PDF
2021-02-25 Automated essay scoring using efficient transformer-based language models Christopher M Ormerod, Akanksha Malhotra, Amir Jafari arXiv_CL arXiv_CL Transformer Language_Model PDF
2021-02-25 Investigating the Limitations of the Transformers with Simple Arithmetic Tasks Rodrigo Nogueira, Zhiying Jiang, Jimmy Li arXiv_AI arXiv_AI Transformer Face Action Language_Model PDF
2021-02-25 A Primer on Contrastive Pretraining in Language Processing: Methods, Lessons Learned and Perspectives Nils Rethmeier, Isabelle Augenstein arXiv_AI arXiv_AI Image_Caption Zero-Shot Adversarial Self-Supervised Contrastive_Learning Survey Relation Language_Model PDF
2021-02-25 ZJUKLAB at SemEval-2021 Task 4: Negative Augmentation with Language Model for Reading Comprehension of Abstract Meaning Xin Xie, Xiangnan Chen, Xiang Chen, Yong Wang, Ningyu Zhang, Shumin Deng, Huajun Chen arXiv_AI arXiv_AI Pose Language_Model PDF
2021-02-25 LET: Linguistic Knowledge Enhanced Graph Transformer for Chinese Short Text Matching Boer Lyu, Lu Chen, Su Zhu, Kai Yu arXiv_AI arXiv_AI Transformer Segmentation Knowledge Pose Language_Model Matching PDF
2021-02-24 RoBERTa-wwm-ext Fine-Tuning for Chinese Text Classification Zhuo Xu arXiv_CL arXiv_CL Transformer Embedding Bert Text_Classification Pose Classification Language_Model PDF
2021-02-24 When Attention Meets Fast Recurrence: Training Language Models with Reduced Compute Tao Lei arXiv_CL arXiv_CL Transformer Attention Language_Model PDF
2021-02-24 Re-Evaluating GermEval17 Using German Pre-Trained Language Models M. Aßenmacher, A. Corvonato, C. Heumann arXiv_CL arXiv_CL Transformer Bert Face Relation Language_Model PDF
2021-02-24 LRG at SemEval-2021 Task 4: Improving Reading Comprehension with Abstract Words using Augmentation, Linguistic Features and Voting Abheesht Sharma, Harshit Pandey, Gunjan Chhablani, Yash Bhartia, Tirtharaj Dash arXiv_CL arXiv_CL Transformer Bert Pose Language_Model Prediction PDF
2021-02-24 From Universal Language Model to Downstream Task: Improving RoBERTa-Based Vietnamese Hate Speech Detection Quang Huu Pham, Viet Anh Nguyen, Linh Bao Doan, Ngoc N. Tran, Ta Minh Thanh arXiv_CL arXiv_CL Transformer Bert Text_Classification Speech Pose Classification Detection Language_Model PDF
2021-02-24 Sentiment Analysis of Code-Mixed Social Media Text Gaurav Singh arXiv_CL arXiv_CL Embedding Sentiment Language_Model PDF
2021-02-23 Paraphrases do not explain word analogies Louis Fournier, Ewan Dunbar arXiv_CL arXiv_CL Embedding Relation Language_Model PDF
2021-02-23 Automated Quality Assessment of Cognitive Behavioral Therapy Sessions Through Highly Contextualized Language Representations Nikolaos Flemotomos, Victor R. Martinez, Zhuohao Chen, Torrey A. Creed, David C. Atkins, Shrikanth Narayanan arXiv_CL arXiv_CL Recognition Bert Pose Action Language_Model PDF
2021-02-23 Robust and Transferable Anomaly Detection in Log Data using Pre-Trained Language Models Harold Ott, Jasmin Bogatinovski, Alexander Acker, Sasho Nedelkoski, Odej Kao arXiv_CL arXiv_CL Embedding Bert Pose Detection Language_Model PDF
2021-02-23 Enhanced Modality Transition for Image Captioning Ziwei Wang, Yadan Luo, Zi Huang arXiv_CV arXiv_CV Image_Caption Knowledge Pose Caption Language_Model PDF
2021-02-23 Evolutionary optimization of contexts for phonetic correction in speech recognition systems Rafael Viana-Cámara, Diego Campos-Sobrino, Mario Campos-Soberanis arXiv_SD arXiv_SD Recognition Optimization Speech Pose Speech_Recognition Language_Model PDF
2021-02-22 Generating Human Readable Transcript for Automatic Speech Recognition with Pre-trained Language Model Junwei Liao, Yu Shi, Ming Gong, Linjun Shou, Sefik Eskimez, Liyang Lu, Hong Qu, Michael Zeng arXiv_CL arXiv_CL Recognition Bert Speech Pose Action Speech_Recognition Language_Model PDF
2021-02-22 RUBERT: A Bilingual Roman Urdu BERT Using Cross Lingual Transfer Learning Usama Khalid, Mirza Omer Beg, Muhammad Umair Arshad arXiv_CL arXiv_CL Transfer_Learning Bert Pose Language_Model PDF
2021-02-22 Bilingual Language Modeling, A transfer learning technique for Roman Urdu Usama Khalid, Mirza Omer Beg, Muhammad Umair Arshad arXiv_CL arXiv_CL Transfer_Learning Pose Language_Model PDF
2021-02-22 Co-occurrences using Fasttext embeddings for word similarity tasks in Urdu Usama Khalid, Aizaz Hussain, Muhammad Umair Arshad, Waseem Shahzad, Mirza Omer Beg arXiv_CL arXiv_CL Embedding Language_Model PDF
2021-02-22 Few Shot Learning for Information Verification Usama Khalid, Mirza Omer Beg arXiv_CL arXiv_CL Relation Attention Language_Model PDF
2021-02-22 Evaluating Contextualized Language Models for Hungarian Judit Ács, Dániel Lévai, Dávid Márk Nemeskey, András Kornai arXiv_CL arXiv_CL Bert Language_Model PDF
2021-02-21 Web-based Application for Detecting Indonesian Clickbait Headlines using IndoBERT Muhammad Noor Fakhruzzaman, Sie Wildan Gunawan arXiv_AI arXiv_AI Bert Pose Language_Model PDF
2021-02-21 Automatic Code Generation using Pre-Trained Language Models Luis Perez, Lizi Ottens, Sudharshan Viswanathan arXiv_CL arXiv_CL Bert Pose Language_Model PDF
2021-02-20 VisualGPT: Data-efficient Image Captioning by Balancing Visual Input and Linguistic Knowledge from Pretraining Jun Chen, Han Guo, Kai Yi, Boyang Li, Mohamed Elhoseiny arXiv_AI arXiv_AI Image_Caption Sparse Knowledge Pose Attention Caption Language_Model PDF
2021-02-19 Towards Emotion Recognition in Hindi-English Code-Mixed Data: A Transformer Based Approach Anshul Wadhawan, Akshita Aggarwal arXiv_CL arXiv_CL Transformer Embedding Recognition Bert RNN Emotion Action Deep_Learning Detection Sentiment Attention Language_Model PDF
2021-02-19 Back to Prior Knowledge: Joint Event Causality Extraction via Convolutional Semantic Infusion Zijian Wang, Hao Wang, Xiangfeng Luo, Jianqi Gao arXiv_AI arXiv_AI Bert Knowledge Pose Action CNN Language_Model PDF
2021-02-19 End-to-End Neural Systems for Automatic Children Speech Recognition: An Empirical Study Prashanth Gurunath Shivakumar, Shrikanth Narayanan arXiv_SD arXiv_SD Recognition Speech Speech_Recognition Language_Model PDF
2021-02-19 Alternate Endings: Improving Prosody for Incremental Neural TTS with Predicted Future Text Input Brooke Stephenson, Thomas Hueber, Laurent Girin, Laurent Besacier arXiv_CL arXiv_CL Speech Language_Model PDF
2021-02-19 An Empirical Study on Measuring the Similarity of Sentential Arguments with Language Model Domain Adaptation ChaeHun Park, Sangwoo Seo arXiv_CL arXiv_CL Unsupervised Transfer_Learning Self-Supervised Face Relation Language_Model PDF
2021-02-19 Calibrate Before Use: Improving Few-Shot Performance of Language Models Tony Z. Zhao, Eric Wallace, Shi Feng, Dan Klein, Sameer Singh arXiv_CL arXiv_CL Few-Shot Language_Model Prediction PDF
2021-02-18 Fixing Errors of the Google Voice Recognizer through Phonetic Distance Metrics Diego Campos-Sobrino, Mario Campos-Soberanis, Iván Martínez-Chin, Víctor Uc-Cetina arXiv_CL arXiv_CL Recognition Speech Pose Speech_Recognition Language_Model PDF
2021-02-18 Training Microsoft News Recommenders with Pretrained Language Models in the Loop Shitao Xiao, Zheng Liu, Yingxia Shao, Tao Di, Xing Xie arXiv_AI arXiv_AI Bert Pose Language_Model Recommendation PDF
2021-02-17 Do End-to-End Speech Recognition Models Care About Context? Lasse Borgholt, Jakob Drachmann Havtorn, Željko Agić, Anders Søgaard, Lars Maaløe, Christian Igel arXiv_CL arXiv_CL Recognition Speech Classification Attention Speech_Recognition Language_Model PDF
2021-02-17 End-to-end lyrics Recognition with Voice to Singing Style Transfer Sakya Basak, Shrutina Agarwal, Sriram Ganapathy, Naoya Takahashi arXiv_SD arXiv_SD Transfer_Learning Style_Transfer Recognition Speech Pose Contour Language_Model PDF
2021-02-17 Jointly Learning Clinical Entities and Relations with Contextual Language Models and Explicit Context Paul Barry, Sam Henry, Meliha Yetisgen, Bridget McInnes, Ozlem Uzuner arXiv_CL arXiv_CL Recognition Action Relation Relation_Extraction Language_Model PDF
2021-02-16 COCO-LM: Correcting and Contrasting Text Sequences for Language Model Pretraining Yu Meng, Chenyan Xiong, Payal Bajaj, Saurabh Tiwary, Paul Bennett, Jiawei Han, Xia Song arXiv_CL arXiv_CL Self-Supervised Contrastive_Learning Few-Shot Language_Model PDF
2021-02-16 Boosting Low-Resource Biomedical QA via Entity-Aware Masking Strategies Gabriele Pergola, Elena Kochkina, Lin Gui, Maria Liakata, Yulan He arXiv_CL arXiv_CL Transfer_Learning Knowledge Pose Attention Medical Language_Model QA PDF
2021-02-16 Non-Autoregressive Text Generation with Pre-trained Language Models Yixuan Su, Deng Cai, Yan Wang, David Vandyke, Simon Baker, Piji Li, Nigel Collier arXiv_CL arXiv_CL Bert Pose Attention Summarization Text_Generation Inference Language_Model Prediction PDF
2021-02-16 Large-Context Conversational Representation Learning: Self-Supervised Learning for Conversational Documents Ryo Masumura, Naoki Makishima, Mana Ihori, Akihiko Takashima, Tomohiro Tanaka, Shota Orihashi arXiv_CL arXiv_CL Segmentation Represenation_Learning Self-Supervised Pose Language_Model PDF
2021-02-16 Accelerated Sparse Neural Training: A Provable and Efficient Method to Find N:M Transposable Masks Itay Hubara, Brian Chmiel, Moshe Island, Ron Banner, Seffi Naor, Daniel Soudry arXiv_AI arXiv_AI Sparse Pose Inference Language_Model PDF
2021-02-16 GradInit: Learning to Initialize Neural Networks for Stable and Efficient Training Chen Zhu, Renkun Ni, Zheng Xu, Kezhi Kong, W. Ronny Huang, Tom Goldstein arXiv_CV arXiv_CV Transformer CNN Language_Model PDF
2021-02-16 Exploring Transformers in Natural Language Generation: GPT, BERT, and XLNet M. Onat Topal, Anil Bas, Imke van Heerden arXiv_CL arXiv_CL Transformer Bert RNN Attention Summarization Text_Generation Language_Model PDF
2021-02-16 TeraPipe: Token-Level Pipeline Parallelism for Training Large-Scale Language Models Zhuohan Li, Siyuan Zhuang, Shiyuan Guo, Danyang Zhuo, Hao Zhang, Dawn Song, Ion Stoica arXiv_CL arXiv_CL Transformer Language_Model PDF
2021-02-16 Hierarchical Transformer-based Large-Context End-to-end ASR with Large-Context Knowledge Distillation Ryo Masumura, Naoki Makishima, Mana Ihori, Akihiko Takashima, Tomohiro Tanaka, Shota Orihashi arXiv_CL arXiv_CL Transformer Recognition Knowledge Speech Pose Speech_Recognition Language_Model PDF
2021-02-16 Have Attention Heads in BERT Learned Constituency Grammar? Ziyang Luo arXiv_CL arXiv_CL Bert Quantitative Attention Inference Language_Model PDF
2021-02-15 Fast End-to-End Speech Recognition via Non-Autoregressive Models and Cross-Modal Knowledge Transferring from BERT Ye Bai, Jiangyan Yi, Jianhua Tao, Zhengkun Tian, Zhengqi Wen, Shuai Zhang arXiv_AI arXiv_AI Transfer_Learning Recognition Bert Knowledge Speech Pose Classification Relation Attention Speech_Recognition Inference Language_Model Prediction PDF
2021-02-15 DOBF: A Deobfuscation Pre-Training Objective for Programming Languages Baptiste Roziere, Marie-Anne Lachaux, Marc Szafraniec, Guillaume Lample arXiv_CL arXiv_CL Unsupervised Bert Self-Supervised Language_Model PDF
2021-02-15 Jira: a Kurdish Speech Recognition System Designing and Building Speech Corpus and Pronunciation Lexicon Hadi Veisi, Hawre Hosseini, Mohammad Mohammadamini (LIA), Wirya Fathy, Aso Mahmudi arXiv_AI arXiv_AI Recognition Speech Pose Face Speech_Recognition Language_Model PDF
2021-02-15 Beyond the English Web: Zero-Shot Cross-Lingual and Lightweight Monolingual Classification of Registers Liina Repo, Valtteri Skantsi, Samuel Rönnqvist, Saara Hellström, Miika Oinonen, Anna Salmela, Douglas Biber, Jesse Egbert, Sampo Pyysalo, Veronika Laippala arXiv_CL arXiv_CL Zero-Shot Pose Classification Language_Model PDF
2021-02-15 Leveraging Acoustic and Linguistic Embeddings from Pretrained speech and language Models for Intent Classification Bidisha Sharma, Maulik Madhavi, Haizhou Li arXiv_CL arXiv_CL Embedding Recognition Knowledge Speech Pose Classification Attention Speech_Recognition Language_Model PDF
2021-02-15 Prompt Programming for Large Language Models: Beyond the Few-Shot Paradigm Laria Reynolds, Kyle McDonell arXiv_AI arXiv_AI Few-Shot Language_Model PDF
2021-02-14 Error-driven Pruning of Language Models for Virtual Assistants Sashank Gondala, Lyan Verwimp, Ernest Pusateri, Manos Tsagkias, Christophe Van Gysel arXiv_CL arXiv_CL Pose Language_Model PDF
2021-02-14 A Difference-of-Convex Programming Approach With Parallel Branch-and-Bound For Sentence Compression Via A Hybrid Extractive Model Yi-Shuai Niu, Yu You, Wenxu Xu, Wentao Ding, Junpeng Hu, Songquan Yao arXiv_AI arXiv_AI Optimization Action Summarization Language_Model PDF
2021-02-14 Reasoning Over Virtual Knowledge Bases With Open Predicate Relations Haitian Sun, Pat Verga, Bhuwan Dhingra, Ruslan Salakhutdinov, William W. Cohen arXiv_AI arXiv_AI Knowledge Relation Language_Model Recommendation PDF
2021-02-12 End-to-end Audio-visual Speech Recognition with Conformers Pingchuan Ma, Stavros Petridis, Maja Pantic arXiv_CV arXiv_CV Transformer Recognition Speech Pose Attention Speech_Recognition Language_Model PDF
2021-02-12 Transformer Language Models with LSTM-based Cross-utterance Information Representation G. Sun, C. Zhang, P. C. Woodland arXiv_AI arXiv_AI Transformer Recognition RNN Speech Pose Speech_Recognition Language_Model PDF
2021-02-12 On Efficient Training, Controllability and Compositional Generalization of Insertion-based Language Generators Sidi Lu, Nanyun Peng arXiv_CL arXiv_CL Transformer Pose Attention Text_Generation Caption Language_Model PDF
2021-02-12 Multiversal views on language models Laria Reynolds, Kyle McDonell arXiv_CL arXiv_CL Face Language_Model PDF
2021-02-11 Speech-language Pre-training for End-to-end Spoken Language Understanding Yao Qian, Ximo Bian, Yu Shi, Naoyuki Kanda, Leo Shen, Zhen Xiao, Michael Zeng arXiv_CL arXiv_CL Transformer Speech Pose Inference Language_Model PDF
2021-02-11 Unsupervised Extractive Summarization using Pointwise Mutual Information Vishakh Padmakumar, He He arXiv_CL arXiv_CL Unsupervised Pose Summarization Medical Language_Model PDF
2021-02-11 Proof Artifact Co-training for Theorem Proving with Language Models Jesse Michael Han, Jason Rute, Yuhuai Wu, Edward W. Ayers, Stanislas Polu arXiv_AI arXiv_AI Transformer Self-Supervised Pose Language_Model Prediction PDF
2021-02-11 Less is More: ClipBERT for Video-and-Language Learning via Sparse Sampling Jie Lei, Linjie Li, Luowei Zhou, Zhe Gan, Tamara L. Berg, Mohit Bansal, Jingjing Liu arXiv_CV arXiv_CV Bert Sparse Pose Activity Language_Model Video_Retrieval PDF
2021-02-10 Fused Acoustic and Text Encoding for Multimodal Bilingual Pretraining and Speech Translation Renjie Zheng, Junkun Chen, Mingbo Ma, Liang Huang arXiv_CL arXiv_CL Represenation_Learning Speech Pose Language_Model PDF
2021-02-10 Customizing Contextualized Language Models forLegal Document Reviews Shohreh Shaghaghian, Luna (Yue) Feng, Borna Jafarpour, Nicolai Pogrebnyakov arXiv_AI arXiv_AI Transfer_Learning Review Inference Language_Model PDF
2021-02-10 Multi-turn Dialogue Reading Comprehension with Pivot Turns and Knowledge Zhuosheng Zhang, Junlong Li, Hai Zhao arXiv_AI arXiv_AI Transformer Knowledge Knowledge_Graph Pose Language_Model Prediction Matching PDF
2021-02-10 Argmax Flows and Multinomial Diffusion: Towards Non-Autoregressive Language Models Emiel Hoogeboom, Didrik Nielsen, Priyank Jaini, Patrick Forré, Max Welling arXiv_CL arXiv_CL Segmentation Denoising Language_Model PDF
2021-02-10 Language Models for Lexical Inference in Context Martin Schmitt, Hinrich Schütze arXiv_AI arXiv_AI Relation Few-Shot Inference Language_Model PDF
2021-02-09 AuGPT: Dialogue with Pre-trained Language Models and Data Augmentation Jonáš Kulhánek, Vojtěch Hudeček, Tomáš Nekvinda, Ondřej Dušek arXiv_AI arXiv_AI Knowledge Attention Language_Model PDF
2021-02-09 NewsBERT: Distilling Pre-trained Language Model for Intelligent News Application Chuhan Wu, Fangzhao Wu, Yang Yu, Tao Qi, Yongfeng Huang, Qi Liu arXiv_CL arXiv_CL Bert Knowledge Pose Language_Model Recommendation PDF
2021-02-09 Bayesian Transformer Language Models for Speech Recognition Boyang Xue, Jianwei Yu, Junhao Xu, Shansong Liu, Shoukang Hu, Zi Ye, Mengzhe Geng, Xunying Liu, Helen Meng arXiv_CL arXiv_CL Transformer Embedding Recognition Speech Pose Attention Speech_Recognition Inference Language_Model PDF
2021-02-09 Train your classifier first: Cascade Neural Networks Training from upper layers to lower layers Shucong Zhang, Cong-Thanh Do, Rama Doddipatla, Erfan Loweimi, Peter Bell, Steve Renals arXiv_AI arXiv_AI Recognition RNN Speech Pose Attention Speech_Recognition Language_Model PDF
2021-02-08 Generating Fake Cyber Threat Intelligence Using Transformer-Based Models Priyanka Ranade, Aritran Piplai, Sudip Mittal, Anupam Joshi, Tim Finin arXiv_AI arXiv_AI Transformer Knowledge Knowledge_Graph Language_Model PDF
2021-02-08 The Singleton Fallacy: Why Current Critiques of Language Models Miss the Point Magnus Sahlgren, Fredrik Carlsson arXiv_CL arXiv_CL Knowledge Pose Language_Model PDF
2021-02-08 Neurogenetic Programming Framework for Explainable Reinforcement Learning Vadim Liventsev, Aki Härmä, Milan Petković arXiv_AI arXiv_AI Gradient_Descent Reinforcement_Learning Knowledge Pose Language_Model PDF
2021-02-08 How True is GPT-2? An Empirical Analysis of Intersectional Occupational Biases Hannah Kirk, Yennie Jun, Haider Iqbal, Elias Benussi, Filippo Volpin, Frederic A. Dreyer, Aleksandar Shtedritski, Yuki M. Asano arXiv_AI arXiv_AI Action Language_Model PDF
2021-02-08 Clinical Outcome Prediction from Admission Notes using Self-Supervised Knowledge Integration Betty van Aken, Jens-Michalis Papaioannou, Manuel Mayrdorfer, Klemens Budde, Felix A. Gers, Alexander Löser arXiv_CL arXiv_CL Knowledge Self-Supervised Pose Language_Model Prediction PDF
2021-02-07 Spoiler Alert: Using Natural Language Processing to Detect Spoilers in Book Reviews Allen Bao, Marshall Ho, Saarthak Sangamnerkar arXiv_CL arXiv_CL Bert RNN Review Detection Language_Model PDF
2021-02-07 CSS-LM: A Contrastive Framework for Semi-supervised Fine-tuning of Pre-trained Language Models Yusheng Su, Xu Han, Yankai Lin, Zhengyan Zhang, Zhiyuan Liu, Peng Li, Maosong Sun arXiv_CL arXiv_CL Few-Shot Language_Model PDF
2021-02-06 Does He Wink or Does He Nod? A Challenging Benchmark for Evaluating Word Understanding of Language Models Lutfi Kerem Senel, Hinrich Schütze arXiv_CL arXiv_CL Knowledge Relation Language_Model PDF
2021-02-05 Intermediate Loss Regularization for CTC-based Speech Recognition Jaesong Lee, Shinji Watanabe arXiv_CL arXiv_CL Recognition Regularization Speech Pose Classification Speech_Recognition Inference Language_Model PDF
2021-02-05 Understanding Emails and Drafting Responses -- An Approach Using GPT-3 Jonas Thiergart, Stefan Huber, Thomas Übellacker arXiv_AI arXiv_AI Knowledge Language_Model PDF
2021-02-04 Unifying Vision-and-Language Tasks via Text Generation Jaemin Cho, Jie Lei, Hao Tan, Mohit Bansal arXiv_AI arXiv_AI Image_Caption Pose VQA Text_Generation Caption Language_Model PDF
2021-02-04 One Size Does Not Fit All: Finding the Optimal N-gram Sizes for FastText Models across Languages Vít Novotný (1), Eniafe Festus Ayetiran (1), Dávid Lupták (1), Michal Štefánik (1), Petr Sojka (1) ((1) Faculty of Informatics Masaryk University) arXiv_CL arXiv_CL Unsupervised Text_Classification Optimization Represenation_Learning Classification Language_Model PDF
2021-02-04 Adaptive Semiparametric Language Models Dani Yogatama, Cyprien de Masson d'Autume, Lingpeng Kong arXiv_CL arXiv_CL Transformer Pose Language_Model Prediction PDF
2021-02-04 Understanding the Capabilities, Limitations, and Societal Impact of Large Language Models Alex Tamkin, Miles Brundage, Jack Clark, Deep Ganguli arXiv_CL arXiv_CL GAN Language_Model PDF
2021-02-03 When Can Models Learn From Explanations? A Formal Framework for Understanding the Roles of Explanation Data Peter Hase, Mohit Bansal arXiv_AI arXiv_AI Knowledge Pose Inference Language_Model PDF
2021-02-03 DiSCoL: Toward Engaging Dialogue Systems through Conversational Line Guided Response Generation Sarik Ghazarian, Zixi Liu, Tuhin Chakrabarty, Xuezhe Ma, Aram Galstyan, Nanyun Peng arXiv_CL arXiv_CL Transformer Language_Model PDF
2021-02-03 Pitfalls of Static Language Modelling Angeliki Lazaridou, Adhiguna Kuncoro, Elena Gribovskaya, Devang Agrawal, Adam Liska, Tayfun Terzi, Mai Gimenez, Cyprien de Masson d'Autume, Sebastian Ruder, Dani Yogatama, Kris Cao, Tomas Kocisky, Susannah Young, Phil Blunsom arXiv_AI arXiv_AI Transformer Knowledge Language_Model PDF
2021-02-03 General-Purpose Speech Representation Learning through a Self-Supervised Multi-Granularity Framework Yucheng Zhao, Dacheng Yin, Chong Luo, Zhiyuan Zhao, Chuanxin Tang, Wenjun Zeng, Zheng-Jun Zha arXiv_SD arXiv_SD Recognition Represenation_Learning Speech Self-Supervised Pose Emotion Classification Speech_Recognition Language_Model PDF
2021-02-03 HeBERT & HebEMO: a Hebrew BERT Model and a Tool for Polarity Analysis and Emotion Recognition Avihay Chriqui, Inbal Yahav arXiv_CL arXiv_CL Transformer Recognition Bert Pose Emotion Classification Detection Sentiment Language_Model PDF
2021-02-03 A Computational Framework for Slang Generation Zhewei Sun, Richard Zemel, Yang Xu arXiv_CL arXiv_CL Knowledge Pose Contrastive_Learning Inference Language_Model PDF
2021-02-02 Clickbait Headline Detection in Indonesian News Sites using Multilingual Bidirectional Encoder Representations from Transformers Muhammad N. Fakhruzzaman, Saidah Z. Jannah, Ratih A. Ningrum, Indah Fahmiyah arXiv_CL arXiv_CL Transformer Embedding Bert Text_Classification Pose Classification Detection Language_Model PDF
2021-02-02 Internal Language Model Training for Domain-Adaptive End-to-End Speech Recognition Zhong Meng, Naoyuki Kanda, Yashesh Gaur, Sarangarajan Parthasarathy, Eric Sun, Liang Lu, Xie Chen, Jinyu Li, Yifan Gong arXiv_AI arXiv_AI Recognition Speech Pose Attention Speech_Recognition Inference Language_Model PDF
2021-02-01 Generative Spoken Language Modeling from Raw Audio Kushal Lakhotia, Evgeny Kharitonov, Wei-Ning Hsu, Yossi Adi, Adam Polyak, Benjamin Bolte, Tu-Anh Nguyen, Jade Copet, Alexei Baevski, Adelrahman Mohamed, Emmanuel Dupoux arXiv_CL arXiv_CL Unsupervised Bert Zero-Shot Speech Language_Model PDF
2021-02-01 SJ_AJ@DravidianLangTech-EACL2021: Task-Adaptive Pre-Training of Multilingual BERT models for Offensive Language Identification Sai Muralidhar Jayanthi, Akshat Gupta arXiv_CL arXiv_CL Bert Language_Model PDF
2021-02-01 Measuring and Improving Consistency in Pretrained Language Models Yanai Elazar, Nora Kassner, Shauli Ravfogel, Abhilasha Ravichander, Eduard Hovy, Hinrich Schütze, Yoav Goldberg arXiv_CL arXiv_CL Knowledge Pose Relation Language_Model PDF
2021-02-01 End2End Acoustic to Semantic Transduction Valentin Pelloin, Nathalie Camelin, Antoine Laurent, Renato De Mori, Antoine Caubrière, Yannick Estève, Sylvain Meignier arXiv_CL arXiv_CL Pose Attention Language_Model PDF
2021-02-01 Multilingual LAMA: Investigating Knowledge in Multilingual Pretrained Language Models Nora Kassner, Philipp Dufter, Hinrich Schütze arXiv_CL arXiv_CL Bert Knowledge Language_Model Prediction PDF
2021-02-01 Scaling Federated Learning for Fine-tuning of Large Language Models Agrin Hilmkil, Sebastian Callh, Matteo Barbieri, Leon René Sütfeld, Edvin Listo Zec, Olof Mogren arXiv_CL arXiv_CL Transformer Bert Text_Classification Review Classification Sentiment Language_Model PDF
2021-02-01 Phoneme-BERT: Joint Language Modelling of Phoneme Sequence and ASR Transcript Mukuntha Narayanan Sundararaman, Ayush Kumar, Jithendra Vepa arXiv_CL arXiv_CL Bert Pose Classification Sentiment Language_Model PDF
2021-01-31 Short Text Clustering with Transformers Leonid Pugachev, Mikhail Burtsev arXiv_CL arXiv_CL Transformer Embedding Transfer_Learning Enhancement Classification Language_Model PDF
2021-01-31 Adversarial Contrastive Pre-training for Protein Sequences Matthew B. A. McDermott, Brendan Yap, Harry Hsu, Di Jin, Peter Szolovits arXiv_AI arXiv_AI Adversarial Self-Supervised Language_Model PDF
2021-01-30 Speech Recognition by Simply Fine-tuning BERT Wen-Chin Huang, Chia-Hua Wu, Shang-Bao Luo, Kuan-Yu Chen, Hsin-Min Wang, Tomoki Toda arXiv_CL arXiv_CL Recognition Bert Speech Pose Speech_Recognition Language_Model PDF
2021-01-30 Fake it Till You Make it: Self-Supervised Semantic Shifts for Monolingual Word Embedding Tasks Maurício Gruppi, Sibel Adalı, Pin-Yu Chen arXiv_CL arXiv_CL Embedding Unsupervised Knowledge Self-Supervised Pose Detection Language_Model PDF
2021-01-30 ShufText: A Simple Black Box Approach to Evaluate the Fragility of Text Classification Models Rutuja Taware, Shraddha Varat, Gaurav Salunke, Chaitanya Gawande, Geetanjali Kale, Rahul Khengare, Raviraj Joshi arXiv_CL arXiv_CL Transformer Bert Text_Classification RNN Pose Classification Deep_Learning Sentiment Language_Model PDF
2021-01-29 N-grams Bayesian Differential Privacy Osman Ramadan, James Withers, Douglas Orr arXiv_CL arXiv_CL Pose Language_Model PDF
2021-01-29 BCN2BRNO: ASR System Fusion for Albayzin 2020 Speech to Text Challenge Martin Kocour, Guillermo Cámbara, Jordi Luque, David Bonet, Mireia Farrús, Martin Karafiát, Karel Veselý, Jan ''Honza'' Ĉernocký arXiv_CL arXiv_CL Recognition Speech Speech_Recognition CNN Language_Model PDF
2021-01-29 Does injecting linguistic structure into language models lead to better alignment with brain recordings? Mostafa Abdou, Ana Valeria Gonzalez, Mariya Toneva, Daniel Hershcovich, Anders Søgaard arXiv_AI arXiv_AI Pose Attention Inference Language_Model PDF
2021-01-29 Fine-tuning BERT-based models for Plant Health Bulletin Classification Shufan Jiang (CRESTIC, ISEP), Rafael Angarita (ISEP), Stephane Cormier (CRESTIC), Francis Rousseaux (CRESTIC) arXiv_CL arXiv_CL Transformer Bert Represenation_Learning Knowledge Pose Classification Deep_Learning Language_Model PDF
2021-01-28 Combining pre-trained language models and structured knowledge Pedro Colon-Hernandez, Catherine Havasi, Jason Alonso, Matthew Huggins, Cynthia Breazeal arXiv_CL arXiv_CL Transformer Knowledge Knowledge_Graph Survey Language_Model PDF
2021-01-28 BERTa'u: Ita'u BERT for digital customer service Paulo Finardi, José Dié Viegas, Gustavo T. Ferreira, Alex F. Mansano, Vinicius F. Caridá arXiv_AI arXiv_AI Bert Pose Face Deep_Learning Sentiment Language_Model QA PDF
2021-01-28 Tokens-to-Token ViT: Training Vision Transformers from Scratch on ImageNet Li Yuan, Yunpeng Chen, Tao Wang, Weihao Yu, Yujun Shi, Francis EH Tay, Jiashi Feng, Shuicheng Yan arXiv_CV arXiv_CV Transformer Pose Classification Relation Attention Image_Classification Language_Model PDF
2021-01-28 LESA: Linguistic Encapsulation and Semantic Amalgamation Based Generalised Claim Detection from Online Content Shreya Gupta, Parantak Singh, Megha Sundriyal, Md Shad Akhtar, Tanmoy Chakraborty arXiv_CL arXiv_CL Embedding Speech Pose Detection Language_Model PDF
2021-01-28 Explaining Natural Language Processing Classifiers with Occlusion and Language Modeling David Harbecke arXiv_CL arXiv_CL Language_Model Prediction PDF
2021-01-28 DRAG: Director-Generator Language Modelling Framework for Non-Parallel Author Stylized Rewriting Hrituraj Singh, Gaurav Verma, Aparna Garimella, Balaji Vasan Srinivasan arXiv_AI arXiv_AI Transformer Pose Quantitative Denoising Language_Model PDF
2021-01-28 Weakly Supervised Neuro-Symbolic Module Networks for Numerical Reasoning Amrita Saha, Shafiq Joty, Steven C.H. Hoi arXiv_CL arXiv_CL Reinforcement_Learning Bert Weakly_Supervised Pose Action Language_Model Matching PDF
2021-01-28 ProtoDA: Efficient Transfer Learning for Few-Shot Intent Classification Manoj Kumar, Varun Kumar, Hadrien Glaude, Cyprien delichy, Aman Alok, Rahul Gupta arXiv_CL