Language_Model

Language_Model

• 2021-09-16 MeLT: Message-Level Transformer with Masked Document Representations as Pre-Training for Stance Detection    Matthew Matero, Nikita Soni, Niranjan Balasubramanian, H. Andrew Schwartz arXiv_CL arXiv_CL  Transformer  Reconstruction  Detection  Language_Model  Prediction  PDF
• 2021-09-16 Locating Language-Specific Information in Contextualized Embeddings    Sheng Liang, Philipp Dufter, Hinrich Schütze arXiv_CL arXiv_CL  Embedding  Unsupervised  Relation  Language_Model  Prediction  PDF
• 2021-09-16 Deep Algorithmic Question Answering: Towards a Compositionally Hybrid AI for Algorithmic Reasoning    Kwwabena Nuamah arXiv_AI arXiv_AI  Pose  Classification  Deep_Learning  Image_Classification  Language_Model  QA  PDF
• 2021-09-16 KnowMAN: Weakly Supervised Multinomial Adversarial Networks    Luisa März, Ehsaneddin Asgari, Fabienne Braune, Franziska Zimmermann, Benjamin Roth arXiv_CL arXiv_CL  Transformer  Weakly_Supervised  Knowledge  Adversarial  Pose  Language_Model  PDF
• 2021-09-16 Let the CAT out of the bag: Contrastive Attributed explanations for Text    Saneem Chemmengath, Amar Prakash Azad, Ronny Luss, Amit Dhurandhar arXiv_AI arXiv_AI  Bert  Pose  Quantitative  Attention  Language_Model  PDF
• 2021-09-16 Do Language Models Know the Way to Rome?    Bastien Liétard, Mostafa Abdou, Anders Søgaard arXiv_CL arXiv_CL  Knowledge  Relation  Language_Model  PDF
• 2021-09-16 Efficient Attribute Injection for Pretrained Language Models    Reinald Kim Amplayo, Kang Min Yoo, Sang-Woo Lee arXiv_CL arXiv_CL  Sparse  Review  Pose  Language_Model  PDF
• 2021-09-16 MFE-NER: Multi-feature Fusion Embedding for Chinese Named Entity Recognition    Jiatong Li, Kui Meng arXiv_CL arXiv_CL  Embedding  Recognition  Knowledge  Pose  Language_Model  PDF
• 2021-09-16 Translation Transformers Rediscover Inherent Data Domains    Maksym Del, Elizaveta Korotkova, Mark Fishel arXiv_CL arXiv_CL  Transformer  Unsupervised  Pose  NMT  Language_Model  PDF
• 2021-09-16 The Language Model Understood the Prompt was Ambiguous: Probing Syntactic Uncertainty Through Generation    Laura Aina, Tal Linzen arXiv_CL arXiv_CL  RNN  Language_Model  PDF
• 2021-09-16 Does External Knowledge Help Explainable Natural Language Inference? Automatic Evaluation vs. Human Ratings    Hendrik Schuff, Hsiu-Yu Yang, Heike Adel, Ngoc Thang Vu arXiv_CL arXiv_CL  Knowledge  Inference  Language_Model  Prediction  PDF
• 2021-09-16 Reframing Instructional Prompts to GPTk's Language    Swaroop Mishra, Daniel Khashabi, Chitta Baral, Yejin Choi, Hannaneh Hajishirzi arXiv_AI arXiv_AI  Pose  Classification  Few-Shot  Language_Model  PDF
• 2021-09-16 Spanish Biomedical Crawled Corpus: A Large, Diverse Dataset for Spanish Biomedical Language Models    Casimiro Pio Carrino, Jordi Armengol-Estapé, Ona de Gibert Bonet, Asier Gutiérrez-Fandiño, Aitor Gonzalez-Agirre, Martin Krallinger, Marta Villegas arXiv_CL arXiv_CL  Medical  Language_Model  PDF
• 2021-09-16 Language Models are Few-shot Multilingual Learners    Genta Indra Winata, Andrea Madotto, Zhaojiang Lin, Rosanne Liu, Jason Yosinski, Pascale Fung arXiv_AI arXiv_AI  Pose  Classification  Few-Shot  Language_Model  Prediction  PDF
• 2021-09-15 On the Complementarity of Data Selection and Fine Tuning for Domain Adaptation    Dan Iter, David Grangier arXiv_CL arXiv_CL  Language_Model  Recommendation  PDF
• 2021-09-15 'It doesn't look good for a date': Transforming Critiques into Preferences for Conversational Recommendation Systems    Victor S. Bursztyn, Jennifer Healey, Nedim Lipka, Eunyee Koh, Doug Downey, Larry Birnbaum arXiv_AI arXiv_AI  Embedding  Review  Few-Shot  Language_Model  Recommendation  PDF
• 2021-09-15 Tied & Reduced RNN-T Decoder    Rami Botros (1), Tara N. Sainath (1), Robert David (1), Emmanuel Guzman (1), Wei Li (1), Yanzhang He (1) ((1) Google Inc. USA) arXiv_CL arXiv_CL  Embedding  Recognition  RNN  Inference  Language_Model  Prediction  PDF
• 2021-09-15 Dialogue State Tracking with a Language Model using Schema-Driven Prompting    Chia-Hsuan Lee, Hao Cheng, Mari Ostendorf arXiv_CL arXiv_CL  Tracking  Knowledge  Pose  Language_Model  PDF
• 2021-09-15 On the Limits of Minimal Pairs in Contrastive Evaluation    Jannis Vamvas, Rico Sennrich arXiv_CL arXiv_CL  Pose  Language_Model  Recommendation  PDF
• 2021-09-15 Efficient Domain Adaptation of Language Models via Adaptive Tokenization    Vin Sachidananda, Jason S. Kessler, Yi-an Lai arXiv_CL arXiv_CL  Embedding  Bert  Pose  Inference  Language_Model  PDF
• 2021-09-15 Comparing Text Representations: A Theory-Driven Approach    Gregory Yauney, David Mimno arXiv_CL arXiv_CL  Embedding  Quantitative  Classification  Inference  Language_Model  PDF
• 2021-09-15 Can Machines Read Coding Manuals Yet? -- A Benchmark for Building Better Language Models for Code Understanding    Ibrahim Abdelaziz, Julian Dolby, Jamie McCusker, Kavitha Srinivas arXiv_AI arXiv_AI  Bert  Language_Model  PDF
• 2021-09-15 Challenges in Detoxifying Language Models    Johannes Welbl, Amelia Glaese, Jonathan Uesato, Sumanth Dathathri, John Mellor, Lisa Anne Hendricks, Kirsty Anderson, Pushmeet Kohli, Ben Coppin, Po-Sen Huang arXiv_AI arXiv_AI  Language_Model  PDF
• 2021-09-15 SupCL-Seq: Supervised Contrastive Learning for Downstream Optimized Sequence Representations    Hooman Sedghamiz, Shivam Raval, Enrico Santus, Tuka Alhanai, Mohammad Ghassemi arXiv_CL arXiv_CL  Transformer  Bert  Optimization  Self-Supervised  Contrastive_Learning  Classification  Language_Model  PDF
• 2021-09-15 Matching with Transformers in MELT    Sven Hertling, Jan Portisch, Heiko Paulheim arXiv_AI arXiv_AI  Transformer  Knowledge  Knowledge_Graph  Ontology  Classification  Language_Model  Matching  PDF
• 2021-09-15 RankNAS: Efficient Neural Architecture Search by Pairwise Ranking    Chi Hu, Chenglong Wang, Xiangnan Ma, Xia Meng, Yinqiao Li, Tong Xiao, Jingbo Zhu, Changliang Li arXiv_CL arXiv_CL  NAS  Pose  Language_Model  PDF
• 2021-09-15 Image Captioning for Effective Use of Language Models in Knowledge-Based Visual Question Answering    Ander Salaberria, Gorka Azkune, Oier Lopez de Lacalle, Aitor Soroa, Eneko Agirre arXiv_AI arXiv_AI  Image_Caption  Knowledge  Knowledge_Graph  Pose  VQA  Caption  Inference  Language_Model  QA  PDF
• 2021-09-15 Allocating Large Vocabulary Capacity for Cross-lingual Language Model Pre-training    Bo Zheng, Li Dong, Shaohan Huang, Saksham Singhal, Wanxiang Che, Ting Liu, Xia Song, Furu Wei arXiv_CL arXiv_CL  Pose  Language_Model  PDF
• 2021-09-15 What Vision-Language Models `See' when they See Scenes    Michele Cafagna, Kees van Deemter, Albert Gatt arXiv_CL arXiv_CL  Bert  Language_Model  PDF
• 2021-09-15 {E}fficient{BERT}: Progressively Searching Multilayer Perceptron via Warm-up Knowledge Distillation    Chenhe Dong, Guangrun Wang, Hang Xu, Jiefeng Peng, Xiaozhe Ren, Xiaodan Liang arXiv_AI arXiv_AI  Bert  Optimization  Knowledge  Pose  Attention  Inference  Language_Model  PDF
• 2021-09-15 Transformer-based Language Models for Factoid Question Answering at BioASQ9b    Urvashi Khanna, Diego Mollá arXiv_CL arXiv_CL  Transformer  Bert  Medical  Language_Model  PDF
• 2021-09-15 Can Language Models be Biomedical Knowledge Bases?    Mujeen Sung, Jinhyuk Lee, Sean Yi, Minji Jeon, Sungdong Kim, Jaewoo Kang arXiv_CL arXiv_CL  Knowledge  Pose  Relation  Attention  Medical  Language_Model  Prediction  PDF
• 2021-09-15 Incorporating Residual and Normalization Layers into Analysis of Masked Language Models    Goro Kobayashi, Tatsuki Kuribayashi, Sho Yokoi, Kentaro Inui arXiv_CL arXiv_CL  Transformer  Pose  Action  Attention  Language_Model  PDF
• 2021-09-15 Beyond Glass-Box Features: Uncertainty Quantification Enhanced Quality Estimation for Neural Machine Translation    Ke Wang, Yangbin Shi, Jiayi Wang, Yuqi Zhang, Yu Zhao, Xiaolin Zheng arXiv_AI arXiv_AI  Pose  Language_Model  PDF
• 2021-09-15 On the Universality of Deep COntextual Language Models    Shaily Bhatt, Poonam Goyal, Sandipan Dandapat, Monojit Choudhury, Sunayana Sitaram arXiv_CL arXiv_CL  Bert  Zero-Shot  Survey  Language_Model  PDF
• 2021-09-15 Can Edge Probing Tasks Reveal Linguistic Knowledge in QA Models?    Sagnik Ray Choudhury, Nikita Bhutani, Isabelle Augenstein arXiv_CL arXiv_CL  Knowledge  Adversarial  Speech  Relation  Language_Model  Prediction  QA  PDF
• 2021-09-15 Fast Extraction of Word Embedding from Q-contexts    Junsheng Kong, Weizhao Li, Zeyi Liu, Ben Liao, Jiezhong Qiu, Chang-Yu Hsieh, Yi Cai, Shengyu Zhang arXiv_AI arXiv_AI  Embedding  Action  Language_Model  PDF
• 2021-09-15 Improving Text Auto-Completion with Next Phrase Prediction    Dong-Ho Lee, Zhiqiang Hu, Roy Ka-Wei Lee arXiv_CL arXiv_CL  Self-Supervised  Pose  Medical  Language_Model  Prediction  PDF
• 2021-09-14 Frequency Effects on Syntactic Rule Learning in Transformers    Jason Wei, Dan Garrette, Tal Linzen, Ellie Pavlick arXiv_CL arXiv_CL  Transformer  Bert  Inference  Language_Model  Prediction  PDF
• 2021-09-14 Legal Transformer Models May Not Always Help    Sakbo Geng, Rémi Lebret, Karl Aberer arXiv_CL arXiv_CL  Transformer  Bert  Deep_Learning  Language_Model  PDF
• 2021-09-14 Broaden the Vision: Geo-Diverse Visual Commonsense Reasoning    Da Yin, Liunian Harold Li, Ziniu Hu, Nanyun Peng, Kai-Wei Chang arXiv_AI arXiv_AI  Recognition  Bert  Knowledge  Language_Model  QA  PDF
• 2021-09-14 ePiC: Employing Proverbs in Context as a Benchmark for Abstract Language Understanding    Sayan Ghosh, Shashank Srivastava arXiv_CL arXiv_CL  Pose  Face  Language_Model  Prediction  Recommendation  PDF
• 2021-09-14 Types of Out-of-Distribution Texts and How to Detect Them    Udit Arora, William Huang, He He arXiv_CL arXiv_CL  Detection  Language_Model  PDF
• 2021-09-14 LM-Critic: Language Models for Unsupervised Grammatical Error Correction    Michihiro Yasunaga, Jure Leskovec, Percy Liang arXiv_CL arXiv_CL  Unsupervised  Language_Model  PDF
• 2021-09-14 A Temporal Variational Model for Story Generation    David Wilmot, Frank Keller arXiv_AI arXiv_AI  RNN  Text_Generation  Language_Model  PDF
• 2021-09-14 KFCNet: Knowledge Filtering and Contrastive Learning Network for Generative Commonsense Reasoning    Haonan Li, Yeyun Gong, Jian Jiao, Ruofei Zhang, Timothy Baldwin, Nan Duan arXiv_CL arXiv_CL  Bert  Knowledge  Pose  Contrastive_Learning  Language_Model  PDF
• 2021-09-14 MDAPT: Multilingual Domain Adaptive Pretraining in a Single Model    Rasmus Kær Jørgensen, Mareike Hartmann, Xiang Dai, Desmond Elliott arXiv_CL arXiv_CL  Unsupervised  Recognition  Pose  Classification  Medical  Language_Model  PDF
• 2021-09-14 Challenging Instances are Worth Learning: Generating Valuable Negative Samples for Response Selection Training    Yao Qiu, Jinchao Zhang, Huiying Ren, Jie Zhou arXiv_CL arXiv_CL  Language_Model  QA  PDF
• 2021-09-14 Different Strokes for Different Folks: Investigating Appropriate Further Pre-training Approaches for Diverse Dialogue Tasks    Yao Qiu, Jinchao Zhang, Jie Zhou arXiv_CL arXiv_CL  Relation  Language_Model  PDF
• 2021-09-14 Exploring Prompt-based Few-shot Learning for Grounded Dialog Generation    Chujie Zheng, Minlie Huang arXiv_CL arXiv_CL  Knowledge  Few-Shot  Language_Model  PDF
• 2021-09-14 Uncovering Implicit Gender Bias in Narratives through Commonsense Inference    Tenghao Huang, Faeze Brahman, Vered Shwartz, Snigdha Chaturvedi arXiv_CL arXiv_CL  Inference  Language_Model  PDF
• 2021-09-14 Rationales for Sequential Predictions    Keyon Vafa, Yuntian Deng, David M. Blei, Alexander M. Rush arXiv_CL arXiv_CL  Optimization  Pose  Language_Model  Prediction  PDF
• 2021-09-13 Old BERT, New Tricks: Artificial Language Learning for Pre-Trained Language Models    Lisa Bylinina, Alexey Tikhonov, Ekaterina Garmash arXiv_CL arXiv_CL  Bert  Relation  Language_Model  PDF
• 2021-09-13 Evaluating Transferability of BERT Models on Uralic Languages    Judit Ács, Dániel Lévai, András Kornai arXiv_CL arXiv_CL  Transformer  Bert  Optimization  Language_Model  PDF
• 2021-09-13 A Massively Multilingual Analysis of Cross-linguality in Shared Embedding Space    Alex Jones, William Yang Wang, Kyle Mahowald arXiv_AI arXiv_AI  Segmentation  Embedding  Bert  Zero-Shot  RNN  Language_Model  PDF
• 2021-09-13 STraTA: Self-Training with Task Augmentation for Better Few-shot Learning    Tu Vu, Minh-Thang Luong, Quoc V. Le, Grady Simon, Mohit Iyyer arXiv_CL arXiv_CL  Pose  Sentiment  Few-Shot  Language_Model  PDF
• 2021-09-13 KroneckerBERT: Learning Kronecker Decomposition for Pre-trained Language Models via Knowledge Distillation    Marzieh S. Tahaei, Ella Charlaix, Vahid Partovi Nia, Ali Ghodsi, Mehdi Rezagholizadeh arXiv_AI arXiv_AI  Transformer  Embedding  Bert  Knowledge  Pose  Attention  Language_Model  PDF
• 2021-09-13 Can Language Models Encode Perceptual Structure Without Grounding? A Case Study in Color    Mostafa Abdou, Artur Kulmizev, Daniel Hershcovich, Stella Frank, Ellie Pavlick, Anders Søgaard arXiv_CV arXiv_CV  Knowledge  Relation  Language_Model  PDF
• 2021-09-13 The Grammar-Learning Trajectories of Neural Language Models    Leshem Choshen, Guy Hacohen, Daphna Weinshall, Omri Abend arXiv_AI arXiv_AI  Language_Model  PDF
• 2021-09-13 xGQA: Cross-Lingual Visual Question Answering    Jonas Pfeiffer, Gregor Geigle, Aishwarya Kamath, Jan-Martin O. Steitz, Stefan Roth, Ivan Vulić, Iryna Gurevych arXiv_CL arXiv_CL  Transformer  Zero-Shot  Pose  VQA  Language_Model  QA  PDF
• 2021-09-13 On Language Models for Creoles    Heather Lent, Emanuele Bugliarello, Miryam de Lhoneux, Chen Qiu, Anders Søgaard arXiv_CL arXiv_CL  Language_Model  PDF
• 2021-09-13 Few-Shot Cross-Lingual Stance Detection with Sentiment-Based Pre-Training    Momchil Hardalov, Arnav Arora, Preslav Nakov, Isabelle Augenstein arXiv_CL arXiv_CL  Pose  Detection  Sentiment  Few-Shot  Language_Model  PDF
• 2021-09-13 Virtual Data Augmentation: A Robust and General Framework for Fine-tuning Pre-trained Models    Kun Zhou, Wayne Xin Zhao, Sirui Wang, Fuzheng Zhang, Wei Wu, Ji-Rong Wen arXiv_CL arXiv_CL  Embedding  Adversarial  Pose  Language_Model  PDF
• 2021-09-13 Effectiveness of Pre-training for Few-shot Intent Classification    Haode Zhang, Yuwei Zhang, Li-Ming Zhan, Jiaxin Chen, Guangyuan Shi, Xiao-Ming Wu, Albert Y.S. Lam arXiv_CL arXiv_CL  Bert  Classification  Detection  Few-Shot  Language_Model  PDF
• 2021-09-13 Wine is Not v i n. -- On the Compatibility of Tokenizations Across Languages    Antonis Maronikolakis, Philipp Dufter, Hinrich Schütze arXiv_CL arXiv_CL  Embedding  Pose  Language_Model  PDF
• 2021-09-13 CPT: A Pre-Trained Unbalanced Transformerfor Both Chinese Language Understanding and Generation    Yunfan Shao, Zhichao Geng, Yitao Liu, Junqi Dai, Fei Yang, Li Zhe, Hujun Bao, Xipeng Qiu arXiv_CL arXiv_CL  Transformer  Knowledge  Pose  Denoising  Text_Generation  Inference  Language_Model  PDF
• 2021-09-13 Mitigating Language-Dependent Ethnic Bias in BERT    Jaimeen Ahn, Alice Oh arXiv_AI arXiv_AI  Bert  Pose  Language_Model  PDF
• 2021-09-13 Raise a Child in Large Language Model: Towards Effective and Generalizable Fine-tuning    Runxin Xu, Fuli Luo, Zhiyuan Zhang, Chuanqi Tan, Baobao Chang, Songfang Huang, Fei Huang arXiv_AI arXiv_AI  Pose  Language_Model  PDF
• 2021-09-12 RockNER: A Simple Method to Create Adversarial Examples for Evaluating the Robustness of Named Entity Recognition Models    Bill Yuchen Lin, Wenyang Gao, Jun Yan, Ryan Moreno, Xiang Ren arXiv_CL arXiv_CL  Recognition  Bert  Adversarial  Pose  Language_Model  PDF
• 2021-09-12 TEASEL: A Transformer-Based Speech-Prefixed Language Model    Mehdi Arjmand, Mohammad Javad Dousti, Hadi Moradi arXiv_AI arXiv_AI  Transformer  Speech  Self-Supervised  Pose  Sentiment  Language_Model  PDF
• 2021-09-12 'Let Your Characters Tell Their Story': A Dataset for Character-Centric Narrative Understanding    Faeze Brahman, Meng Huang, Oyvind Tafjord, Chao Zhao, Mrinmaya Sachan, Snigdha Chaturvedi arXiv_CL arXiv_CL  Action  Relation  Inference  Language_Model  PDF
• 2021-09-12 Not All Negatives are Equal: Label-Aware Contrastive Loss for Fine-grained Text Classification    Varsha Suresh, Desmond C. Ong arXiv_AI arXiv_AI  Text_Classification  Emotion  Classification  Relation  Sentiment  Language_Model  PDF
• 2021-09-12 Leveraging Table Content for Zero-shot Text-to-SQL with Meta-Learning    Yongrui Chen, Xinnan Guo, Chaojie Wang, Jian Qiu, Guilin Qi, Meng Wang, Huiying Li arXiv_CL arXiv_CL  Zero-Shot  Pose  Language_Model  PDF
• 2021-09-11 The Impact of Positional Encodings on Multilingual Compression    Vinit Ravishankar, Anders Søgaard arXiv_CL arXiv_CL  Transformer  Embedding  Bert  Knowledge  Pose  Attention  Language_Model  PDF
• 2021-09-11 Learning from Language Description: Low-shot Named Entity Recognition via Decomposed Framework    Yaqing Wang, Haoda Chu, Chao Zhang, Jing Gao arXiv_CL arXiv_CL  Recognition  Zero-Shot  Pose  Few-Shot  Language_Model  PDF
• 2021-09-11 Multilingual Translation via Grafting Pre-trained Language Models    Zewei Sun, Mingxuan Wang, Lei Li arXiv_CL arXiv_CL  Transformer  Bert  Self-Supervised  Pose  Attention  Language_Model  PDF
• 2021-09-11 Eliciting Knowledge from Language Models for Event Extraction    Jiaju Lin, Jin Jian, Qin Chen arXiv_AI arXiv_AI  Text_Classification  Knowledge  Pose  Action  Classification  Detection  Few-Shot  Language_Model  PDF
• 2021-09-11 Semantic Categorization of Social Knowledge for Commonsense Question Answering    Gengyu Wang, Xiaochen Hou, Diyi Yang, Kathleen McKeown, Jing Huang arXiv_CL arXiv_CL  Knowledge  Pose  Relation  Attention  Language_Model  QA  PDF
• 2021-09-10 Towards Zero-shot Commonsense Reasoning with Self-supervised Refinement of Language Models    Tassilo Klein, Moin Nabi arXiv_CL arXiv_CL  Zero-Shot  Self-Supervised  Pose  Relation  Language_Model  PDF
• 2021-09-10 PICARD: Parsing Incrementally for Constrained Auto-Regressive Decoding from Language Models    Torsten Scholak, Nathan Schucher, Dzmitry Bahdanau arXiv_CL arXiv_CL  Pose  Language_Model  PDF
• 2021-09-10 Enhancing Self-Disclosure In Neural Dialog Models By Candidate Re-ranking    Mayank Soni, Benjamin Cowan, Vincent Wade arXiv_CL arXiv_CL  Enhancement  Pose  Relation  Inference  Language_Model  PDF
• 2021-09-10 Distantly-Supervised Named Entity Recognition with Noise-Robust Learning and Language Model Augmented Self-Training    Yu Meng, Yunyi Zhang, Jiaxin Huang, Xuan Wang, Yu Zhang, Heng Ji, Jiawei Han arXiv_CL arXiv_CL  Recognition  Knowledge  Pose  Language_Model  Matching  PDF
• 2021-09-10 Tiered Reasoning for Intuitive Physics: Toward Verifiable Commonsense Language Understanding    Shane Storks, Qiaozi Gao, Yichi Zhang, Joyce Chai arXiv_CL arXiv_CL  Language_Model  Prediction  PDF
• 2021-09-10 Modeling Human Sentence Processing with Left-Corner Recurrent Neural Network Grammars    Ryo Yoshida, Hiroshi Noji, Yohei Oseki arXiv_CL arXiv_CL  RNN  Relation  Language_Model  PDF
• 2021-09-10 Beyond the Tip of the Iceberg: Assessing Coherence of Text Classifiers    Shane Storks, Joyce Chai arXiv_CL arXiv_CL  Text_Classification  Pose  Classification  Language_Model  Prediction  PDF
• 2021-09-10 Examining Cross-lingual Contextual Embeddings with Orthogonal Structural Probes    Tomasz Limisiewicz, David Mareček arXiv_AI arXiv_AI  Embedding  Bert  Zero-Shot  Few-Shot  Language_Model  PDF
• 2021-09-10 ReasonBERT: Pre-trained to Reason with Distant Supervision    Xiang Deng, Yu Su, Alyssa Lees, You Wu, Cong Yu, Huan Sun arXiv_AI arXiv_AI  Bert  Pose  Relation  Few-Shot  Language_Model  PDF
• 2021-09-10 Studying word order through iterative shuffling    Nikolay Malkin, Sameera Lanka, Pranav Goel, Nebojsa Jojic arXiv_CL arXiv_CL  Inference  Language_Model  PDF
• 2021-09-10 Dual-State Capsule Networks for Text Classification    Piyumal Demotte, Surangika Ranathunga arXiv_CL arXiv_CL  Embedding  Text_Classification  Classification  Language_Model  PDF
• 2021-09-10 How Does Fine-tuning Affect the Geometry of Embedding Space: A Case Study on Isotropy    Sara Rajaee, Mohammad Taher Pilehvar arXiv_CL arXiv_CL  Embedding  Enhancement  Knowledge  Language_Model  PDF
• 2021-09-10 Genre as Weak Supervision for Cross-lingual Dependency Parsing    Max Müller-Eberstein, Rob van der Goot, Barbara Plank arXiv_CL arXiv_CL  Embedding  Unsupervised  Zero-Shot  Language_Model  PDF
• 2021-09-10 Pre-train or Annotate? Domain Adaptation with a Constrained Budget    Fan Bai, Alan Ritter, Wei Xu arXiv_CL arXiv_CL  Language_Model  PDF
• 2021-09-10 EfficientCLIP: Efficient Cross-Modal Pre-training by Ensemble Confident Learning and Language Modeling    Jue Wang, Haofan Wang, Jincan Deng, Weijia Wu, Debing Zhang arXiv_CV arXiv_CV  Text_Classification  Pose  Face  Classification  Language_Model  PDF
• 2021-09-10 Investigating Numeracy Learning Ability of a Text-to-Text Transfer Model    Kuntal Kumar Pal, Chitta Baral arXiv_AI arXiv_AI  Transformer  Transfer_Learning  Language_Model  Prediction  PDF
• 2021-09-10 Euphemistic Phrase Detection by Masked Language Model    Wanzheng Zhu, Suma Bhat arXiv_CL arXiv_CL  Embedding  Bert  Detection  GAN  Language_Model  PDF
• 2021-09-10 What Changes Can Large-scale Language Models Bring? Intensive Study on HyperCLOVA: Billions-scale Korean Generative Pretrained Transformers    Boseop Kim, HyoungSeok Kim, Sang-Woo Lee, Gichang Lee, Donghyun Kwak, Dong Hyeon Jeon, Sunghyun Park, Sungju Kim, Seonhoon Kim, Dongpil Seo, Heungsub Lee, Minyoung Jeong, Sungjae Lee, Minsub Kim, Suk Hyun Ko, Seokhun Kim, Taeyong Park, Jinuk Kim, Soyoung Kang, Na-Hyeon Ryu, Kang Min Yoo, Minsuk Chang, Soobin Suh, Sookyo In, Jinseong Park, Kyungduk Kim, Hiun Kim, Jisu Jeong, Yong Goo Yeo, Donghoon Ham, Dongju Park, Min Young Lee, Jaewook Kang, Inho Kang, Jung-Woo Ha, Woomyoung Park, Nako Sung arXiv_CL arXiv_CL  Transformer  Zero-Shot  Optimization  Face  Few-Shot  Language_Model  PDF
• 2021-09-10 CINS: Comprehensive Instruction for Few-shot Learning in Task-orientedDialog Systems    Fei Mi, Yitong Li, Yasheng Wang, Xin Jiang, Qun Liu arXiv_CL arXiv_CL  Tracking  Pose  Classification  Few-Shot  Language_Model  PDF
• 2021-09-10 IndoBERTweet: A Pretrained Language Model for Indonesian Twitter with Effective Domain-Specific Vocabulary Initialization    Fajri Koto, Jey Han Lau, Timothy Baldwin arXiv_CL arXiv_CL  Embedding  Bert  Pose  Language_Model  PDF
• 2021-09-10 Augmenting BERT-style Models with Predictive Coding to Improve Discourse-level Representations    Vladimir Araujo, Andrés Villa, Marcelo Mendoza, Marie-Francine Moens, Alvaro Soto arXiv_CL arXiv_CL  Bert  Knowledge  Self-Supervised  Pose  Detection  Relation  Language_Model  PDF
• 2021-09-09 BERT, mBERT, or BiBERT? A Study on Contextualized Embeddings for Neural Machine Translation    Haoran Xu, Benjamin Van Durme, Kenton Murray arXiv_CL arXiv_CL  Embedding  Bert  Pose  NMT  Language_Model  PDF
• 2021-09-09 Math Word Problem Generation with Mathematical Consistency and Problem Context Constraints    Zichao Wang, Andrew S. Lan, Richard G. Baraniuk arXiv_CL arXiv_CL  Quantitative  Language_Model  PDF
• 2021-09-09 Filling the Gaps in Ancient Akkadian Texts: A Masked Language Modelling Approach    Koren Lazar, Benny Saret, Asaf Yehudai, Wayne Horowitz, Nathan Wasserman, Gabriel Stanovsky arXiv_CL arXiv_CL  Language_Model  Prediction  PDF
• 2021-09-09 Vision-and-Language or Vision-for-Language? On Cross-Modal Influence in Multimodal Transformers    Stella Frank, Emanuele Bugliarello, Desmond Elliott arXiv_CV arXiv_CV  Transformer  Bert  Pose  Language_Model  Prediction  PDF
• 2021-09-09 AStitchInLanguageModels: Dataset and Methods for the Exploration of Idiomaticity in Pre-Trained Language Models    Harish Tayyar Madabushi, Edward Gow-Smith, Carolina Scarton, Aline Villavicencio arXiv_CL arXiv_CL  Zero-Shot  Few-Shot  Language_Model  PDF
• 2021-09-09 Non-autoregressive End-to-end Speech Translation with Parallel Autoregressive Rescoring    Hirofumi Inaguma, Yosuke Higuchi, Kevin Duh, Tatsuya Kawahara, Shinji Watanabe arXiv_CL arXiv_CL  Speech  Pose  Classification  Inference  Language_Model  PDF
• 2021-09-09 All Bark and No Bite: Rogue Dimensions in Transformer Language Models Obscure Representational Quality    William Timkey, Marten van Schijndel arXiv_CL arXiv_CL  Transformer  Embedding  Bert  Language_Model  PDF
• 2021-09-09 PPT: Pre-trained Prompt Tuning for Few-shot Learning    Yuxian Gu, Xu Han, Zhiyuan Liu, Minlie Huang arXiv_CL arXiv_CL  Pose  Classification  Few-Shot  Language_Model  PDF
• 2021-09-09 Translate & Fill: Improving Zero-Shot Multilingual Semantic Parsing with Synthetic Data    Massimo Nicosia, Zhongdi Qu, Yasemin Altun arXiv_AI arXiv_AI  Zero-Shot  Pose  Language_Model  PDF
• 2021-09-09 Variational Latent-State GPT for Semi-supervised Task-Oriented Dialog Systems    Hong Liu, Yucheng Cai, Zhenru Lin, Zhijian Ou, Yi Huang, Junlan Feng arXiv_CL arXiv_CL  Pose  Inference  Language_Model  PDF
• 2021-09-09 MetaXT: Meta Cross-Task Transfer between Disparate Label Spaces    Srinagesh Sharma, Guoqing Zheng, Ahmed Hassan Awadallah arXiv_CL arXiv_CL  Optimization  Knowledge  Language_Model  Prediction  PDF
• 2021-09-09 KELM: Knowledge Enhanced Pre-Trained Language Representations with Message Passing on Hierarchical Relational Graphs    Yinquan Lu, Haonan Lu, Guirong Fu, Qun Liu arXiv_AI arXiv_AI  Bert  Knowledge  Knowledge_Graph  Pose  Relation  Language_Model  PDF
• 2021-09-09 Efficient Nearest Neighbor Language Models    Junxian He, Graham Neubig, Taylor Berg-Kirkpatrick arXiv_CL arXiv_CL  Pose  Inference  Language_Model  PDF
• 2021-09-09 Avoiding Inference Heuristics in Few-shot Prompt-based Finetuning    Prasetya Ajie Utama, Nafise Sadat Moosavi, Victor Sanh, Iryna Gurevych arXiv_AI arXiv_AI  Zero-Shot  Regularization  Knowledge  Classification  Few-Shot  Inference  Language_Model  PDF
• 2021-09-09 ARMAN: Pre-training with Semantically Selecting and Reordering of Sentences for Persian Abstractive Summarization    Alireza Salemi, Emad Kebriaei, Ghazal Neisi Minaei, Azadeh Shakery arXiv_CL arXiv_CL  Transformer  Bert  Salient  Pose  Attention  Summarization  Language_Model  PDF
• 2021-09-09 Debiasing Methods in Natural Language Understanding Make Bias More Accessible    Michael Mendelson, Yonatan Belinkov arXiv_CL arXiv_CL  Pose  Language_Model  Prediction  PDF
• 2021-09-09 Graphine: A Dataset for Graph-aware Terminology Definition Generation    Zequn Liu, Shukai Wang, Yiyang Gu, Ruiyi Zhang, Ming Zhang, Sheng Wang arXiv_CL arXiv_CL  Transformer  Represenation_Learning  Pose  Text_Generation  Medical  Language_Model  PDF
• 2021-09-08 Transformers in the loop: Polarity in neural models of language    Lisa Bylinina, Alexey Tikhonov arXiv_CL arXiv_CL  Transformer  Bert  Pose  Language_Model  Prediction  PDF
• 2021-09-08 A Recipe For Arbitrary Text Style Transfer with Large Language Models    Emily Reif, Daphne Ippolito, Ann Yuan, Andy Coenen, Chris Callison-Burch, Jason Wei arXiv_CL arXiv_CL  Style_Transfer  Zero-Shot  Sentiment  Language_Model  PDF
• 2021-09-08 TruthfulQA: Measuring How Models Mimic Human Falsehoods    Stephanie Lin, Jacob Hilton, Owain Evans arXiv_AI arXiv_AI  Pose  Language_Model  QA  PDF
• 2021-09-08 Memory and Knowledge Augmented Language Models for Inferring Salience in Long-Form Stories    David Wilmot, Frank Keller arXiv_AI arXiv_AI  Transformer  Unsupervised  Knowledge  Detection  Language_Model  PDF
• 2021-09-08 Continuous Entailment Patterns for Lexical Inference in Context    Martin Schmitt, Hinrich Schütze arXiv_AI arXiv_AI  Zero-Shot  Self-Supervised  Few-Shot  Inference  Language_Model  PDF
• 2021-09-08 Sustainable Modular Debiasing of Language Models    Anne Lauscher, Tobias Lüken, Goran Glavaš arXiv_CL arXiv_CL  Bert  Knowledge  Pose  Language_Model  PDF
• 2021-09-08 Discrete and Soft Prompting for Multilingual Models    Mengjie Zhao, Hinrich Schütze arXiv_CL arXiv_CL  Few-Shot  Inference  Language_Model  PDF
• 2021-09-08 Biomedical and Clinical Language Models for Spanish: On the Benefits of Domain-Specific Pretraining in a Mid-Resource Scenario    Casimiro Pio Carrino, Jordi Armengol-Estapé, Asier Gutiérrez-Fandiño, Joan Llop-Palao, Marc Pàmies, Aitor Gonzalez-Agirre, Marta Villegas arXiv_CL arXiv_CL  Transformer  Recognition  Bert  Knowledge  Medical  Language_Model  PDF
• 2021-09-08 NSP-BERT: A Prompt-based Zero-Shot Learner Through an Original Pre-training Task--Next Sentence Prediction    Yi Sun, Yu Zheng, Chao Hao, Hangping Qiu arXiv_AI arXiv_AI  Bert  Zero-Shot  Few-Shot  Language_Model  Prediction  PDF
• 2021-09-08 On the Transferability of Pre-trained Language Models: A Study from Artificial Datasets    Cheng-Han Chiang, Hung-yi Lee arXiv_CL arXiv_CL  Knowledge  Pose  Relation  Language_Model  Matching  PDF
• 2021-09-08 RefineCap: Concept-Aware Refinement for Image Captioning    Yekun Chai, Shuo Jin, Junliang Xing arXiv_CL arXiv_CL  Image_Caption  Pose  Caption  Language_Model  PDF
• 2021-09-08 It is AI's Turn to Ask Human a Question: Question and Answer Pair Generation for Children Storybooks in FairytaleQA Dataset    Bingsheng Yao, Dakuo Wang, Tongshuang Wu, Tran Hoang, Branda Sun, Toby Jia-Jun Li, Mo Yu, Ying Xu arXiv_AI arXiv_AI  Language_Model  QA  PDF
• 2021-09-07 Text-Free Prosody-Aware Generative Spoken Language Modeling    Eugene Kharitonov, Ann Lee, Adam Polyak, Yossi Adi, Jade Copet, Kushal Lakhotia, Tu-Anh Nguyen, Morgane Rivière, Abdelrahman Mohamed, Emmanuel Dupoux, Wei-Ning Hsu arXiv_CL arXiv_CL  Transformer  Speech  Pose  Classification  GAN  Language_Model  PDF
• 2021-09-07 Beyond Preserved Accuracy: Evaluating Loyalty and Robustness of BERT Compression    Canwen Xu, Wangchunshu Zhou, Tao Ge, Ke Xu, Julian McAuley, Furu Wei arXiv_AI arXiv_AI  Quantization  Bert  Knowledge  Adversarial  Pose  Language_Model  PDF
• 2021-09-07 How much pretraining data do language models need to learn syntax?    Laura Pérez-Mayos, Miguel Ballesteros, Leo Wanner arXiv_CL arXiv_CL  Transformer  Bert  Knowledge  Speech  Language_Model  PDF
• 2021-09-07 NumGPT: Improving Numeracy Ability of Generative Pre-trained Models    Zhihua Jin, Xin Jiang, Xingbo Wang, Qun Liu, Yong Wang, Xiaozhe Ren, Huamin Qu arXiv_CL arXiv_CL  Embedding  Pose  Classification  Language_Model  PDF
• 2021-09-07 Rare Words Degenerate All Words    Sangwon Yu, Jongyoon Song, Heeseung Kim, Seong-min Lee, Woo-Jong Ryu, Sungroh Yoon arXiv_CL arXiv_CL  Embedding  Pose  Quantitative  Language_Model  PDF
• 2021-09-07 Infusing Future Information into Monotonic Attention Through Language Models    Mohd Abbas Zaidi, Sathish Indurthi, Beomseok Lee, Nikhil Kumar Lakumarapu, Sangha Kim arXiv_CL arXiv_CL  Knowledge  Speech  Pose  NMT  Attention  Language_Model  PDF
• 2021-09-07 Generate & Rank: A Multi-task Framework for Math Word Problems    Jianhao Shen, Yichun Yin, Lin Li, Lifeng Shang, Xin Jiang, Ming Zhang, Qun Liu arXiv_AI arXiv_AI  Pose  Language_Model  PDF
• 2021-09-07 Sequential Attention Module for Natural Language Processing    Mengyuan Zhou, Jian Ma, Haiqin Yang, Lianxin Jiang, Yang Mo arXiv_AI arXiv_AI  Embedding  Pose  Sentiment  Attention  Language_Model  PDF
• 2021-09-07 FH-SWF SG at GermEval 2021: Using Transformer-Based Language Models to Identify Toxic, Engaging, & Fact-Claiming Comments    Christian Gawron, Sebastian Schmidt arXiv_CL arXiv_CL  Transformer  Face  Language_Model  Prediction  PDF
• 2021-09-07 Exploring Strategies for Generalizable Commonsense Reasoning with Pre-trained Models    Kaixin Ma, Filip Ilievski, Jonathan Francis, Satoru Ozaki, Eric Nyberg, Alessandro Oltramari arXiv_CL arXiv_CL  Knowledge  Adversarial  Pose  Language_Model  PDF
• 2021-09-06 An Empirical Study on Few-shot Knowledge Probing for Pretrained Language Models    Tianxing He, Kyunghyun Cho, James Glass arXiv_AI arXiv_AI  Knowledge  Relation  Few-Shot  Language_Model  PDF
• 2021-09-06 Text-to-Table: A New Way of Information Extraction    Xueqing Wu, Jiacheng Zhang, Hang Li arXiv_CL arXiv_CL  Embedding  Pose  Action  Relation  Relation_Extraction  Language_Model  PDF
• 2021-09-06 General-Purpose Question-Answering with Macaw    Oyvind Tafjord, Peter Clark arXiv_AI arXiv_AI  Zero-Shot  Pose  Language_Model  QA  PDF
• 2021-09-06 Enhancing Language Models with Plug-and-Play Large-Scale Commonsense    Wanyun Cui, Xingran Chen arXiv_CL arXiv_CL  Transformer  Embedding  Bert  Represenation_Learning  Knowledge  Knowledge_Graph  Pose  Language_Model  PDF
• 2021-09-06 GPT-3 Models are Poor Few-Shot Learners in the Biomedical Domain    Milad Moradi, Kathrin Blagec, Florian Haberl, Matthias Samwald arXiv_AI arXiv_AI  Transformer  Transfer_Learning  Bert  Knowledge  Few-Shot  Medical  Language_Model  PDF
• 2021-09-06 You should evaluate your language model on marginal likelihood overtokenisations    Kris Cao, Laura Rimell arXiv_CL arXiv_CL  Language_Model  PDF
• 2021-09-06 Vision Guided Generative Pre-trained Language Models for Multimodal Abstractive Summarization    Tiezheng Yu, Wenliang Dai, Zihan Liu, Pascale Fung arXiv_CL arXiv_CL  Attention  Summarization  Text_Generation  Language_Model  PDF
• 2021-09-06 PermuteFormer: Efficient Relative Position Encoding for Long Sequences    Peng Chen arXiv_CL arXiv_CL  Transformer  Pose  Attention  Language_Model  PDF
• 2021-09-05 Teaching Autoregressive Language Models Complex Tasks By Demonstration    Gabriel Recchia arXiv_AI arXiv_AI  Transformer  Language_Model  PDF
• 2021-09-05 Data Efficient Masked Language Modeling for Vision and Language    Yonatan Bitton, Gabriel Stanovsky, Michael Elhadad, Roy Schwartz arXiv_CV arXiv_CV  Caption  Language_Model  PDF
• 2021-09-05 Learning Hierarchical Structures with Differentiable Nondeterministic Stacks    Brian DuSell, David Chiang arXiv_CL arXiv_CL  RNN  Pose  Action  Language_Model  PDF
• 2021-09-05 SideControl: Controlled Open-domain Dialogue Generation via Additive Side Networks    Wanyu Du, Yangfeng Ji arXiv_CL arXiv_CL  Transformer  Pose  Language_Model  PDF
• 2021-09-04 Frustratingly Simple Pretraining Alternatives to Masked Language Modeling    Atsuki Yamaguchi, George Chrysostomou, Katerina Margatina, Nikolaos Aletras arXiv_AI arXiv_AI  Bert  Self-Supervised  Pose  Classification  Language_Model  Prediction  PDF
• 2021-09-03 ALLWAS: Active Learning on Language models in WASserstein space    Anson Bastos, Manohar Kaul arXiv_CL arXiv_CL  Text_Classification  Optimization  Pose  Classification  Medical  Language_Model  PDF
• 2021-09-03 Finetuned Language Models Are Zero-Shot Learners    Jason Wei, Maarten Bosma, Vincent Y. Zhao, Kelvin Guu, Adams Wei Yu, Brian Lester, Nan Du, Andrew M. Dai, Quoc V. Le arXiv_CL arXiv_CL  Zero-Shot  Few-Shot  Language_Model  QA  PDF
• 2021-09-03 Multi-modal Program Inference: a Marriage of Pre-trainedLanguage Models and Component-based Synthesis    Kia Rahmani, Mohammad Raza, Sumit Gulwani, Vu Le, Daniel Morris, Arjun Radhakrishna, Gustavo Soares, Ashish Tiwari arXiv_AI arXiv_AI  Inference  Language_Model  PDF
• 2021-09-03 LG4AV: Combining Language Models and Graph Neural Networks for Author Verification    Maximilian Stubbemann, Gerd Stumme arXiv_AI arXiv_AI  Transformer  Knowledge  Knowledge_Graph  Relation  Language_Model  PDF
• 2021-09-03 An Exploratory Study on Utilising the Web of Linked Data for Product Data Mining    Ziqi Zhang, Xingyi Song arXiv_AI arXiv_AI  Embedding  Bert  Classification  Language_Model  PDF
• 2021-09-03 Language Modeling, Lexical Translation, Reordering: The Training Process of NMT through the Lens of Classical SMT    Elena Voita, Rico Sennrich, Ivan Titov arXiv_CL arXiv_CL  Pose  NMT  Language_Model  PDF
• 2021-09-02 An Empirical Study on Leveraging Position Embeddings for Target-oriented Opinion Words Extraction    Samuel Mensah, Kai Sun, Nikolaos Aletras arXiv_AI arXiv_AI  Embedding  RNN  Speech  Action  Sentiment  CNN  Language_Model  PDF
• 2021-09-02 Multimodal Conditionality for Natural Language Generation    Michael Sollami, Aashish Jain arXiv_CL arXiv_CL  Transformer  Pose  Language_Model  PDF
• 2021-09-02 So Cloze yet so Far: N400 Amplitude is Better Predicted by Distributional Information than Human Predictability Judgements    James A. Michaelov, Seana Coulson, Benjamin K. Bergen arXiv_AI arXiv_AI  Bert  Face  Language_Model  Prediction  PDF
• 2021-09-02 Establishing Interlingua in Multilingual Language Models    Maksym Del, Mark Fishel arXiv_CL arXiv_CL  Bert  Zero-Shot  Relation  Language_Model  PDF
• 2021-09-02 Learning to Prompt for Vision-Language Models    Kaiyang Zhou, Jingkang Yang, Chen Change Loy, Ziwei Liu arXiv_AI arXiv_AI  Zero-Shot  Optimization  Represenation_Learning  Pose  Language_Model  PDF
• 2021-09-02 Text Classification for Predicting Multi-level Product Categories    Hadi Jahanshahi, Ozan Ozyegen, Mucahit Cevik, Beste Bulut, Deniz Yigit, Fahrettin F. Gonen, Ayşe Başar arXiv_AI arXiv_AI  Text_Classification  Pose  Classification  Language_Model  Prediction  PDF
• 2021-09-02 Skim-Attention: Learning to Focus via Document Layout    Laura Nguyen, Thomas Scialom, Jacopo Staiano, Benjamin Piwowarski arXiv_CL arXiv_CL  Transformer  Attention  Language_Model  PDF
• 2021-09-02 TravelBERT: Pre-training Language Model Incorporating Domain-specific Heterogeneous Knowledge into A Unified Representation    Hongyin Zhu, Hao Peng, Zhiheng Lv, Lei Hou, Juanzi Li, Jinghui Xiao arXiv_CL arXiv_CL  Bert  Knowledge  Knowledge_Graph  Pose  Classification  Relation  Language_Model  Matching  PDF
• 2021-09-02 LegaLMFiT: Efficient Short Legal Text Classification with LSTM Language Model Pre-Training    Benjamin Clavié, Akshita Gheewala, Paul Briton, Marc Alphonsus, Rym Labiyaad, Francesco Piccoli arXiv_CL arXiv_CL  Transformer  Bert  Text_Classification  RNN  Classification  Language_Model  PDF
• 2021-09-02 Imposing Relation Structure in Language-Model EmbeddingsUsing Contrastive Learning    Christos Theodoropoulos, James Henderson, Andrei C. Coman, Marie-Francine Moens arXiv_AI arXiv_AI  Embedding  Recognition  Bert  Pose  Contrastive_Learning  Action  Relation  Relation_Extraction  Language_Model  PDF
• 2021-09-02 ConQX: Semantic Expansion of Spoken Queries for Intent Detection based on Conditioned Text Generation    Eyup Halit Yilmaz, Cagri Toraman arXiv_AI arXiv_AI  Bert  Zero-Shot  Pose  Detection  Few-Shot  Text_Generation  Language_Model  PDF
• 2021-09-02 An Empirical Exploration in Quality Filtering of Text Data    Leo Gao arXiv_CL arXiv_CL  Language_Model  PDF
• 2021-09-01 Fight Fire with Fire: Fine-tuning Hate Detectors using Large Samples of Generated Hate Speech    Tomer Wullach, Amir Adler, Einat Minkov arXiv_AI arXiv_AI  Bert  Speech  Detection  Object_Detection  Language_Model  PDF
• 2021-09-01 DILBERT: Customized Pre-Training for Domain Adaptation withCategory Shift, with an Application to Aspect Extraction    Entony Lekhtman, Yftah Ziser, Roi Reichart arXiv_CL arXiv_CL  Unsupervised  Bert  Review  Action  Language_Model  PDF
• 2021-09-01 Does Knowledge Help General NLU? An Empirical Study    Ruochen Xu, Yuwei Fang, Chenguang Zhu, Michael Zeng arXiv_CL arXiv_CL  Knowledge  Classification  Relation  Language_Model  PDF
• 2021-09-01 M^2-MedDialog: A Dataset and Benchmarks for Multi-domain Multi-service Medical Dialogues    Guojun Yan, Jiahuan Pei, Pengjie Ren, Zhumin Chen, Zhaochun Ren, Huasheng Liang arXiv_AI arXiv_AI  Bert  Knowledge  Pose  Medical  Language_Model  PDF
• 2021-09-01 Masked Adversarial Generation for Neural Machine Translation    Badr Youbi Idrissi, Stéphane Clinchant arXiv_AI arXiv_AI  Adversarial  Pose  Language_Model  PDF
• 2021-09-01 Boosting Search Engines with Interactive Agents    Leonard Adolphs, Benjamin Boerschinger, Christian Buck, Michelle Chen Huebscher, Massimiliano Ciaramita, Lasse Espeholt, Thomas Hofmann, Yannic Kilcher arXiv_AI arXiv_AI  Transformer  Reinforcement_Learning  Knowledge  Action  Language_Model  PDF
• 2021-09-01 ConRPG: Paraphrase Generation using Contexts as Regularizer    Yuxian Meng, Xiang Ao, Qing He, Xiaofei Sun, Qinghong Han, Fei Wu, Chun fan, Jiwei Li arXiv_CL arXiv_CL  Unsupervised  Pose  Language_Model  PDF
• 2021-09-01 $infty$-former: Infinite Memory Transformer    Pedro Henrique Martins, Zita Marinho, André F. T. Martins arXiv_CL arXiv_CL  Transformer  Pose  Attention  Language_Model  PDF
• 2021-09-01 Aligning Cross-lingual Sentence Representations with Dual Momentum Contrast    Liang Wang, Wei Zhao, Jingming Liu arXiv_CL arXiv_CL  Embedding  Pose  Language_Model  PDF
• 2021-09-01 Boosting Cross-Lingual Transfer via Self-Learning with Uncertainty Estimation    Liyan Xu, Xuchao Zhang, Xujiang Zhao, Haifeng Chen, Feng Chen, Jinho D. Choi arXiv_CL arXiv_CL  Recognition  Zero-Shot  Pose  Inference  Language_Model  PDF
• 2021-09-01 CTAL: Pre-training Cross-modal Transformer for Audio-and-Language Representations    Hang Li, Yu Kang, Tianqiao Liu, Wenbiao Ding, Zitao Liu arXiv_AI arXiv_AI  Transformer  Pose  Emotion  Classification  Sentiment  Language_Model  PDF
• 2021-08-31 It's not Rocket Science : Interpreting Figurative Language in Narratives    Tuhin Chakrabarty, Yejin Choi, Vered Shwartz arXiv_CL arXiv_CL  Knowledge  Pose  Language_Model  PDF
• 2021-08-31 Effectiveness of Deep Networks in NLP using BiDAF as an example architecture    Soumyendu Sarkar arXiv_CL arXiv_CL  Embedding  Bert  Language_Model  PDF
• 2021-08-31 Sentence Bottleneck Autoencoders from Transformer Language Models    Ivan Montero, Nikolaos Pappas, Noah A. Smith arXiv_CL arXiv_CL  Transformer  Reconstruction  Style_Transfer  Represenation_Learning  Classification  Denoising  Language_Model  PDF
• 2021-08-31 Sense representations for Portuguese: experiments with sense embeddings and deep neural language models    Jessica Rodrigues da Silva, Helena de Medeiros Caseli arXiv_CL arXiv_CL  Embedding  Unsupervised  Transfer_Learning  Bert  Language_Model  PDF
• 2021-08-31 Effective Sequence-to-Sequence Dialogue State Tracking    Jeffrey Zhao, Mahdis Mahdieh, Ye Zhang, Yuan Cao, Yonghui Wu arXiv_AI arXiv_AI  Tracking  Summarization  Language_Model  Prediction  PDF
• 2021-08-31 Robust Retrieval Augmented Generation for Zero-shot Slot Filling    Michael Glass, Gaetano Rossiello, Md Faisal Mahbub Chowdhury, Alfio Gliozzo arXiv_AI arXiv_AI  Zero-Shot  Knowledge  Knowledge_Graph  Few-Shot  Language_Model  PDF
• 2021-08-31 LightNER: A Lightweight Generative Framework with Prompt-guided Attention for Low-resource NER    Xiang Chen, Ningyu Zhang, Lei Li, Xin Xie, Shumin Deng, Chuanqi Tan, Fei Huang, Luo Si, Huajun Chen arXiv_CL arXiv_CL  Transfer_Learning  Knowledge  Pose  Attention  Language_Model  PDF
• 2021-08-31 The five Is: Key principles for interpretable and safe conversational AI    Mattias Wahde, Marco Virgolin arXiv_AI arXiv_AI  Language_Model  PDF
• 2021-08-31 Efficient Conformer: Progressive Downsampling and Grouped Attention for Automatic Speech Recognition    Maxime Burchi, Valentin Vielzeuf arXiv_CL arXiv_CL  Recognition  RNN  Speech  Pose  Attention  Speech_Recognition  Inference  Language_Model  PDF
• 2021-08-31 MELM: Data Augmentation with Masked Entity Language Modeling for Cross-lingual NER    Ran Zhou, Ruidan He, Xin Li, Lidong Bing, Erik Cambria, Luo Si, Chunyan Miao arXiv_CL arXiv_CL  Pose  Language_Model  PDF
• 2021-08-31 Discretized Integrated Gradients for Explaining Language Models    Soumya Sanyal, Xiang Ren arXiv_CL arXiv_CL  Embedding  Sentiment_Classification  Pose  Classification  Sentiment  Language_Model  PDF
• 2021-08-31 Dynamic Sliding Window for Meeting Summarization    Zhengyuan Liu, Nancy F. Chen arXiv_CL arXiv_CL  Pose  Summarization  Language_Model  PDF
• 2021-08-31 Cross-Lingual Text Classification of Transliterated Hindi and Malayalam    Jitin Krishnan, Antonios Anastasopoulos, Hemant Purohit, Huzefa Rangwala arXiv_CL arXiv_CL  Bert  Sentiment_Classification  Text_Classification  Classification  Sentiment  Language_Model  PDF
• 2021-08-31 How Does Adversarial Fine-Tuning Benefit BERT?    Javid Ebrahimi, Hao Yang, Wei Zhang arXiv_AI arXiv_AI  Transfer_Learning  Bert  Regularization  Adversarial  Language_Model  PDF
• 2021-08-30 Towards Consistent Document-level Entity Linking: Joint Models for Entity Linking and Coreference Resolution    Klim Zaporojets, Johannes Deleu, Thomas Demeester, Chris Develder arXiv_CL arXiv_CL  Knowledge  Pose  Relation  Language_Model  Prediction  PDF
• 2021-08-30 Want To Reduce Labeling Cost? GPT-3 Can Help    Shuohang Wang, Yang Liu, Yichong Xu, Chenguang Zhu, Michael Zeng arXiv_AI arXiv_AI  Pose  Few-Shot  Language_Model  PDF
• 2021-08-30 On the Multilingual Capabilities of Very Large-Scale English Language Models    Jordi Armengol-Estapé, Ona de Gibert Bonet, Maite Melero arXiv_AI arXiv_AI  Transformer  Zero-Shot  Pose  Few-Shot  Language_Model  PDF
• 2021-08-30 The effects of data size on Automated Essay Scoring engines    Christopher Ormerod, Amir Jafari, Susan Lottridge, Milan Patel, Amy Harris, Paul van Wamelen arXiv_AI arXiv_AI  Transformer  Classification  Language_Model  PDF
• 2021-08-30 Differentiable Prompt Makes Pre-trained Language Models Better Few-shot Learners    Ningyu Zhang, Luoqiu Li, Xiang Chen, Shumin Deng, Zhen Bi, Chuanqi Tan, Fei Huang, Huajun Chen arXiv_CL arXiv_CL  Pose  Classification  Few-Shot  Language_Model  PDF
• 2021-08-30 Selective Differential Privacy for Language Modeling    Weiyan Shi, Aiqi Cui, Evan Li, Ruoxi Jia, Zhou Yu arXiv_CL arXiv_CL  Sparse  RNN  Pose  Language_Model  PDF
• 2021-08-29 Span Fine-tuning for Pre-trained Language Models    Rongzhou Bao, Zhuosheng Zhang, Hai Zhao arXiv_CL arXiv_CL  Segmentation  Pose  Language_Model  PDF
• 2021-08-29 Interpretable Propaganda Detection in News Articles    Seunghak Yu, Giovanni Da San Martino, Mitra Mohtarami, James Glass, Preslav Nakov arXiv_AI arXiv_AI  Pose  Detection  GAN  Language_Model  PDF
• 2021-08-28 Self-training Improves Pre-training for Few-shot Learning in Task-oriented Dialog Systems    Fei Mi, Wanhao Zhou, Fengyu Cai, Lingjing Kong, Minlie Huang, Boi Faltings arXiv_CL arXiv_CL  Tracking  Bert  Pose  Classification  Few-Shot  Language_Model  Prediction  PDF
• 2021-08-27 ReGen: Reinforcement Learning for Text and Knowledge Base Generation using Pretrained Language Models    Pierre L. Dognin, Inkit Padhi, Igor Melnyk, Payel Das arXiv_CL arXiv_CL  Reinforcement_Learning  Knowledge  Text_Generation  Language_Model  PDF
• 2021-08-27 CAPE: Context-Aware Private Embeddings for Private Language Learning    Richard Plant, Dimitra Gkatzia, Valerio Giuffrida arXiv_CL arXiv_CL  Embedding  Adversarial  Pose  Classification  Deep_Learning  Sentiment  Language_Model  PDF
• 2021-08-27 Evaluating the Robustness of Neural Language Models to Input Perturbations    Milad Moradi, Matthias Samwald arXiv_AI arXiv_AI  Bert  Language_Model  PDF
• 2021-08-27 Injecting Text in Self-Supervised Speech Pretraining    Zhehuai Chen, Yu Zhang, Andrew Rosenberg, Bhuvana Ramabhadran, Gary Wang, Pedro Moreno arXiv_CL arXiv_CL  Recognition  Speech  Self-Supervised  Pose  Contrastive_Learning  Speech_Recognition  Language_Model  Matching  PDF
• 2021-08-27 Exploring the Capacity of a Large-scale Masked Language Model to Recognize Grammatical Errors    Ryo Nagata, Manabu Kimura, Kazuaki Hanawa arXiv_CL arXiv_CL  Bert  Knowledge  Detection  Language_Model  PDF
• 2021-08-27 Offensive Language Identification in Low-resourced Code-mixed Dravidian languages using Pseudo-labeling    Adeep Hande, Karthik Puranik, Konthala Yasaswini, Ruba Priyadharshini, Sajeetha Thavareesan, Anbukkarasi Sampath, Kogilavani Shanmugavadivel, Durairaj Thenmozhi, Bharathi Raja Chakravarthi arXiv_CL arXiv_CL  Embedding  RNN  Language_Model  PDF
• 2021-08-27 Improving callsign recognition with air-surveillance data in air-traffic communication    Iuliia Nigmatulina, Rudolf Braun, Juan Zuluaga-Gomez, Petr Motlicek arXiv_CL arXiv_CL  Surveillance  Recognition  Speech  Speech_Recognition  Language_Model  Prediction  PDF
• 2021-08-27 Harms of Gender Exclusivity and Challenges in Non-Binary Representation in Language Technologies    Sunipa Dev, Masoud Monajatipoor, Anaelia Ovalle, Arjun Subramonian, Jeff M Phillips, Kai-Wei Chang arXiv_AI arXiv_AI  Recognition  Bert  Knowledge  Survey  Language_Model  PDF
• 2021-08-26 Semantic-based Self-Critical Training For Question Generation    Loïc, Kwate Dassi arXiv_AI arXiv_AI  Transformer  Reinforcement_Learning  Bert  Relation  Text_Generation  Language_Model  PDF
• 2021-08-26 Position-Invariant Truecasing with a Word-and-Character Hierarchical Recurrent Neural Network    Hao Zhang, You-Chi Cheng, Shankar Kumar, Mingqing Chen, Rajiv Mathews arXiv_CL arXiv_CL  Recognition  Speech  Pose  Speech_Recognition  Language_Model  PDF
• 2021-08-26 A Realistic Study of Auto-regressive Language Models for Named Entity Typing and Recognition    Elena V. Epure, Romain Hennequin arXiv_CL arXiv_CL  Recognition  Zero-Shot  Pose  Few-Shot  Inference  Language_Model  PDF
• 2021-08-26 Fine-tuning Pretrained Language Models with Label Attention for Explainable Biomedical Text Classification    Bruce Nguyen, Shaoxiong Ji arXiv_CL arXiv_CL  Transformer  Text_Classification  Pose  Classification  Attention  Medical  CNN  Language_Model  PDF
• 2021-08-26 Rethinking Why Intermediate-Task Fine-Tuning Works    Ting-Yun Chang, Chi-Jen Lu arXiv_CL arXiv_CL  Bert  Inference  Language_Model  PDF
• 2021-08-26 AVATAR: A Parallel Corpus for Java-Python Program Translation    Wasi Uddin Ahmad, Md Golam Rahman Tushar, Saikat Chakraborty, Kai-Wei Chang arXiv_CL arXiv_CL  Unsupervised  Pose  Language_Model  PDF
• 2021-08-26 Understanding Attention in Machine Reading Comprehension    Yiming Cui, Wei-Nan Zhang, Wanxiang Che, Ting Liu, Zhigang Chen arXiv_AI arXiv_AI  Bert  Action  Quantitative  Relation  Attention  Language_Model  PDF
• 2021-08-25 Exploring the Promises of Transformer-Based LMs for the Representation of Normative Claims in the Legal Domain    Reto Gubelmann (1), Peter Hongler (1), Siegfried Handschuh (1) ((1) University of St.Gallen (HSG)) arXiv_CL arXiv_CL  Transformer  Embedding  Bert  Language_Model  PDF
• 2021-08-25 Models In a Spelling Bee: Language Models Implicitly Learn the Character Composition of Tokens    Itay Itzhak, Omer Levy arXiv_AI arXiv_AI  Embedding  Bert  Pose  Language_Model  PDF
• 2021-08-25 Viola: A Topic Agnostic Generate-and-Rank Dialogue System    Hyundong Cho, Basel Shbita, Kartik Shenoy, Shuai Liu, Nikhil Patel, Hitesh Pindikanti, Jennifer Lee, Jonathan May arXiv_CL arXiv_CL  Knowledge  Knowledge_Graph  Language_Model  PDF
• 2021-08-24 Using BERT Encoding and Sentence-Level Language Model for Sentence Ordering    Melika Golestani, Seyedeh Zahra Razavi, Zeinab Borhanifard, Farnaz Tahmasebian, Hesham Faili arXiv_CL arXiv_CL  Transformer  Embedding  Bert  RNN  Pose  Attention  Summarization  Text_Generation  Language_Model  PDF
• 2021-08-24 SimVLM: Simple Visual Language Model Pretraining with Weak Supervision    Zirui Wang, Jiahui Yu, Adams Wei Yu, Zihang Dai, Yulia Tsvetkov, Yuan Cao arXiv_CV arXiv_CV  Image_Caption  Zero-Shot  VQA  Caption  Language_Model  QA  PDF
• 2021-08-24 Reducing Exposure Bias in Training Recurrent Neural Network Transducers    Xiaodong Cui, Brian Kingsbury, George Saon, David Haws, Zoltan Tuske arXiv_AI arXiv_AI  Recognition  RNN  Speech  Speech_Recognition  Inference  Language_Model  Prediction  PDF
• 2021-08-24 Density-Based Dynamic Curriculum Learning for Intent Detection    Yantao Gong, Cao Liu, Jiazhen Yuan, Fan Yang, Xunliang Cai, Guanglu Wan, Jiansong Chen, Ruiyao Niu, Houfeng Wang arXiv_CL arXiv_CL  Pose  Detection  Attention  Language_Model  PDF
• 2021-08-24 Prompt-Learning for Fine-Grained Entity Typing    Ning Ding, Yulin Chen, Xu Han, Guangwei Xu, Pengjun Xie, Hai-Tao Zheng, Zhiyuan Liu, Juanzi Li, Hong-Gee Kim arXiv_AI arXiv_AI  Sentiment_Classification  Zero-Shot  Optimization  Knowledge  Self-Supervised  Pose  Classification  Sentiment  Few-Shot  Attention  Inference  Language_Model  PDF
• 2021-08-24 Detection of Criminal Texts for the Polish State Border Guard    Artur Nowakowski, Krzysztof Jassem arXiv_CL arXiv_CL  Transformer  Classification  Detection  Language_Model  PDF
• 2021-08-24 Taming the Beast: Learning to Control Neural Conversational Models    Andrea Madotto arXiv_AI arXiv_AI  Tracking  Pose  Deep_Learning  Language_Model  PDF
• 2021-08-23 Legal Search in Case Law and Statute Law    Julien Rossi, Evangelos Kanoulas arXiv_CL arXiv_CL  Unsupervised  Review  Language_Model  PDF
• 2021-08-23 Regularizing Transformers With Deep Probabilistic Layers    Aurora Cobo Aguilera, Pablo Martínez Olmos, Antonio Artés-Rodríguez, Fernando Pérez-Cruz arXiv_CL arXiv_CL  Transformer  Bert  Attention  Language_Model  PDF
• 2021-08-23 TACo: Token-aware Cascade Contrastive Learning for Video-Text Alignment    Jianwei Yang, Yonatan Bisk, Jianfeng Gao arXiv_AI arXiv_AI  Transformer  Segmentation  Represenation_Learning  Contrastive_Learning  Action  Activity  Language_Model  Video_Retrieval  PDF
• 2021-08-22 UzBERT: pretraining a BERT model for Uzbek    B. Mansurov, A. Mansurov arXiv_CL arXiv_CL  Transformer  Recognition  Bert  Speech  Language_Model  PDF
• 2021-08-22 From Two to One: A New Scene Text Recognizer with Visual Language Modeling Network    Yuxin Wang, Hongtao Xie, Shancheng Fang, Jing Wang, Shenggao Zhu, Yongdong Zhang arXiv_CV arXiv_CV  Recognition  Pose  Scene_Text  Language_Model  PDF
• 2021-08-21 How Cute is Pikachu? Gathering and Ranking Pok'emon Properties from Data with Pok'emon Word Embeddings    Mika Hämäläinen, Khalid Alnajjar, Niko Partanen arXiv_CL arXiv_CL  Embedding  Language_Model  PDF
• 2021-08-21 CushLEPOR: Customised hLEPOR Metric Using LABSE Distilled Knowledge Model to Improve Agreement with Human Judgements    Lifeng Han, Irina Sorokina, Gleb Erofeev, Serge Gladkoff arXiv_AI arXiv_AI  Knowledge  Pose  Language_Model  PDF
• 2021-08-20 One Chatbot Per Person: Creating Personalized Chatbots based on Implicit User Profiles    Zhengyi Ma, Zhicheng Dou, Yutao Zhu, Hanxun Zhong, Ji-Rong Wen arXiv_AI arXiv_AI  Transformer  Pose  Language_Model  QA  PDF
• 2021-08-20 An Empirical Cybersecurity Evaluation of GitHub Copilot's Code Contributions    Hammond Pearce, Baleegh Ahmad, Benjamin Tan, Brendan Dolan-Gavitt, Ramesh Karri arXiv_AI arXiv_AI  Language_Model  PDF
• 2021-08-20 Open Relation Modeling: Learning to Define Relations between Entities    Jie Huang, Kevin Chen-Chuan Chang, Jinjun Xiong, Wen-mei Hwu arXiv_AI arXiv_AI  Knowledge  Knowledge_Graph  Pose  Relation  Language_Model  PDF
• 2021-08-20 Knowledge Perceived Multi-modal Pretraining in E-commerce    Yushan Zhu, Huaixiao Tou, Wen Zhang, Ganqiang Ye, Hui Chen, Ningyu Zhang, Huajun Chen arXiv_AI arXiv_AI  Knowledge  Pose  Face  Action  Language_Model  Prediction  PDF
• 2021-08-20 SMedBERT: A Knowledge-Enhanced Pre-trained Language Model with Structured Semantics for Medical Text Mining    Taolin Zhang, Zerui Cai, Chengyu Wang, Minghui Qiu, Bite Yang, Xiaofeng He arXiv_CL arXiv_CL  Bert  Knowledge  Knowledge_Graph  Pose  Relation  Attention  Medical  Inference  Language_Model  Matching  PDF
• 2021-08-19 A Framework for Neural Topic Modeling of Text Corpora    Shayan Fazeli, Majid Sarrafzadeh arXiv_CL arXiv_CL  Transformer  Embedding  Bert  Language_Model  PDF
• 2021-08-19 DESYR: Definition and Syntactic Representation Based Claim Detection on the Web    Megha Sundriyal, Parantak Singh, Md Shad Akhtar, Shubhashis Sengupta, Tanmoy Chakraborty arXiv_CL arXiv_CL  Embedding  Represenation_Learning  Pose  Detection  Language_Model  PDF
• 2021-08-19 Language Model Augmented Relevance Score    Ruibo Liu, Jason Wei, Soroush Vosoughi arXiv_CL arXiv_CL  Reinforcement_Learning  Bert  Adversarial  Pose  Relation  Language_Model  Matching  PDF
• 2021-08-19 Augmenting Slot Values and Contexts for Spoken Language Understanding with Pretrained Models    Haitao Lin, Lu Xiang, Yu Zhou, Jiajun Zhang, Chengqing Zong arXiv_CL arXiv_CL  Knowledge  Pose  Language_Model  PDF
• 2021-08-19 MvSR-NAT: Multi-view Subset Regularization for Non-Autoregressive Machine Translation    Pan Xie, Zexian Li, Xiaohui Hu arXiv_CL arXiv_CL  Transformer  Regularization  Language_Model  Prediction  PDF
• 2021-08-19 Exploiting Multi-Object Relationships for Detecting Adversarial Attacks in Complex Scenes    Mingjun Yin, Shasha Li, Zikui Cai, Chengyu Song, M. Salman Asif, Amit K. Roy-Chowdhury, Srikanth V. Krishnamurthy arXiv_CV arXiv_CV  Adversarial  Detection  Relation  Object_Detection  Language_Model  PDF
• 2021-08-18 TSI: an Ad Text Strength Indicator using Text-to-CTR and Semantic-Ad-Similarity    Shaunak Mishra, Changwei Hu, Manisha Verma, Kevin Yen, Yifan Hu, Maxim Sviridenko arXiv_CL arXiv_CL  Unsupervised  Bert  Pose  Language_Model  Prediction  PDF
• 2021-08-18 Table Caption Generation in Scholarly Documents Leveraging Pre-trained Language Models    Junjie H. Xu, Kohei Shinden, Makoto P. Kato arXiv_CL arXiv_CL  Pose  Caption  Language_Model  Matching  PDF
• 2021-08-18 AdapterHub Playground: Simple and Flexible Few-Shot Learning with Adapters    Tilman Beck, Bela Bohlender, Christina Viehmann, Vincent Hane, Yanik Adamson, Jaber Khuri, Jonas Brossmann, Jonas Pfeiffer, Iryna Gurevych arXiv_CL arXiv_CL  Transfer_Learning  OCR  Knowledge  Face  Few-Shot  Language_Model  Prediction  PDF
• 2021-08-18 Learning Implicit User Profiles for Personalized Retrieval-Based Chatbot    Hongjin Qian, Zhicheng Dou, Yutao Zhu, Yueyuan Ma, Ji-Rong Wen arXiv_AI arXiv_AI  Relation  Language_Model  QA  Matching  PDF
• 2021-08-17 Modulating Language Models with Emotions    Ruibo Liu, Jason Wei, Chenyan Jia, Soroush Vosoughi arXiv_CL arXiv_CL  Pose  Emotion  Language_Model  PDF
• 2021-08-17 A Game Interface to Study Semantic Grounding in Text-Based Models    Timothee Mickus, Mathieu Constant, Denis Paperno arXiv_CL arXiv_CL  Pose  Face  Language_Model  PDF
• 2021-08-17 A Weak Supervised Dataset of Fine-Grained Emotions in Portuguese    Diogo Cortiz, Jefferson O. Silva, Newton Calegari, Ana Luísa Freitas, Ana Angélica Soares, Carolina Botelho, Gabriel Gaudencio Rêgo, Waldir Sampaio, Paulo Sergio Boggio arXiv_CL arXiv_CL  Transformer  Recognition  Bert  Emotion  Classification  Sentiment  Language_Model  PDF
• 2021-08-17 Coalesced Multi-Output Tsetlin Machines with Clause Sharing    Sondre Glimsdal, Ole-Christoffer Granmo arXiv_AI arXiv_AI  Pose  Language_Model  PDF
• 2021-08-17 Modeling Protein Using Large-scale Pretrain Language Model    Yijia Xiao, Jiezhong Qiu, Ziang Li, Chang-Yu Hsieh, Jie Tang arXiv_CL arXiv_CL  Classification  Deep_Learning  Detection  CNN  Language_Model  PDF
• 2021-08-16 Deep Natural Language Processing for LinkedIn Search    Weiwei Guo, Xiaowei Liu, Sida Wang, Michaeel Kazi, Zhiwei Wang, Zhoutong Fu, Jun Jia, Liang Zhang, Huiji Gao, Bo Long arXiv_CL arXiv_CL  Bert  Classification  Deep_Learning  Language_Model  Prediction  PDF
• 2021-08-16 Autoencoders as Tools for Program Synthesis    Sander de Bruin, Vadim Liventsev, Milan Petković arXiv_AI arXiv_AI  Summarization  Language_Model  PDF
• 2021-08-16 Hybrid deep learning methods for phenotype prediction from clinical notes    Sahar Khalafi, Nasser Ghadiri, Milad Moradi arXiv_CL arXiv_CL  Embedding  RNN  Pose  Action  Deep_Learning  Medical  CNN  Language_Model  Prediction  PDF
• 2021-08-15 Exploring Generalization Ability of Pretrained Language Models on Arithmetic and Logical Reasoning    Cunxiang Wang, Boyuan Zheng, Yuchen Niu, Yue Zhang arXiv_AI arXiv_AI  Quantitative  Language_Model  PDF
• 2021-08-15 Accurate, yet inconsistent? Consistency Analysis on Language Understanding Models    Myeongjun Jang, Deuk Sin Kwon, Thomas Lukasiewicz arXiv_CL arXiv_CL  Pose  Language_Model  Prediction  PDF
• 2021-08-14 The SelectGen Challenge: Finding the Best Training Samples for Few-Shot Neural Text Generation    Ernie Chang, Xiaoyu Shen, Alex Marin, Vera Demberg arXiv_CL arXiv_CL  Pose  Few-Shot  Attention  Text_Generation  Language_Model  PDF
• 2021-08-14 Few-Sample Named Entity Recognition for Security Vulnerability Reports by Fine-Tuning Pre-Trained Language Models    Guanqun Yang, Shay Dineen, Zhipeng Lin, Xueqing Liu arXiv_CL arXiv_CL  Transfer_Learning  Recognition  Pose  Action  Language_Model  PDF
• 2021-08-14 Exploiting a Joint Embedding Space for Generalized Zero-Shot Semantic Segmentation    Donghyeon Baek, Youngmin Oh, Bumsub Ham arXiv_CV arXiv_CV  Segmentation  Embedding  Semantic_Segmentation  Zero-Shot  Pose  Inference  Language_Model  PDF
• 2021-08-13 On Single and Multiple Representations in Dense Passage Retrieval    Craig Macdonald, Nicola Tonellotto, Iadh Ounis arXiv_CL arXiv_CL  Embedding  Bert  Language_Model  PDF
• 2021-08-13 Towards Structured Dynamic Sparse Pre-Training of BERT    Anastasia Dietrich, Frithjof Gressmann, Douglas Orr, Ivan Chelombiev, Daniel Justus, Carlo Luschi arXiv_CL arXiv_CL  Unsupervised  Bert  Sparse  Language_Model  PDF
• 2021-08-13 Detection and Captioning with Unseen Object Classes    Berkan Demirel, Ramazan Gokberk Cinbis arXiv_CV arXiv_CV  Image_Caption  Recognition  Zero-Shot  Pose  Detection  Caption  Language_Model  PDF
• 2021-08-12 How Optimal is Greedy Decoding for Extractive Question Answering?    Or Castel, Ori Ram, Avia Efrat, Omer Levy arXiv_CL arXiv_CL  Zero-Shot  Self-Supervised  Few-Shot  Language_Model  PDF
• 2021-08-12 Modeling Relevance Ranking under the Pre-training and Fine-tuning Paradigm    Lin Bo, Liang Pang, Gang Wang, Jun Xu, XiuQiang He, Ji-Rong Wen arXiv_CL arXiv_CL  Bert  Knowledge  Pose  Language_Model  PDF
• 2021-08-12 AMMUS : A Survey of Transformer-based Pretrained Models in Natural Language Processing    Katikapalli Subramanyam Kalyan, Ajit Rajasekharan, Sivanesan Sangeetha arXiv_CL arXiv_CL  Transformer  Embedding  Transfer_Learning  Bert  Knowledge  Self-Supervised  Survey  Language_Model  PDF
• 2021-08-12 Unsupervised Corpus Aware Language Model Pre-training for Dense Passage Retrieval    Luyu Gao, Jamie Callan arXiv_CL arXiv_CL  Embedding  Unsupervised  Pose  Language_Model  QA  PDF
• 2021-08-11 Extracting Semantics from Maintenance Records    Sharad Dixit, Varish Mulwad, Abhinav Saxena arXiv_AI arXiv_AI  Recognition  Knowledge  Ontology  Action  Relation  Relation_Extraction  Language_Model  PDF
• 2021-08-11 Putting RDF2vec in Order    Jan Portisch, Heiko Paulheim arXiv_AI arXiv_AI  Embedding  Knowledge  Knowledge_Graph  Language_Model  PDF
• 2021-08-11 Mounting Video Metadata on Transformer-based Language Model for Open-ended Video Question Answering    Donggeon Lee, Seongho Choi, Youwon Jang, Byoung-Tak Zhang arXiv_AI arXiv_AI  Transformer  Attention  Language_Model  QA  PDF
• 2021-08-11 DEMix Layers: Disentangling Domains for Modular Language Modeling    Suchin Gururangan, Mike Lewis, Ari Holtzman, Noah A. Smith, Luke Zettlemoyer arXiv_AI arXiv_AI  Transformer  Inference  Language_Model  PDF
• 2021-08-11 A Transformer-based Math Language Model for Handwritten Math Expression Recognition    Huy Quang Ung, Cuong Tuan Nguyen, Hung Tuan Nguyen, Thanh-Nghia Truong, Masaki Nakagawa arXiv_CV arXiv_CV  Transformer  Recognition  Pose  Relation  Attention  Language_Model  PDF
• 2021-08-11 Perturbing Inputs for Fragile Interpretations in Deep Natural Language Processing    Sanchit Sinha, Hanjie Chen, Arshdeep Sekhon, Yangfeng Ji, Yanjun Qi arXiv_CL arXiv_CL  Transformer  Adversarial  Relation  Language_Model  Prediction  PDF
• 2021-08-10 BERTHop: An Effective Vision-and-Language Model for Chest X-ray Disease Diagnosis    Masoud Monajatipoor, Mozhdeh Rouhsedaghat, Liunian Harold Li, Aichi Chien, C.-C. Jay Kuo, Fabien Scalzo, Kai-Wei Chang arXiv_AI arXiv_AI  Transformer  Bert  Pose  VQA  Medical  Language_Model  QA  PDF
• 2021-08-10 CLSEBERT: Contrastive Learning for Syntax Enhanced Code Pre-Trained Model    Xin Wang, Yasheng Wang, Pingyi Zhou, Meng Xiao, Yadao Wang, Li Li, Xiao Liu, Hao Wu, Jin Liu, Xin Jiang arXiv_AI arXiv_AI  Bert  Pose  Contrastive_Learning  Detection  Language_Model  Matching  PDF
• 2021-08-10 BROS: A Layout-Aware Pre-trained Language Model for Understanding Documents    Teakgyu Hong, Donghyun Kim, Mingi Ji, Wonseok Hwang, Daehyun Nam, Sungrae Park arXiv_CL arXiv_CL  Recognition  OCR  Bert  Pose  Language_Model  PDF
• 2021-08-09 COMPARE: A Taxonomy and Dataset of Comparison Discussions in Peer Reviews    Shruti Singh, Mayank Singh, Pawan Goyal arXiv_CL arXiv_CL  Review  Deep_Learning  Language_Model  PDF
• 2021-08-09 Noisy Channel Language Model Prompting for Few-Shot Text Classification    Sewon Min, Mike Lewis, Hannaneh Hajishirzi, Luke Zettlemoyer arXiv_AI arXiv_AI  Text_Classification  Pose  Classification  Few-Shot  Language_Model  Recommendation  PDF
• 2021-08-09 Image Retrieval on Real-life Images with Pre-trained Vision-and-Language Models    Zheyuan Liu, Cristian Rodriguez-Opazo, Damien Teney, Stephen Gould arXiv_CV arXiv_CV  Transformer  Image_Retrieval  Knowledge  Pose  Language_Model  Matching  PDF
• 2021-08-09 Do Images really do the Talking? Analysing the significance of Images in Tamil Troll meme classification    Siddhanth U Hegde, Adeep Hande, Ruba Priyadharshini, Sajeetha Thavareesan, Ratnasingam Sakuntharaj, Sathiyaraj Thangasamy, B Bharathi, Bharathi Raja Chakravarthi arXiv_CL arXiv_CL  Transformer  Emotion  Action  Classification  Attention  Language_Model  PDF
• 2021-08-09 Learning Joint Embedding with Modality Alignments for Cross-Modal Retrieval of Recipes and Food Images    Zhongwei Xie, Ling Liu, Lin Li, Luo Zhong arXiv_CV arXiv_CV  Embedding  Optimization  RNN  Image_Retrieval  Regularization  Pose  Action  Language_Model  PDF
• 2021-08-08 Leveraging Commonsense Knowledge on Classifying False News and Determining Checkworthiness of Claims    Ipek Baris Schlicht, Erhan Sezerer, Selma Tekir, Oul Han, Zeyd Boukhers arXiv_AI arXiv_AI  Bert  Knowledge  Pose  Classification  Detection  Language_Model  PDF
• 2021-08-08 Language Model Evaluation in Open-ended Text Generation    An Nguyen arXiv_CL arXiv_CL  Pose  Text_Generation  Language_Model  PDF
• 2021-08-07 W2v-BERT: Combining Contrastive Learning and Masked Language Modeling for Self-Supervised Speech Pre-Training    Yu-An Chung, Yu Zhang, Wei Han, Chung-Cheng Chiu, James Qin, Ruoming Pang, Yonghui Wu arXiv_SD arXiv_SD  Unsupervised  Bert  Represenation_Learning  Speech  Self-Supervised  Pose  Contrastive_Learning  Language_Model  Prediction  PDF
• 2021-08-06 Towards Zero-shot Language Modeling    Edoardo Maria Ponti, Ivan Vulić, Ryan Cotterell, Roi Reichart, Anna Korhonen arXiv_CL arXiv_CL  Zero-Shot  Knowledge  Few-Shot  Language_Model  PDF
• 2021-08-06 Offensive Language and Hate Speech Detection with Deep Learning and Transfer Learning    Bencheng Wei, Jason Li, Ajay Gupta, Hafiza Umair, Atsu Vovor, Natalie Durzynski arXiv_AI arXiv_AI  Transformer  Embedding  Transfer_Learning  Bert  Text_Classification  RNN  Speech  Pose  Classification  Deep_Learning  Detection  Sentiment  Language_Model  PDF
• 2021-08-06 Deriving Disinformation Insights from Geolocalized Twitter Callouts    David Tuxworth, Dimosthenis Antypas, Luis Espinosa-Anke, Jose Camacho-Collados, Alun Preece, David Rogers arXiv_CL arXiv_CL  Transformer  Embedding  Bert  Classification  Language_Model  PDF
• 2021-08-06 Sentence Semantic Regression for Text Generation    Wei Wang, Piji Li, Hai-Tao Zheng arXiv_CL arXiv_CL  Bert  Pose  Face  Text_Generation  Language_Model  Prediction  PDF
• 2021-08-06 StrucTexT: Structured Text Understanding with Multi-Modal Transformers    Yulin Li, Yuxi Qian, Yuchen Yu, Xiameng Qin, Chengquan Zhang, Yan Liu, Kun Yao, Junyu Han, Jingtuo Liu, Errui Ding arXiv_CV arXiv_CV  Transformer  Self-Supervised  Pose  Language_Model  Prediction  PDF
• 2021-08-06 LadRa-Net: Locally-Aware Dynamic Re-read Attention Net for Sentence Semantic Matching    Kun Zhang, Guangyi Lv, Le Wu, Enhong Chen, Qi Liu, Meng Wang arXiv_CL arXiv_CL  Pose  Relation  Attention  Inference  Language_Model  Matching  PDF
• 2021-08-05 Knowledge Distillation from BERT Transformer to Speech Transformer for Intent Classification    Yidi Jiang, Bidisha Sharma, Maulik Madhavi, Haizhou Li arXiv_CL arXiv_CL  Transformer  Recognition  Bert  Knowledge  Speech  Pose  Classification  Attention  Speech_Recognition  Language_Model  PDF
• 2021-08-05 Finetuning Pretrained Transformers into Variational Autoencoders    Seongmin Park, Jihwa Lee arXiv_AI arXiv_AI  Transformer  Language_Model  PDF
• 2021-08-05 FMMformer: Efficient and Flexible Transformer via Decomposed Near-field and Far-field Attention    Tan M. Nguyen, Vai Suliafu, Stanley J. Osher, Long Chen, Bao Wang arXiv_AI arXiv_AI  Transformer  Pose  Action  Classification  Attention  Language_Model  PDF
• 2021-08-05 Robust Transfer Learning with Pretrained Language Models through Adapters    Wenjuan Han, Bo Pang, Yingnian Wu arXiv_CL arXiv_CL  Transformer  Unsupervised  Transfer_Learning  Bert  Adversarial  Pose  Classification  Language_Model  PDF
• 2021-08-04 Mitigating harm in language models with conditional-likelihood filtration    Helen Ngo, Cooper Raterink, João G.M. Araújo, Ivan Zhang, Carol Chen, Adrien Morisot, Nicholas Frosst arXiv_CL arXiv_CL  Speech  Language_Model  PDF
• 2021-08-04 Curriculum learning for language modeling    Daniel Campos arXiv_AI arXiv_AI  Bert  Language_Model  PDF
• 2021-08-04 Knowledgeable Prompt-tuning: Incorporating Knowledge into Prompt Verbalizer for Text Classification    Shengding Hu, Ning Ding, Huadong Wang, Zhiyuan Liu, Juanzi Li, Maosong Sun arXiv_CL arXiv_CL  Gradient_Descent  Text_Classification  Knowledge  Classification  Few-Shot  Language_Model  PDF
• 2021-08-04 How to Query Language Models?    Leonard Adolphs, Shehzaad Dhuliawala, Thomas Hofmann arXiv_CL arXiv_CL  Bert  Knowledge  Pose  Relation  Language_Model  PDF
• 2021-08-04 Controlled Text Generation as Continuous Optimization with Multiple Constraints    Sachin Kumar, Eric Malmi, Aliaksei Severyn, Yulia Tsvetkov arXiv_CL arXiv_CL  Style_Transfer  Optimization  Pose  Text_Generation  Inference  Language_Model  PDF
• 2021-08-04 Improving Distinction between ASR Errors and Speech Disfluencies with Feature Space Interpolation    Seongmin Park, Dongchan Shin, Sangyoun Paik, Subong Choi, Alena Kazakova, Jihwa Lee arXiv_CL arXiv_CL  Recognition  Knowledge  Speech  Pose  Detection  Speech_Recognition  Language_Model  PDF
• 2021-08-03 Improving Counterfactual Generation for Fair Hate Speech Detection    Aida Mostafazadeh Davani, Ali Omrani, Brendan Kennedy, Mohammad Atari, Xiang Ren, Morteza Dehghani arXiv_CL arXiv_CL  Speech  Detection  Language_Model  Prediction  PDF
• 2021-08-03 Exploiting BERT For Multimodal Target SentimentClassification Through Input Space Translation    Zaid Khan, Yun Fu arXiv_CV arXiv_CV  Transformer  Bert  Sentiment_Classification  Emotion  Classification  Sentiment  Text_Generation  Language_Model  PDF
• 2021-08-03 Large-Scale Differentially Private BERT    Rohan Anil, Badih Ghazi, Vineet Gupta, Ravi Kumar, Pasin Manurangsi arXiv_CL arXiv_CL  Bert  Language_Model  PDF
• 2021-08-03 EVA: An Open-Domain Chinese Dialogue System with Large-Scale Generative Pre-Training    Hao Zhou, Pei Ke, Zheng Zhang, Yuxian Gu, Yinhe Zheng, Chujie Zheng, Yida Wang, Chen Henry Wu, Hao Sun, Xiaocong Yang, Bosi Wen, Xiaoyan Zhu, Minlie Huang, Jie Tang arXiv_AI arXiv_AI  Pose  Action  Language_Model  PDF
• 2021-08-03 Your fairness may vary: Group fairness of pretrained language models in toxic text classification    Ioana Baldini, Dennis Wei, Karthikeyan Natesan Ramamurthy, Mikhail Yurochkin, Moninder Singh arXiv_CL arXiv_CL  Text_Classification  Classification  Language_Model  PDF
• 2021-08-02 PyEuroVoc: A Tool for Multilingual Legal Document Classification with EuroVoc Descriptors    Andrei-Marius Avram, Vasile Pais, Dan Tufis arXiv_AI arXiv_AI  Transformer  Pose  Face  Classification  GAN  Language_Model  PDF
• 2021-08-02 Automatic recognition of suprasegmentals in speech    Jiahong Yuan, Neville Ryant, Xingyu Cai, Kenneth Church, Mark Liberman arXiv_CL arXiv_CL  Recognition  Speech  Speech_Recognition  Language_Model  PDF
• 2021-08-02 Analyzing Speaker Information in Self-Supervised Models to Improve Zero-Resource Speech Processing    Benjamin van Niekerk, Leanne Nortje, Matthew Baas, Herman Kamper arXiv_SD arXiv_SD  Speech  Self-Supervised  Pose  Language_Model  PDF
• 2021-08-02 LICHEE: Improving Language Model Pre-training with Multi-grained Tokenization    Weidong Guo, Mingjun Zhao, Lusheng Zhang, Di Niu, Jinwen Luo, Zhenhua Liu, Zhenyang Li, Jianbo Tang arXiv_AI arXiv_AI  Bert  Pose  Inference  Language_Model  PDF
• 2021-08-02 Self-supervised Answer Retrieval on Clinical Notes    Paul Grundmann, Sebastian Arnold, Alexander Löser arXiv_CL arXiv_CL  Transformer  Zero-Shot  Self-Supervised  Medical  Language_Model  Matching  PDF
• 2021-08-02 Is My Model Using The Right Evidence? Systematic Probes for Examining Evidence-Based Tabular Reasoning    Vivek Gupta, Riyaz A. Bhat, Atreya Ghosal, Manish Srivastava, Maneesh Singh, Vivek Srikumar arXiv_AI arXiv_AI  Bert  Knowledge  Language_Model  Prediction  PDF
• 2021-08-01 Learning to Look Inside: Augmenting Token-Based Encoders with Character-Level Information    Yuval Pinter, Amanda Stent, Mark Dredze, Jacob Eisenstein arXiv_CL arXiv_CL  Transformer  Embedding  Pose  Language_Model  PDF
• 2021-08-01 Improving Social Meaning Detection with Pragmatic Masking and Surrogate Fine-Tuning    Chiyu Zhang, Muhammad Abdul-Mageed, AbdelRahim Elmadany, El Moatez Billah Nagoudi arXiv_AI arXiv_AI  Transfer_Learning  Zero-Shot  Pose  Detection  Few-Shot  Denoising  Language_Model  PDF
• 2021-07-31 Using Knowledge-Embedded Attention to Augment Pre-trained Language Models for Fine-Grained Emotion Recognition    Varsha Suresh, Desmond C. Ong arXiv_AI arXiv_AI  Recognition  Bert  Knowledge  Pose  Emotion  Action  Attention  Language_Model  PDF
• 2021-07-31 Learning Embeddings that Capture Spatial Semantics for Indoor Navigation    Vidhi Jain, Prakhar Agarwal, Shishir Patil, Katia Sycara arXiv_AI arXiv_AI  Embedding  Knowledge  Pose  Relation  Language_Model  PDF
• 2021-07-30 Structural Guidance for Transformer Language Models    Peng Qian, Tahira Naseem, Roger Levy, Ramón Fernandez Astudillo arXiv_CL arXiv_CL  Transformer  Pose  Language_Model  PDF
• 2021-07-30 Towards Continual Entity Learning in Language Models for Conversational Agents    Ravi Teja Gadde, Ivan Bulyko arXiv_AI arXiv_AI  Language_Model  PDF
• 2021-07-29 Adapting GPT, GPT-2 and BERT Language Models for Speech Recognition    Xianrui Zheng, Chao Zhang, Philip C. Woodland arXiv_CL arXiv_CL  Transformer  Recognition  Bert  Speech  Pose  Speech_Recognition  Language_Model  PDF
• 2021-07-29 Demystifying Neural Language Models' Insensitivity to Word-Order    Louis Clouatre, Prasanna Parthasarathi, Amal Zouaq, Sarath Chandar arXiv_AI arXiv_AI  Transformer  RNN  Pose  Relation  CNN  Language_Model  PDF
• 2021-07-29 AutoTinyBERT: Automatic Hyper-parameter Optimization for Efficient Pre-trained Language Models    Yichun Yin, Cheng Chen, Lifeng Shang, Xin Jiang, Xiao Chen, Qun Liu arXiv_CL arXiv_CL  NAS  Bert  Optimization  Pose  Language_Model  PDF
• 2021-07-28 Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing    Pengfei Liu, Weizhe Yuan, Jinlan Fu, Zhengbao Jiang, Hiroaki Hayashi, Graham Neubig arXiv_AI arXiv_AI  Zero-Shot  Review  Survey  Few-Shot  GAN  Language_Model  Prediction  PDF
• 2021-07-28 MWP-BERT: A Strong Baseline for Math Word Problems    Zhenwen Liang, Jipeng Zhang, Jie Shao, Xiangliang Zhang arXiv_AI arXiv_AI  Bert  Knowledge  Language_Model  Matching  PDF
• 2021-07-28 Arabic aspect based sentiment analysis using BERT    Mohammed M.Abdelgwad arXiv_CL arXiv_CL  Embedding  Bert  Review  Classification  Deep_Learning  Sentiment  Language_Model  PDF
• 2021-07-28 Goal-Oriented Script Construction    Qing Lyu, Li Zhang, Chris Callison-Burch arXiv_CL arXiv_CL  Transformer  Zero-Shot  Knowledge  Pose  Language_Model  PDF
• 2021-07-27 Red Dragon AI at TextGraphs 2021 Shared Task: Multi-Hop Inference Explanation Regeneration by Matching Expert Ratings    Vivek Kalyan, Sam Witteveen, Martin Andrews arXiv_CL arXiv_CL  Inference  Language_Model  Matching  PDF
• 2021-07-27 gaBERT -- an Irish Language Model    James Barry, Joachim Wagner, Lauren Cassidy, Alan Cowap, Teresa Lynn, Abigail Walsh, Mícheál J. Ó Meachair, Jennifer Foster arXiv_CL arXiv_CL  Bert  Language_Model  PDF
• 2021-07-27 Cross-lingual Transferring of Pre-trained Contextualized Language Models    Zuchao Li, Kevin Parnow, Hai Zhao, Zhuosheng Zhang, Rui Wang, Masao Utiyama, Eiichiro Sumita arXiv_CL arXiv_CL  Embedding  Adversarial  Pose  Language_Model  PDF
• 2021-07-27 Federated Learning Meets Natural Language Processing: A Survey    Ming Liu, Stella Ho, Mengqi Wang, Longxiang Gao, Yuan Jin, He Zhang arXiv_AI arXiv_AI  Review  Survey  Deep_Learning  Language_Model  PDF
• 2021-07-27 Combining Probabilistic Logic and Deep Learning for Self-Supervised Learning    Hoifung Poon, Hai Wang, Hunter Lang arXiv_AI arXiv_AI  Text_Classification  Represenation_Learning  Knowledge  Self-Supervised  Pose  Action  Classification  Deep_Learning  Medical  Language_Model  PDF
• 2021-07-26 Don't Sweep your Learning Rate under the Rug: A Closer Look at Cross-modal Transfer of Pretrained Transformers    Danielle Rothermel, Margaret Li, Tim Rocktäschel, Jakob Foerster arXiv_AI arXiv_AI  Transformer  Self-Supervised  Language_Model  PDF
• 2021-07-26 Exploiting Language Model for Efficient Linguistic Steganalysis: An Empirical Study    Biao Yi, Hanzhou Wu, Guorui Feng, Xinpeng Zhang arXiv_CL arXiv_CL  RNN  Knowledge  Deep_Learning  Detection  GAN  Language_Model  PDF
• 2021-07-26 Fine-Grained Emotion Prediction by Modeling Emotion Definitions    Gargi Singh, Dhanajit Brahma, Piyush Rai, Ashutosh Modi arXiv_AI arXiv_AI  Transfer_Learning  Pose  Emotion  Language_Model  Prediction  PDF
• 2021-07-26 Language Models as Zero-shot Visual Semantic Learners    Yue Jiao, Jonathon Hare, Adam Prügel-Bennett arXiv_CV arXiv_CV  Transformer  Embedding  Recognition  Zero-Shot  Knowledge  Pose  Language_Model  PDF
• 2021-07-24 Stress Test Evaluation of Biomedical Word Embeddings    Vladimir Araujo, Andrés Carvallo, Carlos Aspillaga, Camilo Thorne, Denis Parra arXiv_AI arXiv_AI  Embedding  Recognition  Adversarial  Pose  Medical  Language_Model  PDF
• 2021-07-24 MDQE: A More Accurate Direct Pretraining for Machine Translation Quality Estimation    Lei Lin arXiv_CL arXiv_CL  Bert  Pose  Language_Model  PDF
• 2021-07-23 A Differentiable Language Model Adversarial Attack on Text Classifiers    Ivan Fursov, Alexey Zaytsev, Pavel Burnyshev, Ekaterina Dmitrieva, Nikita Klyuchnikov, Andrey Kravchenko, Ekaterina Artemova, Evgeny Burnaev arXiv_CL arXiv_CL  Transformer  Adversarial  Pose  Deep_Learning  Language_Model  PDF
• 2021-07-23 Label Distribution Amendment with Emotional Semantic Correlations for Facial Expression Recognition    Shasha Mao, Guanghui Shi, Licheng Jiao, Shuiping Gou, Yangyang Li, Lin Xiong, Boxin Shi arXiv_CV arXiv_CV  Recognition  Pose  Emotion  Relation  Language_Model  PDF
• 2021-07-23 When a crisis strikes: Emotion analysis and detection during COVID-19    Alexander Tekle, Chau Pham, Cornelia Caragea, Junyi Jessy Li arXiv_CL arXiv_CL  Emotion  Detection  Language_Model  Prediction  PDF
• 2021-07-22 FNetAR: Mixing Tokens with Autoregressive Fourier Transforms    Tim Lou, Michael Park, Mohammad Ramezanali, Vincent Tang arXiv_CL arXiv_CL  Transformer  Sparse  Attention  Language_Model  Prediction  PDF
• 2021-07-22 Did the Cat Drink the Coffee? Challenging Transformers with Generalized Event Knowledge    Paolo Pedinotti, Giulia Rambelli, Emmanuele Chersoni, Enrico Santus, Alessandro Lenci, Philippe Blache arXiv_CL arXiv_CL  Transformer  Knowledge  Face  Relation  Language_Model  Prediction  PDF
• 2021-07-22 Back-Translated Task Adaptive Pretraining: Improving Accuracy and Robustness on Text Classification    Junghoon Lee, Jounghee Kim, Pilsung Kang arXiv_CL arXiv_CL  Text_Classification  Pose  Classification  Language_Model  PDF
• 2021-07-22 Spinning Sequence-to-Sequence Models with Meta-Backdoors    Eugene Bagdasaryan, Vitaly Shmatikov arXiv_CL arXiv_CL  Embedding  Adversarial  Sentiment  GAN  Summarization  Language_Model  PDF
• 2021-07-21 JS Fake Chorales: a Synthetic Dataset of Polyphonic Music with Human Annotation    Omar Peracha arXiv_SD arXiv_SD  Pose  Classification  Image_Classification  Language_Model  PDF
• 2021-07-21 JEFL: Joint Embedding of Formal Proof Libraries    Qingxiang Wang, Cezary Kaliszyk arXiv_CL arXiv_CL  Embedding  Unsupervised  Pose  Language_Model  Matching  PDF
• 2021-07-21 Few Shots Is All You Need: A Progressive Few Shot Learning Approach for Low Resource Handwriting Recognition    Mohamed Ali Souibgui, Alicia Fornés, Yousri Kessentini, Beáta Megyesi arXiv_CV arXiv_CV  Unsupervised  Handwriting  Recognition  Pose  Few-Shot  Language_Model  PDF
• 2021-07-21 An artificial intelligence natural language processing pipeline for information extraction in neuroradiology    Henry Watkins, Robert Gray, Ashwani Jha, Parashkev Nachev arXiv_AI arXiv_AI  Action  Medical  Language_Model  PDF
• 2021-07-21 The Effectiveness of Intermediate-Task Training for Code-Switched Natural Language Understanding    Archiki Prasad, Mohammad Ali Rehan, Shreya Pathak, Preethi Jyothi arXiv_CL arXiv_CL  Pose  Sentiment  Inference  Language_Model  QA  PDF
• 2021-07-20 Different kinds of cognitive plausibility: why are transformers better than RNNs at predicting N400 amplitude?    James A. Michaelov, Megan D. Bardolph, Seana Coulson, Benjamin K. Bergen arXiv_AI arXiv_AI  Transformer  RNN  Pose  Language_Model  Prediction  PDF
• 2021-07-20 Learning ULMFiT and Self-Distillation with Calibration for Medical Dialogue System    Shuang Ao, Xeno Acharya arXiv_CL arXiv_CL  Transfer_Learning  Regularization  Knowledge  Pose  Deep_Learning  Relation  GAN  Medical  Language_Model  PDF
• 2021-07-20 Seed Words Based Data Selection for Language Model Adaptation    Roberto Gretter, Marco Matassoni, Daniele Falavigna arXiv_CL arXiv_CL  Recognition  Speech  Pose  Speech_Recognition  Language_Model  PDF
• 2021-07-20 MIMO: Mutual Integration of Patient Journey and Medical Ontology for Healthcare Representation Learning    Xueping Peng, and Guodong Long, Tao Shen, Sen Wang, Zhendong Niu, Chengqi Zhang arXiv_AI arXiv_AI  Transformer  Embedding  Represenation_Learning  RNN  Knowledge  Knowledge_Graph  Self-Supervised  Pose  Ontology  Attention  Medical  Language_Model  Prediction  PDF
• 2021-07-19 Token-Level Supervised Contrastive Learning for Punctuation Restoration    Qiushi Huang, Tom Ko, H Lilian Tang, Xubo Liu, Bo Wu arXiv_CL arXiv_CL  Embedding  Recognition  Restoration  Speech  Contrastive_Learning  Detection  Speech_Recognition  Language_Model  PDF
• 2021-07-19 Unsupervised Identification of Relevant Prior Cases    Shivangi Bithel, Sumitra S Malagi arXiv_CL arXiv_CL  Embedding  Unsupervised  Bert  Knowledge  Pose  Language_Model  PDF
• 2021-07-19 A baseline model for computationally inexpensive speech recognition for Kazakh using the Coqui STT framework    Ilnar Salimzianov arXiv_CL arXiv_CL  Recognition  Speech  Face  Speech_Recognition  Inference  Language_Model  PDF
• 2021-07-19 Human-in-the-Loop for Data Collection: a Multi-Target Counter Narrative Dataset to Fight Online Hate Speech    Margherita Fanton, Helena Bonaldi, Serra Sinem Tekiroglu, Marco Guerini arXiv_CL arXiv_CL  Knowledge  Review  Speech  Pose  Language_Model  PDF
• 2021-07-19 Bridging the Gap between Language Model and Reading Comprehension: Unsupervised MRC via Self-Supervision    Ning Bian, Xianpei Han, Bo Chen, Hongyu Lin, Ben He, Le Sun arXiv_CL arXiv_CL  Unsupervised  Self-Supervised  Pose  Action  Inference  Language_Model  PDF
• 2021-07-18 Pre-trained Language Models as Prior Knowledge for Playing Text-based Games    Ishika Singh, Gargi Singh, Ashutosh Modi arXiv_AI arXiv_AI  Transformer  Knowledge  Pose  Action  Language_Model  PDF
• 2021-07-18 A High-Performance Adaptive Quantization Approach for Edge CNN Applications    Hsu-Hsun Chin, Ren-Song Tsay, Hsin-I Wu arXiv_CV arXiv_CV  Quantization  Pose  Classification  Detection  Object_Detection  CNN  Image_Classification  Language_Model  PDF
• 2021-07-17 On the Copying Behaviors of Pre-Training for Neural Machine Translation    Xuebo Liu, Longyue Wang, Derek F. Wong, Liang Ding, Lidia S. Chao, Shuming Shi, Zhaopeng Tu arXiv_CL arXiv_CL  Pose  Quantitative  NMT  Language_Model  PDF
• 2021-07-16 Darmok and Jalad at Tanagra: A Dataset and Model for English-to-Tamarian Translation    Peter Jansen arXiv_CL arXiv_CL  Language_Model  PDF
• 2021-07-16 A Comparison of Methods for OOV-word Recognition on a New Public Dataset    Rudolf A. Braun, Srikanth Madikeri, Petr Motlicek arXiv_CL arXiv_CL  Recognition  Speech  Pose  Speech_Recognition  Language_Model  PDF
• 2021-07-16 Are Multilingual Models the Best Choice for Moderately Under-resourced Languages? A Comprehensive Assessment for Catalan    Jordi Armengol-Estapé, Casimiro Pio Carrino, Carlos Rodriguez-Penagos, Ona de Gibert Bonet, Carme Armentano-Oller, Aitor Gonzalez-Agirre, Maite Melero, Marta Villegas arXiv_CL arXiv_CL  Transformer  Recognition  Bert  Text_Classification  Speech  Action  Classification  Language_Model  PDF
• 2021-07-16 Intersectional Bias in Causal Language Models    Liam Magee, Lida Ghahremanlou, Karen Soldatic, Shanthi Robertson arXiv_CL arXiv_CL  Zero-Shot  Knowledge  Sentiment  Language_Model  PDF
• 2021-07-16 TAPEX: Table Pre-training via Learning a Neural SQL Executor    Qian Liu, Bei Chen, Jiaqi Guo, Zeqi Lin, Jian-guang Lou arXiv_CL arXiv_CL  Language_Model  QA  PDF
• 2021-07-15 Self-Supervised Contrastive Learning with Adversarial Perturbations for Robust Pretrained Language Models    Zhao Meng, Yihan Dong, Mrinmaya Sachan, Roger Wattenhofer arXiv_CL arXiv_CL  Bert  Adversarial  Self-Supervised  Contrastive_Learning  Language_Model  PDF
• 2021-07-15 Internet-Augmented Dialogue Generation    Mojtaba Komeili, Kurt Shuster, Jason Weston arXiv_CL arXiv_CL  Knowledge  Pose  Language_Model  PDF
• 2021-07-15 FewCLUE: A Chinese Few-shot Learning Evaluation Benchmark    Liang Xu, Xiaojing Lu, Chenyang Yuan, Xuanwei Zhang, Hu Yuan, Huilin Xu, Guoao Wei, Xiang Pan, Hai Hu arXiv_AI arXiv_AI  Zero-Shot  Classification  Few-Shot  Language_Model  PDF
• 2021-07-15 AutoBERT-Zero: Evolving BERT Backbone from Scratch    Jiahui Gao, Hang Xu, Han shi, Xiaozhe Ren, Philip L.H. Yu, Xiaodan Liang, Xin Jiang, Zhenguo Li arXiv_CL arXiv_CL  Transformer  NAS  Bert  Pose  Attention  Language_Model  PDF
• 2021-07-15 Wordcraft: a Human-AI Collaborative Editor for Story Writing    Andy Coenen, Luke Davis, Daphne Ippolito, Emily Reif, Ann Yuan arXiv_CL arXiv_CL  Transformer  Pose  Face  Action  Few-Shot  Language_Model  PDF
• 2021-07-15 Turning Tables: Generating Examples from Semi-structured Tables for Endowing Language Models with Reasoning Skills    Ori Yoran, Alon Talmor, Jonathan Berant arXiv_CL arXiv_CL  Knowledge  Pose  Language_Model  PDF
• 2021-07-15 Spanish Language Models    Asier Gutiérrez-Fandiño, Jordi Armengol-Estapé, Marc Pàmies, Joan Llop-Palao, Joaquín Silveira-Ocampo, Casimiro Pio Carrino, Aitor Gonzalez-Agirre, Carme Armentano-Oller, Carlos Rodriguez-Penagos, Marta Villegas arXiv_AI arXiv_AI  Bert  Language_Model  PDF
• 2021-07-15 FLEX: Unifying Evaluation for Few-Shot NLP    Jonathan Bragg, Arman Cohan, Kyle Lo, Iz Beltagy arXiv_CL arXiv_CL  Zero-Shot  Few-Shot  Language_Model  PDF
• 2021-07-15 Solving ESL Sentence Completion Questions via Pre-trained Neural Language Models    Qiongqiong Liu, Tianqiao Liu, Jiafu Zhao, Qiang Fang, Wenbiao Ding, Zhongqin Wu, Feng Xia, Jiliang Tang, Zitao Liu arXiv_AI arXiv_AI  Pose  Language_Model  Prediction  PDF
• 2021-07-15 Multi-Task Learning based Online Dialogic Instruction Detection with Pre-trained Language Models    Yang Hao, Hang Li, Wenbiao Ding, Zhongqin Wu, Jiliang Tang, Rose Luckin, Zitao Liu arXiv_AI arXiv_AI  Pose  Detection  Language_Model  PDF
• 2021-07-14 HTLM: Hyper-Text Pre-Training and Prompting of Language Models    Armen Aghajanyan, Dmytro Okhonko, Mike Lewis, Mandar Joshi, Hu Xu, Gargi Ghosh, Luke Zettlemoyer arXiv_CL arXiv_CL  Zero-Shot  Classification  Denoising  Summarization  Language_Model  PDF
• 2021-07-14 From Show to Tell: A Survey on Image Captioning    Matteo Stefanini, Marcella Cornia, Lorenzo Baraldi, Silvia Cascianelli, Giuseppe Fiameni, Rita Cucchiara arXiv_CV arXiv_CV  Image_Caption  Bert  Pose  Survey  Quantitative  Relation  Text_Generation  Caption  Language_Model  PDF
• 2021-07-14 TGIF: Tree-Graph Integrated-Format Parser for Enhanced UD with Two-Stage Generic- to Individual-Language Finetuning    Tianze Shi, Lillian Lee arXiv_CL arXiv_CL  Segmentation  Language_Model  Prediction  PDF
• 2021-07-14 Large-Scale News Classification using BERT Language Model: Spark NLP Approach    Kuncahyo Setyo Nugroho, Kuncahyo Setyo Nugroho, Novanto Yudistira arXiv_CL arXiv_CL  Bert  Face  Classification  Deep_Learning  Language_Model  PDF
• 2021-07-14 A Note on Learning Rare Events in Molecular Dynamics using LSTM and Transformer    Wenqi Zeng, Siqin Cao, Xuhui Huang, Yuan Yao arXiv_AI arXiv_AI  Transformer  RNN  Action  Language_Model  PDF
• 2021-07-14 ZR-2021VG: Zero-Resource Speech Challenge, Visually-Grounded Language Modelling track, 2021 edition    Afra Alishahia, Grzegorz Chrupała, Alejandrina Cristia, Emmanuel Dupoux, Bertrand Higy, Marvin Lavechin, Okko Räsänen, Chen Yu arXiv_CL arXiv_CL  Speech  Language_Model  PDF
• 2021-07-14 Deduplicating Training Data Makes Language Models Better    Katherine Lee, Daphne Ippolito, Andrew Nystrom, Chiyuan Zhang, Douglas Eck, Chris Callison-Burch, Nicholas Carlini arXiv_CL arXiv_CL  Language_Model  PDF
• 2021-07-14 From Machine Translation to Code-Switching: Generating High-Quality Code-Switched Text    Ishan Tarunesh, Syamantak Kumar, Preethi Jyothi arXiv_CL arXiv_CL  Inference  Language_Model  PDF
• 2021-07-13 Using BERT Encoding to Tackle the Mad-lib Attack in SMS Spam Detection    Sergio Rojas-Galeano arXiv_CL arXiv_CL  Bert  Adversarial  Classification  Detection  Relation  Language_Model  PDF
• 2021-07-13 Exploiting Network Structures to Improve Semantic Representation for the Financial Domain    Chao Feng, Shi-jie We arXiv_CL arXiv_CL  Transformer  Embedding  Bert  Knowledge  Knowledge_Graph  Pose  Inference  Language_Model  PDF
• 2021-07-12 Tortured phrases: A dubious writing style emerging in science. Evidence of critical issues affecting established journals    Guillaume Cabanac, Cyril Labbé, Alexander Magazinov arXiv_CL arXiv_CL  Knowledge  Review  Detection  Object_Detection  Language_Model  PDF
• 2021-07-12 Uncertainty-based Query Strategies for Active Learning with Transformers    Christopher Schröder, Andreas Niekler, Martin Potthast arXiv_CL arXiv_CL  Transformer  Text_Classification  Classification  Language_Model  PDF
• 2021-07-12 Codified audio language modeling learns useful representations for music information retrieval    Rodrigo Castellon, Chris Donahue, Percy Liang arXiv_SD arXiv_SD  Recognition  Emotion  Classification  Detection  Language_Model  PDF
• 2021-07-12 DaCy: A Unified Framework for Danish NLP    Kenneth Enevoldsen, Lasse Hansen, Kristoffer Nielbo arXiv_CL arXiv_CL  Recognition  Speech  Emotion  Detection  Language_Model  PDF
• 2021-07-12 MidiBERT-Piano: Large-scale Pre-training for Symbolic Music Understanding    Yi-Hui Chou, I-Chun Chen, Chin-Jui Chang, Joann Ching, Yi-Hsuan Yang arXiv_SD arXiv_SD  Transformer  Bert  Pose  Emotion  Action  Classification  Attention  Language_Model  Prediction  PDF
• 2021-07-12 MOOCRep: A Unified Pre-trained Embedding of MOOC Entities    Shalini Pandey, Jaideep Srivastava arXiv_AI arXiv_AI  Transformer  Embedding  OCR  Represenation_Learning  Knowledge  Pose  Relation  Language_Model  Prediction  Recommendation  PDF
• 2021-07-11 Document Embedding for Scientific Articles: Efficacy of Word Embeddings vs TFIDF    H.J. Meijer, J. Truong, R. Karimi arXiv_AI arXiv_AI  Embedding  Pose  Language_Model  PDF
• 2021-07-10 Noise Stability Regularization for Improving BERT Fine-tuning    Hang Hua, Xingjian Li, Dejing Dou, Cheng-Zhong Xu, Jiebo Luo arXiv_CL arXiv_CL  Bert  Regularization  Pose  Language_Model  PDF
• 2021-07-09 Can Deep Neural Networks Predict Data Correlations from Column Names?    Immanuel Trummer arXiv_CL arXiv_CL  Transformer  Pose  Detection  Relation  Language_Model  Prediction  PDF
• 2021-07-09 Benchmarking for Biomedical Natural Language Processing Tasks with a Domain Specific ALBERT    Usman Naseem, Adam G. Dunn, Matloob Khushi, Jinman Kim arXiv_CL arXiv_CL  Transformer  Recognition  Bert  Action  Classification  Relation  Relation_Extraction  Medical  Language_Model  PDF
• 2021-07-08 Inspiration through Observation: Demonstrating the Influence of Automatically Generated Text on Creative Writing    Melissa Roemmele arXiv_AI arXiv_AI  Text_Generation  Language_Model  PDF
• 2021-07-07 LanguageRefer: Spatial-Language Model for 3D Visual Grounding    Junha Roh, Karthik Desingh, Ali Farhadi, Dieter Fox arXiv_CV arXiv_CV  Transformer  Embedding  Point_Cloud  3D  Bert  Pose  Language_Model  PDF
• 2021-07-07 KaFiStO: A Kalman Filtering Framework for Stochastic Optimization    Aram Davtyan, Sepehr Sameni, Llukman Cerkezi, Givi Meishvilli, Adam Bielski, Paolo Favaro arXiv_CV arXiv_CV  Gradient_Descent  Optimization  Pose  Language_Model  PDF
• 2021-07-07 Not Quite 'Ask a Librarian': AI on the Nature, Value, and Future of LIS    Jesse David Dinneen, Helen Bubinger arXiv_AI arXiv_AI  Knowledge  Sentiment  Attention  Language_Model  Prediction  PDF
• 2021-07-07 On Training Instance Selection for Few-Shot Neural Text Generation    Ernie Chang, Xiaoyu Shen, Hui-Syuan Yeh, Vera Demberg arXiv_CL arXiv_CL  Pose  Few-Shot  Attention  Summarization  Text_Generation  Language_Model  PDF
• 2021-07-07 Improving Speech Recognition Accuracy of Local POI Using Geographical Models    Songjun Cao, Yike Zhang, Xiaobing Feng, Long Ma arXiv_SD arXiv_SD  Recognition  Speech  Pose  Speech_Recognition  Language_Model  PDF
• 2021-07-07 Hierarchical Text Classification of Urdu News using Deep Neural Network    Taimoor Ahmed Javed, Waseem Shahzad, Umair Arshad arXiv_CL arXiv_CL  Embedding  Text_Classification  RNN  Pose  Classification  Deep_Learning  GAN  Language_Model  PDF
• 2021-07-07 Controlled Caption Generation for Images Through Adversarial Attacks    Nayyer Aafaq, Naveed Akhtar, Wei Liu, Mubarak Shah, Ajmal Mian arXiv_CV arXiv_CV  Image_Caption  RNN  Adversarial  Pose  Action  Classification  Deep_Learning  GAN  Caption  CNN  Language_Model  PDF
• 2021-07-06 VidLanKD: Improving Language Understanding via Video-Distilled Knowledge Transfer    Zineng Tang, Jaemin Cho, Hao Tan, Mohit Bansal arXiv_AI arXiv_AI  Image_Retrieval  Knowledge  Pose  Attention  Language_Model  Prediction  QA  PDF
• 2021-07-05 Long-Short Transformer: Efficient Transformers for Language and Vision    Chen Zhu, Wei Ping, Chaowei Xiao, Mohammad Shoeybi, Tom Goldstein, Anima Anandkumar, Bryan Catanzaro arXiv_CV arXiv_CV  Transformer  Pose  Classification  Relation  Attention  Language_Model  PDF
• 2021-07-05 ERNIE 3.0: Large-scale Knowledge Enhanced Pre-training for Language Understanding and Generation    Yu Sun, Shuohuan Wang, Shikun Feng, Siyu Ding, Chao Pang, Junyuan Shang, Jiaxiang Liu, Xuyi Chen, Yanbin Zhao, Yuxiang Lu, Weixin Liu, Zhihua Wu, Weibao Gong, Jianzhong Liang, Zhizhou Shang, Peng Sun, Wei Liu, Xuan Ouyang, Dianhai Yu, Hao Tian, Hua Wu, Haifeng Wang arXiv_CL arXiv_CL  Zero-Shot  Knowledge  Knowledge_Graph  Pose  Few-Shot  Language_Model  PDF
• 2021-07-05 DeepRapper: Neural Rap Generation with Rhyme and Rhythm Modeling    Lanqing Xue, Kaitao Song, Duocai Wu, Xu Tan, Nevin L. Zhang, Tao Qin, Wei-Qiang Zhang, Tie-Yan Liu arXiv_AI arXiv_AI  Transformer  Enhancement  Knowledge  Language_Model  PDF
• 2021-07-05 Doing Good or Doing Right? Exploring the Weakness of Commonsense Causal Reasoning Models    Mingyue Han, Yinglin Wang arXiv_CL arXiv_CL  Regularization  Language_Model  PDF
• 2021-07-04 End-to-end Neural Coreference Resolution Revisited: A Simple yet Effective Baseline    Tuan Manh Lai, Trung Bui, Doo Soon Kim arXiv_CL arXiv_CL  Transformer  Reinforcement_Learning  Pose  Inference  Language_Model  PDF
• 2021-07-04 Robust End-to-End Offline Chinese Handwriting Text Page Spotter with Text Kernel    Zhihao Wang, Yanwei Yu, Yibo Wang, Haixu Long, Fazheng Wang arXiv_CV arXiv_CV  Handwriting  Recognition  Pose  Detection  Language_Model  PDF
• 2021-07-02 Scarecrow: A Framework for Scrutinizing Machine Text    Yao Dou, Maxwell Forbes, Rik Koncel-Kedziorski, Noah A.Smith, Yejin Choi arXiv_CL arXiv_CL  Ontology  Text_Generation  Language_Model  PDF
• 2021-07-02 Relaxed Attention: A Simple Method to Boost Performance of End-to-End Automatic Speech Recognition    Timo Lohrenz, Patrick Schwarz, Zhengyang Li, Tim Fingscheidt arXiv_CL arXiv_CL  Transformer  Recognition  Speech  Attention  Speech_Recognition  Language_Model  PDF
• 2021-07-02 Language Identification of Hindi-English tweets using code-mixed BERT    Mohd Zeeshan Ansari, M M Sufyan Beg, Tanvir Ahmad, Mohd Jazib Khan, Ghazali Wasim arXiv_CL arXiv_CL  Embedding  Transfer_Learning  Bert  Knowledge  Classification  Language_Model  PDF
• 2021-07-02 R2D2: Recursive Transformer based on Differentiable Tree for Interpretable Hierarchical Language Modeling    Xiang Hu, Haitao Mi, Zujie Wen, Yafang Wang, Yi Su, Jing Zheng, Gerard de Melo arXiv_CL arXiv_CL  Transformer  Unsupervised  Pose  Action  Language_Model  PDF
• 2021-07-01 An Investigation of the effectiveness of Counterfactually Augmented Data    Nitish Joshi, He He arXiv_CL arXiv_CL  Relation  Language_Model  PDF
• 2021-07-01 A Primer on Pretrained Multilingual Language Models    Sumanth Doddapaneni, Gowtham Ramesh, Anoop Kunchukuttan, Pratyush Kumar, Mitesh M. Khapra arXiv_CL arXiv_CL  Transfer_Learning  Bert  Review  Survey  Language_Model  PDF
• 2021-07-01 CLIP-It! Language-Guided Video Summarization    Medhini Narasimhan, Anna Rohrbach, Trevor Darrell arXiv_AI arXiv_AI  Transformer  Unsupervised  Video_Caption  Salient  Pose  Relation  Summarization  Caption  Language_Model  PDF
• 2021-07-01 CLINE: Contrastive Learning with Semantic Negative Examples for Natural Language Understanding    Dong Wang, Ning Ding, Piji Li, Hai-Tao Zheng arXiv_AI arXiv_AI  Unsupervised  Adversarial  Pose  Contrastive_Learning  Sentiment  Language_Model  PDF
• 2021-07-01 Leveraging Domain Agnostic and Specific Knowledge for Acronym Disambiguation    Qiwei Zhong, Guanxiong Zeng, Danqing Zhu, Yang Zhang, Wangli Lin, Ben Chen, Jiayu Tang arXiv_AI arXiv_AI  Embedding  Bert  Knowledge  Pose  Deep_Learning  Language_Model  Prediction  PDF
• 2021-07-01 Word-Free Spoken Language Understanding for Mandarin-Chinese    Zhiyuan Guo, Yuexin Li, Guo Chen, Xingyu Chen, Akshat Gupta arXiv_CL arXiv_CL  Transformer  Recognition  Speech  Pose  Classification  Speech_Recognition  Language_Model  PDF
• 2021-07-01 Elbert: Fast Albert with Confidence-Window Based Early Exit    Keli Xie, Siyuan Lu, Meiqi Wang, Zhongfeng Wang arXiv_CL arXiv_CL  Bert  Pose  Inference  Language_Model  PDF
• 2021-07-01 Cross-Lingual Adaptation for Type Inference    Zhiming Li, Xiaofei Xie, Haoliang Li, Zhengzi Xu, Yi Li, Yang Liu arXiv_AI arXiv_AI  Knowledge  Pose  Deep_Learning  Attention  Summarization  Inference  Language_Model  PDF
• 2021-06-30 XLM-E: Cross-lingual Language Model Pre-training via ELECTRA    Zewen Chi, Shaohan Huang, Li Dong, Shuming Ma, Saksham Singhal, Payal Bajaj, Xia Song, Furu Wei arXiv_CL arXiv_CL  Detection  Language_Model  PDF
• 2021-06-30 ChineseBERT: Chinese Pretraining Enhanced by Glyph and Pinyin Information    Zijun Sun, Xiaoya Li, Xiaofei Sun, Yuxian Meng, Xiang Ao, Qing He, Fei Wu, Jiwei Li arXiv_CL arXiv_CL  Embedding  Recognition  Bert  Text_Classification  Pose  Classification  Inference  Language_Model  Matching  PDF
• 2021-06-29 Time-Aware Language Models as Temporal Knowledge Bases    Bhuwan Dhingra, Jeremy R. Cole, Julian Martin Eisenschlos, Daniel Gillick, Jacob Eisenstein, William W. Cohen arXiv_CL arXiv_CL  Knowledge  Pose  Language_Model  Prediction  PDF
• 2021-06-29 A Simple and Efficient Probabilistic Language model for Code-Mixed Text    M Zeeshan Ansari, Tanvir Ahmad, M M Sufyan Beg, Asma Ikram arXiv_CL arXiv_CL  Embedding  Recognition  RNN  Action  Classification  Relation  Relation_Extraction  Language_Model  PDF
• 2021-06-28 What's in a Measurement? Using GPT-3 on SemEval 2021 Task 8 -- MeasEval    Curt Kohler, Ron Daniel Jr arXiv_CL arXiv_CL  Few-Shot  Language_Model  PDF
• 2021-06-28 A Knowledge-Grounded Dialog System Based on Pre-Trained Language Models    Weijie Zhang, Jiaoxuan Chen, Haipang Wu, Sanhui Wan, Gongfeng Li arXiv_CL arXiv_CL  Transformer  Transfer_Learning  Knowledge  Language_Model  Matching  PDF
• 2021-06-27 SymbolicGPT: A Generative Transformer Model for Symbolic Regression    Mojtaba Valipour, Bowen You, Maysum Panju, Ali Ghodsi arXiv_CL arXiv_CL  Transformer  Deep_Learning  Language_Model  PDF
• 2021-06-27 Visual Conceptual Blending with Large-scale Language and Vision Models    Songwei Ge, Devi Parikh arXiv_AI arXiv_AI  Quantitative  Language_Model  PDF
• 2021-06-26 Benchmarking Differential Privacy and Federated Learning for BERT Models    Priyam Basu, Tiasa Singha Roy, Rakshit Naidu, Zumrut Muftuoglu, Sahib Singh, Fatemehsadat Mireshghallah arXiv_CL arXiv_CL  Bert  Emotion  Medical  Language_Model  PDF
• 2021-06-26 Toward Less Hidden Cost of Code Completion with Acceptance and Ranking Models    Jingxuan Li, Rui Huang, Wei Li, Kai Yao, Weiguo Tan arXiv_AI arXiv_AI  Pose  Language_Model  PDF
• 2021-06-25 Multimodal Few-Shot Learning with Frozen Language Models    Maria Tsimpoukelli, Jacob Menick, Serkan Cabi, S.M. Ali Eslami, Oriol Vinyals, Felix Hill arXiv_CV arXiv_CV  Embedding  Knowledge  VQA  Few-Shot  Caption  Language_Model  PDF
• 2021-06-25 Efficient Document Image Classification Using Region-Based Graph Neural Network    Jaya Krishna Mandivarapu, Eric Bunch, Qian You, Glenn Fung arXiv_CV arXiv_CV  Pose  Classification  CNN  Image_Classification  Inference  Language_Model  PDF
• 2021-06-25 Learning to Sample Replacements for ELECTRA Pre-Training    Yaru Hao, Li Dong, Hangbo Bao, Ke Xu, Furu Wei arXiv_CL arXiv_CL  Pose  Language_Model  Prediction  PDF
• 2021-06-25 Language Models are Good Translators    Shuo Wang, Zhaopeng Tu, Zhixing Tan, Wenxuan Wang, Maosong Sun, Yang Liu arXiv_CL arXiv_CL  Zero-Shot  Knowledge  NMT  Language_Model  PDF
• 2021-06-25 Adapt-and-Distill: Developing Small, Fast and Effective Pretrained Language Models for Domains    Yunzhi Yao, Shaohan Huang, Wenhui Wang, Li Dong, Furu Wei arXiv_CL arXiv_CL  Bert  Knowledge  Pose  Medical  Language_Model  PDF
• 2021-06-25 A Picture May Be Worth a Hundred Words for Visual Question Answering    Yusuke Hirota, Noa Garcia, Mayu Otani, Chenhui Chu, Yuta Nakashima, Ittetsu Taniguchi, Takao Onoye arXiv_CV arXiv_CV  Image_Caption  Transformer  Pose  VQA  Language_Model  QA  PDF
• 2021-06-24 Cutting Down on Prompts and Parameters: Simple Few-Shot Learning with Language Models    Robert L. Logan IV, Ivana Balažević, Eric Wallace, Fabio Petroni, Sameer Singh, Sebastian Riedel arXiv_CL arXiv_CL  Few-Shot  Language_Model  PDF
• 2021-06-24 Towards Understanding and Mitigating Social Biases in Language Models    Paul Pu Liang, Chiyu Wu, Louis-Philippe Morency, Ruslan Salakhutdinov arXiv_AI arXiv_AI  Pose  Text_Generation  Language_Model  PDF
• 2021-06-24 QASR: QCRI Aljazeera Speech Resource -- A Large Scale Annotated Arabic Speech Corpus    Hamdy Mubarak, Amir Hussein, Shammur Absar Chowdhury, Ahmed Ali arXiv_CL arXiv_CL  Segmentation  Recognition  Restoration  Speech  Speech_Recognition  Language_Model  QA  PDF
• 2021-06-24 Winner Team Mia at TextVQA Challenge 2021: Vision-and-Language Representation Learning with Pre-trained Sequence-to-Sequence Model    Yixuan Qiao, Hao Chen, Jun Wang, Yihao Chen, Xianbin Ye, Ziliang Li, Xianbiao Qi, Peng Gao, Guotong Xie arXiv_CV arXiv_CV  Represenation_Learning  Scene_Text  Face  VQA  Language_Model  Prediction  QA  PDF
• 2021-06-23 Clinical Named Entity Recognition using Contextualized Token Representations    Yichao Zhou, Chelsea Ju, J. Harry Caufield, Kevin Shih, Calvin Chen, Yizhou Sun, Kai-Wei Chang, Peipei Ping, Wei Wang arXiv_CL arXiv_CL  Embedding  Recognition  Action  Language_Model  PDF
• 2021-06-23 Classifying Textual Data with Pre-trained Vision Models through Transfer Learning and Data Transformations    Charaf Eddine Benarab arXiv_AI arXiv_AI  Embedding  Transfer_Learning  Bert  Knowledge  Pose  Sentiment  Language_Model  PDF
• 2021-06-23 Mixtures of Deep Neural Experts for Automated Speech Scoring    Sara Papi, Edmondo Trentin, Roberto Gretter, Marco Matassoni, Daniele Falavigna arXiv_CL arXiv_CL  Embedding  Recognition  Speech  Action  Speech_Recognition  Language_Model  PDF
• 2021-06-23 PALRACE: Reading Comprehension Dataset with Human Data and Labeled Rationales    Jiajie Zou, Yuran Zhang, Peiqing Jin, Cheng Luo, Xunyi Pan, Nai Ding arXiv_AI arXiv_AI  Language_Model  PDF
• 2021-06-23 CharacterChat: Supporting the Creation of Fictional Characters through Conversation and Progressive Manifestation with a Chatbot    Oliver Schmitt, Daniel Buschek arXiv_CL arXiv_CL  Survey  Language_Model  QA  PDF
• 2021-06-22 Structured in Space, Randomized in Time: Leveraging Dropout in RNNs for Efficient Training    Anup Sarma, Sonali Singh, Huaipan Jiang, Rui Zhang, Mahmut T Kandemir, Chita R Das arXiv_CL arXiv_CL  Recognition  RNN  Regularization  Speech  Pose  NMT  Deep_Learning  Inference  Language_Model  PDF
• 2021-06-22 End-to-End Task-Oriented Dialog Modeling with Semi-Structured Knowledge Management    Silin Gao, Ryuichi Takanobu, Minlie Huang arXiv_CL arXiv_CL  Knowledge  Review  Pose  Language_Model  PDF
• 2021-06-22 LV-BERT: Exploiting Layer Variety for BERT    Weihao Yu, Zihang Jiang, Fei Chen, Qibin Hou, Jiashi Feng arXiv_AI arXiv_AI  Bert  Attention  Language_Model  PDF
• 2021-06-22 Information Retrieval for ZeroSpeech 2021: The Submission by University of Wroclaw    Jan Chorowski, Grzegorz Ciesielski, Jarosław Dzikowski, Adrian Łańcucki, Ricard Marxer, Mateusz Opala, Piotr Pusz, Paweł Rychlikowski, Michał Stypułkowski arXiv_SD arXiv_SD  Unsupervised  Speech  Pose  GAN  Language_Model  Matching  PDF
• 2021-06-22 Do Language Models Perform Generalizable Commonsense Inference?    Peifeng Wang, Filip Ilievski, Muhao Chen, Xiang Ren arXiv_AI arXiv_AI  Knowledge  Knowledge_Graph  Relation  Inference  Language_Model  PDF
• 2021-06-22 A Comprehensive Exploration of Pre-training Language Models    Tong Guo arXiv_CL arXiv_CL  Transformer  Bert  RNN  Language_Model  PDF
• 2021-06-21 Membership Inference on Word Embedding and Beyond    Saeed Mahloujifar, Huseyin A. Inan, Melissa Chase, Esha Ghosh, Marcello Hasegawa arXiv_AI arXiv_AI  Embedding  RNN  Knowledge  Pose  Classification  Inference  Language_Model  PDF
• 2021-06-21 A Discriminative Entity-Aware Language Model for Virtual Assistants    Mandana Saebi, Ernest Pusateri, Aaksha Meghawat, Christophe Van Gysel arXiv_CL arXiv_CL  Recognition  Knowledge  Knowledge_Graph  Speech  Relation  Speech_Recognition  Language_Model  PDF
• 2021-06-21 CLIP2Video: Mastering Video-Text Retrieval via Image CLIP    Han Fang, Pengfei Xiong, Luhui Xu, Yu Chen arXiv_CV arXiv_CV  Action  Relation  Language_Model  PDF
• 2021-06-21 Ad Text Classification with Transformer-Based Natural Language Processing Methods    Umut Özdil, Büşra Arslan, D. Emre Taşar, Gökçe Polat, Şükrü Ozan arXiv_CL arXiv_CL  Transformer  Bert  Text_Classification  Pose  Classification  Language_Model  PDF
• 2021-06-20 CPM-2: Large-scale Cost-effective Pre-trained Language Models    Zhengyan Zhang, Yuxian Gu, Xu Han, Shengqi Chen, Chaojun Xiao, Zhenbo Sun, Yuan Yao, Fanchao Qi, Jian Guan, Pei Ke, Yanzheng Cai, Guoyang Zeng, Zhixing Tan, Zhiyuan Liu, Minlie Huang, Wentao Han, Yang Liu, Xiaoyan Zhu, Maosong Sun arXiv_CL arXiv_CL  Knowledge  Inference  Language_Model  PDF
• 2021-06-20 A Brief Study on the Effects of Training Generative Dialogue Models with a Semantic loss    Prasanna Parthasarathi, Mohamed Abdelsalam, Joelle Pineau, Sarath Chandar arXiv_CL arXiv_CL  Embedding  Language_Model  PDF
• 2021-06-18 Process for Adapting Language Models to Society with Values-Targeted Datasets    Irene Solaiman (1), Christy Dennison (1) ((1) OpenAI) arXiv_CL arXiv_CL  Pose  Quantitative  Language_Model  PDF
• 2021-06-18 World-GAN: a Generative Model for Minecraft Worlds    Maren Awiszus, Frederik Schubert, Bodo Rosenhahn arXiv_CV arXiv_CV  3D  Adversarial  Pose  GAN  Language_Model  PDF
• 2021-06-18 Label Mask for Multi-Label Text Classification    Rui Song, Xingbing Chen, Zelong Liu, Haining An, Zhiqi Zhang, Xiaoguang Wang, Hao Xu arXiv_AI arXiv_AI  Text_Classification  Pose  Classification  Relation  Language_Model  PDF
• 2021-06-18 SPBERT: Pre-training BERT on SPARQL Queries for End-to-end Question Answering over Knowledge Graphs    Hieu Tran, Long Phan, Truong-Son Nguyen arXiv_CL arXiv_CL  Transformer  Bert  Knowledge  Knowledge_Graph  Pose  Language_Model  QA  PDF
• 2021-06-18 An Improved Single Step Non-autoregressive Transformer for Automatic Speech Recognition    Ruchao Fan, Wei Chu, Peng Chang, Jing Xiao, Abeer Alwan arXiv_AI arXiv_AI  Transformer  Embedding  Recognition  Speech  Pose  Relation  Attention  Speech_Recognition  Inference  Language_Model  PDF
• 2021-06-17 Scientific Language Models for Biomedical Knowledge Base Completion: An Empirical Study    Rahul Nadkarni, David Wadden, Iz Beltagy, Noah A. Smith, Hannaneh Hajishirzi, Tom Hope arXiv_CL arXiv_CL  Embedding  Knowledge  Knowledge_Graph  Medical  Language_Model  Prediction  PDF
• 2021-06-17 LoRA: Low-Rank Adaptation of Large Language Models    Edward J. Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu, Yuanzhi Li, Shean Wang, Weizhu Chen arXiv_AI arXiv_AI  Transformer  Pose  Inference  Language_Model  PDF
• 2021-06-17 Classifying vaccine sentiment tweets by modelling domain-specific representation and commonsense knowledge into context-aware attentive GRU    Usman Naseem, Matloob Khushi, Jinman Kim, Adam G. Dunn arXiv_CL arXiv_CL  Knowledge  Pose  Sentiment  Attention  Language_Model  PDF
• 2021-06-17 Do Large Scale Molecular Language Representations Capture Important Structural Information?    Jerret Ross, Brian Belgodere, Vijil Chenthamarakshan, Inkit Padhi, Youssef Mroueh, Payel Das arXiv_CL arXiv_CL  Transformer  Embedding  Pose  Attention  Language_Model  Prediction  PDF
• 2021-06-17 Biomedical Interpretable Entity Representations    Diego Garcia-Olano, Yasumasa Onoe, Ioana Baldini, Joydeep Ghosh, Byron C. Wallace, Kush R. Varshney arXiv_CL arXiv_CL  Sparse  Represenation_Learning  Pose  Ontology  Classification  Medical  Language_Model  PDF
• 2021-06-17 Knowledgeable or Educated Guess? Revisiting Language Models as Knowledge Bases    Boxi Cao, Hongyu Lin, Xianpei Han, Le Sun, Lingyong Yan, Meng Liao, Tong Xue, Jin Xu arXiv_AI arXiv_AI  Bert  Knowledge  Action  Language_Model  Prediction  PDF
• 2021-06-17 An Empirical Study on Hyperparameter Optimization for Fine-Tuning Pre-trained Language Models    Xueqing Liu, Chi Wang arXiv_CL arXiv_CL  Optimization  Pose  Language_Model  PDF
• 2021-06-16 Specializing Multilingual Language Models: An Empirical Study    Ethan C. Chau, Noah A. Smith arXiv_CL arXiv_CL  Action  Language_Model  PDF
• 2021-06-16 On the long-term learning ability of LSTM LMs    Wim Boes, Robbe Van Rompaey, Lyan Verwimp, Joris Pelemans, Hugo Van hamme, Patrick Wambacq arXiv_CL arXiv_CL  RNN  Speech  Language_Model  PDF
• 2021-06-16 Algorithm to Compilation Codesign: An Integrated View of Neural Network Sparsity    Fu-Ming Guo, Austin Huang arXiv_AI arXiv_AI  Transformer  Bert  Optimization  Sparse  Regularization  Relation  Attention  Inference  Language_Model  PDF
• 2021-06-16 SEOVER: Sentence-level Emotion Orientation Vector based Conversation Emotion Recognition Model    Zaijing Li, Fengxiao Tang, Tieyu Sun, Yusen Zhu, Ming Zhao arXiv_AI arXiv_AI  Recognition  Pose  Emotion  Relation  Sentiment  Language_Model  PDF
• 2021-06-16 Alzheimer's Disease Detection from Spontaneous Speech through Combining Linguistic Complexity and Fluency Features with Pretrained Language Models    Yu Qiao, Xuefeng Yin, Daniel Wiechmann, Elma Kerz arXiv_CL arXiv_CL  Recognition  Speech  Detection  Language_Model  PDF
• 2021-06-16 Evaluating Gender Bias in Hindi-English Machine Translation    Gauri Gupta, Krithika Ramesh, Sanjay Singh arXiv_AI arXiv_AI  Embedding  Sparse  Pose  Language_Model  PDF
• 2021-06-16 Discrete Auto-regressive Variational Attention Models for Text Modeling    Xianghong Fang, Haoli Bai, Jian Li, Zenglin Xu, Michael Lyu, Irwin King arXiv_CL arXiv_CL  Optimization  RNN  Pose  Attention  Language_Model  PDF
• 2021-06-15 ASR Adaptation for E-commerce Chatbots using Cross-Utterance Context and Multi-Task Language Modeling    Ashish Shenoy, Sravan Bodapati, Katrin Kirchhoff arXiv_CL arXiv_CL  Transformer  Embedding  Recognition  RNN  Speech  Pose  Action  Detection  Speech_Recognition  Language_Model  QA  PDF
• 2021-06-15 Scene Transformer: A unified multi-task model for behavior prediction and planning    Jiquan Ngiam, Benjamin Caine, Vijay Vasudevan, Zhengdong Zhang, Hao-Tien Lewis Chiang, Jeffrey Ling, Rebecca Roelofs, Alex Bewley, Chenxi Liu, Ashish Venugopal, David Weiss, Ben Sapp, Zhifeng Chen, Jonathon Shlens arXiv_CV arXiv_CV  Transformer  Action  Attention  Autonomous  Language_Model  Prediction  PDF
• 2021-06-15 What Context Features Can Transformer Language Models Use?    Joe O'Connor, Jacob Andreas arXiv_CL arXiv_CL  Transformer  Language_Model  Prediction  PDF
• 2021-06-15 PairConnect: A Compute-Efficient MLP Alternative to Attention    Zhaozhuo Xu, Minghao Yan, Junyan Zhang, Anshumali Shrivastava arXiv_CL arXiv_CL  Transformer  Embedding  Action  Attention  Inference  Language_Model  PDF
• 2021-06-15 Consistency Regularization for Cross-Lingual Fine-Tuning    Bo Zheng, Li Dong, Shaohan Huang, Wenhui Wang, Zewen Chi, Saksham Singhal, Wanxiang Che, Ting Liu, Xia Song, Furu Wei arXiv_CL arXiv_CL  Text_Classification  Regularization  Pose  Classification  Language_Model  Prediction  PDF
• 2021-06-15 Direction is what you need: Improving Word Embedding Compression in Large Language Models    Klaudia Bałazy, Mohammadreza Banaei, Rémi Lebret, Jacek Tabor, Karl Aberer arXiv_CL arXiv_CL  Transformer  Embedding  Pose  Inference  Language_Model  PDF
• 2021-06-15 Dialectal Speech Recognition and Translation of Swiss German Speech to Standard German Text: Microsoft's Submission to SwissText 2021    Yuriy Arabskyy, Aashish Agarwal, Subhadeep Dey, Oscar Koller arXiv_CL arXiv_CL  Recognition  Speech  Pose  Speech_Recognition  Language_Model  PDF
• 2021-06-15 Incorporating Word Sense Disambiguation in Neural Language Models    Jan Philip Wahle, Terry Ruas, Norman Meuschke, Bela Gipp arXiv_AI arXiv_AI  Bert  Language_Model  PDF
• 2021-06-15 Deriving Word Vectors from Contextualized Language Models using Topic-Aware Mention Selection    Yixiao Wang, Zied Bouraoui, Luis Espinosa Anke, Steven Schockaert arXiv_CL arXiv_CL  Embedding  Pose  Language_Model  PDF
• 2021-06-15 Bilateral Personalized Dialogue Generation with Dynamic Persona-Aware Fusion    Bin Li, Bin Sun (Member, IEEE), Shutao Li (Fellow, IEEE) arXiv_AI arXiv_AI  Transfer_Learning  Pose  Action  Language_Model  Prediction  PDF
• 2021-06-14 Overcoming Domain Mismatch in Low Resource Sequence-to-Sequence ASR Models using Hybrid Generated Pseudotranscripts    Chak-Fai Li, Francis Keith, William Hartmann, Matthew Snover, Owen Kimball arXiv_CL arXiv_CL  Recognition  Speech  Speech_Recognition  Language_Model  PDF
• 2021-06-14 Text Generation with Efficient Q-Learning    Han Guo, Bowen Tan, Zhengzhong Liu, Eric P. Xing, Zhiting Hu arXiv_CL arXiv_CL  Reinforcement_Learning  Sparse  Adversarial  Text_Generation  Language_Model  PDF
• 2021-06-14 HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Units    Wei-Ning Hsu, Benjamin Bolte, Yao-Hung Hubert Tsai, Kushal Lakhotia, Ruslan Salakhutdinov, Abdelrahman Mohamed arXiv_AI arXiv_AI  Segmentation  Unsupervised  Bert  Represenation_Learning  Speech  Self-Supervised  Pose  Language_Model  Prediction  PDF
• 2021-06-14 Probing Pre-Trained Language Models for Disease Knowledge    Israa Alghanmi, Luis Espinosa-Anke, Steven Schockaert arXiv_AI arXiv_AI  Bert  Knowledge  Adversarial  Pose  Classification  Medical  Inference  Language_Model  PDF
• 2021-06-14 Is Einstein more agreeable and less neurotic than Hitler? A computational exploration of the emotional and personality profiles of historical persons    Arthur M. Jacobs, Annette Kinder arXiv_AI arXiv_AI  Bert  Emotion  Language_Model  PDF
• 2021-06-14 Differentiable Neural Architecture Search with Morphism-based Transformable Backbone Architectures    Renlong Jie, Junbin Gao arXiv_AI arXiv_AI  NAS  RNN  Pose  Language_Model  PDF
• 2021-06-14 Straight to the Gradient: Learning to Use Novel Tokens for Neural Text Generation    Xiang Lin, Simeng Han, Shafiq Joty arXiv_CL arXiv_CL  Text_Generation  Language_Model  PDF
• 2021-06-14 Automatic Document Sketching: Generating Drafts from Analogous Texts    Zeqiu Wu, Michel Galley, Chris Brockett, Yizhe Zhang, Bill Dolan arXiv_CL arXiv_CL  Transformer  Reinforcement_Learning  Weakly_Supervised  Sketch  Review  Text_Generation  Language_Model  Prediction  PDF
• 2021-06-14 SAS: Self-Augmented Strategy for Language Model Pre-training    Yifei Xu, Jingqiao Zhang, Ru He, Liangzhu Ge, Chao Yang, Cheng Yang, Ying Nian Wu arXiv_AI arXiv_AI  Bert  Self-Supervised  Pose  Attention  Language_Model  PDF
• 2021-06-14 GPT3-to-plan: Extracting plans from text using GPT-3    Alberto Olmo, Sarath Sreedharan, Subbarao Kambhampati arXiv_AI arXiv_AI  Action  Language_Model  PDF
• 2021-06-13 Common Sense Beyond English: Evaluating and Improving Multilingual Language Models for Commonsense Reasoning    Bill Yuchen Lin, Seyeon Lee, Xiaoyang Qiao, Xiang Ren arXiv_AI arXiv_AI  Pose  Language_Model  QA  PDF
• 2021-06-13 Cross-sentence Neural Language Models for Conversational Speech Recognition    Shih-Hsuan Chiu, Tien-Hong Lo, Berlin Chen arXiv_CL arXiv_CL  Unsupervised  Recognition  RNN  Speech  Speech_Recognition  Language_Model  Prediction  PDF
• 2021-06-13 Memory-efficient Transformers via Top-$k$ Attention    Ankit Gupta, Guy Dar, Shaya Goodman, David Ciprut, Jonathan Berant arXiv_CL arXiv_CL  Transformer  Zero-Shot  Pose  Attention  Inference  Language_Model  QA  PDF
• 2021-06-12 Can Transformer Language Models Predict Psychometric Properties?    Antonio Laverghetta Jr., Animesh Nighojkar, Jamshidbek Mirzakhalov, John Licato arXiv_CL arXiv_CL  Transformer  Language_Model  Prediction  PDF
• 2021-06-12 Prompting Contrastive Explanations for Commonsense Reasoning Tasks    Bhargavi Paranjape, Julian Michael, Marjan Ghazvininejad, Luke Zettlemoyer, Hannaneh Hajishirzi arXiv_AI arXiv_AI  Knowledge  Language_Model  PDF
• 2021-06-12 Predicting the Ordering of Characters in Japanese Historical Documents    Alex Lamb, Tarin Clanuwat, Siyu Han, Mikel Bober-Irizar, Asanobu Kitamoto arXiv_CL arXiv_CL  Embedding  Recognition  Quantitative  Language_Model  PDF
• 2021-06-12 A Sentence-level Hierarchical BERT Model for Document Classification with Limited Labelled Data    Jinghui Lu, Maeve Henchion, Ivan Bacher, Brian Mac Namee arXiv_CL arXiv_CL  Bert  Salient  Classification  Deep_Learning  Language_Model  PDF
• 2021-06-12 Incorporating External POS Tagger for Punctuation Restoration    Ning Shi, Wei Wang, Boxin Wang, Jinfeng Li, Xiangyu Liu, Zhouhan Lin arXiv_CL arXiv_CL  Recognition  Restoration  Speech  Pose  Speech_Recognition  Language_Model  PDF
• 2021-06-12 Scalable Approach for Normalizing E-commerce Text Attributes    Ravi Shankar Mishra, Kartik Mehta, Nikhil Rasiwasia arXiv_CL arXiv_CL  Embedding  Unsupervised  Self-Supervised  Pose  Face  Language_Model  Matching  PDF
• 2021-06-12 Explaining the Deep Natural Language Processing by Mining Textual Interpretable Features    Francesco Ventura, Salvatore Greco, Daniele Apiletti, Tania Cerquitelli arXiv_AI arXiv_AI  Bert  RNN  Knowledge  Pose  Classification  Relation  Sentiment  Language_Model  Prediction  PDF
• 2021-06-11 Leveraging Pre-trained Language Model for Speech Sentiment Analysis    Suwon Shon, Pablo Brusco, Jing Pan, Kyu J. Han, Shinji Watanabe arXiv_CL arXiv_CL  Recognition  Speech  Pose  Sentiment  Speech_Recognition  Language_Model  PDF
• 2021-06-11 Improving Pretrained Cross-Lingual Language Models via Self-Labeled Word Alignment    Zewen Chi, Li Dong, Bo Zheng, Shaohan Huang, Xian-Ling Mao, Heyan Huang, Furu Wei arXiv_CL arXiv_CL  Denoising  Language_Model  Prediction  PDF
• 2021-06-11 Dynamic Language Models for Continuously Evolving Content    Spurthi Amba Hombaiah, Tao Chen, Mingyang Zhang, Michael Bendersky, Marc Najork arXiv_CL arXiv_CL  Bert  Pose  Language_Model  Prediction  PDF
• 2021-06-11 RefBERT: Compressing BERT by Referencing to Pre-computed Representations    Xinyi Wang, Haiqin Yang, Liang Zhao, Yang Mo, Jianping Shen arXiv_CL arXiv_CL  Bert  Knowledge  Pose  Inference  Language_Model  PDF
• 2021-06-10 Causal Analysis of Syntactic Agreement Mechanisms in Neural Language Models    Matthew Finlayson, Aaron Mueller, Stuart Shieber, Sebastian Gehrmann, Tal Linzen, Yonatan Belinkov arXiv_CL arXiv_CL  Language_Model  PDF
• 2021-06-10 KARI: KAnari/QCRI's End-to-End systems for the INTERSPEECH 2021 Indian Languages Code-Switching Challenge    Amir Hussein, Shammur Chowdhury, Ahmed Ali arXiv_CL arXiv_CL  Transformer  Transfer_Learning  Recognition  Speech  Speech_Recognition  Language_Model  PDF
• 2021-06-10 GroupBERT: Enhanced Transformer Architecture with Efficient Grouped Structures    Ivan Chelombiev, Daniel Justus, Douglas Orr, Anastasia Dietrich, Frithjof Gressmann, Alexandros Koliousis, Carlo Luschi arXiv_CL