Language_Model

2022-01-21 A Comparative Study on Language Models for Task-Oriented Dialogue Systems Vinsen Marselino Andreas, Genta Indra Winata, Ayu Purwarianti arXiv_CL arXiv_CL Tracking Knowledge Language_Model PDF
2022-01-21 Context-Tuning: Learning Contextualized Prompts for Natural Language Generation Tianyi Tang, Junyi Li, Wayne Xin Zhao arXiv_CL arXiv_CL Embedding Knowledge Pose Language_Model PDF
2022-01-21 Text Style Transfer for Bias Mitigation using Masked Language Modeling Ewoenam Kwaku Tokpo, Toon Calders arXiv_CL arXiv_CL Style_Transfer Salient Language_Model QA PDF
2022-01-21 Identifying Adversarial Attacks on Text Classifiers Zhouhang Xie, Jonathan Brophy, Adam Noack, Wencong You, Kalyani Asthana, Carter Perkins, Sabrina Reis, Sameer Singh, Daniel Lowd arXiv_CL arXiv_CL Adversarial Detection Sentiment Language_Model PDF
2022-01-21 Can Model Compression Improve NLP Fairness Guangxuan Xu, Qingyuan Hu arXiv_CL arXiv_CL Regularization Knowledge Attention Language_Model PDF
2022-01-21 Black-box Prompt Learning for Pre-trained Language Models Shizhe Diao, Xuechun Li, Yong Lin, Zhichao Huang, Tong Zhang arXiv_CL arXiv_CL Text_Classification Knowledge Pose Classification Attention Language_Model PDF
2022-01-20 LaMDA: Language Models for Dialog Applications Romal Thoppilan, Daniel De Freitas, Jamie Hall, Noam Shazeer, Apoorv Kulshreshtha, Heng-Tze Cheng, Alicia Jin, Taylor Bos, Leslie Baker, Yu Du, YaGuang Li, Hongrae Lee, Huaixiu Steven Zheng, Amin Ghafouri, Marcelo Menegali, Yanping Huang, Maxim Krikun, Dmitry Lepikhin, James Qin, Dehao Chen, Yuanzhong Xu, Zhifeng Chen, Adam Roberts, Maarten Bosma, Yanqi Zhou, Chung-Ching Chang, Igor Krivokon, Will Rusch, Marc Pickett, Kathleen Meier-Hellstern, Meredith Ringel Morris, Tulsee Doshi, Renelito Delos Santos, Toju Duke, Johnny Soraker, Ben Zevenbergen, Vinodkumar Prabhakaran, Mark Diaz, Ben Hutchinson, Kristen Olson, Alejandra Molina, Erin Hoffman-John, Josh Lee, Lora Aroyo, Ravi Rajakumar, Alena Butryna, Matthew Lamm, Viktoriya Kuzmina, Joe Fenton, Aaron Cohen, Rachel Bernstein, Ray Kurzweil, et al. (5 additional authors not shown) arXiv_AI arXiv_AI Transformer Knowledge Language_Model Recommendation PDF
2022-01-20 LEMON: Language-Based Environment Manipulation via Execution-Guided Pre-training Qi Shi, Qian Liu, Bei Chen, Yu Zhang, Ting Liu, Jian-Guang Lou arXiv_CL arXiv_CL Knowledge Pose Language_Model PDF
2022-01-20 AstBERT: Enabling Language Model for Code Understanding with Abstract Syntax Tree Rong Liang, Yujie Lu, Zhen Huang, Tiehua Zhang, Yuze Liu arXiv_AI arXiv_AI Bert Knowledge Pose Action Attention Language_Model PDF
2022-01-19 Evaluating Machine Common Sense via Cloze Testing Ehsan Qasemi, Lee Kezar, Jay Pujara, Pedro Szekely arXiv_CL arXiv_CL Embedding Knowledge Pose Language_Model PDF
2022-01-19 Uncovering More Shallow Heuristics: Probing the Natural Language Inference Capacities of Transformer-Based Pre-Trained Language Models Using Syllogistic Patterns Reto Gubelmann, Siegfried Handschuh arXiv_CL arXiv_CL Transformer Inference Language_Model PDF
2022-01-19 CM3: A Causal Masked Multimodal Model of the Internet Armen Aghajanyan, Bernie Huang, Candace Ross, Vladimir Karpukhin, Hu Xu, Naman Goyal, Dmytro Okhonko, Mandar Joshi, Gargi Ghosh, Mike Lewis, Luke Zettlemoyer arXiv_CL arXiv_CL Zero-Shot GAN Summarization Caption Language_Model PDF
2022-01-19 TourBERT: A pretrained language model for the tourism industry Veronika Arefieva, Roman Egger arXiv_CL arXiv_CL Transformer Bert Language_Model PDF
2022-01-19 GAP-Gen: Guided Automatic Python Code Generation Junchen Zhao, Yurun Song, Junlin Wang, Ian G. Harris arXiv_CL arXiv_CL Transformer Pose Language_Model PDF
2022-01-19 Interpreting Arabic Transformer Models Ahmed Abdelali, Nadir Durrani, Fahim Dalvi, Hassan Sajjad arXiv_CL arXiv_CL Transformer Embedding Knowledge Face Language_Model PDF
2022-01-19 Neural Language Models are Effective Plagiarists Stella Biderman, Edward Raff arXiv_CL arXiv_CL Transformer Detection Language_Model PDF
2022-01-18 Language Models as Zero-Shot Planners: Extracting Actionable Knowledge for Embodied Agents Wenlong Huang, Pieter Abbeel, Deepak Pathak, Igor Mordatch arXiv_AI arXiv_AI Zero-Shot Knowledge Pose Action Language_Model PDF
2022-01-18 Instance-aware Prompt Learning for Language Understanding and Generation Feihu Jin, Jinliang Lu, Jiajun Zhang, Chengqing Zong arXiv_CL arXiv_CL Pose Few-Shot Language_Model PDF
2022-01-18 CoAuthor: Designing a Human-AI Collaborative Writing Dataset for Exploring Language Model Capabilities Mina Lee, Percy Liang, Qian Yang arXiv_CL arXiv_CL Face Action Relation Language_Model PDF
2022-01-18 Label Dependent Attention Model for Disease Risk Prediction Using Multimodal Electronic Health Records Shuai Niu, Qing Yin, Yunya Song, Yike Guo, Xian Yang arXiv_AI arXiv_AI Embedding Bert Pose Quantitative Attention Medical Language_Model Prediction PDF
2022-01-17 Towards a Cleaner Document-Oriented Multilingual Crawled Corpus Julien Abadji, Pedro Ortiz Suarez, Laurent Romary, Benoît Sagot arXiv_CL arXiv_CL Transfer_Learning Pose Language_Model PDF
2022-01-17 Handling Compounding in Mobile Keyboard Input Andreas Kabel, Keith Hall, Tom Ouyang, David Rybach, Daan van Esch, Françoise Beaufays arXiv_CL arXiv_CL Pose Language_Model Prediction PDF
2022-01-17 Language Model-Based Paired Variational Autoencoders for Robotic Language Learning Ozan Özdemir, Matthias Kerzel, Cornelius Weber, Jae Hee Lee, Stefan Wermter arXiv_RO arXiv_RO Transformer Recognition Bert Action Language_Model PDF
2022-01-17 The CLEAR Benchmark: Continual LEArning on Real-World Imagery Zhiqiu Lin, Jia Shi, Deepak Pathak, Deva Ramanan arXiv_AI arXiv_AI Unsupervised Pose Classification Image_Classification Language_Model PDF
2022-01-17 MuLVE, A Multi-Language Vocabulary Evaluation Data Set Anik Jacobsen, Salar Mohtaj, Sebastian Möller arXiv_CL arXiv_CL Bert Pose Language_Model PDF
2022-01-17 Generalizable Neuro-symbolic Systems for Commonsense Question Answering Alessandro Oltramari, Jonathan Francis, Filip Ilievski, Kaixin Ma, Roshanak Mirzaee arXiv_CL arXiv_CL Knowledge Knowledge_Graph Quantitative Language_Model PDF
2022-01-17 Efficient DNN Training with Knowledge-Guided Layer Freezing Yiding Wang, Decang Sun, Kai Chen, Fan Lai, Mosharaf Chowdhury arXiv_AI arXiv_AI Quantization Knowledge Language_Model PDF
2022-01-17 Unintended Bias in Language Model-drivenConversational Recommendation Tianshu Shen, Jiaru Li, Mohamed Reda Bouadjenek, Zheda Mai, Scott Sanner arXiv_CL arXiv_CL Bert Review Language_Model Recommendation PDF
2022-01-17 Korean-Specific Dataset for Table Question Answering Changwook Jun, Jooyoung Choi, Myoseop Sim, Hyun Kim, Hansol Jang, Kyungkoo Min arXiv_CL arXiv_CL Transformer Unsupervised Relation Language_Model PDF
2022-01-17 Evaluation of HTR models without Ground Truth Material Phillip Benjamin Ströbel, Simon Clematide, Martin Volk, Raphael Schwitter, Tobias Hodel, David Schoch arXiv_CL arXiv_CL Transformer Recognition Face Language_Model PDF
2022-01-16 Temporal Relation Extraction with a Graph-Based Deep Biaffine Attention Model Bo-Ying Su, Shang-Ling Hsu, Kuan-Yin Lai, Amarnath Gupta arXiv_CL arXiv_CL Pose Action Relation Relation_Extraction Attention Inference Language_Model Prediction PDF
2022-01-16 COLD: A Benchmark for Chinese Offensive Language Detection Jiawen Deng, Jingyan Zhou, Hao Sun, Fei Mi, Minlie Huang arXiv_CL arXiv_CL Pose Detection Object_Detection Language_Model PDF
2022-01-16 UnifiedSKG: Unifying and Multi-Tasking Structured Knowledge Grounding with Text-to-Text Language Models Tianbao Xie, Chen Henry Wu, Peng Shi, Ruiqi Zhong, Torsten Scholak, Michihiro Yasunaga, Chien-Sheng Wu, Ming Zhong, Pengcheng Yin, Sida I. Wang, Victor Zhong, Bailin Wang, Chengzu Li, Connor Boyle, Ansong Ni, Ziyu Yao, Dragomir Radev, Caiming Xiong, Lingpeng Kong, Rui Zhang, Noah A. Smith, Luke Zettlemoyer, Tao Yu arXiv_CL arXiv_CL Zero-Shot Knowledge Few-Shot Language_Model PDF
2022-01-16 WANLI: Worker and AI Collaboration for Natural Language Inference Dataset Creation Alisa Liu, Swabha Swayamdipta, Noah A. Smith, Yejin Choi arXiv_CL arXiv_CL Adversarial Pose Inference Language_Model PDF
2022-01-15 A Novel Multi-Task Learning Method for Symbolic Music Emotion Recognition Jibao Qiu, C. L. Philip Chen, Tong Zhang arXiv_SD arXiv_SD Recognition Emotion Language_Model PDF
2022-01-15 Prompt Learning for Few-Shot Dialogue State Tracking Yuting Yang, Wenqiang Lei, Juan Cao, Jintao Li, Tat-Seng Chua arXiv_CL arXiv_CL Tracking Knowledge Ontology Few-Shot Language_Model PDF
2022-01-15 Kformer: Knowledge Injection in Transformer Feed-Forward Layers Yunzhi Yao, Shaohan Huang, Ningyu Zhang, Li Dong, Furu Wei, Huajun Chen arXiv_CL arXiv_CL Transformer Knowledge Pose Medical Language_Model QA PDF
2022-01-14 A Warm Start and a Clean Crawled Corpus -- A Recipe for Good Language Models Vésteinn Snæbjarnarson, Haukur Barri Símonarson, Pétur Orri Ragnarsson, Svanhvít Ingólfsdóttir, Haukur Páll Jónsson, Vilhjálmur Þorsteinsson, Hafsteinn Einarsson arXiv_CL arXiv_CL Recognition Bert Speech Detection Language_Model PDF
2022-01-14 DeepSpeed-MoE: Advancing Mixture-of-Experts Inference and Training to Power Next-Generation AI Scale Samyam Rajbhandari, Conglong Li, Zhewei Yao, Minjia Zhang, Reza Yazdani Aminabadi, Ammar Ahmad Awan, Jeff Rasley, Yuxiong He arXiv_AI arXiv_AI Sparse Inference Language_Model PDF
2022-01-14 Eliciting Knowledge from Pretrained Language Models for Prototypical Prompt Verbalizer Yinyi Wei, Tong Mo, Yongtao Jiang, Weiping Li, Wen Zhao arXiv_CL arXiv_CL Embedding Zero-Shot Text_Classification Knowledge Pose Contrastive_Learning Classification Few-Shot Language_Model PDF
2022-01-14 A Survey of Controllable Text Generation using Transformer-based Pre-trained Language Models Hanqing Zhang, Haolin Song, Shaoyu Li, Ming Zhou, Dawei Song arXiv_CL arXiv_CL Transformer Knowledge Review Survey Text_Generation Language_Model PDF
2022-01-14 CommonsenseQA 2.0: Exposing the Limits of AI through Gamification Alon Talmor, Ori Yoran, Ronan Le Bras, Chandra Bhagavatula, Yoav Goldberg, Yejin Choi, Jonathan Berant arXiv_CL arXiv_CL Adversarial Pose Few-Shot Inference Language_Model QA PDF
2022-01-14 Applying a Generic Sequence-to-Sequence Model for Simple and Effective Keyphrase Generation Md Faisal Mahbub Chowdhury, Gaetano Rossiello, Michael Glass, Nandana Mihindukulasooriya, Alfio Gliozzo arXiv_CL arXiv_CL Pose Language_Model PDF
2022-01-14 A Thousand Words Are Worth More Than a Picture: Natural Language-Centric Outside-Knowledge Visual Question Answering Feng Gao, Qing Ping, Govind Thattai, Aishwarya Reganti, Ying Nian Wu, Prem Natarajan arXiv_CV arXiv_CV Image_Caption Knowledge Pose VQA GAN Language_Model QA PDF
2022-01-14 A Survey of Pretrained Language Models Based Text Generation Junyi Li, Tianyi Tang, Wayne Xin Zhao, Jian-Yun Nie, Ji-Rong Wen arXiv_CL arXiv_CL Survey Deep_Learning Text_Generation Language_Model PDF
2022-01-13 Datasheet for the Pile Stella Biderman, Kieran Bicheno, Leo Gao arXiv_CL arXiv_CL Language_Model PDF
2022-01-13 LP-BERT: Multi-task Pre-training Knowledge Graph BERT for Link Prediction Da Li, Ming Yi, Yukai He arXiv_AI arXiv_AI Bert Knowledge Knowledge_Graph Pose Contrastive_Learning Relation Language_Model Prediction PDF
2022-01-12 How Does Data Corruption Affect Natural Language Understanding Models? A Study on GLUE datasets Aarne Talman, Marianna Apidianaki, Stergios Chatzikyriakidis, Jörg Tiedemann arXiv_CL arXiv_CL Pose Language_Model Prediction PDF
2022-01-12 Diagnosing BERT with Retrieval Heuristics Arthur Câmara, Claudia Hauff arXiv_CL arXiv_CL Embedding Bert Pose Deep_Learning Language_Model Matching PDF
2022-01-12 GateFormer: Speeding Up News Feed Recommendation with Input Gated Transformers Peitian Zhang, Zheng liu arXiv_AI arXiv_AI Transformer Pose Language_Model Recommendation PDF
2022-01-12 PhysNLU: A Language Resource for Evaluating Natural Language Understanding and Explanation Coherence in Physics Jordan Meadows, Zili Zhou, Andre Freitas arXiv_CL arXiv_CL Language_Model Prediction PDF
2022-01-11 Uni-EDEN: Universal Encoder-Decoder Network by Multi-Granular Vision-Language Pre-training Yehao Li, Jiahao Fan, Yingwei Pan, Ting Yao, Weiyao Lin, Tao Mei arXiv_CV arXiv_CV Image_Caption Transformer Knowledge Action Classification VQA Caption Language_Model Matching PDF
2022-01-11 Explaining Prediction Uncertainty of Pre-trained Language Models by Detecting Uncertain Words in Inputs Hanjie Chen, Yangfeng Ji arXiv_CL arXiv_CL Bert Sentiment_Classification Pose Classification Sentiment Inference Language_Model Prediction PDF
2022-01-10 Black-Box Tuning for Language-Model-as-a-Service Tianxiang Sun, Yunfan Shao, Hong Qian, Xuanjing Huang, Xipeng Qiu arXiv_AI arXiv_AI Bert Pose Inference Language_Model PDF
2022-01-10 BERT for Sentiment Analysis: Pre-trained and Fine-Tuned Alternatives Frederico Souza, João Filho arXiv_CL arXiv_CL Embedding Transfer_Learning Bert Text_Classification Pose Classification Sentiment Language_Model PDF
2022-01-10 Fully automatic scoring of handwritten descriptive answers in Japanese language tests Hung Tuan Nguyen, Cuong Tuan Nguyen, Haruki Oka, Tsunenori Ishioka, Masaki Nakagawa arXiv_CL arXiv_CL Handwriting Bert Pose Language_Model PDF
2022-01-09 Semantic and sentiment analysis of selected Bhagavad Gita translations using BERT-based language framework Rohitash Chandra, Venkatesh Kulkarni arXiv_AI arXiv_AI Transformer Embedding Bert Deep_Learning Sentiment Language_Model PDF
2022-01-09 Medication Error Detection Using Contextual Language Models Yu Jiang, Christian Poellabauer arXiv_CL arXiv_CL Bert Speech Pose Detection Medical Language_Model PDF
2022-01-09 An Ensemble Approach to Acronym Extraction using Transformers Prashant Sharma, Hadeel Saadany, Leonardo Zilio, Diptesh Kanojia, Constantin Orăsan arXiv_CL arXiv_CL Transformer Action CNN Language_Model PDF
2022-01-08 Defining maximum acceptable latency of AI-enhanced CAI tools Claudio Fantinuoli, Maddalena Montecchio arXiv_CL arXiv_CL Speech Language_Model PDF
2022-01-08 Low-Rank Constraints for Fast Inference in Structured Models Justin T. Chiu, Yuntian Deng, Alexander M. Rush arXiv_CL arXiv_CL Unsupervised Inference Language_Model PDF
2022-01-07 Computational Lens on Cognition: Study Of Autobiographical Versus Imagined Stories With Large-Scale Language Models Maarten Sap, Anna Jafarpour, Yejin Choi, Noah A. Smith, James W. Pennebaker, Eric Horvitz arXiv_AI arXiv_AI Salient Knowledge Language_Model PDF
2022-01-07 The Defeat of the Winograd Schema Challenge Vid Kocijan, Ernest Davis, Thomas Lukasiewicz, Gary Marcus, Leora Morgenstern arXiv_CL arXiv_CL Transformer Knowledge Review Pose Language_Model PDF
2022-01-07 A Transfer Learning Pipeline for Educational Resource Discovery with Application in Leading Paragraph Generation Irene Li, Thomas George, Alexander Fabbri, Tammy Liao, Benjamin Chen, Rina Kawamura, Richard Zhou, Vanessa Yan, Swapnil Hingmire, Dragomir Radev arXiv_AI arXiv_AI Transfer_Learning Knowledge Pose Survey Action Classification Language_Model PDF
2022-01-06 Fortunately, Discourse Markers Can Enhance Language Models for Sentiment Analysis Liat Ein-Dor, Ilya Shnayderman, Artem Spector, Lena Dankin, Ranit Aharonov, Noam Slonim arXiv_CL arXiv_CL Pose Sentiment Language_Model PDF
2022-01-06 Improving Mandarin End-to-End Speech Recognition with Word N-gram Language Model Jinchuan Tian, Jianwei Yu, Chao Weng, Yuexian Zou, Dong Yu arXiv_SD arXiv_SD Recognition Speech Pose Attention Speech_Recognition Language_Model PDF
2022-01-05 Formal Analysis of Art: Proxy Learning of Visual Concepts from Style Through Language Models Diana Kim, Ahmed Elgammal, Marian Mazzone arXiv_AI arXiv_AI Bert Pose Quantitative Relation Language_Model PDF
2022-01-05 Does entity abstraction help generative Transformers reason? Nicolas Gontier, Siva Reddy, Christopher Pal arXiv_AI arXiv_AI Transformer Embedding Knowledge Pose Action Relation Language_Model Prediction QA PDF
2022-01-04 ZeroBERTo -- Leveraging Zero-Shot Text Classification by Topic Modeling Alexandre Alcoforado, Thomas Palmeira Ferraz, Rodrigo Gerber, Enzo Bustos, André Seidel Oliveira, Bruno Miguel Veloso, Fabio Levy Siqueira, Anna Helena Reali Costa arXiv_CL arXiv_CL Transformer Unsupervised Bert Zero-Shot Text_Classification Pose Classification Language_Model PDF
2022-01-04 Submix: Practical Private Prediction for Large-Scale Language Models Antonio Ginart, Laurens van der Maaten, James Zou, Chuan Guo arXiv_AI arXiv_AI Transformer Pose Action Language_Model Prediction PDF
2022-01-04 Interactive Attention AI to translate low light photos to captions for night scene understanding in women safety Rajagopal A, Nirmala V, Arun Muthuraj Vedamanickam arXiv_CV arXiv_CV Image_Caption Enhancement Image_Enhancement Deep_Learning VQA Attention Caption Language_Model PDF
2022-01-03 Semantically Grounded Visual Embeddings for Zero-Shot Learning Shah Nawaz, Jacopo Cavazza, Alessio Del Bue arXiv_CV arXiv_CV Embedding Recognition Zero-Shot Pose Caption Language_Model PDF
2022-01-01 Zero-shot Commonsense Question Answering with Cloze Translation and Consistency Optimization Zi-Yi Dou, Nanyun Peng arXiv_CL arXiv_CL Unsupervised Zero-Shot Text_Classification Optimization Knowledge Pose Action Classification Relation Relation_Extraction Language_Model Prediction QA PDF
2021-12-31 Training and Generating Neural Networks in Compressed Weight Space Kazuki Irie, Jürgen Schmidhuber arXiv_CL arXiv_CL RNN Language_Model PDF
2021-12-30 TextRGNN: Residual Graph Neural Networks for Text Classification Jiayuan Chen, Boyu Zhang, Yinfei Xu, Meng Wang arXiv_AI arXiv_AI Embedding Text_Classification Pose Classification Attention Language_Model PDF
2021-12-30 Does QA-based intermediate training help fine-tuning language models for text classification? Shiwei Zhang, Xiuzhen Zhang arXiv_AI arXiv_AI Text_Classification Classification Inference Language_Model QA PDF
2021-12-30 Automatic Mixed-Precision Quantization Search of BERT Changsheng Zhao, Ting Hua, Yilin Shen, Qian Lou, Hongxia Jin arXiv_AI arXiv_AI NAS Quantization Bert Knowledge Pose Language_Model PDF
2021-12-29 Materialized Knowledge Bases from Commonsense Transformers Tuan-Phong Nguyen, Simon Razniewski arXiv_CL arXiv_CL Transformer Knowledge Attention Language_Model PDF
2021-12-29 A Simple Baseline for Zero-shot Semantic Segmentation with Pre-trained Vision-language Model Mengde Xu, Zheng Zhang, Fangyun Wei, Yutong Lin, Yue Cao, Han Hu, Xiang Bai arXiv_CV arXiv_CV Segmentation Semantic_Segmentation Recognition Zero-Shot Classification Detection Object_Detection Image_Classification Language_Model PDF
2021-12-27 What do Large Language Models Learn about Scripts? Abhilasha Sancheti, Rachel Rudinger arXiv_CL arXiv_CL Bert Zero-Shot Knowledge Pose Language_Model PDF
2021-12-27 Understanding RoBERTa's Mood: The Role of Contextual-Embeddings as User-Representations for Depression Prediction Matthew Matero, Albert Hung, H. Andrew Schwartz arXiv_CL arXiv_CL Embedding Bert Language_Model Prediction PDF
2021-12-27 Secondary Use of Clinical Problem List Entries for Neural Network-Based Disease Code Assignment Markus Kreuzthaler, Stefan Schulz arXiv_CL arXiv_CL Bert RNN Classification Language_Model PDF
2021-12-27 CUGE: A Chinese Language Understanding and Generation Evaluation Benchmark Yuan Yao, Qingxiu Dong, Jian Guan, Boxi Cao, Zhengyan Zhang, Chaojun Xiao, Xiaozhi Wang, Fanchao Qi, Junwei Bao, Jinran Nie, Zheni Zeng, Yuxian Gu, Kun Zhou, Xuancheng Huang, Wenhao Li, Shuhuai Ren, Jinliang Lu, Chengqiang Xu, Huadong Wang, Guoyang Zeng, Zile Zhou, Jiajun Zhang, Juanzi Li, Minlie Huang, Rui Yan, Xiaodong He, Xiaojun Wan, Xin Zhao, Xu Sun, Yang Liu, Zhiyuan Liu, Xianpei Han, Erhong Yang, Zhifang Sui, Maosong Sun arXiv_CL arXiv_CL Pose GAN Language_Model PDF
2021-12-27 Event-based clinical findings extraction from radiology reports with pre-trained language model Wilson Lau, Kevin Lybarger, Martin L. Gunn, Meliha Yetisgen arXiv_CL arXiv_CL Bert Action Deep_Learning Relation Relation_Extraction Medical Language_Model Prediction PDF
2021-12-26 ArT: All-round Thinker for Unsupervised Commonsense Question-Answering Jiawei Wang, Hai Zhao arXiv_AI arXiv_AI Unsupervised Knowledge Pose Language_Model QA PDF
2021-12-25 Multi-Dialect Arabic Speech Recognition Abbas Raza Ali arXiv_SD arXiv_SD Recognition Speech Pose Speech_Recognition CNN Language_Model PDF
2021-12-25 A Preliminary Study for Literary Rhyme Generation based on Neuronal Representation, Semantics and Shallow Parsing Luis-Gil Moreno-Jiménez, Juan-Manuel Torres-Moreno, Roseli S. Wedemann arXiv_AI arXiv_AI Language_Model PDF
2021-12-25 PerCQA: Persian Community Question Answering Dataset Naghme Jamali, Yadollah Yaghoobzadeh, Hesham Faili arXiv_CL arXiv_CL Language_Model QA PDF
2021-12-25 CABACE: Injecting Character Sequence Information and Domain Knowledge for Enhanced Acronym and Long-Form Extraction Nithish Kannen, Divyanshu Sheth, Abhranil Chandra, Shubhraneel Pal arXiv_AI arXiv_AI Transformer Bert Zero-Shot Knowledge Adversarial Pose Action Language_Model PDF
2021-12-24 Counterfactual Memorization in Neural Language Models Chiyuan Zhang, Daphne Ippolito, Katherine Lee, Matthew Jagielski, Florian Tramèr, Nicholas Carlini arXiv_AI arXiv_AI Knowledge Language_Model Prediction PDF
2021-12-24 Visual Semantics Allow for Textual Reasoning Better in Scene Text Recognition Yue He, Chen Chen, Jing Zhang, Juhua Liu, Fengxiang He, Chaoyue Wang, Bo Du arXiv_AI arXiv_AI Segmentation Recognition Scene_Text CNN Language_Model PDF
2021-12-23 ERNIE 3.0 Titan: Exploring Larger-scale Knowledge Enhanced Pre-training for Language Understanding and Generation Shuohuan Wang, Yu Sun, Yang Xiang, Zhihua Wu, Siyu Ding, Weibao Gong, Shikun Feng, Junyuan Shang, Yanbin Zhao, Chao Pang, Jiaxiang Liu, Xuyi Chen, Yuxiang Lu, Weixin Liu, Xi Wang, Yangfan Bai, Qiuliang Chen, Li Zhao, Shiyong Li, Peng Sun, Dianhai Yu, Yanjun Ma, Hao Tian, Hua Wu, Tian Wu, Wei Zeng, Ge Li, Wen Gao, Haifeng Wang arXiv_CL arXiv_CL Knowledge Adversarial Self-Supervised Pose Language_Model PDF
2021-12-23 Towards more patient friendly clinical notes through language models and ontologies Francesco Moramarco, Damir Juric, Aleksandar Savkov, Jack Flann, Maria Lehl, Kristian Boda, Tessa Grafen, Vitalii Zhelezniak, Sunir Gohil, Alex Papadopoulos Korfiatis, Nils Hammerla arXiv_CL arXiv_CL Medical Language_Model PDF
2021-12-23 Distilling the Knowledge of Romanian BERTs Using Multiple Teachers Andrei-Marius Avram, Darius Catrina, Dumitru-Clementin Cercel, Mihai Dascălu, Traian Rebedea, Vasile Păiş, Dan Tufiş arXiv_CL arXiv_CL Quantization Transfer_Learning Recognition Bert Knowledge Speech Pose Sentiment Language_Model Prediction PDF
2021-12-23 Do Multi-Lingual Pre-trained Language Models Reveal Consistent Token Attributions in Different Languages? Junxiang Wang, Xuchao Zhang, Bo Zong, Yanchi Liu, Wei Cheng, Jingchao Ni, Haifeng Chen, Liang Zhao arXiv_CL arXiv_CL Pose Language_Model PDF
2021-12-23 Investigating Effect of Dialogue History in Multilingual Task Oriented Dialogue Systems Michael Sun, Kaili Huang, Mehrad Moradshahi arXiv_CL arXiv_CL Tracking Action Few-Shot Language_Model PDF
2021-12-22 CRASS: A Novel Data Set and Benchmark to Test Counterfactual Reasoning of Large Language Models Jörg Frohberg, Frank Binder arXiv_CL arXiv_CL Pose Language_Model PDF
2021-12-22 The Importance of the Current Input in Sequence Modeling Christian Oliva, Luis F. Lago-Fernández arXiv_CL arXiv_CL RNN Deep_Learning Language_Model Prediction PDF
2021-12-22 How Should Pre-Trained Language Models Be Fine-Tuned Towards Adversarial Robustness? Xinhsuai Dong, Luu Anh Tuan, Min Lin, Shuicheng Yan, Hanwang Zhang arXiv_CL arXiv_CL Bert Adversarial Pose Sentiment Inference Language_Model PDF
2021-12-22 Diformer: Directional Transformer for Neural Machine Translation Minghan Wang, Jiaxin Guo, Yuxia Wang, Daimeng Wei, Hengchao Shang, Chang Su, Yimeng Chen, Yinglu Li, Min Zhang, Shimin Tao, Hao Yang arXiv_AI arXiv_AI Transformer Pose Inference Language_Model Prediction PDF
2021-12-21 Predicting Job Titles from Job Descriptions with Multi-label Text Classification Hieu Trung Tran, Hanh Hong Phuc Vo, Son T. Luu arXiv_CL arXiv_CL Bert Text_Classification RNN Pose Classification Language_Model Prediction PDF
2021-12-21 DB-BERT: a Database Tuning Tool that 'Reads the Manual' Immanuel Trummer arXiv_AI arXiv_AI Reinforcement_Learning Bert Language_Model PDF
2021-12-20 Efficient Large Scale Language Modeling with Mixtures of Experts Mikel Artetxe, Shruti Bhosale, Naman Goyal, Todor Mihaylov, Myle Ott, Sam Shleifer, Xi Victoria Lin, Jingfei Du, Srinivasan Iyer, Ramakanth Pasunuru, Giri Anantharaman, Xian Li, Shuohui Chen, Halil Akin, Mandeep Baines, Louis Martin, Xing Zhou, Punit Singh Koura, Brian O'Horo, Jeff Wang, Luke Zettlemoyer, Mona Diab, Zornitsa Kozareva, Ves Stoyanov arXiv_AI arXiv_AI Few-Shot Language_Model PDF
2021-12-20 Few-shot Learning with Multilingual Language Models Xi Victoria Lin, Todor Mihaylov, Mikel Artetxe, Tianlu Wang, Shuohui Chen, Daniel Simig, Myle Ott, Naman Goyal, Shruti Bhosale, Jingfei Du, Ramakanth Pasunuru, Sam Shleifer, Punit Singh Koura, Vishrav Chaudhary, Brian O'Horo, Jeff Wang, Luke Zettlemoyer, Zornitsa Kozareva, Mona Diab, Veselin Stoyanov, Xian Li arXiv_AI arXiv_AI Zero-Shot Speech Face Detection Few-Shot Inference Language_Model PDF
2021-12-20 Training dataset and dictionary sizes matter in BERT models: the case of Baltic languages Matej Ulčar, Marko Robnik-Šikonja arXiv_CL arXiv_CL Recognition Bert Speech Language_Model PDF
2021-12-20 Spiral Language Modeling Yong Cao, Yukun Feng, Shaohui Kuang, Gu Xu arXiv_AI arXiv_AI Optimization Regularization Pose NMT Text_Generation Language_Model PDF
2021-12-19 Integrating Knowledge in End-to-End Automatic Speech Recognition for Mandarin-English Code-Switching Chia-Yu Li, Ngoc Thang Vu arXiv_CL arXiv_CL Recognition Knowledge Speech Pose Speech_Recognition Language_Model PDF
2021-12-17 Best of Both Worlds: A Hybrid Approach for Multi-Hop Explanation with Declarative Facts Shane Storks, Qiaozi Gao, Aishwarya Reganti, Govind Thattai arXiv_AI arXiv_AI Language_Model PDF
2021-12-17 Transcribing Natural Languages for The Deaf via Neural Editing Programs Dongxu Li, Chenchen Xu, Liu Liu, Yiran Zhong, Rong Wang, Lars Petersson, Hongdong Li arXiv_CL arXiv_CL Action Language_Model PDF
2021-12-16 UniREx: A Unified Learning Framework for Language Model Rationale Extraction Aaron Chan, Maziar Sanjabi, Lambert Mathias, Liang Tan, Shaoliang Nie, Xiaochang Peng, Xiang Ren, Hamed Firooz arXiv_CL arXiv_CL Text_Classification Pose Action Classification Language_Model Prediction PDF
2021-12-16 ATM: An Uncertainty-aware Active Self-training Framework for Label-efficient Text Classification Yue Yu, Lingkai Kong, Jieyu Zhang, Rongzhi Zhang, Chao Zhang arXiv_CL arXiv_CL Text_Classification Pose Classification Language_Model Prediction PDF
2021-12-16 Efficient Hierarchical Domain Adaptation for Pretrained Language Models Alexandra Chronopoulou, Matthew E. Peters, Jesse Dodge arXiv_CL arXiv_CL Action Inference Language_Model PDF
2021-12-16 Self-Supervised Learning for speech recognition with Intermediate layer supervision Chengyi Wang, Yu Wu, Sanyuan Chen, Shujie Liu, Jinyu Li, Yao Qian, Zhenglu Yang arXiv_CL arXiv_CL Recognition Bert Speech Self-Supervised Pose Relation Speech_Recognition Language_Model PDF
2021-12-16 Unsupervised Matching of Data and Text Naser Ahmadi, Hansjorg Sand, Paolo Papotti arXiv_AI arXiv_AI Embedding Unsupervised Optimization Relation Language_Model Matching PDF
2021-12-16 CLIN-X: pre-trained language models and a study on cross-task transfer for concept extraction in the clinical domain Lukas Lange, Heike Adel, Jannik Strötgen, Dietrich Klakow arXiv_CL arXiv_CL Transformer Pose Face Action Language_Model PDF
2021-12-16 NeuroLogic A*esque Decoding: Constrained Text Generation with Lookahead Heuristics Ximing Lu, Sean Welleck, Peter West, Liwei Jiang, Jungo Kasai, Daniel Khashabi, Ronan Le Bras, Lianhui Qin, Youngjae Yu, Rowan Zellers, Noah A. Smith, Yejin Choi arXiv_CL arXiv_CL Zero-Shot Pose Action Few-Shot Text_Generation Language_Model PDF
2021-12-16 Domain Prompts: Towards memory and compute efficient domain adaptation of ASR systems Saket Dingliwal, Ashish Shenoy, Sravan Bodapati, Ankur Gandhe, Ravi Teja Gadde, Katrin Kirchhoff arXiv_CL arXiv_CL Transformer Embedding Recognition Speech Speech_Recognition Language_Model PDF
2021-12-16 DOCmT5: Document-Level Pretraining of Multilingual Language Models Chia-Hsuan Lee, Aditya Siddhant, Viresh Ratnakar, Melvin Johnson arXiv_CL arXiv_CL Pose Summarization Language_Model PDF
2021-12-16 Few-Shot Semantic Parsing with Language Models Trained On Code Richard Shin, Benjamin Van Durme arXiv_CL arXiv_CL Few-Shot Language_Model PDF
2021-12-16 Lacuna Reconstruction: Self-supervised Pre-training for Low-Resource Historical Document Transcription Nikolai Vogler, Jonathan Parkes Allen, Matthew Thomas Miller, Taylor Berg-Kirkpatrick arXiv_CV arXiv_CV Reconstruction Recognition Self-Supervised SLAM Language_Model PDF
2021-12-16 Reframing Human-AI Collaboration for Generating Free-Text Explanations Sarah Wiegreffe, Jack Hessel, Swabha Swayamdipta, Mark Riedl, Yejin Choi arXiv_CL arXiv_CL Classification Few-Shot Language_Model PDF
2021-12-16 Taming Repetition in Dialogue Generation Yadong Xi, Jiashu Pu, Xiaoxi Mao arXiv_CL arXiv_CL Inference Language_Model PDF
2021-12-16 DREAM: Uncovering Mental Models behind Language Models Yuling Gu, Bhavana Dalvi Mishra, Peter Clark arXiv_AI arXiv_AI Zero-Shot Pose Language_Model QA PDF
2021-12-16 Reconsidering the Past: Optimizing Hidden States in Language Models Davis Yoshida, Kevin Gimpel arXiv_CL arXiv_CL Transformer Optimization Few-Shot Inference Language_Model PDF
2021-12-16 Analyzing the Limits of Self-Supervision in Handling Bias in Language Lisa Bauer, Karthik Gopalakrishnan, Spandana Gella, Yang Liu, Mohit Bansal, Dilek Hakkani-Tur arXiv_AI arXiv_AI Self-Supervised Pose Action Few-Shot Language_Model PDF
2021-12-16 Learning To Retrieve Prompts for In-Context Learning Ohad Rubin, Jonathan Herzig, Jonathan Berant arXiv_CL arXiv_CL Pose Language_Model PDF
2021-12-16 Call for Customized Conversation: Customized Conversation Grounding Persona and Knowledge Yoonna Jang, Jungwoo Lim, Yuna Hur, Dongsuk Oh, Suhyune Son, Yeonsoo Lee, Donghoon Shin, Seungryong Kim, Heuiseok Lim arXiv_AI arXiv_AI Transformer Knowledge Pose Language_Model PDF
2021-12-16 Masked Measurement Prediction: Learning to Jointly Predict Quantities and Units from Textual Context Daniel Spokoyny, Ivan Lee, Zhao Jin, Taylor Berg-Kirkpatrick arXiv_CL arXiv_CL Transformer Bert Pose Language_Model Prediction PDF
2021-12-16 Commonsense Knowledge-Augmented Pretrained Language Models for Causal Reasoning Classification Pedram Hosseini, David A. Broniatowski, Mona Diab arXiv_CL arXiv_CL Bert Knowledge Knowledge_Graph Classification Relation Language_Model PDF
2021-12-16 Guiding Neural Story Generation with Reader Models Xiangyu Peng, Kaige Xie, Amal Alabdulkarim, Harshith Kayam, Samihan Dani, Mark O. Riedl arXiv_CL arXiv_CL Knowledge Knowledge_Graph Relation Attention Language_Model PDF
2021-12-16 Goal-Directed Story Generation: Augmenting Generative Language Models with Reinforcement Learning Amal Alabdulkarim, Winston Li, Lara J. Martin, Mark O. Riedl arXiv_AI arXiv_AI Transformer Reinforcement_Learning Optimization Knowledge Knowledge_Graph Attention Language_Model PDF
2021-12-16 Does Pre-training Induce Systematic Inference? How Masked Language Models Acquire Commonsense Knowledge Ian Porada, Alessandro Sordoni, Jackie Chi Kit Cheung arXiv_CL arXiv_CL Transformer Bert Knowledge Face Inference Language_Model PDF
2021-12-16 Learning Rich Representation of Keyphrases from Text Mayank Kulkarni, Debanjan Mahata, Ravneet Arora, Rajarshi Bhowmik arXiv_CL arXiv_CL Transformer Recognition Action Relation Relation_Extraction Summarization Language_Model QA PDF
2021-12-15 Applying SoftTriple Loss for Supervised Language Model Fine Tuning Witold Sosnowski, Anna Wroblewska, Piotr Gawrysiak arXiv_CL arXiv_CL Bert Knowledge Classification Language_Model PDF
2021-12-15 PROMPT WAYWARDNESS: The Curious Case of Discretized Interpretation of Continuous Prompts Daniel Khashabi, Shane Lyu, Sewon Min, Lianhui Qin, Kyle Richardson, Sameer Singh, Sean Welleck, Hannaneh Hajishirzi, Tushar Khot, Ashish Sabharwal, Yejin Choi arXiv_CL arXiv_CL Language_Model PDF
2021-12-15 Simple Text Detoxification by Identifying a Linear Toxic Subspace in Language Model Embeddings Andrew Wang, Mohit Sudhakar, Yangfeng Ji arXiv_CL arXiv_CL Embedding Pose Language_Model PDF
2021-12-15 Is 'my favorite new movie' my favorite movie? Probing the Understanding of Recursive Noun Phrases Qing Lyu, Hua Zheng, Daoxin Li, Li Zhang, Marianna Apidianaki, Chris Callison-Burch arXiv_CL arXiv_CL Transformer Zero-Shot Knowledge Detection Language_Model PDF
2021-12-15 CheckDST: Measuring Real-World Generalization of Dialogue State Tracking Performance Hyundong Cho, Chinnadhurai Sankar, Christopher Lin, Kaushik Ram Sadagopan, Shahin Shayandeh, Asli Celikyilmaz, Jonathan May, Ahmad Beirami arXiv_CL arXiv_CL Tracking Classification Language_Model PDF
2021-12-15 One System to Rule them All: a Universal Intent Recognition System for Customer Service Chatbots Juan Camilo Vasquez-Correa, Juan Carlos Guerrero-Sierra, Jose Luis Pemberty-Tamayo, Juan Esteban Jaramillo, Andres Felipe Tejada-Castro arXiv_CL arXiv_CL Embedding Transfer_Learning Recognition Bert RNN Pose Classification CNN Language_Model QA PDF
2021-12-15 Improving Conversational Recommendation Systems' Quality with Context-Aware Item Meta Information Bowen Yang, Cong Han, Yu Li, Lei Zuo, Zhou Yu arXiv_AI arXiv_AI Embedding Knowledge Knowledge_Graph Pose Relation Language_Model Recommendation PDF
2021-12-15 Assisted Text Annotation Using Active Learning to Achieve High Quality with Little Effort Franziska Weeber, Felix Hamborg, Karsten Donnay, Bela Gipp arXiv_AI arXiv_AI Pose Classification Deep_Learning Language_Model PDF
2021-12-15 Knowledge-Grounded Dialogue Generation with a Unified Knowledge Representation Yu Li, Baolin Peng, Yelong Shen, Yi Mao, Lars Liden, Zhou Yu, Jianfeng Gao arXiv_CL arXiv_CL Zero-Shot Knowledge Few-Shot Language_Model PDF
2021-12-15 SPTS: Single-Point Text Spotting Dezhi Peng, Xinyu Wang, Yuliang Liu, Jiaxin Zhang, Mingxin Huang, Songxuan Lai, Shenggao Zhu, Jing Li, Dahua Lin, Chunhua Shen, Lianwen Jin arXiv_CV arXiv_CV Transformer Recognition Pose Scene_Text Detection Language_Model Prediction PDF
2021-12-15 Decoupling Zero-Shot Semantic Segmentation Jian Ding, Nan Xue, Gui-Song Xia, Dengxin Dai arXiv_CV arXiv_CV Segmentation Semantic_Segmentation Zero-Shot Knowledge Pose Classification Language_Model PDF
2021-12-15 Oracle Linguistic Graphs Complement a Pretrained Transformer Language Model: A Cross-formalism Comparison Jakob Prange, Nathan Schneider, Lingpeng Kong arXiv_CL arXiv_CL Transformer Speech Language_Model PDF
2021-12-15 Tracing Text Provenance via Context-Aware Lexical Substitution Xi Yang, Jie Zhang, Kejiang Chen, Weiming Zhang, Zehua Ma, Feng Wang, Nenghai Yu arXiv_CL arXiv_CL Transformer OCR Bert Pose Language_Model PDF
2021-12-15 Cross-Domain Generalization and Knowledge Transfer in Transformers Trained on Legal Data Jaromir Savelka, Hannes Westermann, Karim Benyekhlef arXiv_CL arXiv_CL Transformer Knowledge Language_Model Prediction PDF
2021-12-15 Fine-Tuning Large Neural Language Models for Biomedical Natural Language Processing Robert Tinn, Hao Cheng, Yu Gu, Naoto Usuyama, Xiaodong Liu, Tristan Naumann, Jianfeng Gao, Hoifung Poon arXiv_CL arXiv_CL Transfer_Learning Bert Medical Language_Model PDF
2021-12-15 Few-shot Instruction Prompts for Pretrained Language Models to Detect Social Biases Shrimai Prabhumoye, Rafal Kocielnik, Mohammad Shoeybi, Anima Anandkumar, Bryan Catanzaro arXiv_AI arXiv_AI Embedding Pose Detection Few-Shot Object_Detection Language_Model PDF
2021-12-15 Value Retrieval with Arbitrary Queries for Form-like Documents Mingfei Gao, Le Xue, Chetan Ramaiah, Chen Xing, Ran Xu, Caiming Xiong arXiv_AI arXiv_AI Pose Language_Model PDF
2021-12-14 Towards Interactive Language Modeling Maartje ter Hoeve, Evgeny Kharitonov, Dieuwke Hupkes, Emmanuel Dupoux arXiv_AI arXiv_AI Action Language_Model PDF
2021-12-14 VALSE: A Task-Independent Benchmark for Vision and Language Models Centered on Linguistic Phenomena Letitia Parcalabescu, Michele Cafagna, Lilitta Muradjan, Anette Frank, Iacer Calixto, Albert Gatt arXiv_CV arXiv_CV Pose Language_Model PDF
2021-12-14 LMTurk: Few-Shot Learners as Crowdsourcing Workers Mengjie Zhao, Fei Mi, Yasheng Wang, Minglei Li, Xin Jiang, Qun Liu, Hinrich Schütze arXiv_CL arXiv_CL Pose Few-Shot Language_Model PDF
2021-12-14 CoCo-BERT: Improving Video-Language Pre-training with Contrastive Cross-modal Matching and Denoising Jianjie Luo, Yehao Li, Yingwei Pan, Ting Yao, Hongyang Chao, Tao Mei arXiv_AI arXiv_AI Video_Caption Bert Action Denoising Caption Language_Model Prediction Matching PDF
2021-12-14 Measuring Fairness with Biased Rulers: A Survey on Quantifying Biases in Pretrained Language Models Pieter Delobelle, Ewoenam Kwaku Tokpo, Toon Calders, Bettina Berendt arXiv_CL arXiv_CL Embedding Bert Survey Relation Language_Model PDF
2021-12-14 Model Uncertainty-Aware Knowledge Amalgamation for Pre-Trained Language Models Lei Li, Yankai Lin, Xuancheng Ren, Guangxiang Zhao, Peng Li, Jie Zhou, Xu Sun arXiv_AI arXiv_AI Knowledge Classification Language_Model PDF
2021-12-14 Improving Hybrid CTC/Attention End-to-end Speech Recognition with Pretrained Acoustic and Language Model Keqi Deng, Songjun Cao, Yike Zhang, Long Ma arXiv_CL arXiv_CL Transformer Recognition Knowledge Speech Self-Supervised Pose Attention Speech_Recognition Inference Language_Model PDF
2021-12-14 From Dense to Sparse: Contrastive Pruning for Better Pre-trained Language Model Compression Runxin Xu, Fuli Luo, Chengyu Wang, Baobao Chang, Jun Huang, Songfang Huang, Fei Huang arXiv_AI arXiv_AI Bert Sparse Knowledge Pose Contrastive_Learning Language_Model PDF
2021-12-14 Discovering Explanatory Sentences in Legal Case Decisions Using Pre-trained Language Models Jaromir Savelka, Kevin D. Ashley arXiv_CL arXiv_CL Transformer Relation Language_Model Prediction PDF
2021-12-14 Few-shot Multi-hop Question Answering over Knowledge Base Fan Meihao arXiv_AI arXiv_AI Knowledge Pose Relation Few-Shot Language_Model QA PDF
2021-12-13 Language Models are not Models of Language Csaba Veres arXiv_CL arXiv_CL Transfer_Learning Pose Deep_Learning Language_Model PDF
2021-12-13 Controlled Cue Generation for Play Scripts Alara Dirik, Hilal Donmez, Pinar Yanardag arXiv_AI arXiv_AI Pose Emotion Quantitative Text_Generation Language_Model PDF
2021-12-13 GLaM: Efficient Scaling of Language Models with Mixture-of-Experts Nan Du, Yanping Huang, Andrew M. Dai, Simon Tong, Dmitry Lepikhin, Yuanzhong Xu, Maxim Krikun, Yanqi Zhou, Adams Wei Yu, Orhan Firat, Barret Zoph, Liam Fedus, Maarten Bosma, Zongwei Zhou, Tao Wang, Yu Emma Wang, Kellie Webster, Marie Pellat, Kevin Robinson, Kathy Meier-Hellstern, Toju Duke, Lucas Dixon, Kun Zhang, Quoc V Le, Yonghui Wu, Zhifeng Chen, Claire Cui arXiv_CL arXiv_CL Zero-Shot Sparse Pose Inference Language_Model PDF
2021-12-13 Improving and Diagnosing Knowledge-Based Visual Question Answering via Entity Enhanced Knowledge Injection Diego Garcia-Olano, Yasumasa Onoe, Joydeep Ghosh arXiv_CV arXiv_CV Embedding Weakly_Supervised Knowledge Knowledge_Graph Pose VQA Attention Language_Model QA PDF
2021-12-13 Sparse Interventions in Language Models with Differentiable Masking Nicola De Cao, Leon Schmid, Dieuwke Hupkes, Ivan Titov arXiv_CL arXiv_CL Sparse RNN Regularization Pose Detection Language_Model PDF
2021-12-13 VL-Adapter: Parameter-Efficient Transfer Learning for Vision-and-Language Tasks Yi-Lin Sung, Jaemin Cho, Mohit Bansal arXiv_AI arXiv_AI Image_Caption Transfer_Learning Knowledge Pose VQA Caption Language_Model QA PDF
2021-12-13 Step-unrolled Denoising Autoencoders for Text Generation Nikolay Savinov, Junyoung Chung, Mikolaj Binkowski, Erich Elsen, Aaron van den Oord arXiv_CL arXiv_CL Pose Denoising Text_Generation Language_Model PDF
2021-12-13 WECHSEL: Effective initialization of subword embeddings for cross-lingual transfer of monolingual language models Benjamin Minixhofer, Fabian Paischer, Navid Rekabsaz arXiv_CL arXiv_CL Embedding Bert Pose Language_Model PDF
2021-12-13 Do Data-based Curricula Work? Maxim K. Surkov, Vladislav D. Mosin, Ivan P. Yamshchikov arXiv_CL arXiv_CL Bert Knowledge Pose Language_Model PDF
2021-12-13 On the Compression of Natural Language Models Saeed Damadi arXiv_CL arXiv_CL Quantization Sparse Knowledge Review Language_Model PDF
2021-12-13 Surfer100: Generating Surveys From Web Resources on Wikipedia-style Irene Li, Alexander Fabbri, Rina Kawamura, Yixin Liu, Xiangru Tang, Jaesung Tae, Chang Shen, Sally Ma, Tomoe Mizutani, Dragomir Radev arXiv_CL arXiv_CL Knowledge Survey Language_Model PDF
2021-12-13 Dependency Learning for Legal Judgment Prediction with a Unified Text-to-Text Transformer Yunyun Huang, Xiaoyu Shen, Chuanyi Li, Jidong Ge, Bin Luo arXiv_AI arXiv_AI Transformer Pose Classification Language_Model Prediction PDF
2021-12-12 Improving Code-switching Language Modeling with Artificially Generated Texts using Cycle-consistent Adversarial Networks Chia-Yu Li, Ngoc Thang Vu arXiv_CL arXiv_CL Recognition Adversarial Speech Pose Speech_Recognition Language_Model PDF
2021-12-12 Contextualized Scene Imagination for Generative Commonsense Reasoning PeiFeng Wang, Jonathan Zamora, Junfeng Liu, Filip Ilievski, Muhao Chen, Xiang Ren arXiv_CL arXiv_CL Transformer Knowledge Knowledge_Graph Pose Relation Text_Generation Language_Model PDF
2021-12-11 Show and Write: Entity-aware News Generation with Image Information Zhongping Zhang, Yiwen Gu, Bryan A. Plummer arXiv_CL arXiv_CL Pose Quantitative Caption Language_Model PDF
2021-12-10 Discourse-Aware Prompt Design for Text Generation Marjan Ghazvininejad, Vladimir Karpukhin, Asli Celikyilmaz arXiv_CL arXiv_CL Sparse Salient Pose Attention Text_Generation Language_Model PDF
2021-12-10 Pruning Pretrained Encoders with a Multitask Objective Patrick Xia, Richard Shin arXiv_CL arXiv_CL Language_Model PDF
2021-12-10 Unified Multimodal Pre-training and Prompt-based Tuning for Vision-Language Understanding and Generation Tianyi Liu, Zuxuan Wu, Wenhan Xiong, Jingjing Chen, Yu-Gang Jiang arXiv_CV arXiv_CV Bert Pose VQA Few-Shot Text_Generation Language_Model Matching PDF
2021-12-09 MAGMA -- Multimodal Augmentation of Generative Models through Adapter-based Finetuning Constantin Eichenberg, Sidney Black, Samuel Weinbach, Letitia Parcalabescu, Anette Frank arXiv_CV arXiv_CV Optimization Knowledge VQA Language_Model QA PDF
2021-12-09 Spinning Language Models for Propaganda-As-A-Service Eugene Bagdasaryan, Vitaly Shmatikov arXiv_CL arXiv_CL Embedding Adversarial Pose Sentiment GAN Summarization Language_Model PDF
2021-12-09 From Good to Best: Two-Stage Training for Cross-lingual Machine Reading Comprehension Nuo Chen, Linjun Shou, Min Gong, Jian Pei, Daxin Jiang arXiv_AI arXiv_AI Contrastive_Learning Language_Model Prediction PDF
2021-12-09 Towards Neural Functional Program Evaluation Torsten Scholak, Jonathan Pilault, Joey Velez-Ginorio arXiv_CL arXiv_CL Transformer Language_Model PDF
2021-12-08 Scaling Language Models: Methods, Analysis & Insights from Training Gopher Jack W. Rae, Sebastian Borgeaud, Trevor Cai, Katie Millican, Jordan Hoffmann, Francis Song, John Aslanides, Sarah Henderson, Roman Ring, Susannah Young, Eliza Rutherford, Tom Hennigan, Jacob Menick, Albin Cassirer, Richard Powell, George van den Driessche, Lisa Anne Hendricks, Maribeth Rauh, Po-Sen Huang, Amelia Glaese, Johannes Welbl, Sumanth Dathathri, Saffron Huang, Jonathan Uesato, John Mellor, Irina Higgins, Antonia Creswell, Nat McAleese, Amy Wu, Erich Elsen, Siddhant Jayakumar, Elena Buchatskaya, David Budden, Esme Sutherland, Karen Simonyan, Michela Paganini, Laurent Sifre, Lena Martens, Xiang Lorraine Li, Adhiguna Kuncoro, Aida Nematzadeh, Elena Gribovskaya, Domenic Donato, Angeliki Lazaridou, Arthur Mensch, Jean-Baptiste Lespiau, Maria Tsimpoukelli, Nikolai Grigorev, Doug Fritz, et al. (31 additional authors not shown) arXiv_AI arXiv_AI Transformer Knowledge Language_Model PDF
2021-12-08 FLAVA: A Foundational Language And Vision Alignment Model Amanpreet Singh, Ronghang Hu, Vedanuj Goswami, Guillaume Couairon, Wojciech Galuba, Marcus Rohrbach, Douwe Kiela arXiv_CV arXiv_CV Language_Model PDF
2021-12-08 Prompting Visual-Language Models for Efficient Video Understanding Chen Ju, Tengda Han, Kunhao Zheng, Ya Zhang, Weidi Xie arXiv_CV arXiv_CV Transformer Recognition Video_Caption Zero-Shot Pose Action_Recognition Action Few-Shot Language_Model Video_Retrieval PDF
2021-12-08 MLP Architectures for Vision-and-Language Modeling: An Empirical Study Yixin Nie, Linjie Li, Zhe Gan, Shuohang Wang, Chenguang Zhu, Michael Zeng, Zicheng Liu, Mohit Bansal, Lijuan Wang arXiv_CV arXiv_CV Transformer VQA Attention Language_Model QA PDF
2021-12-08 Improving language models by retrieving from trillions of tokens Sebastian Borgeaud, Arthur Mensch, Jordan Hoffmann, Trevor Cai, Eliza Rutherford, Katie Millican, George van den Driessche, Jean-Baptiste Lespiau, Bogdan Damoc, Aidan Clark, Diego de Las Casas, Aurelia Guy, Jacob Menick, Roman Ring, Tom Hennigan, Saffron Huang, Loren Maggiore, Chris Jones, Albin Cassirer, Andy Brock, Michela Paganini, Geoffrey Irving, Oriol Vinyals, Simon Osindero, Karen Simonyan, Jack W. Rae, Erich Elsen, Laurent Sifre arXiv_CL arXiv_CL Transformer Bert Knowledge Attention Language_Model PDF
2021-12-08 Ethical and social risks of harm from Language Models Laura Weidinger, John Mellor, Maribeth Rauh, Conor Griffin, Jonathan Uesato, Po-Sen Huang, Myra Cheng, Mia Glaese, Borja Balle, Atoosa Kasirzadeh, Zac Kenton, Sasha Brown, Will Hawkins, Tom Stepleton, Courtney Biles, Abeba Birhane, Julia Haas, Laura Rimell, Lisa Anne Hendricks, William Isaac, Sean Legassick, Geoffrey Irving, Iason Gabriel arXiv_AI arXiv_AI Review Pose Action GAN Language_Model PDF
2021-12-08 JABER: Junior Arabic BERt Abbas Ghaddar, Yimeng Wu, Ahmad Rashid, Khalil Bibi, Mehdi Rezagholizadeh, Chao Xing, Yasheng Wang, Duan Xinyu, Zhefeng Wang, Baoxing Huai, Xin Jiang, Qun Liu, Philippe Langlais arXiv_CL arXiv_CL Bert Language_Model PDF
2021-12-08 Transformer-Based Approach for Joint Handwriting and Named Entity Recognition in Historical documents Ahmed Cheikh Rouhoua, Marwa Dhiaf, Yousri Kessentini, Sinda Ben Salem arXiv_CV arXiv_CV Transformer Segmentation Handwriting Recognition Pose Face Action Language_Model Prediction PDF
2021-12-08 Zero-Shot Recommendation as Language Modeling Damien Sileo, Wout Vossen, Robbe Raymaekers arXiv_CL arXiv_CL Zero-Shot Pose Language_Model Recommendation PDF
2021-12-08 A study on native American English speech recognition by Indian listeners with varying word familiarity level Abhayjeet Singh, Achuth Rao MV, Rakesh Vaideeswaran, Chiranjeevi Yarra, Prasanta Kumar Ghosh arXiv_CL arXiv_CL Recognition Speech Speech_Recognition Language_Model PDF
2021-12-08 Improving Knowledge Graph Representation Learning by Structure Contextual Pre-training Ganqiang Ye, Wen Zhang, Zhen Bi, Chi Man Wong, Chen Hui, Huajun Chen arXiv_AI arXiv_AI Represenation_Learning Knowledge Knowledge_Graph Pose Classification Language_Model Prediction PDF
2021-12-07 Automated Story Generation as Question-Answering Louis Castricato, Spencer Frazier, Jonathan Balloch, Nitya Tarakad, Mark Riedl arXiv_CL arXiv_CL Pose Language_Model PDF
2021-12-07 GKS: Graph-based Knowledge Selector for Task-oriented Dialog System Jen-Chieh Yang, Jia-Yan Wu, Sung-Ping Chang, Ya-Chieh Huang arXiv_CL arXiv_CL Embedding Knowledge Pose Relation Attention Language_Model PDF
2021-12-07 Parsing with Pretrained Language Models, Multiple Datasets, and Dataset Embeddings Rob van der Goot, Miryam de Lhoneux arXiv_CL arXiv_CL Transformer Embedding Language_Model PDF
2021-12-07 A deep language model to predict metabolic network equilibria François Charton, Amaury Hayat, Sean T. McQuade, Nathaniel J. Merrill, Benedetto Piccoli arXiv_CL arXiv_CL Transformer Quantitative Deep_Learning Language_Model PDF
2021-12-07 Ground-Truth, Whose Truth? -- Examining the Challenges with Annotating Toxic Text Datasets Kofi Arhin, Ioana Baldini, Dennis Wei, Karthikeyan Natesan Ramamurthy, Moninder Singh arXiv_CL arXiv_CL Language_Model PDF
2021-12-06 Zero-shot hashtag segmentation for multilingual sentiment analysis Ruan Chaves Rodrigues, Marcelo Akira Inuzuka, Juliana Resplande Sant'Anna Gomes, Acquila Santos Rocha, Iacer Calixto, Hugo Alexandre Dantas do Nascimento arXiv_CL arXiv_CL Segmentation Zero-Shot Speech Detection Sentiment Language_Model PDF
2021-12-06 Quantifying Adaptability in Pre-trained Language Models with 500 Tasks Belinda Z. Li, Jane Yu, Madian Khabsa, Luke Zettlemoyer, Alon Halevy, Jacob Andreas arXiv_CL arXiv_CL Knowledge Face Language_Model PDF
2021-12-06 Keeping it Simple: Language Models can learn Complex Molecular Distributions Daniel Flam-Shepherd, Kevin Zhu, Alán Aspuru-Guzik arXiv_AI arXiv_AI Pose Language_Model PDF
2021-12-06 Fast and Accurate Span-based Semantic Role Labeling as Graph Parsing Shilin Zhou, Qingrong Xia, Zhenghua Li, Yu Zhang, Min Zhang arXiv_CL arXiv_CL Pose Inference Language_Model Prediction PDF
2021-12-06 MoCA: Incorporating Multi-stage Domain Pretraining and Cross-guided Multimodal Attention for Textbook Question Answering Fangzhi Xu, Qika Lin, Jun Liu, Lingling Zhang, Tianzhe Zhao, Qi Chai, Yudai Pan arXiv_AI arXiv_AI Unsupervised Pose VQA Attention Language_Model QA PDF
2021-12-06 An Effective GCN-based Hierarchical Multi-label classification for Protein Function Prediction Kyudam Choi, Yurim Lee, Cheongwon Kim, Minsung Yoon arXiv_AI arXiv_AI Pose Ontology Classification CNN Language_Model Prediction PDF
2021-12-06 Search and Learn: Improving Semantic Coverage for Data-to-Text Generation Shailza Jolly, Zi Xuan Zhang, Andreas Dengel, Lili Mou arXiv_CL arXiv_CL Pose Few-Shot Text_Generation Inference Language_Model PDF
2021-12-06 End-to-end Adaptive Distributed Training on PaddlePaddle Yulong Ao, Zhihua Wu, Dianhai Yu, Weibao Gong, Zhiqing Kui, Minxu Zhang, Zilingfeng Ye, Liang Shen, Yanjun Ma, Tian Wu, Haifeng Wang, Wei Zeng, Chao Yang arXiv_AI arXiv_AI Language_Model Recommendation PDF
2021-12-06 JointLK: Joint Reasoning with Language Models and Knowledge Graphs for Commonsense Question Answering Yueqing Sun, Qi Shi, Le Qi, Yu Zhang arXiv_AI arXiv_AI Knowledge Knowledge_Graph Pose Action Attention Language_Model QA PDF
2021-12-06 NL-Augmenter: A Framework for Task-Sensitive Natural Language Augmentation Kaustubh D. Dhole, Varun Gangal, Sebastian Gehrmann, Aadesh Gupta, Zhenhao Li, Saad Mahamood, Abinaya Mahendiran, Simon Mille, Ashish Srivastava, Samson Tan, Tongshuang Wu, Jascha Sohl-Dickstein, Jinho D. Choi, Eduard Hovy, Ondrej Dusek, Sebastian Ruder, Sajant Anand, Nagender Aneja, Rabin Banjade, Lisa Barthe, Hanna Behnke, Ian Berlot-Attwell, Connor Boyle, Caroline Brun, Marco Antonio Sobrevilla Cabezudo, Samuel Cahyawijaya, Emile Chapuis, Wanxiang Che, Mukund Choudhary, Christian Clauss, Pierre Colombo, Filip Cornell, Gautier Dagan, Mayukh Das, Tanay Dixit, Thomas Dopierre, Paul-Alexis Dray, Suchitra Dubey, Tatiana Ekeinhor, Marco Di Giovanni, Rishabh Gupta, Rishabh Gupta, Louanes Hamla, Sang Han, Fabrice Harel-Canada, Antoine Honore, Ishan Jindal, Przemyslaw K. Joniak, Denis Kleyko, Venelin Kovatchev, et al. (75 additional authors not shown) arXiv_AI arXiv_AI Language_Model PDF
2021-12-05 Achieving Forgetting Prevention and Knowledge Transfer in Continual Learning Zixuan Ke, Bing Liu, Nianzu Ma, Hu Xu, Lei Shu arXiv_CL arXiv_CL Bert Knowledge Pose Language_Model PDF
2021-12-05 Open Vocabulary Electroencephalography-To-Text Decoding and Zero-shot Sentiment Classification Zhenhailong Wang, Heng Ji arXiv_AI arXiv_AI Sentiment_Classification Zero-Shot Pose Classification Sentiment Language_Model PDF
2021-12-05 VarCLR: Variable Semantic Representation Pre-training via Contrastive Learning Qibin Chen, Jeremy Lacomis, Edward J. Schwartz, Graham Neubig, Bogdan Vasilescu, Claire Le Goues arXiv_CL arXiv_CL Bert Pose Contrastive_Learning Detection Relation Language_Model PDF
2021-12-05 Contextual Multi-View Query Learning for Short Text Classification in User-Generated Data Payam Karisani, Negin Karisani, Li Xiong arXiv_CL arXiv_CL Text_Classification Pose Classification Detection Language_Model PDF
2021-12-05 Interpretable Privacy Preservation of Text Representations Using Vector Steganography Geetanjali Bihani arXiv_AI arXiv_AI GAN Language_Model PDF
2021-12-05 Causal Distillation for Language Models Zhengxuan Wu, Atticus Geiger, Josh Rozner, Elisa Kreiss, Hanson Lu, Thomas Icard, Christopher Potts, Noah D. Goodman arXiv_CL arXiv_CL Recognition Bert Action Language_Model PDF
2021-12-05 Gaud'i: Conversational Interactions with Deep Representations to Generate Image Collections Victor S. Bursztyn, Jennifer Healey, Vishwa Vinay arXiv_AI arXiv_AI Knowledge Action Language_Model PDF
2021-12-04 VT-CLIP: Enhancing Vision-Language Models with Visual-guided Texts Renrui Zhang, Longtian Qiu, Wei Zhang, Ziyao Zeng arXiv_CV arXiv_CV Recognition Zero-Shot Represenation_Learning Knowledge Pose Classification Few-Shot Attention Language_Model Matching PDF
2021-12-04 Controllable Response Generation for Assistive Use-cases Shachi H Kumar, Hsuan Su, Ramesh Manuvinakurike, Saurav Sahay, Lama Nachman arXiv_CL arXiv_CL Speech Action Quantitative Language_Model PDF
2021-12-04 Joint Audio-Text Model for Expressive Speech-Driven 3D Facial Animation Yingruo Fan, Zhaojiang Lin, Jun Saito, Wenping Wang, Taku Komura arXiv_CV arXiv_CV Embedding 3D Speech Pose Face Quantitative Language_Model PDF
2021-12-03 Can OpenAI Codex and Other Large Language Models Help Us Fix Security Bugs? Hammond Pearce, Benjamin Tan, Baleegh Ahmad, Ramesh Karri, Brendan Dolan-Gavitt arXiv_AI arXiv_AI Zero-Shot Language_Model PDF
2021-12-03 The Catalan Language CLUB Carlos Rodriguez-Penagos, Carme Armentano-Oller, Marta Villegas, Maite Melero, Aitor Gonzalez, Ona de Gibert Bonet, Casimiro Carrino Pio arXiv_AI arXiv_AI Language_Model PDF
2021-12-03 Siamese BERT-based Model for Web Search Relevance Ranking Evaluated on a New Czech Dataset Matěj Kocián, Jakub Náplava, Daniel Štancl, Vladimír Kadlec arXiv_CL arXiv_CL Transformer Bert Language_Model PDF
2021-12-03 Given Users Recommendations Based on Reviews on Yelp Shuwei Zhang, Maiqi Tang, Qingyang Zhang, Yucan Luo, Yuhui Zou arXiv_CL arXiv_CL Embedding Bert Review Language_Model Prediction Recommendation PDF
2021-12-03 Probing Linguistic Information For Logical Inference In Pre-trained Language Models Zeming Chen, Qiyue Gao arXiv_AI arXiv_AI Knowledge Pose Inference Language_Model PDF
2021-12-03 Multitask Finetuning for Improving Neural Machine Translation in Indian Languages Shaily Desai, Atharva Kshirsagar, Manisha Marathe arXiv_CL arXiv_CL Transformer Text_Classification Pose Classification Language_Model PDF
2021-12-03 Single-Shot Black-Box Adversarial Attacks Against Malware Detectors: A Causal Language Model Approach James Lee Hu, Mohammadreza Ebrahimi, Hsinchun Chen arXiv_AI arXiv_AI Transformer Adversarial Pose Action Deep_Learning Detection Object_Detection Attention Language_Model PDF
2021-12-03 Improving Predictions of Tail-end Labels using Concatenated BioMed-Transformers for Long Medical Documents Vithya Yogarajan, Bernhard Pfahringer, Tony Smith, Jacob Montiel arXiv_AI arXiv_AI Transformer Knowledge Classification Relation Medical Language_Model Prediction PDF
2021-12-02 InfoLM: A New Metric to Evaluate Summarization & Data2Text Generation Pierre Colombo, Chloe Clave, Pablo Piantanida arXiv_AI arXiv_AI Relation Summarization Text_Generation Language_Model PDF
2021-12-02 DenseCLIP: Language-Guided Dense Prediction with Context-Aware Prompting Yongming Rao, Wenliang Zhao, Guangyi Chen, Yansong Tang, Zheng Zhu, Guan Huang, Jie Zhou, Jiwen Lu arXiv_AI arXiv_AI Segmentation Semantic_Segmentation Represenation_Learning Knowledge Classification Detection Object_Detection Language_Model Prediction Matching PDF
2021-12-02 CO2Sum:Contrastive Learning for Factual-Consistent Abstractive Summarization Wei Liu, Huanqin Wu, Wenjing Mu, Zhen Li, Tao Chen, Dan Nie arXiv_CL arXiv_CL Pose Contrastive_Learning Summarization Language_Model PDF
2021-12-02 DKPLM: Decomposable Knowledge-enhanced Pre-trained Language Model for Natural Language Understanding Taolin Zhang, Chengyu Wang, Nan Hu, Minghui Qiu, Chengguang Tang, Xiaofeng He, Jun Huang arXiv_CL arXiv_CL Reconstruction Embedding Zero-Shot Knowledge Knowledge_Graph Pose Relation Inference Language_Model PDF
2021-12-01 A General Language Assistant as a Laboratory for Alignment Amanda Askell, Yuntao Bai, Anna Chen, Dawn Drain, Deep Ganguli, Tom Henighan, Andy Jones, Nicholas Joseph, Ben Mann, Nova DasSarma, Nelson Elhage, Zac Hatfield-Dodds, Danny Hernandez, Jackson Kernion, Kamal Ndousse, Catherine Olsson, Dario Amodei, Tom Brown, Jack Clark, Sam McCandlish, Chris Olah, Jared Kaplan arXiv_CL arXiv_CL Pose Language_Model PDF
2021-12-01 Iconary: A Pictionary-Based Game for Testing Multimodal Communication with Drawings and Text Christopher Clark, Jordi Salvador, Dustin Schwenk, Derrick Bonafilia, Mark Yatskar, Eric Kolve, Alvaro Herrasti, Jonghyun Choi, Sachin Mehta, Sam Skjonsberg, Carissa Schoenick, Aaron Sarnat, Hannaneh Hajishirzi, Aniruddha Kembhavi, Oren Etzioni, Ali Farhadi arXiv_AI arXiv_AI Gesture Knowledge Pose Language_Model PDF
2021-12-01 Controlling Conditional Language Models with Distributional Policy Gradients Tomasz Korbak, Hady Elsahar, German Kruszewski, Marc Dymetman arXiv_CL arXiv_CL Self-Supervised Pose Summarization Language_Model PDF
2021-12-01 Towards More Robust Natural Language Understanding Xinliang Frederick Zhang arXiv_AI arXiv_AI Knowledge Adversarial Deep_Learning Language_Model PDF
2021-12-01 Building astroBERT, a language model for Astronomy & Astrophysics Felix Grezes, Sergi Blanco-Cuaresma, Alberto Accomazzi, Michael J. Kurtz, Golnaz Shapurian, Edwin Henneken, Carolyn S. Grant, Donna M. Thompson, Roman Chyla, Stephen McDonald, Timothy W. Hostetler, Matthew R. Templeton, Kelly E. Lockhart, Nemanja Martinovic, Shinyi Chen, Chris Tanner, Pavlos Protopapas arXiv_CL arXiv_CL Recognition Bert Language_Model PDF
2021-12-01 Domain-oriented Language Pre-training with Adaptive Hybrid Masking and Optimal Transport Alignment Denghui Zhang, Zixuan Yuan, Yanchi Liu, Hao Liu, Fuzhen Zhuang, Hui Xiong, Haifeng Chen arXiv_CL arXiv_CL Bert Knowledge Language_Model PDF
2021-12-01 DPRK-BERT: The Supreme Language Model Arda Akdemir, Yeojoo Jeon arXiv_CL arXiv_CL Unsupervised Bert Pose Language_Model PDF
2021-12-01 NER-BERT: A Pre-trained Model for Low-Resource Entity Tagging Zihan Liu, Feijun Jiang, Yuxiang Hu, Chen Shi, Pascale Fung arXiv_AI arXiv_AI Recognition Bert Language_Model PDF
2021-12-01 Interactive Model with Structural Loss for Language-based Abductive Reasoning Linhao Li, Ming Xu, Yongfeng Dong, Xin Li, Ao Wang, Qinghua Hu arXiv_AI arXiv_AI Bert Pose Action Relation Inference Language_Model PDF
2021-12-01 Wiki to Automotive: Understanding the Distribution Shift and its impact on Named Entity Recognition Anmol Nayak, Hari Prasad Timmapathini arXiv_CL arXiv_CL Transfer_Learning Recognition Bert Sparse Language_Model PDF
2021-11-30 Dyna-bAbI: unlocking bAbI's potential with dynamic synthetic benchmarking Ronen Tamari, Kyle Richardson, Aviad Sar-Shalom, Noam Kahlon, Nelson Liu, Reut Tsarfaty, Dafna Shahaf arXiv_AI arXiv_AI Pose Language_Model PDF
2021-11-30 Automatic Extraction of Medication Names in Tweets as Named Entity Recognition Carol Anderson, Bo Liu, Anas Abidin, Hoo-Chang Shin, Virginia Adams arXiv_CL arXiv_CL Recognition OCR Bert Action Classification Medical Language_Model Prediction PDF
2021-11-30 Chemical Identification and Indexing in PubMed Articles via BERT and Text-to-Text Approaches Virginia Adams, Hoo-Chang Shin, Carol Anderson, Bo Liu, Anas Abidin arXiv_CL arXiv_CL Embedding Recognition OCR Bert Language_Model PDF
2021-11-30 Zero-Shot Semantic Segmentation via Spatial and Multi-Scale Aware Visual Class Embedding Sungguk Cha, Yooseung Wang arXiv_CV arXiv_CV Segmentation Embedding Semantic_Segmentation Zero-Shot Pose Attention Language_Model PDF
2021-11-29 A Simple Long-Tailed Recognition Baseline via Vision-Language Model Teli Ma, Shijie Geng, Mengmeng Wang, Jing Shao, Jiasen Lu, Hongsheng Li, Peng Gao, Yu Qiao arXiv_CV arXiv_CV Recognition Pose Contrastive_Learning Language_Model Matching PDF
2021-11-29 Linguistic Knowledge in Data Augmentation for Natural Language Processing: An Example on Chinese Question Matching Zhengxiang Wang arXiv_CL arXiv_CL Knowledge Pose Classification Attention Language_Model Matching PDF
2021-11-29 Mixed Precision Low-bit Quantization of Neural Network Language Models for Speech Recognition Junhao Xu, Jianwei Yu, Shoukang Hu, Xunying Liu, Helen Meng arXiv_CL arXiv_CL Transformer NAS Quantization Gradient_Descent Recognition RNN Speech Pose Speech_Recognition Language_Model PDF
2021-11-29 Zero-Shot Image-to-Text Generation for Visual-Semantic Arithmetic Yoad Tewel, Yoav Shalev, Idan Schwartz, Lior Wolf arXiv_AI arXiv_AI Image_Caption Zero-Shot Knowledge Pose Contrastive_Learning Text_Generation Caption Inference Language_Model Matching PDF
2021-11-29 Mixed Precision of Quantization of Transformer Language Models for Speech Recognition Junhao Xu, Shoukang Hu, Jianwei Yu, Xunying Liu, Helen Meng arXiv_SD arXiv_SD Transformer NAS Quantization Recognition Speech Pose Speech_Recognition Language_Model PDF
2021-11-29 SimCLAD: A Simple Framework for Contrastive Learning of Acronym Disambiguation Bin Li, Fei Xia, Yixuan Weng, Xiusheng Huang, Bin Sun, Shutao Li arXiv_AI arXiv_AI Pose Contrastive_Learning Language_Model PDF
2021-11-29 PSG: Prompt-based Sequence Generation for Acronym Extraction Bin Li, Fei Xia, Yixuan Weng, Xiusheng Huang, Bin Sun, Shutao Li arXiv_AI arXiv_AI Knowledge Pose Action Language_Model PDF
2021-11-29 Customer Sentiment Analysis using Weak Supervision for Customer-Agent Chat Navdeep Jain arXiv_AI arXiv_AI Bert Knowledge Review Sentiment Language_Model PDF
2021-11-28 Explore the Potential Performance of Vision-and-Language Navigation Model: a Snapshot Ensemble Method Wenda Qin, Teruhisa Misu, Derry Wijaya arXiv_AI arXiv_AI Bert Pose Action Language_Model Prediction PDF
2021-11-28 Zero-Shot Cross-Lingual Transfer in Legal Domain Using Transformer models Zein Shaheen, Gerhard Wohlgenannt, Dmitry Muromtsev arXiv_AI arXiv_AI Transformer Bert Zero-Shot Text_Classification Classification Language_Model PDF
2021-11-28 FastTrees: Parallel Latent Tree-Induction for Faster Sequence Encoding Bill Tuck Weng Pung, Alvin Chan arXiv_CL arXiv_CL Transformer RNN Pose Sentiment Inference Language_Model PDF
2021-11-27 Exploring Low-Cost Transformer Model Compression for Large-Scale Commercial Reply Suggestions Vaishnavi Shrivastava, Radhika Gaonkar, Shashank Gupta, Abhishek Jha arXiv_CL arXiv_CL Transformer Language_Model Recommendation PDF
2021-11-27 Language models in word sense disambiguation for Polish Agnieszka Mykowiecka, Agnieszka A. Mykowiecka, Piotr Rychlik arXiv_AI arXiv_AI Unsupervised Pose Language_Model PDF
2021-11-27 Common Sense Knowledge Learning for Open Vocabulary Neural Reasoning: A First View into Chronic Disease Literature Ignacio Arroyo-Fernández, José Armando Sánchez-Rojas, Arturo Tellez-Velázquez, Flavio Juárez-Martínez, Raúl Cruz-Barbosa, Enrique Guzmán-Ramírez, Yalbi Itzel Balderas-Martínez arXiv_AI arXiv_AI Knowledge Pose Attention Inference Language_Model PDF
2021-11-26 Do Language Models Have Beliefs? Methods for Detecting, Updating, and Visualizing Model Beliefs Peter Hase, Mona Diab, Asli Celikyilmaz, Xian Li, Zornitsa Kozareva, Veselin Stoyanov, Mohit Bansal, Srinivasan Iyer arXiv_AI arXiv_AI Face Language_Model PDF
2021-11-26 Predicting Document Coverage for Relation Extraction Sneha Singhania, Simon Razniewski, Gerhard Weikum arXiv_AI arXiv_AI Bert Knowledge Action Relation Relation_Extraction Language_Model Prediction PDF
2021-11-26 Predict, Prevent, and Evaluate: Disentangled Text-Driven Image Manipulation Empowered by Pre-Trained Vision-Language Model Zipeng Xu, Tianwei Lin, Hao Tang, Fu Li, Dongliang He, Nicu Sebe, Radu Timofte, Luc Van Gool, Errui Ding arXiv_CV arXiv_CV Pose Face Quantitative Language_Model PDF
2021-11-25 Transformer-based Korean Pretrained Language Models: A Survey on Three Years of Progress Kichang Yang arXiv_CL arXiv_CL Transformer Bert Survey Attention GAN Language_Model PDF
2021-11-25 TunBERT: Pretrained Contextualized Text Representation for Tunisian Dialect Abir Messaoudi, Ahmed Cheikhrouhou, Hatem Haddad, Nourchene Ferchichi, Moez BenHajhmida, Abir Korched, Malek Naski, Faten Ghriss, Amine Kerkeni arXiv_CL arXiv_CL Transformer Bert Sparse Pose Sentiment Attention Language_Model PDF
2021-11-24 Universal Captioner: Long-Tail Vision-and-Language Model Training through Content-Style Separation Marcella Cornia, Lorenzo Baraldi, Giuseppe Fiameni, Rita Cucchiara arXiv_AI arXiv_AI Image_Caption Zero-Shot Pose Caption Language_Model PDF
2021-11-24 ViCE: Self-Supervised Visual Concept Embeddings as Contextual and Pixel Appearance Invariant Semantic Representations Robin Karlsson, Tomoki Hayashi, Keisuke Fujii, Alexander Carballo, Kento Ohtani, Kazuya Takeda arXiv_CV arXiv_CV Embedding Self-Supervised Language_Model Matching PDF
2021-11-24 Few-shot Named Entity Recognition with Cloze Questions Valerio La Gatta, Vincenzo Moscato, Marco Postiglione, Giancarlo Sperlì arXiv_AI arXiv_AI Recognition Knowledge Pose Few-Shot Medical Language_Model PDF
2021-11-23 Using Distributional Principles for the Semantic Study of Contextual Language Models Olivier Ferret arXiv_CL arXiv_CL Pose Relation Language_Model PDF
2021-11-23 Crossing the Format Boundary of Text and Boxes: Towards Unified Vision-Language Modeling Zhengyuan Yang, Zhe Gan, Jianfeng Wang, Xiaowei Hu, Faisal Ahmed, Zicheng Liu, Yumao Lu, Lijuan Wang arXiv_CV arXiv_CV Image_Caption Transformer Pose VQA Text_Generation Caption Language_Model Prediction PDF
2021-11-23 Romanian Speech Recognition Experiments from the ROBIN Project Andrei-Marius Avram, Vasile Păiş, Dan Tufiş arXiv_CL arXiv_CL Recognition Restoration Speech Pose Action Speech_Recognition Language_Model PDF
2021-11-23 Triple Classification for Scholarly Knowledge Graph Completion Mohamad Yaser Jaradeh, Kuldeep Singh, Markus Stocker, Sören Auer arXiv_CL arXiv_CL Transformer Bert Knowledge Knowledge_Graph Classification Relation Language_Model Prediction PDF
2021-11-22 Zero-Shot Open-Book Question Answering Sia Gholami, Mehdi Noori arXiv_CL arXiv_CL Zero-Shot Knowledge Pose Language_Model QA PDF
2021-11-22 Knowledge Based Multilingual Language Model Linlin Liu, Xin Li, Ruidan He, Lidong Bing, Shafiq Joty, Luo Si arXiv_AI arXiv_AI Recognition Represenation_Learning Knowledge Knowledge_Graph Classification Relation Language_Model PDF
2021-11-22 Finding the Winning Ticket of BERT for Binary Text Classification via Adaptive Layer Truncation before Fine-tuning Jing Fan, Xin Zhang, Sheng Zhang arXiv_CL arXiv_CL Bert Text_Classification Pose Classification Language_Model Prediction PDF
2021-11-19 Small Changes Make Big Differences: Improving Multi-turn Response Selection in Dialogue Systems via Fine-Grained Contrastive Learning Yuntao Li, Can Xu, Huang Hu, Lei Sha, Yan Zhang, Daxin Jiang arXiv_CL arXiv_CL Pose Contrastive_Learning Language_Model Prediction Matching PDF
2021-11-19 UFO: A UniFied TransfOrmer for Vision-Language Representation Learning Jianfeng Wang, Xiaowei Hu, Zhe Gan, Zhengyuan Yang, Xiyang Dai, Zicheng Liu, Yumao Lu, Lijuan Wang arXiv_CV arXiv_CV Image_Caption Transformer Optimization Represenation_Learning Pose VQA Attention Caption Language_Model Matching PDF
2021-11-18 Swin Transformer V2: Scaling Up Capacity and Resolution Ze Liu, Han Hu, Yutong Lin, Zhuliang Yao, Zhenda Xie, Yixuan Wei, Jia Ning, Yue Cao, Zheng Zhang, Li Dong, Furu Wei, Baining Guo arXiv_CV arXiv_CV Transformer Segmentation Semantic_Segmentation Self-Supervised Face Action Classification Detection Object_Detection Attention Image_Classification Language_Model PDF
2021-11-18 Supporting Undotted Arabic with Pre-trained Language Models Aviad Rom, Kfir Bar arXiv_CL arXiv_CL Classification Language_Model PDF
2021-11-18 ClipCap: CLIP Prefix for Image Captioning Ron Mokady, Amir Hertz, Amit H. Bermano arXiv_CV arXiv_CV Image_Caption Pose Quantitative Caption Language_Model PDF
2021-11-18 To Augment or Not to Augment? A Comparative Study on Text Augmentation Techniques for Low-Resource NLP Gözde Gül Şahin arXiv_AI arXiv_AI Bert Speech Language_Model PDF
2021-11-18 How Emotionally Stable is ALBERT? Testing Robustness with Stochastic Weight Averaging on a Sentiment Analysis Task Urja Khurana, Eric Nalisnick, Antske Fokkens arXiv_CL arXiv_CL Gradient_Descent Bert Emotion Sentiment Language_Model PDF
2021-11-18 LAnoBERT : System Log Anomaly Detection based on BERT Masked Language Model Yukyung Lee, Jina Kim, Pilsung Kang arXiv_CL arXiv_CL Unsupervised Bert Adversarial Pose Detection Inference Language_Model PDF
2021-11-18 DeBERTaV3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding Sharing Pengcheng He, Jianfeng Gao, Weizhu Chen arXiv_CL arXiv_CL Embedding Bert Zero-Shot Pose Detection Inference Language_Model PDF
2021-11-18 How much do language models copy from their training data? Evaluating linguistic novelty in text generation using RAVEN R. Thomas McCoy, Paul Smolensky, Tal Linzen, Jianfeng Gao, Asli Celikyilmaz arXiv_CL arXiv_CL Transformer RNN Action Text_Generation Language_Model PDF
2021-11-18 SDCUP: Schema Dependency-Enhanced Curriculum Pre-Training for Table Semantic Parsing Bowen Qin, Lihan Wang, Binyuan Hui, Ruiying Geng, Zheng Cao, Min Yang, Jian Sun, Yongbin Li arXiv_CL arXiv_CL Represenation_Learning Pose Action Relation Attention Language_Model PDF
2021-11-18 RoBERTuito: a pre-trained language model for social media text in Spanish Juan Manuel Pérez, Damián A. Furman, Laura Alonso Alemany, Franco Luque arXiv_CL arXiv_CL Transformer Transfer_Learning Bert Face Medical Language_Model PDF
2021-11-18 Towards Open Vocabulary Object Detection without Human-provided Bounding Boxes Mingfei Gao, Chen Xing, Juan Carlos Niebles, Junnan Li, Ran Xu, Wenhao Liu, Caiming Xiong arXiv_CV arXiv_CV Zero-Shot Pose Detection Object_Detection Language_Model PDF
2021-11-17 Induce, Edit, Retrieve:Language Grounded Multimodal Schema for Instructional Video Retrieval Yue Yang, Joongwon Kim, Artemis Panagopoulou, Mark Yatskar, Chris Callison-Burch arXiv_CV arXiv_CV Zero-Shot Pose Language_Model Video_Retrieval PDF
2021-11-17 Green CWS: Extreme Distillation and Efficient Decode Method Towards Industrial Application Yulan Hu, Yong Liu arXiv_AI arXiv_AI Transformer Segmentation Bert Knowledge Pose Inference Language_Model PDF
2021-11-17 Guiding Generative Language Models for Data Augmentation in Few-Shot Text Classification Aleksandra Edwards, Asahi Ushio, Jose Camacho-Collados, Hélène de Ribaupierre, Alun Preece arXiv_CL arXiv_CL Text_Classification Classification Few-Shot Language_Model PDF
2021-11-17 EMScore: Evaluating Video Captioning via Coarse-Grained and Fine-Grained Embedding Matching Yaya Shi, Xu Yang, Haiyang Xu, Chunfeng Yuan, Bing Li, Weiming Hu, Zheng-Jun Zha arXiv_CV arXiv_CV Embedding Video_Caption Pose Relation Caption Activity Language_Model Matching PDF
2021-11-16 A Comparative Study on Transfer Learning and Distance Metrics in Semantic Clustering over the COVID-19 Tweets Elnaz Zafarani-Moattar, Mohammad Reza Kangavari, Amir Masoud Rahmani arXiv_CL arXiv_CL Embedding Transfer_Learning Bert Action Detection Language_Model PDF
2021-11-16 NVIDIA NeMo Neural Machine Translation Systems for English-German and English-Russian News and Biomedical Tasks at WMT21 Sandeep Subramanian, Oleksii Hrinchuk, Virginia Adams, Oleksii Kuchaiev arXiv_CL arXiv_CL Transformer Knowledge Medical Language_Model PDF
2021-11-16 Interpreting Language Models Through Knowledge Graph Extraction Vinitra Swamy, Angelika Romanou, Martin Jaggi arXiv_CL arXiv_CL Transformer Bert Knowledge Knowledge_Graph Speech Pose Action Quantitative Relation Language_Model PDF
2021-11-16 Improving the robustness and accuracy of biomedical language models through adversarial training Milad Moradi, Matthias Samwald arXiv_CL arXiv_CL Transformer Bert Adversarial Medical Language_Model PDF
2021-11-16 Integrated Semantic and Phonetic Post-correction for Chinese Speech Recognition Yi-Chang Chen, Chun-Yen Cheng, Chien-An Chen, Ming-Chieh Sung, Yi-Ren Yeh arXiv_CL arXiv_CL Recognition Bert Speech Pose Speech_Recognition Language_Model PDF
2021-11-16 An Empirical Study of Finding Similar Exercises Tongwen Huang, Xihua Li arXiv_AI arXiv_AI Bert Pose Language_Model PDF
2021-11-16 Solving Probability and Statistics Problems by Program Synthesis Leonard Tang, Elizabeth Ke, Nikhil Singh, Nakul Verma, Iddo Drori arXiv_CL arXiv_CL Transformer Language_Model PDF
2021-11-16 Meeting Summarization with Pre-training and Clustering Methods Andras Huebner, Wei Ji, Xiang Xiao arXiv_CL arXiv_CL Transformer Embedding Summarization Language_Model PDF
2021-11-16 Adversarially Constructed Evaluation Sets Are More Challenging, but May Not Be Fair Jason Phang, Angelica Chen, William Huang, Samuel R. Bowman arXiv_CL arXiv_CL Adversarial Pose Language_Model QA PDF
2021-11-15 Joint Unsupervised and Supervised Training for Multilingual ASR Junwen Bai, Bo Li, Yu Zhang, Ankur Bapna, Nikhil Siddhartha, Khe Chai Sim, Tara N. Sainath arXiv_CL arXiv_CL Unsupervised Transfer_Learning Recognition RNN Speech Self-Supervised Pose Speech_Recognition Language_Model PDF
2021-11-15 Assessing gender bias in medical and scientific masked language models with StereoSet Robert Robinson arXiv_CL arXiv_CL Bert Pose Medical Language_Model PDF
2021-11-15 Semantically Grounded Object Matching for Robust Robotic Scene Rearrangement Walter Goodwin, Sagar Vaze, Ioannis Havoutis, Ingmar Posner arXiv_CV arXiv_CV Recognition Detection Object_Detection Inference Language_Model Matching PDF
2021-11-15 Attention based end to end Speech Recognition for Voice Search in Hindi and English Raviraj Joshi, Venkateshan Kannan arXiv_SD arXiv_SD Recognition Speech Deep_Learning Attention Speech_Recognition Language_Model PDF
2021-11-15 iBOT: Image BERT Pre-Training with Online Tokenizer Jinghao Zhou, Chen Wei, Huiyu Wang, Wei Shen, Cihang Xie, Alan Yuille, Tao Kong arXiv_CV arXiv_CV Transformer Segmentation Semantic_Segmentation Bert Self-Supervised Classification Detection Object_Detection Image_Classification Language_Model Prediction PDF
2021-11-15 Testing the Generalization of Neural Language Models for COVID-19 Misinformation Detection Jan Philip Wahle, Nischal Ashok, Terry Ruas, Norman Meuschke, Tirthankar Ghosal, Bela Gipp arXiv_AI arXiv_AI Transformer Pose Detection Language_Model PDF
2021-11-15 Data Augmentation for Speech Recognition in Maltese: A Low-Resource Perspective Carlos Mena, Andrea DeMarco, Claudia Borg, Lonneke van der Plas, Albert Gatt arXiv_CL arXiv_CL Unsupervised Recognition Sparse Speech Speech_Recognition Language_Model PDF
2021-11-15 Calculating Question Similarity is Enough:A New Method for KBQA Tasks Hanyu Zhao, Sha Yuan, Jiahong Leng, Xiang Pan, Guoqiang Wang arXiv_AI arXiv_AI Recognition Knowledge Knowledge_Graph Pose Action Relation Language_Model Prediction QA PDF
2021-11-13 Explainable Semantic Space by Grounding Language to Vision with Cross-Modal Contrastive Learning Yizhen Zhang, Minkyu Choi, Kuan Han, Zhongming Liu arXiv_CL arXiv_CL Embedding Bert Knowledge Contrastive_Learning Action Relation Attention Visual_Relation Language_Model PDF
2021-11-13 SocialBERT -- Transformers for Online SocialNetwork Language Modelling Ilia Karpov, Nick Kartashev arXiv_AI arXiv_AI Transformer Embedding Bert Knowledge Pose Language_Model PDF
2021-11-13 Extracting and filtering paraphrases by bridging natural language inference and paraphrasing Matej Klemen, Marko Robnik-Šikonja arXiv_CL arXiv_CL Transformer Pose Action Inference Language_Model PDF
2021-11-12 On Transferability of Prompt Tuning for Natural Language Understanding Yusheng Su, Xiaozhi Wang, Yujia Qin, Chi-Min Chan, Yankai Lin, Zhiyuan Liu, Peng Li, Juanzi Li, Lei Hou, Maosong Sun, Jie Zhou arXiv_CL arXiv_CL Optimization Knowledge Language_Model PDF
2021-11-12 Extraction of Medication Names from Twitter Using Augmentation and an Ensemble of Language Models Igor Kulev, Berkay Köprü, Raul Rodriguez-Esteban, Diego Saldana, Yi Huang, Alessandro La Torraca, Elif Ozkirimli arXiv_CL arXiv_CL OCR Pose Action Language_Model PDF
2021-11-12 PESTO: Switching Point based Dynamic and Relative Positional Encoding for Code-Mixed Languages Mohsin Ali, Kandukuri Sai Teja, Sumanth Manduru, Parth Patwa, Amitava Das arXiv_AI arXiv_AI Embedding Language_Model PDF
2021-11-11 SynthBio: A Case Study in Human-AI Collaborative Curation of Text Datasets Ann Yuan, Daphne Ippolito, Vitaly Nikolaev, Chris Callison-Burch, Andy Coenen, Sebastian Gehrmann arXiv_AI arXiv_AI Pose Language_Model PDF
2021-11-11 Character-level HyperNetworks for Hate Speech Detection Tomer Wullach, Amir Adler, Einat Minkov arXiv_CL arXiv_CL Speech Pose Deep_Learning Detection Language_Model PDF
2021-11-11 Self-Normalized Importance Sampling for Neural Language Modeling Zijian Yang, Yingbo Gao, Alexander Gerstenberger, Jintao Jiang, Ralf Schlüter, Hermann Ney arXiv_CL arXiv_CL Recognition Speech Pose Speech_Recognition Language_Model PDF
2021-11-11 CU-UD: text-mining drug and chemical-protein interactions with ensembles of BERT-based models Mehmet Efruz Karabulut, K. Vijay-Shanker, Yifan Peng arXiv_AI arXiv_AI OCR Bert Action Relation Language_Model PDF
2021-11-11 Improving Large-scale Language Models and Resources for Filipino Jan Christian Blaise Cruz, Charibeth Cheng arXiv_CL arXiv_CL Transformer Bert Classification Language_Model PDF
2021-11-11 HMD-AMP: Protein Language-Powered Hierarchical Multi-label Deep Forest for Annotating Antimicrobial Peptides Qinze Yu, Zhihang Dong, Xingyu Fan, Licheng Zong, Yu Li arXiv_AI arXiv_AI Classification Deep_Learning Language_Model PDF
2021-11-10 Prune Once for All: Sparse Pre-Trained Language Models Ofir Zafrir, Ariel Larey, Guy Boudoukh, Haihao Shen, Moshe Wasserblat arXiv_AI arXiv_AI Transformer Quantization Transfer_Learning Bert Sparse Knowledge Pose Language_Model PDF
2021-11-10 Pre-trained Transformer-Based Approach for Arabic Question Answering : A Comparative Study Kholoud Alsubhi, Amani Jamal, Areej Alhothali arXiv_CL arXiv_CL Transformer Bert Language_Model QA PDF
2021-11-09 Reason first, then respond: Modular Generation for Knowledge-infused Dialogue Leonard Adolphs, Kurt Shuster, Jack Urbanek, Arthur Szlam, Jason Weston arXiv_AI arXiv_AI Zero-Shot Knowledge Pose Face Language_Model QA PDF
2021-11-09 FPM: A Collection of Large-scale Foundation Pre-trained Language Models Dezhou Shen arXiv_AI arXiv_AI Transformer Bert Classification Language_Model PDF
2021-11-08 Explaining Face Presentation Attack Detection Using Natural Language Hengameh Mirzaalian, Mohamed E. Hussein, Leonidas Spinoulas, Jonathan May, Wael Abd-Almageed arXiv_CV arXiv_CV RNN Knowledge Face Quantitative Classification Detection Attention Language_Model Prediction PDF
2021-11-07 TaCL: Improving BERT Pre-training with Token-aware Contrastive Learning Yixuan Su, Fangyu Liu, Zaiqiao Meng, Lei Shu, Ehsan Shareghi, Nigel Collier arXiv_CL arXiv_CL Unsupervised Bert Pose Contrastive_Learning Language_Model PDF
2021-11-07 Machine-in-the-Loop Rewriting for Creative Image Captioning Vishakh Padmakumar, He He arXiv_CL arXiv_CL Image_Caption Caption Language_Model PDF
2021-11-07 Look at the Variance! Efficient Black-box Explanations with Sobol-based Sensitivity Analysis Thomas Fel, Remi Cadene, Mathieu Chalvidal, Matthieu Cord, David Vigouroux, Thomas Serre arXiv_AI arXiv_AI Pose Action Language_Model Prediction PDF
2021-11-07 NLP From Scratch Without Large-Scale Pretraining: A Simple and Efficient Framework Xingcheng Yao, Yanan Zheng, Xiaocong Yang, Zhilin Yang arXiv_CL arXiv_CL OCR Bert Pose Classification Language_Model PDF
2021-11-07 Cross-modal Zero-shot Hashing by Label Attributes Embedding Runmin Wang, Guoxian Yu, Lei Liu, Lizhen Cui, Carlotta Domeniconi, Xiangliang Zhang arXiv_AI arXiv_AI Embedding Zero-Shot Knowledge Action Language_Model PDF
2021-11-06 Tip-Adapter: Training-free CLIP-Adapter for Better Vision-Language Modeling Renrui Zhang, Rongyao Fang, Peng Gao, Wei Zhang, Kunchang Li, Jifeng Dai, Yu Qiao, Hongsheng Li arXiv_CV arXiv_CV Zero-Shot Knowledge Pose Classification Few-Shot Language_Model PDF
2021-11-06 Patent Sentiment Analysis to Highlight Patent Paragraphs Renukswamy Chikkamath, Vishvapalsinhji Ramsinh Parmar, Christoph Hewel, Markus Endres arXiv_CL arXiv_CL Pose Deep_Learning Sentiment Language_Model PDF
2021-11-06 Focusing on Possible Named Entities in Active Named Entity Label Acquisition Ali Osman Berk Sapci, Oznur Tastan, Reyyan Yeniterzi arXiv_CL arXiv_CL Recognition Pose Deep_Learning Attention Language_Model Prediction PDF
2021-11-05 Conversational speech recognition leveraging effective fusion methods for cross-utterance language modeling Bi-Cheng Yan, Hsin-Wei Wang, Shih-Hsuan Chiu, Hsuan-Sheng Chiu, Berlin Chen arXiv_CL arXiv_CL Embedding Recognition Bert Speech Action Relation Speech_Recognition Language_Model Prediction PDF
2021-11-04 How Do Neural Sequence Models Generalize? Local and Global Context Cues for Out-of-Distribution Prediction Anthony Bau, Jacob Andreas arXiv_CL arXiv_CL Transformer RNN Regularization Relation Language_Model Prediction PDF
2021-11-04 Unsupervised and Distributional Detection of Machine-Generated Text Matthias Gallé, Jos Rozen, Germán Kruszewski, Hady Elsahar arXiv_CL arXiv_CL Unsupervised Pose Action Detection Language_Model PDF
2021-11-04 A text autoencoder from transformer for fast encoding language representation Tan Huang arXiv_AI arXiv_AI Transformer Embedding Bert Pose Classification Attention Language_Model PDF
2021-11-04 Adversarial GLUE: A Multi-Task Benchmark for Robustness Evaluation of Language Models Boxin Wang, Chejian Xu, Shuohang Wang, Zhe Gan, Yu Cheng, Jianfeng Gao, Ahmed Hassan Awadallah, Bo Li arXiv_CL arXiv_CL Adversarial Pose Quantitative Language_Model PDF
2021-11-04 CoreLM: Coreference-aware Language Model Fine-Tuning Nikolaos Stylianou, Ioannis Vlahavas arXiv_AI arXiv_AI Transformer Pose Action Language_Model PDF
2021-11-04 Response Generation with Context-Aware Prompt Learning Xiaodong Gu, Kang Min Yoo, Sang-Woo Lee arXiv_CL arXiv_CL Embedding Knowledge Language_Model PDF
2021-11-04 Lexically Aware Semi-Supervised Learning for OCR Post-Correction Shruti Rijhwani, Daisy Rosenblum, Antonios Anastasopoulos, Graham Neubig arXiv_CL arXiv_CL Recognition OCR Optical_Character Pose Language_Model PDF
2021-11-04 On Semantic Cognition, Inductive Generalization, and Language Models Kanishka Misra arXiv_AI arXiv_AI Recognition Knowledge Pose Language_Model PDF
2021-11-03 HmBlogs: A big general Persian corpus Hamzeh Motahari Khansari, Mehrnoush Shamsfard arXiv_CL arXiv_CL Embedding Language_Model PDF
2021-11-03 An Explanation of In-context Learning as Implicit Bayesian Inference Sang Michael Xie, Aditi Raghunathan, Percy Liang, Tengyu Ma arXiv_CL arXiv_CL Transformer RNN Inference Language_Model Prediction PDF
2021-11-03 OpenPrompt: An Open-source Framework for Prompt-learning Ning Ding, Shengding Hu, Weilin Zhao, Yulin Chen, Zhiyuan Liu, Hai-Tao Zheng, Maosong Sun arXiv_AI arXiv_AI Pose Face Language_Model Prediction PDF
2021-11-03 Leveraging Advantages of Interactive and Non-Interactive Models for Vector-Based Cross-Lingual Information Retrieval Linlong Xu, Baosong Yang, Xiaoyu Lv, Tianchi Bi, Dayiheng Liu, Haibo Zhang arXiv_CL arXiv_CL Embedding Bert Knowledge Pose Language_Model PDF
2021-11-02 LMdiff: A Visual Diff Tool to Compare Language Models Hendrik Strobelt, Benjamin Hoover, Arvind Satyanarayan, Sebastian Gehrmann arXiv_CL arXiv_CL Language_Model PDF
2021-11-02 Detection of Hate Speech using BERT and Hate Speech Word Embedding with Deep Model Hind Saleh, Areej Alhothali, Kawthar Moria arXiv_CL arXiv_CL Embedding Transfer_Learning Bert RNN Speech Classification Detection Language_Model PDF
2021-11-02 Integrating Pretrained Language Model for Dialogue Policy Learning Hongru Wang, Huimin Wang, Zezhong Wang, Kam-Fai Wong arXiv_AI arXiv_AI Reinforcement_Learning Sparse Adversarial Pose Action Language_Model Prediction PDF
2021-11-01 Recent Advances in Natural Language Processing via Large Pre-Trained Language Models: A Survey Bonan Min, Hayley Ross, Elior Sulem, Amir Pouran Ben Veyseh, Thien Huu Nguyen, Oscar Sainz, Eneko Agirre, Ilana Heinz, Dan Roth arXiv_AI arXiv_AI Transformer Bert Pose Survey Text_Generation Language_Model PDF
2021-11-01 PerSpeechNorm: A Persian Toolkit for Speech Processing Normalization Romina Oji, Seyedeh Fatemeh Razavi, Sajjad Abdi Dehsorkh, Alireza Hariri, Hadi Asheri, Reshad Hosseini arXiv_CL arXiv_CL Knowledge Speech Pose Language_Model PDF
2021-11-01 With a Little Help from my Temporal Context: Multimodal Egocentric Action Recognition Evangelos Kazakos, Jaesung Huh, Arsha Nagrani, Andrew Zisserman, Dima Damen arXiv_CV arXiv_CV Transformer Recognition Pose Action_Recognition Action Language_Model Prediction PDF
2021-11-01 Hex2vec -- Context-Aware Embedding H3 Hexagons with OpenStreetMap Tags Szymon Woźniak, Piotr Szymański arXiv_AI arXiv_AI Embedding Represenation_Learning Pose Detection Inference Language_Model PDF
2021-11-01 Unsupervised Discovery of Unaccusative and Unergative Verbs Sharid Loáiciga, Luca Bevacqua, Christian Hardmeier arXiv_CL arXiv_CL Unsupervised Language_Model PDF
2021-11-01 Domain-adaptation of spherical embeddings Mihalis Gongolidis, Jeremy Minton, Ronin Wu, Valentin Stauber, Jason Hoelscher-Obermaier, Viktor Botev arXiv_CL arXiv_CL Embedding Pose Classification Relation Language_Model PDF
2021-11-01 Unsupervised Domain Adaptation with Adapter Rongsheng Zhang, Yinhe Zheng, Xiaoxi Mao, Minlie Huang arXiv_CL arXiv_CL Unsupervised Knowledge Language_Model PDF
2021-10-31 R-BERT-CNN: Drug-target interactions extraction from biomedical literature Jehad Aldahdooh, Ziaurrehman Tanoli, Jing Tang arXiv_AI arXiv_AI OCR Bert Knowledge Action Deep_Learning Relation Medical CNN Language_Model PDF
2021-10-31 Towards Language Modelling in the Speech Domain Using Sub-word Linguistic Units Anurag Katakkar, Alan W Black arXiv_CL arXiv_CL RNN Speech Pose Language_Model Prediction PDF
2021-10-31 A Systematic Investigation of Commonsense Understanding in Large Language Models Xiang Lorraine Li, Adhi Kuncoro, Cyprien de Masson d'Autume, Phil Blunsom, Aida Nematzadeh arXiv_CL arXiv_CL Zero-Shot Knowledge Few-Shot Language_Model PDF
2021-10-31 FinEAS: Financial Embedding Analysis of Sentiment Asier Gutiérrez-Fandiño, Miquel Noguer i Alonso, Petter Kolm, Jordi Armengol-Estapé arXiv_CL arXiv_CL Transformer Embedding Transfer_Learning Bert Text_Classification RNN Pose Classification Sentiment Language_Model PDF
2021-10-31 PnPOOD : Out-Of-Distribution Detection for Text Classification via Plug andPlay Data Augmentation Mrinal Rawat, Ramya Hebbalaguppe, Lovekesh Vig arXiv_AI arXiv_AI Text_Classification Pose Classification Detection Sentiment Language_Model PDF
2021-10-30 EmpBot: A T5-based Empathetic Chatbot focusing on Sentiments Emmanouil Zaranis, Georgios Paraskevopoulos, Athanasios Katsamanis, Alexandros Potamianos arXiv_AI arXiv_AI Transformer Knowledge Pose Sentiment Language_Model QA PDF
2021-10-30 EventNarrative: A large-scale Event-centric Dataset for Knowledge Graph-to-Text Generation Anthony Colas, Ali Sadeghian, Yue Wang, Daisy Zhe Wang arXiv_CL arXiv_CL Sparse Knowledge Knowledge_Graph Ontology Action Text_Generation Language_Model PDF
2021-10-30 Top1 Solution of QQ Browser 2021 Ai Algorithm Competition Track 1 : Multimodal Video Similarity Zhuoran Ma, Majing Lou, Xuan Ouyang arXiv_CV arXiv_CV Transformer Embedding Action Classification Language_Model PDF
2021-10-30 Magic Pyramid: Accelerating Inference with Early Exiting and Token Pruning Xuanli He, Iman Keivanloo, Yi Xu, Xiang He, Belinda Zeng, Santosh Rajagopalan, Trishul Chilimbi arXiv_CL arXiv_CL Transformer Bert Text_Classification Salient Pose Classification Inference Language_Model PDF
2021-10-30 Backdoor Pre-trained Models Can Transfer to All Lujia Shen, Shouling Ji, Xuhong Zhang, Jinfeng Li, Jing Chen, Jie Shi, Chengfang Fang, Jianwei Yin, Ting Wang arXiv_CL arXiv_CL Recognition Bert Knowledge Pose Face Classification Language_Model PDF
2021-10-30 Automatic Knowledge Augmentation for Generative Commonsense Reasoning Jaehyung Seo, Chanjun Park, Sugyeong Eo, Hyeonseok Moon, Heuiseok Lim arXiv_CL arXiv_CL Knowledge Pose Language_Model PDF
2021-10-30 DSEE: Dually Sparsity-embedded Efficient Tuning of Pre-trained Language Models Xuxi Chen, Tianlong Chen, Yu Cheng, Weizhu Chen, Zhangyang Wang, Ahmed Hassan Awadallah arXiv_CL arXiv_CL Bert Sparse Regularization Pose GAN Inference Language_Model PDF
2021-10-29 MetaICL: Learning to Learn In Context Sewon Min, Mike Lewis, Luke Zettlemoyer, Hannaneh Hajishirzi arXiv_AI arXiv_AI Zero-Shot Classification Detection Few-Shot Inference Language_Model PDF
2021-10-29 Combining Unsupervised and Text Augmented Semi-Supervised Learning for Low Resourced Autoregressive Speech Recognition Chak-Fai Li, Francis Keith, William Hartmann, Matthew Snover arXiv_CL arXiv_CL Unsupervised Recognition Represenation_Learning Knowledge Speech Speech_Recognition Language_Model PDF
2021-10-29 MentalBERT: Publicly Available Pretrained Language Models for Mental Healthcare Shaoxiong Ji, Tianlin Zhang, Luna Ansari, Jie Fu, Prayag Tiwari, Erik Cambria arXiv_CL arXiv_CL Bert Detection Language_Model PDF
2021-10-29 Structure-aware Fine-tuning of Sequence-to-sequence Transformers for Transition-based AMR Parsing Jiawei Zhou, Tahira Naseem, Ramón Fernandez Astudillo, Young-Suk Lee, Radu Florian, Salim Roukos arXiv_CL arXiv_CL Transformer Pose Language_Model PDF
2021-10-29 Pre-training Co-evolutionary Protein Representation via A Pairwise Masked Language Model Liang He, Shizhuo Zhang, Lijun Wu, Huanhuan Xia, Fusong Ju, He Zhang, Siyuan Liu, Yingce Xia, Jianwei Zhu, Pan Deng, Bin Shao, Tao Qin, Tie-Yan Liu arXiv_AI arXiv_AI Represenation_Learning Knowledge Pose Relation Language_Model Prediction PDF
2021-10-28 NxMTransformer: Semi-Structured Sparsification for Natural Language Understanding via ADMM Connor Holmes, Minjia Zhang, Yuxiong He, Bo Wu arXiv_AI arXiv_AI Transformer Optimization Sparse Knowledge Pose Language_Model PDF
2021-10-28 Bridge the Gap Between CV and NLP! A Gradient-based Textual Adversarial Attack Framework Lifan Yuan, Yichi Zhang, Yangyi Chen, Wei Wei arXiv_CL arXiv_CL Embedding Bert Adversarial Pose Language_Model PDF
2021-10-28 'UFAL at MultiLexNorm 2021: Improving Multilingual Lexical Normalization by Fine-tuning ByT5 David Samuel, Milan Straka arXiv_CL arXiv_CL Language_Model PDF
2021-10-28 BERTian Poetics: Constrained Composition with Masked LMs Christopher Akiki, Martin Potthast arXiv_CL arXiv_CL Bert Language_Model PDF
2021-10-28 Semi-Siamese Bi-encoder Neural Ranking Model Using Lightweight Fine-Tuning Euna Jung, Jaekeol Choi, Wonjong Rhee arXiv_CL arXiv_CL Bert Language_Model PDF
2021-10-28 A Sequence to Sequence Model for Extracting Multiple Product Name Entities from Dialog Praneeth Gubbala, Xuan Zhang arXiv_CL arXiv_CL Transformer Recognition Bert Pose Language_Model PDF
2021-10-27 When is BERT Multilingual? Isolating Crucial Ingredients for Cross-lingual Transfer Ameet Deshpande, Partha Talukdar, Karthik Narasimhan arXiv_CL arXiv_CL Embedding Bert Zero-Shot Relation Language_Model PDF
2021-10-27 Discovering Non-monotonic Autoregressive Orderings with Variational Inference Xuanlin Li, Brandon Trabucco, Dong Huk Park, Michael Luo, Sheng Shen, Trevor Darrell, Yang Gao arXiv_AI arXiv_AI Transformer Unsupervised Optimization Knowledge Attention Inference Language_Model PDF
2021-10-27 How Much Coffee Was Consumed During EMNLP 2019? Fermi Problems: A New Reasoning Challenge for AI Ashwin Kalyan, Abhinav Kumar, Arjun Chandrasekaran, Ashish Sabharwal, Peter Clark arXiv_AI arXiv_AI Knowledge Pose Action Language_Model PDF
2021-10-27 Diversity Enhanced Active Learning with Strictly Proper Scoring Rules Wei Tan, Lan Du, Wray Buntine arXiv_AI arXiv_AI Text_Classification Classification Language_Model PDF
2021-10-27 Training Verifiers to Solve Math Word Problems Karl Cobbe, Vineet Kosaraju, Mohammad Bavarian, Jacob Hilton, Reiichiro Nakano, Christopher Hesse, John Schulman arXiv_CL arXiv_CL Transformer Pose Language_Model PDF
2021-10-26 Can Character-based Language Models Improve Downstream Task Performance in Low-Resource and Noisy Language Scenarios? Arij Riabi, Benoît Sagot, Djamé Seddah arXiv_CL arXiv_CL Speech Language_Model PDF
2021-10-26 Hierarchical Transformers Are More Efficient Language Models Piotr Nawrot, Szymon Tworkowski, Michał Tyrolski, Łukasz Kaiser, Yuhuai Wu, Christian Szegedy, Henryk Michalewski arXiv_CL arXiv_CL Transformer Language_Model PDF
2021-10-26 Open Rule Induction Wanyun Cui, Xingran Chen arXiv_CL arXiv_CL Knowledge Pose Action Relation Relation_Extraction Inference Language_Model PDF
2021-10-26 Assessing the Sufficiency of Arguments through Conclusion Generation Timon Gurcke, Milad Alshomary, Henning Wachsmuth arXiv_CL arXiv_CL Text_Classification Classification Relation Language_Model PDF
2021-10-26 AVocaDo: Strategy for Adapting Vocabulary to Downstream Domain Jimin Hong, Taehee Kim, Hyesu Lim, Jaegul Choo arXiv_CL arXiv_CL Embedding Transfer_Learning Regularization Knowledge Review Pose Medical Language_Model PDF
2021-10-25 Distributionally Robust Recurrent Decoders with Random Network Distillation Antonio Valerio Miceli-Barone, Alexandra Birch, Rico Sennrich arXiv_CL arXiv_CL Pose Detection Relation Inference Language_Model PDF
2021-10-25 Revisiting CNN for Highly Inflected Bengali and Hindi Language Modeling Chowdhury Rafeed Rahman, MD. Hasibur Rahman, Mohammad Rafsan, Samiha Zakir, Mohammed Eunus Ali, Rafsanjani Muhammod arXiv_CL arXiv_CL Transformer Bert RNN Pose Deep_Learning CNN Language_Model PDF
2021-10-25 'So You Think You're Funny?': Rating the Humour Quotient in Standup Comedy Anirudh Mittal, Pranav Jeevan, Prerak Gandhi, Diptesh Kanojia, Pushpak Bhattacharyya arXiv_AI arXiv_AI Language_Model PDF
2021-10-25 No News is Good News: A Critique of the One Billion Word Benchmark Helen Ngo, João G.M. Araújo, Jeffrey Hui, Nicholas Frosst arXiv_CL arXiv_CL Language_Model PDF
2021-10-24 Sentence Punctuation for Collaborative Commentary Generation in Esports Live-Streaming Hong Huang, Junjie H. Xu, Xiaoling Ling, Pujana Paliyawan arXiv_CL arXiv_CL Language_Model PDF
2021-10-24 Team Enigma at ArgMining-EMNLP 2021: Leveraging Pre-trained Language Models for Key Point Matching Manav Nitin Kapadnis, Sohan Patnaik, Siba Smarak Panigrahi, Varun Madhavan, Abhilash Nandy arXiv_CL arXiv_CL Language_Model Matching PDF
2021-10-24 Chinese Traditional Poetry Generating System Based on Deep Learning Chenlei Bao, Lican Huang arXiv_CL arXiv_CL Pose Emotion Deep_Learning Attention Language_Model PDF
2021-10-23 Spanish Legalese Language Model and Corpora Asier Gutiérrez-Fandiño, Jordi Armengol-Estapé, Aitor Gonzalez-Agirre, Marta Villegas arXiv_CL arXiv_CL Language_Model PDF
2021-10-23 Optimizing Alignment of Speech and Language Latent Spaces for End-to-End Speech Recognition and Understanding Wei Wang, Shuo Ren, Yao Qian, Shujie Liu, Yu Shi, Yanmin Qian, Michael Zeng arXiv_SD arXiv_SD Embedding Recognition Speech Pose Classification Attention Speech_Recognition Language_Model PDF
2021-10-22 ClimateBert: A Pretrained Language Model for Climate-Related Text Nicolas Webersinke, Mathias Kraus, Julia Anna Bingler, Markus Leippold arXiv_CL arXiv_CL Transformer Bert Text_Classification Pose Classification Sentiment Language_Model PDF
2021-10-22 Cleaning Dirty Books: Post-OCR Processing for Previously Scanned Texts Allen Kim, Charuta Pethe, Naoya Inoue, Steve Skiena arXiv_CL arXiv_CL Recognition OCR Optical_Character Detection Relation Language_Model PDF
2021-10-22 Double Trouble: How to not explain a text classifier's decisions using counterfactuals synthesized by masked language models? Thang M. Pham, Trung Bui, Long Mai, Anh Nguyen arXiv_AI arXiv_AI Bert Inference Language_Model Prediction PDF
2021-10-22 Lightweight Decoding Strategies for Increasing Specificity Katy Ilonka Gero, Chris Kedzie, Savvas Petridis, Lydia Chilton arXiv_CL arXiv_CL Unsupervised Pose Summarization Language_Model PDF
2021-10-22 Learning Text-Image Joint Embedding for Efficient Cross-Modal Retrieval with Deep Feature Engineering Zhongwei Xie, Ling Liu, Yanzhao Wu, Luo Zhong, Lin Li arXiv_CV arXiv_CV Embedding Bert RNN Language_Model PDF
2021-10-22 Text Counterfactuals via Latent Optimization and Shapley-Guided Search Quintin Pope, Xiaoli Z. Fern arXiv_CL arXiv_CL Optimization Classification Language_Model Prediction PDF
2021-10-21 Improving Non-autoregressive Generation with Mixup Training Ting Jiang, Shaohan Huang, Zihan Zhang, Deqing Wang, Fuzhen Zhuang, Furu Wei, Haizhen Huang, Liangjie Zhang, Qi Zhang arXiv_CL arXiv_CL Transformer Pose Summarization Inference Language_Model PDF
2021-10-20 Shaking the foundations: delusions in sequence models for interaction and control Pedro A. Ortega, Markus Kunesch, Grégoire Delétang, Tim Genewein, Jordi Grau-Moya, Joel Veness, Jonas Buchli, Jonas Degrave, Bilal Piot, Julien Perolat, Tom Everitt, Corentin Tallec, Emilio Parisotto, Tom Erez, Yutian Chen, Scott Reed, Marcus Hutter, Nando de Freitas, Shane Legg arXiv_AI arXiv_AI Transformer Pose Action Inference Language_Model PDF
2021-10-20 Contrastive Document Representation Learning with Graph Attention Networks Peng Xu, Xinchi Chen, Xiaofei Ma, Zhiheng Huang, Bing Xiang arXiv_CL arXiv_CL Transformer Embedding Represenation_Learning Pose Contrastive_Learning Classification Attention Language_Model PDF
2021-10-20 Knowledge Graph informed Fake News Classification via Heterogeneous Representation Ensembles Boshko Koloski, Timen Stepišnik-Perdih, Marko Robnik-Šikonja, Senja Pollak, Blaž Škrlj arXiv_AI arXiv_AI Represenation_Learning Knowledge Knowledge_Graph Classification Detection Relation Language_Model PDF
2021-10-20 Knowledge distillation from language model to acoustic model: a hierarchical multi-task learning approach Mun-Hak Lee, Joon-Hyuk Chang arXiv_CL arXiv_CL Recognition Knowledge Speech Self-Supervised Pose Deep_Learning Speech_Recognition Language_Model PDF
2021-10-20 SLAM: A Unified Encoder for Speech and Language Modeling via Speech-Text Joint Pre-Training Ankur Bapna, Yu-an Chung, Nan Wu, Anmol Gulati, Ye Jia, Jonathan H. Clark, Melvin Johnson, Jason Riesa, Alexis Conneau, Yu Zhang arXiv_CL arXiv_CL Unsupervised Recognition Bert Speech SLAM Attention Language_Model Matching PDF
2021-10-20 LMSOC: An Approach for Socially Sensitive Pretraining Vivek Kulkarni, Shubhanshu Mishra, Aria Haghighi arXiv_CL arXiv_CL Transformer Represenation_Learning Pose Language_Model PDF
2021-10-20 Improved Multilingual Language Model Pretraining for Social Media Text via Translation Pair Prediction Shubhanshu Mishra, Aria Haghighi arXiv_CL arXiv_CL Transfer_Learning Bert Sentiment_Classification Zero-Shot Classification Sentiment Language_Model Prediction PDF
2021-10-19 Risks of AI Foundation Models in Education Su Lin Blodgett, Michael Madaio arXiv_AI arXiv_AI Bert Pose Language_Model PDF
2021-10-19 DEEPAG'E: Answering Questions in Portuguese about the Brazilian Environment Flávio Nakasato Cação, Marcos Menon José, André Seidel Oliveira, Stefano Spindola, Anna Helena Reali Costa, Fábio Gagliardi Cozman arXiv_CL arXiv_CL Sparse Language_Model QA PDF
2021-10-18 A Data Bootstrapping Recipe for Low Resource Multilingual Relation Classification Arijit Nag, Bidisha Samanta, Animesh Mukherjee, Niloy Ganguly, Soumen Chakrabarti arXiv_CL arXiv_CL Bert Action Classification Relation Language_Model PDF
2021-10-18 BERMo: What can BERT learn from ELMo? Sangamesh Kodge, Kaushik Roy arXiv_CL arXiv_CL Embedding Bert Pose Face Language_Model Prediction PDF
2021-10-18 NormFormer: Improved Transformer Pretraining with Extra Normalization Sam Shleifer, Jason Weston, Myle Ott arXiv_AI arXiv_AI Transformer Pose Attention Language_Model PDF
2021-10-18 Ceasing hate withMoH: Hate Speech Detection in Hindi-English Code-Switched Language Arushi Sharma, Anubha Kabra, Minni Jain arXiv_AI arXiv_AI Bert Knowledge Speech Pose Quantitative Detection Object_Detection Language_Model PDF
2021-10-18 Automatic Learning of Subword Dependent Model Scales Felix Meyer, Wilfried Michel, Mohammad Zeineldeen, Ralf Schlüter, Hermann Ney arXiv_CL arXiv_CL Recognition Knowledge Speech Pose Attention Speech_Recognition Language_Model PDF
2021-10-18 Deep Transfer Learning & Beyond: Transformer Language Models in Information Systems Research Ross Gruetzemacher, David Paradice arXiv_AI arXiv_AI Transformer Transfer_Learning Review Face Language_Model PDF
2021-10-17 Quantifying the Task-Specific Information in Text-Based Classifications Zining Zhu, Aparna Balagopalan, Marzyeh Ghassemi, Frank Rudzicz arXiv_CL arXiv_CL Knowledge Face Classification Language_Model PDF
2021-10-17 Schrödinger's Tree -- On Syntax and Neural Language Models Artur Kulmizev, Joakim Nivre arXiv_CL arXiv_CL Knowledge Language_Model PDF
2021-10-17 Reminding the Incremental Language Model via Data-Free Self-Distillation Han Wang, Ruiliu Fu, Chengzhang Li, Xuejun Zhang, Jun Zhou, Yonghong Yan arXiv_AI arXiv_AI Knowledge Pose Language_Model PDF
2021-10-17 GNN-LM: Language Modeling based on Global Contexts via GNN Yuxian Meng, Shi Zong, Xiaoya Li, Xiaofei Sun, Tianwei Zhang, Fei Wu, Jiwei Li arXiv_CL arXiv_CL Language_Model PDF
2021-10-16 Transformer with a Mixture of Gaussian Keys Tam Nguyen, Tan M. Nguyen, Dung Le, Khuong Nguyen, Anh Tran, Richard G. Baraniuk, Nhat Ho, Stanley J. Osher arXiv_CL arXiv_CL Transformer Embedding Pose Attention Inference Language_Model PDF
2021-10-16 ASR4REAL: An extended benchmark for speech models Morgane Riviere, Jade Copet, Gabriel Synnaeve arXiv_AI arXiv_AI Speech Language_Model Matching PDF
2021-10-16 FrugalScore: Learning Cheaper, Lighter and Faster Evaluation Metricsfor Automatic Text Generation Moussa Kamal Eddine, Guokan Shang, Antoine J.-P. Tixier, Michalis Vazirgiannis arXiv_CL arXiv_CL Bert Pose Summarization Text_Generation Language_Model PDF
2021-10-16 HRKD: Hierarchical Relational Knowledge Distillation for Cross-domain Language Model Compression Chenhe Dong, Yaliang Li, Ying Shen, Minghui Qiu arXiv_AI arXiv_AI Knowledge Pose Relation Few-Shot Inference Language_Model PDF
2021-10-16 Lifelong Pretraining: Continually Adapting Language Models to Emerging Corpora Xisen Jin, Dejiao Zhang, Henghui Zhu, Wei Xiao, Shang-Wen Li, Xiaokai Wei, Andrew Arnold, Xiang Ren arXiv_CL arXiv_CL Knowledge Language_Model PDF
2021-10-16 Sharpness-Aware Minimization Improves Language Model Generalization Dara Bahri, Hossein Mobahi, Yi Tay arXiv_CL arXiv_CL Optimization Pose Language_Model QA PDF
2021-10-16 An Empirical Survey of the Effectiveness of Debiasing Techniques for Pre-Trained Language Models Nicholas Meade, Elinor Poole-Dayan, Siva Reddy arXiv_CL arXiv_CL Pose Survey Attention Language_Model PDF
2021-10-16 The Power of Prompt Tuning for Low-Resource Semantic Parsing Nathan Schucher, Siva Reddy, Harm de Vries arXiv_CL arXiv_CL Language_Model PDF
2021-10-16 Summ^N: A Multi-Stage Summarization Framework for Long Input Dialogues and Documents Yusen Zhang, Ansong Ni, Ziming Mao, Chen Henry Wu, Chenguang Zhu, Budhaditya Deb, Ahmed H. Awadallah, Dragomir Radev, Rui Zhang arXiv_CL arXiv_CL Salient Pose Summarization Language_Model PDF
2021-10-16 A Good Prompt Is Worth Millions of Parameters? Low-resource Prompt-based Learning for Vision-Language Models Woojeong Jin, Yu Cheng, Yelong Shen, Weizhu Chen, Xiang Ren arXiv_CV arXiv_CV Image_Caption Transformer Zero-Shot Pose VQA Few-Shot GAN Caption Inference Language_Model QA PDF
2021-10-16 Improving Compositional Generalization with Self-Training for Data-to-Text Generation Sanket Vaibhav Mehta, Jinfeng Rao, Yi Tay, Mihir Kale, Ankur Parikh, Hongtao Zhong, Emma Strubell arXiv_AI arXiv_AI Pose Few-Shot Text_Generation Language_Model PDF
2021-10-16 Leveraging Knowledge in Multilingual Commonsense Reasoning Yuwei Fang, Shuohang Wang, Yichong Xu, Ruochen Xu, Siqi Sun, Chenguang Zhu, Michael Zeng arXiv_CL arXiv_CL Zero-Shot Knowledge Pose Attention Language_Model QA PDF
2021-10-16 A Short Study on Compressing Decoder-Based Language Models Tianda Li, Yassir El Mesbahi, Ivan Kobyzev, Ahmad Rashid, Atif Mahmud, Nithin Anchuri, Habib Hajimolahoseini, Yang Liu, Mehdi Rezagholizadeh arXiv_CL arXiv_CL Bert Knowledge Attention Language_Model PDF
2021-10-16 Knowledge Enhanced Pretrained Language Models: A Compreshensive Survey Xiaokai Wei, Shen Wang, Dejiao Zhang, Parminder Bhatia, Andrew Arnold arXiv_CL arXiv_CL Knowledge Face Survey Language_Model PDF
2021-10-16 Prix-LM: Pretraining for Multilingual Knowledge Base Construction Wenxuan Zhou, Fangyu Liu, Ivan Vulić, Nigel Collier, Muhao Chen arXiv_CL arXiv_CL Knowledge Pose Language_Model Prediction PDF
2021-10-16 Metadata Shaping: Natural Language Annotations for the Tail Simran Arora, Sen Wu, Enci Liu, Christopher Re arXiv_CL arXiv_CL Bert Knowledge Pose Language_Model PDF
2021-10-16 EncT5: Fine-tuning T5 Encoder for Non-autoregressive Tasks Frederick Liu, Siamak Shakeri, Hongkun Yu, Jing Li arXiv_CL arXiv_CL Transformer Bert Pose Classification Language_Model PDF
2021-10-16 What do Compressed Large Language Models Forget? Robustness Challenges in Model Compression Mengnan Du, Subhabrata Mukherjee, Yu Cheng, Milad Shokouhi, Xia Hu, Ahmed Hassan Awadallah arXiv_CL arXiv_CL Bert Regularization Knowledge Adversarial Language_Model PDF
2021-10-16 Multilingual unsupervised sequence segmentation transfers to extremely low-resource languages C.M. Downey, Shannon Drizin, Levon Haroutunian, Shivin Thukral arXiv_CL arXiv_CL Segmentation Unsupervised Zero-Shot Sparse Pose Language_Model PDF
2021-10-16 Invariant Language Modeling Maxime Peyrard, Sarvjeet Singh Ghotra, Martin Josifoski, Vidhan Agarwal, Barun Patra, Dean Carignan, Emre Kiciman, Robert West arXiv_CL arXiv_CL Pose Relation Language_Model PDF
2021-10-15 DS-TOD: Efficient Domain Specialization for Task Oriented Dialog Chia-Chien Hung, Anne Lauscher, Simone Paolo Ponzetto, Goran Glavaš arXiv_CL arXiv_CL Tracking Salient Knowledge Self-Supervised Pose Language_Model PDF
2021-10-15 Generated Knowledge Prompting for Commonsense Reasoning Jiacheng Liu, Alisa Liu, Ximing Lu, Sean Welleck, Peter West, Ronan Le Bras, Yejin Choi, Hannaneh Hajishirzi arXiv_CL arXiv_CL Knowledge Pose Language_Model Prediction QA PDF
2021-10-15 Training Dynamics for Text Summarization Models Tanya Goyal, Jiacheng Xu, Junyi Jessy Li, Greg Durrett arXiv_CL arXiv_CL Knowledge Summarization Language_Model PDF
2021-10-15 Control Prefixes for Text Generation Jordan Clive, Kris Cao, Marek Rei arXiv_AI arXiv_AI Transformer Pose Text_Generation Language_Model PDF
2021-10-15 Boosting coherence of language models Nikolay Malkin, Zhen Wang, Nebojsa Jojic arXiv_CL arXiv_CL Zero-Shot Pose Inference Language_Model Prediction PDF
2021-10-15 Intent-based Product Collections for E-commerce using Pretrained Language Models Hiun Kim, Jisu Jeong, Kyung-Min Kim, Dongjun Lee, Hyun Dong Lee, Dongpil Seo, Jeeseung Han, Dong Wook Park, Ji Ae Heo, Rak Yeong Kim arXiv_CL arXiv_CL Bert Relation Language_Model Matching PDF
2021-10-15 Multitask Prompted Training Enables Zero-Shot Task Generalization Victor Sanh, Albert Webson, Colin Raffel, Stephen H. Bach, Lintang Sutawika, Zaid Alyafeai, Antoine Chaffin, Arnaud Stiegler, Teven Le Scao, Arun Raja, Manan Dey, M Saiful Bari, Canwen Xu, Urmish Thakker, Shanya Sharma Sharma, Eliza Szczechla, Taewoon Kim, Gunjan Chhablani, Nihal Nayak, Debajyoti Datta, Jonathan Chang, Mike Tian-Jian Jiang, Han Wang, Matteo Manica, Sheng Shen, Zheng Xin Yong, Harshit Pandey, Rachel Bawden, Thomas Wang, Trishala Neeraj, Jos Rozen, Abheesht Sharma, Andrea Santilli, Thibault Fevry, Jason Alan Fries, Ryan Teehan, Stella Biderman, Leo Gao, Tali Bers, Thomas Wolf, Alexander M. Rush arXiv_CL arXiv_CL Zero-Shot Language_Model PDF
2021-10-15 Sparse Progressive Distillation: Resolving Overfitting under Pretrain-and-Finetune Paradigm Shaoyi Huang, Dongkuan Xu, Ian E.H. Yen, Sung-en Chang, Bingbing Li, Shiyang Chen, Mimi Xie, Hang Liu, Caiwen Ding arXiv_CL arXiv_CL Transformer Sparse Knowledge Pose Language_Model PDF
2021-10-15 The World of an Octopus: How Reporting Bias Influences a Language Model's Perception of Color Cory Paik, Stéphane Aroca-Ouellette, Alessandro Roncone, Katharina Kann arXiv_CV arXiv_CV Language_Model PDF
2021-10-15 Rewire-then-Probe: A Contrastive Recipe for Probing Biomedical Knowledge of Pre-trained Language Models Zaiqiao Meng, Fangyu Liu, Ehsan Shareghi, Yixuan Su, Charlotte Collins, Nigel Collier arXiv_CL arXiv_CL Knowledge Self-Supervised Pose Medical Language_Model PDF
2021-10-15 Kronecker Decomposition for GPT Compression Ali Edalati, Marzieh Tahaei, Ahmad Rashid, Vahid Partovi Nia, James J. Clark, Mehdi Rezagholizadeh arXiv_CL arXiv_CL Transformer Zero-Shot Knowledge Pose Few-Shot Attention Language_Model PDF
2021-10-15 mLUKE: The Power of Entity Representations in Multilingual Pretrained Language Models Ryokan Ri, Ikuya Yamada, Yoshimasa Tsuruoka arXiv_CL arXiv_CL Knowledge Language_Model PDF
2021-10-15 Few-Shot Bot: Prompt-Based Learning for Dialogue Systems Andrea Madotto, Zhaojiang Lin, Genta Indra Winata, Pascale Fung arXiv_AI arXiv_AI Tracking Knowledge Pose Action Few-Shot Language_Model QA PDF
2021-10-15 Jurassic is All You Need: Few-Shot Meaning-to-Text Generation for Open-Domain Dialogue Lena Reed, Cecilia Li, Angela Ramirez, Liren Wu, Marilyn Walker (Natural Language and Dialogue Systems Lab, University of California, Santa Cruz) arXiv_CL arXiv_CL Knowledge Few-Shot Text_Generation Language_Model PDF
2021-10-15 Crisis Domain Adaptation Using Sequence-to-sequence Transformers Congcong Wang, Paul Nulty, David Lillis arXiv_CL arXiv_CL Transformer Knowledge Pose Classification Language_Model PDF
2021-10-15 Tracing Origins: Coref-aware Machine Reading Comprehension Baorong Huang, Zhuosheng Zhang, Hai Zhao arXiv_CL arXiv_CL Embedding Bert Relation CNN Language_Model PDF
2021-10-15 Identifying Causal Influences on Publication Trends and Behavior: A Case Study of the Computational Linguistics Community Maria Glenski, Svitlana Volkova arXiv_CL arXiv_CL Embedding RNN Deep_Learning Inference Language_Model PDF
2021-10-15 SPoT: Better Frozen Model Adaptation through Soft Prompt Transfer Tu Vu, Brian Lester, Noah Constant, Rami Al-Rfou, Daniel Cer arXiv_CL arXiv_CL Embedding Transfer_Learning Pose Language_Model PDF
2021-10-15 Exploring Low-dimensional Intrinsic Task Subspace via Prompt Tuning Yujia Qin, Xiaozhi Wang, Yusheng Su, Yankai Lin, Ning Ding, Zhiyuan Liu, Juanzi Li, Lei Hou, Peng Li, Maosong Sun, Jie Zhou arXiv_AI arXiv_AI Pose Few-Shot Language_Model PDF
2021-10-15 End-to-End Segmentation-based News Summarization Yang Liu, Chenguang Zhu, Michael Zeng arXiv_CL arXiv_CL Segmentation Pose Summarization Language_Model PDF
2021-10-15 Meta-learning via Language Model In-context Tuning Yanda Chen, Ruiqi Zhong, Sheng Zha, George Karypis, He He arXiv_CL arXiv_CL Gradient_Descent Text_Classification Pose Classification Language_Model Prediction Matching PDF
2021-10-15 A Multilingual Bag-of-Entities Model for Zero-Shot Cross-Lingual Text Classification Sosuke Nishikawa, Ikuya Yamada, Yoshimasa Tsuruoka, Isao Echizen arXiv_CL arXiv_CL Embedding Bert Zero-Shot Text_Classification Pose Classification Language_Model PDF
2021-10-14 CCQA: A New Web-Scale Question Answering Dataset for Model Pre-Training Patrick Huber, Armen Aghajanyan, Barlas Oğuz, Dmytro Okhonko, Wen-tau Yih, Sonal Gupta, Xilun Chen arXiv_CL arXiv_CL Zero-Shot Pose Language_Model QA PDF
2021-10-14 Large Scale Substitution-based Word Sense Induction Matan Eyal, Shoval Sadde, Hillel Taub-Tabib, Yoav Goldberg arXiv_CL arXiv_CL Embedding Detection Language_Model PDF
2021-10-14 Sparks: Inspiration for Science Writing using Language Models Katy Ilonka Gero, Vivian Liu, Lydia B. Chilton arXiv_CL arXiv_CL Language_Model PDF
2021-10-14 P-Tuning v2: Prompt Tuning Can Be Comparable to Fine-tuning Universally Across Scales and Tasks Xiao Liu, Kaixuan Ji, Yicheng Fu, Zhengxiao Du, Zhilin Yang, Jie Tang arXiv_CL arXiv_CL Language_Model PDF
2021-10-14 Compressibility of Distributed Document Representations Blaž Škrlj, Matej Petkovič arXiv_AI arXiv_AI Text_Classification Pose Classification Medical Language_Model PDF
2021-10-14 UniPELT: A Unified Framework for Parameter-Efficient Language Model Tuning Yuning Mao, Lambert Mathias, Rui Hou, Amjad Almahairi, Hao Ma, Jiawei Han, Wen-tau Yih, Madian Khabsa arXiv_AI arXiv_AI Pose Language_Model PDF
2021-10-14 Spoken ObjectNet: A Bias-Controlled Spoken Caption Dataset Ian Palmer, Andrew Rouditchenko, Andrei Barbu, Boris Katz, James Glass arXiv_CV arXiv_CV Image_Retrieval Caption Language_Model PDF
2021-10-14 Delphi: Towards Machine Ethics and Norms Liwei Jiang, Jena D. Hwang, Chandra Bhagavatula, Ronan Le Bras, Maxwell Forbes, Jon Borchardt, Jenny Liang, Oren Etzioni, Maarten Sap, Yejin Choi arXiv_CL arXiv_CL Zero-Shot Action Deep_Learning Language_Model PDF
2021-10-14 Composable Sparse Fine-Tuning for Cross-Lingual Transfer Alan Ansell, Edoardo Maria Ponti, Anna Korhonen, Ivan Vulić arXiv_CL arXiv_CL Transfer_Learning Zero-Shot Sparse Knowledge Pose Face Inference Language_Model PDF
2021-10-14 On the Pitfalls of Analyzing Individual Neurons in Language Models Omer Antverg, Yonatan Belinkov arXiv_CL arXiv_CL Language_Model PDF
2021-10-14 Finetuning Large-Scale Pre-trained Language Models for Conversational Recommendation with Knowledge Graph Lingzhi Wang, Huang Hu, Lei Sha, Can Xu, Kam-Fai Wong, Daxin Jiang arXiv_CL arXiv_CL Embedding Knowledge Knowledge_Graph Relation CNN Language_Model Recommendation PDF
2021-10-14 A Simple, Strong and Robust Baseline for Distantly Supervised Relation Extraction Vipul Rathore, Kartikeya Badola, Mausam, Parag Singla arXiv_CL arXiv_CL Bert Action Relation Relation_Extraction Attention Language_Model PDF
2021-10-14 Evaluating Off-the-Shelf Machine Listening and Natural Language Models for Automated Audio Captioning Benno Weck, Xavier Favory, Konstantinos Drossos, Xavier Serra arXiv_CL arXiv_CL Transformer Embedding Bert Attention Caption Language_Model PDF
2021-10-14 Transferring Semantic Knowledge Into Language Encoders Mohammad Umair, Francis Ferraro arXiv_CL arXiv_CL Transformer Embedding Knowledge Pose Classification Inference Language_Model PDF
2021-10-14 Plug-Tagger: A Pluggable Sequence Labeling Framework Using Language Models Xin Zhou, Ruotian Ma, Tao Gui, Yiding Tan, Qi Zhang, Xuanjing Huang arXiv_AI arXiv_AI Pose Classification Deep_Learning Text_Generation Language_Model Prediction PDF
2021-10-14 Solving Aspect Category Sentiment Analysis as a Text Generation Task Jian Liu, Zhiyang Teng, Leyang Cui, Hanmeng Liu, Yue Zhang arXiv_CL arXiv_CL Zero-Shot Knowledge Sentiment Few-Shot Attention Text_Generation Language_Model PDF
2021-10-14 P-Adapters: Robustly Extracting Factual Information from Language Models with Diverse Prompts Benjamin Newman, Prafulla Kumar Choubey, Nazneen Rajani arXiv_CL arXiv_CL Embedding Bert Attention Language_Model PDF
2021-10-14 Building Chinese Biomedical Language Models via Multi-Level Text Discrimination Quan Wang, Songtai Dai, Benfeng Xu, Yajuan Lyu, Yong Zhu, Hua Wu, Haifeng Wang arXiv_AI arXiv_AI Bert Medical Language_Model PDF
2021-10-14 Causal Transformers Perform Below Chance on Recursive Nested Constructions, Unlike Humans Yair Lakretz, Théo Desbordes, Dieuwke Hupkes, Stanislas Dehaene arXiv_CL arXiv_CL Transformer RNN Language_Model PDF
2021-10-14 Symbolic Knowledge Distillation: from General Language Models to Commonsense Models Peter West, Chandra Bhagavatula, Jack Hessel, Jena D. Hwang, Liwei Jiang, Ronan Le Bras, Ximing Lu, Sean Welleck, Yejin Choi arXiv_CL arXiv_CL Knowledge Knowledge_Graph Language_Model PDF
2021-10-14 Semantically Distributed Robust Optimization for Vision-and-Language Inference Tejas Gokhale, Abhishek Chaudhary, Pratyay Banerjee, Chitta Baral, Yezhou Yang arXiv_CV arXiv_CV Optimization Knowledge Adversarial VQA Inference Language_Model QA PDF
2021-10-14 bert2BERT: Towards Reusable Pretrained Language Models Cheng Chen, Yichun Yin, Lifeng Shang, Xin Jiang, Yujia Qin, Fengyu Wang, Zhi Wang, Xiao Chen, Zhiyuan Liu, Qun Liu arXiv_CL arXiv_CL Transformer Bert Knowledge Pose Language_Model PDF
2021-10-14 MIMICause : Defining, identifying and predicting types of causal relationships between biomedical concepts from clinical notes Vivek Khetan, Md Imbesat Hassan Rizvi, Jessica Huber, Paige Bartusiak, Bogdan Sacaleanu, Andrew Fano arXiv_CL arXiv_CL Pose Relation Medical Language_Model PDF
2021-10-13 Towards Efficient NLP: A Standard Evaluation and A Strong Baseline Xiangyang Liu, Tianxiang Sun, Junliang He, Lingling Wu, Xinyu Zhang, Hao Jiang, Zhao Cao, Xuanjing Huang, Xipeng Qiu arXiv_AI arXiv_AI Bert Language_Model PDF
2021-10-13 Language Modelling via Learning to Rank Arvid Frydenlund, Gagandeep Singh, Frank Rudzicz arXiv_CL arXiv_CL Transformer Bert Knowledge Language_Model Prediction PDF
2021-10-13 Teaching Models new APIs: Domain-Agnostic Simulators for Task Oriented Dialogue Moya Chen, Paul A. Crook, Stephen Roller arXiv_CL arXiv_CL Knowledge Language_Model PDF
2021-10-13 TAG: Toward Accurate Social Media Content Tagging with a Concept Graph Jiuding Yang, Weidong Guo, Bang Liu, Yakun Yu, Chaoyue Wang, Jinwen Luo, Linglong Kong, Di Niu, Zhen Wen arXiv_AI arXiv_AI Knowledge Pose Action Language_Model Matching PDF
2021-10-13 Morphosyntactic Tagging with Pre-trained Language Models for Arabic and its Dialects Go Inoue, Salam Khalifa, Nizar Habash arXiv_CL arXiv_CL Transformer Language_Model PDF
2021-10-13 On Language Model Integration for RNN Transducer based Speech Recognition Wei Zhou, Zuoyun Zheng, Ralf Schlüter, Hermann Ney arXiv_CL arXiv_CL Recognition RNN Speech Pose Speech_Recognition Language_Model PDF
2021-10-13 Maximizing Efficiency of Language Model Pre-training for Learning Representation Junmo Kang, Suwon Shin, Jeonghwan Kim, Jaeyoung Jo, Sung-Hyon Myaeng arXiv_CL arXiv_CL Bert Pose Detection Language_Model PDF
2021-10-13 MSP: Multi-Stage Prompting for Making Pre-trained Language Models Better Translators Zhixing Tan, Xiangwen Zhang, Shuo Wang, Yang Liu arXiv_CL arXiv_CL Language_Model PDF
2021-10-13 Efficient domain adaptation of language models in ASR systems using Prompt-tuning Saket Dingliwal, Ashish Shenoy, Sravan Bodapati, Ankur Gandhe, Ravi Teja Gadde, Katrin Kirchhoff arXiv_CL arXiv_CL Transformer Embedding Recognition Speech Speech_Recognition Language_Model PDF
2021-10-13 Differentially Private Fine-tuning of Language Models Da Yu, Saurabh Naik, Arturs Backurs, Sivakanth Gopi, Huseyin A. Inan, Gautam Kamath, Janardhan Kulkarni, Yin Tat Lee, Andre Manoel, Lukas Wutschitz, Sergey Yekhanin, Huishuai Zhang arXiv_CL arXiv_CL Bert Sparse Pose Language_Model PDF
2021-10-13 Dict-BERT: Enhancing Language Model Pre-training with Dictionary Wenhao Yu, Chenguang Zhu, Yuwei Fang, Donghan Yu, Shuohang Wang, Yichong Xu, Michael Zeng, Meng Jiang arXiv_CL arXiv_CL Embedding Bert Self-Supervised Pose Language_Model PDF
2021-10-12 ALL Dolphins Are Intelligent and SOME Are Friendly: Probing BERT for Nouns' Semantic Properties and their Prototypicality Marianna Apidianaki, Aina Garí Soler arXiv_CL arXiv_CL Bert Knowledge Classification Language_Model PDF
2021-10-12 Time Masking for Temporal Language Models Guy D. Rosin, Ido Guy, Kira Radinsky arXiv_CL arXiv_CL Bert Pose Detection Language_Model Prediction PDF
2021-10-12 Learning Compact Metrics for MT Amy Pu, Hyung Won Chung, Ankur P. Parikh, Sebastian Gehrmann, Thibault Sellam arXiv_CL arXiv_CL Bert Knowledge Text_Generation Language_Model PDF
2021-10-12 LiST: Lite Self-training Makes Efficient Few-shot Learners Yaqing Wang, Subhabrata Mukherjee, Xiaodong Liu, Jing Gao, Ahmed Hassan Awadallah, Jianfeng Gao arXiv_CL arXiv_CL Few-Shot Inference Language_Model PDF
2021-10-12 Sm{aa}prat: DialoGPT for Natural Language Generation of Swedish Dialogue by Transfer Learning Tosin Adewumi, Nosheen Abid, Maryam Pahlavan, Rickard Brännvall, Sana Sabah Sabry, Foteini Liwicki, Marcus Liwicki arXiv_CL arXiv_CL Transformer Transfer_Learning Face Survey Language_Model QA PDF
2021-10-12 Multi-Modal Pre-Training for Automated Speech Recognition David M. Chan, Shalini Ghosh, Debmalya Chakrabarty, Björn Hoffmeister arXiv_SD arXiv_SD Recognition Speech Self-Supervised Speech_Recognition Language_Model PDF
2021-10-12 Model-based analysis of brain activity reveals the hierarchy of language in 305 subjects Charlotte Caucheteux, Alexandre Gramfort, Jean-Rémi King arXiv_AI arXiv_AI Speech Pose Activity Language_Model PDF
2021-10-12 Deep Learning for Bias Detection: From Inception to Deployment Md Abul Bashar, Richi Nayak, Anjor Kothare, Vishal Sharma, Kesavan Kandadai arXiv_AI arXiv_AI Transfer_Learning Pose Deep_Learning Detection Language_Model PDF
2021-10-12 DiscoDVT: Generating Long Text with Discourse-Aware Discrete Variational Transformer Haozhe Ji, Minlie Huang arXiv_CL arXiv_CL Transformer Pose Relation Language_Model PDF
2021-10-12 Rescoring Sequence-to-Sequence Models for Text Line Recognition with CTC-Prefixes Christoph Wick, Jochen Zöllner, Tobias Grüning arXiv_CV arXiv_CV Transformer Recognition RNN Pose Classification Attention CNN Language_Model PDF
2021-10-12 LaoPLM: Pre-trained Language Models for Lao Nankai Lin, Yingwen Fu, Ziyu Yang, Shengyi Jiang arXiv_CL arXiv_CL Transformer Bert Text_Classification Speech Classification Language_Model PDF
2021-10-12 Balancing Average and Worst-case Accuracy in Multitask Learning