Language_Model

Language_Model

• 2022-06-27 Analyzing Encoded Concepts in Transformer Language Models    Hassan Sajjad, Nadir Durrani, Fahim Dalvi, Firoj Alam, Abdul Rafae Khan, Jia Xu arXiv_CL arXiv_CL  Transformer  Pose  Face  Relation  Language_Model  PDF
• 2022-06-27 Few-Shot Stance Detection via Target-Aware Prompt Distillation    Yan Jiang, Jinhua Gao, Huawei Shen, Xueqi Cheng arXiv_CL arXiv_CL  Knowledge  Pose  Detection  Relation  Few-Shot  Attention  Language_Model  PDF
• 2022-06-27 Endowing Language Models with Multimodal Knowledge Graph Representations    Ningyuan Huang, Yash R. Deshpande, Yibo Liu, Houda Alberts, Kyunghyun Cho, Clara Vania, Iacer Calixto arXiv_CL arXiv_CL  Recognition  Knowledge  Knowledge_Graph  Pose  Relation  Language_Model  PDF
• 2022-06-27 Bi-VLDoc: Bidirectional Vision-Language Modeling for Visually-Rich Document Understanding    Chuwei Luo, Guozhi Tang, Qi Zheng, Cong Yao, Lianwen Jin, Chenliang Li, Yang Xue, Luo Si arXiv_CV arXiv_CV  Represenation_Learning  Pose  Action  Classification  Attention  Language_Model  QA  PDF
• 2022-06-27 Leveraging Language for Accelerated Learning of Tool Manipulation    Allen Z. Ren, Bharat Govil, Tsung-Yen Yang, Karthik Narasimhan, Anirudha Majumdar arXiv_RO arXiv_RO  Language_Model  PDF
• 2022-06-26 Your Autoregressive Generative Model Can be Better If You Treat It as an Energy-Based One    Yezhen Wang, Tong Che, Bo Li, Kaitao Song, Hengzhi Pei, Yoshua Bengio, Dongsheng Li arXiv_CL arXiv_CL  Pose  Language_Model  PDF
• 2022-06-25 TEVR: Improving Speech Recognition by Token Entropy Variance Reduction    Hajo Nils Krabbenhöft, Erhardt Barth arXiv_CL arXiv_CL  Recognition  Speech  Speech_Recognition  Language_Model  PDF
• 2022-06-25 Distilling a Pretrained Language Model to a Multilingual ASR Model    Kwanghee Choi, Hyung-Min Park arXiv_AI arXiv_AI  Transformer  Recognition  Knowledge  Speech  Pose  Speech_Recognition  Language_Model  PDF
• 2022-06-25 Language Models as Knowledge Embeddings    Xintao Wang, Qianyu He, Jiaqing Liang, Yanghua Xiao arXiv_AI arXiv_AI  Embedding  Knowledge  Knowledge_Graph  Pose  Contrastive_Learning  Classification  Relation  Language_Model  Prediction  PDF
• 2022-06-25 Adversarial Self-Attention for Language Understanding    Hongqiu Wu, Hai Zhao arXiv_CL arXiv_CL  Transformer  Adversarial  Pose  Attention  Language_Model  PDF
• 2022-06-25 Construct a Sentence with Multiple Specified Words    Yuanliang Meng arXiv_AI arXiv_AI  Language_Model  PDF
• 2022-06-24 OPERA: Harmonizing Task-Oriented Dialogs and Information Seeking Experience    Miaoran Li, Baolin Peng, Jianfeng Gao, Zhu Zhang arXiv_AI arXiv_AI  Knowledge  Pose  Language_Model  QA  PDF
• 2022-06-24 QAGAN: Adversarial Approach To Learning Domain Invariant Language Features    Shubham Shrivastava, Kaiyue Wang arXiv_CL arXiv_CL  Transformer  Embedding  Adversarial  GAN  Language_Model  Prediction  QA  PDF
• 2022-06-24 Using BERT Embeddings to Model Word Importance in Conversational Transcripts for Deaf and Hard of Hearing Users    Akhter Al Amin, Saad Hassan, Cecilia O. Alm, Matt Huenerfauth arXiv_CL arXiv_CL  Embedding  Bert  Classification  Relation  Caption  Language_Model  PDF
• 2022-06-24 Text and author-level political inference using heterogeneous knowledge representations    Samuel Caetano da Silva, Ivandre Paraboni arXiv_CL arXiv_CL  Transformer  Bert  Knowledge  Inference  Language_Model  PDF
• 2022-06-24 MVP: Multi-task Supervised Pre-training for Natural Language Generation    Tianyi Tang, Junyi Li, Wayne Xin Zhao, Ji-Rong Wen arXiv_CL arXiv_CL  Unsupervised  Pose  Text_Generation  Language_Model  PDF
• 2022-06-24 Unified BERT for Few-shot Natural Language Understanding    JunYu Lu, Ping Yang, JiaXing Zhang, RuYi Gan, Jing Yang arXiv_CL arXiv_CL  Bert  Zero-Shot  Knowledge  Pose  Action  Classification  Few-Shot  Language_Model  PDF
• 2022-06-24 Classifying Unstructured Clinical Notes via Automatic Weak Supervision    Chufan Gao, Mononito Goswami, Jieshi Chen, Artur Dubrawski arXiv_CL arXiv_CL  Text_Classification  Knowledge  Pose  Classification  Medical  Language_Model  PDF
• 2022-06-24 Confidence Score Based Conformer Speaker Adaptation for Speech Recognition    Jiajun Deng, Xurong Xie, Tianzi Wang, Mingyu Cui, Boyang Xue, Zengrui Jin, Mengzhe Geng, Guinan Li, Xunying Liu, Helen Meng arXiv_SD arXiv_SD  Transformer  Unsupervised  Recognition  RNN  Speech  Pose  Speech_Recognition  Language_Model  PDF
• 2022-06-24 SC-Ques: A Sentence Completion Question Dataset for English as a Second Language Learners    Qiongqiong Liu, Shuyan Huang, Zitao Liu, Weiqi Luo arXiv_CL arXiv_CL  Pose  Language_Model  PDF
• 2022-06-24 DialogID: A Dialogic Instruction Dataset for Improving Teaching Effectiveness in Online Environments    Jiahao Chen, Shuyan Huang, Zitao Liu, Weiqi Luo arXiv_CL arXiv_CL  Adversarial  Pose  Detection  Language_Model  PDF
• 2022-06-23 A Disability Lens towards Biases in GPT-3 Generated Open-Ended Languages    Akhter Al Amin, Kazi Sinthia Kabir arXiv_CL arXiv_CL  Action  Language_Model  PDF
• 2022-06-23 Do Trajectories Encode Verb Meaning?    Dylan Ebert, Chen Sun, Ellie Pavlick arXiv_CL arXiv_CL  Represenation_Learning  Self-Supervised  Action  Language_Model  PDF
• 2022-06-23 PromptPose: Language Prompt Helps Animal Pose Estimation    Xu Zhang, Wen Wang, Zhe Chen, Jing Zhang, Dacheng Tao arXiv_CV arXiv_CV  Pose_Estimation  Knowledge  Pose  Relation  Few-Shot  Language_Model  Prediction  PDF
• 2022-06-23 AST-Probe: Recovering abstract syntax trees from hidden representations of pre-trained language models    José Antonio Hernández López, Martin Weyssow, Jesús Sánchez Cuadrado, Houari Sahraoui arXiv_CL arXiv_CL  Language_Model  PDF
• 2022-06-23 Theory-Grounded Measurement of U.S. Social Stereotypes in English Language Models    Yang Trista Cao, Anna Sotnikova, Hal Daumé III, Rachel Rudinger, Linda Zou arXiv_CL arXiv_CL  Language_Model  PDF
• 2022-06-23 Towards Green ASR: Lossless 4-bit Quantization of a Hybrid TDNN System on the 300-hr Switchboard Corpus    Junhao Xu, Shoukang Hu, Xunying Liu, Helen Meng arXiv_SD arXiv_SD  Transformer  Quantization  Recognition  Speech  Pose  Speech_Recognition  Language_Model  PDF
• 2022-06-23 Mining Error Templates for Grammatical Error Correction    Yue Zhang, Haochen Jiang, Zuyi Bao, Bo Zhang, Chen Li, Zhenghua Li arXiv_CL arXiv_CL  Pose  Action  Language_Model  PDF
• 2022-06-23 Towards WinoQueer: Developing a Benchmark for Anti-Queer Bias in Large Language Models    Virginia K. Felkner, Ho-Chun Herbert Chang, Eugene Jang, Jonathan May arXiv_CL arXiv_CL  Bert  Pose  Detection  Language_Model  PDF
• 2022-06-22 DP-Parse: Finding Word Boundaries from Raw Speech with an Instance Lexicon    Robin Algayres, Tristan Ricoul, Julien Karadayi, Hugo Laurençon, Salah Zaiem, Abdelrahman Mohamed, Benoît Sagot, Emmanuel Dupoux arXiv_CL arXiv_CL  Segmentation  Embedding  Weakly_Supervised  Speech  Language_Model  PDF
• 2022-06-22 GODEL: Large-Scale Pre-Training for Goal-Directed Dialog    Baolin Peng, Michel Galley, Pengcheng He, Chris Brockett, Lars Liden, Elnaz Nouri, Zhou Yu, Bill Dolan, Jianfeng Gao arXiv_CL arXiv_CL  Relation  Few-Shot  Language_Model  QA  PDF
• 2022-06-22 Open Vocabulary Object Detection with Proposal Mining and Prediction Equalization    Peixian Chen, Kekai Sheng, Mengdan Zhang, Yunhang Shen, Ke Li, Chunhua Shen arXiv_CV arXiv_CV  Knowledge  Detection  Object_Detection  Inference  Language_Model  Prediction  PDF
• 2022-06-22 Multi-LexSum: Real-World Summaries of Civil Rights Lawsuits at Multiple Granularities    Zejiang Shen, Kyle Lo, Lauren Yu, Nathan Dahlberg, Margo Schlanger, Doug Downey arXiv_CL arXiv_CL  Knowledge  Summarization  Language_Model  PDF
• 2022-06-22 Scaling Autoregressive Models for Content-Rich Text-to-Image Generation    Jiahui Yu, Yuanzhong Xu, Jing Yu Koh, Thang Luong, Gunjan Baid, Zirui Wang, Vijay Vasudevan, Alexander Ku, Yinfei Yang, Burcu Karagol Ayan, Ben Hutchinson, Wei Han, Zarana Parekh, Xin Li, Han Zhang, Jason Baldridge, Yonghui Wu arXiv_CV arXiv_CV  Transformer  Zero-Shot  Knowledge  GAN  Language_Model  PDF
• 2022-06-22 Efficient and effective training of language and graph neural network models    Vassilis N. Ioannidis, Xiang Song, Da Zheng, Houyu Zhang, Jun Ma, Yi Xu, Belinda Zeng, Trishul Chilimbi, George Karypis arXiv_CL arXiv_CL  Bert  Optimization  Pose  Classification  Language_Model  Prediction  PDF
• 2022-06-21 Don't Forget About Pronouns: Removing Gender Bias in Language Models Without Losing Factual Gender Information    Tomasz Limisiewicz, David Mareček arXiv_AI arXiv_AI  Embedding  Relation  Language_Model  PDF
• 2022-06-21 BenchCLAMP: A Benchmark for Evaluating Language Models on Semantic Parsing    Subhro Roy, Sam Thomson, Tongfei Chen, Richard Shin, Adam Pauls, Jason Eisner, Benjamin Van Durme arXiv_CL arXiv_CL  Face  Action  Classification  Text_Generation  Language_Model  PDF
• 2022-06-21 Questions Are All You Need to Train a Dense Passage Retriever    Devendra Singh Sachan, Mike Lewis, Dani Yogatama, Luke Zettlemoyer, Joelle Pineau, Manzil Zaheer arXiv_CL arXiv_CL  Reconstruction  Unsupervised  Denoising  Language_Model  QA  PDF
• 2022-06-21 Large Language Models Still Can't Plan    Karthik Valmeekam, Alberto Olmo, Sarath Sreedharan, Subbarao Kambhampati arXiv_AI arXiv_AI  Pose  Action  Language_Model  PDF
• 2022-06-21 KnowDA: All-in-One Knowledge Mixture Model for Data Augmentation in Few-Shot NLP    Yufei Wang, Jiayi Zheng, Can Xu, Xiubo Geng, Tao Shen, Chongyang Tao, Daxin Jiang arXiv_CL arXiv_CL  Bert  Knowledge  Pose  Few-Shot  Denoising  Language_Model  PDF
• 2022-06-21 TAPHSIR: Towards AnaPHoric Ambiguity Detection and ReSolution In Requirements    Saad Ezzini, Sallam Abualhaija, Chetan Arora, Mehrdad Sabetzadeh arXiv_CL arXiv_CL  Bert  Review  Pose  Detection  Language_Model  PDF
• 2022-06-21 SemMAE: Semantic-Guided Masking for Learning Masked Autoencoders    Gang Li, Heliang Zheng, Daqing Liu, Bing Su, Changwen Zheng arXiv_CV arXiv_CV  Image_Caption  Segmentation  Semantic_Segmentation  Recognition  Self-Supervised  Relation  Attention  Language_Model  PDF
• 2022-06-21 General Framework for Reversible Data Hiding in Texts Based on Masked Language Modeling    Xiaoyan Zheng, Yurun Fang, Hanzhou Wu arXiv_CL arXiv_CL  Embedding  Pose  Language_Model  PDF
• 2022-06-21 Automatic Controllable Product Copywriting for E-Commerce    Xiaojie Guo, Qingkai Zeng, Meng Jiang, Yun Xiao, Bo Long, Lingfei Wu arXiv_AI arXiv_AI  Weakly_Supervised  Pose  Action  Text_Generation  Language_Model  Recommendation  PDF
• 2022-06-20 Fewer Errors, but More Stereotypes? The Effect of Model Size on Gender Bias    Yarden Tal, Inbal Magar, Roy Schwartz arXiv_CL arXiv_CL  Bert  Language_Model  PDF
• 2022-06-20 SMT-DTA: Improving Drug-Target Affinity Prediction with Semi-supervised Multi-task Training    Qizhi Pei, Lijun Wu, Jinhua Zhu, Yingce Xia, Shufang Xia, Tao Qin, Haiguang Liu, Tie-Yan Liu arXiv_AI arXiv_AI  Represenation_Learning  Pose  Action  Deep_Learning  Attention  Language_Model  Prediction  PDF
• 2022-06-20 Domain-Adaptive Text Classification with Structured Knowledge from Unlabeled Data    Tian Li, Xiang Chen, Zhen Dong, Weijiang Yu, Yijun Yan, Kurt Keutzer, Shanghang Zhang arXiv_CL arXiv_CL  Bert  Sentiment_Classification  Text_Classification  Knowledge  Knowledge_Graph  Pose  Classification  Relation  Sentiment  Language_Model  PDF
• 2022-06-20 nuQmm: Quantized MatMul for Efficient Inference of Large-Scale Generative Language Models    Gunho Park, Baeseong Park, Se Jung Kwon, Byeongwook Kim, Youngjoo Lee, Dongsoo Lee arXiv_CL arXiv_CL  Transformer  Quantization  Self-Supervised  Pose  Inference  Language_Model  PDF
• 2022-06-19 Towards Unified Conversational Recommender Systems via Knowledge-Enhanced Prompt Learning    Xiaolei Wang, Kun Zhou, Ji-Rong Wen, Wayne Xin Zhao arXiv_AI arXiv_AI  Knowledge  Pose  Action  Language_Model  Recommendation  PDF
• 2022-06-18 Can Language Models Capture Graph Semantics? From Graphs to Language Model and Vice-Versa    Tarun Garg, Kaushik Roy, Amit Sheth arXiv_CL arXiv_CL  Transformer  Knowledge  Knowledge_Graph  Deep_Learning  Relation  Attention  Language_Model  PDF
• 2022-06-18 Automatic Summarization of Russian Texts: Comparison of Extractive and Abstractive Methods    Valeriya Goloviznina, Evgeny Kotelnikov arXiv_CL arXiv_CL  Transformer  Bert  Summarization  Text_Generation  Language_Model  PDF
• 2022-06-18 Argumentative Text Generation in Economic Domain    Irina Fishcheva, Dmitriy Osadchiy, Klavdiya Bochenina, Evgeny Kotelnikov arXiv_CL arXiv_CL  Transformer  Bert  Text_Generation  Language_Model  PDF
• 2022-06-18 Collocation2Text: Controllable Text Generation from Guide Phrases in Russian    Sergey Vychegzhanin, Evgeny Kotelnikov arXiv_CL arXiv_CL  Bert  Pose  Text_Generation  Language_Model  PDF
• 2022-06-18 CLiMB: A Continual Learning Benchmark for Vision-and-Language Tasks    Tejas Srinivasan, Ting-Yun Chang, Leticia Leonor Pinto Alva, Georgios Chochlakis, Mohammad Rostami, Jesse Thomason arXiv_AI arXiv_AI  Transformer  Knowledge  Language_Model  PDF
• 2022-06-17 MineDojo: Building Open-Ended Embodied Agents with Internet-Scale Knowledge    Linxi Fan, Guanzhi Wang, Yunfan Jiang, Ajay Mandlekar, Yuncong Yang, Haoyi Zhu, Andrew Tang, De-An Huang, Yuke Zhu, Anima Anandkumar arXiv_CV arXiv_CV  Knowledge  Pose  Autonomous  Language_Model  PDF
• 2022-06-17 A Quantitative and Qualitative Analysis of Suicide Ideation Detection using Deep Learning    Siqu Long, Rina Cabral, Josiah Poon, Soyeon Caren Han arXiv_CL arXiv_CL  Embedding  Text_Classification  RNN  Quantitative  Classification  Deep_Learning  Detection  Attention  Language_Model  Prediction  PDF
• 2022-06-17 Medical Dialogue Response Generation with Pivotal Information Recalling    Yu Zhao, Yunxin Li, Yuxiang Wu, Baotian Hu, Qingcai Chen, Xiaolong Wang, Yuxin Ding, Min Zhang arXiv_AI arXiv_AI  Knowledge  Pose  Relation  Attention  Medical  Language_Model  PDF
• 2022-06-16 Methods for Estimating and Improving Robustness of Language Models    Michal Štefánik arXiv_CL arXiv_CL  Face  Survey  Relation  Language_Model  PDF
• 2022-06-16 CS-UM6P at SemEval-2022 Task 6: Transformer-based Models for Intended Sarcasm Detection in English and Arabic    Abdelkader El Mahdaouy, Abdellah El Mekki, Kabil Essefar, Abderrahman Skiredj, Ismail Berrada arXiv_CL arXiv_CL  Transformer  Pose  Deep_Learning  Detection  Sentiment  Language_Model  PDF
• 2022-06-16 Deep Multi-Task Models for Misogyny Identification and Categorization on Arabic Social Media    Abdelkader El Mahdaouy, Abdellah El Mekki, Ahmed Oumar, Hajar Mousannif, Ismail Berrada arXiv_CL arXiv_CL  Bert  Speech  Attention  Language_Model  PDF
• 2022-06-16 Know your audience: specializing grounded language models with the game of Dixit    Aaditya K. Singh, David Ding, Andrew Saxe, Felix Hill, Andrew K. Lampinen arXiv_AI arXiv_AI  Zero-Shot  Pose  Attention  Language_Model  PDF
• 2022-06-16 Characteristics of Harmful Text: Towards Rigorous Benchmarking of Language Models    Maribeth Rauh, John Mellor, Jonathan Uesato, Po-Sen Huang, Johannes Welbl, Laura Weidinger, Sumanth Dathathri, Amelia Glaese, Geoffrey Irving, Iason Gabriel, William Isaac, Lisa Anne Hendricks arXiv_AI arXiv_AI  Language_Model  PDF
• 2022-06-16 Paraformer: Fast and Accurate Parallel Transformer for Non-autoregressive End-to-End Speech Recognition    Zhifu Gao, Shiliang Zhang, Ian McLoughlin, Zhijie Yan arXiv_SD arXiv_SD  Transformer  Embedding  Recognition  Speech  Pose  Speech_Recognition  Inference  Language_Model  PDF
• 2022-06-16 GoodBye WaveNet -- A Language Model for Raw Audio with Context of 1/2 Million Samples    Prateek Verma arXiv_SD arXiv_SD  Transformer  RNN  Pose  Language_Model  PDF
• 2022-06-16 Zero-Shot Video Question Answering via Frozen Bidirectional Language Models    Antoine Yang, Antoine Miech, Josef Sivic, Ivan Laptev, Cordelia Schmid arXiv_CV arXiv_CV  Zero-Shot  Pose  VQA  Few-Shot  Activity  Inference  Language_Model  QA  PDF
• 2022-06-16 Self-Generated In-Context Learning: Leveraging Auto-regressive Language Models as a Demonstration Generator    Hyuhng Joon Kim, Hyunsoo Cho, Junyeob Kim, Taeuk Kim, Kang Min Yoo, Sang-goo Lee arXiv_CL arXiv_CL  Zero-Shot  Text_Classification  Pose  Classification  Language_Model  PDF
• 2022-06-16 PreCogIIITH at HinglishEval : Leveraging Code-Mixing Metrics & Language Model Embeddings To Estimate Code-Mix Quality    Prashant Kodali, Tanmay Sachan, Akshay Goindani, Anmol Goel, Naman Ahuja, Manish Shrivastava, Ponnurangam Kumaraguru arXiv_AI arXiv_AI  Embedding  Speech  Language_Model  PDF
• 2022-06-16 PInKS: Preconditioned Commonsense Inference with Minimal Supervision    Ehsan Qasemi, Piyush Khanna, Qiang Ning, Muhao Chen arXiv_CL arXiv_CL  Knowledge  Inference  Language_Model  PDF
• 2022-06-16 Accelerating Inference and Language Model Fusion of Recurrent Neural Network Transducers via End-to-End 4-bit Quantization    Andrea Fasoli, Chia-Yu Chen, Mauricio Serrano, Swagath Venkataramani, George Saon, Xiaodong Cui, Brian Kingsbury, Kailash Gopalakrishnan arXiv_SD arXiv_SD  Quantization  RNN  Inference  Language_Model  QA  PDF
• 2022-06-15 TOKEN is a MASK: Few-shot Named Entity Recognition with Pre-trained Language Models    Ali Davody, David Ifeoluwa Adelani, Thomas Kleinbauer, Dietrich Klakow arXiv_CL arXiv_CL  Recognition  Zero-Shot  Knowledge  Pose  Few-Shot  Language_Model  PDF
• 2022-06-15 Prefix Language Models are Unified Modal Learners    Shizhe Diao, Wangchunshu Zhou, Xinsong Zhang, Jiawei Wang arXiv_CV arXiv_CV  Zero-Shot  Pose  Classification  VQA  Text_Generation  Caption  Language_Model  QA  PDF
• 2022-06-15 DIRECTOR: Generator-Classifiers For Supervised Language Modeling    Kushal Arora, Kurt Shuster, Sainbayar Sukhbaatar, Jason Weston arXiv_CL arXiv_CL  Classification  Language_Model  PDF
• 2022-06-15 Emergent Abilities of Large Language Models    Jason Wei, Yi Tay, Rishi Bommasani, Colin Raffel, Barret Zoph, Sebastian Borgeaud, Dani Yogatama, Maarten Bosma, Denny Zhou, Donald Metzler, Ed H. Chi, Tatsunori Hashimoto, Oriol Vinyals, Percy Liang, Jeff Dean, William Fedus arXiv_CL arXiv_CL  Language_Model  PDF
• 2022-06-15 Transformer-based Automatic Speech Recognition of Formal and Colloquial Czech in MALACH Project    Jan Lehečka, Josef V. Psutka, Josef Psutka arXiv_CL arXiv_CL  Transformer  Recognition  Speech  Self-Supervised  Speech_Recognition  Language_Model  PDF
• 2022-06-15 NatGen: Generative pre-training by 'Naturalizing' source code    Saikat Chakraborty, Toufique Ahmed, Yangruibo Ding, Premkumar Devanbu, Baishakhi Ray arXiv_AI arXiv_AI  Zero-Shot  Self-Supervised  Pose  Few-Shot  Language_Model  PDF
• 2022-06-15 Contextualization and Generalization in Entity and Relation Extraction    Bruno Taillé arXiv_AI arXiv_AI  Embedding  Recognition  Pose  Face  Action  Relation  Relation_Extraction  Language_Model  Prediction  PDF
• 2022-06-15 Residual Language Model for End-to-end Speech Recognition    Emiru Tsunoo, Yosuke Kashiwagi, Chaitanya Narisetty, Shinji Watanabe arXiv_SD arXiv_SD  Recognition  Speech  Pose  Speech_Recognition  Inference  Language_Model  PDF
• 2022-06-15 A Survey : Neural Networks for AMR-to-Text    Hongyu Hao, Guangtong Li, Zhiming Hu, Huafeng Wang arXiv_CL arXiv_CL  Transformer  Reconstruction  Optimization  Pose  Survey  Language_Model  PDF
• 2022-06-15 Human Heuristics for AI-Generated Language Are Flawed    Maurice Jakesch, Jeffrey Hancock, Mor Naaman arXiv_AI arXiv_AI  Pose  Language_Model  PDF
• 2022-06-15 Test-Time Adaptation for Visual Document Understanding    Sayna Ebrahimi, Sercan O. Arik, Tomas Pfister arXiv_AI arXiv_AI  Recognition  Self-Supervised  Pose  Action  VQA  Language_Model  PDF
• 2022-06-14 Can Foundation Models Talk Causality?    Moritz Willig, Matej Zečević, Devendra Singh Dhami, Kristian Kersting arXiv_AI arXiv_AI  Language_Model  PDF
• 2022-06-14 Understanding Narratives through Dimensions of Analogy    Thiloshon Nagarajah, Filip Ilievski, Jay Pujara arXiv_AI arXiv_AI  Knowledge  Language_Model  PDF
• 2022-06-14 LAVENDER: Unifying Video-Language Understanding as Masked Language Modeling    Linjie Li, Zhe Gan, Kevin Lin, Chung-Ching Lin, Zicheng Liu, Ce Liu, Lijuan Wang arXiv_CV arXiv_CV  Video_Caption  Zero-Shot  Face  Few-Shot  Caption  Language_Model  Video_Retrieval  PDF
• 2022-06-14 SBERT studies Meaning Representations: Decomposing Sentence Embeddings into Explainable AMR Meaning Features    Juri Opitz, Anette Frank arXiv_CL arXiv_CL  Embedding  Bert  Pose  Face  Relation  Language_Model  PDF
• 2022-06-14 FETILDA: An Effective Framework For Fin-tuned Embeddings For Long Financial Text Documents    Bolun "Namir" Xia, Vipula D. Rawte, Mohammed J. Zaki, Aparna Gupta arXiv_CL arXiv_CL  Embedding  Pose  Deep_Learning  Attention  Language_Model  Prediction  PDF
• 2022-06-14 CERT: Continual Pre-Training on Sketches for Library-Oriented Code Generation    Daoguang Zan, Bei Chen, Dejian Yang, Zeqi Lin, Minsu Kim, Bei Guan, Yongji Wang, Weizhu Chen, Jian-Guang Lou arXiv_CL arXiv_CL  Sketch  Language_Model  PDF
• 2022-06-14 Task Transfer and Domain Adaptation for Zero-Shot Question Answering    Xiang Pan, Alex Sheng, David Shimshoni, Aditya Singhal, Sara Rosenthal, Avirup Sil arXiv_CL arXiv_CL  Zero-Shot  Language_Model  PDF
• 2022-06-14 FreeTransfer-X: Safe and Label-Free Cross-Lingual Transfer from Off-the-Shelf Models    Yinpeng Guo, Liangyou Li, Xin Jiang, Qun Liu arXiv_CL arXiv_CL  Knowledge  Pose  NMT  Language_Model  PDF
• 2022-06-14 Exploring evolution-based & -free protein language models as protein function predictors    Mingyang Hu, Fajie Yuan, Kevin K. Yang, Fusong Ju, Jin Su, Hui Wang, Fei Yang, Qiuyang Ding arXiv_AI arXiv_AI  Transformer  3D  Language_Model  Prediction  PDF
• 2022-06-14 LIFT: Language-Interfaced Fine-Tuning for Non-Language Machine Learning Tasks    Tuan Dinh, Yuchen Zeng, Ruisu Zhang, Ziqian Lin, Shashank Rajput, Michael Gira, Jy-yong Sohn, Dimitris Papailiopoulos, Kangwook Lee arXiv_CL arXiv_CL  Embedding  Pose  Face  Classification  Language_Model  Prediction  Matching  PDF
• 2022-06-13 Memory-Based Model Editing at Scale    Eric Mitchell, Charles Lin, Antoine Bosselut, Christopher D. Manning, Chelsea Finn arXiv_CL arXiv_CL  Knowledge  Pose  Language_Model  Prediction  PDF
• 2022-06-13 MetaTPTrans: A Meta Learning Approach for Multilingual Code Representation Learning    Weiguo Pian, Hanyu Peng, Xunzhu Tang, Tiezhu Sun, Haoye Tian, Andrew Habib, Jacques Klein, Tegawendé F. Bissyandé arXiv_AI arXiv_AI  Represenation_Learning  Pose  Summarization  Language_Model  Prediction  PDF
• 2022-06-13 Language Models are General-Purpose Interfaces    Yaru Hao, Haoyu Song, Li Dong, Shaohan Huang, Zewen Chi, Wenhui Wang, Shuming Ma, Furu Wei arXiv_CL arXiv_CL  Zero-Shot  Pose  Face  Few-Shot  Attention  Language_Model  PDF
• 2022-06-13 JiuZhang: A Chinese Pre-trained Language Model for Mathematical Problem Understanding    Wayne Xin Zhao, Kun Zhou, Zheng Gong, Beichen Zhang, Yuanhang Zhou, Jing Sha, Zhigang Chen, Shijin Wang, Cong Liu, Ji-Rong Wen arXiv_AI arXiv_AI  Knowledge  Language_Model  PDF
• 2022-06-13 Transition-based Abstract Meaning Representation Parsing with Contextual Embeddings    Yichao Liang arXiv_AI arXiv_AI  Embedding  Bert  Pose  Language_Model  PDF
• 2022-06-13 EGRU: Event-based GRU for activity-sparse inference and learning    Anand Subramoney, Khaleelulla Khan Nazeer, Mark Schöne, Christian Mayr, David Kappel arXiv_AI arXiv_AI  Gradient_Descent  Sparse  RNN  Pose  Action  Activity  Inference  Language_Model  PDF
• 2022-06-13 INDIGO: Intrinsic Multimodality for Domain Generalization    Puneet Mangla, Shivam Chandhok, Milan Aggarwal, Vineeth N Balasubramanian, Balaji Krishnamurthy arXiv_CV arXiv_CV  Weakly_Supervised  Pose  GAN  Language_Model  PDF
• 2022-06-12 GLIPv2: Unifying Localization and Vision-Language Understanding    Haotian Zhang, Pengchuan Zhang, Xiaowei Hu, Yen-Chun Chen, Liunian Harold Li, Xiyang Dai, Lijuan Wang, Lu Yuan, Jenq-Neng Hwang, Jianfeng Gao arXiv_AI arXiv_AI  Image_Caption  Segmentation  Zero-Shot  Contrastive_Learning  Detection  VQA  Few-Shot  Object_Detection  GAN  Caption  Language_Model  QA  PDF
• 2022-06-12 Self-critiquing models for assisting human evaluators    William Saunders, Catherine Yeh, Jeff Wu, Steven Bills, Long Ouyang, Jonathan Ward, Jan Leike arXiv_CL arXiv_CL  Knowledge  Summarization  Language_Model  PDF
• 2022-06-12 CoSe-Co: Text Conditioned Generative CommonSense Contextualizer    Rachit Bansal, Milan Aggarwal, Sumit Bhatia, Jivat Neet Kaur, Balaji Krishnamurthy arXiv_CL arXiv_CL  Knowledge  Knowledge_Graph  Pose  Relation  Language_Model  QA  PDF
• 2022-06-12 Fine-tuning Pre-trained Language Models with Noise Stability Regularization    Hang Hua, Xingjian Li, Dejing Dou, Cheng-Zhong Xu, Jiebo Luo arXiv_CL arXiv_CL  Text_Classification  Regularization  Pose  Classification  Language_Model  PDF
• 2022-06-11 Bridging the Gap Between Training and Inference of Bayesian Controllable Language Models    Han Liu, Bingning Wang, Ting Yao, Haijin Liang, Jianjin Xu, Xiaolin Hu arXiv_AI arXiv_AI  Pose  Sentiment  Inference  Language_Model  PDF
• 2022-06-11 Building a Personalized Dialogue System with Prompt-Tuning    Tomohito Kasahara, Daisuke Kawahara, Nguyen Tung, Shengzhe Li, Kenta Shinzato, Toshinori Sato arXiv_CL arXiv_CL  Pose  Language_Model  PDF
• 2022-06-11 Why is constrained neural language generation particularly challenging?    Cristina Garbacea, Qiaozhu Mei arXiv_AI arXiv_AI  Review  Survey  Text_Generation  Language_Model  PDF
• 2022-06-10 A Multi-Task Benchmark for Korean Legal Language Understanding and Judgement Prediction    Wonseok Hwang, Dongjun Lee, Kyoungyeon Cho, Hanuhl Lee, Minjoon Seo arXiv_AI arXiv_AI  Review  Classification  Deep_Learning  Summarization  Language_Model  Prediction  PDF
• 2022-06-10 Putting GPT-3's Creativity to the Test    Claire Stevenson, Iris Smal, Matthijs Baas, Raoul Grasman, Han van der Maas arXiv_AI arXiv_AI  Language_Model  PDF
• 2022-06-10 REKnow: Enhanced Knowledge for Joint Entity and Relation Extraction    Sheng Zhang, Patrick Ng, Zhiguo Wang, Bing Xiang arXiv_CL arXiv_CL  Knowledge  Knowledge_Graph  Pose  Action  Relation  Relation_Extraction  Language_Model  PDF
• 2022-06-10 Unsupervised and Few-shot Parsing from Pretrained Language Models    Zhiyuan Zeng, Deyi Xiong arXiv_CL arXiv_CL  Segmentation  Unsupervised  Knowledge  Pose  Few-Shot  Attention  Language_Model  PDF
• 2022-06-10 Borrowing or Codeswitching? Annotating for Finer-Grained Distinctions in Language Mixing    Elena Alvarez Mellado, Constantine Lignos arXiv_CL arXiv_CL  Transformer  Language_Model  PDF
• 2022-06-10 Sort by Structure: Language Model Ranking as Dependency Probing    Max Müller-Eberstein, Rob van der Goot, Barbara Plank arXiv_CL arXiv_CL  Embedding  Bert  Pose  Language_Model  Prediction  PDF
• 2022-06-09 Factuality Enhanced Language Models for Open-Ended Text Generation    Nayeon Lee, Wei Ping, Peng Xu, Mostofa Patwary, Mohammad Shoeybi, Bryan Catanzaro arXiv_AI arXiv_AI  Pose  Text_Generation  Language_Model  PDF
• 2022-06-09 Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models    Aarohi Srivastava, Abhinav Rastogi, Abhishek Rao, Abu Awal Md Shoeb, Abubakar Abid, Adam Fisch, Adam R. Brown, Adam Santoro, Aditya Gupta, Adrià Garriga-Alonso, Agnieszka Kluska, Aitor Lewkowycz, Akshat Agarwal, Alethea Power, Alex Ray, Alex Warstadt, Alexander W. Kocurek, Ali Safaya, Ali Tazarv, Alice Xiang, Alicia Parrish, Allen Nie, Aman Hussain, Amanda Askell, Amanda Dsouza, Ameet Rahane, Anantharaman S. Iyer, Anders Andreassen, Andrea Santilli, Andreas Stuhlmüller, Andrew Dai, Andrew La, Andrew Lampinen, Andy Zou, Angela Jiang, Angelica Chen, Anh Vuong, Animesh Gupta, Anna Gottardi, Antonio Norelli, Anu Venkatesh, Arash Gholamidavoodi, Arfa Tabassum, Arul Menezes, Arun Kirubarajan, Asher Mullokandov, Ashish Sabharwal, Austin Herrick, Avia Efrat, Aykut Erdem, Ayla Karakaş, et al. (392 additional authors not shown) arXiv_AI arXiv_AI  Transformer  Sparse  Knowledge  Quantitative  Language_Model  PDF
• 2022-06-09 Privacy Leakage in Text Classification: A Data Extraction Approach    Adel Elmahdy, Huseyin A. Inan, Robert Sim arXiv_CL arXiv_CL  Text_Classification  Pose  Action  Classification  Language_Model  Prediction  PDF
• 2022-06-09 Extracting Zero-shot Common Sense from Large Language Models for Robot 3D Scene Understanding    William Chen, Siyi Hu, Rajat Talak, Luca Carlone arXiv_CL arXiv_CL  3D  Zero-Shot  Knowledge  Pose  Language_Model  PDF
• 2022-06-09 SsciBERT: A Pre-trained Language Model for Social Science Texts    Si Shen, Jiangfeng Liu, Litao Lin, Ying Huang, Lin Zhang, Chang Liu, Yutong Feng, Dongbo Wang arXiv_CL arXiv_CL  Recognition  Bert  Pose  Classification  Language_Model  PDF
• 2022-06-09 Joint Encoder-Decoder Self-Supervised Pre-training for ASR    Arunkumar A, Umesh S arXiv_CL arXiv_CL  Embedding  Recognition  Bert  Speech  Self-Supervised  Pose  Speech_Recognition  Language_Model  Prediction  PDF
• 2022-06-09 Ancestor-to-Creole Transfer is Not a Walk in the Park    Heather Lent, Emanuele Bugliarello, Anders Søgaard arXiv_CL arXiv_CL  Language_Model  PDF
• 2022-06-09 Context-based out-of-vocabulary word recovery for ASR systems in Indian languages    Arun Baby, Saranya Vinnaitherthan, Akhil Kerhalkar, Pranav Jawale, Sharath Adavanne, Nagaraj Adiga arXiv_CL arXiv_CL  Recognition  Knowledge  Speech  Pose  Speech_Recognition  Language_Model  Matching  PDF
• 2022-06-08 Few-shot Prompting Toward Controllable Response Generation    Hsuan Su, Pohan Chi, Shih-Cheng Huang, Chung Ho Lam, Saurav Sahay, Shang-Tse Chen, Hung-yi Lee arXiv_AI arXiv_AI  Reinforcement_Learning  Pose  Few-Shot  Language_Model  QA  PDF
• 2022-06-07 Revealing Single Frame Bias for Video-and-Language Learning    Jie Lei, Tamara L. Berg, Mohit Bansal arXiv_AI arXiv_AI  Recognition  Pose  Action_Recognition  Action  Inference  Language_Model  Video_Retrieval  PDF
• 2022-06-07 Always Keep your Target in Mind: Studying Semantics and Improving Performance of Neural Lexical Substitution    Nikolay Arefyev, Boris Sheludko, Alexander Podolskiy, Alexander Panchenko arXiv_CL arXiv_CL  Bert  Action  Relation  Relation_Extraction  Language_Model  PDF
• 2022-06-07 cViL: Cross-Lingual Training of Vision-Language Models using Knowledge Distillation    Kshitij Gupta, Devansh Gautam, Radhika Mamidi arXiv_CV arXiv_CV  Knowledge  Pose  Classification  VQA  Language_Model  PDF
• 2022-06-07 OCHADAI at SemEval-2022 Task 2: Adversarial Training for Multilingual Idiomaticity Detection    Lis Kanashiro Pereira, Ichiro Kobayashi arXiv_CL arXiv_CL  Transformer  Bert  Zero-Shot  Knowledge  Adversarial  Pose  Detection  Language_Model  PDF
• 2022-06-07 Plot Writing From Pre-Trained Language Models    Yiping Jin, Vishakha Kadam, Dittaya Wanvarie arXiv_CL arXiv_CL  Pose  Language_Model  PDF
• 2022-06-07 DynaMaR: Dynamic Prompt with Mask Token Representation    Xiaodi Sun, Sunny Rajagopalan, Priyanka Nigam, Weiyi Lu, Yi Xu, Belinda Zeng, Trishul Chilimbi arXiv_CL arXiv_CL  Unsupervised  Pose  Classification  Few-Shot  Language_Model  PDF
• 2022-06-06 Neuro-Symbolic Causal Language Planning with Commonsense Prompting    Yujie Lu, Weixi Feng, Wanrong Zhu, Wenda Xu, Xin Eric Wang, Miguel Eckstein, William Yang Wang arXiv_AI arXiv_AI  Knowledge  Pose  Action  Relation  Language_Model  PDF
• 2022-06-06 No Parameter Left Behind: How Distillation and Model Size Affect Zero-Shot Retrieval    Guilherme Moraes Rosa, Luiz Bonifacio, Vitor Jeronymo, Hugo Abonizio, Marzieh Fadaee, Roberto Lotufo, Rodrigo Nogueira arXiv_CL arXiv_CL  Zero-Shot  Action  Language_Model  PDF
• 2022-06-06 Blended Latent Diffusion    Omri Avrahami, Ohad Fried, Dani Lischinski arXiv_CV arXiv_CV  Optimization  Pose  Face  Quantitative  GAN  Inference  Language_Model  PDF
• 2022-06-06 What do tokens know about their characters and how do they know it?    Ayush Kaushal, Kyle Mahowald arXiv_CL arXiv_CL  Embedding  Bert  Knowledge  Speech  Relation  Language_Model  PDF
• 2022-06-06 Improving Contrastive Learning of Sentence Embeddings with Case-Augmented Positives and Retrieved Negatives    Wei Wang, Liangzhu Ge, Jingqiao Zhang, Cheng Yang arXiv_CL arXiv_CL  Embedding  Unsupervised  Pose  Contrastive_Learning  Language_Model  PDF
• 2022-06-06 Learning to Break the Loop: Analyzing and Mitigating Repetitions for Neural Text Generation    Jin Xu, Xiaojiang Liu, Jianhao Yan, Deng Cai, Huayang Li, Jian Li arXiv_CL arXiv_CL  Pose  Quantitative  Relation  Summarization  Text_Generation  Language_Model  PDF
• 2022-06-06 OrdinalCLIP: Learning Rank Prompts for Language-Guided Ordinal Regression    Wanhua Li, Xiaoke Huang, Zheng Zhu, Yansong Tang, Xiu Li, Jiwen Lu, Jie Zhou arXiv_CV arXiv_CV  Embedding  Pose  Few-Shot  Language_Model  Matching  PDF
• 2022-06-06 On the Advance of Making Language Models Better Reasoners    Yifei Li, Zeqi Lin, Shizhuo Zhang, Qiang Fu, Bei Chen, Jian-Guang Lou, Weizhu Chen arXiv_AI arXiv_AI  Pose  Few-Shot  Language_Model  PDF
• 2022-06-06 Pretrained Models for Multilingual Federated Learning    Orion Weller, Marc Marone, Vladimir Braverman, Dawn Lawrie, Benjamin Van Durme arXiv_CL arXiv_CL  Text_Classification  Classification  Language_Model  PDF
• 2022-06-05 Exploring Cross-lingual Textual Style Transfer with Large Multilingual Language Models    Daniil Moskovskiy, Daryna Dementieva, Alexander Panchenko arXiv_CL arXiv_CL  Style_Transfer  Language_Model  PDF
• 2022-06-05 Offline RL for Natural Language Generation with Implicit Language Q Learning    Charlie Snell, Ilya Kostrikov, Yi Su, Mengjiao Yang, Sergey Levine arXiv_CL arXiv_CL  Reinforcement_Learning  Optimization  Knowledge  Speech  Pose  Language_Model  PDF
• 2022-06-05 Sentiment Analysis of Online Travel Reviews Based on Capsule Network and Sentiment Lexicon    Jia Wang, Junping Du, Yingxia Shao, Ang Li arXiv_AI arXiv_AI  Bert  Sentiment_Classification  Review  Pose  Emotion  Classification  Sentiment  Language_Model  PDF
• 2022-06-04 Fault-Aware Neural Code Rankers    Jeevana Priya Inala, Chenglong Wang, Mei Yang, Andres Codas, Mark Encarnación, Shuvendu K Lahiri, Madanlal Musuvathi, Jianfeng Gao arXiv_AI arXiv_AI  Pose  Language_Model  PDF
• 2022-06-04 Instance-wise Prompt Tuning for Pretrained Language Models    Yuezihan Jiang, Hao Yang, Junyang Lin, Hanyu Zhao, An Yang, Chang Zhou, Hongxia Yang, Zhi Yang, Bin Cui arXiv_AI arXiv_AI  Knowledge  Language_Model  PDF
• 2022-06-04 Comparing Performance of Different Linguistically-Backed Word Embeddings for Cyberbullying Detection    Juuso Eronen, Michal Ptaszynski, Fumito Masui arXiv_AI arXiv_AI  Embedding  Bert  Speech  Pose  Detection  Relation  Language_Model  PDF
• 2022-06-04 ZeroQuant: Efficient and Affordable Post-Training Quantization for Large-Scale Transformers    Zhewei Yao, Reza Yazdani Aminabadi, Minjia Zhang, Xiaoxia Wu, Conglong Li, Yuxiong He arXiv_CL arXiv_CL  Transformer  Quantization  Bert  Knowledge  Attention  Inference  Language_Model  PDF
• 2022-06-03 Visual Clues: Bridging Vision and Language Foundations for Image Paragraph Captioning    Yujia Xie, Luowei Zhou, Xiyang Dai, Lu Yuan, Nguyen Bach, Ce Liu, Michael Zeng arXiv_AI arXiv_AI  Zero-Shot  Quantitative  Caption  Language_Model  PDF
• 2022-06-03 Relevance in Dialogue: Is Less More? An Empirical Comparison of Existing Metrics, and a Novel Simple Metric    Ian Berlot-Attwell, Frank Rudzicz arXiv_CL arXiv_CL  Pose  Relation  Language_Model  PDF
• 2022-06-03 Revisiting the 'Video' in Video-Language Understanding    Shyamal Buch, Cristóbal Eyzaguirre, Adrien Gaidon, Jiajun Wu, Li Fei-Fei, Juan Carlos Niebles arXiv_AI arXiv_AI  Self-Supervised  Pose  Language_Model  Video_Retrieval  PDF
• 2022-06-03 A-OKVQA: A Benchmark for Visual Question Answering using World Knowledge    Dustin Schwenk, Apoorv Khandelwal, Christopher Clark, Kenneth Marino, Roozbeh Mottaghi arXiv_CV arXiv_CV  Knowledge  Pose  VQA  Language_Model  QA  PDF
• 2022-06-03 Acquiring and Modelling Abstract Commonsense Knowledge via Conceptualization    Mutian He, Tianqing Fang, Weiqi Wang, Yangqiu Song arXiv_AI arXiv_AI  Knowledge  Knowledge_Graph  Inference  Language_Model  PDF
• 2022-06-03 Latent Topology Induction for Understanding Contextualized Representations    Yao Fu, Mirella Lapata arXiv_AI arXiv_AI  Embedding  Unsupervised  Pose  Language_Model  PDF
• 2022-06-03 Automatic Generation of Programming Exercises and Code Explanations with Large Language Models    Sami Sarsa, Paul Denny, Arto Hellas, Juho Leinonen arXiv_CL arXiv_CL  Quantitative  Language_Model  PDF
• 2022-06-02 VL-BEiT: Generative Vision-Language Pretraining    Hangbo Bao, Wenhui Wang, Li Dong, Furu Wei arXiv_CV arXiv_CV  Transformer  Segmentation  Semantic_Segmentation  Classification  VQA  Image_Classification  Language_Model  Prediction  PDF
• 2022-06-02 Squeezeformer: An Efficient Transformer for Automatic Speech Recognition    Sehoon Kim, Amir Gholami, Albert Shaw, Nicholas Lee, Karttikeya Mangalam, Jitendra Malik, Michael W. Mahoney, Kurt Keutzer arXiv_CL arXiv_CL  Transformer  Recognition  Speech  Pose  Attention  Speech_Recognition  CNN  Language_Model  PDF
• 2022-06-02 BayesFormer: Transformer with Uncertainty Estimation    Karthik Abinav Sankararaman, Sinong Wang, Han Fang arXiv_AI arXiv_AI  Transformer  Pose  Classification  Inference  Language_Model  PDF
• 2022-06-01 On Reinforcement Learning and Distribution Matching for Fine-Tuning Language Models with no Catastrophic Forgetting    Tomasz Korbak, Hady Elsahar, Germán Kruszewski, Marc Dymetman arXiv_CL arXiv_CL  Reinforcement_Learning  Action  Sentiment  Language_Model  Matching  PDF
• 2022-06-01 What Changed? Investigating Debiasing Methods using Causal Mediation Analysis    Sullam Jeoung, Jana Diesner arXiv_AI arXiv_AI  Pose  Detection  Attention  Language_Model  Prediction  PDF
• 2022-06-01 Cross-View Language Modeling: Towards Unified Cross-Lingual Cross-Modal Pre-training    Yan Zeng, Wangchunshu Zhou, Ao Luo, Xinsong Zhang arXiv_AI arXiv_AI  Image_Caption  Zero-Shot  Contrastive_Learning  Caption  Language_Model  PDF
• 2022-06-01 MaskOCR: Text Recognition with Masked Encoder-Decoder Pretraining    Pengyuan Lyu, Chengquan Zhang, Shanshan Liu, Meina Qiao, Yangliu Xu, Liang Wu, Kun Yao, Junyu Han, Errui Ding, Jingdong Wang arXiv_CV arXiv_CV  Transformer  Recognition  OCR  Self-Supervised  Pose  Language_Model  PDF
• 2022-06-01 THE-X: Privacy-Preserving Transformer Inference with Homomorphic Encryption    Tianyu Chen, Hangbo Bao, Shaohan Huang, Li Dong, Binxing Jiao, Daxin Jiang, Haoyi Zhou, Jianxin Li arXiv_CL arXiv_CL  Transformer  Pose  Medical  Inference  Language_Model  PDF
• 2022-06-01 Order-sensitive Shapley Values for Evaluating Conceptual Soundness of NLP Models    Kaiji Lu, Anupam Datta arXiv_AI arXiv_AI  Bert  Adversarial  Face  Sentiment  Language_Model  PDF
• 2022-05-31 A Mixture-of-Expert Approach to RL-based Dialogue Management    Yinlam Chow, Aza Tulepbergenov, Ofir Nachum, MoonKyung Ryu, Mohammad Ghavamzadeh, Craig Boutilier arXiv_AI arXiv_AI  Reinforcement_Learning  Action  Language_Model  PDF
• 2022-05-31 CodeAttack: Code-based Adversarial Attacks for Pre-Trained Programming Language Models    Akshita Jha, Chandan K. Reddy arXiv_CL arXiv_CL  Bert  Adversarial  Pose  Summarization  Language_Model  PDF
• 2022-05-31 Cluster-based Evaluation of Automatically Generated Text    Tiago Pimentel, Clara Meister, Ryan Cotterell arXiv_CL arXiv_CL  Embedding  Pose  Face  Relation  Language_Model  PDF
• 2022-05-31 NEWTS: A Corpus for News Topic-Focused Summarization    Seyed Ali Bahrainian, Sheridan Feucht, Carsten Eickhoff arXiv_CL arXiv_CL  Pose  GAN  Summarization  Language_Model  PDF
• 2022-05-31 Prompt Injection: Parameterization of Fixed Inputs    Eunbi Choi, Yongrae Jo, Joel Jang, Minjoon Seo arXiv_CL arXiv_CL  Zero-Shot  Pose  Inference  Language_Model  PDF
• 2022-05-31 hmBERT: Historical Multilingual Language Models for Named Entity Recognition    Stefan Schweter, Luisa März, Katharina Schmid, Erion Çano arXiv_CL arXiv_CL  Recognition  OCR  Bert  Optical_Character  Pose  GAN  Language_Model  PDF
• 2022-05-31 Leveraging Pre-Trained Language Models to Streamline Natural Language Interaction for Self-Tracking    Young-Ho Kim, Sungdong Kim, Minsuk Chang, Sang-Woo Lee arXiv_AI arXiv_AI  Tracking  Pose  Action  Activity  Language_Model  QA  PDF
• 2022-05-30 VLUE: A Multi-Task Benchmark for Evaluating Vision-Language Models    Wangchunshu Zhou, Yan Zeng, Shizhe Diao, Xinsong Zhang arXiv_CV arXiv_CV  Language_Model  PDF
• 2022-05-30 Prompting ELECTRA: Few-Shot Learning with Discriminative Pre-Trained Models    Mengzhou Xia, Mikel Artetxe, Jingfei Du, Danqi Chen, Ves Stoyanov arXiv_CL arXiv_CL  Few-Shot  Language_Model  Prediction  PDF
• 2022-05-30 Automatic Short Math Answer Grading via In-context Meta-learning    Mengxue Zhang, Sami Baral, Neil Heffernan, Andrew Lan arXiv_CL arXiv_CL  Bert  Pose  Language_Model  PDF
• 2022-05-30 Billions of Parameters Are Worth More Than In-domain Training Data: A case study in the Legal Case Entailment Task    Guilherme Moraes Rosa, Luiz Bonifacio, Vitor Jeronymo, Hugo Abonizio, Roberto Lotufo, Rodrigo Nogueira arXiv_CL arXiv_CL  Zero-Shot  Pose  Few-Shot  Language_Model  PDF
• 2022-05-30 Parameter Efficient Diff Pruning for Bias Mitigation    Lukas Hauzenberger, Navid Rekabsaz arXiv_CL arXiv_CL  Sparse  Pose  Inference  Language_Model  PDF
• 2022-05-30 ZusammenQA: Data Augmentation with Specialized Models for Cross-lingual Open-retrieval Question Answering System    Chia-Chien Hung, Tommaso Green, Robert Litschko, Tornike Tsereteli, Sotaro Takeshita, Marco Bombieri, Goran Glavaš, Simone Paolo Ponzetto arXiv_CL arXiv_CL  Pose  GAN  Language_Model  QA  PDF
• 2022-05-30 E2S2: Encoding-Enhanced Sequence-to-Sequence Pretraining for Language Understanding and Generation    Qihuang Zhong, Liang Ding, Juhua Liu, Bo Du, Dacheng Tao arXiv_CL arXiv_CL  Knowledge  Self-Supervised  Pose  Denoising  Language_Model  PDF
• 2022-05-30 Prompt-aligned Gradient for Prompt Tuning    Beier Zhu, Yulei Niu, Yucheng Han, Yue Wu, Hanwang Zhang arXiv_CV arXiv_CV  Zero-Shot  Knowledge  Few-Shot  Language_Model  Prediction  PDF
• 2022-05-30 Rites de Passage: Elucidating Displacement to Emplacement of Refugees    Aparup Khatua, Wolfgang Nejdl arXiv_CL arXiv_CL  Transformer  Recognition  Bert  RNN  Pose  Language_Model  PDF
• 2022-05-29 COVID-19 Literature Mining and Retrieval using Text Mining Approaches    Sanku Satya Uday, Satti Thanuja Pavani, T. Jaya Lakshmi, Rohit Chivukula arXiv_CL arXiv_CL  Bert  Pose  GAN  Language_Model  PDF
• 2022-05-29 L3Cube-MahaNLP: Marathi Natural Language Processing Datasets, Models, and Library    Raviraj Joshi arXiv_CL arXiv_CL  Transformer  Unsupervised  Recognition  Bert  Speech  Detection  Sentiment  Language_Model  PDF
• 2022-05-29 CPED: A Large-Scale Chinese Personalized and Emotional Dialogue Dataset for Conversational AI    Yirong Chen, Weiquan Fan, Xiaofen Xing, Jianxin Pang, Minlie Huang, Wenjing Han, Qianfeng Tie, Xiangmin Xu arXiv_AI arXiv_AI  Recognition  Knowledge  Pose  Emotion  Language_Model  PDF
• 2022-05-29 Decoupling Knowledge from Memorization: Retrieval-augmented Prompt Learning    Xiang Chen, Lei Li, Ningyu Zhang, Xiaozhuan Liang, Shumin Deng, Chuanqi Tan, Fei Huang, Luo Si, Huajun Chen arXiv_CL arXiv_CL  Enhancement  Zero-Shot  Knowledge  Pose  Few-Shot  Inference  Language_Model  PDF
• 2022-05-29 SFE-AI at SemEval-2022 Task 11: Low-Resource Named Entity Recognition using Large Pre-trained Language Models    Changyu Hou, Jun Wang, Yixuan Qiao, Peng Jiang, Peng Gao, Guotong Xie, Qizhi Lin, Xiaopeng Wang, Xiandi Jiang, Benqi Wang, Qifeng Xiao arXiv_CL arXiv_CL  Transformer  Recognition  Pose  Language_Model  PDF
• 2022-05-29 COFS: Controllable Furniture layout Synthesis    Wamiq Reyaz Para, Paul Guerrero, Niloy Mitra, Peter Wonka arXiv_CV arXiv_CV  Transformer  Pose  Action  Quantitative  Language_Model  PDF
• 2022-05-29 Urdu News Article Recommendation Model using Natural Language Processing Techniques    Syed Zain Abbas, Dr. Arif ur Rahman, Abdul Basit Mughal, Syed Mujtaba Haider arXiv_CL arXiv_CL  Bert  Pose  Language_Model  Recommendation  PDF
• 2022-05-29 Learning Locality and Isotropy in Dialogue Modeling    Han Wu, Haochen Tan, Mingjie Zhan, Gangming Zhao, Shaoqing Lu, Ding Liang, Linqi Song arXiv_CL arXiv_CL  Transformer  Pose  Language_Model  PDF
• 2022-05-29 AutoDisc: Automatic Distillation Schedule for Large Language Model Compression    Chen Zhang, Yang Yang, Qifan Wang, Jiahao Liu, Jingang Wang, Wei Wu, Dawei Song arXiv_CL arXiv_CL  Optimization  Knowledge  Pose  Language_Model  PDF
• 2022-05-28 Few-shot Subgoal Planning with Language Models    Lajanugen Logeswaran, Yao Fu, Moontae Lee, Honglak Lee arXiv_CL arXiv_CL  Pose  Action  Few-Shot  Language_Model  Prediction  PDF
• 2022-05-27 Self-supervised models of audio effectively explain human cortical responses to speech    Aditya R. Vaidya, Shailee Jain, Alexander G. Huth arXiv_CL arXiv_CL  Bert  Represenation_Learning  Speech  Self-Supervised  Language_Model  Prediction  PDF
• 2022-05-27 Controllable Text Generation with Neurally-Decomposed Oracle    Tao Meng, Sidi Lu, Nanyun Peng, Kai-Wei Chang arXiv_CL arXiv_CL  Pose  Text_Generation  Language_Model  PDF
• 2022-05-27 Diffusion-LM Improves Controllable Text Generation    Xiang Lisa Li, John Thickstun, Ishaan Gulrajani, Percy Liang, Tatsunori B. Hashimoto arXiv_AI arXiv_AI  Sentiment  Text_Generation  Language_Model  PDF
• 2022-05-27 GIT: A Generative Image-to-text Transformer for Vision and Language    Jianfeng Wang, Zhengyuan Yang, Xiaowei Hu, Linjie Li, Kevin Lin, Zhe Gan, Zicheng Liu, Ce Liu, Lijuan Wang arXiv_CV arXiv_CV  Image_Caption  Transformer  Recognition  Video_Caption  OCR  Optical_Character  Scene_Text  Classification  Detection  Object_Detection  Caption  Image_Classification  Language_Model  PDF
• 2022-05-27 StereoKG: Data-Driven Knowledge Graph Construction for Cultural Knowledge and Stereotypes    Awantee Deshpande, Dana Ruiter, Marius Mosbach, Dietrich Klakow arXiv_CL arXiv_CL  Knowledge  Knowledge_Graph  Speech  Classification  Detection  Language_Model  PDF
• 2022-05-27 Learning to Automate Follow-up Question Generation using Process Knowledge for Depression Triage on Reddit Posts    Shrey Gupta, Anmol Agarwal, Manas Gaur, Kaushik Roy, Vignesh Narayanan, Ponnurangam Kumaraguru, Amit Sheth arXiv_AI arXiv_AI  Knowledge  Language_Model  PDF
• 2022-05-27 Nearest Neighbor Zero-Shot Inference    Weijia Shi, Julian Michael, Suchin Gururangan, Luke Zettlemoyer arXiv_CL arXiv_CL  Zero-Shot  Text_Classification  Sparse  Classification  Inference  Language_Model  PDF
• 2022-05-27 Understanding Long Programming Languages with Structure-Aware Sparse Attention    Tingting Liu, Chengyu Wang, Cen Chen, Ming Gao, Aoying Zhou arXiv_AI arXiv_AI  Transformer  Bert  Sparse  Relation  Attention  Language_Model  PDF
• 2022-05-27 HiJoNLP at SemEval-2022 Task 2: Detecting Idiomaticity of Multiword Expressions using Multilingual Pretrained Language Models    Minghuan Tan arXiv_CL arXiv_CL  Detection  Language_Model  PDF
• 2022-05-26 Contextual Adapters for Personalized Speech Recognition in Neural Transducers    Kanthashree Mysore Sathyendra, Thejaswi Muniyappa, Feng-Ju Chang, Jing Liu, Jinru Su, Grant P. Strimel, Athanasios Mouchtaris, Siegfried Kunzmann arXiv_CL arXiv_CL  Recognition  Speech  Pose  Speech_Recognition  Inference  Language_Model  PDF
• 2022-05-26 Quark: Controllable Text Generation with Reinforced Unlearning    Ximing Lu, Sean Welleck, Liwei Jiang, Jack Hessel, Lianhui Qin, Peter West, Prithviraj Ammanabrolu, Yejin Choi arXiv_CL arXiv_CL  Reinforcement_Learning  Sentiment  Text_Generation  Language_Model  PDF
• 2022-05-26 Differentially Private Decoding in Large Language Models    Jimit Majmudar, Christophe Dupuy, Charith Peris, Sami Smaili, Rahul Gupta, Richard Zemel arXiv_CL arXiv_CL  Pose  Language_Model  PDF
• 2022-05-26 Training and Inference on Any-Order Autoregressive Models the Right Way    Andy Shih, Dorsa Sadigh, Stefano Ermon arXiv_AI arXiv_AI  Inpainting  Inference  Language_Model  PDF
• 2022-05-25 Transcormer: Transformer for Sentence Scoring with Sliding Language Modeling    Kaitao Song, Yichong Leng, Xu Tan, Yicheng Zou, Tao Qin, Dongsheng Li arXiv_CL arXiv_CL  Transformer  Bert  Pose  Attention  Language_Model  PDF
• 2022-05-25 NaturalProver: Grounded Mathematical Proof Generation with Language Models    Sean Welleck, Jiacheng Liu, Ximing Lu, Hannaneh Hajishirzi, Yejin Choi arXiv_AI arXiv_AI  Knowledge  Language_Model  PDF
• 2022-05-25 Detecting Label Errors using Pre-Trained Language Models    Derek Chong, Jenny Hong, Christopher D. Manning arXiv_CL arXiv_CL  Language_Model  PDF
• 2022-05-25 PLOG: Table-to-Logic Pretraining for Logical Table-to-Text Generation    Ao Liu, Haoyu Dong, Naoaki Okazaki, Shi Han, Dongmei Zhang arXiv_CL arXiv_CL  Knowledge  Pose  Text_Generation  Inference  Language_Model  PDF
• 2022-05-25 Understanding Natural Language in Context    Avichai Levy, Erez Karpas arXiv_CL arXiv_CL  Knowledge  Face  Language_Model  QA  PDF
• 2022-05-25 Large Language Models are Zero-Shot Clinical Information Extractors    Monica Agrawal, Stefan Hegselmann, Hunter Lang, Yoon Kim, David Sontag arXiv_AI arXiv_AI  Zero-Shot  Action  Few-Shot  Language_Model  PDF
• 2022-05-25 ProsocialDialog: A Prosocial Backbone for Conversational Agents    Hyunwoo Kim, Youngjae Yu, Liwei Jiang, Ximing Lu, Daniel Khashabi, Gunhee Kim, Yejin Choi, Maarten Sap arXiv_CL arXiv_CL  Detection  Language_Model  PDF
• 2022-05-25 ZeroGen$^+$: Self-Guided High-Quality Data Generation in Efficient Zero-Shot Learning    Jiahui Gao, Renjie Pi, Yong Lin, Hang Xu, Jiacheng Ye, Zhiyong Wu, Xiaodan Liang, Zhenguo Li, Lingpeng Kong arXiv_CL arXiv_CL  Zero-Shot  Text_Classification  Pose  Classification  Language_Model  PDF
• 2022-05-25 Language Anisotropic Cross-Lingual Model Editing    Yang Xu, Yutai Hou, Wanxiang Che arXiv_CL arXiv_CL  Knowledge  Pose  Language_Model  PDF
• 2022-05-25 Training Language Models with Memory Augmentation    Zexuan Zhong, Tao Lei, Danqi Chen arXiv_CL arXiv_CL  Knowledge  Language_Model  PDF
• 2022-05-25 Improving Zero and Few-shot Generalization in Dialogue through Instruction Tuning    Prakhar Gupta, Cathy Jiao, Yi-Ting Yeh, Shikib Mehri, Maxine Eskenazi, Jeffrey P. Bigham arXiv_CL arXiv_CL  Zero-Shot  Pose  Action  Detection  Few-Shot  Language_Model  PDF
• 2022-05-25 Discovering Language-neutral Sub-networks in Multilingual Language Models    Negar Foroutan, Mohammadreza Banaei, Remi Lebret, Antoine Bosselut, Karl Aberer arXiv_CL arXiv_CL  Bert  Language_Model  PDF
• 2022-05-25 LEPUS: Prompt-based Unsupervised Multi-hop Reranking for Open-domain QA    Muhammad Khalifa, Lajanugen Logeswaran, Moontae Lee, Honglak Lee, Lu Wang arXiv_CL arXiv_CL  Unsupervised  Language_Model  QA  PDF
• 2022-05-25 Investigating Lexical Replacements for Arabic-English Code-Switched Data Augmentation    Injy Hamed, Nizar Habash, Slim Abdennadher, Ngoc Thang Vu arXiv_CL arXiv_CL  Recognition  Speech  Pose  Speech_Recognition  Language_Model  PDF
• 2022-05-25 Multimodal Knowledge Alignment with Reinforcement Learning    Youngjae Yu, Jiwan Chung, Heeseung Yun, Jack Hessel, JaeSung Park, Ximing Lu, Prithviraj Ammanabrolu, Rowan Zellers, Ronan Le Bras, Gunhee Kim, Yejin Choi arXiv_CV arXiv_CV  Reinforcement_Learning  Zero-Shot  Optimization  Knowledge  Pose  Caption  Language_Model  PDF
• 2022-05-25 Are Large Pre-Trained Language Models Leaking Your Personal Information?    Jie Huang, Hanyin Shao, Kevin Chen-Chuan Chang arXiv_AI arXiv_AI  Pose  Language_Model  PDF
• 2022-05-25 Autoformalization with Large Language Models    Yuhuai Wu, Albert Q. Jiang, Wenda Li, Markus N. Rabe, Charles Staats, Mateja Jamnik, Christian Szegedy arXiv_AI arXiv_AI  Language_Model  PDF
• 2022-05-25 Intermediate Training on Question Answering Datasets Improves Generative Data Augmentation    Dheeraj Mekala, Tu Vu, Jingbo Shang arXiv_CL arXiv_CL  Zero-Shot  Classification  Sentiment  Few-Shot  Text_Generation  Language_Model  QA  PDF
• 2022-05-25 ORCA: Interpreting Prompted Language Models via Locating Supporting Data Evidence in the Ocean of Pretraining Data    Xiaochuang Han, Yulia Tsvetkov arXiv_CL arXiv_CL  Bert  Zero-Shot  Knowledge  Pose  Sentiment  Language_Model  PDF
• 2022-05-25 RobustLR: Evaluating Robustness to Logical Perturbation in Deductive Reasoning    Soumya Sanyal, Zeyi Liao, Xiang Ren arXiv_CL arXiv_CL  Transformer  Bert  Pose  Language_Model  PDF
• 2022-05-25 Heterogeneous Reservoir Computing Models for Persian Speech Recognition    Zohreh Ansari, Farzin Pourhoseini, Fatemeh Hadaeghi arXiv_SD arXiv_SD  Recognition  RNN  Knowledge  Speech  Pose  Speech_Recognition  Language_Model  PDF
• 2022-05-25 RSTGen: Imbuing Fine-Grained Interpretable Control into Long-FormText Generators    Rilwan A. Adewoyin, Ritabrata Dutta, Yulan He arXiv_CL arXiv_CL  Pose  Relation  Language_Model  PDF
• 2022-05-25 Perturbation Augmentation for Fairer NLP    Rebecca Qian, Candace Ross, Jude Fernandes, Eric Smith, Douwe Kiela, Adina Williams arXiv_AI arXiv_AI  Salient  Language_Model  PDF
• 2022-05-25 A Simple and Unified Tagging Model with Priming for Relational Structure Predictions    I-Hung Hsu, Kuan-Hao Huang, Shuning Zhang, Wenxin Cheng, Premkumar Natarajan, Kai-Wei Chang, Nanyun Peng arXiv_AI arXiv_AI  Pose  Action  Relation  Inference  Language_Model  Prediction  PDF
• 2022-05-25 Constrained Sampling from Language Models via Langevin Dynamics in Embedding Spaces    Sachin Kumar, Biswajit Paria, Yulia Tsvetkov arXiv_CL arXiv_CL  Embedding  Pose  Sentiment  Text_Generation  Language_Model  PDF
• 2022-05-25 RLPrompt: Optimizing Discrete Text Prompts With Reinforcement Learning    Mingkai Deng, Jianyu Wang, Cheng-Ping Hsieh, Yihan Wang, Han Guo, Tianmin Shu, Meng Song, Eric P. Xing, Zhiting Hu arXiv_CL arXiv_CL  Embedding  Unsupervised  Style_Transfer  Reinforcement_Learning  Bert  Optimization  Pose  Classification  Few-Shot  Language_Model  PDF
• 2022-05-25 ER-TEST: Evaluating Explanation Regularization Methods for NLP Models    Brihi Joshi, Aaron Chan, Ziyi Liu, Shaoliang Nie, Maziar Sanjabi, Hamed Firooz, Xiang Ren arXiv_CL arXiv_CL  Regularization  Pose  Language_Model  PDF
• 2022-05-25 Is a Question Decomposition Unit All We Need?    Pruthvi Patel, Swaroop Mishra, Mihir Parmar, Chitta Baral arXiv_AI arXiv_AI  Bert  Pose  Language_Model  PDF
• 2022-05-25 Segmenting Numerical Substitution Ciphers    Nada Aldarrab, Jonathan May arXiv_CL arXiv_CL  Segmentation  Pose  Language_Model  PDF
• 2022-05-25 Memorization in NLP Fine-tuning Methods    Fatemehsadat Mireshghallah, Archit Uniyal, Tianhao Wang, David Evans, Taylor Berg-Kirkpatrick arXiv_CL arXiv_CL  Action  Attention  Inference  Language_Model  PDF
• 2022-05-25 Teaching Broad Reasoning Skills via Decomposition-Guided Contexts    Harsh Trivedi, Niranjan Balasubramanian, Tushar Khot, Ashish Sabharwal arXiv_AI arXiv_AI  Language_Model  QA  PDF
• 2022-05-25 Fine-grained Contrastive Learning for Relation Extraction    William Hogan, Jiacheng Li, Jingbo Shang arXiv_CL arXiv_CL  Pose  Contrastive_Learning  Action  Relation  Relation_Extraction  Denoising  Language_Model  PDF
• 2022-05-25 Low Resource Style Transfer via Domain Adaptive Meta Learning    Xiangyang Li, Xiang Long, Yu Xia, Sujian Li arXiv_AI arXiv_AI  Unsupervised  Style_Transfer  Knowledge  Adversarial  Pose  Language_Model  PDF
• 2022-05-25 Learning a Better Initialization for Soft Prompts via Meta-Learning    Yukun Huang, Kun Qian, Zhou Yu arXiv_CL arXiv_CL  Unsupervised  Pose  Few-Shot  Language_Model  PDF
• 2022-05-25 Improving CTC-based ASR Models with Gated Interlayer Collaboration    Yuting Yang, Yuke Li, Binbin Du arXiv_CL arXiv_CL  Embedding  Recognition  Speech  Pose  Action  Speech_Recognition  Inference  Language_Model  PDF
• 2022-05-25 Know Where You're Going: Meta-Learning for Parameter-Efficient Fine-tuning    Mozhdeh Gheini, Xuezhe Ma, Jonathan May arXiv_CL arXiv_CL  Transfer_Learning  Optimization  Knowledge  Pose  Language_Model  PDF
• 2022-05-25 Sparse*BERT: Sparse Models are Robust    Daniel Campos, Alexandre Marques, Tuan Nguyen, Mark Kurtz, ChengXiang Zhai arXiv_AI arXiv_AI  Quantization  Bert  Sparse  Medical  Inference  Language_Model  PDF
• 2022-05-25 Towards Understanding Label Regularization for Fine-tuning Pre-trained Language Models    Ivan Kobyzev, Aref Jafari, Mehdi Rezagholizadeh, Tianda Li, Alan Do-Omri, Peng Lu, Ali Ghodsi, Pascal Poupart arXiv_CL arXiv_CL  Bert  Regularization  Knowledge  Language_Model  Prediction  PDF
• 2022-05-25 Counterfactual Data Augmentation improves Factuality of Abstractive Summarization    Dheeraj Rajagopal, Siamak Shakeri, Cicero Nogueira dos Santos, Eduard Hovy, Chung-Ching Chang arXiv_CL arXiv_CL  Summarization  Language_Model  PDF
• 2022-05-24 AdaMix: Mixture-of-Adapter for Parameter-efficient Tuning of Large Language Models    Yaqing Wang, Subhabrata Mukherjee, Xiaodong Liu, Jing Gao, Ahmed Hassan Awadallah, Jianfeng Gao arXiv_AI arXiv_AI  Transformer  Sparse  Pose  Few-Shot  Language_Model  PDF
• 2022-05-24 FLUTE: Figurative Language Understanding and Textual Explanations    Tuhin Chakrabarty, Arkadiy Saakyan, Debanjan Ghosh, Smaranda Muresan arXiv_CL arXiv_CL  Transformer  Relation  Inference  Language_Model  PDF
• 2022-05-24 MaskEval: Weighted MLM-Based Evaluation for Text Summarization and Simplification    Yu Lu Liu, Rachel Bawden, Thomas Scaliom, Benoît Sagot, Jackie Chi Kit Cheung arXiv_CL arXiv_CL  Relation  Attention  Summarization  Language_Model  PDF
• 2022-05-24 Continual-T0: Progressively Instructing 50+ Tasks to Language Models Without Forgetting    Thomas Scialom, Tuhin Chakrabarty, Smaranda Muresan arXiv_CL arXiv_CL  Zero-Shot  Knowledge  Language_Model  PDF
• 2022-05-24 Toxicity Detection with Generative Prompt-based Inference    Yau-Shian Wang, Yingshan Chang arXiv_AI arXiv_AI  Zero-Shot  Quantitative  Classification  Detection  Inference  Language_Model  PDF
• 2022-05-24 K-12BERT: BERT for K-12 education    Vasu Goel, Dhruv Sahnan, Venktesh V, Gaurav Sharma, Deep Dwivedi, Mukesh Mohania arXiv_CL arXiv_CL  Bert  Knowledge  Pose  Language_Model  PDF
• 2022-05-24 Garden-Path Traversal within GPT-2    William Jurayj, William Rudman, Carsten Eickhoff arXiv_CL arXiv_CL  Transformer  Bert  Language_Model  PDF
• 2022-05-24 History Compression via Language Models in Reinforcement Learning    Fabian Paischer, Thomas Adler, Vihang Patil, Angela Bitto-Nemling, Markus Holzleitner, Sebastian Lehner, Hamid Eghbal-zadeh, Sepp Hochreiter arXiv_CL arXiv_CL  Transformer  Embedding  Reinforcement_Learning  Pose  Language_Model  PDF
• 2022-05-24 TALM: Tool Augmented Language Models    Aaron Parisi, Yao Zhao, Noah Fiedel arXiv_AI arXiv_AI  Transformer  Knowledge  Inference  Language_Model  QA  PDF
• 2022-05-24 Evaluating the Impact of Model Scale for Compositional Generalization in Semantic Parsing    Linlu Qiu, Peter Shaw, Panupong Pasupat, Tianze Shi, Jonathan Herzig, Emily Pitler, Fei Sha, Kristina Toutanova arXiv_CL arXiv_CL  Transfer_Learning  Language_Model  PDF
• 2022-05-24 GeoMLAMA: Geo-Diverse Commonsense Probing on Multilingual Pre-Trained Language Models    Da Yin, Hritik Bansal, Masoud Monajatipoor, Liunian Harold Li, Kai-Wei Chang arXiv_CL arXiv_CL  Bert  Knowledge  Relation  Language_Model  PDF
• 2022-05-24 Chunk-based Nearest Neighbor Machine Translation    Pedro Henrique Martins, Zita Marinho, André F. T. Martins arXiv_CL arXiv_CL  Pose  Language_Model  PDF
• 2022-05-24 PoeLM: A Meter- and Rhyme-Controllable Language Model for Unsupervised Poetry Generation    Aitor Ormazabal, Mikel Artetxe, Manex Agirrezabal, Aitor Soroa, Eneko Agirre arXiv_AI arXiv_AI  Transformer  Unsupervised  Pose  Inference  Language_Model  PDF
• 2022-05-24 Learning for Expressive Task-Related Sentence Representations    Xueying Bai, Jinghuan Shang, Yifan Sun, Niranjan Balasubramanian arXiv_AI arXiv_AI  Regularization  Pose  Classification  Attention  Language_Model  Prediction  PDF
• 2022-05-24 The Curious Case of Control    Elias Stengel-Eskin, Benjamin Van Durme arXiv_CL arXiv_CL  Relation  Language_Model  PDF
• 2022-05-24 Analysing the Greek Parliament Records with Emotion Classification    John Pavlopoulos, Vanessa Lislevand arXiv_CL arXiv_CL  Transformer  Speech  Emotion  Classification  Sentiment  Language_Model  PDF
• 2022-05-24 Multi-Level Modeling Units for End-to-End Mandarin Speech Recognition    Yuting Yang, Binbin Du, Yuke Li arXiv_CL arXiv_CL  Transformer  Recognition  Speech  Speech_Recognition  Inference  Language_Model  PDF
• 2022-05-24 Attentional Mixtures of Soft Prompt Tuning for Parameter-efficient Multi-task Knowledge Sharing    Akari Asai, Mohammadreza Salehi, Matthew E. Peters, Hannaneh Hajishirzi arXiv_CL arXiv_CL  Knowledge  Attention  Language_Model  PDF
• 2022-05-24 Large Language Models are Zero-Shot Reasoners    Takeshi Kojima, Shixiang Shane Gu, Machel Reid, Yutaka Matsuo, Yusuke Iwasawa arXiv_AI arXiv_AI  Tracking  Zero-Shot  Knowledge  Few-Shot  Language_Model  PDF
• 2022-05-24 Lutma: a Frame-Making Tool for Collaborative FrameNet Development    Tiago Timponi Torrent, Arthur Lorenzi, Ely Edison da Silva Matos, Frederico Belcavello, Marcelo Viridiano, Maucha Andrade Gamonal arXiv_CL arXiv_CL  Language_Model  PDF
• 2022-05-24 Maieutic Prompting: Logically Consistent Reasoning with Recursive Explanations    Jaehun Jung, Lianhui Qin, Sean Welleck, Faeze Brahman, Chandra Bhagavatula, Ronan Le Bras, Yejin Choi arXiv_CL arXiv_CL  Unsupervised  Relation  Inference  Language_Model  QA  PDF
• 2022-05-24 Formulating Few-shot Fine-tuning Towards Language Model Pre-training: A Pilot Study on Named Entity Recognition    Zihan Wang, Kewen Zhao, Zilong Wang, Jingbo Shang arXiv_AI arXiv_AI  Recognition  Bert  Pose  Few-Shot  Language_Model  Prediction  PDF
• 2022-05-24 Analyzing the Mono- and Cross-Lingual Pretraining Dynamics of Multilingual Language Models    Terra Blevins, Hila Gonen, Luke Zettlemoyer arXiv_CL arXiv_CL  Language_Model  PDF
• 2022-05-24 BabyBear: Cheap inference triage for expensive language models    Leila Khalili, Yao You, John Bohannon arXiv_CL arXiv_CL  Transformer  Recognition  Classification  Deep_Learning  Inference  Language_Model  Prediction  PDF
• 2022-05-24 PERT: A New Solution to Pinyin to Character Conversion Task    Jinghui Xiao, Qun Liu, Xin Jiang, Yuanfeng Xiong, Haiteng Wu, Zhe Zhang arXiv_AI arXiv_AI  Transformer  RNN  Language_Model  PDF
• 2022-05-24 On the Role of Bidirectionality in Language Model Pre-Training    Mikel Artetxe, Jingfei Du, Naman Goyal, Luke Zettlemoyer, Ves Stoyanov arXiv_AI arXiv_AI  Bert  Zero-Shot  Pose  Attention  Language_Model  Prediction  PDF
• 2022-05-24 On Advances in Text Generation from Images Beyond Captioning: A Case Study in Self-Rationalization    Shruti Palaskar, Akshita Bhagia, Yonatan Bisk, Florian Metze, Alan W Black, Ana Marasovic arXiv_CV arXiv_CV  Image_Caption  Action  VQA  Attention  Text_Generation  Caption  Language_Model  QA  PDF
• 2022-05-23 Penguins Don't Fly: Reasoning about Generics through Instantiations and Exceptions    Emily Allaway, Jena D. Hwang, Chandra Bhagavatula, Kathleen McKeown, Doug Downey, Yejin Choi arXiv_CL arXiv_CL  Knowledge  Few-Shot  Inference  Language_Model  PDF
• 2022-05-23 FlexiBERT: Are Current Transformer Architectures too Homogeneous and Rigid?    Shikhar Tuli, Bhishma Dedhia, Shreshth Tuli, Niraj K. Jha arXiv_CL arXiv_CL  Transformer  NAS  Embedding  Bert  Optimization  Pose  Language_Model  PDF
• 2022-05-23 On Measuring Social Biases in Prompt-Based Multi-Task Learning    Afra Feyza Akyürek, Sejin Paik, Muhammed Yusuf Kocyigit, Seda Akbiyik, Şerife Leman Runyun, Derry Wijaya arXiv_CL arXiv_CL  Inference  Language_Model  PDF
• 2022-05-23 Improving language models fine-tuning with representation consistency targets    Anastasia Razdaibiedina, Vivek Madan, Zohar Karnin, Ashish Khetan, Vishaal Kapoor arXiv_CL arXiv_CL  Regularization  Pose  Language_Model  PDF
• 2022-05-23 Challenges in Measuring Bias via Open-Ended Language Generation    Afra Feyza Akyürek, Muhammed Yusuf Kocyigit, Sejin Paik, Derry Wijaya arXiv_CL arXiv_CL  Pose  Language_Model  Recommendation  PDF
• 2022-05-23 Simple Recurrence Improves Masked Language Models    Tao Lei, Ran Tian, Jasmijn Bastings, Ankur P. Parikh arXiv_AI arXiv_AI  Transformer  Bert  Optimization  Language_Model  PDF
• 2022-05-23 What Makes Data-to-Text Generation Hard for Pretrained Language Models?    Moniba Keymanesh, Adrian Benton, Mark Dredze arXiv_AI arXiv_AI  Knowledge  Relation  Few-Shot  Text_Generation  Language_Model  PDF
• 2022-05-23 Prompt-and-Rerank: A Method for Zero-Shot and Few-Shot Arbitrary Textual Style Transfer with Small Language Models    Mirac Suzgun, Luke Melas-Kyriazi, Dan Jurafsky arXiv_CL arXiv_CL  Style_Transfer  Zero-Shot  Pose  Few-Shot  Language_Model  PDF
• 2022-05-23 Photorealistic Text-to-Image Diffusion Models with Deep Language Understanding    Chitwan Saharia, William Chan, Saurabh Saxena, Lala Li, Jay Whang, Emily Denton, Seyed Kamyar Seyed Ghasemipour, Burcu Karagol Ayan, S. Sara Mahdavi, Rapha Gontijo Lopes, Tim Salimans, Jonathan Ho, David J Fleet, Mohammad Norouzi arXiv_CV arXiv_CV  Transformer  GAN  Language_Model  PDF
• 2022-05-23 Towards Automated Document Revision: Grammatical Error Correction, Fluency Edits, and Beyond    Masato Mita, Keisuke Sakaguchi, Masato Hagiwara, Tomoya Mizumoto, Jun Suzuki, Kentaro Inui arXiv_CL arXiv_CL  Language_Model  PDF
• 2022-05-23 Tracing Knowledge in Language Models Back to the Training Data    Ekin Akyürek, Tolga Bolukbasi, Frederick Liu, Binbin Xiong, Ian Tenney, Jacob Andreas, Kelvin Guu arXiv_CL arXiv_CL  Embedding  Knowledge  Classification  Language_Model  Prediction  PDF
• 2022-05-23 Context Limitations Make Neural Language Models More Human-Like    Tatsuki Kuribayashi, Yohei Oseki, Ana Brassard, Kentaro Inui arXiv_CL arXiv_CL  Language_Model  PDF
• 2022-05-23 QASem Parsing: Text-to-text Modeling of QA-based Semantics    Ayal Klein, Eran Hirsch, Ron Eliav, Valentina Pyatkin, Avi Caciularu, Ido Dagan arXiv_CL arXiv_CL  Pose  Relation  Language_Model  QA  PDF
• 2022-05-23 Many-Class Text Classification with Matching    Yi Song, Yuxian Gu, Minlie Huang arXiv_CL arXiv_CL  Text_Classification  Pose  Classification  Few-Shot  Language_Model  Matching  PDF
• 2022-05-23 StreamingQA: A Benchmark for Adaptation to New Knowledge over Time in Question Answering Models    Adam Liška, Tomáš Kočiský, Elena Gribovskaya, Tayfun Terzi, Eren Sezener, Devang Agrawal, Cyprien de Masson d'Autume, Tim Scholtes, Manzil Zaheer, Susannah Young, Ellen Gilsenan-McMahon, Sophia Austin, Phil Blunsom, Angeliki Lazaridou arXiv_CL arXiv_CL  Knowledge  Language_Model  QA  PDF
• 2022-05-23 Outliers Dimensions that Disrupt Transformers Are Driven by Frequency    Giovanni Puccetti, Anna Rogers, Aleksandr Drozd, Felice Dell'Orletta arXiv_AI arXiv_AI  Transformer  Embedding  Bert  Relation  Attention  Language_Model  PDF
• 2022-05-23 Looking for a Handsome Carpenter! Debiasing GPT-3 Job Advertisements    Conrad Borchers, Dalia Sara Gala, Benjamin Gilburt, Eduard Oravkin, Wilfried Bounsi, Yuki M. Asano, Hannah Rose Kirk arXiv_AI arXiv_AI  Zero-Shot  Language_Model  PDF
• 2022-05-23 ScholarBERT: Bigger is Not Always Better    Zhi Hong, Aswathy Ajith, Gregory Pauloski, Eamon Duede, Carl Malamud, Roger Magoulas, Kyle Chard, Ian Foster arXiv_CL arXiv_CL  Transformer  Bert  Language_Model  PDF
• 2022-05-23 KOLD: Korean Offensive Language Dataset    Younghoon Jeong, Juhyun Oh, Jaimeen Ahn, Jongwon Lee, Jihyung Mon, Sungjoon Park, Alice Oh arXiv_AI arXiv_AI  Speech  Detection  Attention  Language_Model  PDF
• 2022-05-23 Sample Efficient Approaches for Idiomaticity Detection    Dylan Phelps, Xuan-Rui Fan, Edward Gow-Smith, Harish Tayyar Madabushi, Carolina Scarton, Aline Villavicencio arXiv_CL arXiv_CL  Transformer  Embedding  Bert  Classification  Detection  Few-Shot  Language_Model  PDF
• 2022-05-23 BBTv2: Pure Black-Box Optimization Can Be Comparable to Gradient Descent for Few-Shot Learning    Tianxiang Sun, Zhengfu He, Hong Qian, Xuanjing Huang, Xipeng Qiu arXiv_AI arXiv_AI  Embedding  Gradient_Descent  Optimization  Pose  Classification  Few-Shot  Language_Model  PDF
• 2022-05-23 UnifieR: A Unified Retriever for Large-Scale Retrieval    Tao Shen, Xiubo Geng, Chongyang Tao, Can Xu, Kai Zhang, Daxin Jiang arXiv_CL arXiv_CL  Represenation_Learning  Pose  Language_Model  PDF
• 2022-05-23 PEVL: Position-enhanced Pre-training and Prompt Tuning for Vision-language Models    Yuan Yao, Qianyu Chen, Ao Zhang, Wei Ji, Zhiyuan Liu, Tat-Seng Chua, Maosong Sun arXiv_AI arXiv_AI  Detection  Object_Detection  Language_Model  PDF
• 2022-05-23 Prompt Tuning for Discriminative Pre-trained Language Models    Yuan Yao, Bowen Dong, Ao Zhang, Zhengyan Zhang, Ruobing Xie, Zhiyuan Liu, Leyu Lin, Maosong Sun, Jianyong Wang arXiv_AI arXiv_AI  Bert  Text_Classification  Knowledge  Classification  Language_Model  PDF
• 2022-05-23 Supporting Vision-Language Model Inference with Causality-pruning Knowledge Prompt    Jiangmeng Li, Wenyi Mo, Wenwen Qiang, Bing Su, Changwen Zheng arXiv_CV arXiv_CV  Recognition  Zero-Shot  Knowledge  Knowledge_Graph  Pose  Classification  Inference  Language_Model  PDF
• 2022-05-23 BanglaNLG: Benchmarks and Resources for Evaluating Low-Resource Natural Language Generation in Bangla    Abhik Bhattacharjee, Tahmid Hasan, Wasi Uddin Ahmad, Rifat Shahriyar arXiv_CL arXiv_CL  Transformer  Text_Generation  Language_Model  PDF
• 2022-05-23 TempLM: Distilling Language Models into Template-Based Generators    Tianyi Zhang, Mina Lee, Lisa Li, Ende Shen, Tatsunori B. Hashimoto arXiv_CL arXiv_CL  Bert  Pose  Text_Generation  Language_Model  PDF
• 2022-05-23 Vector-Quantized Input-Contextualized Soft Prompts for Natural Language Understanding    Rishabh Bhardwaj, Amrita Saha, Steven C.H. Hoi arXiv_CL arXiv_CL  Quantization  Pose  Classification  Relation  Language_Model  QA  PDF
• 2022-05-23 Artificial intelligence for topic modelling in Hindu philosophy: mapping themes between the Upanishads and the Bhagavad Gita    Rohitash Chandra, Mukul Ranjan arXiv_CL arXiv_CL  Embedding  Bert  Deep_Learning  Language_Model  PDF
• 2022-05-23 Parameter-Efficient Sparsity for Large Language Models Fine-Tuning    Yuchao Li, Fuli Luo, Chuanqi Tan, Mengdi Wang, Songfang Huang, Shen Li, Junjie Bai arXiv_AI arXiv_AI  Bert  Sparse  Pose  Language_Model  PDF
• 2022-05-23 Improving Short Text Classification With Augmented Data Using GPT-3    Salvador Balkus, Donghui Yan arXiv_CL arXiv_CL  Text_Classification  Pose  Classification  Language_Model  PDF
• 2022-05-22 The Geometry of Multilingual Language Model Representations    Tyler A. Chang, Zhuowen Tu, Benjamin K. Bergen arXiv_CL arXiv_CL  Transfer_Learning  Speech  Language_Model  Prediction  PDF
• 2022-05-22 Thor: Wielding Hammers to Integrate Language Models and Automated Theorem Provers    Albert Q. Jiang, Wenda Li, Szymon Tworkowski, Konrad Czechowski, Tomasz Odrzygóźdź, Piotr Miłoś, Yuhuai Wu, Mateja Jamnik arXiv_AI arXiv_AI  Language_Model  PDF
• 2022-05-22 Instruction Induction: From Few Examples to Natural Language Task Descriptions    Or Honovich, Uri Shaham, Samuel R. Bowman, Omer Levy arXiv_CL arXiv_CL  Language_Model  PDF
• 2022-05-22 Memorization Without Overfitting: Analyzing the Training Dynamics of Large Language Models    Kushal Tirumala, Aram H. Markosyan, Luke Zettlemoyer, Armen Aghajanyan arXiv_CL arXiv_CL  Speech  Language_Model  PDF
• 2022-05-22 Language Models with Image Descriptors are Strong Few-Shot Video-Language Learners    Zhenhailong Wang, Manling Li, Ruochen Xu, Luowei Zhou, Jie Lei, Xudong Lin, Shuohang Wang, Ziyi Yang, Chenguang Zhu, Derek Hoiem, Shih-Fu Chang, Mohit Bansal, Heng Ji arXiv_AI arXiv_AI  Recognition  Video_Caption  Speech  Pose  Few-Shot  Speech_Recognition  Caption  Language_Model  Prediction  PDF
• 2022-05-22 Do Deep Learning Models and News Headlines Outperform Conventional Prediction Techniques on Forex Data?    Sucharita Atha, Bharath Kumar Bolla arXiv_AI arXiv_AI  Embedding  Bert  RNN  Deep_Learning  Sentiment  Language_Model  Prediction  PDF
• 2022-05-22 Housekeep: Tidying Virtual Households using Commonsense Reasoning    Yash Kant, Arun Ramachandran, Sriram Yenamandra, Igor Gilitschenski, Dhruv Batra, Andrew Szot, Harsh Agrawal arXiv_CV arXiv_CV  Pose  Language_Model  PDF
• 2022-05-22 Phrase-level Textual Adversarial Attack with Label Preservation    Yibin Lei, Yu Cao, Dianqi Li, Tianyi Zhou, Meng Fang, Mykola Pechenizkiy arXiv_AI arXiv_AI  Adversarial  Pose  Language_Model  PDF
• 2022-05-21 Revisiting Pre-trained Language Models and their Evaluation for Arabic Natural Language Understanding    Abbas Ghaddar, Yimeng Wu, Sunyam Bagga, Ahmad Rashid, Khalil Bibi, Mehdi Rezagholizadeh, Chao Xing, Yasheng Wang, Duan Xinyu, Zhefeng Wang, Baoxing Huai, Xin Jiang, Qun Liu, Philippe Langlais arXiv_CL arXiv_CL  Bert  Language_Model  PDF
• 2022-05-21 An Empirical Investigation of Commonsense Self-Supervision with Knowledge Graphs    Jiarui Zhang, Filip Ilievski, Kaixin Ma, Jonathan Francis, Alessandro Oltramari arXiv_AI arXiv_AI  Zero-Shot  Knowledge  Knowledge_Graph  Language_Model  PDF
• 2022-05-21 Least-to-Most Prompting Enables Complex Reasoning in Large Language Models    Denny Zhou, Nathanael Schärli, Le Hou, Jason Wei, Nathan Scales, Xuezhi Wang, Dale Schuurmans, Olivier Bousquet, Quoc Le, Ed Chi arXiv_AI arXiv_AI  Pose  Language_Model  PDF
• 2022-05-21 Few-Shot Natural Language Inference Generation with PDD: Prompt and Dynamic Demonstration    Kaijian Li, Shansan Gong, Kenny Q. Zhu arXiv_AI arXiv_AI  Pose  Classification  Relation  Few-Shot  Text_Generation  Inference  Language_Model  PDF
• 2022-05-21 HLATR: Enhance Multi-stage Text Retrieval with Hybrid List Aware Transformer Reranking    Yanzhao Zhang, Dingkun Long, Guangwei Xu, Pengjun Xie arXiv_CL arXiv_CL  Transformer  Bert  Optimization  Language_Model  PDF
• 2022-05-21 Scenario-based Multi-product Advertising Copywriting Generation for E-Commerce    Xueying Zhang, Kai Shen, Chi Zhang, Xiaochuan Fan, Yun Xiao, Zhen He, Bo Long, Lingfei Wu arXiv_AI arXiv_AI  Enhancement  Knowledge  Pose  Language_Model  Prediction  Recommendation  PDF
• 2022-05-21 Pre-training Data Quality and Quantity for a Low-Resource Language: New Corpus and BERT Models for Maltese    Kurt Micallef, Albert Gatt, Marc Tanti, Lonneke van der Plas, Claudia Borg arXiv_CL arXiv_CL  Recognition  Bert  Speech  Action  Classification  Sentiment  Language_Model  PDF
• 2022-05-21 Scaling Laws and Interpretability of Learning from Repeated Data    Danny Hernandez, Tom Brown, Tom Conerly, Nova DasSarma, Dawn Drain, Sheer El-Showk, Nelson Elhage, Zac Hatfield-Dodds, Tom Henighan, Tristan Hume, Scott Johnston, Ben Mann, Chris Olah, Catherine Olsson, Dario Amodei, Nicholas Joseph, Jared Kaplan, Sam McCandlish arXiv_AI arXiv_AI  Pose  Action  Language_Model  PDF
• 2022-05-21 DeepStruct: Pretraining of Language Models for Structure Prediction    Chenguang Wang, Xiao Liu, Zui Chen, Haoyun Hong, Jie Tang, Dawn Song arXiv_AI arXiv_AI  Tracking  Recognition  Zero-Shot  Knowledge  Action  Classification  Detection  Relation  Relation_Extraction  Language_Model  Prediction  PDF
• 2022-05-20 Forecasting COVID-19 Caseloads Using Unsupervised Embedding Clusters of Social Media Posts    Felix Drinkall, Stefan Zohren, Janet B. Pierrehumbert arXiv_CL arXiv_CL  Transformer  Embedding  Tracking  Unsupervised  Classification  Language_Model  PDF
• 2022-05-20 Multi2WOZ: A Robust Multilingual Dataset and Conversational Pretraining for Task-Oriented Dialog    Chia-Chien Hung, Anne Lauscher, Ivan Vulić, Simone Paolo Ponzetto, Goran Glavaš arXiv_CL arXiv_CL  Tracking  Zero-Shot  Few-Shot  Language_Model  PDF
• 2022-05-20 Multilingual Normalization of Temporal Expressions with Masked Language Models    Lukas Lange, Jannik Strötgen, Heike Adel, Dietrich Klakow arXiv_CL arXiv_CL  Pose  Detection  Language_Model  PDF
• 2022-05-20 UViM: A Unified Modeling Approach for Vision with Learned Guiding Codes    Alexander Kolesnikov, André Susano Pinto, Lucas Beyer, Xiaohua Zhai, Jeremiah Harmsen, Neil Houlsby arXiv_CV arXiv_CV  Segmentation  Language_Model  Prediction  PDF
• 2022-05-20 Heterformer: A Transformer Architecture for Node Representation Learning on Heterogeneous Text-Rich Networks    Bowen Jin, Yu Zhang, Qi Zhu, Jiawei Han arXiv_CL arXiv_CL  Transformer  Enhancement  Represenation_Learning  Pose  Classification  Attention  Language_Model  Prediction  PDF
• 2022-05-20 Progressive Class Semantic Matching for Semi-supervised Text Classification    Hai-Ming Xu, Lingqiao Liu, Ehsan Abbasnejad arXiv_AI arXiv_AI  Bert  Text_Classification  Pose  Classification  Language_Model  Matching  PDF
• 2022-05-20 Prototypical Calibration for Few-shot Learning of Language Models    Zhixiong Han, Yaru Hao, Li Dong, Furu Wei arXiv_CL arXiv_CL  Pose  Classification  Few-Shot  Language_Model  Prediction  Matching  PDF
• 2022-05-20 Visually-Augmented Language Modeling    Weizhi Wang, Li Dong, Hao Cheng, Haoyu Song, Xiaodong Liu, Xifeng Yan, Jianfeng Gao, Furu Wei arXiv_CL arXiv_CL  Image_Retrieval  Knowledge  Self-Supervised  Pose  Language_Model  PDF
• 2022-05-20 Exploring Extreme Parameter Compression for Pre-trained Language Models    Yuxin Ren, Benyou Wang, Lifeng Shang, Xin Jiang, Qun Liu arXiv_CL arXiv_CL  Transformer  Reconstruction  Embedding  Bert  Knowledge  Pose  Attention  Inference  Language_Model  PDF
• 2022-05-20 MPI: Evaluating and Inducing Personality in Pre-trained Language Models    Guangyuan Jiang, Manjie Xu, Song-Chun Zhu, Wenjuan Han, Chi Zhang, Yixin Zhu arXiv_AI arXiv_AI  Pose  Language_Model  PDF
• 2022-05-20 KERPLE: Kernelized Relative Positional Embedding for Length Extrapolation    Ta-Chung Chi, Ting-Han Fan, Peter J. Ramadge, Alexander I. Rudnicky arXiv_CL arXiv_CL  Embedding  Pose  Attention  Language_Model  PDF
• 2022-05-19 Automated Scoring for Reading Comprehension via In-context BERT Tuning    Nigel Fernandez, Aritra Ghosh, Naiming Liu, Zichao Wang, Benoît Choffin, Richard Baraniuk, Andrew Lan arXiv_AI arXiv_AI  Bert  Language_Model  PDF
• 2022-05-19 RankGen: Improving Text Generation with Large Ranking Models    Kalpesh Krishna, Yapei Chang, John Wieting, Mohit Iyyer arXiv_CL arXiv_CL  Contrastive_Learning  Text_Generation  Language_Model  PDF
• 2022-05-19 Selection-Inference: Exploiting Large Language Models for Interpretable Logical Reasoning    Antonia Creswell, Murray Shanahan, Irina Higgins arXiv_AI arXiv_AI  Pose  Few-Shot  Inference  Language_Model  PDF
• 2022-05-19 PLAID: An Efficient Engine for Late Interaction Retrieval    Keshav Santhanam, Omar Khattab, Christopher Potts, Matei Zaharia arXiv_CL arXiv_CL  Bert  Action  Language_Model  PDF
• 2022-05-19 Self-augmented Data Selection for Few-shot Dialogue Generation    Wanyu Du, Hanjie Chen, Yangfeng Ji arXiv_CL arXiv_CL  Pose  Face  Action  Few-Shot  Text_Generation  Language_Model  PDF
• 2022-05-19 Great Power, Great Responsibility: Recommendations for Reducing Energy for Training Language Models    Joseph McDonald, Baolin Li, Nathan Frey, Devesh Tiwari, Vijay Gadepally, Siddharth Samsi arXiv_AI arXiv_AI  Transformer  Inference  Language_Model  Recommendation  PDF
• 2022-05-19 Automatic Spoken Language Identification using a Time-Delay Neural Network    Benjamin Kepecs, Homayoon Beigi arXiv_CL arXiv_CL  Recognition  Speech  Speech_Recognition  Language_Model  PDF
• 2022-05-19 Nebula-I: A General Framework for Collaboratively Training Deep Learning Models on Low-Bandwidth Cloud Clusters    Yang Xiang, Zhihua Wu, Weibao Gong, Siyu Ding, Xianjie Mo, Yuang Liu, Shuohuan Wang, Peng Liu, Yongshuai Hou, Long Li, Bin Wang, Shaohuai Shi, Yaqian Han, Yue Yu, Ge Li, Yu Sun, Yanjun Ma, Dianhai Yu arXiv_AI arXiv_AI  Knowledge  Pose  Face  Deep_Learning  Inference  Language_Model  PDF
• 2022-05-19 Transformers as Neural Augmentors: Class Conditional Sentence Generation via Variational Bayes    M. Şafak Bilici, Mehmet Fatih Amasyali arXiv_CL arXiv_CL  Transformer  Pose  Language_Model  PDF
• 2022-05-19 Are Prompt-based Models Clueless?    Pride Kavumba, Ryo Takahashi, Yasuke Oda arXiv_CL arXiv_CL  Few-Shot  Language_Model  PDF
• 2022-05-18 PromptDA: Label-guided Data Augmentation for Prompt-based Few Shot Learners    Canyu Chen, Kai Shu arXiv_AI arXiv_AI  Text_Classification  Pose  Classification  Few-Shot  Language_Model  PDF
• 2022-05-18 Entailment Tree Explanations via Iterative Retrieval-Generation Reasoner    Danilo Ribeiro, Shen Wang, Xiaofei Ma, Rui Dong, Xiaokai Wei, Henry Zhu, Xinchi Chen, Zhiheng Huang, Peng Xu, Andrew Arnold, Dan Roth arXiv_CL arXiv_CL  Pose  Language_Model  QA  PDF
• 2022-05-18 'I'm sorry to hear that': finding bias in language models with a holistic descriptor dataset    Eric Michael Smith, Melissa Hall Melanie Kambadur, Eleonora Presani, Adina Williams (Meta AI) arXiv_CL arXiv_CL  Pose  Language_Model  PDF
• 2022-05-18 ERNIE-Search: Bridging Cross-Encoder with Dual-Encoder via Self On-the-fly Distillation for Dense Passage Retrieval    Yuxiang Lu, Yiding Liu, Jiaxiang Liu, Yunsheng Shi, Zhengjie Huang, Shikun Feng Yu Sun, Hao Tian, Hua Wu, Shuaiqiang Wang, Dawei Yin, Haifeng Wang arXiv_CL arXiv_CL  Bert  Knowledge  Pose  Action  Language_Model  QA  PDF
• 2022-05-18 Minimising Biasing Word Errors for Contextual ASR with the Tree-Constrained Pointer Generator    Guangzhi Sun, Chao Zhang, Philip C Woodland arXiv_CL arXiv_CL  Tracking  Recognition  Zero-Shot  Knowledge  Speech  Pose  Ontology  Speech_Recognition  Language_Model  PDF
• 2022-05-18 GPoeT-2: A GPT-2 Based Poem Generator    Kai-Ling Lo, Rami Ariss, Philipp Kurz arXiv_AI arXiv_AI  Language_Model  PDF
• 2022-05-18 LogiGAN: Learning Logical Reasoning via Adversarial Pre-training    Xinyu Pi, Wanjun Zhong, Yan Gao, Nan Duan, Jian-Guang Lou arXiv_CL arXiv_CL  Unsupervised  Adversarial  Detection  GAN  Language_Model  PDF
• 2022-05-17 AvatarCLIP: Zero-Shot Text-Driven Generation and Animation of 3D Avatars    Fangzhou Hong, Mingyuan Zhang, Liang Pan, Zhongang Cai, Lei Yang, Ziwei Liu arXiv_CV arXiv_CV  OCR  3D  Zero-Shot  Knowledge  Pose  Quantitative  Language_Model  PDF
• 2022-05-17 Recovering Private Text in Federated Learning of Language Models    Samyak Gupta, Yangsibo Huang, Zexuan Zhong, Tianyu Gao, Kai Li, Danqi Chen arXiv_CL arXiv_CL  Knowledge  Language_Model  PDF
• 2022-05-17 Feature Aggregation in Zero-Shot Cross-Lingual Transfer Using Multilingual BERT    Beiduo Chen, Wu Guo, Quan Liu, Kun Tao arXiv_CL arXiv_CL  Transformer  Recognition  Bert  Zero-Shot  Pose  Attention  Language_Model  PDF
• 2022-05-17 SKILL: Structured Knowledge Infusion for Large Language Models    Fedor Moiseev, Zhe Dong, Enrique Alfonseca, Martin Jaggi arXiv_AI arXiv_AI  Knowledge  Knowledge_Graph  Pose  Language_Model  QA  PDF
• 2022-05-16 CascadER: Cross-Modal Cascading for Knowledge Graph Link Prediction    Tara Safavi, Doug Downey, Tom Hope arXiv_AI arXiv_AI  Embedding  Knowledge  Knowledge_Graph  Pose  Language_Model  Prediction  PDF
• 2022-05-16 A Precis of Language Models are not Models of Language    Csaba Veres arXiv_CL arXiv_CL  Language_Model  PDF
• 2022-05-16 Heroes, Villains, and Victims, and GPT-3 -- Automated Extraction of Character Roles Without Training Data    Dominik Stammbach, Maria Antoniak, Elliott Ash arXiv_CL arXiv_CL  Zero-Shot  Speech  Action  Language_Model  PDF
• 2022-05-16 Prompting to Distill: Boosting Data-Free Knowledge Distillation via Reinforced Prompt    Xinyin Ma, Xinchao Wang, Gongfan Fang, Yongliang Shen, Weiming Lu arXiv_CL arXiv_CL  Reconstruction  Knowledge  Pose  Language_Model  PDF
• 2022-05-16 What GPT Knows About Who is Who    Xiaohan Yang, Eduardo Peynetti, Vasco Meerman, Chris Tanner arXiv_CL arXiv_CL  Language_Model  QA  PDF
• 2022-05-15 SeqZero: Few-shot Compositional Semantic Parsing with Sequential Prompts and Zero-shot Models    Jingfeng Yang, Haoming Jiang, Qingyu Yin, Danqing Zhang, Bing Yin, Diyi Yang arXiv_CL arXiv_CL  Zero-Shot  Knowledge  Pose  Few-Shot  Language_Model  PDF
• 2022-05-15 TiBERT: Tibetan Pre-trained Language Model    Yuan Sun, Sisi Liu, Junjie Deng, Xiaobing Zhao arXiv_AI arXiv_AI  Bert  Text_Classification  Classification  Language_Model  PDF
• 2022-05-15 Classifiers are Better Experts for Controllable Text Generation    Askhat Sitdikov, Nikita Balagansky, Daniil Gavrilov, Alexander Markov arXiv_CL arXiv_CL  Pose  Sentiment  Text_Generation  Language_Model  Prediction  PDF
• 2022-05-15 Mitigating Toxic Degeneration with Empathetic Data: Exploring the Relationship Between Toxicity and Empathy    Allison Lahnala, Charles Welch, Béla Neuendorf, Lucie Flek arXiv_AI arXiv_AI  Emotion  Relation  Text_Generation  Language_Model  PDF
• 2022-05-15 Fine-tuning Pre-trained Language Models for Few-shot Intent Detection: Supervised Pre-training and Isotropization    Haode Zhang, Haowen Liang, Yuwei Zhang, Liming Zhan, Xiao-Ming Wu, Xiaolei Lu, Albert Y.S. Lam arXiv_CL arXiv_CL  Pose  Contrastive_Learning  Detection  Relation  Few-Shot  Language_Model  PDF
• 2022-05-14 What do Models Learn From Training on More Than Text? Measuring Visual Commonsense Knowledge    Lovisa Hagström, Richard Johansson arXiv_CL arXiv_CL  Knowledge  Language_Model  PDF
• 2022-05-13 A Property Induction Framework for Neural Language Models    Kanishka Misra, Julia Taylor Rayz, Allyson Ettinger arXiv_CL arXiv_CL  Knowledge  GAN  Language_Model  PDF
• 2022-05-13 Bootstrapping Text Anonymization Models with Distant Supervision    Anthi Papadopoulou, Pierre Lison, Lilja Øvrelid, Ildikó Pilán arXiv_CL arXiv_CL  Bert  Knowledge  Knowledge_Graph  Pose  Language_Model  PDF
• 2022-05-13 PathologyBERT -- Pre-trained Vs. A New Transformer Language Model for Pathology Domain    Thiago Santos, Amara Tariq, Susmita Das, Kavyasree Vayalpati, Geoffrey H. Smith, Hari Trivedi, Imon Banerjee arXiv_CL arXiv_CL  Transformer  Surveillance  Bert  Pose  Face  Classification  Language_Model  PDF
• 2022-05-13 Improving the Numerical Reasoning Skills of Pretrained Language Models    Dominic Petrak, Nafise Sadat Moosavi, Iryna Gurevych arXiv_CL arXiv_CL  Pose  Contrastive_Learning  Text_Generation  Inference  Language_Model  Prediction  PDF
• 2022-05-13 Controlling Translation Formality Using Pre-trained Multilingual Language Models    Elijah Rippeth, Sweta Agrawal, Marine Carpuat arXiv_CL arXiv_CL  Language_Model  PDF
• 2022-05-13 Weakly Supervised Text Classification using Supervision Signals from a Language Model    Ziqian Zeng, Weimin Ni, Tianqing Fang, Xiang Li, Xinran Zhao, Yangqiu Song arXiv_CL arXiv_CL  Weakly_Supervised  Text_Classification  Pose  Classification  Language_Model  PDF
• 2022-05-13 Improving Contextual Representation with Gloss Regularized Pre-training    Yu Lin, Zhecheng An, Peihao Wu, Zejun Ma arXiv_AI arXiv_AI  Embedding  Unsupervised  Bert  Pose  Inference  Language_Model  PDF
• 2022-05-13 TIE: Topological Information Enhanced Structural Reading Comprehension on Web Pages    Zihan Zhao, Lu Chen, Ruisheng Cao, Hongshen Xu, Xingyu Chen, Kai Yu arXiv_CL arXiv_CL  Pose  Attention  Language_Model  PDF
• 2022-05-12 Beyond Static Models and Test Sets: Benchmarking the Potential of Pre-trained Models Across Tasks and Languages    Kabir Ahuja, Sandipan Dandapat, Sunayana Sitaram, Monojit Choudhury arXiv_CL arXiv_CL  Bert  Pose  Language_Model  Prediction  PDF
• 2022-05-12 On the Economics of Multilingual Few-shot Learning: Modeling the Cost-Performance Trade-offs of Machine Translated and Manual Data    Kabir Ahuja, Monojit Choudhury, Sandipan Dandapat arXiv_CL arXiv_CL  Knowledge  Few-Shot  Language_Model  QA  PDF
• 2022-05-12 Noun2Verb: Probabilistic frame semantics for word class conversion    Lei Yu, Yang Xu arXiv_CL arXiv_CL  Knowledge  Speech  Language_Model  PDF
• 2022-05-12 Using Natural Sentences for Understanding Biases in Language Models    Sarah Alnegheimish, Alicia Guo, Yi Sun arXiv_CL arXiv_CL  Pose  Language_Model  PDF
• 2022-05-12 FETA: A Benchmark for Few-Sample Task Transfer in Open-Domain Dialogue    Alon Albalak, Yi-Lin Tuan, Pegah Jandaghi, Connor Pryor, Luke Yoffe, Deepak Ramachandran, Lise Getoor, Jay Pujara, William Yang Wang arXiv_CL arXiv_CL  Knowledge  Action  Language_Model  PDF
• 2022-05-12 Predicting Human Psychometric Properties Using Computational Language Models    Antonio Laverghetta Jr., Animesh Nighojkar, Jamshidbek Mirzakhalov, John Licato arXiv_CL arXiv_CL  Transformer  Language_Model  Prediction  PDF
• 2022-05-12 A Generalist Agent    Scott Reed, Konrad Zolna, Emilio Parisotto, Sergio Gomez Colmenarejo, Alexander Novikov, Gabriel Barth-Maron, Mai Gimenez, Yury Sulsky, Jackie Kay, Jost Tobias Springenberg, Tom Eccles, Jake Bruce, Ali Razavi, Ashley Edwards, Nicolas Heess, Yutian Chen, Raia Hadsell, Oriol Vinyals, Mahyar Bordbar, Nando de Freitas arXiv_AI arXiv_AI  Caption  Language_Model  PDF
• 2022-05-12 Localized Vision-Language Matching for Open-vocabulary Object Detection    Maria A. Bravo, Sudhanshu Mittal, Thomas Brox arXiv_CV arXiv_CV  Image_Caption  Regularization  Pose  Detection  Object_Detection  Caption  Language_Model  Matching  PDF
• 2022-05-12 Is the Computation of Abstract Sameness Relations Human-Like in Neural Language Models?    Lukas Thoma, Benjamin Roth arXiv_CL arXiv_CL  Bert  Face  Relation  Language_Model  PDF
• 2022-05-12 Multi Task Learning For Zero Shot Performance Prediction of Multilingual Models    Kabir Ahuja, Shanu Kumar, Sandipan Dandapat, Monojit Choudhury arXiv_CL arXiv_CL  Transformer  Zero-Shot  Multi_Task  Language_Model  Prediction  PDF
• 2022-05-12 Sampling with Attribute-Related Information for Controlling Language Models    Shangda Wu, Maosong Sun arXiv_CL arXiv_CL  Pose  Sentiment  Language_Model  PDF
• 2022-05-12 AiSocrates: Towards Answering Ethical Quandary Questions    Yejin Bang, Nayeon Lee, Tiezheng Yu, Leila Khalatbari, Yan Xu, Dan Su, Elham J. Barezi, Andrea Madotto, Hayden Kee, Pascale Fung arXiv_AI arXiv_AI  OCR  Pose  Few-Shot  Language_Model  PDF
• 2022-05-12 SimCPSR: Simple Contrastive Learning for Paper Submission Recommendation System    Duc H. Le, Tram T. Doan, Son T. Huynh, Binh T. Nguyen arXiv_CV arXiv_CV  Transformer  Transfer_Learning  Pose  Contrastive_Learning  Language_Model  Recommendation  PDF
• 2022-05-12 AdaVAE: Exploring Adaptive GPT-2s in Variational Auto-Encoders for Language Modeling    Haoqin Tu, Zhongliang Yang, Jinshuai Yang, Siyu Zhang, Yongfeng Huang arXiv_CL arXiv_CL  Represenation_Learning  RNN  GAN  Language_Model  PDF
• 2022-05-11 Structured, flexible, and robust: benchmarking and improving large language models towards more human-like behavior in out-of-distribution reasoning tasks    Katherine M. Collins, Catherine Wong, Jiahai Feng, Megan Wei, Joshua B. Tenenbaum arXiv_AI arXiv_AI  Pose  Language_Model  PDF
• 2022-05-11 Aggregating Pairwise Semantic Differences for Few-Shot Claim Veracity Classification    Xia Zeng, Arkaitz Zubiaga arXiv_AI arXiv_AI  Bert  Classification  Few-Shot  Language_Model  PDF
• 2022-05-11 Few-Shot Parameter-Efficient Fine-Tuning is Better and Cheaper than In-Context Learning    Haokun Liu, Derek Tam, Mohammed Muqeeth, Jay Mohta, Tenghao Huang, Mohit Bansal, Colin Raffel arXiv_AI arXiv_AI  Sparse  Pose  Few-Shot  Language_Model  Prediction  PDF
• 2022-05-11 An Empirical Study Of Self-supervised Learning Approaches For Object Detection With Transformers    Gokul Karthik Kumar, Sahal Shaji Mullappilly, Abhishek Singh Gehlot arXiv_AI arXiv_AI  Transformer  Reconstruction  Self-Supervised  Classification  Detection  Relation  Object_Detection  CNN  Image_Classification  Language_Model  PDF
• 2022-05-11 Clinical Prompt Learning with Frozen Language Models    Niall Taylor, Yi Zhang, Dan Joyce, Alejo Nevado-Holgado, Andrey Kormilitzin arXiv_CL arXiv_CL  Zero-Shot  Few-Shot  Medical  Language_Model  PDF
• 2022-05-11 Towards the Generation of Musical Explanations with GPT-3    Stephen James Krol, Maria Teresa Llano, Jon McCormack arXiv_AI arXiv_AI  Action  Language_Model  PDF
• 2022-05-11 Making Pre-trained Language Models Good Long-tailed Learners    Chen Zhang, Lei Ren, Jingang Wang, Wei Wu, Dawei Song arXiv_CL arXiv_CL  Knowledge  Classification  Few-Shot  Language_Model  PDF
• 2022-05-11 Pre-trained Language Models as Re-Annotators    Chang Shu arXiv_AI arXiv_AI  OCR  Knowledge  Pose  Contrastive_Learning  Action  Detection  Relation  Relation_Extraction  Language_Model  PDF
• 2022-05-11 Towards Unified Prompt Tuning for Few-shot Text Classification    Jianing Wang, Chengyu Wang, Fuli Luo, Chuanqi Tan, Minghui Qiu, Fei Yang, Qiuhui Shi, Songfang Huang, Ming Gao arXiv_AI arXiv_AI  Bert  Text_Classification  Knowledge  Self-Supervised  Pose  Classification  Few-Shot  Language_Model  PDF
• 2022-05-10 Reducing Activation Recomputation in Large Transformer Models    Vijay Korthikanti, Jared Casper, Sangkug Lym, Lawrence McAfee, Michael Andersch, Mohammad Shoeybi, Bryan Catanzaro arXiv_CL arXiv_CL  Transformer  Language_Model  PDF
• 2022-05-10 Human Language Modeling    Nikita Soni, Matthew Matero, Niranjan Balasubramanian, H. Andrew Schwartz arXiv_CL arXiv_CL  Transformer  Sentiment_Classification  Pose  Classification  Detection  Sentiment  Language_Model  PDF
• 2022-05-10 Extracting Latent Steering Vectors from Pretrained Language Models    Nishant Subramani, Nivedita Suresh, Matthew E. Peters arXiv_AI arXiv_AI  Unsupervised  Sentiment  Text_Generation  Language_Model  PDF
• 2022-05-10 Symphony Generation with Permutation Invariant Language Model    Jiafeng Liu, Yuanliang Dong, Zehua Cheng, Xinran Zhang, Xiaobing Li, Feng Yu, Maosong Sun arXiv_AI arXiv_AI  Transformer  Embedding  Pose  Text_Generation  Language_Model  PDF
• 2022-05-10 The Importance of Context in Very Low Resource Language Modeling    Lukas Edman, Antonio Toral, Gertjan van Noord arXiv_CL arXiv_CL  Attention  Language_Model  PDF
• 2022-05-10 From Distillation to Hard Negative Sampling: Making Sparse Neural IR Models More Effective    Thibault Formal, Carlos Lassance, Benjamin Piwowarski, Stéphane Clinchant arXiv_CL arXiv_CL  Zero-Shot  Sparse  Represenation_Learning  Pose  Attention  Language_Model  Matching  PDF
• 2022-05-10 SuMe: A Dataset Towards Summarizing Biomedical Mechanisms    Mohaddeseh Bastan, Nishant Shankar, Mihai Surdeanu, Niranjan Balasubramanian arXiv_AI arXiv_AI  Relation  Summarization  Medical  Language_Model  PDF
• 2022-05-10 Sentence-level Privacy for Document Embeddings    Casey Meehan, Khalil Mrini, Kamalika Chaudhuri arXiv_CL arXiv_CL  Embedding  Pose  Classification  Sentiment  Language_Model  PDF
• 2022-05-09 Unsupervised Slot Schema Induction for Task-oriented Dialog    Dian Yu, Mingqiu Wang, Yuan Cao, Izhak Shafran, Laurent El Shafey, Hagen Soltau arXiv_CL arXiv_CL  Tracking  Unsupervised  Pose  Language_Model  PDF
• 2022-05-09 Long Document Re-ranking with Modular Re-ranker    Luyu Gao, Jamie Callan arXiv_CL arXiv_CL  Transformer  Bert  Pose  Action  Attention  Language_Model  PDF
• 2022-05-09 LayoutXLM vs. GNN: An Empirical Evaluation of Relation Extraction for Documents    Hervé Déjean, Stéphane Clinchant, Jean-Luc Meunier arXiv_AI arXiv_AI  Action  Relation  Relation_Extraction  Language_Model  PDF
• 2022-05-09 Attribution-based Task-specific Pruning for Multi-task Language Models    Nakyeong Yang, Yunah Jang, Hwanhee Lee, Seohyeong Jung, Kyomin Jung arXiv_AI arXiv_AI  Pose  Language_Model  PDF
• 2022-05-09 A Balanced Data Approach for Evaluating Cross-Lingual Transfer: Mapping the Linguistic Blood Bank    Dan Malkin, Tomasz Limisiewicz, Gabriel Stanovsky arXiv_AI arXiv_AI  Bert  Zero-Shot  Relation  Language_Model  PDF
• 2022-05-09 Improving negation detection with negation-focused pre-training    Thinh Hung Truong, Timothy Baldwin, Trevor Cohn, Karin Verspoor arXiv_CL arXiv_CL  Bert  Pose  Detection  Language_Model  PDF
• 2022-05-08 MASALA: Modelling and Analysing the Semantics of Adpositions in Linguistic Annotation of Hindi    Aryaman Arora, Nitin Venkateswaran, Nathan Schneider arXiv_CL arXiv_CL  Relation  Language_Model  PDF
• 2022-05-08 Multimodal Semi-Supervised Learning for Text Recognition    Aviad Aberdam, Roy Ganz, Shai Mazor, Ron Litman arXiv_AI arXiv_AI  Recognition  Represenation_Learning  Regularization  Self-Supervised  Pose  Scene_Text  Language_Model  PDF
• 2022-05-08 Beyond Distributional Hypothesis: Let Language Models Learn Meaning-Text Correspondence    Myeongjun Jang, Frank Mtumbuka, Thomas Lukasiewicz arXiv_AI arXiv_AI  Pose  Language_Model  Prediction  Matching  PDF
• 2022-05-08 Context-Aware Abbreviation Expansion Using Large Language Models    Shanqing Cai, Subhashini Venugopalan, Katrin Tomanek, Ajit Narayanan, Meredith R. Morris, Michael P. Brenner arXiv_CL arXiv_CL  Zero-Shot  Pose  Few-Shot  Language_Model  PDF
• 2022-05-07 Empowering parameter-efficient transfer learning by recognizing the kernel structure in self-attention    Yifan Chen, Devamanyu Hazarika, Mahdi Namazifar, Yang Liu, Di Jin, Dilek Hakkani-Tur arXiv_CL arXiv_CL  Transformer  Transfer_Learning  Pose  Attention  Language_Model  PDF
• 2022-05-07 AKI-BERT: a Pre-trained Clinical Language Model for Early Prediction of Acute Kidney Injury    Chengsheng Mao, Liang Yao, Yuan Luo arXiv_CL arXiv_CL  Transformer  Bert  Action  Medical  Language_Model  Prediction  PDF
• 2022-05-07 Towards a Progression-Aware Autonomous Dialogue Agent    Abraham Sanders (1), Tomek Strzalkowski (1), Mei Si (1), Albert Chang (1), Deepanshu Dey (1), Jonas Braasch (1), Dakuo Wang (2) ((1) Rensselaer Polytechnic Institute, Troy, NY, USA, (2) IBM Research, USA) arXiv_AI arXiv_AI  Pose  Autonomous  Language_Model  PDF
• 2022-05-06 When a sentence does not introduce a discourse entity, Transformer-based models still sometimes refer to it    Sebastian Schuster, Tal Linzen arXiv_CL arXiv_CL  Transformer  Tracking  Knowledge  Action  Language_Model  PDF
• 2022-05-06 A Data Cartography based MixUp for Pre-trained Language Models    Seo Yeon Park, Cornelia Caragea arXiv_CL arXiv_CL  Bert  Pose  Language_Model  PDF
• 2022-05-06 The Unreliability of Explanations in Few-Shot In-Context Learning    Xi Ye, Greg Durrett arXiv_CL arXiv_CL  Few-Shot  Inference  Language_Model  Prediction  PDF
• 2022-05-06 Prompt Distribution Learning    Yuning Lu, Jianzhuang Liu, Yonggang Zhang, Yajing Liu, Xinmei Tian arXiv_CV arXiv_CV  Embedding  Recognition  Language_Model  PDF
• 2022-05-06 Disentangled Learning of Stance and Aspect Topics for Vaccine Attitude Detection in Social Media    Lixing Zhu, Zheng Fang, Gabriele Pergola, Rob Procter, Yulan He arXiv_CL arXiv_CL  Pose  Detection  Sentiment  Language_Model  PDF
• 2022-05-06 KECP: Knowledge Enhanced Contrastive Prompting for Few-shot Extractive Question Answering    Jianing Wang, Chengyu Wang, Minghui Qiu, Qiuhui Shi, Hongbin Wang, Jun Huang, Ming Gao arXiv_AI arXiv_AI  Knowledge  Pose  Contrastive_Learning  Few-Shot  Language_Model  QA  PDF
• 2022-05-06 Hearing voices at the National Library -- a speech corpus and acoustic model for the Swedish language    Martin Malmsten, Chris Haffenden, Love Börjeson arXiv_CL arXiv_CL  Recognition  OCR  Speech  Speech_Recognition  Language_Model  PDF
• 2022-05-05 Entity Cloze By Date: What LMs Know About Unseen Entities    Yasumasa Onoe, Michael J.Q. Zhang, Eunsol Choi, Greg Durrett arXiv_CL arXiv_CL  Knowledge  Pose  Inference  Language_Model  PDF
• 2022-05-05 Implicit N-grams Induced by Recurrence    Xiaobing Sun, Wei Lu arXiv_CL arXiv_CL  Transformer  RNN  Sentiment  Attention  Language_Model  PDF
• 2022-05-05 Language Models Can See: Plugging Visual Controls in Text Generation    Yixuan Su, Tian Lan, Yahui Liu, Fangyu Liu, Dani Yogatama, Yan Wang, Lingpeng Kong, Nigel Collier arXiv_CV arXiv_CV  Image_Caption  Zero-Shot  Pose  Text_Generation  Caption  Language_Model  Matching  PDF
• 2022-05-05 A Simple Contrastive Learning Objective for Alleviating Neural Text Degeneration    Shaojie Jiang, Ruqing Zhang, Svitlana Vakulenko, Maarten de Rijke arXiv_CL arXiv_CL  Pose  Contrastive_Learning  Relation  Language_Model  PDF
• 2022-05-05 FastRE: Towards Fast Relation Extraction with Convolutional Encoder and Improved Cascade Binary Tagging Framework    Guozheng Li, Xu Chen, Peng Wang, Jiafeng Xie, Qiqing Luo arXiv_AI arXiv_AI  Transformer  Pose  Action  Relation  Relation_Extraction  Attention  CNN  Inference  Language_Model  PDF
• 2022-05-05 Declaration-based Prompt Tuning for Visual Question Answering    Yuhang Liu, Wei Wei, Daowan Peng, Feida Zhu arXiv_AI arXiv_AI  Zero-Shot  Self-Supervised  Pose  VQA  Few-Shot  Language_Model  Prediction  QA  Matching  PDF
• 2022-05-05 Assistive Recipe Editing through Critiquing    Diego Antognini, Shuyang Li, Boi Faltings, Julian McAuley arXiv_CL arXiv_CL  Unsupervised  Relation  Denoising  Language_Model  PDF
• 2022-05-05 Robust Conversational Agents against Imperceptible Toxicity Triggers    Ninareh Mehrabi, Ahmad Beirami, Fred Morstatter, Aram Galstyan arXiv_AI arXiv_AI  Adversarial  Pose  Detection  Attention  Language_Model  PDF
• 2022-05-04 Relation Extraction as Open-book Examination: Retrieval-enhanced Prompt Tuning    Xiang Chen, Lei Li, Ningyu Zhang, Chuanqi Tan, Fei Huang, Luo Si, Huajun Chen arXiv_CL arXiv_CL  Knowledge  Pose  Action  Relation  Few-Shot  Relation_Extraction  Inference  Language_Model  PDF
• 2022-05-04 Knowledge Distillation of Russian Language Models with Reduction of Vocabulary    Alina Kolesnikova, Yuri Kuratov, Vasily Konovalov, Mikhail Burtsev arXiv_CL arXiv_CL  Transformer  Embedding  Knowledge  Pose  Sentiment  Language_Model  PDF
• 2022-05-04 Language Models in the Loop: Incorporating Prompting into Weak Supervision    Ryan Smith, Jason A. Fries, Braden Hancock, Stephen H. Bach arXiv_CL arXiv_CL  Zero-Shot  Pose  Few-Shot  Language_Model  PDF
• 2022-05-04 Using virtual edges to extract keywords from texts modeled as complex networks    Jorge A. V. Tohalino, Thiago C. Silva, Diego R. Amancio arXiv_CL arXiv_CL  Embedding  Bert  Action  Language_Model  PDF
• 2022-05-04 A Few Thousand Translations Go a Long Way! Leveraging Pre-trained Models for African News Translation    David Ifeoluwa Adelani, Jesujoba Oluwadara Alabi, Angela Fan, Julia Kreutzer, Xiaoyu Shen, Machel Reid, Dana Ruiter, Dietrich Klakow, Peter Nabende, Ernie Chang, Tajuddeen Gwadabe, Freshia Sackey, Bonaventure F. P. Dossou, Chris Chinenye Emezue, Colin Leong, Michael Beukman, Shamsuddeen Hassan Muhammad, Guyo Dub Jarso, Oreen Yousuf, Andre Niyongabo Rubungo, Gilles Hacheme, Eric Peter Wairagala, Muhammad Umair Nasir, Benjamin Ayoade Ajibade, Tunde Oluwaseyi Ajayi, Yvonne Wambui Gitau, Jade Abbott, Mohamed Ahmed, Millicent Ochieng, Anuoluwapo Aremu, Perez Ogayo, Jonathan Mukiibi, Fatoumata Ouoba Kabore, Godson Koffi Kalipe, Derguene Mbaye, Allahsera Auguste Tapo, Victoire Memdjokam Koagne, Edwin Munkoh-Buabeng, Valencia Wagner, Idris Abdulmumin, Ayodele Awokoya, Happy Buzaaba, Blessing Sibanda, et al. (2 additional authors not shown) arXiv_CL arXiv_CL  Language_Model  PDF
• 2022-05-04 Aligning to Social Norms and Values in Interactive Narratives    Prithviraj Ammanabrolu, Liwei Jiang, Maarten Sap, Hannaneh Hajishirzi, Yejin Choi arXiv_AI arXiv_AI  Reinforcement_Learning  Salient  Knowledge  Action  Language_Model  PDF
• 2022-05-04 Cross-lingual Word Embeddings in Hyperbolic Space    Chandni Saxena, Mudit Chaudhary, Helen Meng arXiv_CL arXiv_CL  Embedding  Unsupervised  Pose  Relation  Language_Model  PDF
• 2022-05-04 Improving Multi-Document Summarization through Referenced Flexible Extraction with Credit-Awareness    Yun-Zhu Song, Yi-Syuan Chen, Hong-Han Shuai arXiv_AI arXiv_AI  Transformer  Reinforcement_Learning  Optimization  Salient  Pose  Action  Summarization  Language_Model  Prediction  PDF
• 2022-05-04 P$^3$ Ranker: Mitigating the Gaps between Pre-training and Ranking Fine-tuning with Prompt-based Learning and Pre-finetuning    Xiaomeng Hu (1), Shi Yu (2), Chenyan Xiong (3), Zhenghao Liu (1), Zhiyuan Liu (2), Ge Yu (1) ((1) Northeastern University, (2) Tsinghua University, (3) Microsoft Research) arXiv_CL arXiv_CL  Knowledge  Pose  Few-Shot  Language_Model  PDF
• 2022-05-04 Provably Confidential Language Modelling    Xuandong Zhao, Lei Li, Yu-Xiang Wang arXiv_CL arXiv_CL  RNN  Pose  Action  Language_Model  PDF
• 2022-05-04 Seed-Guided Topic Discovery with Out-of-Vocabulary Seeds    Yu Zhang, Yu Meng, Xuan Wang, Sheng Wang, Jiawei Han arXiv_CL arXiv_CL  Unsupervised  Knowledge  Pose  Language_Model  PDF
• 2022-05-04 Great Truths are Always Simple: A Rather Simple Knowledge Encoder for Enhancing the Commonsense Reasoning Capacity of Pre-Trained Models    Jinhao Jiang, Kun Zhou, Wayne Xin Zhao, Ji-Rong Wen arXiv_AI arXiv_AI  Knowledge  Knowledge_Graph  Relation  Language_Model  PDF
• 2022-05-04 Data Governance in the Age of Large-Scale Data-Driven Language Technology    Yacine Jernite, Huu Nguyen, Stella Biderman, Anna Rogers, Maraim Masoud, Valentin Danchev, Samson Tan, Alexandra Sasha Luccioni, Nishant Subramani, Gérard Dupont, Jesse Dodge, Kyle Lo, Zeerak Talat, Isaac Johnson, Dragomir Radev, Somaieh Nikpoor, Jörg Frohberg, Aaron Gokaslan, Peter Henderson, Rishi Bommasani, Margaret Mitchell arXiv_AI arXiv_AI  Pose  Attention  GAN  Language_Model  PDF
• 2022-05-03 Explain and Conquer: Personalised Text-based Reviews to Achieve Transparency    Iñigo López-Riobóo Botana (1), Verónica Bolón-Canedo (1), Bertha Guijarro-Berdiñas (1), Amparo Alonso-Betanzos (1) ((1) University of A Coruña - Research Center on Information and Communication Technologies (CITIC)) arXiv_AI arXiv_AI  Transformer  Bert  Review  Pose  Action  Relation  Language_Model  Recommendation  PDF
• 2022-05-03 XLTime: A Cross-Lingual Knowledge Transfer Framework for Temporal Expression Extraction    Yuwei Cao, William Groves, Tanay Kumar Saha, Joel R. Tetreault, Alex Jaimes, Hao Peng, Philip S. Yu arXiv_CL arXiv_CL  Knowledge  Pose  Action  Inference  Language_Model  PDF
• 2022-05-03 Mixed-effects transformers for hierarchical adaptation    Julia White, Noah Goodman, Robert Hawkins arXiv_CL arXiv_CL  Transformer  Sparse  Language_Model  PDF
• 2022-05-03 Learning to Transfer Prompts for Text Generation    Junyi Li, Tianyi Tang, Jian-Yun Nie, Ji-Rong Wen, Wayne Xin Zhao arXiv_CL arXiv_CL  Pose  Attention  Text_Generation  Language_Model  PDF
• 2022-05-03 ElitePLM: An Empirical Study on General Language Ability Evaluation of Pretrained Language Models    Junyi Li, Tianyi Tang, Zheng Gong, Lixin Yang, Zhuohao Yu, Zhipeng Chen, Jingyuan Wang, Wayne Xin Zhao, Ji-Rong Wen arXiv_CL arXiv_CL  Language_Model  Prediction  PDF
• 2022-05-03 Neural Language Taskonomy: Which NLP Tasks are the most Predictive of fMRI Brain Activity?    Subba Reddy Oota, Jashn Arora, Veeral Agarwal, Mounika Marreddy, Manish Gupta, Bapi Raju Surampudi arXiv_AI arXiv_AI  Transformer  Transfer_Learning  Relation  Summarization  Activity  Inference  Language_Model  PDF
• 2022-05-03 Predicting Issue Types with seBERT    Alexander Trautsch, Steffen Herbold arXiv_CL arXiv_CL  Transformer  Bert  Language_Model  Prediction  PDF
• 2022-05-03 Contrastive Learning for Prompt-Based Few-Shot Language Learners    Yiren Jian, Chongyang Gao, Soroush Vosoughi arXiv_AI arXiv_AI  Pose  Contrastive_Learning  Few-Shot  Language_Model  PDF
• 2022-05-03 Embedding Hallucination for Few-Shot Language Fine-tuning    Yiren Jian, Chongyang Gao, Soroush Vosoughi arXiv_AI arXiv_AI  Embedding  Regularization  Knowledge  Adversarial  Pose  Few-Shot  Language_Model  PDF
• 2022-05-03 SemAttack: Natural Textual Attacks via Different Semantic Spaces    Boxin Wang, Chejian Xu, Xiangyu Liu, Yu Cheng, Bo Li arXiv_CL arXiv_CL  Embedding  Bert  Knowledge  Adversarial  Pose  Language_Model  PDF
• 2022-05-02 The Limits of Word Level Differential Privacy    Justus Mattern, Benjamin Weggenmann, Florian Kerschbaum arXiv_CL arXiv_CL  Transformer  Embedding  Pose  Attention  Language_Model  PDF
• 2022-05-02 OPT: Open Pre-trained Transformer Language Models    Susan Zhang, Stephen Roller, Naman Goyal, Mikel Artetxe, Moya Chen, Shuohui Chen, Christopher Dewan, Mona Diab, Xian Li, Xi Victoria Lin, Todor Mihaylov, Myle Ott, Sam Shleifer, Kurt Shuster, Daniel Simig, Punit Singh Koura, Anjali Sridhar, Tianlu Wang, Luke Zettlemoyer arXiv_CL arXiv_CL  Transformer  Face  Few-Shot  Language_Model  PDF
• 2022-05-02 Entity-aware Transformers for Entity Search    Emma J. Gerritse, Faegheh Hasibi, Arjen P. de Vries arXiv_CL arXiv_CL  Transformer  Embedding  Bert  Knowledge  Knowledge_Graph  Relation  Language_Model  PDF
• 2022-05-02 Debiased Contrastive Learning of Unsupervised Sentence Representations    Kun Zhou, Beichen Zhang, Wayne Xin Zhao, Ji-Rong Wen arXiv_CL arXiv_CL  Unsupervised  Contrastive_Learning  Language_Model  PDF
• 2022-05-02 Robust Fine-tuning via Perturbation and Interpolation from In-batch Instances    Shoujie Tong, Qingxiu Dong, Damai Dai, Yifan song, Tianyu Liu, Baobao Chang, Zhifang Sui arXiv_CL arXiv_CL  Adversarial  Pose  Language_Model  PDF
• 2022-05-02 POLITICS: Pretraining with Same-story Article Comparison for Ideology Prediction and Stance Detection    Yujian Liu, Xinliang Frederick Zhang, David Wegsman, Nick Beauchamp, Lu Wang arXiv_CL arXiv_CL  Pose  Detection  Few-Shot  Language_Model  Prediction  PDF
• 2022-05-01 Gender Bias in Masked Language Models for Multiple Languages    Masahiro Kaneko, Aizhan Imankulova, Danushka Bollegala, Naoaki Okazaki arXiv_CL arXiv_CL  Pose  Language_Model  PDF
• 2022-05-01 Large-Scale Multi-Document Summarization with Information Extraction and Compression    Ning Wang, Han Liu, Diego Klabjan arXiv_CL arXiv_CL  Action  Summarization  Language_Model  PDF
• 2022-05-01 CUP: Curriculum Learning based Prompt Tuning for Implicit Event Argument Extraction    Jiaju Lin, Qin Chen, Jie Zhou, Jian Jin, Liang He arXiv_CL arXiv_CL  Knowledge  Pose  Action  Relation  Language_Model  PDF
• 2022-05-01 Dynamic Programming in Rank Space: Scaling Structured Inference with Low-Rank HMMs and PCFGs    Songlin Yang, Wei Liu, Kewei Tu arXiv_CL arXiv_CL  Unsupervised  Inference  Language_Model  PDF
• 2022-05-01 MRKL Systems: A modular, neuro-symbolic architecture that combines large language models, external knowledge sources and discrete reasoning    Ehud Karpas, Omri Abend, Yonatan Belinkov, Barak Lenz, Opher Lieber, Nir Ratner, Yoav Shoham, Hofit Bata, Yoav Levine, Kevin Leyton-Brown, Dor Muhlgay, Noam Rozen, Erez Schwartz, Gal Shachaf, Shai Shalev-Shwartz, Amnon Shashua, Moshe Tenenholtz arXiv_AI arXiv_AI  Knowledge  Language_Model  PDF
• 2022-04-30 Visual Spatial Reasoning    Fangyu Liu, Guy Emerson, Nigel Collier arXiv_AI arXiv_AI  Zero-Shot  Knowledge  Pose  Classification  Relation  Caption  Language_Model  PDF
• 2022-04-30 LayoutBERT: Masked Language Layout Model for Object Insertion    Kerem Turgutlu, Sanat Sharma, Jayant Kumar arXiv_AI arXiv_AI  Bert  Knowledge  Self-Supervised  Pose  Quantitative  Attention  Language_Model  PDF
• 2022-04-30 Detoxifying Language Models with a Toxic Corpus    Yoon A Park, Frank Rudzicz arXiv_CL arXiv_CL  Pose  Language_Model  PDF
• 2022-04-30 Visualizing and Explaining Language Models    Adrian M.P. Braşoveanu, Răzvan Andonie arXiv_CL arXiv_CL  Salient  Deep_Learning  Relation  Language_Model  PDF
• 2022-04-30 Exposing Cross-Lingual Lexical Knowledge from Multilingual Sentence Encoders    Ivan Vulić, Goran Glavaš, Fangyu Liu, Nigel Collier, Edoardo Maria Ponti, Anna Korhonen arXiv_CL arXiv_CL  Embedding  Knowledge  Pose  Contrastive_Learning  Language_Model  PDF
• 2022-04-30 A New Evaluation Method: Evaluation Data and Metrics for Chinese Grammar Error Correction    Nankai Lin, Nankai Lin, Xiaotian Lin, Ziyu Yang, Shengyi Jiang arXiv_CL arXiv_CL  Segmentation  Pose  Attention  Language_Model  PDF
• 2022-04-30 Building a Role Specified Open-Domain Dialogue System Leveraging Large-Scale Language Models    Sanghwan Bae, Donghyun Kwak, Sungdong Kim, Donghoon Ham, Soyoung Kang, Sang-Woo Lee, Woomyoung Park arXiv_CL arXiv_CL  Pose  Few-Shot  Language_Model  PDF
• 2022-04-30 To Know by the Company Words Keep and What Else Lies in the Vicinity    Jake Ryland Williams, Hunter Scott Heidenreich arXiv_CL arXiv_CL  Knowledge  Deep_Learning  Language_Model  PDF
• 2022-04-29 Prompt Consistency for Zero-Shot Task Generalization    Chunting Zhou, Junxian He, Xuezhe Ma, Taylor Berg-Kirkpatrick, Graham Neubig arXiv_CL arXiv_CL  Unsupervised  Zero-Shot  Pose  Inference  Language_Model  Prediction  PDF
• 2022-04-29 Logically Consistent Adversarial Attacks for Soft Theorem Provers    Alexander Gaskell, Yishu Miao, Lucia Specia, Francesca Toni arXiv_CL arXiv_CL  Adversarial  Pose  Language_Model  PDF
• 2022-04-29 Training Naturalized Semantic Parsers with Very Little Data    Subendhu Rongali, Konstantine Arkoudas, Melanie Rubino, Wael Hamza arXiv_CL arXiv_CL  Unsupervised  Few-Shot  Language_Model  PDF
• 2022-04-29 TemporalWiki: A Lifelong Benchmark for Training and Evaluating Ever-Evolving Language Models    Joel Jang, Seonghyeon Ye, Changho Lee, Sohee Yang, Joongbo Shin, Janghoon Han, Gyeonghun Kim, Minjoon Seo arXiv_CL arXiv_CL  Knowledge  Language_Model  PDF
• 2022-04-29 Flamingo: a Visual Language Model for Few-Shot Learning    Jean-Baptiste Alayrac, Jeff Donahue, Pauline Luc, Antoine Miech, Iain Barr, Yana Hasson, Karel Lenc, Arthur Mensch, Katie Millican, Malcolm Reynolds, Roman Ring, Eliza Rutherford, Serkan Cabi, Tengda Han, Zhitao Gong, Sina Samangooei, Marianne Monteiro, Jacob Menick, Sebastian Borgeaud, Andrew Brock, Aida Nematzadeh, Sahand Sharifzadeh, Mikolaj Binkowski, Ricardo Barreira, Oriol Vinyals, Andrew Zisserman, Karen Simonyan arXiv_AI arXiv_AI  Video_Caption  Pose  VQA  Few-Shot  Caption  Language_Model  PDF
• 2022-04-29 Learning from Natural Language Feedback    Jérémy Scheurer, Jon Ander Campos, Jun Shern Chan, Angelica Chen, Kyunghyun Cho, Ethan Perez arXiv_AI arXiv_AI  Pose  Summarization  Language_Model  PDF
• 2022-04-29 Developmental Negation Processing in Transformer Language Models    Antonio Laverghetta Jr., John Licato arXiv_CL arXiv_CL  Transformer  Inference  Language_Model  PDF
• 2022-04-29 PyramidCLIP: Hierarchical Feature Alignment for Vision-language Model Pretraining    Yuting Gao, Jinfeng Liu, Zihan Xu, Jun Zhang, Ke Li, Chunhua Shen arXiv_AI arXiv_AI  Zero-Shot  Pose  Classification  Detection  Relation  Object_Detection  Image_Classification  Language_Model  PDF
• 2022-04-29 C3-STISR: Scene Text Image Super-resolution with Triple Clues    Minyi Zhao, Miao Wang, Fan Bai, Bingjia Li, Jie Wang, Shuigeng Zhou arXiv_CV arXiv_CV  Recognition  Super_Resolution  Scene_Text  Action  Language_Model  PDF
• 2022-04-29 KERMIT - A Transformer-Based Approach for Knowledge Graph Matching    Sven Hertling, Jan Portisch, Heiko Paulheim arXiv_AI arXiv_AI  Transformer  Knowledge  Knowledge_Graph  Language_Model  Matching  PDF
• 2022-04-29 QRelScore: Better Evaluating Generated Questions with Deeper Understanding of Context-aware Relevance    Xiaoqiang Wang, Bang Liu, Siliang Tang, Lingfei Wu arXiv_CL arXiv_CL  Bert  Adversarial  Pose  Relation  Language_Model  Matching  PDF
• 2022-04-29 OA-Mine: Open-World Attribute Mining for E-Commerce Products with Weak Supervision    Xinyang Zhang, Chenwei Zhang, Xian Li, Xin Luna Dong, Jingbo Shang, Christos Faloutsos, Jiawei Han arXiv_CL arXiv_CL  Pose  Action  Language_Model  PDF
• 2022-04-29 Vision-Language Pre-Training for Boosting Scene Text Detectors    Sibo Song, Jianqiang Wan, Zhibo Yang, Jun Tang, Wenqing Cheng, Xiang Bai, Cong Yao arXiv_AI arXiv_AI  Represenation_Learning  Pose  Scene_Text  Contrastive_Learning  Action  Detection  Object_Detection  Language_Model  Prediction  PDF
• 2022-04-28 Instilling Type Knowledge in Language Models via Multi-Task QA    Shuyang Li, Mukund Sridhar, Chandana Satya Prakash, Jin Cao, Wael Hamza, Julian McAuley arXiv_AI arXiv_AI  Tracking  Zero-Shot  Knowledge  Knowledge_Graph  Language_Model  QA  PDF
• 2022-04-28 Inferring Implicit Relations with Language Models    Uri Katz, Mor Geva, Jonathan Berant arXiv_CL arXiv_CL  Relation  Inference  Language_Model  QA  PDF
• 2022-04-28 HiNER: A Large Hindi Named Entity Recognition Dataset    Rudra Murthy, Pallab Bhattacharjee, Rahul Sharnagat, Jyotsana Khatri, Diptesh Kanojia, Pushpak Bhattacharyya arXiv_CL arXiv_CL  Recognition  Knowledge  GAN  Language_Model  PDF
• 2022-04-28 CogView2: Faster and Better Text-to-Image Generation via Hierarchical Transformers    Ming Ding, Wendi Zheng, Wenyi Hong, Jie Tang arXiv_CV arXiv_CV  Transformer  Super_Resolution  Self-Supervised  Language_Model  PDF
• 2022-04-28 RobBERTje: a Distilled Dutch BERT Model    Pieter Delobelle, Thomas Winters, Bettina Berendt arXiv_CL arXiv_CL  Bert  Attention  Language_Model  PDF
• 2022-04-28 On the Effect of Pretraining Corpora on In-context Learning by a Large-scale Language Model    Seongjin Shin, Sang-Woo Lee, Hwijeen Ahn, Sungdong Kim, HyoungSeok Kim, Boseop Kim, Kyunghyun Cho, Gichang Lee, Woomyoung Park, Jung-Woo Ha, Nako Sung arXiv_CL arXiv_CL  Relation  Few-Shot  Language_Model  PDF
• 2022-04-28 Post-Training Dialogue Summarization using Pseudo-Paraphrasing    Qi Jia, Yizhu Liu, Haifeng Tang, Kenny Q. Zhu arXiv_CL arXiv_CL  Knowledge  Pose  Summarization  Language_Model  PDF
• 2022-04-28 HPT: Hierarchy-aware Prompt Tuning for Hierarchical Text Classification    Zihan Wang, Peiyi Wang, Tianyu Liu, Yunbo Cao, Zhifang Sui, Houfeng Wang arXiv_CL arXiv_CL  Text_Classification  Knowledge  Pose  Classification  Language_Model  PDF
• 2022-04-28 Improving robustness of language models from a geometry-aware perspective    Bin Zhu, Zhaoquan Gu, Le Wang, Jinyin Chen, Qi Xuan arXiv_CL arXiv_CL  Adversarial  Pose  Language_Model  PDF
• 2022-04-27 Towards Teachable Reasoning Systems    Bhavana Dalvi, Oyvind Tafjord, Peter Clark arXiv_AI arXiv_AI  Knowledge  Language_Model  QA  PDF
• 2022-04-27 DialogVED: A Pre-trained Latent Variable Encoder-Decoder Model for Dialog Response Generation    Wei Chen, Yeyun Gong, Song Wang, Bolun Yao, Weizhen Qi, Zhongyu Wei, Xiaowu Hu, Bartuer Zhou, Yi Mao, Weizhu Chen, Biao Cheng, Nan Duan arXiv_CL arXiv_CL  Pose  Language_Model  Prediction  PDF
• 2022-04-27 Extremal GloVe: Theoretically Accurate Distributed Word Embedding by Tail Inference    Hao Wang arXiv_CL arXiv_CL  Embedding  Pose  Inference  Language_Model  Recommendation  PDF
• 2022-04-27 RigoBERTa: A State-of-the-Art Language Model For Spanish    Alejandro Vaca Serrano, Guillem Garcia Subies, Helena Montoro Zamorano, Nuria Aldama Garcia, Doaa Samy, David Betancur Sanchez, Antonio Moreno Sandoval, Marta Guerrero Nieto, Alvaro Barbero Jimenez arXiv_CL arXiv_CL  Bert  Language_Model  PDF
• 2022-04-27 LyS_ACoru~na at SemEval-2022 Task 10: Repurposing Off-the-Shelf Tools for Sentiment Analysis as Semantic Dependency Parsing    Iago Alonso-Alonso, David Vilares, Carlos Gómez-Rodríguez arXiv_CL arXiv_CL  Zero-Shot  Sentiment  Language_Model  PDF
• 2022-04-27 SkillSpan: Hard and Soft Skill Extraction from English Job Postings    Mike Zhang, Kristian Nørgaard Jensen, Sif Dam Sonniks, Barbara Plank arXiv_CL arXiv_CL  Bert  Action  GAN  Language_Model  PDF
• 2022-04-27 Probing Simile Knowledge from Pre-trained Language Models    Weijie Chen, Yongzhu Chang, Rongsheng Zhang, Jiashu Pu, Guandan Chen, Le Zhang, Yadong Xi, Yijiang Chen, Chang Su arXiv_AI arXiv_AI  Knowledge  Language_Model  Prediction  PDF
• 2022-04-27 Modern Baselines for SPARQL Semantic Parsing    Debayan Banerjee, Pranav Ajit Nair, Jivat Neet Kaur, Ricardo Usbeck, Chris Biemann arXiv_CL arXiv_CL  Embedding  Bert  Knowledge  Knowledge_Graph  Relation  Language_Model  PDF
• 2022-04-27 Plug-and-Play Adaptation for Continuously-updated QA    Kyungjae Lee, Wookje Han, Seung-won Hwang, Hwaran Lee, Joonsuk Park, Sang-Woo Lee arXiv_CL arXiv_CL  Knowledge  Pose  Language_Model  QA  PDF
• 2022-04-27 A Thorough Examination on Zero-shot Dense Retrieval    Ruiyang Ren, Yingqi Qu, Jing Liu, Wayne Xin Zhao, Qifei Wu, Yuchen Ding, Hua Wu, Haifeng Wang, Ji-Rong Wen arXiv_CL arXiv_CL  Zero-Shot  Sparse  Review  Language_Model  PDF
• 2022-04-27 A Comprehensive Understanding of Code-mixed Language Semantics using Hierarchical Transformer    Ayan Sengupta, Tharun Suresh, Md Shad Akhtar, Tanmoy Chakraborty arXiv_CL arXiv_CL  Transformer  Embedding  Transfer_Learning  Zero-Shot  Represenation_Learning  Pose  Relation  Attention  Language_Model  PDF
• 2022-04-27 UBERT: A Novel Language Model for Synonymy Prediction at Scale in the UMLS Metathesaurus    Thilini Wijesiriwardene, Vinh Nguyen, Goonmeet Bajaj, Hong Yung Yip, Vishesh Javangula, Yuqing Mao, Kin Wah Fung, Srinivasan Parthasarathy, Amit P. Sheth, Olivier Bodenreider arXiv_AI arXiv_AI  Bert  Deep_Learning  Medical  Language_Model  Prediction  PDF
• 2022-04-26 Testing the Ability of Language Models to Interpret Figurative Language    Emmy Liu, Chen Cui, Kenneth Zheng, Graham Neubig arXiv_AI arXiv_AI  Few-Shot  Language_Model  QA  PDF
• 2022-04-26 Efficient Machine Translation Domain Adaptation    Pedro Henrique Martins, Zita Marinho, André F. T. Martins arXiv_CL arXiv_CL  Pose  Language_Model  PDF
• 2022-04-26 Parkinson's disease diagnostics using AI and natural language knowledge transfer    Maurycy Chronowski, Maciej Klaczynski, Malgorzata Dec-Cwiek, Karolina Porebska arXiv_AI arXiv_AI  Knowledge  Speech  Pose  Classification  Deep_Learning  Language_Model  PDF
• 2022-04-26 Label Anchored Contrastive Learning for Language Understanding    Zhenyu Zhang, Yuming Zhao, Meng Chen, Xiaodong He arXiv_CL arXiv_CL  Embedding  Speech  Self-Supervised  Pose  Contrastive_Learning  Classification  Few-Shot  Language_Model  PDF
• 2022-04-26 You Don't Know My Favorite Color: Preventing Dialogue Representations from Revealing Speakers' Private Personas    Haoran Li, Yangqiu Song, Lixin Fan arXiv_CL arXiv_CL  Pose  Language_Model  QA  PDF
• 2022-04-26 CoVERT: A Corpus of Fact-checked Biomedical COVID-19 Tweets    Isabelle Mohr, Amelie Wührl, Roman Klinger arXiv_CL arXiv_CL  Knowledge  Pose  Relation  Medical  Language_Model  Recommendation  PDF
• 2022-04-26 LM-Debugger: An Interactive Tool for Inspection and Intervention in Transformer-Based Language Models    Mor Geva, Avi Caciularu, Guy Dar, Paul Roit, Shoval Sadde, Micah Shlain, Bar Tamir, Yoav Goldberg arXiv_CL arXiv_CL  Transformer  Language_Model  Prediction  PDF
• 2022-04-26 Pretraining Chinese BERT for Detecting Word Insertion and Deletion Errors    Cong Zhou, Yong Dai, Duyu Tang, Enbo Zhao, Zhangyin Feng, Li Kuang, Shuming Shi arXiv_CL arXiv_CL  Bert  Inference  Language_Model  Prediction  PDF
• 2022-04-25 AI Personification: Estimating the Personality of Language Models    Saketh Reddy Karra, Son Nguyen, Theja Tulabandhula arXiv_AI arXiv_AI  Zero-Shot  Classification  Text_Generation  Language_Model  PDF
• 2022-04-25 C3: Continued Pretraining with Contrastive Weak Supervision for Cross Language Ad-Hoc Retrieval    Eugene Yang, Suraj Nair, Ramraj Chandradevan, Rebecca Iglesias-Flores, Douglas W. Oard arXiv_CL arXiv_CL  Language_Model  PDF
• 2022-04-25 Super-Prompting: Utilizing Model-Independent Contextual Data to Reduce Data Annotation Required in Visual Commonsense Tasks    Navid Rezaei, Marek Z. Reformat arXiv_AI arXiv_AI  Transformer  Pose  Few-Shot  Language_Model  PDF
• 2022-04-25 The Causal News Corpus: Annotating Causal Relations in Event Sentences from News    Fiona Anting Tan, Ali Hürriyetoğlu, Tommaso Caselli, Nelleke Oostdijk, Tadashi Nomoto, Hansi Hettiarachchi, Iqra Ameer, Onur Uca, Farhana Ferdousi Liza, Tiancheng Hu arXiv_CL arXiv_CL  Pose  Relation  Language_Model  PDF
• 2022-04-25 Incorporating Explicit Knowledge in Pre-trained Language Models for Passage Re-ranking    Qian Dong, Yiding Liu, Suqi Cheng, Shuaiqiang Wang, Zhicong Cheng, Shuzi Niu, Dawei Yin arXiv_AI arXiv_AI  Embedding  Knowledge  Knowledge_Graph  Pose  Action  Language_Model  PDF
• 2022-04-25 Which Discriminator for Cooperative Text Generation?    Antoine Chaffin, Thomas Scialom, Sylvain Lamprier, Jacopo Staiano, Benjamin Piwowarski, Ewa Kijak, Vincent Claveau arXiv_CL arXiv_CL  Transformer  Classification  Text_Generation  Language_Model  PDF
• 2022-04-25 Do Transformer Models Show Similar Attention Patterns to Task-Specific Human Gaze?    Stephanie Brandl, Oliver Eberle, Jonas Pilot, Anders Søgaard arXiv_CL arXiv_CL  Transformer  Action  Relation  Sentiment  Relation_Extraction  Attention  Language_Model  PDF
• 2022-04-25 ED2LM: Encoder-Decoder to Language Model for Faster Document Re-ranking Inference    Kai Hui, Honglei Zhuang, Tao Chen, Zhen Qin, Jing Lu, Dara Bahri, Ji Ma, Jai Prakash Gupta, Cicero Nogueira dos Santos, Yi Tay, Don Metzler arXiv_CL arXiv_CL  Embedding  Bert  Pose  Attention  Inference  Language_Model  PDF
• 2022-04-24 Emotion-Aware Transformer Encoder for Empathetic Dialogue Generation    Raman Goel, Seba Susan, Sachin Vashisht, Armaan Dhanda arXiv_CL arXiv_CL  Transformer  Embedding  Pose  Emotion  Face  Detection  Object_Detection  Language_Model  PDF
• 2022-04-24 Learning to Win Lottery Tickets in BERT Transfer via Task-agnostic Mask Training    Yuanxin Liu, Fandong Meng, Zheng Lin, Peng Fu, Yanan Cao, Weiping Wang, Jie Zhou arXiv_CL arXiv_CL  Transfer_Learning  Bert  Pose  Language_Model  Matching  PDF
• 2022-04-23 MuCGEC: a Multi-Reference Multi-Source Evaluation Dataset for Chinese Grammatical Error Correction    Yue Zhang, Zhenghua Li, Zuyi Bao, Jiacheng Li, Bo Zhang, Chen Li, Fei Huang, Min Zhang arXiv_CL arXiv_CL  Review  Language_Model  PDF
• 2022-04-23 CLIP-Dissect: Automatic Description of Neuron Representations in Deep Vision Networks    Tuomas Oikarinen, Tsui-Wei Weng arXiv_AI arXiv_AI  Pose  Language_Model  PDF
• 2022-04-22 Locally Aggregated Feature Attribution on Natural Language Model Understanding    Sheng Zhang, Jin Wang, Haitao Jiang, Rui Song arXiv_AI arXiv_AI  Embedding  Recognition  Pose  Detection  Sentiment  Language_Model  PDF
• 2022-04-22 ChapterBreak: A Challenge Dataset for Long-Range Language Models    Simeng Sun, Katherine Thai, Mohit Iyyer arXiv_CL arXiv_CL  Pose  Language_Model  PDF
• 2022-04-22 Meet Your Favorite Character: Open-domain Chatbot Mimicking Fictional Characters with only a Few Utterances    Seungju Han, Beomsu Kim, Jin Yong Yoo, Seokjun Seo, Sangbum Kim, Enkhbayar Erdenee, Buru Chang arXiv_CL arXiv_CL  Pose  Language_Model  QA  PDF
• 2022-04-22 Data Distributional Properties Drive Emergent Few-Shot Learning in Transformers    Stephanie C.Y. Chan, Adam Santoro, Andrew K. Lampinen, Jane X. Wang, Aaditya Singh, Pierre H. Richemond, Jay McClelland, Felix Hill arXiv_AI arXiv_AI  Transformer  Few-Shot  Language_Model  PDF
• 2022-04-22 Autoregressive Search Engines: Generating Substrings as Document Identifiers    Michele Bevilacqua, Giuseppe Ottaviano, Patrick Lewis, Wen-tau Yih, Sebastian Riedel, Fabio Petroni arXiv_CL arXiv_CL  Knowledge  Pose  Language_Model  PDF
• 2022-04-22 Generalized Quantifiers as a Source of Error in Multilingual NLU Benchmarks    Ruixiang Cui, Daniel Hershcovich, Anders Søgaard arXiv_CL arXiv_CL  Adversarial  Language_Model  PDF
• 2022-04-22 Sparse and Dense Approaches for the Full-rank Retrieval of Responses for Dialogues    Gustavo Penha, Claudia Hauff arXiv_CL