Language_Model
Language_Model
2022-06-27
Analyzing Encoded Concepts in Transformer Language Models
Hassan Sajjad, Nadir Durrani, Fahim Dalvi, Firoj Alam, Abdul Rafae Khan, Jia Xu
arXiv_CL
arXiv_CL
Transformer
Pose
Face
Relation
Language_Model
PDF
2022-06-27
Few-Shot Stance Detection via Target-Aware Prompt Distillation
Yan Jiang, Jinhua Gao, Huawei Shen, Xueqi Cheng
arXiv_CL
arXiv_CL
Knowledge
Pose
Detection
Relation
Few-Shot
Attention
Language_Model
PDF
2022-06-27
Endowing Language Models with Multimodal Knowledge Graph Representations
Ningyuan Huang, Yash R. Deshpande, Yibo Liu, Houda Alberts, Kyunghyun Cho, Clara Vania, Iacer Calixto
arXiv_CL
arXiv_CL
Recognition
Knowledge
Knowledge_Graph
Pose
Relation
Language_Model
PDF
2022-06-27
Bi-VLDoc: Bidirectional Vision-Language Modeling for Visually-Rich Document Understanding
Chuwei Luo, Guozhi Tang, Qi Zheng, Cong Yao, Lianwen Jin, Chenliang Li, Yang Xue, Luo Si
arXiv_CV
arXiv_CV
Represenation_Learning
Pose
Action
Classification
Attention
Language_Model
QA
PDF
2022-06-27
Leveraging Language for Accelerated Learning of Tool Manipulation
Allen Z. Ren, Bharat Govil, Tsung-Yen Yang, Karthik Narasimhan, Anirudha Majumdar
arXiv_RO
arXiv_RO
Language_Model
PDF
2022-06-26
Your Autoregressive Generative Model Can be Better If You Treat It as an Energy-Based One
Yezhen Wang, Tong Che, Bo Li, Kaitao Song, Hengzhi Pei, Yoshua Bengio, Dongsheng Li
arXiv_CL
arXiv_CL
Pose
Language_Model
PDF
2022-06-25
TEVR: Improving Speech Recognition by Token Entropy Variance Reduction
Hajo Nils Krabbenhöft, Erhardt Barth
arXiv_CL
arXiv_CL
Recognition
Speech
Speech_Recognition
Language_Model
PDF
2022-06-25
Distilling a Pretrained Language Model to a Multilingual ASR Model
Kwanghee Choi, Hyung-Min Park
arXiv_AI
arXiv_AI
Transformer
Recognition
Knowledge
Speech
Pose
Speech_Recognition
Language_Model
PDF
2022-06-25
Language Models as Knowledge Embeddings
Xintao Wang, Qianyu He, Jiaqing Liang, Yanghua Xiao
arXiv_AI
arXiv_AI
Embedding
Knowledge
Knowledge_Graph
Pose
Contrastive_Learning
Classification
Relation
Language_Model
Prediction
PDF
2022-06-25
Adversarial Self-Attention for Language Understanding
Hongqiu Wu, Hai Zhao
arXiv_CL
arXiv_CL
Transformer
Adversarial
Pose
Attention
Language_Model
PDF
2022-06-25
Construct a Sentence with Multiple Specified Words
Yuanliang Meng
arXiv_AI
arXiv_AI
Language_Model
PDF
2022-06-24
OPERA: Harmonizing Task-Oriented Dialogs and Information Seeking Experience
Miaoran Li, Baolin Peng, Jianfeng Gao, Zhu Zhang
arXiv_AI
arXiv_AI
Knowledge
Pose
Language_Model
QA
PDF
2022-06-24
QAGAN: Adversarial Approach To Learning Domain Invariant Language Features
Shubham Shrivastava, Kaiyue Wang
arXiv_CL
arXiv_CL
Transformer
Embedding
Adversarial
GAN
Language_Model
Prediction
QA
PDF
2022-06-24
Using BERT Embeddings to Model Word Importance in Conversational Transcripts for Deaf and Hard of Hearing Users
Akhter Al Amin, Saad Hassan, Cecilia O. Alm, Matt Huenerfauth
arXiv_CL
arXiv_CL
Embedding
Bert
Classification
Relation
Caption
Language_Model
PDF
2022-06-24
Text and author-level political inference using heterogeneous knowledge representations
Samuel Caetano da Silva, Ivandre Paraboni
arXiv_CL
arXiv_CL
Transformer
Bert
Knowledge
Inference
Language_Model
PDF
2022-06-24
MVP: Multi-task Supervised Pre-training for Natural Language Generation
Tianyi Tang, Junyi Li, Wayne Xin Zhao, Ji-Rong Wen
arXiv_CL
arXiv_CL
Unsupervised
Pose
Text_Generation
Language_Model
PDF
2022-06-24
Unified BERT for Few-shot Natural Language Understanding
JunYu Lu, Ping Yang, JiaXing Zhang, RuYi Gan, Jing Yang
arXiv_CL
arXiv_CL
Bert
Zero-Shot
Knowledge
Pose
Action
Classification
Few-Shot
Language_Model
PDF
2022-06-24
Classifying Unstructured Clinical Notes via Automatic Weak Supervision
Chufan Gao, Mononito Goswami, Jieshi Chen, Artur Dubrawski
arXiv_CL
arXiv_CL
Text_Classification
Knowledge
Pose
Classification
Medical
Language_Model
PDF
2022-06-24
Confidence Score Based Conformer Speaker Adaptation for Speech Recognition
Jiajun Deng, Xurong Xie, Tianzi Wang, Mingyu Cui, Boyang Xue, Zengrui Jin, Mengzhe Geng, Guinan Li, Xunying Liu, Helen Meng
arXiv_SD
arXiv_SD
Transformer
Unsupervised
Recognition
RNN
Speech
Pose
Speech_Recognition
Language_Model
PDF
2022-06-24
SC-Ques: A Sentence Completion Question Dataset for English as a Second Language Learners
Qiongqiong Liu, Shuyan Huang, Zitao Liu, Weiqi Luo
arXiv_CL
arXiv_CL
Pose
Language_Model
PDF
2022-06-24
DialogID: A Dialogic Instruction Dataset for Improving Teaching Effectiveness in Online Environments
Jiahao Chen, Shuyan Huang, Zitao Liu, Weiqi Luo
arXiv_CL
arXiv_CL
Adversarial
Pose
Detection
Language_Model
PDF
2022-06-23
A Disability Lens towards Biases in GPT-3 Generated Open-Ended Languages
Akhter Al Amin, Kazi Sinthia Kabir
arXiv_CL
arXiv_CL
Action
Language_Model
PDF
2022-06-23
Do Trajectories Encode Verb Meaning?
Dylan Ebert, Chen Sun, Ellie Pavlick
arXiv_CL
arXiv_CL
Represenation_Learning
Self-Supervised
Action
Language_Model
PDF
2022-06-23
PromptPose: Language Prompt Helps Animal Pose Estimation
Xu Zhang, Wen Wang, Zhe Chen, Jing Zhang, Dacheng Tao
arXiv_CV
arXiv_CV
Pose_Estimation
Knowledge
Pose
Relation
Few-Shot
Language_Model
Prediction
PDF
2022-06-23
AST-Probe: Recovering abstract syntax trees from hidden representations of pre-trained language models
José Antonio Hernández López, Martin Weyssow, Jesús Sánchez Cuadrado, Houari Sahraoui
arXiv_CL
arXiv_CL
Language_Model
PDF
2022-06-23
Theory-Grounded Measurement of U.S. Social Stereotypes in English Language Models
Yang Trista Cao, Anna Sotnikova, Hal Daumé III, Rachel Rudinger, Linda Zou
arXiv_CL
arXiv_CL
Language_Model
PDF
2022-06-23
Towards Green ASR: Lossless 4-bit Quantization of a Hybrid TDNN System on the 300-hr Switchboard Corpus
Junhao Xu, Shoukang Hu, Xunying Liu, Helen Meng
arXiv_SD
arXiv_SD
Transformer
Quantization
Recognition
Speech
Pose
Speech_Recognition
Language_Model
PDF
2022-06-23
Mining Error Templates for Grammatical Error Correction
Yue Zhang, Haochen Jiang, Zuyi Bao, Bo Zhang, Chen Li, Zhenghua Li
arXiv_CL
arXiv_CL
Pose
Action
Language_Model
PDF
2022-06-23
Towards WinoQueer: Developing a Benchmark for Anti-Queer Bias in Large Language Models
Virginia K. Felkner, Ho-Chun Herbert Chang, Eugene Jang, Jonathan May
arXiv_CL
arXiv_CL
Bert
Pose
Detection
Language_Model
PDF
2022-06-22
DP-Parse: Finding Word Boundaries from Raw Speech with an Instance Lexicon
Robin Algayres, Tristan Ricoul, Julien Karadayi, Hugo Laurençon, Salah Zaiem, Abdelrahman Mohamed, Benoît Sagot, Emmanuel Dupoux
arXiv_CL
arXiv_CL
Segmentation
Embedding
Weakly_Supervised
Speech
Language_Model
PDF
2022-06-22
GODEL: Large-Scale Pre-Training for Goal-Directed Dialog
Baolin Peng, Michel Galley, Pengcheng He, Chris Brockett, Lars Liden, Elnaz Nouri, Zhou Yu, Bill Dolan, Jianfeng Gao
arXiv_CL
arXiv_CL
Relation
Few-Shot
Language_Model
QA
PDF
2022-06-22
Open Vocabulary Object Detection with Proposal Mining and Prediction Equalization
Peixian Chen, Kekai Sheng, Mengdan Zhang, Yunhang Shen, Ke Li, Chunhua Shen
arXiv_CV
arXiv_CV
Knowledge
Detection
Object_Detection
Inference
Language_Model
Prediction
PDF
2022-06-22
Multi-LexSum: Real-World Summaries of Civil Rights Lawsuits at Multiple Granularities
Zejiang Shen, Kyle Lo, Lauren Yu, Nathan Dahlberg, Margo Schlanger, Doug Downey
arXiv_CL
arXiv_CL
Knowledge
Summarization
Language_Model
PDF
2022-06-22
Scaling Autoregressive Models for Content-Rich Text-to-Image Generation
Jiahui Yu, Yuanzhong Xu, Jing Yu Koh, Thang Luong, Gunjan Baid, Zirui Wang, Vijay Vasudevan, Alexander Ku, Yinfei Yang, Burcu Karagol Ayan, Ben Hutchinson, Wei Han, Zarana Parekh, Xin Li, Han Zhang, Jason Baldridge, Yonghui Wu
arXiv_CV
arXiv_CV
Transformer
Zero-Shot
Knowledge
GAN
Language_Model
PDF
2022-06-22
Efficient and effective training of language and graph neural network models
Vassilis N. Ioannidis, Xiang Song, Da Zheng, Houyu Zhang, Jun Ma, Yi Xu, Belinda Zeng, Trishul Chilimbi, George Karypis
arXiv_CL
arXiv_CL
Bert
Optimization
Pose
Classification
Language_Model
Prediction
PDF
2022-06-21
Don't Forget About Pronouns: Removing Gender Bias in Language Models Without Losing Factual Gender Information
Tomasz Limisiewicz, David Mareček
arXiv_AI
arXiv_AI
Embedding
Relation
Language_Model
PDF
2022-06-21
BenchCLAMP: A Benchmark for Evaluating Language Models on Semantic Parsing
Subhro Roy, Sam Thomson, Tongfei Chen, Richard Shin, Adam Pauls, Jason Eisner, Benjamin Van Durme
arXiv_CL
arXiv_CL
Face
Action
Classification
Text_Generation
Language_Model
PDF
2022-06-21
Questions Are All You Need to Train a Dense Passage Retriever
Devendra Singh Sachan, Mike Lewis, Dani Yogatama, Luke Zettlemoyer, Joelle Pineau, Manzil Zaheer
arXiv_CL
arXiv_CL
Reconstruction
Unsupervised
Denoising
Language_Model
QA
PDF
2022-06-21
Large Language Models Still Can't Plan
Karthik Valmeekam, Alberto Olmo, Sarath Sreedharan, Subbarao Kambhampati
arXiv_AI
arXiv_AI
Pose
Action
Language_Model
PDF
2022-06-21
KnowDA: All-in-One Knowledge Mixture Model for Data Augmentation in Few-Shot NLP
Yufei Wang, Jiayi Zheng, Can Xu, Xiubo Geng, Tao Shen, Chongyang Tao, Daxin Jiang
arXiv_CL
arXiv_CL
Bert
Knowledge
Pose
Few-Shot
Denoising
Language_Model
PDF
2022-06-21
TAPHSIR: Towards AnaPHoric Ambiguity Detection and ReSolution In Requirements
Saad Ezzini, Sallam Abualhaija, Chetan Arora, Mehrdad Sabetzadeh
arXiv_CL
arXiv_CL
Bert
Review
Pose
Detection
Language_Model
PDF
2022-06-21
SemMAE: Semantic-Guided Masking for Learning Masked Autoencoders
Gang Li, Heliang Zheng, Daqing Liu, Bing Su, Changwen Zheng
arXiv_CV
arXiv_CV
Image_Caption
Segmentation
Semantic_Segmentation
Recognition
Self-Supervised
Relation
Attention
Language_Model
PDF
2022-06-21
General Framework for Reversible Data Hiding in Texts Based on Masked Language Modeling
Xiaoyan Zheng, Yurun Fang, Hanzhou Wu
arXiv_CL
arXiv_CL
Embedding
Pose
Language_Model
PDF
2022-06-21
Automatic Controllable Product Copywriting for E-Commerce
Xiaojie Guo, Qingkai Zeng, Meng Jiang, Yun Xiao, Bo Long, Lingfei Wu
arXiv_AI
arXiv_AI
Weakly_Supervised
Pose
Action
Text_Generation
Language_Model
Recommendation
PDF
2022-06-20
Fewer Errors, but More Stereotypes? The Effect of Model Size on Gender Bias
Yarden Tal, Inbal Magar, Roy Schwartz
arXiv_CL
arXiv_CL
Bert
Language_Model
PDF
2022-06-20
SMT-DTA: Improving Drug-Target Affinity Prediction with Semi-supervised Multi-task Training
Qizhi Pei, Lijun Wu, Jinhua Zhu, Yingce Xia, Shufang Xia, Tao Qin, Haiguang Liu, Tie-Yan Liu
arXiv_AI
arXiv_AI
Represenation_Learning
Pose
Action
Deep_Learning
Attention
Language_Model
Prediction
PDF
2022-06-20
Domain-Adaptive Text Classification with Structured Knowledge from Unlabeled Data
Tian Li, Xiang Chen, Zhen Dong, Weijiang Yu, Yijun Yan, Kurt Keutzer, Shanghang Zhang
arXiv_CL
arXiv_CL
Bert
Sentiment_Classification
Text_Classification
Knowledge
Knowledge_Graph
Pose
Classification
Relation
Sentiment
Language_Model
PDF
2022-06-20
nuQmm: Quantized MatMul for Efficient Inference of Large-Scale Generative Language Models
Gunho Park, Baeseong Park, Se Jung Kwon, Byeongwook Kim, Youngjoo Lee, Dongsoo Lee
arXiv_CL
arXiv_CL
Transformer
Quantization
Self-Supervised
Pose
Inference
Language_Model
PDF
2022-06-19
Towards Unified Conversational Recommender Systems via Knowledge-Enhanced Prompt Learning
Xiaolei Wang, Kun Zhou, Ji-Rong Wen, Wayne Xin Zhao
arXiv_AI
arXiv_AI
Knowledge
Pose
Action
Language_Model
Recommendation
PDF
2022-06-18
Can Language Models Capture Graph Semantics? From Graphs to Language Model and Vice-Versa
Tarun Garg, Kaushik Roy, Amit Sheth
arXiv_CL
arXiv_CL
Transformer
Knowledge
Knowledge_Graph
Deep_Learning
Relation
Attention
Language_Model
PDF
2022-06-18
Automatic Summarization of Russian Texts: Comparison of Extractive and Abstractive Methods
Valeriya Goloviznina, Evgeny Kotelnikov
arXiv_CL
arXiv_CL
Transformer
Bert
Summarization
Text_Generation
Language_Model
PDF
2022-06-18
Argumentative Text Generation in Economic Domain
Irina Fishcheva, Dmitriy Osadchiy, Klavdiya Bochenina, Evgeny Kotelnikov
arXiv_CL
arXiv_CL
Transformer
Bert
Text_Generation
Language_Model
PDF
2022-06-18
Collocation2Text: Controllable Text Generation from Guide Phrases in Russian
Sergey Vychegzhanin, Evgeny Kotelnikov
arXiv_CL
arXiv_CL
Bert
Pose
Text_Generation
Language_Model
PDF
2022-06-18
CLiMB: A Continual Learning Benchmark for Vision-and-Language Tasks
Tejas Srinivasan, Ting-Yun Chang, Leticia Leonor Pinto Alva, Georgios Chochlakis, Mohammad Rostami, Jesse Thomason
arXiv_AI
arXiv_AI
Transformer
Knowledge
Language_Model
PDF
2022-06-17
MineDojo: Building Open-Ended Embodied Agents with Internet-Scale Knowledge
Linxi Fan, Guanzhi Wang, Yunfan Jiang, Ajay Mandlekar, Yuncong Yang, Haoyi Zhu, Andrew Tang, De-An Huang, Yuke Zhu, Anima Anandkumar
arXiv_CV
arXiv_CV
Knowledge
Pose
Autonomous
Language_Model
PDF
2022-06-17
A Quantitative and Qualitative Analysis of Suicide Ideation Detection using Deep Learning
Siqu Long, Rina Cabral, Josiah Poon, Soyeon Caren Han
arXiv_CL
arXiv_CL
Embedding
Text_Classification
RNN
Quantitative
Classification
Deep_Learning
Detection
Attention
Language_Model
Prediction
PDF
2022-06-17
Medical Dialogue Response Generation with Pivotal Information Recalling
Yu Zhao, Yunxin Li, Yuxiang Wu, Baotian Hu, Qingcai Chen, Xiaolong Wang, Yuxin Ding, Min Zhang
arXiv_AI
arXiv_AI
Knowledge
Pose
Relation
Attention
Medical
Language_Model
PDF
2022-06-16
Methods for Estimating and Improving Robustness of Language Models
Michal Štefánik
arXiv_CL
arXiv_CL
Face
Survey
Relation
Language_Model
PDF
2022-06-16
CS-UM6P at SemEval-2022 Task 6: Transformer-based Models for Intended Sarcasm Detection in English and Arabic
Abdelkader El Mahdaouy, Abdellah El Mekki, Kabil Essefar, Abderrahman Skiredj, Ismail Berrada
arXiv_CL
arXiv_CL
Transformer
Pose
Deep_Learning
Detection
Sentiment
Language_Model
PDF
2022-06-16
Deep Multi-Task Models for Misogyny Identification and Categorization on Arabic Social Media
Abdelkader El Mahdaouy, Abdellah El Mekki, Ahmed Oumar, Hajar Mousannif, Ismail Berrada
arXiv_CL
arXiv_CL
Bert
Speech
Attention
Language_Model
PDF
2022-06-16
Know your audience: specializing grounded language models with the game of Dixit
Aaditya K. Singh, David Ding, Andrew Saxe, Felix Hill, Andrew K. Lampinen
arXiv_AI
arXiv_AI
Zero-Shot
Pose
Attention
Language_Model
PDF
2022-06-16
Characteristics of Harmful Text: Towards Rigorous Benchmarking of Language Models
Maribeth Rauh, John Mellor, Jonathan Uesato, Po-Sen Huang, Johannes Welbl, Laura Weidinger, Sumanth Dathathri, Amelia Glaese, Geoffrey Irving, Iason Gabriel, William Isaac, Lisa Anne Hendricks
arXiv_AI
arXiv_AI
Language_Model
PDF
2022-06-16
Paraformer: Fast and Accurate Parallel Transformer for Non-autoregressive End-to-End Speech Recognition
Zhifu Gao, Shiliang Zhang, Ian McLoughlin, Zhijie Yan
arXiv_SD
arXiv_SD
Transformer
Embedding
Recognition
Speech
Pose
Speech_Recognition
Inference
Language_Model
PDF
2022-06-16
GoodBye WaveNet -- A Language Model for Raw Audio with Context of 1/2 Million Samples
Prateek Verma
arXiv_SD
arXiv_SD
Transformer
RNN
Pose
Language_Model
PDF
2022-06-16
Zero-Shot Video Question Answering via Frozen Bidirectional Language Models
Antoine Yang, Antoine Miech, Josef Sivic, Ivan Laptev, Cordelia Schmid
arXiv_CV
arXiv_CV
Zero-Shot
Pose
VQA
Few-Shot
Activity
Inference
Language_Model
QA
PDF
2022-06-16
Self-Generated In-Context Learning: Leveraging Auto-regressive Language Models as a Demonstration Generator
Hyuhng Joon Kim, Hyunsoo Cho, Junyeob Kim, Taeuk Kim, Kang Min Yoo, Sang-goo Lee
arXiv_CL
arXiv_CL
Zero-Shot
Text_Classification
Pose
Classification
Language_Model
PDF
2022-06-16
PreCogIIITH at HinglishEval : Leveraging Code-Mixing Metrics & Language Model Embeddings To Estimate Code-Mix Quality
Prashant Kodali, Tanmay Sachan, Akshay Goindani, Anmol Goel, Naman Ahuja, Manish Shrivastava, Ponnurangam Kumaraguru
arXiv_AI
arXiv_AI
Embedding
Speech
Language_Model
PDF
2022-06-16
PInKS: Preconditioned Commonsense Inference with Minimal Supervision
Ehsan Qasemi, Piyush Khanna, Qiang Ning, Muhao Chen
arXiv_CL
arXiv_CL
Knowledge
Inference
Language_Model
PDF
2022-06-16
Accelerating Inference and Language Model Fusion of Recurrent Neural Network Transducers via End-to-End 4-bit Quantization
Andrea Fasoli, Chia-Yu Chen, Mauricio Serrano, Swagath Venkataramani, George Saon, Xiaodong Cui, Brian Kingsbury, Kailash Gopalakrishnan
arXiv_SD
arXiv_SD
Quantization
RNN
Inference
Language_Model
QA
PDF
2022-06-15
TOKEN is a MASK: Few-shot Named Entity Recognition with Pre-trained Language Models
Ali Davody, David Ifeoluwa Adelani, Thomas Kleinbauer, Dietrich Klakow
arXiv_CL
arXiv_CL
Recognition
Zero-Shot
Knowledge
Pose
Few-Shot
Language_Model
PDF
2022-06-15
Prefix Language Models are Unified Modal Learners
Shizhe Diao, Wangchunshu Zhou, Xinsong Zhang, Jiawei Wang
arXiv_CV
arXiv_CV
Zero-Shot
Pose
Classification
VQA
Text_Generation
Caption
Language_Model
QA
PDF
2022-06-15
DIRECTOR: Generator-Classifiers For Supervised Language Modeling
Kushal Arora, Kurt Shuster, Sainbayar Sukhbaatar, Jason Weston
arXiv_CL
arXiv_CL
Classification
Language_Model
PDF
2022-06-15
Emergent Abilities of Large Language Models
Jason Wei, Yi Tay, Rishi Bommasani, Colin Raffel, Barret Zoph, Sebastian Borgeaud, Dani Yogatama, Maarten Bosma, Denny Zhou, Donald Metzler, Ed H. Chi, Tatsunori Hashimoto, Oriol Vinyals, Percy Liang, Jeff Dean, William Fedus
arXiv_CL
arXiv_CL
Language_Model
PDF
2022-06-15
Transformer-based Automatic Speech Recognition of Formal and Colloquial Czech in MALACH Project
Jan Lehečka, Josef V. Psutka, Josef Psutka
arXiv_CL
arXiv_CL
Transformer
Recognition
Speech
Self-Supervised
Speech_Recognition
Language_Model
PDF
2022-06-15
NatGen: Generative pre-training by 'Naturalizing' source code
Saikat Chakraborty, Toufique Ahmed, Yangruibo Ding, Premkumar Devanbu, Baishakhi Ray
arXiv_AI
arXiv_AI
Zero-Shot
Self-Supervised
Pose
Few-Shot
Language_Model
PDF
2022-06-15
Contextualization and Generalization in Entity and Relation Extraction
Bruno Taillé
arXiv_AI
arXiv_AI
Embedding
Recognition
Pose
Face
Action
Relation
Relation_Extraction
Language_Model
Prediction
PDF
2022-06-15
Residual Language Model for End-to-end Speech Recognition
Emiru Tsunoo, Yosuke Kashiwagi, Chaitanya Narisetty, Shinji Watanabe
arXiv_SD
arXiv_SD
Recognition
Speech
Pose
Speech_Recognition
Inference
Language_Model
PDF
2022-06-15
A Survey : Neural Networks for AMR-to-Text
Hongyu Hao, Guangtong Li, Zhiming Hu, Huafeng Wang
arXiv_CL
arXiv_CL
Transformer
Reconstruction
Optimization
Pose
Survey
Language_Model
PDF
2022-06-15
Human Heuristics for AI-Generated Language Are Flawed
Maurice Jakesch, Jeffrey Hancock, Mor Naaman
arXiv_AI
arXiv_AI
Pose
Language_Model
PDF
2022-06-15
Test-Time Adaptation for Visual Document Understanding
Sayna Ebrahimi, Sercan O. Arik, Tomas Pfister
arXiv_AI
arXiv_AI
Recognition
Self-Supervised
Pose
Action
VQA
Language_Model
PDF
2022-06-14
Can Foundation Models Talk Causality?
Moritz Willig, Matej Zečević, Devendra Singh Dhami, Kristian Kersting
arXiv_AI
arXiv_AI
Language_Model
PDF
2022-06-14
Understanding Narratives through Dimensions of Analogy
Thiloshon Nagarajah, Filip Ilievski, Jay Pujara
arXiv_AI
arXiv_AI
Knowledge
Language_Model
PDF
2022-06-14
LAVENDER: Unifying Video-Language Understanding as Masked Language Modeling
Linjie Li, Zhe Gan, Kevin Lin, Chung-Ching Lin, Zicheng Liu, Ce Liu, Lijuan Wang
arXiv_CV
arXiv_CV
Video_Caption
Zero-Shot
Face
Few-Shot
Caption
Language_Model
Video_Retrieval
PDF
2022-06-14
SBERT studies Meaning Representations: Decomposing Sentence Embeddings into Explainable AMR Meaning Features
Juri Opitz, Anette Frank
arXiv_CL
arXiv_CL
Embedding
Bert
Pose
Face
Relation
Language_Model
PDF
2022-06-14
FETILDA: An Effective Framework For Fin-tuned Embeddings For Long Financial Text Documents
Bolun "Namir" Xia, Vipula D. Rawte, Mohammed J. Zaki, Aparna Gupta
arXiv_CL
arXiv_CL
Embedding
Pose
Deep_Learning
Attention
Language_Model
Prediction
PDF
2022-06-14
CERT: Continual Pre-Training on Sketches for Library-Oriented Code Generation
Daoguang Zan, Bei Chen, Dejian Yang, Zeqi Lin, Minsu Kim, Bei Guan, Yongji Wang, Weizhu Chen, Jian-Guang Lou
arXiv_CL
arXiv_CL
Sketch
Language_Model
PDF
2022-06-14
Task Transfer and Domain Adaptation for Zero-Shot Question Answering
Xiang Pan, Alex Sheng, David Shimshoni, Aditya Singhal, Sara Rosenthal, Avirup Sil
arXiv_CL
arXiv_CL
Zero-Shot
Language_Model
PDF
2022-06-14
FreeTransfer-X: Safe and Label-Free Cross-Lingual Transfer from Off-the-Shelf Models
Yinpeng Guo, Liangyou Li, Xin Jiang, Qun Liu
arXiv_CL
arXiv_CL
Knowledge
Pose
NMT
Language_Model
PDF
2022-06-14
Exploring evolution-based & -free protein language models as protein function predictors
Mingyang Hu, Fajie Yuan, Kevin K. Yang, Fusong Ju, Jin Su, Hui Wang, Fei Yang, Qiuyang Ding
arXiv_AI
arXiv_AI
Transformer
3D
Language_Model
Prediction
PDF
2022-06-14
LIFT: Language-Interfaced Fine-Tuning for Non-Language Machine Learning Tasks
Tuan Dinh, Yuchen Zeng, Ruisu Zhang, Ziqian Lin, Shashank Rajput, Michael Gira, Jy-yong Sohn, Dimitris Papailiopoulos, Kangwook Lee
arXiv_CL
arXiv_CL
Embedding
Pose
Face
Classification
Language_Model
Prediction
Matching
PDF
2022-06-13
Memory-Based Model Editing at Scale
Eric Mitchell, Charles Lin, Antoine Bosselut, Christopher D. Manning, Chelsea Finn
arXiv_CL
arXiv_CL
Knowledge
Pose
Language_Model
Prediction
PDF
2022-06-13
MetaTPTrans: A Meta Learning Approach for Multilingual Code Representation Learning
Weiguo Pian, Hanyu Peng, Xunzhu Tang, Tiezhu Sun, Haoye Tian, Andrew Habib, Jacques Klein, Tegawendé F. Bissyandé
arXiv_AI
arXiv_AI
Represenation_Learning
Pose
Summarization
Language_Model
Prediction
PDF
2022-06-13
Language Models are General-Purpose Interfaces
Yaru Hao, Haoyu Song, Li Dong, Shaohan Huang, Zewen Chi, Wenhui Wang, Shuming Ma, Furu Wei
arXiv_CL
arXiv_CL
Zero-Shot
Pose
Face
Few-Shot
Attention
Language_Model
PDF
2022-06-13
JiuZhang: A Chinese Pre-trained Language Model for Mathematical Problem Understanding
Wayne Xin Zhao, Kun Zhou, Zheng Gong, Beichen Zhang, Yuanhang Zhou, Jing Sha, Zhigang Chen, Shijin Wang, Cong Liu, Ji-Rong Wen
arXiv_AI
arXiv_AI
Knowledge
Language_Model
PDF
2022-06-13
Transition-based Abstract Meaning Representation Parsing with Contextual Embeddings
Yichao Liang
arXiv_AI
arXiv_AI
Embedding
Bert
Pose
Language_Model
PDF
2022-06-13
EGRU: Event-based GRU for activity-sparse inference and learning
Anand Subramoney, Khaleelulla Khan Nazeer, Mark Schöne, Christian Mayr, David Kappel
arXiv_AI
arXiv_AI
Gradient_Descent
Sparse
RNN
Pose
Action
Activity
Inference
Language_Model
PDF
2022-06-13
INDIGO: Intrinsic Multimodality for Domain Generalization
Puneet Mangla, Shivam Chandhok, Milan Aggarwal, Vineeth N Balasubramanian, Balaji Krishnamurthy
arXiv_CV
arXiv_CV
Weakly_Supervised
Pose
GAN
Language_Model
PDF
2022-06-12
GLIPv2: Unifying Localization and Vision-Language Understanding
Haotian Zhang, Pengchuan Zhang, Xiaowei Hu, Yen-Chun Chen, Liunian Harold Li, Xiyang Dai, Lijuan Wang, Lu Yuan, Jenq-Neng Hwang, Jianfeng Gao
arXiv_AI
arXiv_AI
Image_Caption
Segmentation
Zero-Shot
Contrastive_Learning
Detection
VQA
Few-Shot
Object_Detection
GAN
Caption
Language_Model
QA
PDF
2022-06-12
Self-critiquing models for assisting human evaluators
William Saunders, Catherine Yeh, Jeff Wu, Steven Bills, Long Ouyang, Jonathan Ward, Jan Leike
arXiv_CL
arXiv_CL
Knowledge
Summarization
Language_Model
PDF
2022-06-12
CoSe-Co: Text Conditioned Generative CommonSense Contextualizer
Rachit Bansal, Milan Aggarwal, Sumit Bhatia, Jivat Neet Kaur, Balaji Krishnamurthy
arXiv_CL
arXiv_CL
Knowledge
Knowledge_Graph
Pose
Relation
Language_Model
QA
PDF
2022-06-12
Fine-tuning Pre-trained Language Models with Noise Stability Regularization
Hang Hua, Xingjian Li, Dejing Dou, Cheng-Zhong Xu, Jiebo Luo
arXiv_CL
arXiv_CL
Text_Classification
Regularization
Pose
Classification
Language_Model
PDF
2022-06-11
Bridging the Gap Between Training and Inference of Bayesian Controllable Language Models
Han Liu, Bingning Wang, Ting Yao, Haijin Liang, Jianjin Xu, Xiaolin Hu
arXiv_AI
arXiv_AI
Pose
Sentiment
Inference
Language_Model
PDF
2022-06-11
Building a Personalized Dialogue System with Prompt-Tuning
Tomohito Kasahara, Daisuke Kawahara, Nguyen Tung, Shengzhe Li, Kenta Shinzato, Toshinori Sato
arXiv_CL
arXiv_CL
Pose
Language_Model
PDF
2022-06-11
Why is constrained neural language generation particularly challenging?
Cristina Garbacea, Qiaozhu Mei
arXiv_AI
arXiv_AI
Review
Survey
Text_Generation
Language_Model
PDF
2022-06-10
A Multi-Task Benchmark for Korean Legal Language Understanding and Judgement Prediction
Wonseok Hwang, Dongjun Lee, Kyoungyeon Cho, Hanuhl Lee, Minjoon Seo
arXiv_AI
arXiv_AI
Review
Classification
Deep_Learning
Summarization
Language_Model
Prediction
PDF
2022-06-10
Putting GPT-3's Creativity to the Test
Claire Stevenson, Iris Smal, Matthijs Baas, Raoul Grasman, Han van der Maas
arXiv_AI
arXiv_AI
Language_Model
PDF
2022-06-10
REKnow: Enhanced Knowledge for Joint Entity and Relation Extraction
Sheng Zhang, Patrick Ng, Zhiguo Wang, Bing Xiang
arXiv_CL
arXiv_CL
Knowledge
Knowledge_Graph
Pose
Action
Relation
Relation_Extraction
Language_Model
PDF
2022-06-10
Unsupervised and Few-shot Parsing from Pretrained Language Models
Zhiyuan Zeng, Deyi Xiong
arXiv_CL
arXiv_CL
Segmentation
Unsupervised
Knowledge
Pose
Few-Shot
Attention
Language_Model
PDF
2022-06-10
Borrowing or Codeswitching? Annotating for Finer-Grained Distinctions in Language Mixing
Elena Alvarez Mellado, Constantine Lignos
arXiv_CL
arXiv_CL
Transformer
Language_Model
PDF
2022-06-10
Sort by Structure: Language Model Ranking as Dependency Probing
Max Müller-Eberstein, Rob van der Goot, Barbara Plank
arXiv_CL
arXiv_CL
Embedding
Bert
Pose
Language_Model
Prediction
PDF
2022-06-09
Factuality Enhanced Language Models for Open-Ended Text Generation
Nayeon Lee, Wei Ping, Peng Xu, Mostofa Patwary, Mohammad Shoeybi, Bryan Catanzaro
arXiv_AI
arXiv_AI
Pose
Text_Generation
Language_Model
PDF
2022-06-09
Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models
Aarohi Srivastava, Abhinav Rastogi, Abhishek Rao, Abu Awal Md Shoeb, Abubakar Abid, Adam Fisch, Adam R. Brown, Adam Santoro, Aditya Gupta, Adrià Garriga-Alonso, Agnieszka Kluska, Aitor Lewkowycz, Akshat Agarwal, Alethea Power, Alex Ray, Alex Warstadt, Alexander W. Kocurek, Ali Safaya, Ali Tazarv, Alice Xiang, Alicia Parrish, Allen Nie, Aman Hussain, Amanda Askell, Amanda Dsouza, Ameet Rahane, Anantharaman S. Iyer, Anders Andreassen, Andrea Santilli, Andreas Stuhlmüller, Andrew Dai, Andrew La, Andrew Lampinen, Andy Zou, Angela Jiang, Angelica Chen, Anh Vuong, Animesh Gupta, Anna Gottardi, Antonio Norelli, Anu Venkatesh, Arash Gholamidavoodi, Arfa Tabassum, Arul Menezes, Arun Kirubarajan, Asher Mullokandov, Ashish Sabharwal, Austin Herrick, Avia Efrat, Aykut Erdem, Ayla Karakaş, et al. (392 additional authors not shown)
arXiv_AI
arXiv_AI
Transformer
Sparse
Knowledge
Quantitative
Language_Model
PDF
2022-06-09
Privacy Leakage in Text Classification: A Data Extraction Approach
Adel Elmahdy, Huseyin A. Inan, Robert Sim
arXiv_CL
arXiv_CL
Text_Classification
Pose
Action
Classification
Language_Model
Prediction
PDF
2022-06-09
Extracting Zero-shot Common Sense from Large Language Models for Robot 3D Scene Understanding
William Chen, Siyi Hu, Rajat Talak, Luca Carlone
arXiv_CL
arXiv_CL
3D
Zero-Shot
Knowledge
Pose
Language_Model
PDF
2022-06-09
SsciBERT: A Pre-trained Language Model for Social Science Texts
Si Shen, Jiangfeng Liu, Litao Lin, Ying Huang, Lin Zhang, Chang Liu, Yutong Feng, Dongbo Wang
arXiv_CL
arXiv_CL
Recognition
Bert
Pose
Classification
Language_Model
PDF
2022-06-09
Joint Encoder-Decoder Self-Supervised Pre-training for ASR
Arunkumar A, Umesh S
arXiv_CL
arXiv_CL
Embedding
Recognition
Bert
Speech
Self-Supervised
Pose
Speech_Recognition
Language_Model
Prediction
PDF
2022-06-09
Ancestor-to-Creole Transfer is Not a Walk in the Park
Heather Lent, Emanuele Bugliarello, Anders Søgaard
arXiv_CL
arXiv_CL
Language_Model
PDF
2022-06-09
Context-based out-of-vocabulary word recovery for ASR systems in Indian languages
Arun Baby, Saranya Vinnaitherthan, Akhil Kerhalkar, Pranav Jawale, Sharath Adavanne, Nagaraj Adiga
arXiv_CL
arXiv_CL
Recognition
Knowledge
Speech
Pose
Speech_Recognition
Language_Model
Matching
PDF
2022-06-08
Few-shot Prompting Toward Controllable Response Generation
Hsuan Su, Pohan Chi, Shih-Cheng Huang, Chung Ho Lam, Saurav Sahay, Shang-Tse Chen, Hung-yi Lee
arXiv_AI
arXiv_AI
Reinforcement_Learning
Pose
Few-Shot
Language_Model
QA
PDF
2022-06-07
Revealing Single Frame Bias for Video-and-Language Learning
Jie Lei, Tamara L. Berg, Mohit Bansal
arXiv_AI
arXiv_AI
Recognition
Pose
Action_Recognition
Action
Inference
Language_Model
Video_Retrieval
PDF
2022-06-07
Always Keep your Target in Mind: Studying Semantics and Improving Performance of Neural Lexical Substitution
Nikolay Arefyev, Boris Sheludko, Alexander Podolskiy, Alexander Panchenko
arXiv_CL
arXiv_CL
Bert
Action
Relation
Relation_Extraction
Language_Model
PDF
2022-06-07
cViL: Cross-Lingual Training of Vision-Language Models using Knowledge Distillation
Kshitij Gupta, Devansh Gautam, Radhika Mamidi
arXiv_CV
arXiv_CV
Knowledge
Pose
Classification
VQA
Language_Model
PDF
2022-06-07
OCHADAI at SemEval-2022 Task 2: Adversarial Training for Multilingual Idiomaticity Detection
Lis Kanashiro Pereira, Ichiro Kobayashi
arXiv_CL
arXiv_CL
Transformer
Bert
Zero-Shot
Knowledge
Adversarial
Pose
Detection
Language_Model
PDF
2022-06-07
Plot Writing From Pre-Trained Language Models
Yiping Jin, Vishakha Kadam, Dittaya Wanvarie
arXiv_CL
arXiv_CL
Pose
Language_Model
PDF
2022-06-07
DynaMaR: Dynamic Prompt with Mask Token Representation
Xiaodi Sun, Sunny Rajagopalan, Priyanka Nigam, Weiyi Lu, Yi Xu, Belinda Zeng, Trishul Chilimbi
arXiv_CL
arXiv_CL
Unsupervised
Pose
Classification
Few-Shot
Language_Model
PDF
2022-06-06
Neuro-Symbolic Causal Language Planning with Commonsense Prompting
Yujie Lu, Weixi Feng, Wanrong Zhu, Wenda Xu, Xin Eric Wang, Miguel Eckstein, William Yang Wang
arXiv_AI
arXiv_AI
Knowledge
Pose
Action
Relation
Language_Model
PDF
2022-06-06
No Parameter Left Behind: How Distillation and Model Size Affect Zero-Shot Retrieval
Guilherme Moraes Rosa, Luiz Bonifacio, Vitor Jeronymo, Hugo Abonizio, Marzieh Fadaee, Roberto Lotufo, Rodrigo Nogueira
arXiv_CL
arXiv_CL
Zero-Shot
Action
Language_Model
PDF
2022-06-06
Blended Latent Diffusion
Omri Avrahami, Ohad Fried, Dani Lischinski
arXiv_CV
arXiv_CV
Optimization
Pose
Face
Quantitative
GAN
Inference
Language_Model
PDF
2022-06-06
What do tokens know about their characters and how do they know it?
Ayush Kaushal, Kyle Mahowald
arXiv_CL
arXiv_CL
Embedding
Bert
Knowledge
Speech
Relation
Language_Model
PDF
2022-06-06
Improving Contrastive Learning of Sentence Embeddings with Case-Augmented Positives and Retrieved Negatives
Wei Wang, Liangzhu Ge, Jingqiao Zhang, Cheng Yang
arXiv_CL
arXiv_CL
Embedding
Unsupervised
Pose
Contrastive_Learning
Language_Model
PDF
2022-06-06
Learning to Break the Loop: Analyzing and Mitigating Repetitions for Neural Text Generation
Jin Xu, Xiaojiang Liu, Jianhao Yan, Deng Cai, Huayang Li, Jian Li
arXiv_CL
arXiv_CL
Pose
Quantitative
Relation
Summarization
Text_Generation
Language_Model
PDF
2022-06-06
OrdinalCLIP: Learning Rank Prompts for Language-Guided Ordinal Regression
Wanhua Li, Xiaoke Huang, Zheng Zhu, Yansong Tang, Xiu Li, Jiwen Lu, Jie Zhou
arXiv_CV
arXiv_CV
Embedding
Pose
Few-Shot
Language_Model
Matching
PDF
2022-06-06
On the Advance of Making Language Models Better Reasoners
Yifei Li, Zeqi Lin, Shizhuo Zhang, Qiang Fu, Bei Chen, Jian-Guang Lou, Weizhu Chen
arXiv_AI
arXiv_AI
Pose
Few-Shot
Language_Model
PDF
2022-06-06
Pretrained Models for Multilingual Federated Learning
Orion Weller, Marc Marone, Vladimir Braverman, Dawn Lawrie, Benjamin Van Durme
arXiv_CL
arXiv_CL
Text_Classification
Classification
Language_Model
PDF
2022-06-05
Exploring Cross-lingual Textual Style Transfer with Large Multilingual Language Models
Daniil Moskovskiy, Daryna Dementieva, Alexander Panchenko
arXiv_CL
arXiv_CL
Style_Transfer
Language_Model
PDF
2022-06-05
Offline RL for Natural Language Generation with Implicit Language Q Learning
Charlie Snell, Ilya Kostrikov, Yi Su, Mengjiao Yang, Sergey Levine
arXiv_CL
arXiv_CL
Reinforcement_Learning
Optimization
Knowledge
Speech
Pose
Language_Model
PDF
2022-06-05
Sentiment Analysis of Online Travel Reviews Based on Capsule Network and Sentiment Lexicon
Jia Wang, Junping Du, Yingxia Shao, Ang Li
arXiv_AI
arXiv_AI
Bert
Sentiment_Classification
Review
Pose
Emotion
Classification
Sentiment
Language_Model
PDF
2022-06-04
Fault-Aware Neural Code Rankers
Jeevana Priya Inala, Chenglong Wang, Mei Yang, Andres Codas, Mark Encarnación, Shuvendu K Lahiri, Madanlal Musuvathi, Jianfeng Gao
arXiv_AI
arXiv_AI
Pose
Language_Model
PDF
2022-06-04
Instance-wise Prompt Tuning for Pretrained Language Models
Yuezihan Jiang, Hao Yang, Junyang Lin, Hanyu Zhao, An Yang, Chang Zhou, Hongxia Yang, Zhi Yang, Bin Cui
arXiv_AI
arXiv_AI
Knowledge
Language_Model
PDF
2022-06-04
Comparing Performance of Different Linguistically-Backed Word Embeddings for Cyberbullying Detection
Juuso Eronen, Michal Ptaszynski, Fumito Masui
arXiv_AI
arXiv_AI
Embedding
Bert
Speech
Pose
Detection
Relation
Language_Model
PDF
2022-06-04
ZeroQuant: Efficient and Affordable Post-Training Quantization for Large-Scale Transformers
Zhewei Yao, Reza Yazdani Aminabadi, Minjia Zhang, Xiaoxia Wu, Conglong Li, Yuxiong He
arXiv_CL
arXiv_CL
Transformer
Quantization
Bert
Knowledge
Attention
Inference
Language_Model
PDF
2022-06-03
Visual Clues: Bridging Vision and Language Foundations for Image Paragraph Captioning
Yujia Xie, Luowei Zhou, Xiyang Dai, Lu Yuan, Nguyen Bach, Ce Liu, Michael Zeng
arXiv_AI
arXiv_AI
Zero-Shot
Quantitative
Caption
Language_Model
PDF
2022-06-03
Relevance in Dialogue: Is Less More? An Empirical Comparison of Existing Metrics, and a Novel Simple Metric
Ian Berlot-Attwell, Frank Rudzicz
arXiv_CL
arXiv_CL
Pose
Relation
Language_Model
PDF
2022-06-03
Revisiting the 'Video' in Video-Language Understanding
Shyamal Buch, Cristóbal Eyzaguirre, Adrien Gaidon, Jiajun Wu, Li Fei-Fei, Juan Carlos Niebles
arXiv_AI
arXiv_AI
Self-Supervised
Pose
Language_Model
Video_Retrieval
PDF
2022-06-03
A-OKVQA: A Benchmark for Visual Question Answering using World Knowledge
Dustin Schwenk, Apoorv Khandelwal, Christopher Clark, Kenneth Marino, Roozbeh Mottaghi
arXiv_CV
arXiv_CV
Knowledge
Pose
VQA
Language_Model
QA
PDF
2022-06-03
Acquiring and Modelling Abstract Commonsense Knowledge via Conceptualization
Mutian He, Tianqing Fang, Weiqi Wang, Yangqiu Song
arXiv_AI
arXiv_AI
Knowledge
Knowledge_Graph
Inference
Language_Model
PDF
2022-06-03
Latent Topology Induction for Understanding Contextualized Representations
Yao Fu, Mirella Lapata
arXiv_AI
arXiv_AI
Embedding
Unsupervised
Pose
Language_Model
PDF
2022-06-03
Automatic Generation of Programming Exercises and Code Explanations with Large Language Models
Sami Sarsa, Paul Denny, Arto Hellas, Juho Leinonen
arXiv_CL
arXiv_CL
Quantitative
Language_Model
PDF
2022-06-02
VL-BEiT: Generative Vision-Language Pretraining
Hangbo Bao, Wenhui Wang, Li Dong, Furu Wei
arXiv_CV
arXiv_CV
Transformer
Segmentation
Semantic_Segmentation
Classification
VQA
Image_Classification
Language_Model
Prediction
PDF
2022-06-02
Squeezeformer: An Efficient Transformer for Automatic Speech Recognition
Sehoon Kim, Amir Gholami, Albert Shaw, Nicholas Lee, Karttikeya Mangalam, Jitendra Malik, Michael W. Mahoney, Kurt Keutzer
arXiv_CL
arXiv_CL
Transformer
Recognition
Speech
Pose
Attention
Speech_Recognition
CNN
Language_Model
PDF
2022-06-02
BayesFormer: Transformer with Uncertainty Estimation
Karthik Abinav Sankararaman, Sinong Wang, Han Fang
arXiv_AI
arXiv_AI
Transformer
Pose
Classification
Inference
Language_Model
PDF
2022-06-01
On Reinforcement Learning and Distribution Matching for Fine-Tuning Language Models with no Catastrophic Forgetting
Tomasz Korbak, Hady Elsahar, Germán Kruszewski, Marc Dymetman
arXiv_CL
arXiv_CL
Reinforcement_Learning
Action
Sentiment
Language_Model
Matching
PDF
2022-06-01
What Changed? Investigating Debiasing Methods using Causal Mediation Analysis
Sullam Jeoung, Jana Diesner
arXiv_AI
arXiv_AI
Pose
Detection
Attention
Language_Model
Prediction
PDF
2022-06-01
Cross-View Language Modeling: Towards Unified Cross-Lingual Cross-Modal Pre-training
Yan Zeng, Wangchunshu Zhou, Ao Luo, Xinsong Zhang
arXiv_AI
arXiv_AI
Image_Caption
Zero-Shot
Contrastive_Learning
Caption
Language_Model
PDF
2022-06-01
MaskOCR: Text Recognition with Masked Encoder-Decoder Pretraining
Pengyuan Lyu, Chengquan Zhang, Shanshan Liu, Meina Qiao, Yangliu Xu, Liang Wu, Kun Yao, Junyu Han, Errui Ding, Jingdong Wang
arXiv_CV
arXiv_CV
Transformer
Recognition
OCR
Self-Supervised
Pose
Language_Model
PDF
2022-06-01
THE-X: Privacy-Preserving Transformer Inference with Homomorphic Encryption
Tianyu Chen, Hangbo Bao, Shaohan Huang, Li Dong, Binxing Jiao, Daxin Jiang, Haoyi Zhou, Jianxin Li
arXiv_CL
arXiv_CL
Transformer
Pose
Medical
Inference
Language_Model
PDF
2022-06-01
Order-sensitive Shapley Values for Evaluating Conceptual Soundness of NLP Models
Kaiji Lu, Anupam Datta
arXiv_AI
arXiv_AI
Bert
Adversarial
Face
Sentiment
Language_Model
PDF
2022-05-31
A Mixture-of-Expert Approach to RL-based Dialogue Management
Yinlam Chow, Aza Tulepbergenov, Ofir Nachum, MoonKyung Ryu, Mohammad Ghavamzadeh, Craig Boutilier
arXiv_AI
arXiv_AI
Reinforcement_Learning
Action
Language_Model
PDF
2022-05-31
CodeAttack: Code-based Adversarial Attacks for Pre-Trained Programming Language Models
Akshita Jha, Chandan K. Reddy
arXiv_CL
arXiv_CL
Bert
Adversarial
Pose
Summarization
Language_Model
PDF
2022-05-31
Cluster-based Evaluation of Automatically Generated Text
Tiago Pimentel, Clara Meister, Ryan Cotterell
arXiv_CL
arXiv_CL
Embedding
Pose
Face
Relation
Language_Model
PDF
2022-05-31
NEWTS: A Corpus for News Topic-Focused Summarization
Seyed Ali Bahrainian, Sheridan Feucht, Carsten Eickhoff
arXiv_CL
arXiv_CL
Pose
GAN
Summarization
Language_Model
PDF
2022-05-31
Prompt Injection: Parameterization of Fixed Inputs
Eunbi Choi, Yongrae Jo, Joel Jang, Minjoon Seo
arXiv_CL
arXiv_CL
Zero-Shot
Pose
Inference
Language_Model
PDF
2022-05-31
hmBERT: Historical Multilingual Language Models for Named Entity Recognition
Stefan Schweter, Luisa März, Katharina Schmid, Erion Çano
arXiv_CL
arXiv_CL
Recognition
OCR
Bert
Optical_Character
Pose
GAN
Language_Model
PDF
2022-05-31
Leveraging Pre-Trained Language Models to Streamline Natural Language Interaction for Self-Tracking
Young-Ho Kim, Sungdong Kim, Minsuk Chang, Sang-Woo Lee
arXiv_AI
arXiv_AI
Tracking
Pose
Action
Activity
Language_Model
QA
PDF
2022-05-30
VLUE: A Multi-Task Benchmark for Evaluating Vision-Language Models
Wangchunshu Zhou, Yan Zeng, Shizhe Diao, Xinsong Zhang
arXiv_CV
arXiv_CV
Language_Model
PDF
2022-05-30
Prompting ELECTRA: Few-Shot Learning with Discriminative Pre-Trained Models
Mengzhou Xia, Mikel Artetxe, Jingfei Du, Danqi Chen, Ves Stoyanov
arXiv_CL
arXiv_CL
Few-Shot
Language_Model
Prediction
PDF
2022-05-30
Automatic Short Math Answer Grading via In-context Meta-learning
Mengxue Zhang, Sami Baral, Neil Heffernan, Andrew Lan
arXiv_CL
arXiv_CL
Bert
Pose
Language_Model
PDF
2022-05-30
Billions of Parameters Are Worth More Than In-domain Training Data: A case study in the Legal Case Entailment Task
Guilherme Moraes Rosa, Luiz Bonifacio, Vitor Jeronymo, Hugo Abonizio, Roberto Lotufo, Rodrigo Nogueira
arXiv_CL
arXiv_CL
Zero-Shot
Pose
Few-Shot
Language_Model
PDF
2022-05-30
Parameter Efficient Diff Pruning for Bias Mitigation
Lukas Hauzenberger, Navid Rekabsaz
arXiv_CL
arXiv_CL
Sparse
Pose
Inference
Language_Model
PDF
2022-05-30
ZusammenQA: Data Augmentation with Specialized Models for Cross-lingual Open-retrieval Question Answering System
Chia-Chien Hung, Tommaso Green, Robert Litschko, Tornike Tsereteli, Sotaro Takeshita, Marco Bombieri, Goran Glavaš, Simone Paolo Ponzetto
arXiv_CL
arXiv_CL
Pose
GAN
Language_Model
QA
PDF
2022-05-30
E2S2: Encoding-Enhanced Sequence-to-Sequence Pretraining for Language Understanding and Generation
Qihuang Zhong, Liang Ding, Juhua Liu, Bo Du, Dacheng Tao
arXiv_CL
arXiv_CL
Knowledge
Self-Supervised
Pose
Denoising
Language_Model
PDF
2022-05-30
Prompt-aligned Gradient for Prompt Tuning
Beier Zhu, Yulei Niu, Yucheng Han, Yue Wu, Hanwang Zhang
arXiv_CV
arXiv_CV
Zero-Shot
Knowledge
Few-Shot
Language_Model
Prediction
PDF
2022-05-30
Rites de Passage: Elucidating Displacement to Emplacement of Refugees
Aparup Khatua, Wolfgang Nejdl
arXiv_CL
arXiv_CL
Transformer
Recognition
Bert
RNN
Pose
Language_Model
PDF
2022-05-29
COVID-19 Literature Mining and Retrieval using Text Mining Approaches
Sanku Satya Uday, Satti Thanuja Pavani, T. Jaya Lakshmi, Rohit Chivukula
arXiv_CL
arXiv_CL
Bert
Pose
GAN
Language_Model
PDF
2022-05-29
L3Cube-MahaNLP: Marathi Natural Language Processing Datasets, Models, and Library
Raviraj Joshi
arXiv_CL
arXiv_CL
Transformer
Unsupervised
Recognition
Bert
Speech
Detection
Sentiment
Language_Model
PDF
2022-05-29
CPED: A Large-Scale Chinese Personalized and Emotional Dialogue Dataset for Conversational AI
Yirong Chen, Weiquan Fan, Xiaofen Xing, Jianxin Pang, Minlie Huang, Wenjing Han, Qianfeng Tie, Xiangmin Xu
arXiv_AI
arXiv_AI
Recognition
Knowledge
Pose
Emotion
Language_Model
PDF
2022-05-29
Decoupling Knowledge from Memorization: Retrieval-augmented Prompt Learning
Xiang Chen, Lei Li, Ningyu Zhang, Xiaozhuan Liang, Shumin Deng, Chuanqi Tan, Fei Huang, Luo Si, Huajun Chen
arXiv_CL
arXiv_CL
Enhancement
Zero-Shot
Knowledge
Pose
Few-Shot
Inference
Language_Model
PDF
2022-05-29
SFE-AI at SemEval-2022 Task 11: Low-Resource Named Entity Recognition using Large Pre-trained Language Models
Changyu Hou, Jun Wang, Yixuan Qiao, Peng Jiang, Peng Gao, Guotong Xie, Qizhi Lin, Xiaopeng Wang, Xiandi Jiang, Benqi Wang, Qifeng Xiao
arXiv_CL
arXiv_CL
Transformer
Recognition
Pose
Language_Model
PDF
2022-05-29
COFS: Controllable Furniture layout Synthesis
Wamiq Reyaz Para, Paul Guerrero, Niloy Mitra, Peter Wonka
arXiv_CV
arXiv_CV
Transformer
Pose
Action
Quantitative
Language_Model
PDF
2022-05-29
Urdu News Article Recommendation Model using Natural Language Processing Techniques
Syed Zain Abbas, Dr. Arif ur Rahman, Abdul Basit Mughal, Syed Mujtaba Haider
arXiv_CL
arXiv_CL
Bert
Pose
Language_Model
Recommendation
PDF
2022-05-29
Learning Locality and Isotropy in Dialogue Modeling
Han Wu, Haochen Tan, Mingjie Zhan, Gangming Zhao, Shaoqing Lu, Ding Liang, Linqi Song
arXiv_CL
arXiv_CL
Transformer
Pose
Language_Model
PDF
2022-05-29
AutoDisc: Automatic Distillation Schedule for Large Language Model Compression
Chen Zhang, Yang Yang, Qifan Wang, Jiahao Liu, Jingang Wang, Wei Wu, Dawei Song
arXiv_CL
arXiv_CL
Optimization
Knowledge
Pose
Language_Model
PDF
2022-05-28
Few-shot Subgoal Planning with Language Models
Lajanugen Logeswaran, Yao Fu, Moontae Lee, Honglak Lee
arXiv_CL
arXiv_CL
Pose
Action
Few-Shot
Language_Model
Prediction
PDF
2022-05-27
Self-supervised models of audio effectively explain human cortical responses to speech
Aditya R. Vaidya, Shailee Jain, Alexander G. Huth
arXiv_CL
arXiv_CL
Bert
Represenation_Learning
Speech
Self-Supervised
Language_Model
Prediction
PDF
2022-05-27
Controllable Text Generation with Neurally-Decomposed Oracle
Tao Meng, Sidi Lu, Nanyun Peng, Kai-Wei Chang
arXiv_CL
arXiv_CL
Pose
Text_Generation
Language_Model
PDF
2022-05-27
Diffusion-LM Improves Controllable Text Generation
Xiang Lisa Li, John Thickstun, Ishaan Gulrajani, Percy Liang, Tatsunori B. Hashimoto
arXiv_AI
arXiv_AI
Sentiment
Text_Generation
Language_Model
PDF
2022-05-27
GIT: A Generative Image-to-text Transformer for Vision and Language
Jianfeng Wang, Zhengyuan Yang, Xiaowei Hu, Linjie Li, Kevin Lin, Zhe Gan, Zicheng Liu, Ce Liu, Lijuan Wang
arXiv_CV
arXiv_CV
Image_Caption
Transformer
Recognition
Video_Caption
OCR
Optical_Character
Scene_Text
Classification
Detection
Object_Detection
Caption
Image_Classification
Language_Model
PDF
2022-05-27
StereoKG: Data-Driven Knowledge Graph Construction for Cultural Knowledge and Stereotypes
Awantee Deshpande, Dana Ruiter, Marius Mosbach, Dietrich Klakow
arXiv_CL
arXiv_CL
Knowledge
Knowledge_Graph
Speech
Classification
Detection
Language_Model
PDF
2022-05-27
Learning to Automate Follow-up Question Generation using Process Knowledge for Depression Triage on Reddit Posts
Shrey Gupta, Anmol Agarwal, Manas Gaur, Kaushik Roy, Vignesh Narayanan, Ponnurangam Kumaraguru, Amit Sheth
arXiv_AI
arXiv_AI
Knowledge
Language_Model
PDF
2022-05-27
Nearest Neighbor Zero-Shot Inference
Weijia Shi, Julian Michael, Suchin Gururangan, Luke Zettlemoyer
arXiv_CL
arXiv_CL
Zero-Shot
Text_Classification
Sparse
Classification
Inference
Language_Model
PDF
2022-05-27
Understanding Long Programming Languages with Structure-Aware Sparse Attention
Tingting Liu, Chengyu Wang, Cen Chen, Ming Gao, Aoying Zhou
arXiv_AI
arXiv_AI
Transformer
Bert
Sparse
Relation
Attention
Language_Model
PDF
2022-05-27
HiJoNLP at SemEval-2022 Task 2: Detecting Idiomaticity of Multiword Expressions using Multilingual Pretrained Language Models
Minghuan Tan
arXiv_CL
arXiv_CL
Detection
Language_Model
PDF
2022-05-26
Contextual Adapters for Personalized Speech Recognition in Neural Transducers
Kanthashree Mysore Sathyendra, Thejaswi Muniyappa, Feng-Ju Chang, Jing Liu, Jinru Su, Grant P. Strimel, Athanasios Mouchtaris, Siegfried Kunzmann
arXiv_CL
arXiv_CL
Recognition
Speech
Pose
Speech_Recognition
Inference
Language_Model
PDF
2022-05-26
Quark: Controllable Text Generation with Reinforced Unlearning
Ximing Lu, Sean Welleck, Liwei Jiang, Jack Hessel, Lianhui Qin, Peter West, Prithviraj Ammanabrolu, Yejin Choi
arXiv_CL
arXiv_CL
Reinforcement_Learning
Sentiment
Text_Generation
Language_Model
PDF
2022-05-26
Differentially Private Decoding in Large Language Models
Jimit Majmudar, Christophe Dupuy, Charith Peris, Sami Smaili, Rahul Gupta, Richard Zemel
arXiv_CL
arXiv_CL
Pose
Language_Model
PDF
2022-05-26
Training and Inference on Any-Order Autoregressive Models the Right Way
Andy Shih, Dorsa Sadigh, Stefano Ermon
arXiv_AI
arXiv_AI
Inpainting
Inference
Language_Model
PDF
2022-05-25
Transcormer: Transformer for Sentence Scoring with Sliding Language Modeling
Kaitao Song, Yichong Leng, Xu Tan, Yicheng Zou, Tao Qin, Dongsheng Li
arXiv_CL
arXiv_CL
Transformer
Bert
Pose
Attention
Language_Model
PDF
2022-05-25
NaturalProver: Grounded Mathematical Proof Generation with Language Models
Sean Welleck, Jiacheng Liu, Ximing Lu, Hannaneh Hajishirzi, Yejin Choi
arXiv_AI
arXiv_AI
Knowledge
Language_Model
PDF
2022-05-25
Detecting Label Errors using Pre-Trained Language Models
Derek Chong, Jenny Hong, Christopher D. Manning
arXiv_CL
arXiv_CL
Language_Model
PDF
2022-05-25
PLOG: Table-to-Logic Pretraining for Logical Table-to-Text Generation
Ao Liu, Haoyu Dong, Naoaki Okazaki, Shi Han, Dongmei Zhang
arXiv_CL
arXiv_CL
Knowledge
Pose
Text_Generation
Inference
Language_Model
PDF
2022-05-25
Understanding Natural Language in Context
Avichai Levy, Erez Karpas
arXiv_CL
arXiv_CL
Knowledge
Face
Language_Model
QA
PDF
2022-05-25
Large Language Models are Zero-Shot Clinical Information Extractors
Monica Agrawal, Stefan Hegselmann, Hunter Lang, Yoon Kim, David Sontag
arXiv_AI
arXiv_AI
Zero-Shot
Action
Few-Shot
Language_Model
PDF
2022-05-25
ProsocialDialog: A Prosocial Backbone for Conversational Agents
Hyunwoo Kim, Youngjae Yu, Liwei Jiang, Ximing Lu, Daniel Khashabi, Gunhee Kim, Yejin Choi, Maarten Sap
arXiv_CL
arXiv_CL
Detection
Language_Model
PDF
2022-05-25
ZeroGen$^+$: Self-Guided High-Quality Data Generation in Efficient Zero-Shot Learning
Jiahui Gao, Renjie Pi, Yong Lin, Hang Xu, Jiacheng Ye, Zhiyong Wu, Xiaodan Liang, Zhenguo Li, Lingpeng Kong
arXiv_CL
arXiv_CL
Zero-Shot
Text_Classification
Pose
Classification
Language_Model
PDF
2022-05-25
Language Anisotropic Cross-Lingual Model Editing
Yang Xu, Yutai Hou, Wanxiang Che
arXiv_CL
arXiv_CL
Knowledge
Pose
Language_Model
PDF
2022-05-25
Training Language Models with Memory Augmentation
Zexuan Zhong, Tao Lei, Danqi Chen
arXiv_CL
arXiv_CL
Knowledge
Language_Model
PDF
2022-05-25
Improving Zero and Few-shot Generalization in Dialogue through Instruction Tuning
Prakhar Gupta, Cathy Jiao, Yi-Ting Yeh, Shikib Mehri, Maxine Eskenazi, Jeffrey P. Bigham
arXiv_CL
arXiv_CL
Zero-Shot
Pose
Action
Detection
Few-Shot
Language_Model
PDF
2022-05-25
Discovering Language-neutral Sub-networks in Multilingual Language Models
Negar Foroutan, Mohammadreza Banaei, Remi Lebret, Antoine Bosselut, Karl Aberer
arXiv_CL
arXiv_CL
Bert
Language_Model
PDF
2022-05-25
LEPUS: Prompt-based Unsupervised Multi-hop Reranking for Open-domain QA
Muhammad Khalifa, Lajanugen Logeswaran, Moontae Lee, Honglak Lee, Lu Wang
arXiv_CL
arXiv_CL
Unsupervised
Language_Model
QA
PDF
2022-05-25
Investigating Lexical Replacements for Arabic-English Code-Switched Data Augmentation
Injy Hamed, Nizar Habash, Slim Abdennadher, Ngoc Thang Vu
arXiv_CL
arXiv_CL
Recognition
Speech
Pose
Speech_Recognition
Language_Model
PDF
2022-05-25
Multimodal Knowledge Alignment with Reinforcement Learning
Youngjae Yu, Jiwan Chung, Heeseung Yun, Jack Hessel, JaeSung Park, Ximing Lu, Prithviraj Ammanabrolu, Rowan Zellers, Ronan Le Bras, Gunhee Kim, Yejin Choi
arXiv_CV
arXiv_CV
Reinforcement_Learning
Zero-Shot
Optimization
Knowledge
Pose
Caption
Language_Model
PDF
2022-05-25
Are Large Pre-Trained Language Models Leaking Your Personal Information?
Jie Huang, Hanyin Shao, Kevin Chen-Chuan Chang
arXiv_AI
arXiv_AI
Pose
Language_Model
PDF
2022-05-25
Autoformalization with Large Language Models
Yuhuai Wu, Albert Q. Jiang, Wenda Li, Markus N. Rabe, Charles Staats, Mateja Jamnik, Christian Szegedy
arXiv_AI
arXiv_AI
Language_Model
PDF
2022-05-25
Intermediate Training on Question Answering Datasets Improves Generative Data Augmentation
Dheeraj Mekala, Tu Vu, Jingbo Shang
arXiv_CL
arXiv_CL
Zero-Shot
Classification
Sentiment
Few-Shot
Text_Generation
Language_Model
QA
PDF
2022-05-25
ORCA: Interpreting Prompted Language Models via Locating Supporting Data Evidence in the Ocean of Pretraining Data
Xiaochuang Han, Yulia Tsvetkov
arXiv_CL
arXiv_CL
Bert
Zero-Shot
Knowledge
Pose
Sentiment
Language_Model
PDF
2022-05-25
RobustLR: Evaluating Robustness to Logical Perturbation in Deductive Reasoning
Soumya Sanyal, Zeyi Liao, Xiang Ren
arXiv_CL
arXiv_CL
Transformer
Bert
Pose
Language_Model
PDF
2022-05-25
Heterogeneous Reservoir Computing Models for Persian Speech Recognition
Zohreh Ansari, Farzin Pourhoseini, Fatemeh Hadaeghi
arXiv_SD
arXiv_SD
Recognition
RNN
Knowledge
Speech
Pose
Speech_Recognition
Language_Model
PDF
2022-05-25
RSTGen: Imbuing Fine-Grained Interpretable Control into Long-FormText Generators
Rilwan A. Adewoyin, Ritabrata Dutta, Yulan He
arXiv_CL
arXiv_CL
Pose
Relation
Language_Model
PDF
2022-05-25
Perturbation Augmentation for Fairer NLP
Rebecca Qian, Candace Ross, Jude Fernandes, Eric Smith, Douwe Kiela, Adina Williams
arXiv_AI
arXiv_AI
Salient
Language_Model
PDF
2022-05-25
A Simple and Unified Tagging Model with Priming for Relational Structure Predictions
I-Hung Hsu, Kuan-Hao Huang, Shuning Zhang, Wenxin Cheng, Premkumar Natarajan, Kai-Wei Chang, Nanyun Peng
arXiv_AI
arXiv_AI
Pose
Action
Relation
Inference
Language_Model
Prediction
PDF
2022-05-25
Constrained Sampling from Language Models via Langevin Dynamics in Embedding Spaces
Sachin Kumar, Biswajit Paria, Yulia Tsvetkov
arXiv_CL
arXiv_CL
Embedding
Pose
Sentiment
Text_Generation
Language_Model
PDF
2022-05-25
RLPrompt: Optimizing Discrete Text Prompts With Reinforcement Learning
Mingkai Deng, Jianyu Wang, Cheng-Ping Hsieh, Yihan Wang, Han Guo, Tianmin Shu, Meng Song, Eric P. Xing, Zhiting Hu
arXiv_CL
arXiv_CL
Embedding
Unsupervised
Style_Transfer
Reinforcement_Learning
Bert
Optimization
Pose
Classification
Few-Shot
Language_Model
PDF
2022-05-25
ER-TEST: Evaluating Explanation Regularization Methods for NLP Models
Brihi Joshi, Aaron Chan, Ziyi Liu, Shaoliang Nie, Maziar Sanjabi, Hamed Firooz, Xiang Ren
arXiv_CL
arXiv_CL
Regularization
Pose
Language_Model
PDF
2022-05-25
Is a Question Decomposition Unit All We Need?
Pruthvi Patel, Swaroop Mishra, Mihir Parmar, Chitta Baral
arXiv_AI
arXiv_AI
Bert
Pose
Language_Model
PDF
2022-05-25
Segmenting Numerical Substitution Ciphers
Nada Aldarrab, Jonathan May
arXiv_CL
arXiv_CL
Segmentation
Pose
Language_Model
PDF
2022-05-25
Memorization in NLP Fine-tuning Methods
Fatemehsadat Mireshghallah, Archit Uniyal, Tianhao Wang, David Evans, Taylor Berg-Kirkpatrick
arXiv_CL
arXiv_CL
Action
Attention
Inference
Language_Model
PDF
2022-05-25
Teaching Broad Reasoning Skills via Decomposition-Guided Contexts
Harsh Trivedi, Niranjan Balasubramanian, Tushar Khot, Ashish Sabharwal
arXiv_AI
arXiv_AI
Language_Model
QA
PDF
2022-05-25
Fine-grained Contrastive Learning for Relation Extraction
William Hogan, Jiacheng Li, Jingbo Shang
arXiv_CL
arXiv_CL
Pose
Contrastive_Learning
Action
Relation
Relation_Extraction
Denoising
Language_Model
PDF
2022-05-25
Low Resource Style Transfer via Domain Adaptive Meta Learning
Xiangyang Li, Xiang Long, Yu Xia, Sujian Li
arXiv_AI
arXiv_AI
Unsupervised
Style_Transfer
Knowledge
Adversarial
Pose
Language_Model
PDF
2022-05-25
Learning a Better Initialization for Soft Prompts via Meta-Learning
Yukun Huang, Kun Qian, Zhou Yu
arXiv_CL
arXiv_CL
Unsupervised
Pose
Few-Shot
Language_Model
PDF
2022-05-25
Improving CTC-based ASR Models with Gated Interlayer Collaboration
Yuting Yang, Yuke Li, Binbin Du
arXiv_CL
arXiv_CL
Embedding
Recognition
Speech
Pose
Action
Speech_Recognition
Inference
Language_Model
PDF
2022-05-25
Know Where You're Going: Meta-Learning for Parameter-Efficient Fine-tuning
Mozhdeh Gheini, Xuezhe Ma, Jonathan May
arXiv_CL
arXiv_CL
Transfer_Learning
Optimization
Knowledge
Pose
Language_Model
PDF
2022-05-25
Sparse*BERT: Sparse Models are Robust
Daniel Campos, Alexandre Marques, Tuan Nguyen, Mark Kurtz, ChengXiang Zhai
arXiv_AI
arXiv_AI
Quantization
Bert
Sparse
Medical
Inference
Language_Model
PDF
2022-05-25
Towards Understanding Label Regularization for Fine-tuning Pre-trained Language Models
Ivan Kobyzev, Aref Jafari, Mehdi Rezagholizadeh, Tianda Li, Alan Do-Omri, Peng Lu, Ali Ghodsi, Pascal Poupart
arXiv_CL
arXiv_CL
Bert
Regularization
Knowledge
Language_Model
Prediction
PDF
2022-05-25
Counterfactual Data Augmentation improves Factuality of Abstractive Summarization
Dheeraj Rajagopal, Siamak Shakeri, Cicero Nogueira dos Santos, Eduard Hovy, Chung-Ching Chang
arXiv_CL
arXiv_CL
Summarization
Language_Model
PDF
2022-05-24
AdaMix: Mixture-of-Adapter for Parameter-efficient Tuning of Large Language Models
Yaqing Wang, Subhabrata Mukherjee, Xiaodong Liu, Jing Gao, Ahmed Hassan Awadallah, Jianfeng Gao
arXiv_AI
arXiv_AI
Transformer
Sparse
Pose
Few-Shot
Language_Model
PDF
2022-05-24
FLUTE: Figurative Language Understanding and Textual Explanations
Tuhin Chakrabarty, Arkadiy Saakyan, Debanjan Ghosh, Smaranda Muresan
arXiv_CL
arXiv_CL
Transformer
Relation
Inference
Language_Model
PDF
2022-05-24
MaskEval: Weighted MLM-Based Evaluation for Text Summarization and Simplification
Yu Lu Liu, Rachel Bawden, Thomas Scaliom, Benoît Sagot, Jackie Chi Kit Cheung
arXiv_CL
arXiv_CL
Relation
Attention
Summarization
Language_Model
PDF
2022-05-24
Continual-T0: Progressively Instructing 50+ Tasks to Language Models Without Forgetting
Thomas Scialom, Tuhin Chakrabarty, Smaranda Muresan
arXiv_CL
arXiv_CL
Zero-Shot
Knowledge
Language_Model
PDF
2022-05-24
Toxicity Detection with Generative Prompt-based Inference
Yau-Shian Wang, Yingshan Chang
arXiv_AI
arXiv_AI
Zero-Shot
Quantitative
Classification
Detection
Inference
Language_Model
PDF
2022-05-24
K-12BERT: BERT for K-12 education
Vasu Goel, Dhruv Sahnan, Venktesh V, Gaurav Sharma, Deep Dwivedi, Mukesh Mohania
arXiv_CL
arXiv_CL
Bert
Knowledge
Pose
Language_Model
PDF
2022-05-24
Garden-Path Traversal within GPT-2
William Jurayj, William Rudman, Carsten Eickhoff
arXiv_CL
arXiv_CL
Transformer
Bert
Language_Model
PDF
2022-05-24
History Compression via Language Models in Reinforcement Learning
Fabian Paischer, Thomas Adler, Vihang Patil, Angela Bitto-Nemling, Markus Holzleitner, Sebastian Lehner, Hamid Eghbal-zadeh, Sepp Hochreiter
arXiv_CL
arXiv_CL
Transformer
Embedding
Reinforcement_Learning
Pose
Language_Model
PDF
2022-05-24
TALM: Tool Augmented Language Models
Aaron Parisi, Yao Zhao, Noah Fiedel
arXiv_AI
arXiv_AI
Transformer
Knowledge
Inference
Language_Model
QA
PDF
2022-05-24
Evaluating the Impact of Model Scale for Compositional Generalization in Semantic Parsing
Linlu Qiu, Peter Shaw, Panupong Pasupat, Tianze Shi, Jonathan Herzig, Emily Pitler, Fei Sha, Kristina Toutanova
arXiv_CL
arXiv_CL
Transfer_Learning
Language_Model
PDF
2022-05-24
GeoMLAMA: Geo-Diverse Commonsense Probing on Multilingual Pre-Trained Language Models
Da Yin, Hritik Bansal, Masoud Monajatipoor, Liunian Harold Li, Kai-Wei Chang
arXiv_CL
arXiv_CL
Bert
Knowledge
Relation
Language_Model
PDF
2022-05-24
Chunk-based Nearest Neighbor Machine Translation
Pedro Henrique Martins, Zita Marinho, André F. T. Martins
arXiv_CL
arXiv_CL
Pose
Language_Model
PDF
2022-05-24
PoeLM: A Meter- and Rhyme-Controllable Language Model for Unsupervised Poetry Generation
Aitor Ormazabal, Mikel Artetxe, Manex Agirrezabal, Aitor Soroa, Eneko Agirre
arXiv_AI
arXiv_AI
Transformer
Unsupervised
Pose
Inference
Language_Model
PDF
2022-05-24
Learning for Expressive Task-Related Sentence Representations
Xueying Bai, Jinghuan Shang, Yifan Sun, Niranjan Balasubramanian
arXiv_AI
arXiv_AI
Regularization
Pose
Classification
Attention
Language_Model
Prediction
PDF
2022-05-24
The Curious Case of Control
Elias Stengel-Eskin, Benjamin Van Durme
arXiv_CL
arXiv_CL
Relation
Language_Model
PDF
2022-05-24
Analysing the Greek Parliament Records with Emotion Classification
John Pavlopoulos, Vanessa Lislevand
arXiv_CL
arXiv_CL
Transformer
Speech
Emotion
Classification
Sentiment
Language_Model
PDF
2022-05-24
Multi-Level Modeling Units for End-to-End Mandarin Speech Recognition
Yuting Yang, Binbin Du, Yuke Li
arXiv_CL
arXiv_CL
Transformer
Recognition
Speech
Speech_Recognition
Inference
Language_Model
PDF
2022-05-24
Attentional Mixtures of Soft Prompt Tuning for Parameter-efficient Multi-task Knowledge Sharing
Akari Asai, Mohammadreza Salehi, Matthew E. Peters, Hannaneh Hajishirzi
arXiv_CL
arXiv_CL
Knowledge
Attention
Language_Model
PDF
2022-05-24
Large Language Models are Zero-Shot Reasoners
Takeshi Kojima, Shixiang Shane Gu, Machel Reid, Yutaka Matsuo, Yusuke Iwasawa
arXiv_AI
arXiv_AI
Tracking
Zero-Shot
Knowledge
Few-Shot
Language_Model
PDF
2022-05-24
Lutma: a Frame-Making Tool for Collaborative FrameNet Development
Tiago Timponi Torrent, Arthur Lorenzi, Ely Edison da Silva Matos, Frederico Belcavello, Marcelo Viridiano, Maucha Andrade Gamonal
arXiv_CL
arXiv_CL
Language_Model
PDF
2022-05-24
Maieutic Prompting: Logically Consistent Reasoning with Recursive Explanations
Jaehun Jung, Lianhui Qin, Sean Welleck, Faeze Brahman, Chandra Bhagavatula, Ronan Le Bras, Yejin Choi
arXiv_CL
arXiv_CL
Unsupervised
Relation
Inference
Language_Model
QA
PDF
2022-05-24
Formulating Few-shot Fine-tuning Towards Language Model Pre-training: A Pilot Study on Named Entity Recognition
Zihan Wang, Kewen Zhao, Zilong Wang, Jingbo Shang
arXiv_AI
arXiv_AI
Recognition
Bert
Pose
Few-Shot
Language_Model
Prediction
PDF
2022-05-24
Analyzing the Mono- and Cross-Lingual Pretraining Dynamics of Multilingual Language Models
Terra Blevins, Hila Gonen, Luke Zettlemoyer
arXiv_CL
arXiv_CL
Language_Model
PDF
2022-05-24
BabyBear: Cheap inference triage for expensive language models
Leila Khalili, Yao You, John Bohannon
arXiv_CL
arXiv_CL
Transformer
Recognition
Classification
Deep_Learning
Inference
Language_Model
Prediction
PDF
2022-05-24
PERT: A New Solution to Pinyin to Character Conversion Task
Jinghui Xiao, Qun Liu, Xin Jiang, Yuanfeng Xiong, Haiteng Wu, Zhe Zhang
arXiv_AI
arXiv_AI
Transformer
RNN
Language_Model
PDF
2022-05-24
On the Role of Bidirectionality in Language Model Pre-Training
Mikel Artetxe, Jingfei Du, Naman Goyal, Luke Zettlemoyer, Ves Stoyanov
arXiv_AI
arXiv_AI
Bert
Zero-Shot
Pose
Attention
Language_Model
Prediction
PDF
2022-05-24
On Advances in Text Generation from Images Beyond Captioning: A Case Study in Self-Rationalization
Shruti Palaskar, Akshita Bhagia, Yonatan Bisk, Florian Metze, Alan W Black, Ana Marasovic
arXiv_CV
arXiv_CV
Image_Caption
Action
VQA
Attention
Text_Generation
Caption
Language_Model
QA
PDF
2022-05-23
Penguins Don't Fly: Reasoning about Generics through Instantiations and Exceptions
Emily Allaway, Jena D. Hwang, Chandra Bhagavatula, Kathleen McKeown, Doug Downey, Yejin Choi
arXiv_CL
arXiv_CL
Knowledge
Few-Shot
Inference
Language_Model
PDF
2022-05-23
FlexiBERT: Are Current Transformer Architectures too Homogeneous and Rigid?
Shikhar Tuli, Bhishma Dedhia, Shreshth Tuli, Niraj K. Jha
arXiv_CL
arXiv_CL
Transformer
NAS
Embedding
Bert
Optimization
Pose
Language_Model
PDF
2022-05-23
On Measuring Social Biases in Prompt-Based Multi-Task Learning
Afra Feyza Akyürek, Sejin Paik, Muhammed Yusuf Kocyigit, Seda Akbiyik, Şerife Leman Runyun, Derry Wijaya
arXiv_CL
arXiv_CL
Inference
Language_Model
PDF
2022-05-23
Improving language models fine-tuning with representation consistency targets
Anastasia Razdaibiedina, Vivek Madan, Zohar Karnin, Ashish Khetan, Vishaal Kapoor
arXiv_CL
arXiv_CL
Regularization
Pose
Language_Model
PDF
2022-05-23
Challenges in Measuring Bias via Open-Ended Language Generation
Afra Feyza Akyürek, Muhammed Yusuf Kocyigit, Sejin Paik, Derry Wijaya
arXiv_CL
arXiv_CL
Pose
Language_Model
Recommendation
PDF
2022-05-23
Simple Recurrence Improves Masked Language Models
Tao Lei, Ran Tian, Jasmijn Bastings, Ankur P. Parikh
arXiv_AI
arXiv_AI
Transformer
Bert
Optimization
Language_Model
PDF
2022-05-23
What Makes Data-to-Text Generation Hard for Pretrained Language Models?
Moniba Keymanesh, Adrian Benton, Mark Dredze
arXiv_AI
arXiv_AI
Knowledge
Relation
Few-Shot
Text_Generation
Language_Model
PDF
2022-05-23
Prompt-and-Rerank: A Method for Zero-Shot and Few-Shot Arbitrary Textual Style Transfer with Small Language Models
Mirac Suzgun, Luke Melas-Kyriazi, Dan Jurafsky
arXiv_CL
arXiv_CL
Style_Transfer
Zero-Shot
Pose
Few-Shot
Language_Model
PDF
2022-05-23
Photorealistic Text-to-Image Diffusion Models with Deep Language Understanding
Chitwan Saharia, William Chan, Saurabh Saxena, Lala Li, Jay Whang, Emily Denton, Seyed Kamyar Seyed Ghasemipour, Burcu Karagol Ayan, S. Sara Mahdavi, Rapha Gontijo Lopes, Tim Salimans, Jonathan Ho, David J Fleet, Mohammad Norouzi
arXiv_CV
arXiv_CV
Transformer
GAN
Language_Model
PDF
2022-05-23
Towards Automated Document Revision: Grammatical Error Correction, Fluency Edits, and Beyond
Masato Mita, Keisuke Sakaguchi, Masato Hagiwara, Tomoya Mizumoto, Jun Suzuki, Kentaro Inui
arXiv_CL
arXiv_CL
Language_Model
PDF
2022-05-23
Tracing Knowledge in Language Models Back to the Training Data
Ekin Akyürek, Tolga Bolukbasi, Frederick Liu, Binbin Xiong, Ian Tenney, Jacob Andreas, Kelvin Guu
arXiv_CL
arXiv_CL
Embedding
Knowledge
Classification
Language_Model
Prediction
PDF
2022-05-23
Context Limitations Make Neural Language Models More Human-Like
Tatsuki Kuribayashi, Yohei Oseki, Ana Brassard, Kentaro Inui
arXiv_CL
arXiv_CL
Language_Model
PDF
2022-05-23
QASem Parsing: Text-to-text Modeling of QA-based Semantics
Ayal Klein, Eran Hirsch, Ron Eliav, Valentina Pyatkin, Avi Caciularu, Ido Dagan
arXiv_CL
arXiv_CL
Pose
Relation
Language_Model
QA
PDF
2022-05-23
Many-Class Text Classification with Matching
Yi Song, Yuxian Gu, Minlie Huang
arXiv_CL
arXiv_CL
Text_Classification
Pose
Classification
Few-Shot
Language_Model
Matching
PDF
2022-05-23
StreamingQA: A Benchmark for Adaptation to New Knowledge over Time in Question Answering Models
Adam Liška, Tomáš Kočiský, Elena Gribovskaya, Tayfun Terzi, Eren Sezener, Devang Agrawal, Cyprien de Masson d'Autume, Tim Scholtes, Manzil Zaheer, Susannah Young, Ellen Gilsenan-McMahon, Sophia Austin, Phil Blunsom, Angeliki Lazaridou
arXiv_CL
arXiv_CL
Knowledge
Language_Model
QA
PDF
2022-05-23
Outliers Dimensions that Disrupt Transformers Are Driven by Frequency
Giovanni Puccetti, Anna Rogers, Aleksandr Drozd, Felice Dell'Orletta
arXiv_AI
arXiv_AI
Transformer
Embedding
Bert
Relation
Attention
Language_Model
PDF
2022-05-23
Looking for a Handsome Carpenter! Debiasing GPT-3 Job Advertisements
Conrad Borchers, Dalia Sara Gala, Benjamin Gilburt, Eduard Oravkin, Wilfried Bounsi, Yuki M. Asano, Hannah Rose Kirk
arXiv_AI
arXiv_AI
Zero-Shot
Language_Model
PDF
2022-05-23
ScholarBERT: Bigger is Not Always Better
Zhi Hong, Aswathy Ajith, Gregory Pauloski, Eamon Duede, Carl Malamud, Roger Magoulas, Kyle Chard, Ian Foster
arXiv_CL
arXiv_CL
Transformer
Bert
Language_Model
PDF
2022-05-23
KOLD: Korean Offensive Language Dataset
Younghoon Jeong, Juhyun Oh, Jaimeen Ahn, Jongwon Lee, Jihyung Mon, Sungjoon Park, Alice Oh
arXiv_AI
arXiv_AI
Speech
Detection
Attention
Language_Model
PDF
2022-05-23
Sample Efficient Approaches for Idiomaticity Detection
Dylan Phelps, Xuan-Rui Fan, Edward Gow-Smith, Harish Tayyar Madabushi, Carolina Scarton, Aline Villavicencio
arXiv_CL
arXiv_CL
Transformer
Embedding
Bert
Classification
Detection
Few-Shot
Language_Model
PDF
2022-05-23
BBTv2: Pure Black-Box Optimization Can Be Comparable to Gradient Descent for Few-Shot Learning
Tianxiang Sun, Zhengfu He, Hong Qian, Xuanjing Huang, Xipeng Qiu
arXiv_AI
arXiv_AI
Embedding
Gradient_Descent
Optimization
Pose
Classification
Few-Shot
Language_Model
PDF
2022-05-23
UnifieR: A Unified Retriever for Large-Scale Retrieval
Tao Shen, Xiubo Geng, Chongyang Tao, Can Xu, Kai Zhang, Daxin Jiang
arXiv_CL
arXiv_CL
Represenation_Learning
Pose
Language_Model
PDF
2022-05-23
PEVL: Position-enhanced Pre-training and Prompt Tuning for Vision-language Models
Yuan Yao, Qianyu Chen, Ao Zhang, Wei Ji, Zhiyuan Liu, Tat-Seng Chua, Maosong Sun
arXiv_AI
arXiv_AI
Detection
Object_Detection
Language_Model
PDF
2022-05-23
Prompt Tuning for Discriminative Pre-trained Language Models
Yuan Yao, Bowen Dong, Ao Zhang, Zhengyan Zhang, Ruobing Xie, Zhiyuan Liu, Leyu Lin, Maosong Sun, Jianyong Wang
arXiv_AI
arXiv_AI
Bert
Text_Classification
Knowledge
Classification
Language_Model
PDF
2022-05-23
Supporting Vision-Language Model Inference with Causality-pruning Knowledge Prompt
Jiangmeng Li, Wenyi Mo, Wenwen Qiang, Bing Su, Changwen Zheng
arXiv_CV
arXiv_CV
Recognition
Zero-Shot
Knowledge
Knowledge_Graph
Pose
Classification
Inference
Language_Model
PDF
2022-05-23
BanglaNLG: Benchmarks and Resources for Evaluating Low-Resource Natural Language Generation in Bangla
Abhik Bhattacharjee, Tahmid Hasan, Wasi Uddin Ahmad, Rifat Shahriyar
arXiv_CL
arXiv_CL
Transformer
Text_Generation
Language_Model
PDF
2022-05-23
TempLM: Distilling Language Models into Template-Based Generators
Tianyi Zhang, Mina Lee, Lisa Li, Ende Shen, Tatsunori B. Hashimoto
arXiv_CL
arXiv_CL
Bert
Pose
Text_Generation
Language_Model
PDF
2022-05-23
Vector-Quantized Input-Contextualized Soft Prompts for Natural Language Understanding
Rishabh Bhardwaj, Amrita Saha, Steven C.H. Hoi
arXiv_CL
arXiv_CL
Quantization
Pose
Classification
Relation
Language_Model
QA
PDF
2022-05-23
Artificial intelligence for topic modelling in Hindu philosophy: mapping themes between the Upanishads and the Bhagavad Gita
Rohitash Chandra, Mukul Ranjan
arXiv_CL
arXiv_CL
Embedding
Bert
Deep_Learning
Language_Model
PDF
2022-05-23
Parameter-Efficient Sparsity for Large Language Models Fine-Tuning
Yuchao Li, Fuli Luo, Chuanqi Tan, Mengdi Wang, Songfang Huang, Shen Li, Junjie Bai
arXiv_AI
arXiv_AI
Bert
Sparse
Pose
Language_Model
PDF
2022-05-23
Improving Short Text Classification With Augmented Data Using GPT-3
Salvador Balkus, Donghui Yan
arXiv_CL
arXiv_CL
Text_Classification
Pose
Classification
Language_Model
PDF
2022-05-22
The Geometry of Multilingual Language Model Representations
Tyler A. Chang, Zhuowen Tu, Benjamin K. Bergen
arXiv_CL
arXiv_CL
Transfer_Learning
Speech
Language_Model
Prediction
PDF
2022-05-22
Thor: Wielding Hammers to Integrate Language Models and Automated Theorem Provers
Albert Q. Jiang, Wenda Li, Szymon Tworkowski, Konrad Czechowski, Tomasz Odrzygóźdź, Piotr Miłoś, Yuhuai Wu, Mateja Jamnik
arXiv_AI
arXiv_AI
Language_Model
PDF
2022-05-22
Instruction Induction: From Few Examples to Natural Language Task Descriptions
Or Honovich, Uri Shaham, Samuel R. Bowman, Omer Levy
arXiv_CL
arXiv_CL
Language_Model
PDF
2022-05-22
Memorization Without Overfitting: Analyzing the Training Dynamics of Large Language Models
Kushal Tirumala, Aram H. Markosyan, Luke Zettlemoyer, Armen Aghajanyan
arXiv_CL
arXiv_CL
Speech
Language_Model
PDF
2022-05-22
Language Models with Image Descriptors are Strong Few-Shot Video-Language Learners
Zhenhailong Wang, Manling Li, Ruochen Xu, Luowei Zhou, Jie Lei, Xudong Lin, Shuohang Wang, Ziyi Yang, Chenguang Zhu, Derek Hoiem, Shih-Fu Chang, Mohit Bansal, Heng Ji
arXiv_AI
arXiv_AI
Recognition
Video_Caption
Speech
Pose
Few-Shot
Speech_Recognition
Caption
Language_Model
Prediction
PDF
2022-05-22
Do Deep Learning Models and News Headlines Outperform Conventional Prediction Techniques on Forex Data?
Sucharita Atha, Bharath Kumar Bolla
arXiv_AI
arXiv_AI
Embedding
Bert
RNN
Deep_Learning
Sentiment
Language_Model
Prediction
PDF
2022-05-22
Housekeep: Tidying Virtual Households using Commonsense Reasoning
Yash Kant, Arun Ramachandran, Sriram Yenamandra, Igor Gilitschenski, Dhruv Batra, Andrew Szot, Harsh Agrawal
arXiv_CV
arXiv_CV
Pose
Language_Model
PDF
2022-05-22
Phrase-level Textual Adversarial Attack with Label Preservation
Yibin Lei, Yu Cao, Dianqi Li, Tianyi Zhou, Meng Fang, Mykola Pechenizkiy
arXiv_AI
arXiv_AI
Adversarial
Pose
Language_Model
PDF
2022-05-21
Revisiting Pre-trained Language Models and their Evaluation for Arabic Natural Language Understanding
Abbas Ghaddar, Yimeng Wu, Sunyam Bagga, Ahmad Rashid, Khalil Bibi, Mehdi Rezagholizadeh, Chao Xing, Yasheng Wang, Duan Xinyu, Zhefeng Wang, Baoxing Huai, Xin Jiang, Qun Liu, Philippe Langlais
arXiv_CL
arXiv_CL
Bert
Language_Model
PDF
2022-05-21
An Empirical Investigation of Commonsense Self-Supervision with Knowledge Graphs
Jiarui Zhang, Filip Ilievski, Kaixin Ma, Jonathan Francis, Alessandro Oltramari
arXiv_AI
arXiv_AI
Zero-Shot
Knowledge
Knowledge_Graph
Language_Model
PDF
2022-05-21
Least-to-Most Prompting Enables Complex Reasoning in Large Language Models
Denny Zhou, Nathanael Schärli, Le Hou, Jason Wei, Nathan Scales, Xuezhi Wang, Dale Schuurmans, Olivier Bousquet, Quoc Le, Ed Chi
arXiv_AI
arXiv_AI
Pose
Language_Model
PDF
2022-05-21
Few-Shot Natural Language Inference Generation with PDD: Prompt and Dynamic Demonstration
Kaijian Li, Shansan Gong, Kenny Q. Zhu
arXiv_AI
arXiv_AI
Pose
Classification
Relation
Few-Shot
Text_Generation
Inference
Language_Model
PDF
2022-05-21
HLATR: Enhance Multi-stage Text Retrieval with Hybrid List Aware Transformer Reranking
Yanzhao Zhang, Dingkun Long, Guangwei Xu, Pengjun Xie
arXiv_CL
arXiv_CL
Transformer
Bert
Optimization
Language_Model
PDF
2022-05-21
Scenario-based Multi-product Advertising Copywriting Generation for E-Commerce
Xueying Zhang, Kai Shen, Chi Zhang, Xiaochuan Fan, Yun Xiao, Zhen He, Bo Long, Lingfei Wu
arXiv_AI
arXiv_AI
Enhancement
Knowledge
Pose
Language_Model
Prediction
Recommendation
PDF
2022-05-21
Pre-training Data Quality and Quantity for a Low-Resource Language: New Corpus and BERT Models for Maltese
Kurt Micallef, Albert Gatt, Marc Tanti, Lonneke van der Plas, Claudia Borg
arXiv_CL
arXiv_CL
Recognition
Bert
Speech
Action
Classification
Sentiment
Language_Model
PDF
2022-05-21
Scaling Laws and Interpretability of Learning from Repeated Data
Danny Hernandez, Tom Brown, Tom Conerly, Nova DasSarma, Dawn Drain, Sheer El-Showk, Nelson Elhage, Zac Hatfield-Dodds, Tom Henighan, Tristan Hume, Scott Johnston, Ben Mann, Chris Olah, Catherine Olsson, Dario Amodei, Nicholas Joseph, Jared Kaplan, Sam McCandlish
arXiv_AI
arXiv_AI
Pose
Action
Language_Model
PDF
2022-05-21
DeepStruct: Pretraining of Language Models for Structure Prediction
Chenguang Wang, Xiao Liu, Zui Chen, Haoyun Hong, Jie Tang, Dawn Song
arXiv_AI
arXiv_AI
Tracking
Recognition
Zero-Shot
Knowledge
Action
Classification
Detection
Relation
Relation_Extraction
Language_Model
Prediction
PDF
2022-05-20
Forecasting COVID-19 Caseloads Using Unsupervised Embedding Clusters of Social Media Posts
Felix Drinkall, Stefan Zohren, Janet B. Pierrehumbert
arXiv_CL
arXiv_CL
Transformer
Embedding
Tracking
Unsupervised
Classification
Language_Model
PDF
2022-05-20
Multi2WOZ: A Robust Multilingual Dataset and Conversational Pretraining for Task-Oriented Dialog
Chia-Chien Hung, Anne Lauscher, Ivan Vulić, Simone Paolo Ponzetto, Goran Glavaš
arXiv_CL
arXiv_CL
Tracking
Zero-Shot
Few-Shot
Language_Model
PDF
2022-05-20
Multilingual Normalization of Temporal Expressions with Masked Language Models
Lukas Lange, Jannik Strötgen, Heike Adel, Dietrich Klakow
arXiv_CL
arXiv_CL
Pose
Detection
Language_Model
PDF
2022-05-20
UViM: A Unified Modeling Approach for Vision with Learned Guiding Codes
Alexander Kolesnikov, André Susano Pinto, Lucas Beyer, Xiaohua Zhai, Jeremiah Harmsen, Neil Houlsby
arXiv_CV
arXiv_CV
Segmentation
Language_Model
Prediction
PDF
2022-05-20
Heterformer: A Transformer Architecture for Node Representation Learning on Heterogeneous Text-Rich Networks
Bowen Jin, Yu Zhang, Qi Zhu, Jiawei Han
arXiv_CL
arXiv_CL
Transformer
Enhancement
Represenation_Learning
Pose
Classification
Attention
Language_Model
Prediction
PDF
2022-05-20
Progressive Class Semantic Matching for Semi-supervised Text Classification
Hai-Ming Xu, Lingqiao Liu, Ehsan Abbasnejad
arXiv_AI
arXiv_AI
Bert
Text_Classification
Pose
Classification
Language_Model
Matching
PDF
2022-05-20
Prototypical Calibration for Few-shot Learning of Language Models
Zhixiong Han, Yaru Hao, Li Dong, Furu Wei
arXiv_CL
arXiv_CL
Pose
Classification
Few-Shot
Language_Model
Prediction
Matching
PDF
2022-05-20
Visually-Augmented Language Modeling
Weizhi Wang, Li Dong, Hao Cheng, Haoyu Song, Xiaodong Liu, Xifeng Yan, Jianfeng Gao, Furu Wei
arXiv_CL
arXiv_CL
Image_Retrieval
Knowledge
Self-Supervised
Pose
Language_Model
PDF
2022-05-20
Exploring Extreme Parameter Compression for Pre-trained Language Models
Yuxin Ren, Benyou Wang, Lifeng Shang, Xin Jiang, Qun Liu
arXiv_CL
arXiv_CL
Transformer
Reconstruction
Embedding
Bert
Knowledge
Pose
Attention
Inference
Language_Model
PDF
2022-05-20
MPI: Evaluating and Inducing Personality in Pre-trained Language Models
Guangyuan Jiang, Manjie Xu, Song-Chun Zhu, Wenjuan Han, Chi Zhang, Yixin Zhu
arXiv_AI
arXiv_AI
Pose
Language_Model
PDF
2022-05-20
KERPLE: Kernelized Relative Positional Embedding for Length Extrapolation
Ta-Chung Chi, Ting-Han Fan, Peter J. Ramadge, Alexander I. Rudnicky
arXiv_CL
arXiv_CL
Embedding
Pose
Attention
Language_Model
PDF
2022-05-19
Automated Scoring for Reading Comprehension via In-context BERT Tuning
Nigel Fernandez, Aritra Ghosh, Naiming Liu, Zichao Wang, Benoît Choffin, Richard Baraniuk, Andrew Lan
arXiv_AI
arXiv_AI
Bert
Language_Model
PDF
2022-05-19
RankGen: Improving Text Generation with Large Ranking Models
Kalpesh Krishna, Yapei Chang, John Wieting, Mohit Iyyer
arXiv_CL
arXiv_CL
Contrastive_Learning
Text_Generation
Language_Model
PDF
2022-05-19
Selection-Inference: Exploiting Large Language Models for Interpretable Logical Reasoning
Antonia Creswell, Murray Shanahan, Irina Higgins
arXiv_AI
arXiv_AI
Pose
Few-Shot
Inference
Language_Model
PDF
2022-05-19
PLAID: An Efficient Engine for Late Interaction Retrieval
Keshav Santhanam, Omar Khattab, Christopher Potts, Matei Zaharia
arXiv_CL
arXiv_CL
Bert
Action
Language_Model
PDF
2022-05-19
Self-augmented Data Selection for Few-shot Dialogue Generation
Wanyu Du, Hanjie Chen, Yangfeng Ji
arXiv_CL
arXiv_CL
Pose
Face
Action
Few-Shot
Text_Generation
Language_Model
PDF
2022-05-19
Great Power, Great Responsibility: Recommendations for Reducing Energy for Training Language Models
Joseph McDonald, Baolin Li, Nathan Frey, Devesh Tiwari, Vijay Gadepally, Siddharth Samsi
arXiv_AI
arXiv_AI
Transformer
Inference
Language_Model
Recommendation
PDF
2022-05-19
Automatic Spoken Language Identification using a Time-Delay Neural Network
Benjamin Kepecs, Homayoon Beigi
arXiv_CL
arXiv_CL
Recognition
Speech
Speech_Recognition
Language_Model
PDF
2022-05-19
Nebula-I: A General Framework for Collaboratively Training Deep Learning Models on Low-Bandwidth Cloud Clusters
Yang Xiang, Zhihua Wu, Weibao Gong, Siyu Ding, Xianjie Mo, Yuang Liu, Shuohuan Wang, Peng Liu, Yongshuai Hou, Long Li, Bin Wang, Shaohuai Shi, Yaqian Han, Yue Yu, Ge Li, Yu Sun, Yanjun Ma, Dianhai Yu
arXiv_AI
arXiv_AI
Knowledge
Pose
Face
Deep_Learning
Inference
Language_Model
PDF
2022-05-19
Transformers as Neural Augmentors: Class Conditional Sentence Generation via Variational Bayes
M. Şafak Bilici, Mehmet Fatih Amasyali
arXiv_CL
arXiv_CL
Transformer
Pose
Language_Model
PDF
2022-05-19
Are Prompt-based Models Clueless?
Pride Kavumba, Ryo Takahashi, Yasuke Oda
arXiv_CL
arXiv_CL
Few-Shot
Language_Model
PDF
2022-05-18
PromptDA: Label-guided Data Augmentation for Prompt-based Few Shot Learners
Canyu Chen, Kai Shu
arXiv_AI
arXiv_AI
Text_Classification
Pose
Classification
Few-Shot
Language_Model
PDF
2022-05-18
Entailment Tree Explanations via Iterative Retrieval-Generation Reasoner
Danilo Ribeiro, Shen Wang, Xiaofei Ma, Rui Dong, Xiaokai Wei, Henry Zhu, Xinchi Chen, Zhiheng Huang, Peng Xu, Andrew Arnold, Dan Roth
arXiv_CL
arXiv_CL
Pose
Language_Model
QA
PDF
2022-05-18
'I'm sorry to hear that': finding bias in language models with a holistic descriptor dataset
Eric Michael Smith, Melissa Hall Melanie Kambadur, Eleonora Presani, Adina Williams (Meta AI)
arXiv_CL
arXiv_CL
Pose
Language_Model
PDF
2022-05-18
ERNIE-Search: Bridging Cross-Encoder with Dual-Encoder via Self On-the-fly Distillation for Dense Passage Retrieval
Yuxiang Lu, Yiding Liu, Jiaxiang Liu, Yunsheng Shi, Zhengjie Huang, Shikun Feng Yu Sun, Hao Tian, Hua Wu, Shuaiqiang Wang, Dawei Yin, Haifeng Wang
arXiv_CL
arXiv_CL
Bert
Knowledge
Pose
Action
Language_Model
QA
PDF
2022-05-18
Minimising Biasing Word Errors for Contextual ASR with the Tree-Constrained Pointer Generator
Guangzhi Sun, Chao Zhang, Philip C Woodland
arXiv_CL
arXiv_CL
Tracking
Recognition
Zero-Shot
Knowledge
Speech
Pose
Ontology
Speech_Recognition
Language_Model
PDF
2022-05-18
GPoeT-2: A GPT-2 Based Poem Generator
Kai-Ling Lo, Rami Ariss, Philipp Kurz
arXiv_AI
arXiv_AI
Language_Model
PDF
2022-05-18
LogiGAN: Learning Logical Reasoning via Adversarial Pre-training
Xinyu Pi, Wanjun Zhong, Yan Gao, Nan Duan, Jian-Guang Lou
arXiv_CL
arXiv_CL
Unsupervised
Adversarial
Detection
GAN
Language_Model
PDF
2022-05-17
AvatarCLIP: Zero-Shot Text-Driven Generation and Animation of 3D Avatars
Fangzhou Hong, Mingyuan Zhang, Liang Pan, Zhongang Cai, Lei Yang, Ziwei Liu
arXiv_CV
arXiv_CV
OCR
3D
Zero-Shot
Knowledge
Pose
Quantitative
Language_Model
PDF
2022-05-17
Recovering Private Text in Federated Learning of Language Models
Samyak Gupta, Yangsibo Huang, Zexuan Zhong, Tianyu Gao, Kai Li, Danqi Chen
arXiv_CL
arXiv_CL
Knowledge
Language_Model
PDF
2022-05-17
Feature Aggregation in Zero-Shot Cross-Lingual Transfer Using Multilingual BERT
Beiduo Chen, Wu Guo, Quan Liu, Kun Tao
arXiv_CL
arXiv_CL
Transformer
Recognition
Bert
Zero-Shot
Pose
Attention
Language_Model
PDF
2022-05-17
SKILL: Structured Knowledge Infusion for Large Language Models
Fedor Moiseev, Zhe Dong, Enrique Alfonseca, Martin Jaggi
arXiv_AI
arXiv_AI
Knowledge
Knowledge_Graph
Pose
Language_Model
QA
PDF
2022-05-16
CascadER: Cross-Modal Cascading for Knowledge Graph Link Prediction
Tara Safavi, Doug Downey, Tom Hope
arXiv_AI
arXiv_AI
Embedding
Knowledge
Knowledge_Graph
Pose
Language_Model
Prediction
PDF
2022-05-16
A Precis of Language Models are not Models of Language
Csaba Veres
arXiv_CL
arXiv_CL
Language_Model
PDF
2022-05-16
Heroes, Villains, and Victims, and GPT-3 -- Automated Extraction of Character Roles Without Training Data
Dominik Stammbach, Maria Antoniak, Elliott Ash
arXiv_CL
arXiv_CL
Zero-Shot
Speech
Action
Language_Model
PDF
2022-05-16
Prompting to Distill: Boosting Data-Free Knowledge Distillation via Reinforced Prompt
Xinyin Ma, Xinchao Wang, Gongfan Fang, Yongliang Shen, Weiming Lu
arXiv_CL
arXiv_CL
Reconstruction
Knowledge
Pose
Language_Model
PDF
2022-05-16
What GPT Knows About Who is Who
Xiaohan Yang, Eduardo Peynetti, Vasco Meerman, Chris Tanner
arXiv_CL
arXiv_CL
Language_Model
QA
PDF
2022-05-15
SeqZero: Few-shot Compositional Semantic Parsing with Sequential Prompts and Zero-shot Models
Jingfeng Yang, Haoming Jiang, Qingyu Yin, Danqing Zhang, Bing Yin, Diyi Yang
arXiv_CL
arXiv_CL
Zero-Shot
Knowledge
Pose
Few-Shot
Language_Model
PDF
2022-05-15
TiBERT: Tibetan Pre-trained Language Model
Yuan Sun, Sisi Liu, Junjie Deng, Xiaobing Zhao
arXiv_AI
arXiv_AI
Bert
Text_Classification
Classification
Language_Model
PDF
2022-05-15
Classifiers are Better Experts for Controllable Text Generation
Askhat Sitdikov, Nikita Balagansky, Daniil Gavrilov, Alexander Markov
arXiv_CL
arXiv_CL
Pose
Sentiment
Text_Generation
Language_Model
Prediction
PDF
2022-05-15
Mitigating Toxic Degeneration with Empathetic Data: Exploring the Relationship Between Toxicity and Empathy
Allison Lahnala, Charles Welch, Béla Neuendorf, Lucie Flek
arXiv_AI
arXiv_AI
Emotion
Relation
Text_Generation
Language_Model
PDF
2022-05-15
Fine-tuning Pre-trained Language Models for Few-shot Intent Detection: Supervised Pre-training and Isotropization
Haode Zhang, Haowen Liang, Yuwei Zhang, Liming Zhan, Xiao-Ming Wu, Xiaolei Lu, Albert Y.S. Lam
arXiv_CL
arXiv_CL
Pose
Contrastive_Learning
Detection
Relation
Few-Shot
Language_Model
PDF
2022-05-14
What do Models Learn From Training on More Than Text? Measuring Visual Commonsense Knowledge
Lovisa Hagström, Richard Johansson
arXiv_CL
arXiv_CL
Knowledge
Language_Model
PDF
2022-05-13
A Property Induction Framework for Neural Language Models
Kanishka Misra, Julia Taylor Rayz, Allyson Ettinger
arXiv_CL
arXiv_CL
Knowledge
GAN
Language_Model
PDF
2022-05-13
Bootstrapping Text Anonymization Models with Distant Supervision
Anthi Papadopoulou, Pierre Lison, Lilja Øvrelid, Ildikó Pilán
arXiv_CL
arXiv_CL
Bert
Knowledge
Knowledge_Graph
Pose
Language_Model
PDF
2022-05-13
PathologyBERT -- Pre-trained Vs. A New Transformer Language Model for Pathology Domain
Thiago Santos, Amara Tariq, Susmita Das, Kavyasree Vayalpati, Geoffrey H. Smith, Hari Trivedi, Imon Banerjee
arXiv_CL
arXiv_CL
Transformer
Surveillance
Bert
Pose
Face
Classification
Language_Model
PDF
2022-05-13
Improving the Numerical Reasoning Skills of Pretrained Language Models
Dominic Petrak, Nafise Sadat Moosavi, Iryna Gurevych
arXiv_CL
arXiv_CL
Pose
Contrastive_Learning
Text_Generation
Inference
Language_Model
Prediction
PDF
2022-05-13
Controlling Translation Formality Using Pre-trained Multilingual Language Models
Elijah Rippeth, Sweta Agrawal, Marine Carpuat
arXiv_CL
arXiv_CL
Language_Model
PDF
2022-05-13
Weakly Supervised Text Classification using Supervision Signals from a Language Model
Ziqian Zeng, Weimin Ni, Tianqing Fang, Xiang Li, Xinran Zhao, Yangqiu Song
arXiv_CL
arXiv_CL
Weakly_Supervised
Text_Classification
Pose
Classification
Language_Model
PDF
2022-05-13
Improving Contextual Representation with Gloss Regularized Pre-training
Yu Lin, Zhecheng An, Peihao Wu, Zejun Ma
arXiv_AI
arXiv_AI
Embedding
Unsupervised
Bert
Pose
Inference
Language_Model
PDF
2022-05-13
TIE: Topological Information Enhanced Structural Reading Comprehension on Web Pages
Zihan Zhao, Lu Chen, Ruisheng Cao, Hongshen Xu, Xingyu Chen, Kai Yu
arXiv_CL
arXiv_CL
Pose
Attention
Language_Model
PDF
2022-05-12
Beyond Static Models and Test Sets: Benchmarking the Potential of Pre-trained Models Across Tasks and Languages
Kabir Ahuja, Sandipan Dandapat, Sunayana Sitaram, Monojit Choudhury
arXiv_CL
arXiv_CL
Bert
Pose
Language_Model
Prediction
PDF
2022-05-12
On the Economics of Multilingual Few-shot Learning: Modeling the Cost-Performance Trade-offs of Machine Translated and Manual Data
Kabir Ahuja, Monojit Choudhury, Sandipan Dandapat
arXiv_CL
arXiv_CL
Knowledge
Few-Shot
Language_Model
QA
PDF
2022-05-12
Noun2Verb: Probabilistic frame semantics for word class conversion
Lei Yu, Yang Xu
arXiv_CL
arXiv_CL
Knowledge
Speech
Language_Model
PDF
2022-05-12
Using Natural Sentences for Understanding Biases in Language Models
Sarah Alnegheimish, Alicia Guo, Yi Sun
arXiv_CL
arXiv_CL
Pose
Language_Model
PDF
2022-05-12
FETA: A Benchmark for Few-Sample Task Transfer in Open-Domain Dialogue
Alon Albalak, Yi-Lin Tuan, Pegah Jandaghi, Connor Pryor, Luke Yoffe, Deepak Ramachandran, Lise Getoor, Jay Pujara, William Yang Wang
arXiv_CL
arXiv_CL
Knowledge
Action
Language_Model
PDF
2022-05-12
Predicting Human Psychometric Properties Using Computational Language Models
Antonio Laverghetta Jr., Animesh Nighojkar, Jamshidbek Mirzakhalov, John Licato
arXiv_CL
arXiv_CL
Transformer
Language_Model
Prediction
PDF
2022-05-12
A Generalist Agent
Scott Reed, Konrad Zolna, Emilio Parisotto, Sergio Gomez Colmenarejo, Alexander Novikov, Gabriel Barth-Maron, Mai Gimenez, Yury Sulsky, Jackie Kay, Jost Tobias Springenberg, Tom Eccles, Jake Bruce, Ali Razavi, Ashley Edwards, Nicolas Heess, Yutian Chen, Raia Hadsell, Oriol Vinyals, Mahyar Bordbar, Nando de Freitas
arXiv_AI
arXiv_AI
Caption
Language_Model
PDF
2022-05-12
Localized Vision-Language Matching for Open-vocabulary Object Detection
Maria A. Bravo, Sudhanshu Mittal, Thomas Brox
arXiv_CV
arXiv_CV
Image_Caption
Regularization
Pose
Detection
Object_Detection
Caption
Language_Model
Matching
PDF
2022-05-12
Is the Computation of Abstract Sameness Relations Human-Like in Neural Language Models?
Lukas Thoma, Benjamin Roth
arXiv_CL
arXiv_CL
Bert
Face
Relation
Language_Model
PDF
2022-05-12
Multi Task Learning For Zero Shot Performance Prediction of Multilingual Models
Kabir Ahuja, Shanu Kumar, Sandipan Dandapat, Monojit Choudhury
arXiv_CL
arXiv_CL
Transformer
Zero-Shot
Multi_Task
Language_Model
Prediction
PDF
2022-05-12
Sampling with Attribute-Related Information for Controlling Language Models
Shangda Wu, Maosong Sun
arXiv_CL
arXiv_CL
Pose
Sentiment
Language_Model
PDF
2022-05-12
AiSocrates: Towards Answering Ethical Quandary Questions
Yejin Bang, Nayeon Lee, Tiezheng Yu, Leila Khalatbari, Yan Xu, Dan Su, Elham J. Barezi, Andrea Madotto, Hayden Kee, Pascale Fung
arXiv_AI
arXiv_AI
OCR
Pose
Few-Shot
Language_Model
PDF
2022-05-12
SimCPSR: Simple Contrastive Learning for Paper Submission Recommendation System
Duc H. Le, Tram T. Doan, Son T. Huynh, Binh T. Nguyen
arXiv_CV
arXiv_CV
Transformer
Transfer_Learning
Pose
Contrastive_Learning
Language_Model
Recommendation
PDF
2022-05-12
AdaVAE: Exploring Adaptive GPT-2s in Variational Auto-Encoders for Language Modeling
Haoqin Tu, Zhongliang Yang, Jinshuai Yang, Siyu Zhang, Yongfeng Huang
arXiv_CL
arXiv_CL
Represenation_Learning
RNN
GAN
Language_Model
PDF
2022-05-11
Structured, flexible, and robust: benchmarking and improving large language models towards more human-like behavior in out-of-distribution reasoning tasks
Katherine M. Collins, Catherine Wong, Jiahai Feng, Megan Wei, Joshua B. Tenenbaum
arXiv_AI
arXiv_AI
Pose
Language_Model
PDF
2022-05-11
Aggregating Pairwise Semantic Differences for Few-Shot Claim Veracity Classification
Xia Zeng, Arkaitz Zubiaga
arXiv_AI
arXiv_AI
Bert
Classification
Few-Shot
Language_Model
PDF
2022-05-11
Few-Shot Parameter-Efficient Fine-Tuning is Better and Cheaper than In-Context Learning
Haokun Liu, Derek Tam, Mohammed Muqeeth, Jay Mohta, Tenghao Huang, Mohit Bansal, Colin Raffel
arXiv_AI
arXiv_AI
Sparse
Pose
Few-Shot
Language_Model
Prediction
PDF
2022-05-11
An Empirical Study Of Self-supervised Learning Approaches For Object Detection With Transformers
Gokul Karthik Kumar, Sahal Shaji Mullappilly, Abhishek Singh Gehlot
arXiv_AI
arXiv_AI
Transformer
Reconstruction
Self-Supervised
Classification
Detection
Relation
Object_Detection
CNN
Image_Classification
Language_Model
PDF
2022-05-11
Clinical Prompt Learning with Frozen Language Models
Niall Taylor, Yi Zhang, Dan Joyce, Alejo Nevado-Holgado, Andrey Kormilitzin
arXiv_CL
arXiv_CL
Zero-Shot
Few-Shot
Medical
Language_Model
PDF
2022-05-11
Towards the Generation of Musical Explanations with GPT-3
Stephen James Krol, Maria Teresa Llano, Jon McCormack
arXiv_AI
arXiv_AI
Action
Language_Model
PDF
2022-05-11
Making Pre-trained Language Models Good Long-tailed Learners
Chen Zhang, Lei Ren, Jingang Wang, Wei Wu, Dawei Song
arXiv_CL
arXiv_CL
Knowledge
Classification
Few-Shot
Language_Model
PDF
2022-05-11
Pre-trained Language Models as Re-Annotators
Chang Shu
arXiv_AI
arXiv_AI
OCR
Knowledge
Pose
Contrastive_Learning
Action
Detection
Relation
Relation_Extraction
Language_Model
PDF
2022-05-11
Towards Unified Prompt Tuning for Few-shot Text Classification
Jianing Wang, Chengyu Wang, Fuli Luo, Chuanqi Tan, Minghui Qiu, Fei Yang, Qiuhui Shi, Songfang Huang, Ming Gao
arXiv_AI
arXiv_AI
Bert
Text_Classification
Knowledge
Self-Supervised
Pose
Classification
Few-Shot
Language_Model
PDF
2022-05-10
Reducing Activation Recomputation in Large Transformer Models
Vijay Korthikanti, Jared Casper, Sangkug Lym, Lawrence McAfee, Michael Andersch, Mohammad Shoeybi, Bryan Catanzaro
arXiv_CL
arXiv_CL
Transformer
Language_Model
PDF
2022-05-10
Human Language Modeling
Nikita Soni, Matthew Matero, Niranjan Balasubramanian, H. Andrew Schwartz
arXiv_CL
arXiv_CL
Transformer
Sentiment_Classification
Pose
Classification
Detection
Sentiment
Language_Model
PDF
2022-05-10
Extracting Latent Steering Vectors from Pretrained Language Models
Nishant Subramani, Nivedita Suresh, Matthew E. Peters
arXiv_AI
arXiv_AI
Unsupervised
Sentiment
Text_Generation
Language_Model
PDF
2022-05-10
Symphony Generation with Permutation Invariant Language Model
Jiafeng Liu, Yuanliang Dong, Zehua Cheng, Xinran Zhang, Xiaobing Li, Feng Yu, Maosong Sun
arXiv_AI
arXiv_AI
Transformer
Embedding
Pose
Text_Generation
Language_Model
PDF
2022-05-10
The Importance of Context in Very Low Resource Language Modeling
Lukas Edman, Antonio Toral, Gertjan van Noord
arXiv_CL
arXiv_CL
Attention
Language_Model
PDF
2022-05-10
From Distillation to Hard Negative Sampling: Making Sparse Neural IR Models More Effective
Thibault Formal, Carlos Lassance, Benjamin Piwowarski, Stéphane Clinchant
arXiv_CL
arXiv_CL
Zero-Shot
Sparse
Represenation_Learning
Pose
Attention
Language_Model
Matching
PDF
2022-05-10
SuMe: A Dataset Towards Summarizing Biomedical Mechanisms
Mohaddeseh Bastan, Nishant Shankar, Mihai Surdeanu, Niranjan Balasubramanian
arXiv_AI
arXiv_AI
Relation
Summarization
Medical
Language_Model
PDF
2022-05-10
Sentence-level Privacy for Document Embeddings
Casey Meehan, Khalil Mrini, Kamalika Chaudhuri
arXiv_CL
arXiv_CL
Embedding
Pose
Classification
Sentiment
Language_Model
PDF
2022-05-09
Unsupervised Slot Schema Induction for Task-oriented Dialog
Dian Yu, Mingqiu Wang, Yuan Cao, Izhak Shafran, Laurent El Shafey, Hagen Soltau
arXiv_CL
arXiv_CL
Tracking
Unsupervised
Pose
Language_Model
PDF
2022-05-09
Long Document Re-ranking with Modular Re-ranker
Luyu Gao, Jamie Callan
arXiv_CL
arXiv_CL
Transformer
Bert
Pose
Action
Attention
Language_Model
PDF
2022-05-09
LayoutXLM vs. GNN: An Empirical Evaluation of Relation Extraction for Documents
Hervé Déjean, Stéphane Clinchant, Jean-Luc Meunier
arXiv_AI
arXiv_AI
Action
Relation
Relation_Extraction
Language_Model
PDF
2022-05-09
Attribution-based Task-specific Pruning for Multi-task Language Models
Nakyeong Yang, Yunah Jang, Hwanhee Lee, Seohyeong Jung, Kyomin Jung
arXiv_AI
arXiv_AI
Pose
Language_Model
PDF
2022-05-09
A Balanced Data Approach for Evaluating Cross-Lingual Transfer: Mapping the Linguistic Blood Bank
Dan Malkin, Tomasz Limisiewicz, Gabriel Stanovsky
arXiv_AI
arXiv_AI
Bert
Zero-Shot
Relation
Language_Model
PDF
2022-05-09
Improving negation detection with negation-focused pre-training
Thinh Hung Truong, Timothy Baldwin, Trevor Cohn, Karin Verspoor
arXiv_CL
arXiv_CL
Bert
Pose
Detection
Language_Model
PDF
2022-05-08
MASALA: Modelling and Analysing the Semantics of Adpositions in Linguistic Annotation of Hindi
Aryaman Arora, Nitin Venkateswaran, Nathan Schneider
arXiv_CL
arXiv_CL
Relation
Language_Model
PDF
2022-05-08
Multimodal Semi-Supervised Learning for Text Recognition
Aviad Aberdam, Roy Ganz, Shai Mazor, Ron Litman
arXiv_AI
arXiv_AI
Recognition
Represenation_Learning
Regularization
Self-Supervised
Pose
Scene_Text
Language_Model
PDF
2022-05-08
Beyond Distributional Hypothesis: Let Language Models Learn Meaning-Text Correspondence
Myeongjun Jang, Frank Mtumbuka, Thomas Lukasiewicz
arXiv_AI
arXiv_AI
Pose
Language_Model
Prediction
Matching
PDF
2022-05-08
Context-Aware Abbreviation Expansion Using Large Language Models
Shanqing Cai, Subhashini Venugopalan, Katrin Tomanek, Ajit Narayanan, Meredith R. Morris, Michael P. Brenner
arXiv_CL
arXiv_CL
Zero-Shot
Pose
Few-Shot
Language_Model
PDF
2022-05-07
Empowering parameter-efficient transfer learning by recognizing the kernel structure in self-attention
Yifan Chen, Devamanyu Hazarika, Mahdi Namazifar, Yang Liu, Di Jin, Dilek Hakkani-Tur
arXiv_CL
arXiv_CL
Transformer
Transfer_Learning
Pose
Attention
Language_Model
PDF
2022-05-07
AKI-BERT: a Pre-trained Clinical Language Model for Early Prediction of Acute Kidney Injury
Chengsheng Mao, Liang Yao, Yuan Luo
arXiv_CL
arXiv_CL
Transformer
Bert
Action
Medical
Language_Model
Prediction
PDF
2022-05-07
Towards a Progression-Aware Autonomous Dialogue Agent
Abraham Sanders (1), Tomek Strzalkowski (1), Mei Si (1), Albert Chang (1), Deepanshu Dey (1), Jonas Braasch (1), Dakuo Wang (2) ((1) Rensselaer Polytechnic Institute, Troy, NY, USA, (2) IBM Research, USA)
arXiv_AI
arXiv_AI
Pose
Autonomous
Language_Model
PDF
2022-05-06
When a sentence does not introduce a discourse entity, Transformer-based models still sometimes refer to it
Sebastian Schuster, Tal Linzen
arXiv_CL
arXiv_CL
Transformer
Tracking
Knowledge
Action
Language_Model
PDF
2022-05-06
A Data Cartography based MixUp for Pre-trained Language Models
Seo Yeon Park, Cornelia Caragea
arXiv_CL
arXiv_CL
Bert
Pose
Language_Model
PDF
2022-05-06
The Unreliability of Explanations in Few-Shot In-Context Learning
Xi Ye, Greg Durrett
arXiv_CL
arXiv_CL
Few-Shot
Inference
Language_Model
Prediction
PDF
2022-05-06
Prompt Distribution Learning
Yuning Lu, Jianzhuang Liu, Yonggang Zhang, Yajing Liu, Xinmei Tian
arXiv_CV
arXiv_CV
Embedding
Recognition
Language_Model
PDF
2022-05-06
Disentangled Learning of Stance and Aspect Topics for Vaccine Attitude Detection in Social Media
Lixing Zhu, Zheng Fang, Gabriele Pergola, Rob Procter, Yulan He
arXiv_CL
arXiv_CL
Pose
Detection
Sentiment
Language_Model
PDF
2022-05-06
KECP: Knowledge Enhanced Contrastive Prompting for Few-shot Extractive Question Answering
Jianing Wang, Chengyu Wang, Minghui Qiu, Qiuhui Shi, Hongbin Wang, Jun Huang, Ming Gao
arXiv_AI
arXiv_AI
Knowledge
Pose
Contrastive_Learning
Few-Shot
Language_Model
QA
PDF
2022-05-06
Hearing voices at the National Library -- a speech corpus and acoustic model for the Swedish language
Martin Malmsten, Chris Haffenden, Love Börjeson
arXiv_CL
arXiv_CL
Recognition
OCR
Speech
Speech_Recognition
Language_Model
PDF
2022-05-05
Entity Cloze By Date: What LMs Know About Unseen Entities
Yasumasa Onoe, Michael J.Q. Zhang, Eunsol Choi, Greg Durrett
arXiv_CL
arXiv_CL
Knowledge
Pose
Inference
Language_Model
PDF
2022-05-05
Implicit N-grams Induced by Recurrence
Xiaobing Sun, Wei Lu
arXiv_CL
arXiv_CL
Transformer
RNN
Sentiment
Attention
Language_Model
PDF
2022-05-05
Language Models Can See: Plugging Visual Controls in Text Generation
Yixuan Su, Tian Lan, Yahui Liu, Fangyu Liu, Dani Yogatama, Yan Wang, Lingpeng Kong, Nigel Collier
arXiv_CV
arXiv_CV
Image_Caption
Zero-Shot
Pose
Text_Generation
Caption
Language_Model
Matching
PDF
2022-05-05
A Simple Contrastive Learning Objective for Alleviating Neural Text Degeneration
Shaojie Jiang, Ruqing Zhang, Svitlana Vakulenko, Maarten de Rijke
arXiv_CL
arXiv_CL
Pose
Contrastive_Learning
Relation
Language_Model
PDF
2022-05-05
FastRE: Towards Fast Relation Extraction with Convolutional Encoder and Improved Cascade Binary Tagging Framework
Guozheng Li, Xu Chen, Peng Wang, Jiafeng Xie, Qiqing Luo
arXiv_AI
arXiv_AI
Transformer
Pose
Action
Relation
Relation_Extraction
Attention
CNN
Inference
Language_Model
PDF
2022-05-05
Declaration-based Prompt Tuning for Visual Question Answering
Yuhang Liu, Wei Wei, Daowan Peng, Feida Zhu
arXiv_AI
arXiv_AI
Zero-Shot
Self-Supervised
Pose
VQA
Few-Shot
Language_Model
Prediction
QA
Matching
PDF
2022-05-05
Assistive Recipe Editing through Critiquing
Diego Antognini, Shuyang Li, Boi Faltings, Julian McAuley
arXiv_CL
arXiv_CL
Unsupervised
Relation
Denoising
Language_Model
PDF
2022-05-05
Robust Conversational Agents against Imperceptible Toxicity Triggers
Ninareh Mehrabi, Ahmad Beirami, Fred Morstatter, Aram Galstyan
arXiv_AI
arXiv_AI
Adversarial
Pose
Detection
Attention
Language_Model
PDF
2022-05-04
Relation Extraction as Open-book Examination: Retrieval-enhanced Prompt Tuning
Xiang Chen, Lei Li, Ningyu Zhang, Chuanqi Tan, Fei Huang, Luo Si, Huajun Chen
arXiv_CL
arXiv_CL
Knowledge
Pose
Action
Relation
Few-Shot
Relation_Extraction
Inference
Language_Model
PDF
2022-05-04
Knowledge Distillation of Russian Language Models with Reduction of Vocabulary
Alina Kolesnikova, Yuri Kuratov, Vasily Konovalov, Mikhail Burtsev
arXiv_CL
arXiv_CL
Transformer
Embedding
Knowledge
Pose
Sentiment
Language_Model
PDF
2022-05-04
Language Models in the Loop: Incorporating Prompting into Weak Supervision
Ryan Smith, Jason A. Fries, Braden Hancock, Stephen H. Bach
arXiv_CL
arXiv_CL
Zero-Shot
Pose
Few-Shot
Language_Model
PDF
2022-05-04
Using virtual edges to extract keywords from texts modeled as complex networks
Jorge A. V. Tohalino, Thiago C. Silva, Diego R. Amancio
arXiv_CL
arXiv_CL
Embedding
Bert
Action
Language_Model
PDF
2022-05-04
A Few Thousand Translations Go a Long Way! Leveraging Pre-trained Models for African News Translation
David Ifeoluwa Adelani, Jesujoba Oluwadara Alabi, Angela Fan, Julia Kreutzer, Xiaoyu Shen, Machel Reid, Dana Ruiter, Dietrich Klakow, Peter Nabende, Ernie Chang, Tajuddeen Gwadabe, Freshia Sackey, Bonaventure F. P. Dossou, Chris Chinenye Emezue, Colin Leong, Michael Beukman, Shamsuddeen Hassan Muhammad, Guyo Dub Jarso, Oreen Yousuf, Andre Niyongabo Rubungo, Gilles Hacheme, Eric Peter Wairagala, Muhammad Umair Nasir, Benjamin Ayoade Ajibade, Tunde Oluwaseyi Ajayi, Yvonne Wambui Gitau, Jade Abbott, Mohamed Ahmed, Millicent Ochieng, Anuoluwapo Aremu, Perez Ogayo, Jonathan Mukiibi, Fatoumata Ouoba Kabore, Godson Koffi Kalipe, Derguene Mbaye, Allahsera Auguste Tapo, Victoire Memdjokam Koagne, Edwin Munkoh-Buabeng, Valencia Wagner, Idris Abdulmumin, Ayodele Awokoya, Happy Buzaaba, Blessing Sibanda, et al. (2 additional authors not shown)
arXiv_CL
arXiv_CL
Language_Model
PDF
2022-05-04
Aligning to Social Norms and Values in Interactive Narratives
Prithviraj Ammanabrolu, Liwei Jiang, Maarten Sap, Hannaneh Hajishirzi, Yejin Choi
arXiv_AI
arXiv_AI
Reinforcement_Learning
Salient
Knowledge
Action
Language_Model
PDF
2022-05-04
Cross-lingual Word Embeddings in Hyperbolic Space
Chandni Saxena, Mudit Chaudhary, Helen Meng
arXiv_CL
arXiv_CL
Embedding
Unsupervised
Pose
Relation
Language_Model
PDF
2022-05-04
Improving Multi-Document Summarization through Referenced Flexible Extraction with Credit-Awareness
Yun-Zhu Song, Yi-Syuan Chen, Hong-Han Shuai
arXiv_AI
arXiv_AI
Transformer
Reinforcement_Learning
Optimization
Salient
Pose
Action
Summarization
Language_Model
Prediction
PDF
2022-05-04
P$^3$ Ranker: Mitigating the Gaps between Pre-training and Ranking Fine-tuning with Prompt-based Learning and Pre-finetuning
Xiaomeng Hu (1), Shi Yu (2), Chenyan Xiong (3), Zhenghao Liu (1), Zhiyuan Liu (2), Ge Yu (1) ((1) Northeastern University, (2) Tsinghua University, (3) Microsoft Research)
arXiv_CL
arXiv_CL
Knowledge
Pose
Few-Shot
Language_Model
PDF
2022-05-04
Provably Confidential Language Modelling
Xuandong Zhao, Lei Li, Yu-Xiang Wang
arXiv_CL
arXiv_CL
RNN
Pose
Action
Language_Model
PDF
2022-05-04
Seed-Guided Topic Discovery with Out-of-Vocabulary Seeds
Yu Zhang, Yu Meng, Xuan Wang, Sheng Wang, Jiawei Han
arXiv_CL
arXiv_CL
Unsupervised
Knowledge
Pose
Language_Model
PDF
2022-05-04
Great Truths are Always Simple: A Rather Simple Knowledge Encoder for Enhancing the Commonsense Reasoning Capacity of Pre-Trained Models
Jinhao Jiang, Kun Zhou, Wayne Xin Zhao, Ji-Rong Wen
arXiv_AI
arXiv_AI
Knowledge
Knowledge_Graph
Relation
Language_Model
PDF
2022-05-04
Data Governance in the Age of Large-Scale Data-Driven Language Technology
Yacine Jernite, Huu Nguyen, Stella Biderman, Anna Rogers, Maraim Masoud, Valentin Danchev, Samson Tan, Alexandra Sasha Luccioni, Nishant Subramani, Gérard Dupont, Jesse Dodge, Kyle Lo, Zeerak Talat, Isaac Johnson, Dragomir Radev, Somaieh Nikpoor, Jörg Frohberg, Aaron Gokaslan, Peter Henderson, Rishi Bommasani, Margaret Mitchell
arXiv_AI
arXiv_AI
Pose
Attention
GAN
Language_Model
PDF
2022-05-03
Explain and Conquer: Personalised Text-based Reviews to Achieve Transparency
Iñigo López-Riobóo Botana (1), Verónica Bolón-Canedo (1), Bertha Guijarro-Berdiñas (1), Amparo Alonso-Betanzos (1) ((1) University of A Coruña - Research Center on Information and Communication Technologies (CITIC))
arXiv_AI
arXiv_AI
Transformer
Bert
Review
Pose
Action
Relation
Language_Model
Recommendation
PDF
2022-05-03
XLTime: A Cross-Lingual Knowledge Transfer Framework for Temporal Expression Extraction
Yuwei Cao, William Groves, Tanay Kumar Saha, Joel R. Tetreault, Alex Jaimes, Hao Peng, Philip S. Yu
arXiv_CL
arXiv_CL
Knowledge
Pose
Action
Inference
Language_Model
PDF
2022-05-03
Mixed-effects transformers for hierarchical adaptation
Julia White, Noah Goodman, Robert Hawkins
arXiv_CL
arXiv_CL
Transformer
Sparse
Language_Model
PDF
2022-05-03
Learning to Transfer Prompts for Text Generation
Junyi Li, Tianyi Tang, Jian-Yun Nie, Ji-Rong Wen, Wayne Xin Zhao
arXiv_CL
arXiv_CL
Pose
Attention
Text_Generation
Language_Model
PDF
2022-05-03
ElitePLM: An Empirical Study on General Language Ability Evaluation of Pretrained Language Models
Junyi Li, Tianyi Tang, Zheng Gong, Lixin Yang, Zhuohao Yu, Zhipeng Chen, Jingyuan Wang, Wayne Xin Zhao, Ji-Rong Wen
arXiv_CL
arXiv_CL
Language_Model
Prediction
PDF
2022-05-03
Neural Language Taskonomy: Which NLP Tasks are the most Predictive of fMRI Brain Activity?
Subba Reddy Oota, Jashn Arora, Veeral Agarwal, Mounika Marreddy, Manish Gupta, Bapi Raju Surampudi
arXiv_AI
arXiv_AI
Transformer
Transfer_Learning
Relation
Summarization
Activity
Inference
Language_Model
PDF
2022-05-03
Predicting Issue Types with seBERT
Alexander Trautsch, Steffen Herbold
arXiv_CL
arXiv_CL
Transformer
Bert
Language_Model
Prediction
PDF
2022-05-03
Contrastive Learning for Prompt-Based Few-Shot Language Learners
Yiren Jian, Chongyang Gao, Soroush Vosoughi
arXiv_AI
arXiv_AI
Pose
Contrastive_Learning
Few-Shot
Language_Model
PDF
2022-05-03
Embedding Hallucination for Few-Shot Language Fine-tuning
Yiren Jian, Chongyang Gao, Soroush Vosoughi
arXiv_AI
arXiv_AI
Embedding
Regularization
Knowledge
Adversarial
Pose
Few-Shot
Language_Model
PDF
2022-05-03
SemAttack: Natural Textual Attacks via Different Semantic Spaces
Boxin Wang, Chejian Xu, Xiangyu Liu, Yu Cheng, Bo Li
arXiv_CL
arXiv_CL
Embedding
Bert
Knowledge
Adversarial
Pose
Language_Model
PDF
2022-05-02
The Limits of Word Level Differential Privacy
Justus Mattern, Benjamin Weggenmann, Florian Kerschbaum
arXiv_CL
arXiv_CL
Transformer
Embedding
Pose
Attention
Language_Model
PDF
2022-05-02
OPT: Open Pre-trained Transformer Language Models
Susan Zhang, Stephen Roller, Naman Goyal, Mikel Artetxe, Moya Chen, Shuohui Chen, Christopher Dewan, Mona Diab, Xian Li, Xi Victoria Lin, Todor Mihaylov, Myle Ott, Sam Shleifer, Kurt Shuster, Daniel Simig, Punit Singh Koura, Anjali Sridhar, Tianlu Wang, Luke Zettlemoyer
arXiv_CL
arXiv_CL
Transformer
Face
Few-Shot
Language_Model
PDF
2022-05-02
Entity-aware Transformers for Entity Search
Emma J. Gerritse, Faegheh Hasibi, Arjen P. de Vries
arXiv_CL
arXiv_CL
Transformer
Embedding
Bert
Knowledge
Knowledge_Graph
Relation
Language_Model
PDF
2022-05-02
Debiased Contrastive Learning of Unsupervised Sentence Representations
Kun Zhou, Beichen Zhang, Wayne Xin Zhao, Ji-Rong Wen
arXiv_CL
arXiv_CL
Unsupervised
Contrastive_Learning
Language_Model
PDF
2022-05-02
Robust Fine-tuning via Perturbation and Interpolation from In-batch Instances
Shoujie Tong, Qingxiu Dong, Damai Dai, Yifan song, Tianyu Liu, Baobao Chang, Zhifang Sui
arXiv_CL
arXiv_CL
Adversarial
Pose
Language_Model
PDF
2022-05-02
POLITICS: Pretraining with Same-story Article Comparison for Ideology Prediction and Stance Detection
Yujian Liu, Xinliang Frederick Zhang, David Wegsman, Nick Beauchamp, Lu Wang
arXiv_CL
arXiv_CL
Pose
Detection
Few-Shot
Language_Model
Prediction
PDF
2022-05-01
Gender Bias in Masked Language Models for Multiple Languages
Masahiro Kaneko, Aizhan Imankulova, Danushka Bollegala, Naoaki Okazaki
arXiv_CL
arXiv_CL
Pose
Language_Model
PDF
2022-05-01
Large-Scale Multi-Document Summarization with Information Extraction and Compression
Ning Wang, Han Liu, Diego Klabjan
arXiv_CL
arXiv_CL
Action
Summarization
Language_Model
PDF
2022-05-01
CUP: Curriculum Learning based Prompt Tuning for Implicit Event Argument Extraction
Jiaju Lin, Qin Chen, Jie Zhou, Jian Jin, Liang He
arXiv_CL
arXiv_CL
Knowledge
Pose
Action
Relation
Language_Model
PDF
2022-05-01
Dynamic Programming in Rank Space: Scaling Structured Inference with Low-Rank HMMs and PCFGs
Songlin Yang, Wei Liu, Kewei Tu
arXiv_CL
arXiv_CL
Unsupervised
Inference
Language_Model
PDF
2022-05-01
MRKL Systems: A modular, neuro-symbolic architecture that combines large language models, external knowledge sources and discrete reasoning
Ehud Karpas, Omri Abend, Yonatan Belinkov, Barak Lenz, Opher Lieber, Nir Ratner, Yoav Shoham, Hofit Bata, Yoav Levine, Kevin Leyton-Brown, Dor Muhlgay, Noam Rozen, Erez Schwartz, Gal Shachaf, Shai Shalev-Shwartz, Amnon Shashua, Moshe Tenenholtz
arXiv_AI
arXiv_AI
Knowledge
Language_Model
PDF
2022-04-30
Visual Spatial Reasoning
Fangyu Liu, Guy Emerson, Nigel Collier
arXiv_AI
arXiv_AI
Zero-Shot
Knowledge
Pose
Classification
Relation
Caption
Language_Model
PDF
2022-04-30
LayoutBERT: Masked Language Layout Model for Object Insertion
Kerem Turgutlu, Sanat Sharma, Jayant Kumar
arXiv_AI
arXiv_AI
Bert
Knowledge
Self-Supervised
Pose
Quantitative
Attention
Language_Model
PDF
2022-04-30
Detoxifying Language Models with a Toxic Corpus
Yoon A Park, Frank Rudzicz
arXiv_CL
arXiv_CL
Pose
Language_Model
PDF
2022-04-30
Visualizing and Explaining Language Models
Adrian M.P. Braşoveanu, Răzvan Andonie
arXiv_CL
arXiv_CL
Salient
Deep_Learning
Relation
Language_Model
PDF
2022-04-30
Exposing Cross-Lingual Lexical Knowledge from Multilingual Sentence Encoders
Ivan Vulić, Goran Glavaš, Fangyu Liu, Nigel Collier, Edoardo Maria Ponti, Anna Korhonen
arXiv_CL
arXiv_CL
Embedding
Knowledge
Pose
Contrastive_Learning
Language_Model
PDF
2022-04-30
A New Evaluation Method: Evaluation Data and Metrics for Chinese Grammar Error Correction
Nankai Lin, Nankai Lin, Xiaotian Lin, Ziyu Yang, Shengyi Jiang
arXiv_CL
arXiv_CL
Segmentation
Pose
Attention
Language_Model
PDF
2022-04-30
Building a Role Specified Open-Domain Dialogue System Leveraging Large-Scale Language Models
Sanghwan Bae, Donghyun Kwak, Sungdong Kim, Donghoon Ham, Soyoung Kang, Sang-Woo Lee, Woomyoung Park
arXiv_CL
arXiv_CL
Pose
Few-Shot
Language_Model
PDF
2022-04-30
To Know by the Company Words Keep and What Else Lies in the Vicinity
Jake Ryland Williams, Hunter Scott Heidenreich
arXiv_CL
arXiv_CL
Knowledge
Deep_Learning
Language_Model
PDF
2022-04-29
Prompt Consistency for Zero-Shot Task Generalization
Chunting Zhou, Junxian He, Xuezhe Ma, Taylor Berg-Kirkpatrick, Graham Neubig
arXiv_CL
arXiv_CL
Unsupervised
Zero-Shot
Pose
Inference
Language_Model
Prediction
PDF
2022-04-29
Logically Consistent Adversarial Attacks for Soft Theorem Provers
Alexander Gaskell, Yishu Miao, Lucia Specia, Francesca Toni
arXiv_CL
arXiv_CL
Adversarial
Pose
Language_Model
PDF
2022-04-29
Training Naturalized Semantic Parsers with Very Little Data
Subendhu Rongali, Konstantine Arkoudas, Melanie Rubino, Wael Hamza
arXiv_CL
arXiv_CL
Unsupervised
Few-Shot
Language_Model
PDF
2022-04-29
TemporalWiki: A Lifelong Benchmark for Training and Evaluating Ever-Evolving Language Models
Joel Jang, Seonghyeon Ye, Changho Lee, Sohee Yang, Joongbo Shin, Janghoon Han, Gyeonghun Kim, Minjoon Seo
arXiv_CL
arXiv_CL
Knowledge
Language_Model
PDF
2022-04-29
Flamingo: a Visual Language Model for Few-Shot Learning
Jean-Baptiste Alayrac, Jeff Donahue, Pauline Luc, Antoine Miech, Iain Barr, Yana Hasson, Karel Lenc, Arthur Mensch, Katie Millican, Malcolm Reynolds, Roman Ring, Eliza Rutherford, Serkan Cabi, Tengda Han, Zhitao Gong, Sina Samangooei, Marianne Monteiro, Jacob Menick, Sebastian Borgeaud, Andrew Brock, Aida Nematzadeh, Sahand Sharifzadeh, Mikolaj Binkowski, Ricardo Barreira, Oriol Vinyals, Andrew Zisserman, Karen Simonyan
arXiv_AI
arXiv_AI
Video_Caption
Pose
VQA
Few-Shot
Caption
Language_Model
PDF
2022-04-29
Learning from Natural Language Feedback
Jérémy Scheurer, Jon Ander Campos, Jun Shern Chan, Angelica Chen, Kyunghyun Cho, Ethan Perez
arXiv_AI
arXiv_AI
Pose
Summarization
Language_Model
PDF
2022-04-29
Developmental Negation Processing in Transformer Language Models
Antonio Laverghetta Jr., John Licato
arXiv_CL
arXiv_CL
Transformer
Inference
Language_Model
PDF
2022-04-29
PyramidCLIP: Hierarchical Feature Alignment for Vision-language Model Pretraining
Yuting Gao, Jinfeng Liu, Zihan Xu, Jun Zhang, Ke Li, Chunhua Shen
arXiv_AI
arXiv_AI
Zero-Shot
Pose
Classification
Detection
Relation
Object_Detection
Image_Classification
Language_Model
PDF
2022-04-29
C3-STISR: Scene Text Image Super-resolution with Triple Clues
Minyi Zhao, Miao Wang, Fan Bai, Bingjia Li, Jie Wang, Shuigeng Zhou
arXiv_CV
arXiv_CV
Recognition
Super_Resolution
Scene_Text
Action
Language_Model
PDF
2022-04-29
KERMIT - A Transformer-Based Approach for Knowledge Graph Matching
Sven Hertling, Jan Portisch, Heiko Paulheim
arXiv_AI
arXiv_AI
Transformer
Knowledge
Knowledge_Graph
Language_Model
Matching
PDF
2022-04-29
QRelScore: Better Evaluating Generated Questions with Deeper Understanding of Context-aware Relevance
Xiaoqiang Wang, Bang Liu, Siliang Tang, Lingfei Wu
arXiv_CL
arXiv_CL
Bert
Adversarial
Pose
Relation
Language_Model
Matching
PDF
2022-04-29
OA-Mine: Open-World Attribute Mining for E-Commerce Products with Weak Supervision
Xinyang Zhang, Chenwei Zhang, Xian Li, Xin Luna Dong, Jingbo Shang, Christos Faloutsos, Jiawei Han
arXiv_CL
arXiv_CL
Pose
Action
Language_Model
PDF
2022-04-29
Vision-Language Pre-Training for Boosting Scene Text Detectors
Sibo Song, Jianqiang Wan, Zhibo Yang, Jun Tang, Wenqing Cheng, Xiang Bai, Cong Yao
arXiv_AI
arXiv_AI
Represenation_Learning
Pose
Scene_Text
Contrastive_Learning
Action
Detection
Object_Detection
Language_Model
Prediction
PDF
2022-04-28
Instilling Type Knowledge in Language Models via Multi-Task QA
Shuyang Li, Mukund Sridhar, Chandana Satya Prakash, Jin Cao, Wael Hamza, Julian McAuley
arXiv_AI
arXiv_AI
Tracking
Zero-Shot
Knowledge
Knowledge_Graph
Language_Model
QA
PDF
2022-04-28
Inferring Implicit Relations with Language Models
Uri Katz, Mor Geva, Jonathan Berant
arXiv_CL
arXiv_CL
Relation
Inference
Language_Model
QA
PDF
2022-04-28
HiNER: A Large Hindi Named Entity Recognition Dataset
Rudra Murthy, Pallab Bhattacharjee, Rahul Sharnagat, Jyotsana Khatri, Diptesh Kanojia, Pushpak Bhattacharyya
arXiv_CL
arXiv_CL
Recognition
Knowledge
GAN
Language_Model
PDF
2022-04-28
CogView2: Faster and Better Text-to-Image Generation via Hierarchical Transformers
Ming Ding, Wendi Zheng, Wenyi Hong, Jie Tang
arXiv_CV
arXiv_CV
Transformer
Super_Resolution
Self-Supervised
Language_Model
PDF
2022-04-28
RobBERTje: a Distilled Dutch BERT Model
Pieter Delobelle, Thomas Winters, Bettina Berendt
arXiv_CL
arXiv_CL
Bert
Attention
Language_Model
PDF
2022-04-28
On the Effect of Pretraining Corpora on In-context Learning by a Large-scale Language Model
Seongjin Shin, Sang-Woo Lee, Hwijeen Ahn, Sungdong Kim, HyoungSeok Kim, Boseop Kim, Kyunghyun Cho, Gichang Lee, Woomyoung Park, Jung-Woo Ha, Nako Sung
arXiv_CL
arXiv_CL
Relation
Few-Shot
Language_Model
PDF
2022-04-28
Post-Training Dialogue Summarization using Pseudo-Paraphrasing
Qi Jia, Yizhu Liu, Haifeng Tang, Kenny Q. Zhu
arXiv_CL
arXiv_CL
Knowledge
Pose
Summarization
Language_Model
PDF
2022-04-28
HPT: Hierarchy-aware Prompt Tuning for Hierarchical Text Classification
Zihan Wang, Peiyi Wang, Tianyu Liu, Yunbo Cao, Zhifang Sui, Houfeng Wang
arXiv_CL
arXiv_CL
Text_Classification
Knowledge
Pose
Classification
Language_Model
PDF
2022-04-28
Improving robustness of language models from a geometry-aware perspective
Bin Zhu, Zhaoquan Gu, Le Wang, Jinyin Chen, Qi Xuan
arXiv_CL
arXiv_CL
Adversarial
Pose
Language_Model
PDF
2022-04-27
Towards Teachable Reasoning Systems
Bhavana Dalvi, Oyvind Tafjord, Peter Clark
arXiv_AI
arXiv_AI
Knowledge
Language_Model
QA
PDF
2022-04-27
DialogVED: A Pre-trained Latent Variable Encoder-Decoder Model for Dialog Response Generation
Wei Chen, Yeyun Gong, Song Wang, Bolun Yao, Weizhen Qi, Zhongyu Wei, Xiaowu Hu, Bartuer Zhou, Yi Mao, Weizhu Chen, Biao Cheng, Nan Duan
arXiv_CL
arXiv_CL
Pose
Language_Model
Prediction
PDF
2022-04-27
Extremal GloVe: Theoretically Accurate Distributed Word Embedding by Tail Inference
Hao Wang
arXiv_CL
arXiv_CL
Embedding
Pose
Inference
Language_Model
Recommendation
PDF
2022-04-27
RigoBERTa: A State-of-the-Art Language Model For Spanish
Alejandro Vaca Serrano, Guillem Garcia Subies, Helena Montoro Zamorano, Nuria Aldama Garcia, Doaa Samy, David Betancur Sanchez, Antonio Moreno Sandoval, Marta Guerrero Nieto, Alvaro Barbero Jimenez
arXiv_CL
arXiv_CL
Bert
Language_Model
PDF
2022-04-27
LyS_ACoru~na at SemEval-2022 Task 10: Repurposing Off-the-Shelf Tools for Sentiment Analysis as Semantic Dependency Parsing
Iago Alonso-Alonso, David Vilares, Carlos Gómez-Rodríguez
arXiv_CL
arXiv_CL
Zero-Shot
Sentiment
Language_Model
PDF
2022-04-27
SkillSpan: Hard and Soft Skill Extraction from English Job Postings
Mike Zhang, Kristian Nørgaard Jensen, Sif Dam Sonniks, Barbara Plank
arXiv_CL
arXiv_CL
Bert
Action
GAN
Language_Model
PDF
2022-04-27
Probing Simile Knowledge from Pre-trained Language Models
Weijie Chen, Yongzhu Chang, Rongsheng Zhang, Jiashu Pu, Guandan Chen, Le Zhang, Yadong Xi, Yijiang Chen, Chang Su
arXiv_AI
arXiv_AI
Knowledge
Language_Model
Prediction
PDF
2022-04-27
Modern Baselines for SPARQL Semantic Parsing
Debayan Banerjee, Pranav Ajit Nair, Jivat Neet Kaur, Ricardo Usbeck, Chris Biemann
arXiv_CL
arXiv_CL
Embedding
Bert
Knowledge
Knowledge_Graph
Relation
Language_Model
PDF
2022-04-27
Plug-and-Play Adaptation for Continuously-updated QA
Kyungjae Lee, Wookje Han, Seung-won Hwang, Hwaran Lee, Joonsuk Park, Sang-Woo Lee
arXiv_CL
arXiv_CL
Knowledge
Pose
Language_Model
QA
PDF
2022-04-27
A Thorough Examination on Zero-shot Dense Retrieval
Ruiyang Ren, Yingqi Qu, Jing Liu, Wayne Xin Zhao, Qifei Wu, Yuchen Ding, Hua Wu, Haifeng Wang, Ji-Rong Wen
arXiv_CL
arXiv_CL
Zero-Shot
Sparse
Review
Language_Model
PDF
2022-04-27
A Comprehensive Understanding of Code-mixed Language Semantics using Hierarchical Transformer
Ayan Sengupta, Tharun Suresh, Md Shad Akhtar, Tanmoy Chakraborty
arXiv_CL
arXiv_CL
Transformer
Embedding
Transfer_Learning
Zero-Shot
Represenation_Learning
Pose
Relation
Attention
Language_Model
PDF
2022-04-27
UBERT: A Novel Language Model for Synonymy Prediction at Scale in the UMLS Metathesaurus
Thilini Wijesiriwardene, Vinh Nguyen, Goonmeet Bajaj, Hong Yung Yip, Vishesh Javangula, Yuqing Mao, Kin Wah Fung, Srinivasan Parthasarathy, Amit P. Sheth, Olivier Bodenreider
arXiv_AI
arXiv_AI
Bert
Deep_Learning
Medical
Language_Model
Prediction
PDF
2022-04-26
Testing the Ability of Language Models to Interpret Figurative Language
Emmy Liu, Chen Cui, Kenneth Zheng, Graham Neubig
arXiv_AI
arXiv_AI
Few-Shot
Language_Model
QA
PDF
2022-04-26
Efficient Machine Translation Domain Adaptation
Pedro Henrique Martins, Zita Marinho, André F. T. Martins
arXiv_CL
arXiv_CL
Pose
Language_Model
PDF
2022-04-26
Parkinson's disease diagnostics using AI and natural language knowledge transfer
Maurycy Chronowski, Maciej Klaczynski, Malgorzata Dec-Cwiek, Karolina Porebska
arXiv_AI
arXiv_AI
Knowledge
Speech
Pose
Classification
Deep_Learning
Language_Model
PDF
2022-04-26
Label Anchored Contrastive Learning for Language Understanding
Zhenyu Zhang, Yuming Zhao, Meng Chen, Xiaodong He
arXiv_CL
arXiv_CL
Embedding
Speech
Self-Supervised
Pose
Contrastive_Learning
Classification
Few-Shot
Language_Model
PDF
2022-04-26
You Don't Know My Favorite Color: Preventing Dialogue Representations from Revealing Speakers' Private Personas
Haoran Li, Yangqiu Song, Lixin Fan
arXiv_CL
arXiv_CL
Pose
Language_Model
QA
PDF
2022-04-26
CoVERT: A Corpus of Fact-checked Biomedical COVID-19 Tweets
Isabelle Mohr, Amelie Wührl, Roman Klinger
arXiv_CL
arXiv_CL
Knowledge
Pose
Relation
Medical
Language_Model
Recommendation
PDF
2022-04-26
LM-Debugger: An Interactive Tool for Inspection and Intervention in Transformer-Based Language Models
Mor Geva, Avi Caciularu, Guy Dar, Paul Roit, Shoval Sadde, Micah Shlain, Bar Tamir, Yoav Goldberg
arXiv_CL
arXiv_CL
Transformer
Language_Model
Prediction
PDF
2022-04-26
Pretraining Chinese BERT for Detecting Word Insertion and Deletion Errors
Cong Zhou, Yong Dai, Duyu Tang, Enbo Zhao, Zhangyin Feng, Li Kuang, Shuming Shi
arXiv_CL
arXiv_CL
Bert
Inference
Language_Model
Prediction
PDF
2022-04-25
AI Personification: Estimating the Personality of Language Models
Saketh Reddy Karra, Son Nguyen, Theja Tulabandhula
arXiv_AI
arXiv_AI
Zero-Shot
Classification
Text_Generation
Language_Model
PDF
2022-04-25
C3: Continued Pretraining with Contrastive Weak Supervision for Cross Language Ad-Hoc Retrieval
Eugene Yang, Suraj Nair, Ramraj Chandradevan, Rebecca Iglesias-Flores, Douglas W. Oard
arXiv_CL
arXiv_CL
Language_Model
PDF
2022-04-25
Super-Prompting: Utilizing Model-Independent Contextual Data to Reduce Data Annotation Required in Visual Commonsense Tasks
Navid Rezaei, Marek Z. Reformat
arXiv_AI
arXiv_AI
Transformer
Pose
Few-Shot
Language_Model
PDF
2022-04-25
The Causal News Corpus: Annotating Causal Relations in Event Sentences from News
Fiona Anting Tan, Ali Hürriyetoğlu, Tommaso Caselli, Nelleke Oostdijk, Tadashi Nomoto, Hansi Hettiarachchi, Iqra Ameer, Onur Uca, Farhana Ferdousi Liza, Tiancheng Hu
arXiv_CL
arXiv_CL
Pose
Relation
Language_Model
PDF
2022-04-25
Incorporating Explicit Knowledge in Pre-trained Language Models for Passage Re-ranking
Qian Dong, Yiding Liu, Suqi Cheng, Shuaiqiang Wang, Zhicong Cheng, Shuzi Niu, Dawei Yin
arXiv_AI
arXiv_AI
Embedding
Knowledge
Knowledge_Graph
Pose
Action
Language_Model
PDF
2022-04-25
Which Discriminator for Cooperative Text Generation?
Antoine Chaffin, Thomas Scialom, Sylvain Lamprier, Jacopo Staiano, Benjamin Piwowarski, Ewa Kijak, Vincent Claveau
arXiv_CL
arXiv_CL
Transformer
Classification
Text_Generation
Language_Model
PDF
2022-04-25
Do Transformer Models Show Similar Attention Patterns to Task-Specific Human Gaze?
Stephanie Brandl, Oliver Eberle, Jonas Pilot, Anders Søgaard
arXiv_CL
arXiv_CL
Transformer
Action
Relation
Sentiment
Relation_Extraction
Attention
Language_Model
PDF
2022-04-25
ED2LM: Encoder-Decoder to Language Model for Faster Document Re-ranking Inference
Kai Hui, Honglei Zhuang, Tao Chen, Zhen Qin, Jing Lu, Dara Bahri, Ji Ma, Jai Prakash Gupta, Cicero Nogueira dos Santos, Yi Tay, Don Metzler
arXiv_CL
arXiv_CL
Embedding
Bert
Pose
Attention
Inference
Language_Model
PDF
2022-04-24
Emotion-Aware Transformer Encoder for Empathetic Dialogue Generation
Raman Goel, Seba Susan, Sachin Vashisht, Armaan Dhanda
arXiv_CL
arXiv_CL
Transformer
Embedding
Pose
Emotion
Face
Detection
Object_Detection
Language_Model
PDF
2022-04-24
Learning to Win Lottery Tickets in BERT Transfer via Task-agnostic Mask Training
Yuanxin Liu, Fandong Meng, Zheng Lin, Peng Fu, Yanan Cao, Weiping Wang, Jie Zhou
arXiv_CL
arXiv_CL
Transfer_Learning
Bert
Pose
Language_Model
Matching
PDF
2022-04-23
MuCGEC: a Multi-Reference Multi-Source Evaluation Dataset for Chinese Grammatical Error Correction
Yue Zhang, Zhenghua Li, Zuyi Bao, Jiacheng Li, Bo Zhang, Chen Li, Fei Huang, Min Zhang
arXiv_CL
arXiv_CL
Review
Language_Model
PDF
2022-04-23
CLIP-Dissect: Automatic Description of Neuron Representations in Deep Vision Networks
Tuomas Oikarinen, Tsui-Wei Weng
arXiv_AI
arXiv_AI
Pose
Language_Model
PDF
2022-04-22
Locally Aggregated Feature Attribution on Natural Language Model Understanding
Sheng Zhang, Jin Wang, Haitao Jiang, Rui Song
arXiv_AI
arXiv_AI
Embedding
Recognition
Pose
Detection
Sentiment
Language_Model
PDF
2022-04-22
ChapterBreak: A Challenge Dataset for Long-Range Language Models
Simeng Sun, Katherine Thai, Mohit Iyyer
arXiv_CL
arXiv_CL
Pose
Language_Model
PDF
2022-04-22
Meet Your Favorite Character: Open-domain Chatbot Mimicking Fictional Characters with only a Few Utterances
Seungju Han, Beomsu Kim, Jin Yong Yoo, Seokjun Seo, Sangbum Kim, Enkhbayar Erdenee, Buru Chang
arXiv_CL
arXiv_CL
Pose
Language_Model
QA
PDF
2022-04-22
Data Distributional Properties Drive Emergent Few-Shot Learning in Transformers
Stephanie C.Y. Chan, Adam Santoro, Andrew K. Lampinen, Jane X. Wang, Aaditya Singh, Pierre H. Richemond, Jay McClelland, Felix Hill
arXiv_AI
arXiv_AI
Transformer
Few-Shot
Language_Model
PDF
2022-04-22
Autoregressive Search Engines: Generating Substrings as Document Identifiers
Michele Bevilacqua, Giuseppe Ottaviano, Patrick Lewis, Wen-tau Yih, Sebastian Riedel, Fabio Petroni
arXiv_CL
arXiv_CL
Knowledge
Pose
Language_Model
PDF
2022-04-22
Generalized Quantifiers as a Source of Error in Multilingual NLU Benchmarks
Ruixiang Cui, Daniel Hershcovich, Anders Søgaard
arXiv_CL
arXiv_CL
Adversarial
Language_Model
PDF
2022-04-22
Sparse and Dense Approaches for the Full-rank Retrieval of Responses for Dialogues
Gustavo Penha, Claudia Hauff
arXiv_CL