Bert

Bert

• 2022-12-08 Fresnel Microfacet BRDF: Unification of Polari-Radiometric Surface-Body Reflection    Tomoki Ichikawa, Yoshiki Fukao, Shohei Nobuhara, Ko Nishino arXiv_CV arXiv_CV  Bert  Face  PDF
• 2022-12-08 BEVBert: Topo-Metric Map Pre-training for Language-guided Navigation    Dong An, Yuankai Qi, Yangguang Li, Yan Huang, Liang Wang, Tieniu Tan, Jing Shao arXiv_AI arXiv_AI  Transformer  Bert  Pose  PDF
• 2022-12-07 TweetDrought: A Deep-Learning Drought Impacts Recognizer based on Twitter Data    Beichen Zhang, Frank Schilder, Kelly Helm Smith, Michael J. Hayes, Sherri Harms, Tsegaye Tadesse arXiv_CL arXiv_CL  Transformer  Transfer_Learning  Bert  Prediction  PDF
• 2022-12-07 A Study on Extracting Named Entities from Fine-tuned vs. Differentially Private Fine-tuned BERT Models    Andor Diera, Nicolas Lell, Aygul Garifullina, Ansgar Scherp arXiv_CL arXiv_CL  Bert  Text_Classification  Action  Classification  Deep_Learning  Text_Generation  Language_Model  PDF
• 2022-12-07 DeepSpeed Data Efficiency: Improving Deep Learning Model Quality and Training Efficiency via Efficient Data Sampling and Routing    Conglong Li, Zhewei Yao, Xiaoxia Wu, Minjia Zhang, Yuxiong He arXiv_AI arXiv_AI  Bert  Pose  Deep_Learning  Language_Model  PDF
• 2022-12-07 SimVTP: Simple Video Text Pre-training with Masked Autoencoders    Yue Ma, Tianyu Yang, Yin Shan, Xiu Li arXiv_CV arXiv_CV  Transformer  Reconstruction  Bert  Contrastive_Learning  Matching  PDF
• 2022-12-07 Improved Speech Pre-Training with Supervision-Enhanced Acoustic Unit    Pengcheng Li, Genshun Wan, Fenglin Ding, Hang Chen, Jianqing Gao, Jia Pan, Cong Liu arXiv_SD arXiv_SD  Transformer  Recognition  Bert  Speech  Self-Supervised  Pose  Speech_Recognition  PDF
• 2022-12-07 Progressive Multi-Scale Self-Supervised Learning for Speech Recognition    Genshun Wan, Tan Liu, Hang Chen, Jia Pan, Cong Liu, Zhongfu Ye arXiv_SD arXiv_SD  Recognition  Bert  Speech  Self-Supervised  Pose  Attention  Speech_Recognition  PDF
• 2022-12-06 Style transfer and classification in hebrew news items    Nir Weingarten arXiv_CL arXiv_CL  Transformer  Style_Transfer  Bert  Classification  Text_Generation  PDF
• 2022-12-06 SODA: A Natural Language Processing Package to Extract Social Determinants of Health for Cancer Studies    Zehao Yu, Xi Yang, Chong Dang, Prakash Adekkanattu, Braja Gopal Patra, Yifan Peng, Jyotishman Pathak, Debbie L. Wilson, Ching-Yuan Chang, Wei-Hsuan Lo-Ciganic, Thomas J. George, William R. Hogan, Yi Guo, Jiang Bian, Yonghui Wu arXiv_AI arXiv_AI  Transformer  Bert  Action  PDF
• 2022-12-06 Proximal methods for point source localisation    Tuomo Valkonen arXiv_CV arXiv_CV  Bert  PDF
• 2022-12-06 CySecBERT: A Domain-Adapted Language Model for the Cybersecurity Domain    Markus Bayer, Philipp Kuehn, Ramin Shanehsaz, Christian Reuter arXiv_CL arXiv_CL  Bert  Knowledge  Classification  Language_Model  PDF
• 2022-12-06 Modern French Poetry Generation with RoBERTa and GPT-2    Mika Hämäläinen, Khalid Alnajjar, Thierry Poibeau arXiv_CL arXiv_CL  Bert  Emotion  PDF
• 2022-12-06 Self-Supervised Audio-Visual Speech Representations Learning By Multimodal Self-Distillation    Jing-Xuan Zhang, Genshun Wan, Zhen-Hua Ling, Jia Pan, Jianqing Gao, Cong Liu arXiv_SD arXiv_SD  Bert  Speech  Self-Supervised  Pose  Language_Model  PDF
• 2022-12-06 Automated Identification of Eviction Status from Electronic Health Record Notes    Zonghai Yao, Jack Tsai, Weisong Liu, David A. Levy, Emily Druhl, Joel I Reisman, Hong Yu arXiv_CL arXiv_CL  Bert  Knowledge  Classification  Language_Model  Prediction  PDF
• 2022-12-06 LUNA: Language Understanding with Number Augmentations on Transformers via Number Plugins and Pre-training    Hongwei Han, Jialiang Xu, Mengyu Zhou, Yijia Shao, Shi Han, Dongmei Zhang arXiv_CL arXiv_CL  Transformer  Embedding  Bert  Knowledge  Pose  Language_Model  QA  PDF
• 2022-12-06 Enabling and Accelerating Dynamic Vision Transformer Inference for Real-Time Applications    Kavya Sreedhar, Jason Clemons, Rangharajan Venkatesan, Stephen W. Keckler, Mark Horowitz arXiv_CV arXiv_CV  Transformer  Segmentation  Semantic_Segmentation  Bert  Deep_Learning  Attention  Inference  PDF
• 2022-12-05 Inverting Cryptographic Hash Functions via Cube-and-Conquer    Oleg Zaikin arXiv_AI arXiv_AI  Bert  Pose  PDF
• 2022-12-05 Construction of Object Boundaries for the Autopilotof a Surface Robot from Satellite Imagesusing Computer Vision Methods    Aleksandr N. Grekov (1) (2), Yurii E. Shishkin (1), Sergei S. Peliushenko (1), Aleksandr S. Mavrin (1) (2), ((1) Institute of Natural and Technical Systems, (2) Sevastopol State University) arXiv_CV arXiv_CV  Bert  Pose  Face  Contour  PDF
• 2022-12-05 Video Games as a Corpus: Sentiment Analysis using Fallout New Vegas Dialog    Mika Hämäläinen, Khalid Alnajjar, Thierry Poibeau arXiv_CL arXiv_CL  Bert  Sentiment  PDF
• 2022-12-05 Human-in-the-Loop Hate Speech Classification in a Multilingual Context    Ana Kotarcic, Dominik Hangartner, Fabrizio Gilardi, Selina Kurer, Karsten Donnay arXiv_CL arXiv_CL  Bert  Speech  Pose  Classification  PDF
• 2022-12-05 Inspired by Norbert Wiener: FeedBack Loop Network Learning Incremental Knowledge for Driver Attention Prediction and Beyond    Yilong Chen, Zhixiong Nan arXiv_CV arXiv_CV  Transformer  Bert  Salient  Knowledge  Pose  Attention  Autonomous  Prediction  PDF
• 2022-12-05 QBERT: Generalist Model for Processing Questions    Zhaozhen Xu, Nello Cristianini arXiv_AI arXiv_AI  Embedding  Recognition  Bert  Classification  PDF
• 2022-12-04 Applying Multilingual Models to Question Answering    Ayrton San Joaquin, Filip Skubacz arXiv_CL arXiv_CL  Bert  Zero-Shot  Language_Model  QA  PDF
• 2022-12-04 Cross-lingual Similarity of Multilingual Representations Revisited    Maksym Del, Mark Fishel arXiv_AI arXiv_AI  Bert  Zero-Shot  Relation  Language_Model  PDF
• 2022-12-04 Languages You Know Influence Those You Learn: Impact of Language Characteristics on Multi-Lingual Text-to-Text Transfer    Benjamin Muller, Deepanshu Gupta, Siddharth Patwardhan, Jean-Philippe Fauconnier, David Vandyke, Sachin Agarwal arXiv_AI arXiv_AI  Transformer  Bert  Zero-Shot  Knowledge  Few-Shot  Language_Model  PDF
• 2022-12-03 Unsupervised Fine-Tuning Data Selection for ASR Using Self-Supervised Speech Models    Reem Gody, David Harwath arXiv_CL arXiv_CL  Transformer  Unsupervised  Recognition  Bert  Speech  Self-Supervised  Relation  Speech_Recognition  PDF
• 2022-12-02 Twitter Data Analysis: Izmir Earthquake Case    Özgür Agrali, Hakan Sökün, Enis Karaarslan arXiv_AI arXiv_AI  Transformer  Bert  Pose  Relation  Sentiment  GAN  Inference  PDF
• 2022-12-02 ColD Fusion: Collaborative Descent for Distributed Multitask Finetuning    Shachar Don-Yehiya, Elad Venezian, Colin Raffel, Noam Slonim, Yoav Katz, Leshem Choshen arXiv_CL arXiv_CL  Bert  Self-Supervised  Pose  PDF
• 2022-12-01 Analogical Math Word Problems Solving with Enhanced Problem-Solution Association    Zhenwen Liang, Jipeng Zhang, Xiangliang Zhang arXiv_AI arXiv_AI  Bert  Pose  Relation  PDF
• 2022-12-01 CliMedBERT: A Pre-trained Language Model for Climate and Health-related Text    B. Jalalzadeh Fard, S. A. Hasan, J. E. Bell arXiv_CL arXiv_CL  Bert  Knowledge  Pose  Action  Relation  Relation_Extraction  Text_Generation  Language_Model  PDF
• 2022-12-01 Adapted Multimodal BERT with Layer-wise Fusion for Sentiment Analysis    Odysseas S. Chlapanis, Georgios Paraskevopoulos, Alexandros Potamianos arXiv_CV arXiv_CV  Bert  Pose  Classification  Sentiment  Language_Model  PDF
• 2022-12-01 CultureBERT: Fine-Tuning Transformer-Based Language Models for Corporate Culture    Sebastian Koch, Stefan Pasch arXiv_CL arXiv_CL  Transformer  Bert  Text_Classification  Review  Classification  Language_Model  Prediction  PDF
• 2022-12-01 CHAPTER: Exploiting Convolutional Neural Network Adapters for Self-supervised Speech Models    Zih-Ching Chen, Yu-Shun Sung, Hung-yi Lee arXiv_CL arXiv_CL  Transformer  Bert  Speech  Self-Supervised  Pose  Emotion  CNN  PDF
• 2022-11-30 Task-Specific Embeddings for Ante-Hoc Explainable Text Classification    Kishaloy Halder, Josip Krapac, Alan Akbik, Anthony Brew, Matti Lyra arXiv_CL arXiv_CL  Transformer  Embedding  Bert  Text_Classification  Pose  Classification  PDF
• 2022-11-30 Topological Data Analysis for Speech Processing    Eduard Tulchinskii, Kristian Kuznetsov, Laida Kushnareva, Daniil Cherniavskii, Serguei Barannikov, Irina Piontkovskaya, Sergey Nikolenko, Evgeny Burnaev arXiv_CL arXiv_CL  Transformer  Embedding  Bert  Speech  Pose  Classification  Attention  Prediction  PDF
• 2022-11-30 ExtremeBERT: A Toolkit for Accelerating Pretraining of Customized BERT    Rui Pan, Shizhe Diao, Jianlin Chen, Tong Zhang arXiv_CL arXiv_CL  Bert  Language_Model  PDF
• 2022-11-30 RAFT: Rationale adaptor for few-shot abusive language detection    Punyajoy Saha, Divyanshu Sheth, Kushal Kedia, Binny Mathew, Animesh Mukherjee arXiv_CL arXiv_CL  Bert  Pose  Classification  Detection  Few-Shot  PDF
• 2022-11-30 X-PuDu at SemEval-2022 Task 6: Multilingual Learning for English and Arabic Sarcasm Detection    Yaqian Han, Yekun Chai, Shuohuan Wang, Yu Sun, Hongyi Huang, Guanghao Chen, Yitong Xu, Yang Yang arXiv_CL arXiv_CL  Bert  Classification  Detection  Sentiment  Language_Model  PDF
• 2022-11-30 HEAT: Hardware-Efficient Automatic Tensor Decomposition for Transformer Compression    Jiaqi Gu, Ben Keller, Jean Kossaifi, Anima Anandkumar, Brucek Khailany, David Z. Pan arXiv_AI arXiv_AI  Transformer  Bert  Optimization  Knowledge  Pose  Action  Attention  Inference  PDF
• 2022-11-29 Improving astroBERT using Semantic Textual Similarity    Felix Grezes, Thomas Allen, Sergi Blanco-Cuaresma, Alberto Accomazzi, Michael J. Kurtz, Golnaz Shapurian, Edwin Henneken, Carolyn S. Grant, Donna M. Thompson, Timothy W. Hostetler, Matthew R. Templeton, Kelly E. Lockhart, Shinyi Chen, Jennifer Koch, Taylor Jacovich, Pavlos Protopapas arXiv_CL arXiv_CL  Bert  Language_Model  PDF
• 2022-11-29 Evaluating Unsupervised Text Classification: Zero-shot and Similarity-based Approaches    Tim Schopf, Daniel Braun, Florian Matthes arXiv_AI arXiv_AI  Transformer  Embedding  Unsupervised  Bert  Zero-Shot  Text_Classification  Knowledge  Pose  Classification  Medical  PDF
• 2022-11-29 Diverse Multi-Answer Retrieval with Determinantal Point Processes    Poojitha Nandigam, Nikhil Rayaprolu, Manish Shrivastava arXiv_CL arXiv_CL  Bert  Pose  Relation  QA  PDF
• 2022-11-29 Compressing Cross-Lingual Multi-Task Models at Qualtrics    Daniel Campos, Daniel Perry, Samir Joshi, Yashmeet Gambhir, Wei Du, Zhengzheng Xing, Aaron Colak arXiv_CL arXiv_CL  Bert  Text_Classification  Action  Classification  GAN  Inference  Prediction  PDF
• 2022-11-28 Automatically Extracting Information in Medical Dialogue: Expert System And Attention for Labelling    Xinshi Wang, Daniel Tang arXiv_CL arXiv_CL  Bert  Pose  Action  Classification  Attention  Medical  PDF
• 2022-11-28 NeuralMPS: Non-Lambertian Multispectral Photometric Stereo via Spectral Reflectance Decomposition    Jipeng Lv, Heng Guo, Guanying Chen, Jinxiu Liang, Boxin Shi arXiv_CV arXiv_CV  Bert  Pose  Face  PDF
• 2022-11-28 Scientific and Creative Analogies in Pretrained Language Models    Tamara Czinczoll, Helen Yannakoudakis, Pushkar Mishra, Ekaterina Shutova arXiv_CL arXiv_CL  Bert  Pose  Relation  Language_Model  PDF
• 2022-11-28 Revisiting Distance Metric Learning for Few-Shot Natural Language Classification    Witold Sosnowski, Anna Wróblewska, Karolina Seweryn, Piotr Gawrysiak arXiv_AI arXiv_AI  Bert  Classification  Few-Shot  Attention  Inference  Language_Model  PDF
• 2022-11-28 Large Pre-Trained Models with Extra-Large Vocabularies: A Contrastive Analysis of Hebrew BERT Models and a New One to Outperform Them All    Eylon Guetta, Avi Shmidman, Shaltiel Shmidman, Cheyn Shmuel Shmidman, Joshua Guedalia, Moshe Koppel, Dan Bareket, Amit Seker, Reut Tsarfaty arXiv_CL arXiv_CL  Segmentation  Bert  Sentiment  Language_Model  PDF
• 2022-11-28 Distance Metric Learning Loss Functions in Few-Shot Scenarios of Supervised Language Models Fine-Tuning    Witold Sosnowski, Karolina Seweryn, Anna Wróblewska, Piotr Gawrysiak arXiv_AI arXiv_AI  Bert  Classification  Few-Shot  Language_Model  PDF
• 2022-11-28 Handling and extracting key entities from customer conversations using Speech recognition and Named Entity recognition    Sharvi Endait, Ruturaj Ghatage, Prof. DD Kadam arXiv_CL arXiv_CL  Transformer  Recognition  Bert  Speech  Face  Action  Speech_Recognition  PDF
• 2022-11-28 DiffusionBERT: Improving Generative Masked Language Models with Diffusion Models    Zhengfu He, Tianxiang Sun, Kuanning Wang, Xuanjing Huang, Xipeng Qiu arXiv_CL arXiv_CL  Bert  Pose  Denoising  Text_Generation  Language_Model  PDF
• 2022-11-27 AWTE-BERT:Attending to Wordpiece Tokenization Explicitly on BERT for Joint Intent Classification and SlotFilling    Yu Guo, Zhilong Xie, Xingyan Chen, Leilei Wang, Gang Wu arXiv_AI arXiv_AI  Transformer  Bert  Optimization  Pose  Action  Classification  Attention  PDF
• 2022-11-26 SKDBERT: Compressing BERT via Stochastic Knowledge Distillation    Zixiang Ding, Guoqing Jiang, Shuai Zhang, Lin Guo, Wei Lin arXiv_CL arXiv_CL  Bert  Knowledge  Pose  Language_Model  PDF
• 2022-11-25 An Analysis of Social Biases Present in BERT Variants Across Multiple Languages    Aristides Milios (1 and 2), Parishad BehnamGhader (1 and 2) ((1) McGill University, (2) Mila) arXiv_CL arXiv_CL  Transformer  Bert  Pose  Language_Model  PDF
• 2022-11-25 Finetuning BERT on Partially Annotated NER Corpora    Viktor Scherbakov, Vladimir Mayorov arXiv_CL arXiv_CL  Recognition  Bert  RNN  PDF
• 2022-11-25 Competency-Aware Neural Machine Translation: Can Machine Translation Know its Own Translation Quality?    Pei Zhang, Baosong Yang, Haoran Wei, Dayiheng Liu, Kai Fan, Luo Si, Jun Xie arXiv_AI arXiv_AI  Bert  Pose  Quantitative  NMT  Relation  Prediction  PDF
• 2022-11-24 Using Selective Masking as a Bridge between Pre-training and Fine-tuning    Tanish Lad, Himanshu Maheshwari, Shreyas Kottukkal, Radhika Mamidi arXiv_CL arXiv_CL  Transformer  Bert  Sentiment_Classification  Pose  Classification  Sentiment  Language_Model  PDF
• 2022-11-24 Question-type Identification for Academic Questions in Online Learning Platform    Azam Rabiee, Alok Goel, Johnson D'Souza, Saurabh Khanwalkar arXiv_AI arXiv_AI  Bert  Classification  PDF
• 2022-11-24 TESSP: Text-Enhanced Self-Supervised Speech Pre-training    Zhuoyuan Yao, Shuo Ren, Sanyuan Chen, Ziyang Ma, Pengcheng Guo, Lei Xie arXiv_SD arXiv_SD  Transformer  Unsupervised  Recognition  Bert  Speech  Self-Supervised  Pose  Speech_Recognition  Matching  PDF
• 2022-11-24 InDEX: Indonesian Idiom and Expression Dataset for Cloze Test    Xinying Qiu, Guofeng Shi arXiv_CL arXiv_CL  Embedding  Bert  Pose  PDF
• 2022-11-24 Tapping the Potential of Coherence and Syntactic Features in Neural Models for Automatic Essay Scoring    Xinying Qiu, Shuxuan Liao, Jiajun Xie, Jian-Yun Nie arXiv_CL arXiv_CL  Embedding  Bert  Pose  Prediction  PDF
• 2022-11-23 SEAT: Stable and Explainable Attention    Lijie Hu, Yixin Liu, Ninghao Liu, Mengdi Huai, Lichao Sun, Di Wang arXiv_AI arXiv_AI  Embedding  Bert  RNN  Attention  Prediction  PDF
• 2022-11-23 SeedBERT: Recovering Annotator Rating Distributions from an Aggregated Label    Aneesha Sampath, Victoria Lin, Louis-Philippe Morency arXiv_CL arXiv_CL  Bert  Pose  Deep_Learning  Attention  Language_Model  PDF
• 2022-11-23 Improving Visual-textual Sentiment Analysis by Fusing Expert Features    Junyu Chen, Jie An, Hanjia Lyu, Jiebo Luo arXiv_CV arXiv_CV  Bert  Pose  Sentiment  Prediction  PDF
• 2022-11-23 Unified Multimodal Model with Unlikelihood Training for Visual Dialog    Zihao Wang, Junli Wang, Changjun Jiang arXiv_AI arXiv_AI  Bert  Knowledge  Pose  Attention  Language_Model  QA  PDF
• 2022-11-23 Word-Level Representation From Bytes For Language Modeling    Chu-Tak Lee, Qipeng Guo, Xipeng Qiu arXiv_CL arXiv_CL  Embedding  Bert  Text_Classification  Classification  Attention  Image_Classification  Language_Model  Prediction  PDF
• 2022-11-22 OLGA : An Ontology and LSTM-based approach for generating Arithmetic Word Problems of transfer type    Suresh Kumar, P Sreenivasa Kumar arXiv_AI arXiv_AI  Bert  RNN  Knowledge  Pose  Ontology  Relation  PDF
• 2022-11-21 L3Cube-HindBERT and DevBERT: Pre-Trained BERT Transformer models for Devanagari based Hindi and Marathi Languages    Raviraj Joshi arXiv_CL arXiv_CL  Transformer  Recognition  Bert  Text_Classification  Classification  PDF
• 2022-11-21 CBEAF-Adapting: Enhanced Continual Pretraining for Building Chinese Biomedical Language Model    Yongyu Yan, Kui Xue, Qi Ye, Tong Ruan arXiv_CL arXiv_CL  Bert  Pose  Attention  Medical  Language_Model  PDF
• 2022-11-21 TCBERT: A Technical Report for Chinese Topic Classification BERT    Ting Han, Kunhao Pan, Xinyu Chen, Dingjie Song, Yuchen Fan, Xinyu Gao, Ruyi Gan, Jiaxing Zhang arXiv_CL arXiv_CL  Transformer  Bert  Pose  Contrastive_Learning  Classification  GAN  PDF
• 2022-11-21 VATLM: Visual-Audio-Text Pre-Training with Unified Masked Prediction for Speech Representation Learning    Qiushi Zhu, Long Zhou, Ziqiang Zhang, Shujie Liu, Binxing Jiao, Jie Zhang, Lirong Dai, Daxin Jiang, Jinyu Li, Furu Wei arXiv_AI arXiv_AI  Transformer  Recognition  Bert  Represenation_Learning  Speech  Pose  Action  Speech_Recognition  Language_Model  Prediction  PDF
• 2022-11-21 Exploring the Efficacy of Pre-trained Checkpoints in Text-to-Music Generation Task    Shangda Wu, Maosong Sun arXiv_CL arXiv_CL  Bert  PDF
• 2022-11-21 L3Cube-MahaSBERT and HindSBERT: Sentence BERT Models and Benchmarking BERT Sentence Representations for Hindi and Marathi    Ananya Joshi, Aditi Kajale, Janhavi Gadre, Samruddhi Deode, Raviraj Joshi arXiv_CL arXiv_CL  Transformer  Embedding  Bert  Text_Classification  Classification  PDF
• 2022-11-20 Conceptor-Aided Debiasing of Contextualized Embeddings    Yifei Li, Lyle Ungar, João Sedoc arXiv_AI arXiv_AI  Embedding  Bert  Pose  Language_Model  PDF
• 2022-11-20 Understanding and Improving Knowledge Distillation for Quantization-Aware Training of Large Transformer Encoders    Minsoo Kim, Sihwa Lee, Sukjin Hong, Du-Seong Chang, Jungwook Choi arXiv_AI arXiv_AI  Transformer  Quantization  Bert  Knowledge  Pose  Attention  QA  PDF
• 2022-11-20 Feature Weaken: Vicinal Data Augmentation for Classification    Songhao Jiang, Yan Chu, Tianxing Ma, Tianning Zang arXiv_AI arXiv_AI  Bert  Text_Classification  Optimization  Adversarial  Pose  Classification  Deep_Learning  Image_Classification  PDF
• 2022-11-20 Detecting Conspiracy Theory Against COVID-19 Vaccines    Md Hasibul Amin (1), Harika Madanu (1), Sahithi Lavu (1), Hadi Mansourifar (1), Dana Alsagheer (1), Weidong Shi (1) ((1) University Of Houston) arXiv_CL arXiv_CL  Bert  Sentiment  PDF
• 2022-11-19 Entity-Assisted Language Models for Identifying Check-worthy Sentences    Ting Su, Craig Macdonald, Iadh Ounis arXiv_CL arXiv_CL  Embedding  Bert  Text_Classification  RNN  Knowledge  Knowledge_Graph  Speech  Pose  Classification  Language_Model  PDF
• 2022-11-18 Knowledge Graph Refinement based on Triplet BERT-Networks    Armita Khajeh Nassiri (1), Nathalie Pernelle (2), Fatiha Sais (1), Gianluca Quercini (1) ((1) LISN, CNRS UMR 9015, University of Paris Saclay (2) LIPN, CNRS UMR 7030, University of Sorbonne Paris Nord) arXiv_AI arXiv_AI  Transformer  Embedding  Bert  Knowledge  Knowledge_Graph  Pose  Classification  Relation  Few-Shot  Language_Model  Prediction  PDF
• 2022-11-18 CITADEL: Conditional Token Interaction via Dynamic Lexical Routing for Efficient and Effective Multi-Vector Retrieval    Minghan Li, Sheng-Chieh Lin, Barlas Oguz, Asish Ghoshal, Jimmy Lin, Yashar Mehdad, Wen-tau Yih, Xilun Chen arXiv_CL arXiv_CL  Bert  Sparse  Pose  Action  PDF
• 2022-11-18 Metadata Might Make Language Models Better    Kaspar Beelen, Daniel van Strien arXiv_CL arXiv_CL  Bert  Pose  Classification  Language_Model  PDF
• 2022-11-18 Where did you tweet from? Inferring the origin locations of tweets based on contextual information    Rabindra Lamsal, Aaron Harwood, Maria Rodriguez Read arXiv_CL arXiv_CL  Bert  Pose  Action  GAN  PDF
• 2022-11-17 MelHuBERT: A simplified HuBERT on Mel spectrogram    Tzu-Quan Lin, Hung-yi Lee, Hao Tang arXiv_SD arXiv_SD  Bert  Speech  Self-Supervised  Pose  PDF
• 2022-11-17 Random-LTD: Random and Layerwise Token Dropping Brings Efficient Training for Large-scale Transformers    Zhewei Yao, Xiaoxia Wu, Conglong Li, Connor Holmes, Minjia Zhang, Cheng Li, Yuxiong He arXiv_CL arXiv_CL  Transformer  Bert  Zero-Shot  Pose  PDF
• 2022-11-17 ProtSi: Prototypical Siamese Network with Data Augmentation for Few-Shot Subjective Answer Evaluation    Yining Lu, Jingxi Qiu, Gaurav Gupta arXiv_CL arXiv_CL  Unsupervised  Bert  Text_Classification  Pose  Contrastive_Learning  Classification  Few-Shot  PDF
• 2022-11-17 Zero-Shot Dynamic Quantization for Transformer Inference    Yousef El-Kurdi, Jerry Quinn, Avirup Sil arXiv_CL arXiv_CL  Transformer  Quantization  Bert  Zero-Shot  Inference  PDF
• 2022-11-17 Consultation Checklists: Standardising the Human Evaluation of Medical Note Generation    Aleksandar Savkov, Francesco Moramarco, Alex Papadopoulos Korfiatis, Mark Perera, Anya Belz, Ehud Reiter arXiv_CL arXiv_CL  Bert  Pose  Relation  Medical  PDF
• 2022-11-17 LongFNT: Long-form Speech Recognition with Factorized Neural Transducer    Xun Gong, Yu Wu, Jinyu Li, Shujie Liu, Rui Zhao, Xie Chen, Yanmin Qian arXiv_SD arXiv_SD  Recognition  Bert  Speech  Pose  Speech_Recognition  Language_Model  Prediction  PDF
• 2022-11-16 A Graph-Based Context-Aware Model to Understand Online Conversations    Vibhor Agarwal, Anthony P. Young, Sagar Joglekar, Nishanth Sastry arXiv_AI arXiv_AI  Embedding  Bert  Speech  Pose  Classification  Deep_Learning  Detection  Inference  Prediction  PDF
• 2022-11-16 Ischemic Stroke Lesion Prediction using imbalanced Temporal Deep Gaussian Process    Mohsen Soltanpour, Muhammad Yousefnezhad, Russ Greiner, Pierre Boulanger, Brian Buck arXiv_CV arXiv_CV  3D  Bert  Pose  Prediction  PDF
• 2022-11-16 L2 proficiency assessment using self-supervised speech representations    Stefano Bannò, Kate M. Knill, Marco Matassoni, Vyas Raina, Mark J. F. Gales arXiv_CL arXiv_CL  Recognition  Bert  Speech  Self-Supervised  Pose  Speech_Recognition  PDF
• 2022-11-16 Fast and Accurate FSA System Using ELBERT: An Efficient and Lightweight BERT    Siyuan Lu, Chenchen Zhou, Keli Xie, Shiyi Liu, Jun Lin, Zhongfeng Wang arXiv_CL arXiv_CL  Transformer  Bert  Pose  Deep_Learning  Sentiment  PDF
• 2022-11-16 Streaming Joint Speech Recognition and Disfluency Detection    Hayato Futami, Emiru Tsunoo, Kentaro Shibata, Yosuke Kashiwagi, Takao Okuda, Siddhant Arora, Shinji Watanabe arXiv_SD arXiv_SD  Transformer  Recognition  Bert  Speech  Pose  Detection  Speech_Recognition  Inference  Language_Model  PDF
• 2022-11-15 Empowering Language Models with Knowledge Graph Reasoning for Question Answering    Ziniu Hu, Yichong Xu, Wenhao Yu, Shuohang Wang, Ziyi Yang, Chenguang Zhu, Kai-Wei Chang, Yizhou Sun arXiv_CL arXiv_CL  Transformer  Enhancement  Bert  Knowledge  Knowledge_Graph  Pose  Action  Relation  Language_Model  PDF
• 2022-11-15 An FNet based Auto Encoder for Long Sequence News Story Generation    Paul K. Mandal, Rakeshkumar Mahto arXiv_CL arXiv_CL  Bert  Pose  PDF
• 2022-11-15 Multiagent Rollout with Reshuffling for Warehouse Robots Path Planning    William Emanuelsson, Alejandro Penacho Riveiros, Yuchao Li, Karl H. Johansson, Jonas Mårtensson arXiv_RO arXiv_RO  Bert  Pose  PDF
• 2022-11-15 RobBERT-2022: Updating a Dutch Language Model to Account for Evolving Language Use    Pieter Delobelle, Thomas Winters, Bettina Berendt arXiv_CL arXiv_CL  Transformer  Bert  GAN  Language_Model  PDF
• 2022-11-15 Persian Emotion Detection using ParsBERT and Imbalanced Data Handling Approaches    Amirhossein Abaskohi, Nazanin Sabri, Behnam Bahrak arXiv_CL arXiv_CL  Transformer  Recognition  Bert  Speech  Emotion  Detection  Language_Model  PDF
• 2022-11-15 Relationship of the language distance to English ability of a country    Cao Xinxin, Lei Xiaolan, Murtadha Ahmed arXiv_CL arXiv_CL  Embedding  Bert  Pose  Relation  Language_Model  Recommendation  PDF
• 2022-11-14 AdaptKeyBERT: An Attention-Based approach towards Few-Shot & Zero-Shot Domain Adaptation of KeyBERT    Aman Priyanshu, Supriti Vijay arXiv_CL arXiv_CL  Transformer  Bert  Zero-Shot  Pose  Ontology  Action  Few-Shot  Attention  Recommendation  PDF
• 2022-11-14 MT4SSL: Boosting Self-Supervised Speech Representation Learning by Integrating Multiple Targets    Ziyang Ma, Zhisheng Zhen, Changli Tang, Yujin Wang, Xie Chen arXiv_SD arXiv_SD  Transformer  Bert  Represenation_Learning  Speech  Self-Supervised  Pose  PDF
• 2022-11-14 ALBERT with Knowledge Graph Encoder Utilizing Semantic Similarity for Commonsense Question Answering    Byeongmin Choi, YongHyun Lee, Yeunwoong Kyung, Eunchan Kim arXiv_AI arXiv_AI  Transformer  Bert  Knowledge  Knowledge_Graph  Pose  Action  Relation  Language_Model  QA  PDF
• 2022-11-13 Xu at SemEval-2022 Task 4: Pre-BERT Neural Network Methods vs Post-BERT RoBERTa Approach for Patronizing and Condescending Language Detection    Jinghua Xu arXiv_CL arXiv_CL  Bert  Detection  Language_Model  PDF
• 2022-11-12 Improving the Robustness of DistilHuBERT to Unseen Noisy Conditions via Data Augmentation, Curriculum Learning, and Multi-Task Enhancement    Heitor R. Guimarães, Arthur Pimentel, Anderson R. Avila, Mehdi Rezagholizadeh, Tiago H. Falk arXiv_SD arXiv_SD  Enhancement  Recognition  Bert  Represenation_Learning  Speech  Self-Supervised  Pose  Emotion  Action  PDF
• 2022-11-11 The Architectural Bottleneck Principle    Tiago Pimentel, Josef Valvoda, Niklas Stoehr, Ryan Cotterell arXiv_CL arXiv_CL  Transformer  Bert  Pose  Attention  PDF
• 2022-11-11 Improving word mover's distance by leveraging self-attention matrix    Hiroaki Yamagiwa, Sho Yokoi, Hidetoshi Shimodaira arXiv_CL arXiv_CL  Embedding  Bert  Pose  Attention  PDF
• 2022-11-11 Towards automating Numerical Consistency Checks in Financial Reports    Lars Hillebrand, Tobias Deußer, Tim Dilmaghani, Bernd Kliem, Rüdiger Loitz, Christian Bauckhage, Rafet Sifa arXiv_CL arXiv_CL  Bert  Action  Classification  Relation  Relation_Extraction  Matching  PDF
• 2022-11-11 Misinformation Detection using Persuasive Writing Strategies    Joseph Romain, Huiyi Liu, Wei Peng, Jingbo Meng, Parisa Kordjamshidi arXiv_CL arXiv_CL  Bert  Text_Classification  Classification  Detection  Language_Model  Prediction  PDF
• 2022-11-10 BERT in Plutarch's Shadows    Ivan P. Yamshchikov, Alexey Tikhonov, Yorgos Pantis, Charlotte Schubert, Jürgen Jost arXiv_CL arXiv_CL  Bert  Relation  Language_Model  PDF
• 2022-11-10 BERT on a Data Diet: Finding Important Examples by Gradient-Based Pruning    Mohsen Fayyaz, Ehsan Aghazadeh, Ali Modarressi, Mohammad Taher Pilehvar, Yadollah Yaghoobzadeh, Samira Ebrahimi Kahou arXiv_CL arXiv_CL  Bert  Action  Language_Model  PDF
• 2022-11-10 Impact of Adversarial Training on Robustness and Generalizability of Language Models    Enes Altinisik, Hassan Sajjad, Husrev Taha Sencar, Safa Messaoud, Sanjay Chawla arXiv_AI arXiv_AI  Transformer  Embedding  Bert  Knowledge  Adversarial  Relation  Language_Model  PDF
• 2022-11-10 Syntax-Guided Domain Adaptation for Aspect-based Sentiment Analysis    Anguo Dong, Cuiyun Gao, Yan Jia, Qing Liao, Xuan Wang, Lei Wang, Jing Xiao arXiv_AI arXiv_AI  Bert  Knowledge  Review  Pose  Classification  Sentiment  Language_Model  PDF
• 2022-11-10 Biomedical Multi-hop Question Answering Using Knowledge Graph Embeddings and Language Models    Dattaraj J. Rao, Shraddha S. Mane, Mukta A. Paliwal arXiv_AI arXiv_AI  Embedding  Bert  Knowledge  Knowledge_Graph  Face  Relation  Medical  Language_Model  QA  PDF
• 2022-11-10 BERT-Based Combination of Convolutional and Recurrent Neural Network for Indonesian Sentiment Analysis    Hendri Murfi, Syamsyuriani, Theresia Gowandi, Gianinna Ardaneswari, Siti Nurrohmah arXiv_CL arXiv_CL  Transformer  Embedding  Bert  RNN  Emotion  Deep_Learning  Sentiment  Attention  CNN  PDF
• 2022-11-09 Collateral facilitation in humans and language models    James A. Michaelov, Benjamin K. Bergen arXiv_CL arXiv_CL  Transformer  Bert  Language_Model  Prediction  PDF
• 2022-11-09 Cross-lingual Transfer Learning for Check-worthy Claim Identification over Twitter    Maram Hasanain, Tamer Elsayed arXiv_CL arXiv_CL  Transfer_Learning  Bert  Zero-Shot  GAN  PDF
• 2022-11-09 Mask More and Mask Later: Efficient Pre-training of Masked Language Models by Disentangling the MASK Token    Baohao Liao, David Thulke, Sanjika Hewavitharana, Hermann Ney, Christof Monz arXiv_CL arXiv_CL  Transformer  Embedding  Bert  Language_Model  PDF
• 2022-11-08 Discover, Explanation, Improvement: Automatic Slice Detection Framework for Natural Language Processing    Wenyue Hua, Lifeng Jin, Linfeng Song, Haitao Mi, Yongfeng Zhang, Dong Yu arXiv_CL arXiv_CL  Bert  Quantitative  Detection  Attention  PDF
• 2022-11-08 A Multimodal Approach for Dementia Detection from Spontaneous Speech with Tensor Fusion Layer    Loukas Ilias, Dimitris Askounis, John Psarras arXiv_CL arXiv_CL  Transformer  Bert  Speech  Pose  Action  Detection  Attention  PDF
• 2022-11-08 An Ensemble-based approach for assigning text to correct Harmonized system code    Shubham, Avinash Arya, Subarna Roy, Sridhar Jonnala arXiv_AI arXiv_AI  Transformer  Bert  Knowledge  Classification  PDF
• 2022-11-08 Hilbert Distillation for Cross-Dimensionality Networks    Dian Qin, Haishuai Wang, Zhe Liu, Hongjia Xu, Sheng Zhou, Jiajun Bu arXiv_AI arXiv_AI  3D  Bert  Knowledge  Pose  Classification  Attention  Medical  CNN  PDF
• 2022-11-08 Parameter and Data Efficient Continual Pre-training for Robustness to Dialectal Variance in Arabic    Soumajyoti Sarkar, Kaixiang Lin, Sailik Sengupta, Leonard Lausen, Sheng Zha, Saab Mansour arXiv_CL arXiv_CL  Transformer  Bert  Classification  Deep_Learning  Attention  Language_Model  PDF
• 2022-11-07 End-to-End Evaluation of a Spoken Dialogue System for Learning Basic Mathematics    Eda Okur, Saurav Sahay, Roddy Fuentes Alba, Lama Nachman arXiv_CL arXiv_CL  Enhancement  Recognition  Bert  Speech  Action  Speech_Recognition  PDF
• 2022-11-07 AfroLM: A Self-Active Learning-based Multilingual Pretrained Language Model for 23 African Languages    Bonaventure F. P. Dossou, Atnafu Lambebo Tonja, Oreen Yousuf, Salomey Osei, Abigail Oppong, Iyanuoluwa Shode, Oluwabusayo Olufunke Awoyomi, Chris Chinenye Emezue arXiv_AI arXiv_AI  Transformer  Bert  Text_Classification  Optimization  Classification  Sentiment  Language_Model  PDF
• 2022-11-06 Improved Target-specific Stance Detection on Social Media Platforms by Delving into Conversation Threads    Yupeng Li, Haorui He, Shaonan Wang, Francis C.M. Lau, Yunya Song arXiv_CL arXiv_CL  Bert  Pose  Detection  PDF
• 2022-11-06 Suffix Retrieval-Augmented Language Modeling    Zecheng Wang, Yik-Cheung Tam arXiv_CL arXiv_CL  Embedding  Bert  Pose  Language_Model  PDF
• 2022-11-05 BEKG: A Built Environment Knowledge Graph    Xiaojun Yang, Haoyu Zhong, Penglin Du, Keyi Zhou, Xingjin Lai, Zhengdong Wang, Yik Lun Lau, Yangqiu Song, Liyaning Tang arXiv_CL arXiv_CL  Recognition  Bert  Knowledge  Knowledge_Graph  Pose  Action  Relation  Relation_Extraction  PDF
• 2022-11-05 PASTA: Table-Operations Aware Fact Verification via Sentence-Table Cloze Pre-training    Zihui Gu, Ju Fan, Nan Tang, Preslav Nakov, Xiaoman Zhao, Xiaoyong Du arXiv_AI arXiv_AI  Transformer  Bert  Action  Attention  Language_Model  PDF
• 2022-11-04 Intriguing Properties of Compression on Multilingual Models    Kelechi Ogueji, Orevaoghene Ahia, Gbemileke Onilude, Sebastian Gehrmann, Sara Hooker, Julia Kreutzer arXiv_CL arXiv_CL  Recognition  Bert  Pose  Language_Model  PDF
• 2022-11-04 Evaluating and Improving Factuality in Multimodal Abstractive Summarization    David Wan, Mohit Bansal arXiv_CV arXiv_CV  Reinforcement_Learning  Bert  Zero-Shot  Pose  Detection  Relation  Summarization  PDF
• 2022-11-04 BERT for Long Documents: A Case Study of Automated ICD Coding    Arash Afkanpour, Shabir Adeel, Hansenclever Bassani, Arkady Epshteyn, Hongbo Fan, Isaac Jones, Mahan Malihi, Adrian Nauth, Raj Sinha, Sanjana Woonna, Shiva Zamani, Elli Kanal, Mikhail Fomitchev, Donny Cheung arXiv_CL arXiv_CL  Transformer  Bert  PDF
• 2022-11-04 BERT-Deep CNN: State-of-the-Art for Sentiment Analysis of COVID-19 Tweets    Javad Hassannataj Joloudari, Sadiq Hussain, Mohammad Ali Nematollahi, Rouhollah Bagheri, Fatemeh Fazl, Roohallah Alizadehsani, Reza Lashgari arXiv_CL arXiv_CL  Bert  Review  Emotion  Survey  Sentiment  PDF
• 2022-11-04 Continuous Prompt Tuning Based Textual Entailment Model for E-commerce Entity Typing    Yibo Wang, Congying Xia, Guan Wang, Philip Yu arXiv_CL arXiv_CL  Embedding  Bert  Pose  Activity  PDF
• 2022-11-04 Miko Team: Deep Learning Approach for Legal Question Answering in ALQAC 2022    Hieu Nguyen Van, Dat Nguyen, Phuong Minh Nguyen, Minh Le Nguyen arXiv_CL arXiv_CL  Bert  Deep_Learning  QA  PDF
• 2022-11-03 Quantifying Model Uncertainty for Semantic Segmentation using Operators in the RKHS    Rishabh Singh, Jose C. Principe arXiv_CV arXiv_CV  Segmentation  Semantic_Segmentation  Bert  Action  Deep_Learning  PDF
• 2022-11-03 Exploring the State-of-the-Art Language Modeling Methods and Data Augmentation Techniques for Multilingual Clause-Level Morphology    Emre Can Acikgoz, Tilek Chubakov, Müge Kural, Gözde Gül Şahin, Deniz Yuret arXiv_CL arXiv_CL  Transformer  Bert  Language_Model  PDF
• 2022-11-03 Hybrid-SD : A new hybrid evaluation metric for automatic speech recognition tasks    Zitha Sasindran, Harsha Yelchuri, Supreeth Rao, T. V. Prabhakar arXiv_CL arXiv_CL  Recognition  Bert  Speech  Pose  Speech_Recognition  PDF
• 2022-11-03 Channel-Aware Pretraining of Joint Encoder-Decoder Self-Supervised Model for Telephonic-Speech ASR    Vrunda N. Sukhadia, A. Arunkumar, S. Umesh arXiv_SD arXiv_SD  Transformer  Bert  Speech  Self-Supervised  Pose  PDF
• 2022-11-03 Revisiting Grammatical Error Correction Evaluation and Beyond    Peiyuan Gong, Xuebo Liu, Heyan Huang, Min Zhang arXiv_CL arXiv_CL  Bert  Knowledge  Pose  Relation  Attention  Summarization  PDF
• 2022-11-03 Fine-Tuning Language Models via Epistemic Neural Networks    Ian Osband, Seyed Mohammad Asghari, Benjamin Van Roy, Nat McAleese, John Aslanides, Geoffrey Irving arXiv_CL arXiv_CL  Unsupervised  Bert  Language_Model  PDF
• 2022-11-02 RQUGE: Reference-Free Metric for Evaluating Question Generation by Answering the Question    Alireza Mohammadshahi, Thomas Scialom, Majid Yazdani, Pouya Yanki, Angela Fan, James Henderson, Marzieh Saeidi arXiv_CL arXiv_CL  Bert  Adversarial  Pose  Relation  QA  PDF
• 2022-11-02 Multi-level Distillation of Semantic Knowledge for Pre-training Multilingual Language Model    Mingqi Li, Fei Ding, Dan Zhang, Long Cheng, Hongxin Hu, Feng Luo arXiv_CL arXiv_CL  Transformer  Bert  Knowledge  Pose  Relation  Language_Model  PDF
• 2022-11-02 M-SpeechCLIP: Leveraging Large-Scale, Pre-Trained Models for Multilingual Speech to Image Retrieval    Layne Berry, Yi-Jen Shih, Hsuan-Fu Wang, Heng-Jui Chang, Hung-yi Lee, David Harwath arXiv_CL arXiv_CL  Transformer  Bert  Image_Retrieval  Speech  PDF
• 2022-11-02 Transformer-based encoder-encoder architecture for Spoken Term Detection    Jan Švec, Luboš Šmídl, Jan Lehečka arXiv_CL arXiv_CL  Transformer  Embedding  Bert  RNN  Speech  Pose  Detection  Attention  CNN  PDF
• 2022-11-02 Processing Long Legal Documents with Pre-trained Transformers: Modding LegalBERT and Longformer    Dimitris Mamakas, Petros Tsotsi, Ion Androutsopoulos, Ilias Chalkidis arXiv_CL arXiv_CL  Transformer  Bert  Sparse  Pose  Classification  Attention  PDF
• 2022-11-02 BECTRA: Transducer-based End-to-End ASR with BERT-Enhanced Encoder    Yosuke Higuchi, Tetsuji Ogawa, Tetsunori Kobayashi, Shinji Watanabe arXiv_CL arXiv_CL  Recognition  Bert  Knowledge  Speech  Pose  Speech_Recognition  Inference  Language_Model  PDF
• 2022-11-01 Reduce, Reuse, Recycle: Improving Training Efficiency with Distillation    Cody Blakeney, Jessica Zosa Forde, Jonathan Frankle, Ziliang Zong, Matthew L. Leavitt arXiv_AI arXiv_AI  Bert  Optimization  Classification  Deep_Learning  Image_Classification  Language_Model  PDF
• 2022-11-01 T5lephone: Bridging Speech and Text Self-supervised Models for Spoken Language Understanding via Phoneme level T5    Chan-Jan Hsu, Ho-Lam Chung, Hung-yi Lee, Yu Tsao arXiv_CL arXiv_CL  Bert  Speech  Self-Supervised  Language_Model  QA  PDF
• 2022-11-01 Investigating Content-Aware Neural Text-To-Speech MOS Prediction Using Prosodic and Linguistic Features    Alexandra Vioni, Georgia Maniati, Nikolaos Ellinas, June Sig Sung, Inchul Hwang, Aimilios Chalamandaris, Pirros Tsiakoulis arXiv_CL arXiv_CL  Embedding  Bert  Speech  Self-Supervised  Pose  Relation  Prediction  PDF
• 2022-11-01 CCS Explorer: Relevance Prediction, Extractive Summarization, and Named Entity Recognition from Clinical Cohort Studies    Irfan Al-Hussaini, Davi Nakajima An, Albert J. Lee, Sarah Bi, Cassie S. Mitchell arXiv_AI arXiv_AI  Transformer  Recognition  Bert  Pose  Face  Detection  Summarization  Language_Model  Prediction  PDF
• 2022-10-31 Leveraging Pre-trained Models for Failure Analysis Triplets Generation    Kenneth Ezukwoke, Anis Hoayek, Mireille Batton-Hubert, Xavier Boucher, Pascal Gounet, Jerome Adrian arXiv_CL arXiv_CL  Transformer  Bert  RNN  Action  Attention  Summarization  Language_Model  PDF
• 2022-10-31 Audio-Visual Speech Enhancement and Separation by Leveraging Multi-Modal Self-Supervised Embeddings    I-Chun Chern, Kuo-Hsuan Hung, Yi-Ting Chen, Tassadaq Hussain, Mandar Gogate, Amir Hussain, Yu Tsao, Jen-Cheng Hou arXiv_SD arXiv_SD  Embedding  Enhancement  Recognition  Bert  Speech  Self-Supervised  Pose  Speech_Recognition  PDF
• 2022-10-31 Emergent Linguistic Structures in Neural Networks are Fragile    Emanuele La Malfa, Matthew Wicker, Marta Kiatkowska arXiv_CL arXiv_CL  Bert  Pose  Attention  Language_Model  PDF
• 2022-10-31 IITD at the WANLP 2022 Shared Task: Multilingual Multi-Granularity Network for Propaganda Detection    Shubham Mittal, Preslav Nakov arXiv_CL arXiv_CL  Bert  Classification  Detection  GAN  PDF
• 2022-10-31 SDCL: Self-Distillation Contrastive Learning for Chinese Spell Checking    Xiaotian Zhang, Hang Yan, Sun Yu, Xipeng Qiu arXiv_CL arXiv_CL  Bert  Pose  Contrastive_Learning  PDF
• 2022-10-31 Improving Cause-of-Death Classification from Verbal Autopsy Reports    Thokozile Manaka, Terence van Zyl, Deepak Kar arXiv_CL arXiv_CL  Transformer  Embedding  Transfer_Learning  Bert  Classification  Language_Model  PDF
• 2022-10-31 QuaLA-MiniLM: a Quantized Length Adaptive MiniLM    Shira Guskin, Moshe Wasserblat, Chang Wang, Haihao Shen arXiv_CL arXiv_CL  Transformer  Embedding  Quantization  Bert  Knowledge  Inference  PDF
• 2022-10-30 Improving Bilingual Lexicon Induction with Cross-Encoder Reranking    Yaoyiran Li, Fangyu Liu, Ivan Vulić, Anna Korhonen arXiv_CL arXiv_CL  Embedding  Bert  Knowledge  Pose  Inference  Language_Model  PDF
• 2022-10-30 Parameter-Efficient Tuning Makes a Good Classification Head    Zhuoyi Yang, Ming Ding, Yanhui Guo, Qingsong Lv, Jie Tang arXiv_CL arXiv_CL  Bert  Classification  PDF
• 2022-10-29 BERT Meets CTC: New Formulation of End-to-End Speech Recognition with Pre-trained Masked Language Model    Yosuke Higuchi, Brian Yan, Siddhant Arora, Tetsuji Ogawa, Tetsunori Kobayashi, Shinji Watanabe arXiv_CL arXiv_CL  Embedding  Recognition  Bert  Knowledge  Speech  Classification  Attention  Speech_Recognition  Inference  Language_Model  PDF
• 2022-10-29 Empirical Evaluation of Post-Training Quantization Methods for Language Tasks    Ting Hu, Christoph Meinel, Haojin Yang arXiv_CL arXiv_CL  Transformer  Quantization  Bert  PDF
• 2022-10-29 Application of Knowledge Distillation to Multi-task Speech Representation Learning    Mine Kerpicci, Van Nguyen, Shuhua Zhang, Erik Visser arXiv_CL arXiv_CL  Recognition  Bert  Represenation_Learning  Knowledge  Speech  Self-Supervised  Pose  Speech_Recognition  PDF
• 2022-10-29 Exploiting prompt learning with pre-trained language models for Alzheimer's Disease detection    Yi Wang, Jiajun Deng, Tianzi Wang, Bo Zheng, Shoukang Hu, Xunying Liu, Helen Meng arXiv_CL arXiv_CL  Embedding  Bert  Speech  Classification  Detection  Language_Model  Prediction  PDF
• 2022-10-29 Two is Better than Many? Binary Classification as an Effective Approach to Multi-Choice Question Answering    Deepanway Ghosal, Navonil Majumder, Rada Mihalcea, Soujanya Poria arXiv_CL arXiv_CL  Bert  Pose  Classification  QA  PDF
• 2022-10-28 DiMBERT: Learning Vision-Language Grounded Representations with Disentangled Multimodal-Attention    Fenglin Liu, Xian Wu, Shen Ge, Xuancheng Ren, Wei Fan, Xu Sun, Yuexian Zou arXiv_CL arXiv_CL  Image_Caption  Transformer  Bert  Pose  Classification  Relation  Attention  Caption  Language_Model  PDF
• 2022-10-28 Probing for targeted syntactic knowledge through grammatical error detection    Christopher Davis, Christopher Bryant, Andrew Caines, Marek Rei, Paula Buttery arXiv_CL arXiv_CL  Bert  Knowledge  Pose  Detection  Language_Model  PDF
• 2022-10-28 Feature Engineering vs BERT on Twitter Data    Ryiaadh Gani, Lisa Chalaguine arXiv_CL arXiv_CL  Embedding  Bert  Language_Model  PDF
• 2022-10-28 Zero-Shot Text Matching for Automated Auditing using Sentence Transformers    David Biesner, Maren Pielka, Rajkumar Ramamurthy, Tim Dilmaghani, Bernd Kliem, Rüdiger Loitz, Rafet Sifa arXiv_CL arXiv_CL  Transformer  Unsupervised  Bert  Zero-Shot  Classification  Matching  PDF
• 2022-10-28 Analyzing Acoustic Word Embeddings from Pre-trained Self-supervised Speech Models    Ramon Sanabria, Hao Tang, Sharon Goldwater arXiv_CL arXiv_CL  Embedding  Bert  Speech  Self-Supervised  PDF
• 2022-10-28 BEBERT: Efficient and robust binary ensemble BERT    Jiayi Tian, Chao Fang, Haonan Wang, Zhongfeng Wang arXiv_CL arXiv_CL  Bert  Knowledge  Pose  PDF
• 2022-10-28 RoChBert: Towards Robust BERT Fine-tuning for Chinese    Zihan Zhang, Jinfeng Li, Ning Shi, Bo Yuan, Xiangyu Liu, Rong Zhang, Hui Xue, Donghong Sun, Chao Zhang arXiv_CL arXiv_CL  Transformer  Bert  Adversarial  Pose  Language_Model  PDF
• 2022-10-28 On the Use of Modality-Specific Large-Scale Pre-Trained Encoders for Multimodal Sentiment Analysis    Atsushi Ando, Ryo Masumura, Akihiko Takashima, Satoshi Suzuki, Naoki Makishima, Keita Suzuki, Takafumi Moriya, Takanori Ashihara, Hiroshi Sato arXiv_CL arXiv_CL  Bert  Sentiment  PDF
• 2022-10-28 Leveraging Label Correlations in a Multi-label Setting: A Case Study in Emotion    Georgios Chochlakis (1 and 2), Gireesh Mahajan (3), Sabyasachee Baruah (1 and 2), Keith Burghardt (2), Kristina Lerman (2), Shrikanth Narayanan (1 and 2) ((1) Signal Analysis and Interpretation Lab, University of Southern California, (2) Information Science Institute, University of Southern California, (3) Microsoft Cognitive Services) arXiv_AI arXiv_AI  Recognition  Bert  Regularization  Emotion  Classification  Detection  Relation  Language_Model  PDF
• 2022-10-27 Exploring Effective Distillation of Self-Supervised Speech Models for Automatic Speech Recognition    Yujin Wang, Changli Tang, Ziyang Ma, Zhisheng Zheng, Xie Chen, Wei-Qiang Zhang arXiv_CL arXiv_CL  Recognition  Bert  Speech  Self-Supervised  Speech_Recognition  Inference  PDF
• 2022-10-27 COST-EFF: Collaborative Optimization of Spatial and Temporal Efficiency with Slenderized Multi-exit Language Models    Bowen Shen, Zheng Lin, Yuanxin Liu, Zhengxiao Liu, Lei Wang, Weiping Wang arXiv_CL arXiv_CL  Transformer  Bert  Optimization  Pose  Inference  Language_Model  Prediction  PDF
• 2022-10-27 Self-consistent Reasoning For Solving Math Word Problems    Jing Xiong, Zhongwei Wan, Xiping Hu, Min Yang, Chengming Li arXiv_CL arXiv_CL  Bert  Pose  Relation  PDF
• 2022-10-27 FCTalker: Fine and Coarse Grained Context Modeling for Expressive Conversational Speech Synthesis    Yifan Hu, Rui Liu, Guanglai Gao, Haizhou Li arXiv_CL arXiv_CL  Bert  Speech  Pose  Relation  PDF
• 2022-10-27 Seq2Seq-SC: End-to-End Semantic Communication Systems with Pre-trained Language Model    Ju-Hyung Lee, Dong-Ho Lee, Eunsoo Sheen, Thomas Choi, Jay Pujara, Joongheon Kim arXiv_CL arXiv_CL  Bert  Language_Model  PDF
• 2022-10-27 Unsupervised Boundary-Aware Language Model Pretraining for Chinese Sequence Labeling    Peijie Jiang, Dingkun Long, Yanzhao Zhang, Pengjun Xie, Meishan Zhang, Min Zhang arXiv_AI arXiv_AI  Segmentation  Unsupervised  Recognition  Bert  Speech  Pose  Language_Model  PDF
• 2022-10-27 Fast DistilBERT on CPUs    Haihao Shen, Ofir Zafrir, Bo Dong, Hengyu Meng, Xinyu Ye, Zhe Wang, Yi Ding, Hanwen Chang, Guy Boudoukh, Moshe Wasserblat arXiv_CL arXiv_CL  Transformer  Quantization  Bert  Sparse  Knowledge  Pose  Inference  Language_Model  PDF
• 2022-10-27 BERT-Flow-VAE: A Weakly-supervised Model for Multi-Label Text Classification    Ziwen Liu, Josep Grau-Bove, Scott Allan Orr arXiv_CL arXiv_CL  Embedding  Bert  Text_Classification  Sparse  Pose  Face  Classification  Prediction  PDF
• 2022-10-27 COCO-DR: Combating Distribution Shifts in Zero-Shot Dense Retrieval with Contrastive and Distributionally Robust Learning    Yue Yu, Chenyan Xiong, Si Sun, Chao Zhang, Arnold Overwijk arXiv_CL arXiv_CL  Embedding  Bert  Zero-Shot  Optimization  Relation  Language_Model  PDF
• 2022-10-27 Open-vocabulary Semantic Segmentation with Frozen Vision-Language Models    Chaofan Ma, Yuhuan Yang, Yanfeng Wang, Ya Zhang, Weidi Xie arXiv_CV arXiv_CV  Transformer  Segmentation  Semantic_Segmentation  Bert  Zero-Shot  Self-Supervised  Pose  Language_Model  PDF
• 2022-10-27 Masked Vision-Language Transformer in Fashion    Ge-Peng Ji, Mingcheng Zhuge, Dehong Gao, Deng-Ping Fan, Christos Sakaridis, Luc Van Gool arXiv_CV arXiv_CV  Transformer  Reconstruction  Recognition  Bert  Matching  PDF
• 2022-10-26 Causality Detection using Multiple Annotation Decision    Quynh Anh Nguyen, Arka Mitra arXiv_CL arXiv_CL  Bert  Action  Detection  Language_Model  PDF
• 2022-10-26 Don't Prompt, Search! Mining-based Zero-Shot Learning with Language Models    Mozes van de Kar, Mengzhou Xia, Danqi Chen, Mikel Artetxe arXiv_AI arXiv_AI  Bert  Zero-Shot  Text_Classification  Pose  Classification  Language_Model  PDF
• 2022-10-26 Multilevel Transformer For Multimodal Emotion Recognition    Junyi He, Meimei Wu, Meng Li, Xiaobo Zhu, Feng Ye arXiv_CL arXiv_CL  Transformer  Embedding  Recognition  Bert  Speech  Pose  Emotion  Attention  PDF
• 2022-10-26 Leveraging Affirmative Interpretations from Negation Improves Natural Language Understanding    Md Mosharaf Hossain, Eduardo Blanco arXiv_CL arXiv_CL  Bert  Pose  Sentiment  Inference  PDF
• 2022-10-26 Bi-Link: Bridging Inductive Link Predictions from Text via Contrastive Learning of Transformers and Prompts    Bohua Peng, Shihao Liang, Mobarakol Islam arXiv_CL arXiv_CL  Transformer  Bert  Knowledge  Knowledge_Graph  Pose  Contrastive_Learning  Relation  Language_Model  Prediction  PDF
• 2022-10-26 Exploring Robustness of Prefix Tuning in Noisy Data: A Case Study in Financial Sentiment Analysis    Sudhandar Balakrishnan, Yihao Fang, Xioadan Zhu arXiv_CL arXiv_CL  Transformer  Bert  Face  Sentiment  PDF
• 2022-10-25 Causal Analysis of Syntactic Agreement Neurons in Multilingual Language Models    Aaron Mueller, Yu Xia, Tal Linzen arXiv_CL arXiv_CL  Bert  Relation  Language_Model  PDF
• 2022-10-25 Universal Evasion Attacks on Summarization Scoring    Wenchuan Mu, Kwan Hui Lim arXiv_CL arXiv_CL  Bert  Pose  Summarization  PDF
• 2022-10-25 IELM: An Open Information Extraction Benchmark for Pre-Trained Language Models    Chenguang Wang, Xiao Liu, Dawn Song arXiv_AI arXiv_AI  Bert  Zero-Shot  Knowledge  Action  Relation  Language_Model  PDF
• 2022-10-25 DEMETR: Diagnosing Evaluation Metrics for Translation    Marzena Karpinska, Nishant Raj, Katherine Thai, Yixiao Song, Ankita Gupta, Mohit Iyyer arXiv_CL arXiv_CL  Bert  Relation  Language_Model  PDF
• 2022-10-25 Parameter-Efficient Legal Domain Adaptation    Jonathan Li, Rohan Bhambhoria, Xiaodan Zhu arXiv_CL arXiv_CL  Transformer  Unsupervised  Bert  Knowledge  Pose  Language_Model  PDF
• 2022-10-24 VLC-BERT: Visual Question Answering with Contextualized Commonsense Knowledge    Sahithya Ravi, Aditya Chinchure, Leonid Sigal, Renjie Liao, Vered Shwartz arXiv_CV arXiv_CV  Transformer  Bert  Knowledge  Pose  VQA  QA  PDF
• 2022-10-24 Learning by Hallucinating: Vision-Language Pre-training with Weak Supervision    Tzu-Jui Julius Wang, Jorma Laaksonen, Tomas Langer, Heikki Arponen, Tom E. Bishop arXiv_CV arXiv_CV  Image_Caption  Transformer  Bert  Image_Retrieval  Pose  Action  VQA  Caption  PDF
• 2022-10-24 Effective Pre-Training Objectives for Transformer-based Autoencoders    Luca Di Liello, Matteo Gabburo, Alessandro Moschitti arXiv_CL arXiv_CL  Transformer  Bert  Pose  PDF
• 2022-10-24 Classification of Misinformation in New Articles using Natural Language Processing and a Recurrent Neural Network    Brendan Cunha, Lydia Manikonda arXiv_CL arXiv_CL  Bert  Classification  PDF
• 2022-10-24 Entity-level Sentiment Analysis in Contact Center Telephone Conversations    Xue-Yong Fu, Cheng Chen, Md Tahmid Rahman Laskar, Shayna Gardiner, Pooja Hiranandani, Shashi Bhushan TN arXiv_CL arXiv_CL  Transformer  Bert  Emotion  Sentiment  CNN  PDF
• 2022-10-24 Explaining Translationese: why are Neural Classifiers Better and what do they Learn?    Kwabena Amponsah-Kaakyire, Daria Pylypenko, Josef van Genabith, Cristina España-Bonet arXiv_CL arXiv_CL  Bert  Classification  Relation  PDF
• 2022-10-24 Universal and Independent: Multilingual Probing Framework for Exhaustive Model Interpretation and Evaluation    Oleg Serikov, Vitaly Protasov, Ekaterina Voloshina, Viktoria Knyazkova, Tatiana Shavrina arXiv_AI arXiv_AI  Bert  Knowledge  Pose  Language_Model  PDF
• 2022-10-24 Mutual Information Alleviates Hallucinations in Abstractive Summarization    Liam van der Poel, Ryan Cotterell, Clara Meister arXiv_CL arXiv_CL  Bert  Pose  Summarization  PDF
• 2022-10-24 The Better Your Syntax, the Better Your Semantics? Probing Pretrained Language Models for the English Comparative Correlative    Leonie Weissweiler, Valentin Hofmann, Abdullatif Köksal, Hinrich Schütze arXiv_CL arXiv_CL  Bert  Knowledge  Classification  Language_Model  PDF
• 2022-10-24 Proficiency assessment of L2 spoken English using wav2vec 2.0    Stefano Bannò, Marco Matassoni arXiv_CL arXiv_CL  Bert  Salient  Speech  PDF
• 2022-10-24 Exploring Euphemism Detection in Few-Shot and Zero-Shot Settings    Sedrick Scott Keh arXiv_CL arXiv_CL  Bert  Zero-Shot  Pose  Detection  Few-Shot  Language_Model  PDF
• 2022-10-23 Bootstrapping meaning through listening: Unsupervised learning of spoken sentence embeddings    Jian Zhu, Zuoyu Tian, Yadong Liu, Cong Zhang, Chia-wen Lo arXiv_CL arXiv_CL  Embedding  Unsupervised  Bert  Knowledge  Speech  Pose  Contrastive_Learning  Relation  PDF
• 2022-10-23 Automated Essay Scoring using Transformers    Kshitij Gupta arXiv_AI arXiv_AI  Transformer  Bert  RNN  Attention  PDF
• 2022-10-23 On Cross-Domain Pre-Trained Language Models for Clinical Text Mining: How Do They Perform on Data-Constrained Fine-Tuning?    Yuping Wu, Lifeng Han, Valerio Antonini, Goran Nenadic arXiv_AI arXiv_AI  Transformer  Recognition  Bert  Medical  Language_Model  PDF
• 2022-10-23 A BERT-based Deep Learning Approach for Reputation Analysis in Social Media    Mohammad Wali Ur Rahman, Sicong Shao, Pratik Satam, Salim Hariri, Chris Padilla, Zoe Taylor, Carlos Nevarez arXiv_CL arXiv_CL  Transformer  Bert  Pose  Face  Action  Deep_Learning  Language_Model  PDF
• 2022-10-22 Meta-learning Pathologies from Radiology Reports using Variance Aware Prototypical Networks    Arijit Sehanobish, Kawshik Kannan, Nabila Abraham, Anasuya Das, Benjamin Odry arXiv_CL arXiv_CL  Transformer  Bert  Text_Classification  Regularization  Pose  Classification  Few-Shot  Language_Model  PDF
• 2022-10-21 SpaBERT: A Pretrained Language Model from Geographic Data for Geo-Entity Representation    Zekun Li, Jina Kim, Yao-Yi Chiang, Muhao Chen arXiv_AI arXiv_AI  Embedding  Bert  Pose  Relation  Language_Model  Prediction  PDF
• 2022-10-21 Probing with Noise: Unpicking the Warp and Weft of Embeddings    Filip Klubička, John D. Kelleher arXiv_AI arXiv_AI  Embedding  Bert  Relation  PDF
• 2022-10-21 Discovering Differences in the Representation of People using Contextualized Semantic Axes    Li Lucy, Divya Tadimeti, David Bamman arXiv_CL arXiv_CL  Embedding  Bert  PDF
• 2022-10-21 Multimodal Model with Text and Drug Embeddings for Adverse Drug Reaction Classification    Andrey Sakhovskiy, Elena Tutubalina arXiv_CL arXiv_CL  Embedding  Bert  Action  Classification  Prediction  PDF
• 2022-10-21 LittleBird: Efficient Faster & Longer Transformer for Question Answering    Minchul Lee (1), Kijong Han (1), Myeong Cheol Shin (1) ((1) Kakao Enterprise Corp.) arXiv_AI arXiv_AI  Transformer  Bert  Pose  Attention  Language_Model  PDF
• 2022-10-21 A Textless Metric for Speech-to-Speech Comparison    Laurent Besacier, Swen Ribeiro, Olivier Galibert, Ioan Calapodescu arXiv_CL arXiv_CL  Bert  Speech  Pose  PDF
• 2022-10-21 Evidence of Vocal Tract Articulation in Self-Supervised Learning of Speech    Cheol Jun Cho, Peter Wu, Abdelrahman Mohamed, Gopala K. Anumanchipalli arXiv_AI arXiv_AI  Transformer  Bert  Speech  Self-Supervised  Pose  Relation  Attention  PDF
• 2022-10-21 SLING: Sino Linguistic Evaluation of Large Language Models    Yixiao Song, Kalpesh Krishna, Rajesh Bhatt, Mohit Iyyer arXiv_CL arXiv_CL  Bert  Knowledge  Language_Model  PDF
• 2022-10-20 Tele-Knowledge Pre-training for Fault Analysis    Zhuo Chen, Wen Zhang, Yufeng Huang, Mingyang Chen, Yuxia Geng, Hongtao Yu, Zhen Bi, Yichi Zhang, Zhen Yao, Wenting Song, Xinliang Wu, Yi Yang, Song Jiang, Zhaoyang Lian, Yingying Li, Huajun Chen arXiv_AI arXiv_AI  Transformer  Bert  Knowledge  Pose  GAN  Prediction  PDF
• 2022-10-20 Automatic Document Selection for Efficient Encoder Pretraining    Yukun Feng, Patrick Xia, Benjamin Van Durme, João Sedoc arXiv_CL arXiv_CL  Bert  Pose  Language_Model  PDF
• 2022-10-19 BioGPT: Generative Pre-trained Transformer for Biomedical Text Generation and Mining    Renqian Luo, Liai Sun, Yingce Xia, Tao Qin, Sheng Zhang, Hoifung Poon, Tie-Yan Liu arXiv_AI arXiv_AI  Transformer  Bert  Pose  Action  Relation  Relation_Extraction  Attention  Text_Generation  Medical  Language_Model  QA  PDF
• 2022-10-19 A Unified Neural Network Model for Readability Assessment with Feature Projection and Length-Balanced Loss    Wenbiao Li, Ziyang Wang, Yunfang Wu arXiv_CL arXiv_CL  Bert  Knowledge  Pose  Deep_Learning  PDF
• 2022-10-19 Forging Multiple Training Objectives for Pre-trained Language Models via Meta-Learning    Hongqiu Wu, Ruixue Ding, Hai Zhao, Boli Chen, Pengjun Xie, Fei Huang, Min Zhang arXiv_CL arXiv_CL  Transformer  Bert  Pose  Language_Model  PDF
• 2022-10-19 Language Model Decomposition: Quantifying the Dependency and Correlation of Language Models    Hao Zhang arXiv_AI arXiv_AI  Bert  Pose  Relation  Language_Model  PDF
• 2022-10-18 ELASTIC: Numerical Reasoning with Adaptive Symbolic Compiler    Jiaxin Zhang, Yashar Moshfeghi arXiv_AI arXiv_AI  Bert  QA  PDF
• 2022-10-18 A Simple and Effective Method to Improve Zero-Shot Cross-Lingual Transfer Learning    Kunbo Ding, Weijie Liu, Yuejian Fang, Weiquan Mao, Zhe Zhao, Tao Zhu, Haoyan Liu, Rong Tian, Yiren Chen arXiv_CL arXiv_CL  Embedding  Transfer_Learning  Bert  Zero-Shot  Text_Classification  Pose  Classification  Attention  PDF
• 2022-10-18 Probing Cross-modal Semantics Alignment Capability from the Textual Perspective    Zheng Ma, Shi Zong, Mianzhi Pan, Jianbing Zhang, Shujian Huang, Xinyu Dai, Jiajun Chen arXiv_CL arXiv_CL  Image_Caption  Transformer  Bert  Pose  Attention  Caption  PDF
• 2022-10-17 Using Bottleneck Adapters to Identify Cancer in Clinical Notes under Low-Resource Constraints    Omid Rohanian, Hannah Jauncey, Mohammadmahdi Nouriborji, Bronner P. Gonçalves, Christiana Kartsonaki, ISARIC Clinical Characterisation Group, Laura Merson, David Clifton arXiv_AI arXiv_AI  Transformer  Bert  RNN  Medical  PDF
• 2022-10-17 Fine-tuned Sentiment Analysis of COVID-19 Vaccine-Related Social Media Data: Comparative Study    Chad A Melton, Brianna M White, Robert L Davis, Robert A Bednarczyk, Arash Shaban-Nejad arXiv_CL arXiv_CL  Bert  Pose  Face  Sentiment  PDF
• 2022-10-17 Zero-Shot Ranking Socio-Political Texts with Transformer Language Models to Reduce Close Reading Time    Kiymet Akdemir, Ali Hürriyetoğlu arXiv_CL arXiv_CL  Transformer  Bert  Zero-Shot  Action  Classification  Language_Model  PDF
• 2022-10-16 Acoustic-aware Non-autoregressive Spell Correction with Mask Sample Decoding    Ruchao Fan, Guoli Ye, Yashesh Gaur, Jinyu Li arXiv_SD arXiv_SD  Transformer  Recognition  Bert  Speech  Pose  Speech_Recognition  Language_Model  PDF
• 2022-10-16 CTCBERT: Advancing Hidden-unit BERT with CTC Objectives    Ruchao Fan, Yiming Wang, Yashesh Gaur, Jinyu Li arXiv_SD arXiv_SD  Bert  Speech  Classification  PDF
• 2022-10-16 Improving Semantic Matching through Dependency-Enhanced Pre-trained Model with Adaptive Fusion    Jian Song, Di Liang, Rumei Li, Yuntao Li, Sirui Wang, Minlong Peng, Wei Wu, Yongxin Yu arXiv_AI arXiv_AI  Transformer  Bert  Knowledge  Pose  Relation  Attention  Matching  PDF
• 2022-10-15 A Simple and Strong Baseline for End-to-End Neural RST-style Discourse Parsing    Naoki Kobayashi, Tsutomu Hirao, Hidetaka Kamigaito, Manabu Okumura, Masaaki Nagata arXiv_CL arXiv_CL  Transformer  Bert  Language_Model  Prediction  PDF
• 2022-10-15 AraLegal-BERT: A pretrained language model for Arabic Legal text    Muhammad AL-Qurishi, Sarah AlQaseemi, Riad Soussi arXiv_CL arXiv_CL  Transformer  Bert  Language_Model  PDF
• 2022-10-14 PseudoReasoner: Leveraging Pseudo Labels for Commonsense Knowledge Base Population    Tianqing Fang, Quyet V. Do, Hongming Zhang, Yangqiu Song, Ginny Y. Wong, Simon See arXiv_AI arXiv_AI  Bert  Knowledge  Pose  Prediction  PDF
• 2022-10-14 BERTScore is Unfair: On Social Bias in Language Model-Based Metrics for Text Generation    Tianxiang Sun, Junliang He, Xipeng Qiu, Xuanjing Huang arXiv_AI arXiv_AI  Bert  Text_Generation  Language_Model  Matching  PDF
• 2022-10-14 TSP-Bot: Robotic TSP Pen Art using High-DoF Manipulators    Daeun Song, Eunjung Lim, Jiyoon Park, Minjung Jung, Young J. Kim arXiv_RO arXiv_RO  Bert  Optimization  PDF
• 2022-10-14 DyLoRA: Parameter Efficient Tuning of Pre-trained Models using Dynamic Search-Free Low-Rank Adaptation    Mojtaba Valipour, Mehdi Rezagholizadeh, Ivan Kobyzev, Ali Ghodsi arXiv_CL arXiv_CL  Bert  PDF
• 2022-10-14 Kernel-Whitening: Overcome Dataset Bias with Isotropic Sentence Embedding    Songyang Gao, Shihan Dou, Qi Zhang, Xuanjing Huang arXiv_CL arXiv_CL  Embedding  Bert  Pose  Relation  Attention  PDF
• 2022-10-14 Self-Adaptive Named Entity Recognition by Retrieving Unstructured Knowledge    Kosuke Nishida, Naoki Yoshinaga, Kyosuke Nishida arXiv_CL arXiv_CL  Recognition  Bert  Knowledge  Pose  Prediction  PDF
• 2022-10-13 HuBERT-TR: Reviving Turkish Automatic Speech Recognition with Self-supervised Speech Representation Learning    Ali Safaya, Engin Erzin arXiv_CL arXiv_CL  Transformer  Recognition  Bert  Represenation_Learning  Speech  Self-Supervised  Speech_Recognition  PDF
• 2022-10-13 SQuAT: Sharpness- and Quantization-Aware Training for BERT    Zheng Wang, Juncheng B Li, Shuhui Qu, Florian Metze, Emma Strubell arXiv_CL arXiv_CL  Transformer  Quantization  Bert  Pose  Deep_Learning  Inference  PDF
• 2022-10-13 Tone prediction and orthographic conversion for Basaa    Ilya Nikitin, Brian O'Connor, Anastasia Safonova arXiv_CL arXiv_CL  Bert  Prediction  PDF
• 2022-10-13 Multilingual Zero Resource Speech Recognition Base on Self-Supervise Pre-Trained Acoustic Models    Haoyu Wang, Wei-Qiang Zhang, Hongbin Suo, Yulong Wan arXiv_CL arXiv_CL  Recognition  Bert  Speech  Speech_Recognition  Language_Model  PDF
• 2022-10-13 Overlooked Video Classification in Weakly Supervised Video Anomaly Detection    Weijun Tan, Qi Yao, Jingfeng Liu arXiv_CV arXiv_CV  Bert  Weakly_Supervised  RNN  Classification  Detection  Video_Classification  PDF
• 2022-10-12 RankT5: Fine-Tuning T5 for Text Ranking with Ranking Losses    Honglei Zhuang, Zhen Qin, Rolf Jagerman, Kai Hui, Ji Ma, Jing Lu, Jianmo Ni, Xuanhui Wang, Michael Bendersky arXiv_CL arXiv_CL  Bert  Zero-Shot  Pose  Classification  Language_Model  PDF
• 2022-10-12 Developing a general-purpose clinical language inference model from a large corpus of clinical notes    Madhumita Sushil, Dana Ludwig, Atul J. Butte, Vivek A. Rudrapatna arXiv_CL arXiv_CL  Transformer  Recognition  Bert  Pose  Action  Relation  Relation_Extraction  Medical  Inference  Language_Model  PDF
• 2022-10-12 MotionBERT: Unified Pretraining for Human Motion Analysis    Wentao Zhu, Xiaoxuan Ma, Zhaoyang Liu, Libin Liu, Wayne Wu, Yizhou Wang arXiv_CV arXiv_CV  Transformer  Recognition  3D  Bert  Pose_Estimation  Knowledge  Pose  Action_Recognition  Action  Relation  PDF
• 2022-10-12 MiniALBERT: Model Distillation via Parameter-Efficient Recursive Transformers    Mohammadmahdi Nouriborji, Omid Rohanian, Samaneh Kouchaki, David A. Clifton arXiv_CL arXiv_CL  Transformer  Bert  Knowledge  Pose  Medical  Language_Model  PDF
• 2022-10-12 Foundation Transformers    Hongyu Wang, Shuming Ma, Shaohan Huang, Li Dong, Wenhui Wang, Zhiliang Peng, Yu Wu, Payal Bajaj, Saksham Singhal, Alon Benhaim, Barun Patra, Zhun Liu, Vishrav Chaudhary, Xia Song, Furu Wei arXiv_CV arXiv_CV  Transformer  Recognition  Bert  Speech  Pose  Speech_Recognition  Language_Model  PDF
• 2022-10-12 On Text Style Transfer via Style Masked Language Models    Sharan Narasimhan, Pooja Shekar, Suvodip Dey, Maunendra Sankar Desarkar arXiv_CL arXiv_CL  Reconstruction  Style_Transfer  Bert  Pose  Attention  Language_Model  PDF
• 2022-10-12 GMP*: Well-Tuned Global Magnitude Pruning Can Outperform Most BERT-Pruning Methods    Eldar Kurtic, Dan Alistarh arXiv_CL arXiv_CL  Bert  Language_Model  PDF
• 2022-10-12 Probing Commonsense Knowledge in Pre-trained Language Models with Sense-level Precision and Expanded Vocabulary    Daniel Loureiro, Alípio Mário Jorge arXiv_AI arXiv_AI  Transformer  Bert  Knowledge  Pose  Ontology  Relation  Language_Model  Prediction  PDF
• 2022-10-12 SQuId: Measuring Speech Naturalness in Many Languages    Thibault Sellam, Ankur Bapna, Joshua Camp, Diana Mackinnon, Ankur P. Parikh, Jason Riesa arXiv_CL arXiv_CL  Transformer  Bert  Zero-Shot  Speech  Prediction  PDF
• 2022-10-11 CLIP also Understands Text: Prompting CLIP for Phrase Understanding    An Yan, Jiacheng Li, Wanrong Zhu, Yujie Lu, William Yang Wang, Julian McAuley arXiv_CL arXiv_CL  Transformer  Transfer_Learning  Bert  Zero-Shot  Language_Model  PDF
• 2022-10-11 Transfer Learning with Joint Fine-Tuning for Multimodal Sentiment Analysis    Guilherme Lourenço de Toledo, Ricardo Marcondes Marcacini arXiv_CV arXiv_CV  Transformer  Transfer_Learning  Bert  Sentiment_Classification  Classification  Sentiment  PDF
• 2022-10-11 CLIP-Fields: Weakly Supervised Semantic Fields for Robotic Memory    Nur Muhammad Mahi Shafiullah, Chris Paxton, Lerrel Pinto, Soumith Chintala, Arthur Szlam arXiv_CV arXiv_CV  Segmentation  Embedding  Semantic_Segmentation  3D  Bert  Weakly_Supervised  Pose  Action  Few-Shot  PDF
• 2022-10-11 Multilingual BERT has an accent: Evaluating English influences on fluency in multilingual models    Isabel Papadimitriou, Kezia Lopez, Dan Jurafsky arXiv_CL arXiv_CL  Bert  Language_Model  PDF
• 2022-10-11 Better Than Whitespace: Information Retrieval for Languages without Custom Tokenizers    Odunayo Ogundepo, Xinyu Zhang, Jimmy Lin arXiv_CL arXiv_CL  Unsupervised  Bert  Knowledge  Pose  Matching  PDF
• 2022-10-11 Are Pretrained Multilingual Models Equally Fair Across Languages?    Laura Cabello Piqueras, Anders Søgaard arXiv_CL arXiv_CL  Bert  Language_Model  PDF
• 2022-10-11 COVID-19-related Nepali Tweets Classification in a Low Resource Setting    Rabin Adhikari, Safal Thapaliya, Nirajan Basnet, Samip Poudel, Aman Shakya, Bishesh Khanal arXiv_CL arXiv_CL  Bert  Classification  GAN  Language_Model  PDF
• 2022-10-11 Code Librarian: A Software Package Recommendation System    Lili Tao, Alexandru-Petre Cazan, Senad Ibraimoski, Sean Moran arXiv_AI arXiv_AI  Bert  Recommendation  PDF
• 2022-10-11 On the Use of Semantically-Aligned Speech Representations for Spoken Language Understanding    Gaëlle Laperrière, Valentin Pelloin, Mickaël Rouvier, Themos Stafylakis, Yannick Estève arXiv_CL arXiv_CL  Embedding  Bert  Represenation_Learning  Speech  PDF
• 2022-10-11 Revisiting and Advancing Chinese Natural Language Understanding with Accelerated Heterogeneous Knowledge Pre-training    Taolin Zhang, Junwei DOng, Jianing Wang, Chengyu Wang, Ang Wang, Yinghui Liu, Jun Huang, Yong Li, Xiaofeng He arXiv_CL arXiv_CL  Transformer  Bert  Knowledge  Knowledge_Graph  Relation  Language_Model  PDF
• 2022-10-11 A Win-win Deal: Towards Sparse and Robust Pre-trained Language Models    Yuanxin Liu, Fandong Meng, Zheng Lin, Jiangnan Li, Peng Fu, Yanan Cao, Weiping Wang, Jie Zhou arXiv_CL arXiv_CL  Bert  Sparse  Face  Language_Model  PDF
• 2022-10-11 HUE: Pretrained Model and Dataset for Understanding Hanja Documents of Ancient Korea    Haneul Yoo, Jiho Jin, Juhee Son, JinYeong Bak, Kyunghyun Cho, Alice Oh arXiv_CL arXiv_CL  Recognition  Bert  Zero-Shot  Classification  Language_Model  PDF
• 2022-10-10 Multi-CLS BERT: An Efficient Alternative to Traditional Ensembling    Haw-Shiuan Chang, Ruei-Yao Sun, Kathryn Ricci, Andrew McCallum arXiv_CL arXiv_CL  Embedding  Bert  Pose  Prediction  PDF
• 2022-10-10 Transformer-based Localization from Embodied Dialog with Large-scale Pre-training    Meera Hahn, James M. Rehg arXiv_AI arXiv_AI  Transformer  Bert  PDF
• 2022-10-10 Empowering the Fact-checkers! Automatic Identification of Claim Spans on Twitter    Megha Sundriyal, Atharva Kulkarni, Vaibhav Pulastya, Md Shad Akhtar, Tanmoy Chakraborty arXiv_CL arXiv_CL  Bert  Pose  Classification  Medical  PDF
• 2022-10-10 Do Children Texts Hold The Key To Commonsense Knowledge?    Julien Romero, Simon Razniewski arXiv_AI arXiv_AI  Bert  Knowledge  Action  PDF
• 2022-10-10 Multi-Modal Fusion Transformer for Visual Question Answering in Remote Sensing    Tim Siebert, Kai Norman Clasen, Mahdyar Ravanbakhsh, Begüm Demir arXiv_AI arXiv_AI  Transformer  Bert  Represenation_Learning  Pose  Action  Classification  Relation  VQA  QA  PDF
• 2022-10-10 DEPTWEET: A Typology for Social Media Texts to Detect Depression Severities    Mohsinul Kabir, Tasnim Ahmed, Md. Bakhtiar Hasan, Md Tahmid Rahman Laskar, Tarun Kumar Joarder, Hasan Mahmud, Kamrul Hasan arXiv_CL arXiv_CL  Bert  Attention  PDF
• 2022-10-10 Parameter-Efficient Tuning with Special Token Adaptation    Xiaoocong Yang, James Y. Huang, Wenxuan Zhou, Muhao Chen arXiv_AI arXiv_AI  Transformer  Bert  Text_Classification  Classification  Attention  Language_Model  PDF
• 2022-10-09 FairGer: Using NLP to Measure Support for Women and Migrants in 155 Years of German Parliamentary Debates    Dominik Beese, Ole Pütz, Steffen Eger arXiv_CL arXiv_CL  Bert  PDF
• 2022-10-09 QAScore -- An Unsupervised Unreferenced Metric for the Question Generation Evaluation    Tianbo Ji, Chenyang Lyu, Gareth Jones, Liting Zhou, Yvette Graham arXiv_CL arXiv_CL  Unsupervised  Bert  Pose  Relation  Language_Model  QA  PDF
• 2022-10-09 Pruning Adversarially Robust Neural Networks without Adversarial Examples    Tong Jian, Zifeng Wang, Yanzhi Wang, Jennifer Dy, Stratis Ioannidis arXiv_AI arXiv_AI  Bert  Knowledge  Adversarial  Pose  PDF
• 2022-10-09 Spread Love Not Hate: Undermining the Importance of Hateful Pre-training for Hate Speech Detection    Shantanu Patankar, Omkar Gokhale, Aditya Kane, Tanmay Chavan, Raviraj Joshi arXiv_AI arXiv_AI  Transformer  Bert  Speech  Classification  Detection  Language_Model  PDF
• 2022-10-09 Improve Transformer Pre-Training with Decoupled Directional Relative Position Encoding and Representation Differentiations    Haojie Zhang, Mingfei Liang, Ruobing Xie, Zhenlong Sun, Bo Zhang, Leyu Lin arXiv_CL arXiv_CL  Transformer  Bert  Optimization  Represenation_Learning  Pose  Attention  Language_Model  PDF
• 2022-10-08 On Task-Adaptive Pretraining for Dialogue Response Selection    Tzu-Hsiang Lin, Ta-Chung Chi, Anna Rumshisky arXiv_CL arXiv_CL  Transformer  Bert  Pose  PDF
• 2022-10-08 CoBERT: Self-Supervised Speech Representation Learning Through Code Representation Learning    Chutong Meng, Junyi Ao, Tom Ko, Mingxuan Wang, Haizhou Li arXiv_SD arXiv_SD  Bert  Represenation_Learning  Speech  Self-Supervised  Pose  Face  PDF
• 2022-10-08 InfoCSE: Information-aggregated Contrastive Learning of Sentence Embeddings    Xing Wu, Chaochen Gao, Zijia Lin, Jizhong Han, Zhongyuan Wang, Songlin Hu arXiv_CL arXiv_CL  Embedding  Unsupervised  Bert  Represenation_Learning  Pose  Contrastive_Learning  Relation  Language_Model  PDF
• 2022-10-08 KG-MTT-BERT: Knowledge Graph Enhanced BERT for Multi-Type Medical Text Classification    Yong He, Cheng Wang, Shun Zhang, Nan Li, Zhaorong Li, Zhenyu Zeng arXiv_AI arXiv_AI  Bert  Text_Classification  Knowledge  Knowledge_Graph  Pose  Classification  Deep_Learning  Medical  PDF
• 2022-10-07 Breaking BERT: Evaluating and Optimizing Sparsified Attention    Siddhartha Brahma, Polina Zablotskaia, David Mimno arXiv_CL arXiv_CL  Transformer  Bert  Sparse  Attention  PDF
• 2022-10-07 Hate Speech and Offensive Language Detection in Bengali    Mithun Das, Somnath Banerjee, Punyajoy Saha, Animesh Mukherjee arXiv_CL arXiv_CL  Bert  Speech  Action  Classification  Detection  Few-Shot  PDF
• 2022-10-07 DABERT: Dual Attention Enhanced BERT for Semantic Matching    Sirui Wang, Di Liang, Jian Song, Yuntao Li, Wei Wu arXiv_CL arXiv_CL  Transformer  Bert  Pose  Attention  Language_Model  Prediction  Matching  PDF
• 2022-10-07 Generating Quizzes to Support Training on Quality Management and Assurance in Space Science and Engineering    Andrés García-Silva, Cristian Berrío, José Manuel Gómez-Pérez arXiv_AI arXiv_AI  Bert  PDF
• 2022-10-06 HealthE: Classifying Entities in Online Textual Health Advice    Joseph Gatto, Parker Seegmiller, Garrett Johnston, Sarah M. Preum arXiv_CL arXiv_CL  Bert  Classification  Medical  PDF
• 2022-10-06 Explainable Verbal Deception Detection using Transformers    Loukas Ilias, Felix Soldner, Bennett Kleinberg arXiv_CL arXiv_CL  Transformer  Bert  Review  Pose  Deep_Learning  Detection  Relation  Attention  Prediction  PDF
• 2022-10-06 Conversational Semantic Role Labeling with Predicate-Oriented Latent Graph    Hao Fei, Shengqiong Wu, Meishan Zhang, Yafeng Ren, Donghong Ji arXiv_AI arXiv_AI  Bert  Pose  Detection  Attention  Language_Model  PDF
• 2022-10-06 Matching Text and Audio Embeddings: Exploring Transfer-learning Strategies for Language-based Audio Retrieval    Benno Weck, Miguel Pérez Fernández, Holger Kirchhoff, Xavier Serra arXiv_CL arXiv_CL  Embedding  Bert  Deep_Learning  Matching  PDF
• 2022-10-06 Join-Chain Network: A Logical Reasoning View of the Multi-head Attention in Transformer    Jianyi Zhang, Yiran Chen, Jianshu Chen arXiv_CL arXiv_CL  Transformer  Bert  Pose  Attention  PDF
• 2022-10-05 Privacy-Preserving Text Classification on BERT Embeddings with Homomorphic Encryption    Garam Lee, Minsoo Kim, Jai Hyun Park, Seung-won Hwang, Jung Hee Cheon arXiv_CL arXiv_CL  Embedding  Bert  Text_Classification  Pose  Classification  PDF
• 2022-10-05 Revisiting Structured Dropout    Yiren Zhao, Oluwatomisin Dada, Xitong Gao, Robert D Mullins arXiv_AI arXiv_AI  Bert  Regularization  Pose  Inference  PDF
• 2022-10-05 Token Classification for Disambiguating Medical Abbreviations    Mucahit Cevik, Sanaz Mohammad Jafari, Mitchell Myers, Savas Yildirim arXiv_AI arXiv_AI  Transformer  Bert  Text_Classification  Pose  Classification  Medical  Prediction  PDF
• 2022-10-03 Characterization of effects of transfer learning across domains and languages    Sovesh Mohapatra arXiv_CL arXiv_CL  Transfer_Learning  Bert  Language_Model  PDF
• 2022-10-03 Hypothesis Engineering for Zero-Shot Hate Speech Detection    Janis Goldzycher, Gerold Schneider arXiv_CL arXiv_CL  Bert  Zero-Shot  Text_Classification  Speech  Pose  Classification  Detection  Inference  Prediction  PDF
• 2022-10-03 SpeechCLIP: Integrating Speech with Pre-Trained Vision and Language Model    Yi-Jen Shih, Hsuan-Fu Wang, Heng-Jui Chang, Layne Berry, Hung-yi Lee, David Harwath arXiv_CL arXiv_CL  Bert  Zero-Shot  Speech  Pose  Caption  Language_Model  PDF
• 2022-10-03 Probing of Quantitative Values in Abstractive Summarization Models    Nathan M. White arXiv_CL arXiv_CL  Embedding  Bert  Pose  Quantitative  Summarization  PDF
• 2022-10-01 Construction and Evaluation of a Self-Attention Model for Semantic Understanding of Sentence-Final Particles    Shuhei Mandokoro, Natsuki Oka, Akane Matsushima, Chie Fukada, Yuko Yoshimura, Koji Kawahara, Kazuaki Tanaka arXiv_CL arXiv_CL  Bert  Pose  Relation  Attention  PDF
• 2022-09-29 Stop Wasting My Time! Saving Days of ImageNet and BERT Training with Latest Weight Averaging    Jean Kaddour arXiv_AI arXiv_AI  Bert  Language_Model  PDF
• 2022-09-29 polyBERT: A chemical language model to enable fully machine-driven ultrafast polymer informatics    Christopher Kuenneth, Rampi Ramprasad arXiv_AI arXiv_AI  Bert  Language_Model  Prediction  PDF
• 2022-09-29 Prompt-guided Scene Generation for 3D Zero-Shot Learning    Majid Nasiri, Ali Cheraghian, Townim Faisal Chowdhury, Sahar Ahmadi, Morteza Saberi, Shafin Rahman arXiv_CV arXiv_CV  Point_Cloud  3D  Bert  Zero-Shot  Scene_Generation  Pose  Contrastive_Learning  Action  Caption  Language_Model  PDF
• 2022-09-29 Neural Media Bias Detection Using Distant Supervision With BABE -- Bias Annotations By Experts    Timo Spinde, Manuel Plank, Jan-David Krieger, Terry Ruas, Bela Gipp, Akiko Aizawa arXiv_CL arXiv_CL  Bert  Pose  Detection  PDF
• 2022-09-28 Downstream Datasets Make Surprisingly Good Pretraining Corpora    Kundan Krishna, Saurabh Garg, Jeffrey P. Bigham, Zachary C. Lipton arXiv_CL arXiv_CL  Transformer  Bert  PDF
• 2022-09-28 Supervised Contrastive Learning as Multi-Objective Optimization for Fine-Tuning Large Pre-trained Language Models    Youness Moukafih, Mounir Ghogho, Kamel Smaili arXiv_CL arXiv_CL  Embedding  Bert  Optimization  Adversarial  Pose  Contrastive_Learning  Classification  Language_Model  PDF
• 2022-09-28 Human-in-the-loop Robotic Grasping using BERT Scene Representation    Yaoxian Song, Penglei Sun, Pengfei Fang, Linyi Yang, Yanghua Xiao, Yue Zhang arXiv_RO arXiv_RO  Bert  Pose  Face  PDF
• 2022-09-28 Keyword Extraction from Short Texts with~a~Text-To-Text Transfer Transformer    Piotr Pęzik, Agnieszka Mikołajczyk-Bareła, Adam Wawrzyński, Bartłomiej Nitoń, Maciej Ogrodniczuk arXiv_CL arXiv_CL  Transformer  Bert  Sparse  Action  Language_Model  PDF
• 2022-09-28 CEFER: A Four Facets Framework based on Context and Emotion embedded features for Implicit and Explicit Emotion Recognition    Fereshteh Khoshnam, Ahmad Baraani-Dastjerdi, M.J. Liaghatdar arXiv_CL arXiv_CL  Recognition  Bert  Knowledge  Pose  Emotion  Face  Action  Attention  PDF
• 2022-09-28 An Efficient Multitask Learning Architecture for Affective Vocal Burst Analysis    Tobias Hallmen, Silvan Mertes, Dominik Schiller, Elisabeth André arXiv_SD arXiv_SD  Bert  Speech  PDF
• 2022-09-28 YATO: Yet Another deep learning based Text analysis Open toolkit    Zeqiang Wang, Yile Wang, Jiageng Wu, Zhiyang Teng, Jie Yang arXiv_CL arXiv_CL  Bert  RNN  Classification  Deep_Learning  Language_Model  PDF
• 2022-09-28 Deep Learning based Automatic Quantification of Urethral Plate Quality using the Plate Objective Scoring Tool    Tariq O. Abbas, Mohamed AbdelMoniem, Ibrahim Khalil, Md Sakib Abrar Hossain, Muhammad E. H. Chowdhury arXiv_AI arXiv_AI  Bert  Pose  Deep_Learning  Detection  CNN  Prediction  PDF
• 2022-09-27 An Effective, Performant Named Entity Recognition System for Noisy Business Telephone Conversation Transcripts    Xue-Yong Fu, Cheng Chen, Md Tahmid Rahman Laskar, Shashi Bhushan TN, Simon Corston-Oliver arXiv_CL arXiv_CL  Recognition  Bert  Speech  Speech_Recognition  PDF
• 2022-09-27 Embarrassingly Easy Document-Level MT Metrics: How to Convert Any Pretrained Metric Into a Document-Level Metric    Giorgos Vernikos, Brian Thompson, Prashant Mathur, Marcello Federico arXiv_CL arXiv_CL  Bert  PDF
• 2022-09-27 A general-purpose material property data extraction pipeline from large polymer corpora using Natural Language Processing    Pranav Shetty, Arunkumar Chitteth Rajan, Christopher Kuenneth, Sonkakshi Gupta, Lakshmi Prerana Panchumarti, Lauren Holm, Chao Zhang, Rampi Ramprasad arXiv_CL arXiv_CL  Recognition  Bert  Pose  Action  Relation  Language_Model  PDF
• 2022-09-27 Improving Radiology Report Generation Systems by Removing Hallucinated References to Non-existent Priors    Vignav Ramesh, Nathan Andrew Chi, Pranav Rajpurkar arXiv_AI arXiv_AI  Bert  Pose  Action  Classification  Deep_Learning  Few-Shot  Medical  PDF
• 2022-09-27 Extractive Question Answering on Queries in Hindi and Tamil    Adhitya Thirumala, Elisa Ferracane arXiv_CL arXiv_CL  Bert  Pose  Classification  QA  PDF
• 2022-09-26 Towards Simple and Efficient Task-Adaptive Pre-training for Text Classification    Arnav Ladkat, Aamir Miyajiwala, Samiksha Jagadale, Rekha Kulkarni, Raviraj Joshi arXiv_CL arXiv_CL  Transformer  Embedding  Bert  Text_Classification  Pose  Classification  Language_Model  PDF
• 2022-09-26 Out-of-Distribution Detection with Hilbert-Schmidt Independence Optimization    Jingyang Lin, Yu Wang, Qi Cai, Yingwei Pan, Ting Yao, Hongyang Chao, Tao Mei arXiv_CV arXiv_CV  Bert  Optimization  Pose  Detection  Inference  PDF
• 2022-09-26 Do ever larger octopi still amplify reporting biases? Evidence from judgments of typical colour    Fangyu Liu, Julian Martin Eisenschlos, Jeremy R. Cole, Nigel Collier arXiv_AI arXiv_AI  Bert  Face  Language_Model  PDF
• 2022-09-26 The Ability of Self-Supervised Speech Models for Audio Representations    Tung-Yu Wu, Chen-An Li, Tzu-Han Lin, Tsu-Yuan Hsu, Hung-Yi Lee arXiv_AI arXiv_AI  Embedding  Bert  Represenation_Learning  Speech  Self-Supervised  Pose  PDF
• 2022-09-26 Taking a Respite from Representation Learning for Molecular Property Prediction    Jianyuan Deng, Zhibo Yang, Hehe Wang, Iwao Ojima, Dimitris Samaras, Fusheng Wang arXiv_AI arXiv_AI  Bert  Represenation_Learning  Self-Supervised  Activity  Prediction  PDF
• 2022-09-24 Can Transformer Models Effectively Detect Software Aspects in StackOverflow Discussion?    Nibir Chandra Mandal, Tashreef Muhammad, G. M. Shahariar arXiv_CL arXiv_CL  Transformer  Bert  Sentiment  PDF
• 2022-09-24 Dead or Murdered? Predicting Responsibility Perception in Femicide News Reports    Gosse Minnema, Sara Gemelli, Chiara Zanchi, Tommaso Caselli, Malvina Nissim arXiv_CL arXiv_CL  Bert  Salient  Survey  PDF
• 2022-09-24 Learning Chess With Language Models and Transformers    Michael DeLeo, Erhan Guven arXiv_AI arXiv_AI  Transformer  Unsupervised  Bert  Few-Shot  Language_Model  PDF
• 2022-09-23 Promptagator: Few-shot Dense Retrieval From 8 Examples    Zhuyun Dai, Vincent Y. Zhao, Ji Ma, Yi Luan, Jianmo Ni, Jing Lu, Anton Bakalov, Kelvin Guu, Keith B. Hall, Ming-Wei Chang arXiv_CL arXiv_CL  Bert  Knowledge  Pose  Few-Shot  Language_Model  PDF
• 2022-09-23 Variational Open-Domain Question Answering    Valentin Liévin, Andreas Geert Motzfeldt, Ida Riis Jensen, Ole Winther arXiv_CL arXiv_CL  Bert  Optimization  Knowledge  Medical  Language_Model  QA  PDF
• 2022-09-23 IDEA: Interactive DoublE Attentions from Label Embedding for Text Classification    Ziyuan Wang, Hailiang Huang, Songqiao Han arXiv_AI arXiv_AI  Embedding  Bert  Text_Classification  Pose  Classification  Attention  Matching  PDF
• 2022-09-23 Extending Word-Level Quality Estimation for Post-Editing Assistance    Yizhen Wei, Takehito Utsuro, Masaaki Nagata arXiv_CL arXiv_CL  Bert  Pose  PDF
• 2022-09-22 Scope of Pre-trained Language Models for Detecting Conflicting Health Information    Joseph Gatto, Madhusudan Basak, Sarah M. Preum arXiv_CL arXiv_CL  Bert  Pose  Detection  Language_Model  PDF
• 2022-09-22 MonoByte: A Pool of Monolingual Byte-level Language Models    Hugo Abonizio, Leandro Rodrigues de Souza, Roberto Lotufo, Rodrigo Nogueira arXiv_CL arXiv_CL  Embedding  Bert  Zero-Shot  Language_Model  QA  PDF
• 2022-09-22 Adaptation of domain-specific transformer models with text oversampling for sentiment analysis of social media posts on Covid-19 vaccines    Anmol Bansal, Arjun Choudhry, Anubhav Sharma, Seba Susan arXiv_CL arXiv_CL  Transformer  Bert  Classification  Sentiment  Language_Model  PDF
• 2022-09-22 AIR-JPMC@SMM4H'22: Classifying Self-Reported Intimate Partner Violence in Tweets with Multiple BERT-based Models    Alec Candidato, Akshat Gupta, Xiaomo Liu, Sameena Shah arXiv_CL arXiv_CL  Bert  Classification  PDF
• 2022-09-21 Assessing ASR Model Quality on Disordered Speech using BERTScore    Jimmy Tobin, Qisheng Li, Subhashini Venugopalan, Katie Seaver, Richard Cave, Katrin Tomanek arXiv_CL arXiv_CL  Recognition  Bert  Speech  Action  Speech_Recognition  Text_Generation  Prediction  PDF
• 2022-09-21 Representing Affect Information in Word Embeddings    Yuhan Zhang, Wenqi Chen, Ruihan Zhang, Xiajie Zhang arXiv_CL arXiv_CL  Transformer  Embedding  Bert  Salient  Knowledge  Emotion  Classification  Relation  Language_Model  PDF
• 2022-09-21 Subject Verb Agreement Error Patterns in Meaningless Sentences: Humans vs. BERT    Karim Lasri, Olga Seminck, Alessandro Lenci, Thierry Poibeau arXiv_CL arXiv_CL  Bert  Knowledge  Language_Model  PDF
• 2022-09-21 SMTCE: A Social Media Text Classification Evaluation Benchmark and BERTology Models for Vietnamese    Luan Thanh Nguyen, Kiet Van Nguyen, Ngan Luu-Thuy Nguyen arXiv_CL arXiv_CL  Bert  Text_Classification  Pose  Classification  PDF
• 2022-09-21 Bias at a Second Glance: A Deep Dive into Bias for German Educational Peer-Review Data Modeling    Thiemo Wambsganss, Vinitra Swamy, Roman Rietsche, Tanja Käser arXiv_CL arXiv_CL  Embedding  Bert  Review  Language_Model  PDF
• 2022-09-21 Extreme Multi-Domain, Multi-Task Learning With Unified Text-to-Text Transfer Transformers    Adebayo Oshingbesan, Courage Ekoh, Germann Atakpa, Yonah Byaruagaba arXiv_CL arXiv_CL  Transformer  Transfer_Learning  Bert  Knowledge  Relation  Summarization  PDF
• 2022-09-20 Can we do that simpler? Simple, Efficient, High-Quality Evaluation Metrics for NLG    Jens Grünwald, Christoph Leiter, Steffen Eger arXiv_CL arXiv_CL  Transformer  Bert  Inference  PDF
• 2022-09-20 Unsupervised Early Exit in DNNs with Multiple Exits    Hari Narayan N U, Manjesh K. Hanawal, Avinash Bhardwaj arXiv_AI arXiv_AI  Unsupervised  Bert  Face  Inference  Prediction  PDF
• 2022-09-20 One-to-Many Semantic Communication Systems: Design, Implementation, Performance Evaluation    Han Hu, Xingwu Zhu, Fuhui Zhou, Wei Wu, Rose Qingyang Hu, Hongbo Zhu arXiv_CL arXiv_CL  Transfer_Learning  Bert  Pose  PDF
• 2022-09-19 TimberTrek: Exploring and Curating Sparse Decision Trees with Interactive Visualization    Zijie J. Wang, Chudi Zhong, Rui Xin, Takuya Takagi, Zhi Chen, Duen Horng Chau, Cynthia Rudin, Margo Seltzer arXiv_AI arXiv_AI  Bert  Sparse  Knowledge  PDF
• 2022-09-19 ALEXSIS-PT: A New Resource for Portuguese Lexical Simplification    Kai North, Marcos Zampieri, Tharindu Ranasinghe arXiv_AI arXiv_AI  Bert  PDF
• 2022-09-19 Tree-based Text-Vision BERT for Video Search in Baidu Video Advertising    Tan Yu, Jie Liu, Yi Yang, Yi Li, Hongliang Fei, Ping Li arXiv_CV arXiv_CV  Transformer  Bert  Attention  Video_Retrieval  PDF
• 2022-09-17 From Disfluency Detection to Intent Detection and Slot Filling    Mai Hoang Dao, Thinh Hung Truong, Dat Quoc Nguyen arXiv_CL arXiv_CL  Bert  Detection  Language_Model  PDF
• 2022-09-17 Watch What You Pretrain For: Targeted, Transferable Adversarial Examples on Self-Supervised Speech Recognition models    Raphael Olivier, Bhiksha Raj arXiv_CL arXiv_CL  Transformer  Recognition  Bert  Knowledge  Adversarial  Speech  Self-Supervised  Pose  Speech_Recognition  PDF
• 2022-09-17 Detecting Generated Scientific Papers using an Ensemble of Transformer Models    Anna Glazkova, Maksim Glazkov arXiv_AI arXiv_AI  Transformer  Bert  Detection  PDF
• 2022-09-16 Changing the Representation: Examining Language Representation for Neural Sign Language Production    Harry Walsh, Ben Saunders, Richard Bowden arXiv_AI arXiv_AI  Embedding  Bert  Language_Model  PDF
• 2022-09-15 TwHIN-BERT: A Socially-Enriched Pre-trained Language Model for Multilingual Tweet Representations    Xinyang Zhang, Yury Malkov, Omar Florez, Serim Park, Brian McWilliams, Jiawei Han, Ahmed El-Kishky arXiv_CL arXiv_CL  Bert  Language_Model  Prediction  Recommendation  PDF
• 2022-09-15 Machine Reading, Fast and Slow: When Do Models 'Understand' Language?    Sagnik Ray Choudhury, Anna Rogers, Isabelle Augenstein arXiv_CL arXiv_CL  Bert  Salient  Pose  Deep_Learning  PDF
• 2022-09-15 Rethinking Round-trip Translation for Automatic Machine Translation Evaluation    Terry Yue Zhuo, Qiongkai Xu, Xuanli He, Trevor Cohn arXiv_CL arXiv_CL  Bert  Pose  PDF
• 2022-09-15 Linear Transformations for Cross-lingual Sentiment Analysis    Pavel Přibáň, Jakub Šmíd, Adam Mištera, Pavel Král arXiv_CL arXiv_CL  Embedding  Bert  Zero-Shot  RNN  Classification  Sentiment  PDF
• 2022-09-15 Learning to Exploit Elastic Actuators for Quadruped Locomotion    Antonin Raffin, Daniel Seidel, Jens Kober, Alin Albu-Schäffer, João Silvério, Freek Stulp arXiv_RO arXiv_RO  Reinforcement_Learning  Bert  Pose  Action  PDF
• 2022-09-15 Knowledge Graph Completion with Pre-trained Multimodal Transformer and Twins Negative Sampling    Yichi Zhang, Wen Zhang arXiv_CL arXiv_CL  Transformer  Embedding  Bert  Knowledge  Knowledge_Graph  Pose  Prediction  PDF
• 2022-09-15 uChecker: Masked Pretrained Language Models as Unsupervised Chinese Spelling Checkers    Piji Li arXiv_CL arXiv_CL  Unsupervised  Bert  Pose  Detection  Language_Model  PDF
• 2022-09-15 VIPHY: Probing 'Visible' Physical Commonsense Knowledge    Shikhar Singh, Ehsan Qasemi, Muhao Chen arXiv_CL arXiv_CL  Transformer  Bert  Knowledge  Caption  Language_Model  PDF
• 2022-09-14 On the State of the Art in Authorship Attribution and Authorship Verification    Jacob Tyo, Bhuwan Dhingra, Zachary C. Lipton arXiv_AI arXiv_AI  Bert  Survey  PDF
• 2022-09-14 LibertyMFD: A Lexicon to Assess the Moral Foundation of Liberty    Oscar Araque, Lorenzo Gatti, Kyriaki Kalimeri arXiv_CL arXiv_CL  Bert  Pose  PDF
• 2022-09-14 Automated Fidelity Assessment for Strategy Training in Inpatient Rehabilitation using Natural Language Processing    Hunter Osterhoudt, Courtney E. Schneider, Haneef A Mohammad, Minmei Shih, Alexandra E. Harper, Leming Zhou, Elizabeth R Skidmore, Yanshan Wang arXiv_CL arXiv_CL  Transformer  Bert  RNN  PDF
• 2022-09-14 Toward Improving Health Literacy in Patient Education Materials with Neural Machine Translation Models    David Oniani, Sreekanth Sreekumar, Renuk DeAlmeida, Dinuk DeAlmeida, Vivian Hui, Young Ji Lee, Yiye Zhang, Leming Zhou, Yanshan Wang arXiv_CL arXiv_CL  Transformer  Bert  RNN  Pose  NMT  Medical  PDF
• 2022-09-14 Pre-training for Information Retrieval: Are Hyperlinks Fully Explored?    Jiawen Wu, Xinyu Zhang, Yutao Zhu, Zheng Liu, Zikai Guo, Zhaoye Fei, Ruofei Lai, Yongkang Wu, Zhao Cao, Zhicheng Dou arXiv_AI arXiv_AI  Transformer  Bert  Pose  Relation  Language_Model  Matching  PDF
• 2022-09-14 BERT-based Ensemble Approaches for Hate Speech Detection    Khouloud Mnassri, Praboda Rajapaksha, Reza Farahbakhsh, Noel Crespi arXiv_CL arXiv_CL  Transformer  Bert  Speech  Classification  Detection  Language_Model  PDF
• 2022-09-13 CNN-Trans-Enc: A CNN-Enhanced Transformer-Encoder On Top Of Static BERT representations for Document Classification    Charaf Eddine Benarab, Shenglin Gui arXiv_CL arXiv_CL  Transformer  Embedding  Bert  Text_Classification  Pose  Classification  CNN  PDF
• 2022-09-13 Pre-training Transformers on Indian Legal Text    Shounak Paul, Arpan Mandal, Pawan Goyal, Saptarshi Ghosh arXiv_AI arXiv_AI  Transformer  Segmentation  Semantic_Segmentation  Bert  Language_Model  Prediction  PDF
• 2022-09-13 Don't Judge a Language Model by Its Last Layer: Contrastive Learning with Layer-Wise Attention Pooling    Dongsuk Oh, Yejin Kim, Hodong Lee, H. Howie Huang, Heuiseok Lim arXiv_AI arXiv_AI  Embedding  Unsupervised  Bert  Contrastive_Learning  Attention  Language_Model  PDF
• 2022-09-13 SkIn: Skimming-Intensive Long-Text Classification Based on BERT and Application to Medical Corpus    Yufeng Zhao, Haiying Che arXiv_AI arXiv_AI  Bert  Text_Classification  Knowledge  Pose  Classification  Medical  PDF
• 2022-09-13 Robin: A Novel Online Suicidal Text Corpus of Substantial Breadth and Scale    Daniel DiPietro, Vivek Hazari, Soroush Vosoughi arXiv_CL arXiv_CL  Bert  Classification  Detection  Sentiment  Language_Model  PDF
• 2022-09-12 DECK: Behavioral Tests to Improve Interpretability and Generalizability of BERT Models Detecting Depression from Text    Jekaterina Novikova, Ksenia Shkaruta arXiv_CL arXiv_CL  Bert  PDF
• 2022-09-12 Classification of hazard event via language fractal    Zhenhua Wang, Dong Gao, Bin Wang, Ming Ren arXiv_CL arXiv_CL  Bert  Pose  Classification  Deep_Learning  Attention  PDF
• 2022-09-11 Probing for Understanding of English Verb Classes and Alternations in Large Pre-trained Language Models    David K. Yi, James V. Bruno, Jiayu Han, Peter Zukerman, Shane Steinert-Threlkeld arXiv_CL arXiv_CL  Embedding  Bert  Language_Model  Prediction  PDF
• 2022-09-10 Code Compliance Assessment as a Learning Problem    Neela Sawant, Srinivasan H. Sengamedu arXiv_AI arXiv_AI  Transformer  Embedding  Bert  Zero-Shot  Review  Classification  Detection  Relation  Prediction  PDF
• 2022-09-10 Yes, DLGM! A novel hierarchical model for hazard classification    Zhenhua Wang, Ming Ren, Dong Gao, Bin Wang arXiv_CL arXiv_CL  Bert  Pose  Classification  Deep_Learning  PDF
• 2022-09-09 Trigger Warnings: Bootstrapping a Violence Detector for FanFiction    Magdalena Wolska, Christopher Schröder, Ole Borchardt, Benno Stein, Martin Potthast arXiv_CL arXiv_CL  Bert  Classification  Detection  Object_Detection  PDF
• 2022-09-09 Automatic Readability Assessment of German Sentences with Transformer Ensembles    Patrick Gustav Blaneck, Tobias Bornheim, Niklas Grieger, Stephan Bialonski arXiv_CL arXiv_CL  Transformer  Bert  Deep_Learning  Language_Model  Prediction  PDF
• 2022-09-09 EchoCoTr: Estimation of the Left Ventricular Ejection Fraction from Spatiotemporal Echocardiography    Rand Muhtaseb, Mohammad Yaqub arXiv_CV arXiv_CV  Transformer  Video_Caption  Bert  Pose  Face  Action  Medical  CNN  PDF
• 2022-09-09 Activity report analysis with automatic single or multispan answer extraction    Ravi Choudhary, Arvind Krishna Sridhar, Erik Visser arXiv_CL arXiv_CL  Bert  Pose  Action  Detection  Activity  QA  PDF
• 2022-09-09 MaxMatch-Dropout: Subword Regularization for WordPiece    Tatsuya Hiraoka arXiv_CL arXiv_CL  Bert  Text_Classification  Regularization  Pose  Classification  Language_Model  Matching  PDF
• 2022-09-09 PoxVerifi: An Information Verification System to Combat Monkeypox Misinformation    Akaash Kolluri, Kami Vinton, Dhiraj Murthy arXiv_CL arXiv_CL  Bert  Review  GAN  PDF
• 2022-09-08 Transformer-based classification of premise in tweets related to COVID-19    Vadim Porvatov, Natalia Semenova arXiv_AI arXiv_AI  Transformer  Bert  Pose  Classification  Prediction  PDF
• 2022-09-08 Applying Transformer-based Text Summarization for Keyphrase Generation    Anna Glazkova, Dmitry Morozov arXiv_AI arXiv_AI  Transformer  Unsupervised  Bert  Action  Summarization  PDF
• 2022-09-08 CLaCLab at SocialDisNER: Using Medical Gazetteers for Named-Entity Recognition of Disease Mentions in Spanish Tweets    Harsh Verma, Parsa Bagherzadeh, Sabine Bergler arXiv_AI arXiv_AI  Transformer  Recognition  Bert  Medical  PDF
• 2022-09-07 AILAB-Udine@SMM4H 22: Limits of Transformers and BERT Ensembles    Beatrice Portelli, Simone Scaboro, Emmanuele Chersoni, Enrico Santus, Giuseppe Serra arXiv_CL arXiv_CL  Transformer  Bert  Text_Classification  Action  Classification  PDF
• 2022-09-07 Dual Instrumental Method for Confounded Kernelized Bandits    Xueping Gong, Jiheng Zhang arXiv_AI arXiv_AI  Bert  Pose  PDF
• 2022-09-07 On the Effectiveness of Compact Biomedical Transformers    Omid Rohanian, Mohammadmahdi Nouriborji, Samaneh Kouchaki, David A. Clifton arXiv_CL arXiv_CL  Transformer  Embedding  Bert  Knowledge  Face  Medical  Language_Model  PDF
• 2022-09-07 DM$^2$S$^2$: Deep Multi-Modal Sequence Sets with Hierarchical Modality Attention    Shunsuke Kitada, Yuki Iwazaki, Riku Togashi, Hitoshi Iyatomi arXiv_AI arXiv_AI  Bert  Pose  Relation  Attention  Prediction  PDF
• 2022-09-07 Non-Standard Vietnamese Word Detection and Normalization for Text-to-Speech    Huu-Tien Dang, Thi-Hai-Yen Vuong, Xuan-Hieu Phan arXiv_CL arXiv_CL  Bert  RNN  Speech  Pose  Face  Detection  Matching  PDF
• 2022-09-06 Multilingual Bidirectional Unsupervised Translation Through Multilingual Finetuning and Back-Translation    Bryan Li, Ajay Patel, Chris Callison-Burch, Mohammad Sadegh Rasooli arXiv_CL arXiv_CL  Unsupervised  Bert  Zero-Shot  Pose  NMT  PDF
• 2022-09-06 'Mama Always Had a Way of Explaining Things So I Could Understand'': A Dialogue Corpus for Learning to Construct Explanations    Henning Wachsmuth, Milad Alshomary arXiv_CL arXiv_CL  Bert  PDF
• 2022-09-06 Comparing Methods for Extractive Summarization of Call Centre Dialogue    Alexandra N. Uma, Dmitry Sityaev arXiv_CL arXiv_CL  Bert  Pose  Summarization  PDF
• 2022-09-06 Layer or Representation Space:What makes BERT-based Evaluation Metrics Robust?    Doan Nam Long Vu, Nafise Sadat Moosavi, Steffen Eger arXiv_CL arXiv_CL  Embedding  Bert  Relation  Text_Generation  PDF
• 2022-09-06 Reference Resolution and Context Change in Multimodal Situated Dialogue for Exploring Data Visualizations    Abhinav Kumar, Barbara Di Eugenio, Abari Bhattacharya, Jillian Aurisano, Andrew Johnson arXiv_CL arXiv_CL  Transformer  Transfer_Learning  Bert  Gesture  RNN  Salient  Deep_Learning  PDF
• 2022-09-05 Evaluating the Susceptibility of Pre-Trained Language Models via Handcrafted Adversarial Examples    Hezekiah J. Branch, Jonathan Rodriguez Cefalu, Jeremy McHugh, Leyla Hujer, Aditya Bahl, Daniel del Castillo Iglesias, Ron Heichman, Ramesh Darwishi arXiv_CL arXiv_CL  Transformer  Unsupervised  Bert  Text_Classification  Adversarial  Speech  Classification  Language_Model  PDF
• 2022-09-05 Distilling the Knowledge of BERT for CTC-based ASR    Hayato Futami, Hirofumi Inaguma, Masato Mimura, Shinsuke Sakai, Tatsuya Kawahara arXiv_CL arXiv_CL  Recognition  Bert  Knowledge  Speech  Pose  Classification  Attention  Speech_Recognition  Inference  Language_Model  Prediction  PDF
• 2022-09-05 Query-focused Extractive Summarisation for Biomedical and COVID-19 Complex Question Answering    Diego Mollá (Macquarie University, Sydney, Australia) arXiv_CL arXiv_CL  Bert  Classification  GAN  Medical  PDF
• 2022-09-05 ChemBERTa-2: Towards Chemical Foundation Models    Walid Ahmad, Elana Simon, Seyone Chithrananda, Gabriel Grand, Bharath Ramsundar arXiv_AI arXiv_AI  Bert  Salient  Knowledge  Self-Supervised  Prediction  PDF
• 2022-09-04 Generalization in Neural Networks: A Broad Survey    Chris Rohlfs arXiv_AI arXiv_AI  Transfer_Learning  Bert  Knowledge  Review  Knowledge_Graph  Survey  Action  Relation  Few-Shot  PDF
• 2022-09-03 A Variational Approach to the Quantum Separability Problem    Mirko Consiglio, Tony John George Apollaro, Marcin Wieśniak arXiv_CV arXiv_CV  Bert  Optimization  Pose  VQA  QA  PDF
• 2022-09-03 Multilingual ColBERT-X    Dawn Lawrie, Eugene Yang, Douglas W. Oard, James Mayfield arXiv_CL arXiv_CL  Bert  Language_Model  PDF
• 2022-09-02 GReS: Graphical Cross-domain Recommendation for Supply Chain Platform    Zhiwen Jing, Ziliang Zhao, Yang Feng, Xiaochen Ma, Nan Wu, Shengqiao Kang, Cheng Yang, Yujia Zhang, Hao Guo arXiv_AI arXiv_AI  Bert  Sparse  Pose  Recommendation  PDF
• 2022-09-02 FOLIO: Natural Language Reasoning with First-Order Logic    Simeng Han, Hailey Schoelkopf, Yilun Zhao, Zhenting Qi, Martin Riddell, Luke Benson, Lucy Sun, Ekaterina Zubova, Yujie Qiao, Matthew Burtell, David Peng, Jonathan Fan, Yixin Liu, Brian Wong, Malcolm Sailor, Ansong Ni, Linyong Nan, Jungo Kasai, Tao Yu, Rui Zhang, Shafiq Joty, Alexander R. Fabbri, Wojciech Kryscinski, Xi Victoria Lin, Caiming Xiong, Dragomir Radev arXiv_CL arXiv_CL  Bert  Few-Shot  Inference  Language_Model  PDF
• 2022-09-01 Multi-Scale Contrastive Co-Training for Event Temporal Relation Extraction    Hao-Ren Yao, Luke Breitfeller, Aakanksha Naik, Chunxiao Zhou, Carolyn Rose arXiv_AI arXiv_AI  Transformer  Embedding  Reinforcement_Learning  Bert  Contrastive_Learning  Action  Relation  Relation_Extraction  Language_Model  Prediction  PDF
• 2022-09-01 Negation detection in Dutch clinical texts: an evaluation of rule-based and machine learning methods    Bram van Es, Leon C. Reteig, Sander C. Tan, Marijn Schraagen, Myrthe M. Hemker, Sebastiaan R.S. Arends, Miguel A.R. Rios, Saskia Haitjema arXiv_CL arXiv_CL  Bert  RNN  Action  Classification  Detection  Medical  PDF
• 2022-09-01 Generating Coherent Drum Accompaniment With Fills And Improvisations    Rishabh Dahale, Vaibhav Talwadker, Preeti Rao, Prateek Verma arXiv_SD arXiv_SD  Transformer  Bert  Pose  Deep_Learning  PDF
• 2022-09-01 Enhancing Semantic Understanding with Self-supervised Methods for Abstractive Dialogue Summarization    Hyunjae Lee, Jaewoong Yun, Hyunjin Choi, Seongho Joe, Youngjune L. Gwon arXiv_AI arXiv_AI  Embedding  Bert  Self-Supervised  Summarization  Language_Model  PDF
• 2022-09-01 Isotropic Representation Can Improve Dense Retrieval    Euna Jung, Jungwon Park, Jaekeol Choi, Sungyoon Kim, Wonjong Rhee arXiv_CL arXiv_CL  Unsupervised  Bert  Pose  PDF
• 2022-08-31 The Fellowship of the Authors: Disambiguating Names from Social Network Context    Ryan Muther, David Smith arXiv_CL arXiv_CL  Unsupervised  Bert  Sparse  Inference  Language_Model  PDF
• 2022-08-31 Few-Shot Learning for Clinical Natural Language Processing Using Siamese Neural Networks    David Oniani, Sonish Sivarajkumar, Yanshan Wang arXiv_CL arXiv_CL  Embedding  Recognition  Bert  Text_Classification  Pose  Classification  Deep_Learning  Few-Shot  Language_Model  PDF
• 2022-08-30 MultiCoNER: A Large-scale Multilingual dataset for Complex Named Entity Recognition    Shervin Malmasi, Anjie Fang, Besnik Fetahu, Sudipta Kar, Oleg Rokhlenko arXiv_CL arXiv_CL  Recognition  Bert  Pose  Action  Language_Model  PDF
• 2022-08-30 Expressions Causing Differences in Emotion Recognition in Social Networking Service Documents    Tsubasa Nakagawa, Shunsuke Kitada, Hitoshi Iyatomi arXiv_CL arXiv_CL  Transformer  Recognition  Bert  Pose  Emotion  Detection  Object_Detection  PDF
• 2022-08-30 Transformers with Learnable Activation Functions    Haishuo Fang, Ji-Ung Lee, Nafise Sadat Moosavi, Iryna Gurevych arXiv_CL arXiv_CL  Transformer  Bert  Pose  Language_Model  PDF
• 2022-08-30 SwiftPruner: Reinforced Evolutionary Pruning for Efficient Ad Relevance    Li Lyna Zhang, Youkow Homma, Yujing Wang, Min Wu, Mao Yang, Ruofei Zhang, Ting Cao, Wei Shen arXiv_AI arXiv_AI  Transformer  Bert  Sparse  Pose  Inference  Prediction  PDF
• 2022-08-29 Combating high variance in Data-Scarce Implicit Hate Speech Classification    Debaditya Pal, Kaustubh Chaudhari, Harsh Sharma arXiv_CL arXiv_CL  Transformer  Bert  Optimization  Regularization  Speech  Classification  Detection  PDF
• 2022-08-29 Multi-dimensional Racism Classification during COVID-19: Stigmatization, Offensiveness, Blame, and Exclusion    Xin Pei, Deval Mehta arXiv_AI arXiv_AI  Bert  Classification  Detection  Prediction  PDF
• 2022-08-28 Training Text-To-Speech Systems From Synthetic Data: A Practical Approach For Accent Transfer Tasks    Lev Finkelstein, Heiga Zen, Norman Casagrande, Chun-an Chan, Ye Jia, Tom Kenter, Alexey Petelin, Jonathan Shen, Vincent Wan, Yu Zhang, Yonghui Wu, Rob Clark arXiv_SD arXiv_SD  Bert  Speech  PDF
• 2022-08-27 MDIA: A Benchmark for Multilingual Dialogue Generation in 46 Languages    Qingyu Zhang, Xiaoyu Shen, Ernie Chang, Jidong Ge, Pengke Chen arXiv_CL arXiv_CL  Bert  Zero-Shot  Few-Shot  QA  PDF
• 2022-08-26 Task-specific Pre-training and Prompt Decomposition for Knowledge Graph Population with Language Models    Tianyi Li, Wenyu Huang, Nikos Papasarantopoulos, Pavlos Vougiouklis, Jeff Z. Pan arXiv_CL arXiv_CL  Transformer  Bert  Knowledge  Knowledge_Graph  Language_Model  PDF
• 2022-08-25 A Compact Pretraining Approach for Neural Language Models    Shahriar Golchin, Mihai Surdeanu, Nazgol Tavabi, Ata Kiapour arXiv_CL arXiv_CL  Bert  Language_Model  PDF
• 2022-08-24 Addressing Token Uniformity in Transformers via Singular Value Transformation    Hanqi Yan, Lin Gui, Wenjie Li, Yulan He arXiv_CL arXiv_CL  Transformer  Embedding  Bert  Pose  Attention  Language_Model  PDF
• 2022-08-24 IndicSUPERB: A Speech Processing Universal Performance Benchmark for Indian languages    Tahir Javed, Kaushal Santosh Bhogale, Abhigyan Raman, Anoop Kunchukuttan, Pratyush Kumar, Mitesh M. Khapra arXiv_CL arXiv_CL  Recognition  Bert  Speech  Self-Supervised  Speech_Recognition  Language_Model  PDF
• 2022-08-24 DPTDR: Deep Prompt Tuning for Dense Passage Retrieval    Zhengyang Tang, Benyou Wang, Ting Yao arXiv_CL arXiv_CL  Bert  Pose  Language_Model  PDF
• 2022-08-23 The Alberta Plan for AI Research    Richard S. Sutton, Michael H. Bowling, Patrick M. Pilarski arXiv_AI arXiv_AI  Bert  PDF
• 2022-08-23 K-MHaS: A Multi-label Hate Speech Detection Dataset in Korean Online News Comment    Jean Lee, Taejun Lim, Heejun Lee, Bogeun Jo, Yangsok Kim, Heegeun Yoon, Soyeon Caren Han arXiv_AI arXiv_AI  Bert  Speech  Pose  Classification  Detection  PDF
• 2022-08-22 PoseBERT: A Generic Transformer Module for Temporal 3D Human Modeling    Fabien Baradel, Romain Brégier, Thibault Groueix, Philippe Weinzaepfel, Yannis Kalantidis, Grégory Rogez arXiv_CV arXiv_CV  Transformer  3D  Bert  Pose_Estimation  Pose  Prediction  PDF
• 2022-08-21 MockingBERT: A Method for Retroactively Adding Resilience to NLP Models    Jan Jezabek, Akash Singh arXiv_CL arXiv_CL  Transformer  Bert  Adversarial  Pose  PDF
• 2022-08-21 A Syntax Aware BERT for Identifying Well-Formed Queries in a Curriculum Framework    Avinash Madasu, Anvesh Rao Vijjini arXiv_CL arXiv_CL  Transformer  Bert  Speech  Pose  Language_Model  PDF
• 2022-08-21 CMSBERT-CLR: Context-driven Modality Shifting BERT with Contrastive Learning for linguistic, visual, acoustic Representations    Junghun Kim, Jihie Kim arXiv_CL arXiv_CL  Embedding  Bert  Optimization  Contrastive_Learning  Sentiment  PDF
• 2022-08-20 BSpell: A CNN-blended BERT Based Bengali Spell Checker    Chowdhury Rafeed Rahman, MD. Hasibur Rahman, Samiha Zakir, Mohammad Rafsan, Mohammed Eunus Ali arXiv_CL arXiv_CL  Bert  Pose  PDF
• 2022-08-20 Combining Compressions for Multiplicative Size Scaling on Natural Language Tasks    Rajiv Movva, Jinhao Lei, Shayne Longpre, Ajay Gupta, Chris DuBois arXiv_CL arXiv_CL  Quantization  Bert  Knowledge  Action  Quantitative  Inference  PDF
• 2022-08-20 Representing Knowledge by Spans: A Knowledge-Enhanced Model for Information Extraction    Jiacheng Li, Yannis Katsis, Tyler Baldwin, Ho-Cheol Kim, Andrew Bartko, Julian McAuley, Chun-Nan Hsu arXiv_AI arXiv_AI  Transformer  Embedding  Unsupervised  Bert  Knowledge  Knowledge_Graph  Pose  Action  Relation  Relation_Extraction  Language_Model  PDF
• 2022-08-20 Pretrained Language Encoders are Natural Tagging Frameworks for Aspect Sentiment Triplet Extraction    Yanjie Gou, Yinjie Lei, Lingqiao Liu, Yong Dai, Chunxu Shen, Yongqi Tong arXiv_CL arXiv_CL  Recognition  Bert  Knowledge  Action  Detection  Relation  Sentiment  Attention  PDF
• 2022-08-20 Using Multi-Encoder Fusion Strategies to Improve Personalized Response Selection    Souvik Das, Sougata Saha, Rohini K. Srihari arXiv_AI arXiv_AI  Bert  Emotion  Action  Relation  PDF
• 2022-08-19 Graph-Augmented Cyclic Learning Framework for Similarity Estimation of Medical Clinical Notes    Can Zheng, Yanshan Wang, Xiaowei Jia arXiv_CL arXiv_CL  Bert  Knowledge  Relation  Medical  Language_Model  PDF
• 2022-08-19 Crafting Monocular Cues and Velocity Guidance for Self-Supervised Multi-Frame Depth Learning    Xiaofeng Wang, Zheng Zhu, Guan Huang, Xu Chi, Yun Ye, Ziwei Chen, Xingang Wang arXiv_CV arXiv_CV  Bert  Self-Supervised  Pose  Face  PDF
• 2022-08-19 UniCausal: Unified Benchmark and Model for Causal Text Mining    Fiona Anting Tan, Xinyu Zuo, See-Kiong Ng arXiv_CL arXiv_CL  Bert  Pose  Action  Classification  Detection  PDF
• 2022-08-19 MonaCoBERT: Monotonic attention based ConvBERT for Knowledge Tracing    Unggi Lee, Yonghyun Park, Yujin Kim, Seongyune Choi, Hyeoncheol Kim arXiv_AI arXiv_AI  Embedding  Bert  Knowledge  Pose  Quantitative  Relation  Attention  CNN  PDF
• 2022-08-18 VAuLT: Augmenting the Vision-and-Language Transformer with the Propagation of Deep Language Representations    Georgios Chochlakis, Tejas Srinivasan, Jesse Thomason, Shrikanth Narayanan (University of Southern California) arXiv_CV arXiv_CV  Image_Caption  Transformer  Bert  Pose  Relation  Caption  Inference  Language_Model  PDF
• 2022-08-17 Analyzing Robustness of End-to-End Neural Models for Automatic Speech Recognition    Goutham Rajendran, Wei Zou arXiv_CL arXiv_CL  Recognition  Bert  Adversarial  Speech  Speech_Recognition  Inference  Prediction  PDF
• 2022-08-17 EmoMent: An Emotion Annotated Mental Health Corpus from two South Asian Countries    Thushari Atapattu, Mahen Herath, Charitha Elvitigala, Piyanjali de Zoysa, Kasun Gunawardana, Menasha Thilakaratne, Kasun de Zoysa, Katrina Falkner arXiv_CL arXiv_CL  Bert  Emotion  Face  PDF
• 2022-08-17 Extracting Medication Changes in Clinical Narratives using Pre-trained Language Models    Giridhar Kaushik Ramachandran, Kevin Lybarger, Yaya Liu, Diwakar Mahajan, Jennifer J. Liang, Ching-Huei Tsou, Meliha Yetisgen, Özlem Uzuner arXiv_CL arXiv_CL  Bert  Pose  Action  Classification  Language_Model  PDF
• 2022-08-17 Summarizing Patients Problems from Hospital Progress Notes Using Pre-trained Sequence-to-Sequence Models    Yanjun Gao, Dmitry Dligach, Timothy Miller, Dongfang Xu, Matthew M. Churpek, Majid Afshar arXiv_CL arXiv_CL  Transformer  Embedding  Bert  Knowledge  Pose  Summarization  Medical  Language_Model  PDF
• 2022-08-17 Transformer Encoder for Social Science    Haosen Ge, In Young Park, Xuancheng Qian, Grace Zeng arXiv_CL arXiv_CL  Transformer  Bert  Pose  PDF
• 2022-08-16 BERTifying Sinhala -- A Comprehensive Analysis of Pre-trained Language Models for Sinhala Text Classification    Vinura Dhananjaya, Piyumal Demotte, Surangika Ranathunga, Sanath Jayasena arXiv_CL arXiv_CL  Bert  Text_Classification  Classification  Language_Model  Recommendation  PDF
• 2022-08-16 BERT to Detect Multiword Expressions    Damith Premasiri, Tharindu Ranasinghe arXiv_CL arXiv_CL  Transformer  Bert  RNN  Action  PDF
• 2022-08-15 MENLI: Robust Evaluation Metrics from Natural Language Inference    Yanran Chen, Steffen Eger arXiv_CL arXiv_CL  Bert  Adversarial  Pose  Summarization  Inference  PDF
• 2022-08-15 Z-BERT-A: a zero-shot Pipeline for Unknown Intent detection    Daniele Comi, Dimitrios Christofidellis, Pier Francesco Piazza, Matteo Manica arXiv_CL arXiv_CL  Transformer  Bert  Zero-Shot  Pose  Classification  Detection  Inference  Language_Model  PDF
• 2022-08-15 Continuous Active Learning Using Pretrained Transformers    Nima Sadri, Gordon V. Cormack arXiv_AI arXiv_AI  Transformer  Bert  PDF
• 2022-08-14 Text Difficulty Study: Do machines behave the same as humans regarding text difficulty?    Bowen Chen, Xiao Ding, Li Du, Qin Bing, Ting Liu arXiv_CL arXiv_CL  Bert  RNN  Pose  Attention  Matching  PDF
• 2022-08-13 Interpreting BERT-based Text Similarity via Activation and Saliency Maps    Itzik Malkiel, Dvir Ginzburg, Oren Barkan, Avi Caciularu, Jonathan Weill, Noam Koenigstein arXiv_CL arXiv_CL  Transformer  Embedding  Unsupervised  Bert  Salient  Prediction  PDF
• 2022-08-13 MetricBERT: Text Representation Learning via Self-Supervised Triplet Training    Itzik Malkiel, Dvir Ginzburg, Oren Barkan, Avi Caciularu, Yoni Weill, Noam Koenigstein arXiv_CL arXiv_CL  Bert  Represenation_Learning  Self-Supervised  Recommendation  PDF
• 2022-08-12 Automated Utterance Labeling of Conversations Using Natural Language Processing    Maria Laricheva, Chiyu Zhang, Yan Liu, Guanyu Chen, Terence Tracey, Richard Young, Giuseppe Carenini arXiv_CL arXiv_CL  Bert  Pose  Emotion  Classification  Deep_Learning  PDF
• 2022-08-12 Is Your Model Sensitive? SPeDaC: A New Benchmark for Detecting and Classifying Sensitive Personal Data    Gaia Gambarelli, Aldo Gangemi, Rocco Tripodi arXiv_AI arXiv_AI  Bert  Classification  Detection  PDF
• 2022-08-11 A Twitter-Driven Deep Learning Mechanism for the Determination of Vehicle Hijacking Spots in Cities    Taahir Aiyoob Patel, Clement N. Nyirenda arXiv_CL arXiv_CL  Transformer  Bert  Pose  Deep_Learning  CNN  PDF
• 2022-08-11 Word-Embeddings Distinguish Denominal and Root-Derived Verbs in Semitic    Ido Benbaji (MIT), Omri Doron (MIT), Adèle Hénot-Mortier (MIT) arXiv_AI arXiv_AI  Embedding  Bert  Pose  Relation  Language_Model  PDF
• 2022-08-11 A Model of Anaphoric Ambiguities using Sheaf Theoretic Quantum-like Contextuality and BERT    Kin Ian Lo (University College London, London, UK), Mehrnoosh Sadrzadeh (University College London, London, UK), Shane Mansfield (Quandela, Paris, France) arXiv_AI arXiv_AI  Embedding  Bert  Pose  PDF
• 2022-08-11 Searching for chromate replacements using natural language processing and machine learning algorithms    Shujing Zhao, Nick Birbilis arXiv_CL arXiv_CL  Embedding  Bert  Knowledge  Pose  Quantitative  Relation  Language_Model  PDF
• 2022-08-10 Learning Two-Player Mixture Markov Games: Kernel Function Approximation and Correlated Equilibrium    Chris Junchi Li, Dongruo Zhou, Quanquan Gu, Michael I. Jordan arXiv_AI arXiv_AI  Bert  Pose  Face  Action  PDF
• 2022-08-10 Multi-View Pre-Trained Model for Code Vulnerability Identification    Xuxiang Jiang, Yinhao Xiao, Jun Wang, Wei Zhang arXiv_AI arXiv_AI  Bert  Pose  Contrastive_Learning  PDF
• 2022-08-09 Emotion Detection From Tweets Using a BERT and SVM Ensemble Model    Ionuţ-Alexandru Albu, Stelian Spînu arXiv_CL arXiv_CL  Transformer  Recognition  Bert  Pose  Emotion  Detection  PDF
• 2022-08-09 Attention Hijacking in Trojan Transformers    Weimin Lyu, Songzhu Zheng, Tengfei Ma, Haibin Ling, Chao Chen arXiv_AI arXiv_AI  Transformer  Bert  Pose  Detection  Object_Detection  Attention  PDF
• 2022-08-09 A Multimodal Transformer: Fusing Clinical Notes with Structured EHR Data for Interpretable In-Hospital Mortality Prediction    Weimin Lyu, Xinyu Dong, Rachel Wong, Songzhu Zheng, Kayley Abell-Hart, Fusheng Wang, Chao Chen arXiv_CL arXiv_CL  Transformer  Bert  Pose  Prediction  PDF
• 2022-08-09 Exploring Hate Speech Detection with HateXplain and BERT    Arvind Subramaniam, Aryan Mehra, Sayani Kundu arXiv_CL arXiv_CL  Bert  Speech  Classification  Detection  Attention  Prediction  PDF
• 2022-08-07 SciAnnotate: A Tool for Integrating Weak Labeling Sources for Sequence Labeling    Mengyang Liu, Haozheng Luo, Leonard Thong, Yinghao Li, Chao Zhang, Le Song arXiv_CL arXiv_CL  Recognition  Bert  Face  Denoising  Language_Model  PDF
• 2022-08-06 HSIC-InfoGAN: Learning Unsupervised Disentangled Representations by Maximising Approximated Mutual Information    Xiao Liu, Spyridon Thermos, Pedro Sanchez, Alison Q. O'Neil, Sotirios A. Tsaftaris arXiv_CV arXiv_CV  Unsupervised  Bert  GAN  Medical  PDF
• 2022-08-05 Leveraging Distributional Bias for Reactive Collision Avoidance under Uncertainty: A Kernel Embedding Approach    Anish Gupta, Arun Kumar Singh, K. Madhava Krishna arXiv_RO arXiv_RO  Embedding  Bert  Pose  Activity  Matching  PDF
• 2022-08-03 A Study of Modeling Rising Intonation in Cantonese Neural Speech Synthesis    Qibing Bai, Tom Ko, Yu Zhang arXiv_SD arXiv_SD  Bert  Speech  Pose  Language_Model  PDF
• 2022-08-03 KPI-BERT: A Joint Named Entity Recognition and Relation Extraction Model for Financial Reports    Lars Hillebrand, Tobias Deußer, Tim Dilmaghani, Bernd Kliem, Rüdiger Loitz, Christian Bauckhage, Rafet Sifa arXiv_AI arXiv_AI  Transformer  Recognition  Bert  RNN  Knowledge  Action  Relation  Relation_Extraction  Prediction  PDF
• 2022-08-03 Efficient Fine-Tuning of Compressed Language Models with Learners    Danilo Vucetic, Mohammadreza Tayaranian, Maryam Ziaeefard, James J. Clark, Brett H. Meyer, Warren J. Gross arXiv_CL arXiv_CL  Bert  Inference  Language_Model  PDF
• 2022-08-03 Cross-lingual Approaches for the Detection of Adverse Drug Reactions in German from a Patient's Perspective    Lisa Raithel, Philippe Thomas, Roland Roller, Oliver Sapina, Sebastian Möller, Pierre Zweigenbaum arXiv_CL arXiv_CL  Bert  Action  Classification  Detection  Few-Shot  Medical  PDF
• 2022-08-03 Introducing BEREL: BERT Embeddings for Rabbinic-Encoded Language    Avi Shmidman, Joshua Guedalia, Shaltiel Shmidman, Cheyn Shmuel Shmidman, Eli Handel, Moshe Koppel arXiv_CL arXiv_CL  Embedding  Bert  Language_Model  PDF
• 2022-08-02 Exploring Gender Bias in Retrieval Models    Dhanasekar Sundararaman, Vivek Subramanian arXiv_CL arXiv_CL  Bert  Zero-Shot  Action  PDF
• 2022-08-02 BERT4Loc: BERT for Location -- POI Recommender System    Syed Raza Bashir, Vojislav Misic arXiv_AI arXiv_AI  Transformer  Bert  Pose  Recommendation  PDF
• 2022-08-02 A Comparative Study on COVID-19 Fake News Detection Using Different Transformer Based Models    Sajib Kumar Saha Joy, Dibyo Fabian Dofadar, Riyo Hayat Khan, Md. Sabbir Ahmed, Rafeed Rahman arXiv_CL arXiv_CL  Transformer  Bert  RNN  Detection  PDF
• 2022-08-02 Bias in -Contextual Clinical Word Embeddings    Gizem Sogancioglu, Fabian Mijsters, Amar van Uden, Jelle Peperzak arXiv_CL arXiv_CL  Embedding  Bert  Relation  Medical  PDF
• 2022-08-02 BEIKE NLP at SemEval-2022 Task 4: Prompt-Based Paragraph Classification for Patronizing and Condescending Language Detection    Yong Deng, Chenxiao Dou, Liangyu Chen, Deqiang Miao, Xianghui Sun, Baochang Ma, Xiangang Li arXiv_CL arXiv_CL  Bert  Text_Classification  Classification  Detection  Language_Model  PDF
• 2022-08-02 Automatic Classification of Bug Reports Based on Multiple Text Information and Reports' Intention    Fanqi Meng, Xuesong Wang, Jingdong Wang, Peifang Wang arXiv_CL arXiv_CL  Tracking  Bert  Pose  Classification  PDF
• 2022-08-01 BabelBERT: Massively Multilingual Transformers Meet a Massively Multilingual Lexical Resource    Tommaso Green, Simone Paolo Ponzetto, Goran Glavaš arXiv_CL arXiv_CL  Transformer  Embedding  Bert  Knowledge  Pose  Language_Model  PDF
• 2022-08-01 giMLPs: Gate with Inhibition Mechanism in MLPs    Cheng Kang, Jindich Prokop, Lei Tong, Huiyu Zhou, Yong Hu, Daneil Novak arXiv_CL arXiv_CL  Bert  Classification  Attention  Image_Classification  PDF
• 2022-08-01 DictBERT: Dictionary Description Knowledge Enhanced Language Model Pre-training via Contrastive Learning    Qianglong Chen, Feng-Lin Li, Guohai Xu, Ming Yan, Ji Zhang, Yin Zhang arXiv_CL arXiv_CL  Transformer  Bert  Knowledge  Knowledge_Graph  Pose  Contrastive_Learning  Action  Relation  Relation_Extraction  Attention  Language_Model  Prediction  QA  PDF
• 2022-07-31 Mismatching-Aware Unsupervised Translation Quality Estimation For Low-Resource Languages    Fatemeh Azadi, Heshaam Faili, Mohammad Javad Dousti arXiv_CL arXiv_CL  Unsupervised  Bert  Zero-Shot  Pose  Relation  Attention  Matching  PDF
• 2022-07-30 A Survey on Masked Autoencoder for Self-supervised Learning in Vision and Beyond    Chaoning Zhang, Chenshuang Zhang, Junha Song, John Seon Keun Yi, Kang Zhang, In So Kweon arXiv_AI arXiv_AI  Bert  Review  Self-Supervised  Contrastive_Learning  Survey  Denoising  Attention  Prediction  PDF
• 2022-07-29 SERCNN: Stacked Embedding Recurrent Convolutional Neural Network in Detecting Depression on Twitter    Heng Ee Tay, Mei Kuan Lim, Chun Yong Chong arXiv_AI arXiv_AI  Embedding  Bert  Pose  Activity  CNN  Inference  PDF
• 2022-07-29 Curriculum Learning for Data-Efficient Vision-Language Alignment    Tejas Srinivasan, Xiang Ren, Jesse Thomason arXiv_AI arXiv_AI  Transformer  Bert  Zero-Shot  Image_Retrieval  Ontology  Contrastive_Learning  PDF
• 2022-07-29 Code Comment Inconsistency Detection with BERT and Longformer    Theo Steiner, Rui Zhang arXiv_CL arXiv_CL  Bert  Pose  Detection  Inference  Language_Model  PDF
• 2022-07-28 Aztec curve: proposal for a new space-filling curve    Diego Ayala, Daniel Durini, Jose Rangel-Magdaleno arXiv_CV arXiv_CV  Bert  Review  Pose  PDF
• 2022-07-28 Multi-Step Deductive Reasoning Over Natural Language: An Empirical Study on Out-of-Distribution Generalisation    Qiming Bao, Alex Yuxuan Peng, Tim Hartill, Neset Tan, Zhenyun Deng, Michael Witbrock, Jiamou Liu arXiv_AI arXiv_AI  Bert  RNN  Deep_Learning  Attention  Inference  PDF
• 2022-07-28 Sequence to sequence pretraining for a less-resourced Slovenian language    Matej Ulčar, Marko Robnik-Šikonja arXiv_CL arXiv_CL  Bert  Classification  Summarization  Text_Generation  Language_Model  PDF
• 2022-07-28 MLRIP: Pre-training a military language representation model with informative factual knowledge and professional knowledge base    Hui Li, Xuekang Yang, Xin Zhao, Lin Yu, Jiping Zheng, Wei Sun arXiv_CL arXiv_CL  Transformer  Bert  Knowledge  Pose  Action  Relation  Relation_Extraction  Language_Model  PDF
• 2022-07-28 SDBERT: SparseDistilBERT, a faster and smaller BERT model    Devaraju Vinoda, Pawan Kumar Yadav arXiv_CL arXiv_CL  Transformer  Bert  Sparse  Knowledge  Attention  PDF
• 2022-07-27 Detecting Spam Reviews on Vietnamese E-commerce Websites    Co Van Dinh, Son T. Luu, Anh Gia-Tuan Nguyen arXiv_AI arXiv_AI  Bert  Review  Pose  Classification  PDF
• 2022-07-27 SoundChoice: Grapheme-to-Phoneme Models with Semantic Disambiguation    Artem Ploujnikov, Mirco Ravanelli arXiv_SD arXiv_SD  Embedding  Recognition  Bert  Speech  Pose  Classification  Speech_Recognition  Language_Model  PDF
• 2022-07-27 Point-McBert: A Multi-choice Self-supervised Framework for Point Cloud Pre-training    Kexue Fu, Mingzhi Yuan, Manning Wang arXiv_CV arXiv_CV  Transformer  Segmentation  Point_Cloud  Bert  Self-Supervised  Pose  Classification  Few-Shot  Language_Model  PDF
• 2022-07-26 When BERT Fails -- The Limits of EHR Classification    Augusto Garcia-Agundez, Carsten Eickhoff arXiv_CL arXiv_CL  Transformer  Bert  Classification  Prediction  PDF
• 2022-07-26 Learning structures of the French clinical language:development and validation of word embedding models using 21 million clinical reports from electronic health records    Basile Dura, Charline Jean, Xavier Tannier, Alice Calliger, Romain Bey, Antoine Neuraz, Rémi Flicoteaux arXiv_CL arXiv_CL  Transformer  Embedding  Transfer_Learning  Bert  Medical  Language_Model  PDF
• 2022-07-26 Bundle MCR: Towards Conversational Bundle Recommendation    Zhankui He, Handong Zhao, Tong Yu, Sungchul Kim, Fan Du, Julian McAuley arXiv_AI arXiv_AI  Transformer  Bert  Pose  Action  Recommendation  PDF
• 2022-07-25 Fine-Tuning BERT for Automatic ADME Semantic Labeling in FDA Drug Labeling to Enhance Product-Specific Guidance Assessment    Yiwen Shi, Jing Wang, Ping Ren, Taha ValizadehAslani, Yi Zhang, Meng Hu, Hualou Liang arXiv_CL arXiv_CL  Transformer  Transfer_Learning  Bert  Knowledge  Attention  Language_Model  PDF
• 2022-07-25 UrduFake@FIRE2020: Shared Track on Fake News Identification in Urdu    Maaz Amjad, Grigori Sidorov, Alisa Zhila, Alexander Gelbukh, Paolo Rosso arXiv_CL arXiv_CL  Bert  Pose  Classification  Detection  PDF
• 2022-07-25 Overview of the Shared Task on Fake News Detection in Urdu at FIRE 2020    Maaz Amjad, Grigori Sidorov, Alisa Zhila, Alexander Gelbukh, Paolo Rosso arXiv_CL arXiv_CL  Bert  Pose  Classification  Detection  PDF
• 2022-07-25 nLMVS-Net: Deep Non-Lambertian Multi-View Stereo    Kohei Yamashita, Yuto Enyo, Shohei Nobuhara, Ko Nishino arXiv_CV arXiv_CV  Reconstruction  Bert  Face  Quantitative  PDF
• 2022-07-24 A Cognitive Study on Semantic Similarity Analysis of Large Corpora: A Transformer-based Approach    Praneeth Nemani, Satyanarayana Vollala arXiv_AI arXiv_AI  Transformer  Recognition  Bert  RNN  Action  Relation  Attention  Matching  PDF
• 2022-07-24 Kernel Relative-prototype Spectral Filtering for Few-shot Learning    Tao Zhang, Wu Huang arXiv_AI arXiv_AI  Bert  Regularization  Pose  Classification  Few-Shot  PDF
• 2022-07-24 No More Fine-Tuning? An Experimental Evaluation of Prompt Tuning in Code Intelligence    Chaozheng Wang, Yuanhang Yang, Cuiyun Gao, Yun Peng, Hongyu Zhang, Michael R. Lyu arXiv_AI arXiv_AI  Transformer  Bert  Knowledge  Summarization  Prediction  PDF
• 2022-07-23 Better Reasoning Behind Classification Predictions with BERT for Fake News Detection    Daesoo Lee arXiv_CL arXiv_CL  Embedding  Bert  Self-Supervised  Pose  Classification  Detection  Prediction  PDF
• 2022-07-23 Vaccine Discourse on Twitter During the COVID-19 Pandemic    Gabriel Lindelöf, Talayeh Aledavood, Barbara Keller arXiv_CL arXiv_CL  Bert  PDF
• 2022-07-23 Catch Me If You Can: Deceiving Stance Detection and Geotagging Models to Protect Privacy of Individuals on Twitter    Dilara Dogan, Bahadir Altun, Muhammed Said Zengin, Mucahid Kutlu, Tamer Elsayed arXiv_CL arXiv_CL  Bert  Salient  Detection  PDF