Bert

2022-05-26 The Document Vectors Using Cosine Similarity Revisited Zhang Bingyu, Nikolay Arefyev arXiv_AI arXiv_AI Transformer Bert Review Pose Sentiment PDF
2022-05-26 Federated Split BERT for Heterogeneous Text Classification Zhengyang Li, Shijing Si, Jianzong Wang, Jing Xiao arXiv_AI arXiv_AI Quantization Bert Text_Classification Pose Classification PDF
2022-05-26 Leveraging Dependency Grammar for Fine-Grained Offensive Language Detection using Graph Convolutional Networks Divyam Goel, Raksha Sharma arXiv_CL arXiv_CL Embedding Bert RNN Pose Deep_Learning Detection CNN PDF
2022-05-26 Matryoshka Representations for Adaptive Deployment Aditya Kusupati, Gantavya Bhatt, Aniket Rege, Matthew Wallingford, Aditya Sinha, Vivek Ramanujan, William Howard-Snyder, Kaifeng Chen, Sham Kakade, Prateek Jain, Ali Farhadi arXiv_CV arXiv_CV Embedding Bert Represenation_Learning Pose Classification Few-Shot Inference PDF
2022-05-25 BiT: Robustly Binarized Multi-distilled Transformer Zechun Liu, Barlas Oguz, Aasish Pappu, Lin Xiao, Scott Yih, Meng Li, Raghuraman Krishnamoorthi, Yashar Mehdad arXiv_CL arXiv_CL Transformer Bert Optimization PDF
2022-05-25 Transcormer: Transformer for Sentence Scoring with Sliding Language Modeling Kaitao Song, Yichong Leng, Xu Tan, Yicheng Zou, Tao Qin, Dongsheng Li arXiv_CL arXiv_CL Transformer Bert Pose Attention Language_Model PDF
2022-05-25 Train Flat, Then Compress: Sharpness-Aware Minimization Learns More Compressible Models Clara Na, Sanket Vaibhav Mehta, Emma Strubell arXiv_AI arXiv_AI Quantization Bert Optimization Pose Classification PDF
2022-05-25 Discovering Language-neutral Sub-networks in Multilingual Language Models Negar Foroutan, Mohammadreza Banaei, Remi Lebret, Antoine Bosselut, Karl Aberer arXiv_CL arXiv_CL Bert Language_Model PDF
2022-05-25 ORCA: Interpreting Prompted Language Models via Locating Supporting Data Evidence in the Ocean of Pretraining Data Xiaochuang Han, Yulia Tsvetkov arXiv_CL arXiv_CL Bert Zero-Shot Knowledge Pose Sentiment Language_Model PDF
2022-05-25 RobustLR: Evaluating Robustness to Logical Perturbation in Deductive Reasoning Soumya Sanyal, Zeyi Liao, Xiang Ren arXiv_CL arXiv_CL Transformer Bert Pose Language_Model PDF
2022-05-25 RLPrompt: Optimizing Discrete Text Prompts With Reinforcement Learning Mingkai Deng, Jianyu Wang, Cheng-Ping Hsieh, Yihan Wang, Han Guo, Tianmin Shu, Meng Song, Eric P. Xing, Zhiting Hu arXiv_CL arXiv_CL Embedding Unsupervised Style_Transfer Reinforcement_Learning Bert Optimization Pose Classification Few-Shot Language_Model PDF
2022-05-25 Is a Question Decomposition Unit All We Need? Pruthvi Patel, Swaroop Mishra, Mihir Parmar, Chitta Baral arXiv_AI arXiv_AI Bert Pose Language_Model PDF
2022-05-25 Text-to-Face Generation with StyleGAN2 D. M. A. Ayanthi, Sarasi Munasinghe arXiv_CV arXiv_CV Embedding Bert Adversarial Pose Face GAN PDF
2022-05-25 Sparse*BERT: Sparse Models are Robust Daniel Campos, Alexandre Marques, Tuan Nguyen, Mark Kurtz, ChengXiang Zhai arXiv_AI arXiv_AI Quantization Bert Sparse Medical Inference Language_Model PDF
2022-05-25 Towards Understanding Label Regularization for Fine-tuning Pre-trained Language Models Ivan Kobyzev, Aref Jafari, Mehdi Rezagholizadeh, Tianda Li, Alan Do-Omri, Peng Lu, Ali Ghodsi, Pascal Poupart arXiv_CL arXiv_CL Bert Regularization Knowledge Language_Model Prediction PDF
2022-05-25 VulBERTa: Simplified Source Code Pre-Training for Vulnerability Detection Hazim Hanif, Sergio Maffeis arXiv_AI arXiv_AI Bert Knowledge Deep_Learning Detection PDF
2022-05-24 Sparse Mixers: Combining MoE and Mixing to build a more efficient BERT James Lee-Thorp, Joshua Ainslie arXiv_CL arXiv_CL Bert Sparse Inference PDF
2022-05-24 K-12BERT: BERT for K-12 education Vasu Goel, Dhruv Sahnan, Venktesh V, Gaurav Sharma, Deep Dwivedi, Mukesh Mohania arXiv_CL arXiv_CL Bert Knowledge Pose Language_Model PDF
2022-05-24 Garden-Path Traversal within GPT-2 William Jurayj, William Rudman, Carsten Eickhoff arXiv_CL arXiv_CL Transformer Bert Language_Model PDF
2022-05-24 GeoMLAMA: Geo-Diverse Commonsense Probing on Multilingual Pre-Trained Language Models Da Yin, Hritik Bansal, Masoud Monajatipoor, Liunian Harold Li, Kai-Wei Chang arXiv_CL arXiv_CL Bert Knowledge Relation Language_Model PDF
2022-05-24 Partial-input baselines show that NLI models can ignore context, but they don't Neha Srikanth, Rachel Rudinger arXiv_CL arXiv_CL Bert Relation Inference PDF
2022-05-24 RetroMAE: Pre-training Retrieval-oriented Transformers via Masked Auto-Encoder Zheng Liu, Yingxia Shao arXiv_CL arXiv_CL Transformer Reconstruction Embedding Bert Pose PDF
2022-05-24 Word-order typology in Multilingual BERT: A case study in subordinate-clause detection Dmitry Nikolaev, Sebastian Padó arXiv_CL arXiv_CL Bert Zero-Shot Action Detection PDF
2022-05-24 Formulating Few-shot Fine-tuning Towards Language Model Pre-training: A Pilot Study on Named Entity Recognition Zihan Wang, Kewen Zhao, Zilong Wang, Jingbo Shang arXiv_AI arXiv_AI Recognition Bert Pose Few-Shot Language_Model Prediction PDF
2022-05-24 On the Role of Bidirectionality in Language Model Pre-Training Mikel Artetxe, Jingfei Du, Naman Goyal, Luke Zettlemoyer, Ves Stoyanov arXiv_AI arXiv_AI Bert Zero-Shot Pose Attention Language_Model Prediction PDF
2022-05-23 FlexiBERT: Are Current Transformer Architectures too Homogeneous and Rigid? Shikhar Tuli, Bhishma Dedhia, Shreshth Tuli, Niraj K. Jha arXiv_CL arXiv_CL Transformer NAS Embedding Bert Optimization Pose Language_Model PDF
2022-05-23 Simple Recurrence Improves Masked Language Models Tao Lei, Ran Tian, Jasmijn Bastings, Ankur P. Parikh arXiv_AI arXiv_AI Transformer Bert Optimization Language_Model PDF
2022-05-23 Learning to Ignore Adversarial Attacks Yiming Zhang, Yangqiaoyu Zhou, Samuel Carton, Chenhao Tan arXiv_AI arXiv_AI Bert Adversarial PDF
2022-05-23 On the Paradox of Learning to Reason from Data Honghua Zhang, Liunian Harold Li, Tao Meng, Kai-Wei Chang, Guy Van den Broeck arXiv_AI arXiv_AI Bert PDF
2022-05-23 Multilingual Extraction and Categorization of Lexical Collocations with Graph-aware Transformers Luis Espinosa-Anke, Alexander Shvets, Alireza Mohammadshahi, James Henderson, Leo Wanner arXiv_CL arXiv_CL Transformer Recognition Bert Action PDF
2022-05-23 Outliers Dimensions that Disrupt Transformers Are Driven by Frequency Giovanni Puccetti, Anna Rogers, Aleksandr Drozd, Felice Dell'Orletta arXiv_AI arXiv_AI Transformer Embedding Bert Relation Attention Language_Model PDF
2022-05-23 ScholarBERT: Bigger is Not Always Better Zhi Hong, Aswathy Ajith, Gregory Pauloski, Eamon Duede, Carl Malamud, Roger Magoulas, Kyle Chard, Ian Foster arXiv_CL arXiv_CL Transformer Bert Language_Model PDF
2022-05-23 Sample Efficient Approaches for Idiomaticity Detection Dylan Phelps, Xuan-Rui Fan, Edward Gow-Smith, Harish Tayyar Madabushi, Carolina Scarton, Aline Villavicencio arXiv_CL arXiv_CL Transformer Embedding Bert Classification Detection Few-Shot Language_Model PDF
2022-05-23 Prompt Tuning for Discriminative Pre-trained Language Models Yuan Yao, Bowen Dong, Ao Zhang, Zhengyan Zhang, Ruobing Xie, Zhiyuan Liu, Leyu Lin, Maosong Sun, Jianyong Wang arXiv_AI arXiv_AI Bert Text_Classification Knowledge Classification Language_Model PDF
2022-05-23 RuNNE-2022 Shared Task: Recognizing Nested Named Entities Ekaterina Artemova, Maxim Zmeev, Natalia Loukachevitch, Igor Rozhkov, Tatiana Batura, Vladimir Ivanov, Elena Tutubalina arXiv_CL arXiv_CL Recognition Bert Few-Shot GAN PDF
2022-05-23 DistilCamemBERT: a distillation of the French model CamemBERT Cyrile Delestre, Abibatou Amar arXiv_CL arXiv_CL Transformer Bert PDF
2022-05-23 TempLM: Distilling Language Models into Template-Based Generators Tianyi Zhang, Mina Lee, Lisa Li, Ende Shen, Tatsunori B. Hashimoto arXiv_CL arXiv_CL Bert Pose Text_Generation Language_Model PDF
2022-05-23 Artificial intelligence for topic modelling in Hindu philosophy: mapping themes between the Upanishads and the Bhagavad Gita Rohitash Chandra, Mukul Ranjan arXiv_CL arXiv_CL Embedding Bert Deep_Learning Language_Model PDF
2022-05-23 Parameter-Efficient Sparsity for Large Language Models Fine-Tuning Yuchao Li, Fuli Luo, Chuanqi Tan, Mengdi Wang, Songfang Huang, Shen Li, Junjie Bai arXiv_AI arXiv_AI Bert Sparse Pose Language_Model PDF
2022-05-22 A Graph Enhanced BERT Model for Event Prediction Li Du, Xiao Ding, Yue Zhang, Kai Xiong, Ting Liu, Bing Qin arXiv_AI arXiv_AI Bert Pose Relation Prediction PDF
2022-05-22 A Domain-adaptive Pre-training Approach for Language Bias Detection in News Jan-David Krieger, Timo Spinde, Terry Ruas, Juhi Kulshrestha, Bela Gipp arXiv_CL arXiv_CL Transformer Bert Pose Face Detection PDF
2022-05-22 Do Deep Learning Models and News Headlines Outperform Conventional Prediction Techniques on Forex Data? Sucharita Atha, Bharath Kumar Bolla arXiv_AI arXiv_AI Embedding Bert RNN Deep_Learning Sentiment Language_Model Prediction PDF
2022-05-21 Life after BERT: What do Other Muppets Understand about Language? Vladislav Lialin, Kevin Zhao, Namrata Shivagunde, Anna Rumshisky arXiv_CL arXiv_CL Transformer Bert Zero-Shot PDF
2022-05-21 Revisiting Pre-trained Language Models and their Evaluation for Arabic Natural Language Understanding Abbas Ghaddar, Yimeng Wu, Sunyam Bagga, Ahmad Rashid, Khalil Bibi, Mehdi Rezagholizadeh, Chao Xing, Yasheng Wang, Duan Xinyu, Zhefeng Wang, Baoxing Huai, Xin Jiang, Qun Liu, Philippe Langlais arXiv_CL arXiv_CL Bert Language_Model PDF
2022-05-21 HLATR: Enhance Multi-stage Text Retrieval with Hybrid List Aware Transformer Reranking Yanzhao Zhang, Dingkun Long, Guangwei Xu, Pengjun Xie arXiv_CL arXiv_CL Transformer Bert Optimization Language_Model PDF
2022-05-21 Pre-training Data Quality and Quantity for a Low-Resource Language: New Corpus and BERT Models for Maltese Kurt Micallef, Albert Gatt, Marc Tanti, Lonneke van der Plas, Claudia Borg arXiv_CL arXiv_CL Recognition Bert Speech Action Classification Sentiment Language_Model PDF
2022-05-21 Deeper vs Wider: A Revisit of Transformer Configuration Fuzhao Xue, Jianghai Chen, Aixin Sun, Xiaozhe Ren, Zangwei Zheng, Xiaoxin He, Xin Jiang, Yang You arXiv_AI arXiv_AI Transformer Bert Pose PDF
2022-05-20 Pre-training Transformer Models with Sentence-Level Objectives for Answer Sentence Selection Luca Di Liello, Siddhant Garg, Luca Soldaini, Alessandro Moschitti arXiv_CL arXiv_CL Transformer Bert Pose QA PDF
2022-05-20 Current Trends and Approaches in Synonyms Extraction: Potential Adaptation to Arabic Eman Naser-Karajah, Nabil Arman, Mustafa Jarrar arXiv_AI arXiv_AI Embedding Bert Survey Action Deep_Learning Attention PDF
2022-05-20 Progressive Class Semantic Matching for Semi-supervised Text Classification Hai-Ming Xu, Lingqiao Liu, Ehsan Abbasnejad arXiv_AI arXiv_AI Bert Text_Classification Pose Classification Language_Model Matching PDF
2022-05-20 Exploring Extreme Parameter Compression for Pre-trained Language Models Yuxin Ren, Benyou Wang, Lifeng Shang, Xin Jiang, Qun Liu arXiv_CL arXiv_CL Transformer Reconstruction Embedding Bert Knowledge Pose Attention Inference Language_Model PDF
2022-05-19 Automated Scoring for Reading Comprehension via In-context BERT Tuning Nigel Fernandez, Aritra Ghosh, Naiming Liu, Zichao Wang, Benoît Choffin, Richard Baraniuk, Andrew Lan arXiv_AI arXiv_AI Bert Language_Model PDF
2022-05-19 Enhancing Slot Tagging with Intent Features for Task Oriented Natural Language Understanding using BERT Shruthi Hariharan, Vignesh Kumar Krishnamurthy, Utkarsh, Jayantha Gowda Sarapanahalli arXiv_AI arXiv_AI Bert Detection Relation PDF
2022-05-19 PLAID: An Efficient Engine for Late Interaction Retrieval Keshav Santhanam, Omar Khattab, Christopher Potts, Matei Zaharia arXiv_CL arXiv_CL Bert Action Language_Model PDF
2022-05-19 ArabGlossBERT: Fine-Tuning BERT on Context-Gloss Pairs for WSD Moustafa Al-Hajj, Mustafa Jarrar arXiv_AI arXiv_AI Transformer Bert Ontology Classification PDF
2022-05-19 Collision Detection Accelerated: An Optimization Perspective Louis Montaut, Quentin Le Lidec, Josef Sivic, Justin Carpentier arXiv_RO arXiv_RO Bert Optimization Pose Detection PDF
2022-05-19 Named Entity Recognition, Multi-Task Learning, Nested Entities, BERT, Arabic NER Corpus Mustafa Jarrar, Mohammed Khalilia, Sana Ghanem arXiv_AI arXiv_AI Recognition Bert GAN PDF
2022-05-19 Acceptability Judgements via Examining the Topology of Attention Maps Daniil Cherniavskii, Eduard Tulchinskii, Vladislav Mikhailov, Irina Proskurina, Laida Kushnareva, Ekaterina Artemova, Serguei Barannikov, Irina Piontkovskaya, Dmitri Piontkovski, Evgeny Burnaev arXiv_CL arXiv_CL Transformer Bert Knowledge Attention PDF
2022-05-19 Psychiatric Scale Guided Risky Post Screening for Early Detection of Depression Zhiling Zhang, Siyuan Chen, Mengyue Wu, Kenny Q. Zhu arXiv_CL arXiv_CL Bert Pose Face Detection Attention Inference Prediction PDF
2022-05-19 A Weakly-Supervised Iterative Graph-Based Approach to Retrieve COVID-19 Misinformation Topics Harry Wang, Sharath Chandra Guntuku arXiv_CL arXiv_CL Embedding Bert Pose Action Quantitative PDF
2022-05-18 Debiasing Neural Retrieval via In-batch Balancing Regularization Yuantong Li, Xiaokai Wei, Zijian Wang, Shen Wang, Parminder Bhatia, Xiaofei Ma, Andrew Arnold arXiv_AI arXiv_AI Bert Regularization Pose PDF
2022-05-18 LeRaC: Learning Rate Curriculum Florinel-Alin Croitoru, Nicolae-Catalin Ristea, Radu Tudor Ionescu, Nicu Sebe arXiv_CV arXiv_CV Transformer Bert RNN Pose CNN PDF
2022-05-18 ERNIE-Search: Bridging Cross-Encoder with Dual-Encoder via Self On-the-fly Distillation for Dense Passage Retrieval Yuxiang Lu, Yiding Liu, Jiaxiang Liu, Yunsheng Shi, Zhengjie Huang, Shikun Feng Yu Sun, Hao Tian, Hua Wu, Shuaiqiang Wang, Dawei Yin, Haifeng Wang arXiv_CL arXiv_CL Bert Knowledge Pose Action Language_Model QA PDF
2022-05-18 Masked Autoencoders As Spatiotemporal Learners Christoph Feichtenhofer, Haoqi Fan, Yanghao Li, Kaiming He arXiv_CV arXiv_CV Transformer Embedding Bert Represenation_Learning Knowledge PDF
2022-05-17 Feature Aggregation in Zero-Shot Cross-Lingual Transfer Using Multilingual BERT Beiduo Chen, Wu Guo, Quan Liu, Kun Tao arXiv_CL arXiv_CL Transformer Recognition Bert Zero-Shot Pose Attention Language_Model PDF
2022-05-17 SAMU-XLSR: Semantically-Aligned Multimodal Utterance-level Cross-Lingual Speech Representation Sameer Khurana, Antoine Laurent, James Glass arXiv_CL arXiv_CL Embedding Bert Represenation_Learning Speech Pose PDF
2022-05-17 SEMI-FND: Stacked Ensemble Based Multimodal Inference For Faster Fake News Detection Prabhav Singh, Ridam Srivastava, K.P.S. Rana, Vineet Kumar arXiv_AI arXiv_AI NAS Bert Detection Inference PDF
2022-05-16 Harnessing Multilingual Resources to Question Answering in Arabic Khalid Alnajjar, Mika Hämäläinen arXiv_CL arXiv_CL Bert PDF
2022-05-15 Transkimmer: Transformer Learns to Layer-wise Skim Yue Guan, Zhengyi Li, Jingwen Leng, Zhouhan Lin, Minyi Guo arXiv_CL arXiv_CL Transformer Bert Optimization Pose PDF
2022-05-15 TiBERT: Tibetan Pre-trained Language Model Yuan Sun, Sisi Liu, Junjie Deng, Xiaobing Zhao arXiv_AI arXiv_AI Bert Text_Classification Classification Language_Model PDF
2022-05-15 Topic Modelling on Consumer Financial Protection Bureau Data: An Approach Using BERT Based Embeddings Vasudeva Raju Sangaraju, Bharath Kumar Bolla, Deepak Kumar Nayak, Jyothsna Kh arXiv_AI arXiv_AI Embedding Bert Review Relation Sentiment PDF
2022-05-15 Discovering Latent Concepts Learned in BERT Fahim Dalvi, Abdul Rafae Khan, Firoj Alam, Nadir Durrani, Jia Xu, Hassan Sajjad arXiv_CL arXiv_CL Unsupervised Bert Knowledge Relation PDF
2022-05-15 Learning Lip-Based Audio-Visual Speaker Embeddings with AV-HuBERT Bowen Shi, Abdelrahman Mohamed, Wei-Ning Hsu arXiv_CV arXiv_CV Embedding Bert Represenation_Learning Speech Self-Supervised Pose PDF
2022-05-14 Naturalistic Causal Probing for Morpho-Syntax Afra Amini, Tiago Pimentel, Clara Meister, Ryan Cotterell arXiv_CL arXiv_CL Bert Prediction PDF
2022-05-13 Bootstrapping Text Anonymization Models with Distant Supervision Anthi Papadopoulou, Pierre Lison, Lilja Øvrelid, Ildikó Pilán arXiv_CL arXiv_CL Bert Knowledge Knowledge_Graph Pose Language_Model PDF
2022-05-13 PathologyBERT -- Pre-trained Vs. A New Transformer Language Model for Pathology Domain Thiago Santos, Amara Tariq, Susmita Das, Kavyasree Vayalpati, Geoffrey H. Smith, Hari Trivedi, Imon Banerjee arXiv_CL arXiv_CL Transformer Surveillance Bert Pose Face Classification Language_Model PDF
2022-05-13 A Study of the Attention Abnormality in Trojaned BERTs Weimin Lyu, Songzhu Zheng, Tengfei Ma, Chao Chen arXiv_AI arXiv_AI Transformer Bert Knowledge Pose Quantitative Detection Object_Detection Attention PDF
2022-05-13 Analyzing Hate Speech Data along Racial, Gender and Intersectional Axes Antonis Maronikolakis, Philip Baader, Hinrich Schütze arXiv_AI arXiv_AI Bert Speech PDF
2022-05-13 Improving Contextual Representation with Gloss Regularized Pre-training Yu Lin, Zhecheng An, Peihao Wu, Zejun Ma arXiv_AI arXiv_AI Embedding Unsupervised Bert Pose Inference Language_Model PDF
2022-05-12 Beyond Static Models and Test Sets: Benchmarking the Potential of Pre-trained Models Across Tasks and Languages Kabir Ahuja, Sandipan Dandapat, Sunayana Sitaram, Monojit Choudhury arXiv_CL arXiv_CL Bert Pose Language_Model Prediction PDF
2022-05-12 ScAN: Suicide Attempt and Ideation Events Dataset Bhanu Pratap Singh Rawat, Samuel Kovaly, Wilfred R. Pigeon, Hong Yu arXiv_AI arXiv_AI Surveillance Bert Classification Detection Medical Prediction PDF
2022-05-12 Is the Computation of Abstract Sameness Relations Human-Like in Neural Language Models? Lukas Thoma, Benjamin Roth arXiv_CL arXiv_CL Bert Face Relation Language_Model PDF
2022-05-12 FPSRS: A Fusion Approach for Paper Submission Recommendation System Son T. Huynh, Nhi Dang, Dac H. Nguyen, Phong T. Huynh, Binh T. Nguyen arXiv_CV arXiv_CV Bert RNN Pose Action Recommendation PDF
2022-05-12 AppTek's Submission to the IWSLT 2022 Isometric Spoken Language Translation Task Patrick Wilken, Evgeny Matusov arXiv_CL arXiv_CL Transformer Bert PDF
2022-05-11 Dimension-adaptive machine-learning-based quantum state reconstruction Sanjaya Lohani, Sangita Regmi, Joseph M. Lukens, Ryan T. Glasser, Thomas A. Searles, Brian T. Kirby arXiv_AI arXiv_AI Reconstruction Bert Matching PDF
2022-05-11 Ontology-Based and Weakly Supervised Rare Disease Phenotyping from Clinical Notes Hang Dong, Víctor Suárez-Paniagua, Huayu Zhang, Minhong Wang, Arlene Casey, Emma Davidson, Jiaoyan Chen, Beatrice Alex, William Whiteley, Honghan Wu arXiv_CL arXiv_CL Transformer Recognition Bert Weakly_Supervised Pose Ontology Face Medical Matching PDF
2022-05-11 Aggregating Pairwise Semantic Differences for Few-Shot Claim Veracity Classification Xia Zeng, Arkaitz Zubiaga arXiv_AI arXiv_AI Bert Classification Few-Shot Language_Model PDF
2022-05-11 Query-Based Keyphrase Extraction from Long Documents Martin Docekal, Pavel Smrz arXiv_CL arXiv_CL Transformer Bert Action PDF
2022-05-11 Towards Unified Prompt Tuning for Few-shot Text Classification Jianing Wang, Chengyu Wang, Fuli Luo, Chuanqi Tan, Minghui Qiu, Fei Yang, Qiuhui Shi, Songfang Huang, Ming Gao arXiv_AI arXiv_AI Bert Text_Classification Knowledge Self-Supervised Pose Classification Few-Shot Language_Model PDF
2022-05-10 Problems with Cosine as a Measure of Embedding Similarity for High Frequency Words Kaitlyn Zhou, Kawin Ethayarajh, Dallas Card, Dan Jurafsky arXiv_AI arXiv_AI Embedding Bert QA PDF
2022-05-10 Fundamental limitations on optimization in variational quantum algorithms Hao-Kai Zhang, Chengkai Zhu, Geng Liu, Xin Wang arXiv_CV arXiv_CV Bert Optimization VQA QA PDF
2022-05-09 Behind the Mask: Demographic bias in name detection for PII masking Courtney Mansfield, Amandalynne Paullada, Kristen Howell arXiv_CL arXiv_CL Bert Pose Action Detection PDF
2022-05-09 Long Document Re-ranking with Modular Re-ranker Luyu Gao, Jamie Callan arXiv_CL arXiv_CL Transformer Bert Pose Action Attention Language_Model PDF
2022-05-09 A Dataset and BERT-based Models for Targeted Sentiment Analysis on Turkish Texts M. Melih Mutlu, Arzucan Özgür arXiv_CL arXiv_CL Bert Pose Sentiment Attention PDF
2022-05-09 A Balanced Data Approach for Evaluating Cross-Lingual Transfer: Mapping the Linguistic Blood Bank Dan Malkin, Tomasz Limisiewicz, Gabriel Stanovsky arXiv_AI arXiv_AI Bert Zero-Shot Relation Language_Model PDF
2022-05-09 Automated Evaluation for Student Argumentative Writing: A Survey Xinyu Wang, Yohan Lee, Juneyoung Park arXiv_CL arXiv_CL Bert Survey GAN PDF
2022-05-09 Improving negation detection with negation-focused pre-training Thinh Hung Truong, Timothy Baldwin, Trevor Cohn, Karin Verspoor arXiv_CL arXiv_CL Bert Pose Detection Language_Model PDF
2022-05-08 On the Use of BERT for Automated Essay Scoring: Joint Learning of Multi-Scale Essay Representation Yongjie Wang, Chuan Wang, Ruobing Li, Hui Lin arXiv_AI arXiv_AI Transfer_Learning Bert RNN Pose Deep_Learning PDF
2022-05-08 Silence is Sweeter Than Speech: Self-Supervised Model Using Silence to Store Speaker Information Chi-Luen Feng, Po-chun Hsu, Hung-yi Lee arXiv_SD arXiv_SD Bert Speech Self-Supervised PDF
2022-05-07 AKI-BERT: a Pre-trained Clinical Language Model for Early Prediction of Acute Kidney Injury Chengsheng Mao, Liang Yao, Yuan Luo arXiv_CL arXiv_CL Transformer Bert Action Medical Language_Model Prediction PDF
2022-05-07 Number Entity Recognition Dhanasekar Sundararaman, Vivek Subramanian, Guoyin Wang, Liyan Xu, Lawrence Carin arXiv_CL arXiv_CL Embedding Recognition Bert Pose Classification PDF
2022-05-06 A Data Cartography based MixUp for Pre-trained Language Models Seo Yeon Park, Cornelia Caragea arXiv_CL arXiv_CL Bert Pose Language_Model PDF
2022-05-06 BDIS: Bayesian Dense Inverse Searching Method for Real-Time Stereo Surgical Image Matching Jingwei Song, Qiuchen Zhu, Jianyu Lin, Maani Ghaffari arXiv_CV arXiv_CV 3D Bert Pose Face Prediction Matching PDF
2022-05-05 RaFoLa: A Rationale-Annotated Corpus for Detecting Indicators of Forced Labour Erick Mendez Guzman, Viktor Schlegel, Riza Batista-Navarro arXiv_CL arXiv_CL Transformer Bert Text_Classification Knowledge Pose Action Classification Detection Attention GAN PDF
2022-05-05 Exploiting Global and Local Hierarchies for Hierarchical Text Classification Ting Jiang, Deqing Wang, Leilei Sun, Zhongzhi Chen, Fuzhen Zhuang, Qinghong Yang arXiv_CL arXiv_CL Bert Text_Classification Knowledge Pose Classification PDF
2022-05-05 View-labels Are Indispensable: A Multifacet Complementarity Study of Multi-view Clustering Chuanxing Geng, Aiyang Han, Songcan Chen arXiv_CV arXiv_CV Embedding Bert Knowledge Contrastive_Learning Face Attention PDF
2022-05-05 Understanding Transfer Learning for Chest Radiograph Clinical Report Generation with Modified Transformer Architectures Edward Vendrow, Ethan Schonfeld arXiv_AI arXiv_AI Image_Caption Transformer Embedding Transfer_Learning Bert Pose Medical Caption PDF
2022-05-04 Using virtual edges to extract keywords from texts modeled as complex networks Jorge A. V. Tohalino, Thiago C. Silva, Diego R. Amancio arXiv_CL arXiv_CL Embedding Bert Action Language_Model PDF
2022-05-04 Hyperbolic Relevance Matching for Neural Keyphrase Extraction Mingyang Song, Yi Feng, Liping Jing arXiv_CL arXiv_CL Embedding Bert Action Matching PDF
2022-05-04 Unsupervised Domain Adaptation Learning for Hierarchical Infant Pose Recognition with Synthetic Data Cheng-Yen Yang, Zhongyu Jiang, Shih-Yu Gu, Jenq-Neng Hwang, Jang-Hee Yoo arXiv_CV arXiv_CV Unsupervised Recognition 3D Bert Optimization Pose Inference PDF
2022-05-03 Explain and Conquer: Personalised Text-based Reviews to Achieve Transparency Iñigo López-Riobóo Botana (1), Verónica Bolón-Canedo (1), Bertha Guijarro-Berdiñas (1), Amparo Alonso-Betanzos (1) ((1) University of A Coruña - Research Center on Information and Communication Technologies (CITIC)) arXiv_AI arXiv_AI Transformer Bert Review Pose Action Relation Language_Model Recommendation PDF
2022-05-03 Efficient Fine-Tuning of BERT Models on the Edge Danilo Vucetic, Mohammadreza Tayaranian, Maryam Ziaeefard, James J. Clark, Brett H. Meyer, Warren J. Gross arXiv_CL arXiv_CL Bert Pose Inference PDF
2022-05-03 Kompetencer: Fine-grained Skill Classification in Danish Job Postings via Distant Supervision and Transfer Learning Mike Zhang, Kristian Nørgaard Jensen, Barbara Plank arXiv_CL arXiv_CL Transfer_Learning Bert Zero-Shot Classification Few-Shot PDF
2022-05-03 Finding patterns in Knowledge Attribution for Transformers Jeevesh Juneja, Ritu Agarwal arXiv_CL arXiv_CL Transformer Bert Knowledge Relation PDF
2022-05-03 Predicting Issue Types with seBERT Alexander Trautsch, Steffen Herbold arXiv_CL arXiv_CL Transformer Bert Language_Model Prediction PDF
2022-05-03 SemAttack: Natural Textual Attacks via Different Semantic Spaces Boxin Wang, Chejian Xu, Xiangyu Liu, Yu Cheng, Bo Li arXiv_CL arXiv_CL Embedding Bert Knowledge Adversarial Pose Language_Model PDF
2022-05-02 Multi-Task Text Classification using Graph Convolutional Networks for Large-Scale Low Resource Language Mounika Marreddy, Subba Reddy Oota, Lakshmi Sireesha Vakada, Venkata Charan Chinni, Radhika Mamidi arXiv_AI arXiv_AI Transformer Reconstruction Embedding Bert Text_Classification Speech Pose Emotion Quantitative Classification Detection Sentiment CNN PDF
2022-05-02 Entity-aware Transformers for Entity Search Emma J. Gerritse, Faegheh Hasibi, Arjen P. de Vries arXiv_CL arXiv_CL Transformer Embedding Bert Knowledge Knowledge_Graph Relation Language_Model PDF
2022-05-02 Teaching BERT to Wait: Balancing Accuracy and Latency for Streaming Disfluency Detection Angelica Chen, Vicky Zayats, Daniel D. Walker, Dirk Padfield arXiv_CL arXiv_CL Transformer Bert Speech Pose Detection Prediction PDF
2022-05-01 Detecting COVID-19 Conspiracy Theories with Transformers and TF-IDF Haoming Guo, Tianyi Huang, Huixuan Huang, Mingyue Fan, Gerald Friedland arXiv_CL arXiv_CL Transformer Bert Detection PDF
2022-04-30 LayoutBERT: Masked Language Layout Model for Object Insertion Kerem Turgutlu, Sanat Sharma, Jayant Kumar arXiv_AI arXiv_AI Bert Knowledge Self-Supervised Pose Quantitative Attention Language_Model PDF
2022-04-30 HateCheckHIn: Evaluating Hindi Hate Speech Detection Models Mithun Das, Punyajoy Saha, Binny Mathew, Animesh Mukherjee arXiv_CL arXiv_CL Transformer Bert Speech Pose Detection PDF
2022-04-29 ExaASC: A General Target-Based Stance Detection Corpus in Arabic Language Mohammad Mehdi Jaziriyan, Ahmad Akbari, Hamed Karbasi arXiv_CL arXiv_CL Bert Pose Detection PDF
2022-04-29 QRelScore: Better Evaluating Generated Questions with Deeper Understanding of Context-aware Relevance Xiaoqiang Wang, Bang Liu, Siliang Tang, Lingfei Wu arXiv_CL arXiv_CL Bert Adversarial Pose Relation Language_Model Matching PDF
2022-04-29 Czech Dataset for Cross-lingual Subjectivity Classification Pavel Přibáň, Josef Steinberger arXiv_CL arXiv_CL Bert Zero-Shot Knowledge Review Pose Classification PDF
2022-04-28 Machine Learning for Violence Risk Assessment Using Dutch Clinical Notes Pablo Mosteiro, Emil Rijcken, Kalliopi Zervanou, Uzay Kaymak, Floortje Scheepers, Marco Spruit arXiv_CL arXiv_CL Bert PDF
2022-04-28 UM6P-CS at SemEval-2022 Task 11: Enhancing Multilingual and Code-Mixed Complex Named Entity Recognition via Pseudo Labels using Multilingual Transformer Abdellah El Mekki, Abdelkader El Mahdaouy, Mohammed Akallouch, Ismail Berrada, Ahmed Khoumsi arXiv_CL arXiv_CL Transformer Recognition Bert Pose Classification PDF
2022-04-28 RobBERTje: a Distilled Dutch BERT Model Pieter Delobelle, Thomas Winters, Bettina Berendt arXiv_CL arXiv_CL Bert Attention Language_Model PDF
2022-04-27 TimeBERT: Enhancing Pre-Trained Language Representations with Temporal Information Jiexin Wang, Adam Jatowt, Masatoshi Yoshikawa arXiv_CL arXiv_CL Bert PDF
2022-04-27 RigoBERTa: A State-of-the-Art Language Model For Spanish Alejandro Vaca Serrano, Guillem Garcia Subies, Helena Montoro Zamorano, Nuria Aldama Garcia, Doaa Samy, David Betancur Sanchez, Antonio Moreno Sandoval, Marta Guerrero Nieto, Alvaro Barbero Jimenez arXiv_CL arXiv_CL Bert Language_Model PDF
2022-04-27 SkillSpan: Hard and Soft Skill Extraction from English Job Postings Mike Zhang, Kristian Nørgaard Jensen, Sif Dam Sonniks, Barbara Plank arXiv_CL arXiv_CL Bert Action GAN Language_Model PDF
2022-04-27 Modern Baselines for SPARQL Semantic Parsing Debayan Banerjee, Pranav Ajit Nair, Jivat Neet Kaur, Ricardo Usbeck, Chris Biemann arXiv_CL arXiv_CL Embedding Bert Knowledge Knowledge_Graph Relation Language_Model PDF
2022-04-27 Multimodal Transformer-based Model for Buchwald-Hartwig and Suzuki-Miyaura Reaction Yield Prediction Shimaa Baraka, Ahmed M. El Kerdawy arXiv_AI arXiv_AI Transformer Bert Action Prediction PDF
2022-04-27 UBERT: A Novel Language Model for Synonymy Prediction at Scale in the UMLS Metathesaurus Thilini Wijesiriwardene, Vinh Nguyen, Goonmeet Bajaj, Hong Yung Yip, Vishesh Javangula, Yuqing Mao, Kin Wah Fung, Srinivasan Parthasarathy, Amit P. Sheth, Olivier Bodenreider arXiv_AI arXiv_AI Bert Deep_Learning Medical Language_Model Prediction PDF
2022-04-27 Better Query Graph Selection for Knowledge Base Question Answering Yonghui Jia, Wenliang Chen arXiv_CL arXiv_CL Bert Knowledge Pose Action QA PDF
2022-04-26 MILES: Visual BERT Pre-training with Injected Language Semantics for Video-text Retrieval Yuying Ge, Yixiao Ge, Xihui Liu, Alex Jinpeng Wang, Jianping Wu, Ying Shan, Xiaohu Qie, Ping Luo arXiv_CV arXiv_CV Reconstruction Recognition Bert Zero-Shot Action_Recognition Action Prediction Video_Retrieval PDF
2022-04-26 Science Checker: Extractive-Boolean Question Answering For Scientific Fact Checking Loïc Rakotoson, Charles Letaillieur, Sylvain Massip, Fréjus Laleye arXiv_AI arXiv_AI Bert Knowledge Pose Classification Summarization Medical QA PDF
2022-04-26 Approach to Predicting News -- A Precise Multi-LSTM Network With BERT Chia-Lin Chen (1), Pei-Yu Huang (2), Yi-Ting Huang (3), Chun Lin (3) ((1) Computer Science and Engineering, National Sun Yat-sen University, Kaohsiung, Taiwan, (2) Management and Digital Innovation, University of London, Singapore, (3) Institute of Information Science, Academia Sinica, Taipei, Taiwan) arXiv_CL arXiv_CL Transformer Embedding OCR Bert RNN PDF
2022-04-26 Pretraining Chinese BERT for Detecting Word Insertion and Deletion Errors Cong Zhou, Yong Dai, Duyu Tang, Enbo Zhao, Zhangyin Feng, Li Kuang, Shuming Shi arXiv_CL arXiv_CL Bert Inference Language_Model Prediction PDF
2022-04-25 ED2LM: Encoder-Decoder to Language Model for Faster Document Re-ranking Inference Kai Hui, Honglei Zhuang, Tao Chen, Zhen Qin, Jing Lu, Dara Bahri, Ji Ma, Jai Prakash Gupta, Cicero Nogueira dos Santos, Yi Tay, Don Metzler arXiv_CL arXiv_CL Embedding Bert Pose Attention Inference Language_Model PDF
2022-04-24 Twitter-Based Gender Recognition Using Transformers Zahra Movahedi Nia, Ali Ahmadi, Bruce Mellado, Jianhong Wu, James Orbinski, Ali Agary, Jude Dzevela Kong arXiv_AI arXiv_AI Transformer Recognition Bert Text_Classification Pose Emotion Classification Sentiment PDF
2022-04-24 Learning to Win Lottery Tickets in BERT Transfer via Task-agnostic Mask Training Yuanxin Liu, Fandong Meng, Zheng Lin, Peng Fu, Yanan Cao, Weiping Wang, Jie Zhou arXiv_CL arXiv_CL Transfer_Learning Bert Pose Language_Model Matching PDF
2022-04-22 Exploiting Session Information in BERT-based Session-aware Sequential Recommendation Jinseok Seol, Youngrok Ko, Sang-goo Lee arXiv_AI arXiv_AI Embedding Bert Pose Action Attention Recommendation PDF
2022-04-22 Zero and Few-shot Learning for Author Profiling Mara Chinea-Rios, Thomas Müller, Gretel Liz De la Peña Sarracén, Francisco Rangel, Marc Franco-Salvador arXiv_CL arXiv_CL Bert Few-Shot PDF
2022-04-22 Taygete at SemEval-2022 Task 4: RoBERTa based models for detecting Patronising and Condescending Language Jayant Chhillar arXiv_CL arXiv_CL Bert RNN Language_Model PDF
2022-04-22 WaBERT: A Low-resource End-to-end Model for Spoken Language Understanding and Speech-to-BERT Alignment Lin Yao, Jianfei Song, Ruizhuo Xu, Yingfang Yang, Zijian Chen, Yafeng Deng arXiv_CL arXiv_CL Recognition Bert Knowledge Speech Pose Emotion Sentiment Speech_Recognition Language_Model PDF
2022-04-21 Improving the Generalizability of Depression Detection by Leveraging Clinical Questionnaires Thong Nguyen, Andrew Yates, Ayah Zirikly, Bart Desmet, Arman Cohan arXiv_CL arXiv_CL Bert Pose Face Detection Prediction PDF
2022-04-21 Decorate the Examples: A Simple Method of Prompt Design for Biomedical Relation Extraction Hui-Syuan Yeh, Thomas Lavergne, Pierre Zweigenbaum arXiv_CL arXiv_CL Bert Action Relation Few-Shot Relation_Extraction Medical Prediction PDF
2022-04-21 Benchmarking Answer Verification Methods for Question Answering-Based Summarization Evaluation Metrics Daniel Deutsch, Dan Roth arXiv_CL arXiv_CL Bert Summarization Prediction QA PDF
2022-04-21 Is Neural Topic Modelling Better than Clustering? An Empirical Study on Clustering with Contextual Embeddings for Topics Zihan Zhang, Meng Fang, Ling Chen, Mohammad-Reza Namazi-Rad arXiv_CL arXiv_CL Embedding Bert PDF
2022-04-20 yosm: A new yoruba sentiment corpus for movie reviews Iyanuoluwa Shode, David Ifeoluwa Adelani, Anna Feldman arXiv_CL arXiv_CL Bert Sentiment_Classification Review Classification Sentiment Attention Language_Model PDF
2022-04-20 Is BERT Robust to Label Noise? A Study on Learning with Noisy Labels in Text Classification Dawei Zhu, Michael A. Hedderich, Fangzhou Zhai, David Ifeoluwa Adelani, Dietrich Klakow arXiv_CL arXiv_CL Bert Text_Classification Classification PDF
2022-04-20 Towards Arabic Sentence Simplification via Classification and Generative Approaches Nouran Khallaf, Serge Sharoff arXiv_CL arXiv_CL Transformer Embedding Bert Classification PDF
2022-04-20 Improving Self-Supervised Speech Representations by Disentangling Speakers Kaizhi Qian, Yang Zhang, Heting Gao, Junrui Ni, Cheng-I Lai, David Cox, Mark Hasegawa-Johnson, Shiyu Chang arXiv_AI arXiv_AI Bert Speech Self-Supervised Pose PDF
2022-04-19 ALBETO and DistilBETO: Lightweight Spanish Language Models José Cañete, Sebastián Donoso, Felipe Bravo-Marquez, Andrés Carvallo, Vladimir Araujo arXiv_CL arXiv_CL Bert Inference Language_Model QA PDF
2022-04-19 Optimize_Prime@DravidianLangTech-ACL2022: Abusive Comment Detection in Tamil Shantanu Patankar, Omkar Gokhale, Onkar Litake, Aditya Mandke, Dipali Kadam arXiv_CL arXiv_CL Transformer Bert RNN Detection PDF
2022-04-19 Optimize_Prime@DravidianLangTech-ACL2022: Emotion Analysis in Tamil Omkar Gokhale, Shantanu Patankar, Onkar Litake, Aditya Mandke, Dipali Kadam arXiv_CL arXiv_CL Transformer Bert RNN Emotion PDF
2022-04-19 Unsupervised Numerical Reasoning to Extract Phenotypes from Clinical Text by Leveraging External Knowledge Ashwani Tanwar, Jingqing Zhang, Julia Ive, Vibhor Gupta, Yike Guo arXiv_CL arXiv_CL Embedding Unsupervised Bert Knowledge PDF
2022-04-19 Impact of Tokenization on Language Models: An Analysis for Turkish Cagri Toraman, Eyup Halit Yilmaz, Furkan Şahinuç, Oguzhan Ozcelik arXiv_CL arXiv_CL Bert Face Language_Model PDF
2022-04-19 Probing for the Usage of Grammatical Number Karim Lasri, Tiago Pimentel, Alessandro Lenci, Thierry Poibeau, Ryan Cotterell arXiv_CL arXiv_CL Bert Prediction PDF
2022-04-19 Multimodal Hate Speech Detection from Bengali Memes and Texts Md. Rezaul Karim, Sumon Kanti Dey, Tanhim Islam, Bharathi Raja Chakravarthi arXiv_CL arXiv_CL Transformer Embedding Bert RNN Speech Pose Face Deep_Learning Detection PDF
2022-04-19 DecBERT: Enhancing the Language Understanding of BERT with Causal Attention Masks Ziyang Luo, Yadong Xi, Jing Ma, Zhiwei Yang, Xiaoxi Mao, Changjie Fan, Rongsheng Zhang arXiv_CL arXiv_CL Transformer Embedding Bert Pose Attention Language_Model PDF
2022-04-19 Mono vs Multilingual BERT for Hate Speech Detection and Text Classification: A Case Study in Marathi Abhishek Velankar, Hrushikesh Patil, Raviraj Joshi arXiv_CL arXiv_CL Transformer Embedding Bert Sentiment_Classification Text_Classification Speech Classification Detection Sentiment PDF
2022-04-19 On The Cross-Modal Transfer from Natural Language to Code through Adapter Modules Divyam Goel, Ramansh Grover, Fatemeh H. Fard arXiv_CL arXiv_CL Bert Knowledge Pose Detection Inference Language_Model PDF
2022-04-19 LitMC-BERT: transformer-based multi-label classification of biomedical literature with an application on COVID-19 literature curation Qingyu Chen, Jingcheng Du, Alexis Allot, Zhiyong Lu arXiv_AI arXiv_AI Transformer Bert Pose Classification Relation Medical Inference PDF
2022-04-18 Neural Space-filling Curves Hanyu Wang, Kamal Gupta, Larry Davis, Abhinav Shrivastava arXiv_CV arXiv_CV Bert Image_Compression PDF
2022-04-18 L3Cube-HingCorpus and HingBERT: A Code Mixed Hindi-English Dataset and BERT Language Models Ravindra Nayak, Raviraj Joshi arXiv_CL arXiv_CL Transformer Bert Sentiment Language_Model PDF
2022-04-18 Visio-Linguistic Brain Encoding Subba Reddy Oota, Jashn Arora, Vijay Rowtula, Manish Gupta, Raju S. Bapi arXiv_AI arXiv_AI Transformer Bert Knowledge Pose Face Activity Language_Model PDF
2022-04-18 UTNLP at SemEval-2022 Task 6: A Comparative Analysis of Sarcasm Detection using generative-based and mutation-based data augmentation Amirhossein Abaskohi, Arash Rasouli, Tanin Zeraati, Behnam Bahrak arXiv_CL arXiv_CL Transformer Bert Detection Sentiment Attention PDF
2022-04-18 Ingredient Extraction from Text in the Recipe Domain Arkin Dharawat, Chris Doan arXiv_CL arXiv_CL Bert Action PDF
2022-04-17 Pathologies of Pre-trained Language Models in Few-shot Fine-tuning Hanjie Chen, Guoqing Zheng, Ahmed Hassan Awadallah, Yangfeng Ji arXiv_CL arXiv_CL Bert Text_Classification Pose Classification Few-Shot Language_Model Prediction PDF
2022-04-17 On Effectively Learning of Knowledge in Continual Pre-training Cunxiang Wang, Fuli Luo, Yanyang Li, Runxin Xu, Fei Huang, Yue Zhang arXiv_AI arXiv_AI Bert Knowledge Self-Supervised Pose Attention Language_Model Prediction PDF
2022-04-16 nigam@COLIEE-22: Legal Case Retrieval and Entailment using Cascading of Lexical and Semantic-based models Shubham Kumar Nigam, Navansh Goel arXiv_CL arXiv_CL Bert Action Matching PDF
2022-04-16 WordAlchemy: A transformer-based Reverse Dictionary Dr. Sunil B. Mane, Harshal Patil, Kanhaiya Madaswar, Pranav Sadavarte arXiv_CL arXiv_CL Transformer Bert Pose Face Deep_Learning Language_Model PDF
2022-04-16 SimpleBERT: A Pre-trained Model That Learns to Generate Simple Words Renliang Sun, Xiaojun Wan arXiv_CL arXiv_CL Bert Pose Language_Model PDF
2022-04-16 Probing Script Knowledge from Pre-Trained Models Zijian Jin, Xingyu Zhang, Mo Yu, Lifu Huang arXiv_CL arXiv_CL Bert Knowledge Language_Model Prediction PDF
2022-04-15 DialAug: Mixing up Dialogue Contexts in Contrastive Learning for Robust Conversational Modeling Lahari Poddar, Peiyao Wang, Julia Reinspach arXiv_CL arXiv_CL Bert Pose Contrastive_Learning Inference PDF
2022-04-15 MoEBERT: from BERT to Mixture-of-Experts via Importance-Guided Adaptation Simiao Zuo, Qingru Zhang, Chen Liang, Pengcheng He, Tuo Zhao, Weizhu Chen arXiv_CL arXiv_CL Bert Knowledge Pose Inference Language_Model PDF
2022-04-15 Semantic Structure based Query Graph Prediction for Question Answering over Knowledge Graph Mingchen Li, Jonathan Shihao Ji arXiv_CL arXiv_CL Bert Knowledge Knowledge_Graph Prediction QA PDF
2022-04-15 Evaluation Benchmarks for Spanish Sentence Representations Vladimir Araujo, Andrés Carvallo, Souvik Kundu, José Cañete, Marcelo Mendoza, Robert E. Mercer, Felipe Bravo-Marquez, Marie-Francine Moens, Alvaro Soto arXiv_CL arXiv_CL Bert Language_Model PDF
2022-04-15 Improving Pre-trained Language Models with Syntactic Dependency Prediction Task for Chinese Semantic Error Recognition Bo Sun, Baoxin Wang, Wanxiang Che, Dayong Wu, Zhigang Chen, Ting Liu arXiv_CL arXiv_CL Recognition Bert Knowledge Classification Detection Relation Language_Model Prediction PDF
2022-04-15 XDBERT: Distilling Visual Information to BERT from Cross-Modal Systems to Improve Language Understanding Chan-Jan Hsu, Hung-yi Lee, Yu Tsao arXiv_CL arXiv_CL Transformer Bert Adversarial Pose PDF
2022-04-15 Improving Cross-Modal Understanding in Visual Dialog via Contrastive Learning Feilong Chen, Xiuyi Chen, Shuang Xu, Bo Xu arXiv_CV arXiv_CV Bert Pose Contrastive_Learning VQA PDF
2022-04-14 Brazilian Court Documents Clustered by Similarity Together Using Natural Language Processing Approaches with Transformers Raphael Souza de Oliveira, Erick Giovani Sperandio Nascimento arXiv_CL arXiv_CL Transformer Unsupervised Bert Inference PDF
2022-04-14 DeiT III: Revenge of the ViT Hugo Touvron, Matthieu Cord, Hervé Jégou arXiv_CV arXiv_CV Transformer Segmentation Transfer_Learning Semantic_Segmentation Bert Self-Supervised Classification Image_Classification PDF
2022-04-14 Composite Code Sparse Autoencoders for first stage retrieval Carlos Lassance, Thibault Formal, Stephane Clinchant arXiv_AI arXiv_AI Quantization Bert Sparse Image_Retrieval Pose PDF
2022-04-14 XLMRQA: Open-Domain Question Answering on Vietnamese Wikipedia-based Textual Knowledge Source Kiet Van Nguyen, Phong Nguyen-Thuan Do, Nhat Duy Nguyen, Tin Van Huynh, Anh Gia-Tuan Nguyen, Ngan Luu-Thuy Nguyen arXiv_CL arXiv_CL Transformer Bert Knowledge Action Attention QA PDF
2022-04-14 Does BERT really agree ? Fine-grained Analysis of Lexical Dependence on a Syntactic Task Karim Lasri, Alessandro Lenci, Thierry Poibeau arXiv_CL arXiv_CL Transformer Bert Language_Model PDF
2022-04-14 Multi-label topic classification for COVID-19 literature with Bioformer Li Fang, Kai Wang arXiv_CL arXiv_CL OCR Bert Classification PDF
2022-04-13 CAMERO: Consistency Regularized Ensemble of Perturbed Language Models with Weight Sharing Chen Liang, Pengcheng He, Yelong Shen, Weizhu Chen, Tuo Zhao arXiv_CL arXiv_CL Bert Pose Inference Language_Model Prediction PDF
2022-04-13 Multilingual Language Model Adaptive Fine-Tuning: A Study on African Languages Jesujoba O. Alabi, David Ifeoluwa Adelani, Marius Mosbach, Dietrich Klakow arXiv_CL arXiv_CL Embedding Transfer_Learning Bert Sentiment_Classification Zero-Shot Classification Sentiment Language_Model PDF
2022-04-13 The Impact of Cross-Lingual Adjustment of Contextual Word Representations on Zero-Shot Transfer Pavel Efimov, Leonid Boytsov, Elena Arslanova, Pavel Braslavski arXiv_CL arXiv_CL Embedding Bert Zero-Shot Language_Model QA PDF
2022-04-13 HuBERT-EE: Early Exiting HuBERT for Efficient Speech Recognition Ji Won Yoon, Beom Jun Woo, Nam Soo Kim arXiv_CL arXiv_CL Recognition Bert Speech Self-Supervised Pose Speech_Recognition Inference Prediction PDF
2022-04-13 TangoBERT: Reducing Inference Cost by using Cascaded Architecture Jonathan Mamou, Oren Pereg, Moshe Wasserblat, Roy Schwartz arXiv_CL arXiv_CL Transformer Bert Text_Classification Optimization Classification Inference PDF
2022-04-13 Probing for Constituency Structure in Neural Language Models David Arps, Younes Samih, Laura Kallmeyer, Hassan Sajjad arXiv_CL arXiv_CL Bert Knowledge Language_Model PDF
2022-04-13 IIITDWD-ShankarB@ Dravidian-CodeMixi-HASOC2021: mBERT based model for identification of offensive content in south Indian languages Shankar Biradar, Sunil Saumya arXiv_CL arXiv_CL Bert GAN PDF
2022-04-12 L3Cube-MahaNER: A Marathi Named Entity Recognition Dataset and BERT models Parth Patil, Aparna Ranade, Maithili Sabane, Onkar Litake, Raviraj Joshi arXiv_CL arXiv_CL Transformer Recognition Bert RNN PDF
2022-04-12 MuCoT: Multilingual Contrastive Training for Question-Answering in Low-resource Languages Gokul Karthik Kumar, Abhishek Singh Gehlot, Sahal Shaji Mullappilly, Karthik Nandakumar arXiv_CL arXiv_CL Transformer Embedding Bert Knowledge Self-Supervised QA PDF
2022-04-12 Solving Price Per Unit Problem Around the World: Formulating Fact Extraction as Question Answering Tarik Arici, Kushal Kumar, Hayreddin Çeker, Anoop S V K K Saladi, Ismail Tutar arXiv_CL arXiv_CL Recognition Bert Action Inference QA PDF
2022-04-12 Deep Annotation of Therapeutic Working Alliance in Psychotherapy Baihan Lin, Guillermo Cecchi, Djallel Bouneffouf arXiv_CL arXiv_CL Embedding Bert Speech Pose PDF
2022-04-12 Overlapping Word Removal is All You Need: Revisiting Data Imbalance in Hope Speech Detection Hariharan RamakrishnaIyer LekshmiAmmal, Manikandan Ravikiran, Gayathri Nisha, Navyasree Balamuralidhar, Adithya Madhusoodanan, Anand Kumar Madasamy, Bharathi Raja Chakravarthi arXiv_CL arXiv_CL Bert Speech Detection PDF
2022-04-11 ProtoTEx: Explaining Model Decisions with Prototype Tensors Anubrata Das, Chitrank Gupta, Venelin Kovatchev, Matthew Lease, Junyi Jessy Li arXiv_CL arXiv_CL Bert Classification Detection GAN Inference PDF
2022-04-11 Doctor XAvIer: Explainable Diagnosis using Physician-Patient Dialogues and XAI Evaluation Hillary Ngai, Frank Rudzicz arXiv_CL arXiv_CL Recognition Bert Classification Prediction PDF
2022-04-11 A Generative Language Model for Few-shot Aspect-Based Sentiment Analysis Ehsan Hosseini-Asl, Wenhao Liu, Caiming Xiong arXiv_CL arXiv_CL Bert Pose Action Detection Sentiment Few-Shot Attention Language_Model Prediction PDF
2022-04-11 Towards Generalizeable Semantic Product Search by Text Similarity Pre-training on Search Click Logs Zheng Liu, Wei Zhang, Yan Chen, Weiyi Sun, Michael Du, Benjamin Schroeder arXiv_CL arXiv_CL Bert PDF
2022-04-11 An Optimal Experimental Design Approach for Light Configurations in Photometric Stereo Hamza Gardi, Sebastian F. Walter, Christoph S. Garbe arXiv_CV arXiv_CV Bert Face PDF
2022-04-11 Tokenwise Contrastive Pretraining for Finer Speech-to-BERT Alignment in End-to-End Speech-to-Intent Systems Vishal Sunder, Eric Fosler-Lussier, Samuel Thomas, Hong-Kwang J. Kuo, Brian Kingsbury arXiv_CL arXiv_CL Embedding Recognition Bert Regularization Knowledge Speech Attention PDF
2022-04-11 Team ÚFAL at CMCL 2022 Shared Task: Figuring out the correct recipe for predicting Eye-Tracking features using Pretrained Language Models Sunit Bhattacharya, Rishu Kumar, Ondrej Bojar arXiv_CL arXiv_CL Tracking Bert Language_Model Prediction PDF
2022-04-11 Fusion of Self-supervised Learned Models for MOS Prediction Zhengdong Yang, Wangjin Zhou, Chenhui Chu, Sheng Li, Raj Dabre, Raphael Rubino, Yi Zhao arXiv_CL arXiv_CL Bert Speech Self-Supervised Pose Prediction PDF
2022-04-10 Fake news detection using parallel BERT deep neural networks Mahmood Farokhian, Vahid Rafe, Hadi Veisi arXiv_CL arXiv_CL Transformer Transfer_Learning Bert Pose Detection PDF
2022-04-10 Few-Shot Cross-lingual Transfer for Coarse-grained De-identification of Code-Mixed Clinical Texts Saadullah Amin, Noon Pokaratsiri Goldstein, Morgan Kelly Wixted, Alejandro García-Rudolph, Catalina Martínez-Costa, Günter Neumann arXiv_CL arXiv_CL Recognition Bert Zero-Shot Knowledge Pose Action Few-Shot Language_Model PDF
2022-04-10 Breaking Character: Are Subwords Good Enough for MRLs After All? Omri Keren, Tal Avinari, Reut Tsarfaty, Omer Levy arXiv_CL arXiv_CL Recognition Bert Face Inference Language_Model PDF
2022-04-10 Pushing on Personality Detection from Verbal Behavior: A Transformer Meets Text Contours of Psycholinguistic Features Elma Kerz, Yu Qiao, Sourabh Zanwar, Daniel Wiechmann arXiv_CL arXiv_CL Transformer Bert RNN Knowledge Classification Detection Contour Attention Language_Model Prediction PDF
2022-04-09 Efficient Extraction of Pathologies from C-Spine Radiology Reports using Multi-Task Learning Arijit Sehanobish, Nathaniel Brown, Ishita Daga, Jayashri Pawar, Danielle Torres, Anasuya Das, Murray Becker, Richard Herzog, Benjamin Odry, Ron Vianu arXiv_AI arXiv_AI Transformer Bert Action PDF
2022-04-09 Benchmarking for Public Health Surveillance tasks on Social Media with a Domain-Specific Pretrained Language Model Usman Naseem, Byoung Chan Lee, Matloob Khushi, Jinman Kim, Adam G. Dunn arXiv_CL arXiv_CL Transformer Surveillance Bert Language_Model PDF
2022-04-09 FoundationLayerNorm: Scaling BERT and GPT to 1,000 Layers Dezhou Shen arXiv_AI arXiv_AI Bert Pose PDF
2022-04-09 Modeling Multi-Granularity Hierarchical Features for Relation Extraction Xinnian Liang, Shuangzhi Wu, Mu Li, Zhoujun Li arXiv_CL arXiv_CL Bert RNN Knowledge Knowledge_Graph Pose Action Relation Relation_Extraction PDF
2022-04-08 Towards Understanding Large-Scale Discourse Structures in Pre-Trained and Fine-Tuned Language Models Patrick Huber, Giuseppe Carenini arXiv_AI arXiv_AI Bert Pose Language_Model PDF
2022-04-08 BioRED: A Comprehensive Biomedical Relation Extraction Dataset Ling Luo, Po-Ting Lai, Chih-Hsuan Wei, Cecilia N Arighi, Zhiyong Lu arXiv_CL arXiv_CL Recognition Bert Knowledge Review Action Relation Relation_Extraction Medical PDF
2022-04-08 Contextual Representation Learning beyond Masked Language Modeling Zhiyi Fu, Wangchunshu Zhou, Jingjing Xu, Hao Zhou, Lei Li arXiv_CL arXiv_CL Embedding Bert Represenation_Learning Pose Language_Model PDF
2022-04-08 Predicting Berth Stay for Tanker Terminals: A Systematic and Dynamic Approach Deqing Zhai, Xiuju Fu, Xiao Feng Yin, Haiyan Xu, Wanbing Zhang arXiv_AI arXiv_AI Enhancement Bert Optimization Pose Face Action Prediction PDF
2022-04-08 Bag-of-Words vs. Sequence vs. Graph vs. Hierarchy for Single- and Multi-Label Text Classification Andor Diera, Bao Xin Lin, Bhakti Khera, Tim Meuser, Tushar Singhal, Lukas Galke, Ansgar Scherp arXiv_CL arXiv_CL Bert Text_Classification Classification PDF
2022-04-08 RuBioRoBERTa: a pre-trained biomedical language model for Russian language biomedical text mining Alexander Yalunin, Alexander Nesterov, Dmitriy Umerenkov arXiv_AI arXiv_AI Recognition Bert Text_Classification Classification Medical Inference Language_Model PDF
2022-04-08 Automatic Pronunciation Assessment using Self-Supervised Speech Representation Learning Eesung Kim, Jae-Jin Jeon, Hyeji Seo, Hoon Kim arXiv_CL arXiv_CL Transformer Bert Represenation_Learning Speech Self-Supervised Pose Classification Relation PDF
2022-04-08 Infusing Knowledge from Wikipedia to Enhance Stance Detection Zihao He, Negar Mokhberian, Kristina Lerman arXiv_CL arXiv_CL Bert Knowledge Detection Few-Shot PDF
2022-04-07 BERTuit: Understanding Spanish language in Twitter through a native transformer Javier Huertas-Tato, Alejandro Martin, David Camacho arXiv_CL arXiv_CL Transformer Bert Zero-Shot Optimization Pose Face Attention Language_Model PDF
2022-04-07 Autoencoding Language Model Based Ensemble Learning for Commonsense Validation and Explanation Ngo Quang Huy, Tu Minh Phuong, Ngo Xuan Bach arXiv_AI arXiv_AI Bert Knowledge Language_Model PDF
2022-04-07 Enhancing Semantic Code Search with Multimodal Contrastive Learning and Soft Data Augmentation Ensheng Shi, Wenchao Gub, Yanlin Wang, Lun Du, Hongyu Zhang, Shi Han, Dongmei Zhang, Hongbin Sun arXiv_AI arXiv_AI Bert Pose Contrastive_Learning PDF
2022-04-07 PALBERT: Teaching ALBERT to Ponder Nikita Balagansky, Daniil Gavrilov arXiv_CL arXiv_CL Bert Pose Inference Prediction PDF
2022-04-07 Pretraining Text Encoders with Adversarial Mixture of Training Signal Generators Yu Meng, Chenyan Xiong, Payal Bajaj, Saurabh Tiwary, Paul Bennett, Jiawei Han, Xia Song arXiv_CL arXiv_CL Bert Adversarial Pose Language_Model PDF
2022-04-07 Speech Pre-training with Acoustic Piece Shuo Ren, Shujie Liu, Yu Wu, Long Zhou, Furu Wei arXiv_SD arXiv_SD Transformer Recognition Bert Speech Pose Relation Speech_Recognition PDF
2022-04-07 Accelerating Attention through Gradient-Based Learned Runtime Pruning Zhenge Li, Soroush Ghodrati, Amir Yazdanbakhsh, Hadi Esmaeilzadeh, Mingu Kang arXiv_CL arXiv_CL Transformer Bert Relation Attention Language_Model PDF
2022-04-06 Paying More Attention to Self-attention: Improving Pre-trained Language Models via Attention Guiding Shanshan Wang, Zhumin Chen, Zhaochun Ren, Huasheng Liang, Qiang Yan, Pengjie Ren arXiv_CL arXiv_CL Bert Pose Relation Attention Language_Model PDF
2022-04-06 drsphelps at SemEval-2022 Task 2: Learning idiom representations using BERTRAM Dylan Phelps arXiv_CL arXiv_CL Transformer Embedding Bert Detection PDF
2022-04-06 Language Model for Text Analytic in Cybersecurity Ehsan Aghaei, Xi Niu, Waseem Shadid, Ehab Al-Shaer arXiv_CL arXiv_CL Transfer_Learning Bert Pose Quantitative Language_Model PDF
2022-04-06 Using Synthetic Data for Conversational Response Generation in Low-resource Settings Gabriel Louis Tan, Adrian Paule Ty, Schuyler Ng, Denzel Adrian Co, Jan Christian Blaise Cruz, Charibeth Cheng arXiv_CL arXiv_CL Bert PDF
2022-04-06 DAGAM: Data Augmentation with Generation And Modification Byeong-Cheol Jo, Tak-Sung Heo, Yeongjoon Park, Yongmin Yoo, Won Ik Cho, Kyungsun Kim arXiv_CL arXiv_CL Transformer Bert Text_Classification Pose Classification Language_Model PDF
2022-04-05 An Exploratory Study on Code Attention in BERT Rishab Sharma, Fuxiang Chen, Fatemeh Fard, David Lo arXiv_CL arXiv_CL Transformer Embedding Bert Detection Attention Summarization Language_Model PDF
2022-04-05 Parameter-Efficient Neural Reranking for Cross-Lingual and Multilingual Retrieval Robert Litschko, Ivan Vulić, Goran Glavaš arXiv_CL arXiv_CL Transformer Bert Zero-Shot Sparse Pose Action Inference Language_Model PDF
2022-04-05 Abstractive summarization of hospitalisation histories with transformer networks Alexander Yalunin, Dmitriy Umerenkov, Vladimir Kokh arXiv_CL arXiv_CL Transformer Bert Summarization PDF
2022-04-05 Multilinguals at SemEval-2022 Task 11: Transformer Based Architecture for Complex NER Amit Pandey, Swayatta Daw, Vikram Pudi arXiv_CL arXiv_CL Transformer Bert Language_Model PDF
2022-04-05 How do media talk about the Covid-19 pandemic? Metaphorical thematic clustering in Italian online newspapers Lucia Busso, Ottavia Tordini arXiv_CL arXiv_CL Bert Quantitative PDF
2022-04-05 How Different are Pre-trained Transformers for Text Ranking? David Rau, Jaap Kamps arXiv_CL arXiv_CL Transformer Bert Deep_Learning PDF
2022-04-04 Applying Automatic Text Summarization for Fake News Detection Philipp Hartl, Udo Kruschwitz arXiv_CL arXiv_CL Transformer Bert Detection Summarization Language_Model PDF
2022-04-04 Self-Supervised Speech Representations Preserve Speech Characteristics while Anonymizing Voices Abner Hernandez, Paula Andrea Pérez-Toro, Juan Camilo Vásquez-Correa, Juan Rafael Orozco-Arroyave, Andreas Maier, Seung Hee Yang arXiv_CL arXiv_CL Recognition Bert Speech Self-Supervised Speech_Recognition PDF
2022-04-04 Cross-lingual Self-Supervised Speech Representations for Improved Dysarthric Speech Recognition Abner Hernandez, Paula Andrea Pérez-Toro, Elmar Nöth, Juan Rafael Orozco-Arroyave, Andreas Maier, Seung Hee Yang arXiv_CL arXiv_CL Recognition Bert Speech Self-Supervised Speech_Recognition PDF
2022-04-04 Aligned Weight Regularizers for Pruning Pretrained Neural Networks James O' Neill, Sourav Dutta, Haytham Assem arXiv_CL arXiv_CL Bert Zero-Shot Pose Language_Model PDF
2022-04-03 Graph Enhanced BERT for Query Understanding Juanhui Li, Yao Ma, Wei Zeng, Suqi Cheng, Jiliang Tang, Shuaiqiang Wang, Dawei Yin arXiv_AI arXiv_AI Bert Pose Language_Model PDF
2022-04-03 Learning Disentangled Semantic Representations for Zero-Shot Cross-Lingual Transfer in Multilingual Machine Reading Comprehension injuan Wu, Shaojuan Wu, Xiaowang Zhang, Deyi Xiong, Shizhan Chen, Zhiqiang Zhuang, Zhiyong Feng arXiv_CL arXiv_CL Bert Zero-Shot Knowledge Pose QA PDF
2022-04-03 POS-BERT: Point Cloud One-Stage BERT Pre-Training Kexue Fu, Peng Gao, ShaoLei Liu, Renrui Zhang, Yu Qiao, Manning Wang arXiv_CV arXiv_CV Transformer Segmentation Point_Cloud Bert Pose Contrastive_Learning Classification Few-Shot Language_Model PDF
2022-04-02 BERT-Assisted Semantic Annotation Correction for Emotion-Related Questions Abe Kazemzadeh arXiv_CL arXiv_CL Bert Pose Emotion Language_Model PDF
2022-04-02 UrbanFly: Uncertainty-Aware Planning for Navigation Amongst High-Rises with Monocular Visual-Inertial SLAM Maps Ayyappa Swamy Thatavarthy, Sudarshan S Harithas, Gurkirat Singh, Arun K Singh, K Madhava Krishna arXiv_RO arXiv_RO Segmentation Embedding Point_Cloud Bert Sparse SLAM PDF
2022-04-02 Efficient comparison of sentence embeddings Spyros Zoupanos, Stratis Kolovos, Athanasios Kanavos, Orestis Papadimitriou, Manolis Maragoudakis arXiv_CL arXiv_CL Embedding Bert PDF
2022-04-01 CharacterBERT and Self-Teaching for Improving the Robustness of Dense Retrievers on Queries with Typos Shengyao Zhuang, Guido Zuccon arXiv_CL arXiv_CL Embedding Bert Knowledge Attention PDF
2022-04-01 Human Evaluation and Correlation with Automatic Metrics in Consultation Note Generation Francesco Moramarco, Alex Papadopoulos Korfiatis, Mark Perera, Damir Juric, Jack Flann, Ehud Reiter, Anya Belz, Aleksandar Savkov arXiv_CL arXiv_CL Bert Quantitative Relation PDF
2022-04-01 Cyberbullying detection across social media platforms via platform-aware adversarial encoding Peiling Yi, Arkaitz Zubiaga arXiv_CL arXiv_CL Transformer Bert Adversarial Pose Detection Attention PDF
2022-04-01 Feature Structure Distillation for BERT Transferring Hee-Jun Jung, Doyeon Kim, Seung-Hoon Na, Kangil Kim arXiv_AI arXiv_AI Bert Knowledge Pose Relation PDF
2022-04-01 Predicting Intervention Approval in Clinical Trials through Multi-Document Summarization Georgios Katsimpras, Georgios Paliouras arXiv_CL arXiv_CL Bert Knowledge Pose Summarization Medical PDF
2022-04-01 Syntax-informed Question Answering with Heterogeneous Graph Transformer Fangyi Zhu, Lok You Tan, See-Kiong Ng, Stéphane Bressan arXiv_AI arXiv_AI Transformer Bert Knowledge Pose Language_Model PDF
2022-04-01 Effect and Analysis of Large-scale Language Model Rescoring on Competitive ASR Systems Takuma Udagawa, Masayuki Suzuki, Gakuto Kurata, Nobuyasu Itoh, George Saon arXiv_CL arXiv_CL Bert Language_Model PDF
2022-03-31 A Baseline Readability Model for Cebuano Lloyd Lois Antonie Reyes, Michael Antonio Ibañez, Ranz Sapinit, Mohammed Hussien, Joseph Marvin Imperial arXiv_CL arXiv_CL Embedding Bert Face PDF
2022-03-31 CatIss: An Intelligent Tool for Categorizing Issues Reports using Transformers Maliheh Izadi arXiv_CL arXiv_CL Transformer Tracking Enhancement Bert Pose Prediction PDF
2022-03-31 Mixed-Phoneme BERT: Improving BERT with Mixed Phoneme and Sup-Phoneme Representations for Text to Speech Guangyan Zhang, Kaitao Song, Xu Tan, Daxin Tan, Yuzi Yan, Yanqing Liu, Gang Wang, Wei Zhou, Tao Qin, Tan Lee, Sheng Zhao arXiv_CL arXiv_CL Bert Speech Pose Attention Inference PDF
2022-03-31 Pre-Training Transformer Decoder for End-to-End ASR Model with Unpaired Speech Data Junyi Ao, Ziqiang Zhang, Long Zhou, Shujie Liu, Haizhou Li, Tom Ko, Lirong Dai, Jinyu Li, Yao Qian, Furu Wei arXiv_SD arXiv_SD Transformer Recognition Bert Speech Pose Speech_Recognition Language_Model PDF
2022-03-31 Domain Adaptation for Sparse-Data Settings: What Do We Gain by Not Using Bert? Marina Sedinkina, Martin Schmitt, Hinrich Schütze arXiv_CL arXiv_CL Transfer_Learning Bert Sparse Language_Model PDF
2022-03-31 A Character-level Span-based Model for Mandarin Prosodic Structure Prediction Xueyuan Chen, Changhe Song, Yixuan Zhou, Zhiyong Wu, Changbin Chen, Zhongqin Wu, Helen Meng arXiv_SD arXiv_SD Segmentation Bert Speech Pose Attention Prediction PDF
2022-03-31 indic-punct: An automatic punctuation restoration and inverse text normalization framework for Indic languages Anirudh Gupta, Neeraj Chhimwal, Ankur Dhuriya, Rishabh Gaur, Priyanshi Shah, Harveen Singh Chadha, Vivek Raghavan arXiv_CL arXiv_CL Recognition Bert Restoration Speech Sentiment Speech_Recognition PDF
2022-03-31 ESGBERT: Language Model to Help with Classification Tasks Related to Companies Environmental, Social, and Governance Practices Srishti Mehra, Robert Louka, Yixun Zhang arXiv_CL arXiv_CL Bert Classification Attention Language_Model PDF
2022-03-30 Reproducibility Issues for BERT-based Evaluation Metrics Yanran Chen, Jonas Belouadi, Steffen Eger arXiv_CL arXiv_CL Bert PDF
2022-03-30 Incorporating Dynamic Semantics into Pre-Trained Language Model for Aspect-based Sentiment Analysis Kai Zhang, Kun Zhang, Mengdi Zhang, Hongke Zhao, Qi Liu, Wei Wu, Enhong Chen arXiv_AI arXiv_AI Bert Pose Sentiment Attention Language_Model PDF
2022-03-30 Detecting Unassimilated Borrowings in Spanish: An Annotated Corpus and Approaches to Modeling Elena Álvarez-Mellado, Constantine Lignos arXiv_CL arXiv_CL Transformer Embedding Bert RNN PDF
2022-03-29 Image Retrieval from Contextual Descriptions Benno Krojer, Vaibhav Adlakha, Vibhav Vineet, Yash Goyal, Edoardo Ponti, Siva Reddy arXiv_CL arXiv_CL Bert Image_Retrieval Inference Language_Model PDF
2022-03-29 Autoregressive Co-Training for Learning Discrete Speech Representations Sung-Lin Yeh, Hao Tang arXiv_CL arXiv_CL Quantization Bert Speech Self-Supervised Pose PDF
2022-03-29 LinkBERT: Pretraining Language Models with Document Links Michihiro Yasunaga, Jure Leskovec, Percy Liang arXiv_CL arXiv_CL Bert Knowledge Self-Supervised Pose Relation Few-Shot Medical Language_Model Prediction QA PDF
2022-03-29 LightHuBERT: Lightweight and Configurable Speech Representation Learning with Once-for-All Hidden-Unit BERT Rui Wang, Qibing Bai, Junyi Ao, Long Zhou, Zhixiang Xiong, Zhihua Wei, Yu Zhang, Tom Ko, Haizhou Li arXiv_SD arXiv_SD Transformer Embedding Recognition Bert Represenation_Learning Speech Self-Supervised Pose Classification Attention Speech_Recognition PDF
2022-03-29 mc-BEiT: Multi-choice Discretization for Image BERT Pre-training Xiaotong Li, Yixiao Ge, Kun Yi, Zixuan Hu, Ying Shan, Ling-Yu Duan arXiv_CV arXiv_CV Segmentation Semantic_Segmentation Bert Represenation_Learning Self-Supervised Classification Detection Object_Detection PDF
2022-03-29 Improving Persian Relation Extraction Models by Data Augmentation Moein Salimi Sartakhti, Romina Etezadi, Mehrnoush Shamsfard arXiv_CL arXiv_CL Bert Action Relation Relation_Extraction PDF
2022-03-29 A Fast Post-Training Pruning Framework for Transformers Woosuk Kwon, Sehoon Kim, Michael W. Mahoney, Joseph Hassoun, Kurt Keutzer, Amir Gholami arXiv_CL arXiv_CL Transformer Bert Pose Inference PDF
2022-03-29 Worldwide city transport typology prediction with sentence-BERT based supervised learning via Wikipedia Srushti Rath, Joseph Y.J. Chow arXiv_CL arXiv_CL Bert Pose Prediction PDF
2022-03-28 Word Discovery in Visually Grounded, Self-Supervised Speech Models Puyuan Peng, David Harwath arXiv_AI arXiv_AI Segmentation Bert Speech Self-Supervised Attention Caption PDF
2022-03-28 Discovering material information using hierarchical Reformer model on financial regulatory filings Francois Mercier, Makesh Narsimhan arXiv_CL arXiv_CL Surveillance Bert Deep_Learning Attention PDF
2022-03-28 UTSA NLP at SemEval-2022 Task 4: An Exploration of Simple Ensembles of Transformers, Convolutional, and Recurrent Neural Networks Xingmeng Zhao, Anthony Rios arXiv_CL arXiv_CL Transformer Bert RNN Memory_Networks Deep_Learning CNN PDF
2022-03-28 Continuous Metric Learning For Transferable Speech Emotion Recognition and Embedding Across Low-resource Languages Sneha Das, Nicklas Leander Lund, Nicole Nadine Lønfeldt, Anne Katrine Pagsberg, Line H. Clemmensen arXiv_SD arXiv_SD Embedding Unsupervised Recognition Bert Knowledge Speech Pose Emotion Classification Deep_Learning Relation Denoising PDF
2022-03-28 Hierarchical Transformer Model for Scientific Named Entity Recognition Urchade Zaratiana, Pierre Holat, Nadi Tomeh, Thierry Charnois arXiv_CL arXiv_CL Transformer Recognition Bert Knowledge Knowledge_Graph Action Relation Relation_Extraction Medical PDF
2022-03-28 Specialized Document Embeddings for Aspect-based Similarity of Research Papers Malte Ostendorff, Till Blume, Terry Ruas, Bela Gipp, Georg Rehm arXiv_CL arXiv_CL Segmentation Embedding Bert Classification Recommendation PDF
2022-03-28 ANNA: Enhanced Language Representation for Question Answering Changwook Jun, Hansol Jang, Myoseop Sim, Hyun Kim, Jooyoung Choi, Kyungkoo Min, Kyunghoon Bae arXiv_CL arXiv_CL Bert Pose Language_Model PDF
2022-03-27 Pyramid-BERT: Reducing Complexity via Successive Core-set based Token Selection Xin Huang, Ashish Khetan, Rene Bidart, Zohar Karnin arXiv_CL arXiv_CL Transformer Embedding Bert Classification Language_Model Prediction PDF
2022-03-27 bitsa_nlp@LT-EDI-ACL2022: Leveraging Pretrained Language Models for Detecting Homophobia and Transphobia in Social Media Comments Vitthal Bhandari, Poonam Goyal arXiv_AI arXiv_AI Transformer Bert Language_Model PDF
2022-03-27 Knowledge Mining with Scene Text for Fine-Grained Recognition Hao Wang, Junchao Liao, Tianheng Cheng, Zewen Gao, Hao Liu, Bo Ren, Xiang Bai, Wenyu Liu arXiv_CV arXiv_CV Image_Caption Recognition Bert Knowledge Pose Scene_Text Action Classification Relation Activity Image_Classification PDF
2022-03-26 Autoregressive Linguistic Steganography Based on BERT and Consistency Coding Xiaoyan Zheng, Hanzhou Wu arXiv_CL arXiv_CL Embedding Bert Pose Deep_Learning GAN Language_Model PDF
2022-03-25 A Comparative Evaluation Of Transformer Models For De-Identification Of Clinical Text Data Christopher Meaney, Wali Hakimpour, Sumeet Kalia, Rahim Moineddin arXiv_CL arXiv_CL Transformer Transfer_Learning Bert GAN PDF
2022-03-25 L3Cube-MahaHate: A Tweet-based Marathi Hate Speech Detection Dataset and BERT models Abhishek Velankar, Hrushikesh Patil, Amol Gore, Shubham Salunke, Raviraj Joshi arXiv_CL arXiv_CL Transformer Bert RNN Speech Face Classification Deep_Learning Detection PDF
2022-03-25 Predicting Clinical Intent from Free Text Electronic Health Records Kawsar Noor, Katherine Smith, Julia Bennett, Jade OConnell, Jessica Fisk, Monika Hunt, Gary Philippo, Teresa Xu, Simon Knight, Luis Romao, Richard JB Dobson, Wai Keong Wong arXiv_CL arXiv_CL Bert Classification PDF
2022-03-25 Reshaping Robot Trajectories Using Natural Language Commands: A Study of Multi-Modal Data Alignment Using Transformers Arthur Bucker, Luis Figueredo, Sami Haddadin, Ashish Kapoor, Shuang Ma, Rogerio Bonatti arXiv_RO arXiv_RO Transformer Bert Face Action Attention Autonomous Language_Model Prediction PDF
2022-03-24 Non-Parametric Stochastic Policy Gradient with Strategic Retreat for Non-Stationary Environment Apan Dastider, Mingjie Lin arXiv_AI arXiv_AI Bert Pose Action Autonomous PDF
2022-03-24 NPBG++: Accelerating Neural Point-Based Graphics Ruslan Rakhimov, Andrei-Timotei Ardelean, Victor Lempitsky, Evgeny Burnaev arXiv_CV arXiv_CV Point_Cloud Bert Optimization Pose PDF
2022-03-24 Token Dropping for Efficient BERT Pretraining Le Hou, Richard Yuanzhe Pang, Tianyi Zhou, Yuexin Wu, Xinying Song, Xiaodan Song, Denny Zhou arXiv_CL arXiv_CL Transformer Bert Language_Model PDF
2022-03-24 Complex Frequency Domain Linear Prediction: A Tool to Compute Modulation Spectrum of Speech Samik Sadhu, Hynek Hermansky arXiv_SD arXiv_SD Recognition Bert Speech Pose Speech_Recognition Prediction PDF
2022-03-24 minicons: Enabling Flexible Behavioral and Representational Analyses of Transformer Language Models Kanishka Misra arXiv_CL arXiv_CL Transformer Bert Zero-Shot Action Language_Model Prediction PDF
2022-03-24 Introducing Neural Bag of Whole-Words with ColBERTer: Contextualized Late Interactions using Enhanced Reduction Sebastian Hofstätter, Omar Khattab, Sophia Althammer, Mete Sertkan, Allan Hanbury arXiv_AI arXiv_AI Bert Pose Action Matching PDF
2022-03-24 mcBERT: Momentum Contrastive Learning with BERT for Zero-Shot Slot Filling Seong-Hwan Heo, WonKee Lee, Jong-Hyeok Lee arXiv_AI arXiv_AI Bert Zero-Shot Pose Contrastive_Learning Attention PDF
2022-03-24 Neural Reflectance for Shape Recovery with Shadow Handling Junxuan Li, Hongdong Li arXiv_CV arXiv_CV 3D Bert Self-Supervised Pose Face PDF
2022-03-24 Mono vs Multilingual BERT: A Case Study in Hindi and Marathi Named Entity Recognition Onkar Litake, Maithili Sabane, Parth Patil, Aparna Ranade, Raviraj Joshi arXiv_CL arXiv_CL Transformer Recognition Bert Classification GAN PDF
2022-03-23 Adversarial Training for Improving Model Robustness? Look at Both Prediction and Interpretation Hanjie Chen, Yangfeng Ji arXiv_CL arXiv_CL Bert Text_Classification RNN Adversarial Pose Classification Language_Model Prediction PDF
2022-03-23 Input-specific Attention Subnetworks for Adversarial Detection Emil Biju, Anirudh Sriram, Pratyush Kumar, Mitesh M Khapra arXiv_CL arXiv_CL Transformer Bert Adversarial Pose Detection Relation Object_Detection Attention PDF
2022-03-22 Self-supervision through Random Segments with Autoregressive Coding Tianyu Hua, Yonglong Tian, Sucheng Ren, Hang Zhao, Leonid Sigal arXiv_CV arXiv_CV Transformer Bert Represenation_Learning Self-Supervised Pose Prediction PDF
2022-03-22 Transformer based ensemble for emotion detection Aditya Kane, Shantanu Patankar, Sahil Khose, Neeraja Kirtane arXiv_CL arXiv_CL Transformer Bert Emotion Action Detection PDF
2022-03-22 Under the Hood of Transformer Networks for Trajectory Forecasting Luca Franco, Leonardo Placidi, Francesco Giuliari, Irtiza Hasan, Marco Cristani, Fabio Galasso arXiv_CV arXiv_CV Transformer Bert RNN Pose Action PDF
2022-03-22 A Computational Approach to Understand Mental Health from Reddit: Knowledge-aware Multitask Learning Framework Usha Lokala, Aseem Srivastava, Triyasha Ghosh Dastidar, Tanmoy Chakraborty, Md Shad Akthar, Maryam Panahiazar, Amit Sheth arXiv_CL arXiv_CL Transfer_Learning Bert Knowledge Pose Detection Language_Model PDF
2022-03-22 Listening to Affected Communities to Define Extreme Speech: Dataset and Experiments Antonis Maronikolakis, Axel Wisiorek, Leah Nann, Haris Jabbar, Sahana Udupa, Hinrich Schuetze arXiv_CL arXiv_CL Bert Speech Pose Prediction PDF
2022-03-22 BERT-ASC: Auxiliary-Sentence Construction for Implicit Aspect Learning in Sentiment Analysis Ahmed Murtadha, Shengfeng Pan, Bo Wen, Jianlin Su, Wenze Zhang, Yunfeng Liu arXiv_CL arXiv_CL Bert Pose Sentiment Language_Model PDF
2022-03-22 Are You Misinformed? A Study of Covid-Related Fake News in Bengali on Facebook Protik Bose Pranto, Syed Zami-Ul-Haque Navid, Protik Dey, Gias Uddin, Anindya Iqbal arXiv_CL arXiv_CL Bert Face Medical PDF
2022-03-22 Factual Consistency of Multilingual Pretrained Language Models Constanza Fierro, Anders Søgaard arXiv_CL arXiv_CL Bert Knowledge Inference Language_Model PDF
2022-03-22 VLSP 2021 Shared Task: Vietnamese Machine Reading Comprehension Kiet Van Nguyen, Son Quoc Tran, Luan Thanh Nguyen, Tin Van Huynh, Son T. Luu, Ngan Luu-Thuy Nguyen arXiv_CL arXiv_CL Transformer Bert Speech Pose GAN Language_Model PDF
2022-03-21 Enhancing Speech Recognition Decoding via Layer Aggregation Tomer Wullach, Shlomo E. Chazan arXiv_CL arXiv_CL Recognition Bert Speech Pose Speech_Recognition Inference Language_Model Prediction PDF
2022-03-21 Towards Explainable Evaluation Metrics for Natural Language Generation Christoph Leiter, Piyawat Lertvittayakumjorn, Marina Fomicheva, Wei Zhao, Yang Gao, Steffen Eger arXiv_CL arXiv_CL Bert Adversarial Pose Relation Text_Generation Language_Model PDF
2022-03-21 AraBART: a Pretrained Arabic Sequence-to-Sequence Model for Abstractive Summarization Moussa Kamal Eddine, Nadi Tomeh, Nizar Habash, Joseph Le Roux, Michalis Vazirgiannis arXiv_CL arXiv_CL Transformer Bert Pose Summarization PDF
2022-03-21 Neural Token Segmentation for High Token-Internal Complexity Idan Brusilovsky, Reut Tsarfaty arXiv_CL arXiv_CL Segmentation Recognition Bert Speech Pose PDF
2022-03-21 TCM-SD: A Large Dataset for Syndrome Differentiation in Traditional Chinese Medicine Mucheng Ren, Heyan Huang, Yuxiang Zhou, Yuan Bu, Yang Gao arXiv_CL arXiv_CL Bert Knowledge Pose Language_Model PDF
2022-03-21 Semantic Similarity Computing for Scientific Academic Conferences fused with domain features Runyu Yu, Yawen Li, Ang Li arXiv_AI arXiv_AI Recognition Bert Pose Action Relation PDF
2022-03-21 An Intellectual Property Entity Recognition Method Based on Transformer and Technological Word Information Yuhui Wang, Junping Du, Yingxia Shao arXiv_CL arXiv_CL Transformer Recognition Bert Pose Action Prediction PDF
2022-03-21 Compression of Generative Pre-trained Language Models via Quantization Chaofan Tao, Lu Hou, Wei Zhang, Lifeng Shang, Xin Jiang, Qun Liu, Ping Luo, Ngai Wong arXiv_CV arXiv_CV Embedding Quantization Bert Pose Language_Model PDF
2022-03-20 Cluster & Tune: Boost Cold Start Performance in Text Classification Eyal Shnarch, Ariel Gera, Alon Halfon, Lena Dankin, Leshem Choshen, Ranit Aharonov, Noam Slonim arXiv_CL arXiv_CL Unsupervised Bert Text_Classification Classification PDF
2022-03-20 Build a Robust QA System with Transformer-based Mixture of Experts Yu Qing Zhou, Xixuan Julie Liu, Yuanzhe Dong arXiv_AI arXiv_AI Transformer Bert Sparse Relation QA PDF
2022-03-20 g2pW: A Conditional Weighted Softmax BERT for Polyphone Disambiguation in Mandarin Yi-Chang Chen, Yu-Chuan Chang, Yen-Cheng Chang, Yi-Ren Yeh arXiv_CL arXiv_CL Bert Speech Pose Language_Model PDF
2022-03-20 How does the pre-training objective affect what large language models learn about linguistic properties? Ahmed Alajrami, Nikolaos Aletras arXiv_CL arXiv_CL Bert Knowledge Pose Language_Model PDF
2022-03-19 Perturbations in the Wild: Leveraging Human-Written Text Perturbations for Realistic Adversarial Attack and Defense Thai Le, Jooyoung Lee, Kevin Yen, Yifan Hu, Dongwon Lee arXiv_CL arXiv_CL Bert Adversarial Pose PDF
2022-03-19 Clickbait Spoiling via Question Answering and Passage Retrieval Matthias Hagen, Maik Fröbe, Artur Jurk, Martin Potthast arXiv_CL arXiv_CL Bert PDF
2022-03-18 RELIC: Retrieving Evidence for Literary Claims Katherine Thai, Yapei Chang, Kalpesh Krishna, Mohit Iyyer arXiv_CL arXiv_CL Bert Matching PDF
2022-03-18 Effect of Active and Passive Protective Soft Skins on Collision Forces in Human-robot Collaboration Petr Svarny, Jakub Rozlivek, Lukas Rustler, Martin Sramek, Ozgur Deli, Michael Zillich, Matej Hoffmann arXiv_RO arXiv_RO Bert Pose Action Detection Prediction PDF
2022-03-18 Are You Robert or RoBERTa? Deceiving Online Authorship Attribution Models Using Neural Text Generators Keenan Jones, Jason R. C. Nurse, Shujun Li arXiv_AI arXiv_AI Bert Pose Detection Text_Generation Language_Model PDF
2022-03-18 Three things everyone should know about Vision Transformers Hugo Touvron, Matthieu Cord, Alaaeldin El-Nouby, Jakob Verbeek, Hervé Jégou arXiv_CV arXiv_CV Transformer Segmentation Bert Self-Supervised Action Classification Detection Attention Image_Classification PDF
2022-03-17 elBERto: Self-supervised Commonsense Learning for Question Answering Xunlin Zhan, Yuan Li, Xiao Dong, Xiaodan Liang, Zhiting Hu, Lawrence Carin arXiv_CL arXiv_CL Bert Represenation_Learning Knowledge Self-Supervised Pose Relation QA PDF
2022-03-17 Finding Structural Knowledge in Multimodal-BERT Victor Milewski, Miryam de Lhoneux, Marie-Francine Moens arXiv_CV arXiv_CV Embedding Bert Knowledge PDF
2022-03-17 Entropy-based Attention Regularization Frees Unintended Bias Mitigation from Lists Giuseppe Attanasio, Debora Nozza, Dirk Hovy, Elena Baralis arXiv_CL arXiv_CL Bert Regularization Knowledge Speech Pose Classification Detection Attention Prediction PDF
2022-03-17 Multilingual Detection of Personal Employment Status on Twitter Manuel Tonneau, Dhaval Adjodah, João Palotti, Nir Grinberg, Samuel Fraiberger arXiv_CL arXiv_CL Bert Classification Detection Attention PDF
2022-03-17 Fine- and Coarse-Granularity Hybrid Self-Attention for Efficient BERT Jing Zhao, Yifan Wang, Junwei Bao, Youzheng Wu, Xiaodong He arXiv_CL arXiv_CL Transformer Bert Pose Attention PDF
2022-03-16 AdapLeR: Speeding up Inference by Adaptive Length Reduction Ali Modarressi, Hosein Mohebbi, Mohammad Taher Pilehvar arXiv_CL arXiv_CL Bert Salient Pose Classification Attention Inference Language_Model PDF
2022-03-16 Label Semantics for Few Shot Named Entity Recognition Jie Ma, Miguel Ballesteros, Srikanth Doss, Rishita Anubhai, Sunil Mallya, Yaser Al-Onaizan, Dan Roth arXiv_CL arXiv_CL Recognition Bert Pose PDF
2022-03-16 CUE Vectors: Modular Training of Language Models Conditioned on Diverse Contextual Signals Scott Novotney, Sreeparna Mukherjee, Zeeshan Ahmed, Andreas Stolcke arXiv_CL arXiv_CL Transformer Embedding Bert Pose Language_Model PDF
2022-03-16 Tangles and Hierarchical Clustering Eva Fluck arXiv_CV arXiv_CV Segmentation Bert Knowledge Pose PDF
2022-03-16 Geographic Adaptation of Pretrained Language Models Valentin Hofmann, Goran Glavaš, Nikola Ljubešić, Janet B. Pierrehumbert, Hinrich Schütze arXiv_CL arXiv_CL Unsupervised Bert Zero-Shot Knowledge Language_Model Prediction PDF
2022-03-16 Zero-Shot Dependency Parsing with Worst-Case Aware Automated Curriculum Learning Miryam de Lhoneux, Sheng Zhang, Anders Søgaard arXiv_CL arXiv_CL Bert Zero-Shot Language_Model PDF
2022-03-16 KinyaBERT: a Morphology-aware Kinyarwanda Language Model Antoine Nzeyimana, Andre Niyongabo Rubungo arXiv_CL arXiv_CL Unsupervised Recognition Bert Pose Language_Model PDF
2022-03-16 Cross-Lingual Ability of Multilingual Masked Language Models: A Study of Language Structure Yuan Chai, Yaobo Liang, Nan Duan arXiv_CL arXiv_CL Bert Language_Model PDF
2022-03-16 Thinking about GPT-3 In-Context Learning for Biomedical IE? Think Again Bernal Jiménez Gutiérrez, Nikolas McNeal, Clay Washington, You Chen, Lang Li, Huan Sun, Yu Su arXiv_CL arXiv_CL Recognition Bert Action Relation Few-Shot Relation_Extraction Medical Language_Model PDF
2022-03-15 Improving Word Translation via Two-Stage Contrastive Learning Yaoyiran Li, Fangyu Liu, Nigel Collier, Anna Korhonen, Ivan Vulić arXiv_CL arXiv_CL Embedding Bert Pose Contrastive_Learning PDF
2022-03-15 Data Contamination: From Memorization to Exploitation Inbal Magar, Roy Schwartz arXiv_CL arXiv_CL Bert Language_Model PDF
2022-03-15 Measuring the Impact of Linguistic and Readability Features and Their Spill Over Effects on the Prediction of Eye Movement Patterns Daniel Wiechmann, Yu Qiao, Elma Kerz, Justus Mattern arXiv_CL arXiv_CL Transformer Tracking Bert Language_Model Prediction PDF
2022-03-15 Signal in Noise: Exploring Meaning Encoded in Random Character Sequences with Character-Aware Language Models Mark Chu, Bhargav Srinivasa Desikan, Ethan O. Nadler, Ruggerio L. Sardo, Elise Darragh-Ford, Douglas Guilbeault arXiv_CL arXiv_CL Embedding Bert Speech Pose Language_Model PDF
2022-03-15 Imputing Out-of-Vocabulary Embeddings with LOVE Makes Language Models Robust with Little Cost Lihu Chen, Gaël Varoquaux, Fabian M. Suchanek arXiv_CL arXiv_CL Embedding Bert Contrastive_Learning Face Language_Model PDF
2022-03-15 Do BERTs Learn to Use Browser User Interface? Exploring Multi-Step Tasks with Unified Vision-and-Language BERTs Taichi Iki, Akiko Aizawa arXiv_CL arXiv_CL Transformer Bert Pose Face PDF
2022-03-15 Evaluating BERT-based Pre-training Language Models for Detecting Misinformation Rini Anggrainingsih, Ghulam Mubashar Hassan, Amitava Datta arXiv_CL arXiv_CL Bert Pose Detection Language_Model PDF
2022-03-14 Choose Your QA Model Wisely: A Systematic Study of Generative and Extractive Readers for Question Answering Man Luo, Kazuma Hashimoto, Semih Yavuz, Zhiwei Liu, Chitta Baral, Yingbo Zhou arXiv_CL arXiv_CL Transformer Bert Quantitative Attention GAN Language_Model QA PDF
2022-03-14 CoNTACT: A Dutch COVID-19 Adapted BERT for Vaccine Hesitancy and Argumentation Detection Jens Lemmens, Jens Van Nooten, Tim Kreutz, Walter Daelemans arXiv_CL arXiv_CL Bert Face Classification Detection Language_Model PDF
2022-03-14 All in One: Exploring Unified Video-Language Pre-training Alex Jinpeng Wang, Yixiao Ge, Rui Yan, Yuying Ge, Xudong Lin, Guanyu Cai, Jianping Wu, Ying Shan, Xiaohu Qie, Mike Zheng Shou arXiv_CV arXiv_CV Transformer Bert Represenation_Learning Language_Model Video_Retrieval PDF
2022-03-14 The Optimal BERT Surgeon: Scalable and Accurate Second-Order Pruning for Large Language Models Eldar Kurtic, Daniel Campos, Tuan Nguyen, Elias Frantar, Mark Kurtz, Benjamin Fineran, Michael Goin, Dan Alistarh arXiv_CL arXiv_CL Transformer Quantization Bert Inference Language_Model PDF
2022-03-14 NeILF: Neural Incident Light Field for Physically-based Material Estimation Yao Yao, Jingyang Zhang, Jingbo Liu, Yihang Qu, Tian Fang, David McKinnon, Yanghai Tsin, Long Quan arXiv_CV arXiv_CV Bert Optimization Regularization Pose Face PDF
2022-03-14 Dawn of the transformer era in speech emotion recognition: closing the valence gap Johannes Wagner, Andreas Triantafyllopoulos, Hagen Wierstorf, Maximilian Schmitt, Florian Eyben, Björn W. Schuller arXiv_SD arXiv_SD Transformer Recognition Bert Knowledge Speech Self-Supervised Emotion Relation Attention Prediction PDF
2022-03-14 WCL-BBCD: A Contrastive Learning and Knowledge Graph Approach to Named Entity Recognition Renjie Zhou, Qiang Hu, Jian Wan, Jilin Zhang, Qiang Liu, Tianxiang Hu, Jianjun Li arXiv_CL arXiv_CL Recognition Bert RNN Knowledge Knowledge_Graph Pose Contrastive_Learning Action PDF
2022-03-14 PERT: Pre-training BERT with Permuted Language Model Yiming Cui, Ziqing Yang, Ting Liu arXiv_CL arXiv_CL Bert Pose Quantitative Language_Model PDF
2022-03-14 Deep Continuous Prompt for Contrastive Learning of Sentence Embeddings Yuxin Jiang, Wei Wang arXiv_CL arXiv_CL Embedding Unsupervised Bert Pose Contrastive_Learning Language_Model PDF
2022-03-14 Can pre-trained Transformers be used in detecting complex sensitive sentences? -- A Monsanto case study Roelien C. Timmer, David Liebowitz, Surya Nepal, Salil S. Kanhere arXiv_CL arXiv_CL Transformer Bert Detection GAN PDF
2022-03-13 Pruned Graph Neural Network for Short Story Ordering Melika Golestani, Zeinab Borhanifard, Farnaz Tahmasebian, Heshaam Faili arXiv_CL arXiv_CL Bert Pose GAN PDF
2022-03-13 Investigating the Impact of COVID-19 on Education by Social Network Mining Mohadese Jamalian, Hamed Vahdat-Nejad, Hamideh Hajiabadi arXiv_CL arXiv_CL Bert Relation Sentiment PDF
2022-03-12 FiNER: Financial Numeric Entity Recognition for XBRL Tagging Lefteris Loukas, Manos Fergadiotis, Ilias Chalkidis, Eirini Spyropoulou, Prodromos Malakasiotis, Ion Androutsopoulos, Georgios Paliouras arXiv_CL arXiv_CL Recognition Bert RNN Pose Action PDF
2022-03-12 BiBERT: Accurate Fully Binarized BERT Haotong Qin, Yifu Ding, Mingyuan Zhang, Qinghua Yan, Aishan Liu, Qingqing Dang, Ziwei Liu, Xianglong Liu arXiv_CL arXiv_CL Embedding Bert Optimization Pose Attention Matching PDF
2022-03-12 MarkBERT: Marking Word Boundaries Improves Chinese BERT Linyang Li, Yong Dai, Duyu Tang, Zhangyin Feng, Cong Zhou, Xipeng Qiu, Zenglin Xu, Shuming Shi arXiv_CL arXiv_CL Recognition Bert Text_Classification Classification PDF
2022-03-12 Image Style Transfer: from Artistic to Photorealistic Chenggui Sun, Li Bin Song arXiv_CV arXiv_CV Style_Transfer Bert Review Deep_Learning PDF
2022-03-12 ELLE: Efficient Lifelong Pre-training for Emerging Data Yujia Qin, Jiajie Zhang, Yankai Lin, Zhiyuan Liu, Peng Li, Maosong Sun, Jie Zhou arXiv_AI arXiv_AI Bert Knowledge Pose Language_Model PDF
2022-03-11 When classifying grammatical role, BERT doesn't care about word order... except when it matters Isabel Papadimitriou, Richard Futrell, Kyle Mahowald arXiv_CL arXiv_CL Embedding Bert Knowledge Classification Language_Model PDF
2022-03-11 Are discrete units necessary for Spoken Language Modeling? Tu Anh Nguyen, Benoit Sagot, Emmanuel Dupoux arXiv_CL arXiv_CL Unsupervised Bert Zero-Shot Speech Language_Model PDF
2022-03-11 A Sentence is Worth 128 Pseudo Tokens: A Semantic-Aware Contrastive Learning Framework for Sentence Embeddings Haochen Tan, Wei Shao, Han Wu, Ke Yang, Linqi Song arXiv_CL arXiv_CL Embedding Unsupervised Bert Pose Contrastive_Learning Attention PDF
2022-03-11 Using Word Embeddings to Analyze Protests News Maria Alejandra Cardoza Ceron arXiv_CL arXiv_CL Embedding Bert Classification Language_Model PDF
2022-03-11 BERTopic: Neural topic modeling with a class-based TF-IDF procedure Maarten Grootendorst arXiv_CL arXiv_CL Transformer Embedding Bert Language_Model PDF
2022-03-11 Hierarchical BERT for Medical Document Understanding Ning Zhang, Maciej Jankowski arXiv_AI arXiv_AI Embedding Bert RNN Pose Classification Attention Medical PDF
2022-03-10 Contextualized Sensorimotor Norms: multi-dimensional measures of sensorimotor strength for ambiguous English words, in context Sean Trott, Benjamin Bergen arXiv_CL arXiv_CL Bert Language_Model PDF
2022-03-10 A new approach to calculating BERTScore for automatic assessment of translation quality A.A. Vetrov, E.A. Gorn arXiv_CL arXiv_CL Embedding Bert Pose Relation Prediction Matching PDF
2022-03-10 Semantic Norm Recognition and its application to Portuguese Law Maria Duarte, Pedro A. Santos, João Dias, Jorge Baptista arXiv_CL arXiv_CL Recognition Bert Action PDF
2022-03-09 Pretrained Domain-Specific Language Model for General Information Retrieval Tasks in the AEC Domain Zhe Zheng, Xin-Zheng Lu, Ke-Yin Chen, Yu-Cheng Zhou, Jia-Rui Lin arXiv_CL arXiv_CL Embedding Transfer_Learning Recognition Bert Text_Classification Knowledge Pose Classification Deep_Learning Attention Language_Model PDF
2022-03-08 Towards Generalized Models for Task-oriented Dialogue Modeling on Spoken Conversations Ruijie Yan, Shuang Peng, Haitao Mi, Liang Jiang, Shihui Yang, Yuchi Zhang, Jiajun Li, Liangrui Peng, Yongliang Wang, Zujie Wen arXiv_CL arXiv_CL Tracking Bert Knowledge Speech Pose Classification Detection Language_Model PDF
2022-03-08 RC-MVSNet: Unsupervised Multi-View Stereo with Neural Rendering Di Chang, Aljaž Božič, Tong Zhang, Qingsong Yan, Yingcong Chen, Sabine Süsstrunk, Matthias Nießner arXiv_CV arXiv_CV Unsupervised Bert Pose Face PDF
2022-03-08 Informative Planning for Worst-Case Error Minimisation in Sparse Gaussian Process Regression Jennifer Wakulicz, Ki Myung Brian Lee, Chanyeol Yoo, Teresa Vidal-Calleja, Robert Fitch arXiv_RO arXiv_RO Bert Sparse Pose PDF
2022-03-07 Multi-CPR: A Multi Domain Chinese Dataset for Passage Retrieval Dingkun Long, Qiong Gao, Kuan Zou, Guangwei Xu, Pengjun Xie, Ruijie Guo, Jian Xu, Guanjun Jiang, Luxi Xing, Ping Yang arXiv_CL arXiv_CL Bert Optimization Attention Medical Language_Model PDF
2022-03-07 Clustering and classification of low-dimensional data in explicit feature map domain: intraoperative pixel-wise diagnosis of adenocarcinoma of a colon in a liver Dario Sitnik, Ivica Kopriva arXiv_CV arXiv_CV Segmentation Semantic_Segmentation Bert Pose Classification Prediction PDF
2022-03-07 Maximizing Conditional Independence for Unsupervised Domain Adaptation Yi-Ming Zhai, You-Wei Luo arXiv_CV arXiv_CV Unsupervised Bert Optimization Pose GAN Matching PDF
2022-03-06 Learnable Irrelevant Modality Dropout for Multimodal Action Recognition on Modality-Specific Annotated Videos Saghir Alfasly, Jian Lu, Chen Xu, Yuru Zou arXiv_CV arXiv_CV Transformer Recognition Bert Pose Action_Recognition Action Attention Language_Model PDF
2022-03-06 Graph Neural Network Enhanced Language Models for Efficient Multilingual Text Classification Samujjwal Ghosh, Subhadeep Maji, Maunendra Sankar Desarkar arXiv_CL arXiv_CL Transformer Bert Text_Classification Pose Action Classification Attention Language_Model PDF
2022-03-06 Divide and Conquer: Text Semantic Matching with Disentangled Keywords and Intents Yicheng Zou, Hongwei Liu, Tao Gui, Junzhe Wang, Qi Zhang, Meng Tang, Haixiang Li, Daniel Wang arXiv_CL arXiv_CL Bert Pose Action Inference Language_Model Recommendation Matching PDF
2022-03-06 Leveraging Pre-trained BERT for Audio Captioning Xubo Liu, Xinhao Mei, Qiushi Huang, Jianyuan Sun, Jinzheng Zhao, Haohe Liu, Mark D. Plumbley, Volkan Kılıç, Wenwu Wang arXiv_AI arXiv_AI Bert Knowledge Attention Caption Language_Model PDF
2022-03-05 Bridging the Gap Between Learning in Discrete and Continuous Environments for Vision-and-Language Navigation Yicong Hong, Zun Wang, Qi Wu, Stephen Gould arXiv_CV arXiv_CV 3D Bert Knowledge Pose Action Matching PDF
2022-03-05 Deep-ASPECTS: A Segmentation-Assisted Model for Stroke Severity Measurement Ujjwal Upadhyay, Mukul Ranjan, Satish Golla, Swetha Tanamala, Preetham Sreenivas, Sasank Chilamkurthy, Jeyaraj Pandian, Jason Tarpley arXiv_CV arXiv_CV Segmentation Bert Pose Deep_Learning Detection Medical PDF
2022-03-04 UVCGAN: UNet Vision Transformer cycle-consistent GAN for unpaired image-to-image translation Dmitrii Torbunov, Yi Huang, Haiwang Yu, Jin Huang, Shinjae Yoo, Meifeng Lin, Brett Viren, Yihui Ren arXiv_CV arXiv_CV Transformer Bert Adversarial Relation GAN PDF
2022-03-04 SimKGC: Simple Contrastive Knowledge Graph Completion with Pre-trained Language Models Liang Wang, Wei Zhao, Zhuoyu Wei, Jingming Liu arXiv_CL arXiv_CL Embedding Bert Knowledge Knowledge_Graph Pose Contrastive_Learning Language_Model PDF
2022-03-04 Detecting Offensive Language on Social Networks: An End-to-end Detection Method based on Graph Attention Networks Zhenxiong Miao, Xingshu Chen, Haizhou Wang, Rui Tang, Zhou Yang, Wenyi Tang arXiv_AI arXiv_AI Embedding Bert Pose Detection Attention PDF
2022-03-04 Deep Lexical Hypothesis: Identifying personality structure in natural language Andrew Cutler, David M. Condon arXiv_CL arXiv_CL Bert Survey Relation Language_Model PDF
2022-03-03 Overlap-based Vocabulary Generation Improves Cross-lingual Transfer Among Related Languages Vaidehi Patil, Partha Talukdar, Sunita Sarawagi arXiv_CL arXiv_CL Embedding Bert Zero-Shot Pose Language_Model PDF
2022-03-03 Improving Health Mentioning Classification of Tweets using Contrastive Adversarial Training Pervaiz Iqbal Khan, Shoaib Ahmed Siddiqui, Imran Razzak, Andreas Dengel, Sheraz Ahmed arXiv_AI arXiv_AI Embedding Bert Adversarial Classification PDF
2022-03-03 Addressing the Shape-Radiance Ambiguity in View-Dependent Radiance Fields Sverker Rasmuson, Erik Sintorn, Ulf Assarsson arXiv_CV arXiv_CV Reconstruction 3D Bert Pose Face PDF
2022-03-02 Discontinuous Constituency and BERT: A Case Study of Dutch Konstantinos Kogkalidis, Gijs Winholds arXiv_CL arXiv_CL Bert Attention PDF
2022-03-01 E-LANG: Energy-Based Joint Inferencing of Super and Swift Language Models Mohammad Akbari, Amin Banitalebi-Dehkordi, Yong Zhang arXiv_CL arXiv_CL Bert Pose Classification Inference Language_Model PDF
2022-03-01 Towards a Common Speech Analysis Engine Hagai Aronowitz, Itai Gat, Edmilson Morais, Weizhong Zhu, Ron Hoory arXiv_CL arXiv_CL Recognition Bert Represenation_Learning Speech Self-Supervised Pose Emotion PDF
2022-03-01 BERT-LID: Leveraging BERT to Improve Spoken Language Identification Yuting Nie, Junhong Zhao, Wei-Qiang Zhang, Jinfeng Bai, Zhongqin Wu arXiv_CL arXiv_CL Bert RNN Speech Pose PDF
2022-03-01 'Is Whole Word Masking Always Better for Chinese BERT?': Probing on Chinese Grammatical Error Correction Yong Dai, Linyang Li, Cong Zhou, Zhangyin Feng, Enbo Zhao, Xipeng Qiu, Piji Li, Duyu Tang arXiv_CL arXiv_CL Bert Language_Model PDF
2022-02-28 The impact of lexical and grammatical processing on generating code from natural language Nathanaël Beau, Benoît Crabbé arXiv_CL arXiv_CL Bert PDF
2022-02-28 RestainNet: a self-supervised digital re-stainer for stain normalization Bingchao Zhao, Jiatai Lin, Changhong Liang, Zongjian Yi, Xin Chen, Bingbing Li, Weihao Qiu, Danyi Li, Li Liang, Chu Han, Zaiyi Liu arXiv_CV arXiv_CV Segmentation Bert Self-Supervised Pose Classification PDF
2022-02-28 Detecting Stance in Scientific Papers: Did we get more Negative Recently? Dominik Beese, Begüm Altunbaş, Görkem Güzeler, Steffen Eger arXiv_CL arXiv_CL Bert PDF
2022-02-27 Enhancing Legal Argument Mining with Domain Pre-training and Neural Networks Gechuan Zhang, Paul Nulty, David Lillis arXiv_CL arXiv_CL Transformer Embedding Bert Knowledge Relation PDF
2022-02-26 Multi-Level Contrastive Learning for Cross-Lingual Alignment Beiduo Chen, Wu Guo, Bin Gu, Quan Liu, Yongchao Wang arXiv_CL arXiv_CL Embedding Bert Zero-Shot Pose Contrastive_Learning PDF
2022-02-26 Bi-directional Joint Neural Networks for Intent Classification and Slot Filling Soyeon Caren Han, Siqu Long, Huichun Li, Henry Weld, Josiah Poon arXiv_CL arXiv_CL Enhancement Bert Pose Classification Relation PDF
2022-02-26 Generalized Label Shift Correction via Minimum Uncertainty Principle: Theory and Algorithm You-Wei Luo, Chuan-Xian Ren arXiv_CV arXiv_CV Bert Optimization Knowledge Pose PDF
2022-02-25 Exploring Multi-Modal Representations for Ambiguity Detection & Coreference Resolution in the SIMMC 2.0 Challenge Francisco Javier Chiyah-Garcia, Alessandro Suglia, José Lopes, Arash Eshghi, Helen Hastie arXiv_AI arXiv_AI Bert Detection Relation Language_Model PDF
2022-02-25 APEACH: Attacking Pejorative Expressions with Analysis on Crowd-Generated Hate Speech Evaluation Datasets Kichang Yang, Wonjun Jang, Won Ik Cho arXiv_CL arXiv_CL Bert Speech Pose Detection Language_Model PDF
2022-02-24 TrimBERT: Tailoring BERT for Trade-offs Sharath Nittur Sridhar, Anthony Sarah, Sairam Sundaresan arXiv_CL arXiv_CL Bert Attention PDF
2022-02-24 Probing BERT's priors with serial reproduction chains Takateru Yamakoshi, Robert D. Hawkins, Thomas L. Griffiths arXiv_CL arXiv_CL Bert Language_Model PDF
2022-02-24 Ask2Mask: Guided Data Selection for Masked Speech Modeling Murali Karthick Baskar, Andrew Rosenberg, Bhuvana Ramabhadran, Yu Zhang, Pedro Moreno arXiv_CL arXiv_CL Unsupervised Recognition Bert Speech Pose Speech_Recognition Matching PDF
2022-02-24 BERTVision -- A Parameter-Efficient Approach for Question Answering Siduo Jiang, Cristopher Benge, William Casey King arXiv_CL arXiv_CL Transformer Bert Action Classification Inference Prediction QA PDF
2022-02-24 Pretraining without Wordpieces: Learning Over a Vocabulary of Millions of Words Zhangyin Feng, Duyu Tang, Cong Zhou, Junwei Liao, Shuangzhi Wu, Xiaocheng Feng, Bing Qin, Yunbo Cao, Shuming Shi arXiv_CL arXiv_CL Bert Inference PDF
2022-02-24 Using calibrator to improve robustness in Machine Reading Comprehension Jing Jin, Houfeng Wang arXiv_CL arXiv_CL Bert Represenation_Learning Adversarial Pose PDF
2022-02-24 Sky Computing: Accelerating Geo-distributed Computing in Federated Learning Jie Zhu, Shenggui Li, Yang You arXiv_AI arXiv_AI Bert Pose Deep_Learning PDF
2022-02-23 Knowledge Augmented BERT Mutual Network in Multi-turn Spoken Dialogues Ting-Wei Wu, Biing-Hwang Juang arXiv_CL arXiv_CL Bert Knowledge Pose Attention PDF
2022-02-22 Learning Cluster Patterns for Abstractive Summarization Sung-Guk Jo, Jeong-Jae Kim, Byung-Won On arXiv_CL arXiv_CL Transformer Bert Salient Pose Summarization PDF
2022-02-22 Improving CTC-based speech recognition via knowledge transferring from pre-trained language models Keqi Deng, Songjun Cao, Yike Zhang, Long Ma, Gaofeng Cheng, Ji Xu, Pengyuan Zhang arXiv_CL arXiv_CL Recognition Bert Represenation_Learning Knowledge Speech Pose Classification Attention Speech_Recognition Language_Model PDF
2022-02-22 VU-BERT: A Unified framework for Visual Dialog Tong Ye, Shijing Si, Jianzong Wang, Rui Wang, Ning Cheng, Jing Xiao arXiv_CV arXiv_CV Embedding Bert Pose Action Relation Language_Model PDF
2022-02-21 Items from Psychometric Tests as Training Data for Personality Profiling Models of Twitter Users Anne Kreuter, Kai Sassenberg, Roman Klinger arXiv_CL arXiv_CL Bert PDF
2022-02-21 Rethinking the Zigzag Flattening for Image Reading Qingsong Zhao, Zhipeng Zhou, Shuguang Dou, Yangguang Li, Rui Lu, Yin Wang, Cairong Zhao arXiv_CV arXiv_CV Transformer Bert PDF
2022-02-21 BERT WEAVER: Using WEight AVERaging to Enable Lifelong Learning for Transformer-based Models Lisa Langnickel, Alexander Schulz, Barbara Hammer, Juliane Fluck arXiv_CL arXiv_CL Transformer Embedding Transfer_Learning Bert Knowledge Medical PDF
2022-02-21 StyleBERT: Chinese pretraining by font style information Chao Lv, Han Zhang, XinKai Du, Yunhao Zhang, Ying Huang, Wenhao Li, Jia Han, Shanshan Gu arXiv_CL arXiv_CL Embedding Bert Pose Language_Model PDF
2022-02-20 $mathcal{Y}$-Tuning: An Efficient Tuning Paradigm for Large-Scale Pre-Trained Models via Label Representation Learning Yitao Liu, Chenxin An, Xipeng Qiu arXiv_CL arXiv_CL Bert Represenation_Learning Pose Attention PDF
2022-02-20 Contextual Semantic Embeddings for Ontology Subsumption Prediction Jiaoyan Chen, Yuan He, Ernesto Jimenez-Ruiz, Hang Dong, Ian Horrocks arXiv_AI arXiv_AI Embedding Bert Knowledge Ontology Language_Model Prediction PDF
2022-02-19 Do Transformers use variable binding? Tommi Gröndahl, N. Asokan arXiv_AI arXiv_AI Transformer Bert Pose Classification Matching PDF
2022-02-19 Priming Cross-Session Motor Imagery Classification with A Universal Deep Domain Adaptation Framework Zhengqing Miao, Xin Zhang, Carlo Menon, Yelong Zheng, Meirong Zhao, Dong Ming arXiv_AI arXiv_AI Embedding Bert Pose Face Classification CNN PDF
2022-02-18 From FreEM to D'AlemBERT: a Large Corpus and a Language Model for Early Modern French Simon Gabay, Pedro Ortiz Suarez, Alexandre Bartz, Alix Chagué, Rachel Bawden, Philippe Gambette, Benoît Sagot arXiv_CL arXiv_CL Transfer_Learning Bert Speech Language_Model PDF
2022-02-18 Deep-Learning Architectures for Multi-Pitch Estimation: Towards Reliable Evaluation Christof Weiß, Geoffroy Peeters arXiv_SD arXiv_SD Bert Pose Attention Activity Prediction PDF
2022-02-18 Evaluating the Construct Validity of Text Embeddings with Application to Survey Questions Qixiang Fang, Dong Nguyen, Daniel L Oberski arXiv_CL arXiv_CL Embedding Bert Pose Survey PDF
2022-02-18 AMS_ADRN at SemEval-2022 Task 5: A Suitable Image-text Multimodal Joint Modeling Method for Multi-task Misogyny Identification Da Li, Ming Yi, Yukai He arXiv_CL arXiv_CL Image_Caption Transformer Embedding Bert PDF
2022-02-17 SGPT: GPT Sentence Embeddings for Semantic Search Niklas Muennighoff arXiv_CL arXiv_CL Transformer Embedding Unsupervised Bert Pose Language_Model PDF
2022-02-17 Mining On Alzheimer's Diseases Related Knowledge Graph to Identity Potential AD-related Semantic Triples for Drug Repurposing Yi Nian, Xinyue Hu, Rui Zhang, Jingna Feng, Jingcheng Du, Fang Li, Yong Chen, Cui Tao arXiv_AI arXiv_AI Bert Knowledge Knowledge_Graph Relation Medical Prediction PDF
2022-02-17 When BERT Meets Quantum Temporal Convolution Learning for Text Classification in Heterogeneous Computing Chao-Han Huck Yang, Jun Qi, Samuel Yen-Chi Chen, Yu Tsao, Pin-Yu Chen arXiv_CL arXiv_CL Bert Text_Classification Pose Face Classification Language_Model PDF
2022-02-16 FAMIE: A Fast Active Learning Framework for Multilingual Information Extraction Minh Van Nguyen, Nghia Trung Ngo, Bonan Min, Thien Huu Nguyen arXiv_CL arXiv_CL Bert Knowledge Action PDF
2022-02-16 GraphNLI: A Graph-based Natural Language Inference Model for Polarity Prediction in Online Debates Vibhor Agarwal, Sagar Joglekar, Anthony P. Young, Nishanth Sastry arXiv_CL arXiv_CL Embedding Bert Pose Deep_Learning Relation Inference Prediction PDF
2022-02-16 Should You Mask 15% in Masked Language Modeling? Alexander Wettig, Tianyu Gao, Zexuan Zhong, Danqi Chen arXiv_CL arXiv_CL Bert Language_Model Prediction PDF
2022-02-16 Probing Pretrained Models of Source Code Sergey Troshin, Nadezhda Chirkova arXiv_CL arXiv_CL Bert Deep_Learning Summarization PDF
2022-02-16 Multimodal Emotion Recognition using Transfer Learning from Speaker Recognition and BERT-based models Sarala Padi, Seyed Omid Sadjadi, Dinesh Manocha, Ram D. Sriram arXiv_SD arXiv_SD Transformer Transfer_Learning Recognition Bert Speech Pose Emotion Action PDF
2022-02-15 Tomayto, Tomahto. Beyond Token-level Answer Equivalence for Question Answering Evaluation Jannis Bulian, Christian Buck, Wojciech Gajewski, Benjamin Boerschinger, Tal Schuster arXiv_CL arXiv_CL Bert Prediction QA Matching PDF
2022-02-15 BLUE at Memotion 2.0 2022: You have my Image, my Text and my Transformer Ana-Maria Bucur, Adrian Cosma, Ioan-Bogdan Iordache arXiv_CL arXiv_CL Transformer Bert Emotion Classification Sentiment Caption PDF
2022-02-15 Toxic Comments Hunter : Score Severity of Toxic Comments Zhichang Wang, Qipeng Zhu arXiv_CL arXiv_CL Bert Action Detection PDF
2022-02-14 Matching Tweets With Applicable Fact-Checks Across Languages Ashkan Kazemi, Zehua Li, Verónica Pérez-Rosas, Scott A. Hale, Rada Mihalcea arXiv_CL arXiv_CL Transformer Embedding Bert Classification Matching PDF
2022-02-14 What Do They Capture? -- A Structural Analysis of Pre-Trained Language Models for Source Code Yao Wan, Wei Zhao, Hongyu Zhang, Yulei Sui, Guandong Xu, Hai Jin arXiv_AI arXiv_AI Transformer Embedding Bert Pose Relation Attention Summarization Language_Model PDF
2022-02-14 Punctuation restoration in Swedish through fine-tuned KB-BERT John Björkman Nilsson arXiv_AI arXiv_AI Bert Restoration Speech Pose Language_Model PDF
2022-02-14 UserBERT: Modeling Long- and Short-Term User Preferences via Self-Supervision Tianyu Li, Ali Cevahir, Derek Cho, Hao Gong, DuyKhuong Nguyen, Bjorn Stenger arXiv_AI arXiv_AI Bert Represenation_Learning Self-Supervised Pose Action PDF
2022-02-14 Modeling Intention, Emotion and External World in Dialogue Systems Wei Peng, Yue Hu, Luxi Xing, Yuqiang Xie, Xingsheng Zhang, Yajing Sun arXiv_AI arXiv_AI Bert Pose Emotion Action Relation PDF
2022-02-13 Assessment of contextualised representations in detecting outcome phrases in clinical trials Micheal Abaho, Danushka Bollegala, Paula R Williamson, Susanna Dodd arXiv_CL arXiv_CL Embedding Recognition Bert Knowledge Speech Classification Detection PDF
2022-02-13 ET-BERT: A Contextualized Datagram Representation with Pre-training Transformers for Encrypted Traffic Classification Xinjie Lin, Gang Xiong, Gaopeng Gou, Zhen Li, Junzheng Shi, Jing Yu arXiv_AI arXiv_AI Transformer Bert Pose Classification PDF
2022-02-12 Indication as Prior Knowledge for Multimodal Disease Classification in Chest Radiographs with Transformers Grzegorz Jacenków, Alison Q. O'Neil, Sotirios A. Tsaftaris arXiv_CV arXiv_CV Transformer Bert Knowledge Classification Image_Classification PDF
2022-02-12 Games of Artificial Intelligence: A Continuous-Time Approach Martino Banchio, Giacomo Mantegazza arXiv_AI arXiv_AI Bert Action Quantitative PDF
2022-02-11 White-Box Attacks on Hate-speech BERT Classifiers in German with Explicit and Implicit Character Level Defense Shahrukh Khan, Mahnoor Shahid, Navdeeppal Singh arXiv_CL arXiv_CL Bert Adversarial Speech PDF
2022-02-10 Slovene SuperGLUE Benchmark: Translation and Evaluation Aleš Žagar, Marko Robnik-Šikonja arXiv_CL arXiv_CL Bert PDF
2022-02-10 Consistency and Diversity induced Human Motion Segmentation Tao Zhou, Huazhu Fu, Chen Gong, Ling Shao, Fatih Porikli, Haibin Ling, Jianbing Shen arXiv_CV arXiv_CV Segmentation Transfer_Learning Bert Knowledge Pose Relation PDF
2022-02-09 Generating Training Data with Language Models: Towards Zero-Shot Language Understanding Yu Meng, Jiaxin Huang, Yu Zhang, Jiawei Han arXiv_CL arXiv_CL Bert Zero-Shot Regularization Classification Few-Shot Text_Generation Language_Model PDF
2022-02-09 Merit-based Fusion of NLP Techniques for Instant Feedback on Water Quality from Twitter Text Khubaib Ahmad, Muhammad Asif Ayub, Kashif Ahmad, Jebran Khan, Nasir Ahmad, Ala Al-Fuqaha arXiv_CL arXiv_CL Transformer Bert Optimization RNN Pose Classification Attention PDF
2022-02-09 pNLP-Mixer: an Efficient all-MLP Architecture for Language Francesco Fusco, Damian Pascual, Peter Staar arXiv_CL arXiv_CL Bert RNN Action Classification Inference Language_Model PDF
2022-02-09 Can Open Domain Question Answering Systems Answer Visual Knowledge Questions? Jiawen Zhang, Abhijit Mishra, Avinesh P.V.S, Siddharth Patwardhan, Sachin Agarwal arXiv_CL arXiv_CL Unsupervised Reinforcement_Learning Bert Weakly_Supervised Knowledge Pose VQA QA PDF
2022-02-09 Stein Particle Filter for Nonlinear, Non-Gaussian State Estimation Fahira Afzal Maken, Fabio Ramos, Lionel Ott arXiv_RO arXiv_RO Bert Inference Prediction PDF
2022-02-08 Data-Driven Chance Constrained Control using Kernel Distribution Embeddings Adam J. Thorpe, Thomas Lew, Meeko M. K. Oishi, Marco Pavone arXiv_RO arXiv_RO Embedding Bert Optimization Pose PDF
2022-02-08 Logical Reasoning for Task Oriented Dialogue Systems Sajjad Beygi, Maryam Fazel-Zarandi, Alessandra Cervone, Prakash Krishnan, Siddhartha Reddy Jonnalagadda arXiv_CL arXiv_CL Transformer Bert Knowledge Pose Relation QA PDF
2022-02-08 What are the best systems? New perspectives on NLP Benchmarking Pierre Colombo, Nathan Noiry, Ekhine Irurozki, Stephan Clemencon arXiv_CL arXiv_CL Bert Pose PDF
2022-02-08 How to Understand Masked Autoencoders Shuhao Cao, Peng Xu, David A. Clifton arXiv_CV arXiv_CV Bert Knowledge Self-Supervised Pose Attention PDF
2022-02-08 Causal Scene BERT: Improving object detection by searching for challenging groups of data Cinjon Resnick, Or Litany, Amlan Kar, Karsten Kreis, James Lucas, Kyunghyun Cho, Sanja Fidler arXiv_CV arXiv_CV Bert Detection Object_Detection Autonomous Language_Model PDF
2022-02-08 HistBERT: A Pre-trained Language Model for Diachronic Lexical Semantic Analysis Wenjun Qiu, Yang Xu arXiv_CL arXiv_CL Embedding Bert Language_Model PDF
2022-02-08 Do Language Models Learn Position-Role Mappings? Jackson Petty, Michael Wilson, Robert Frank arXiv_CL arXiv_CL Bert Knowledge Language_Model Prediction PDF
2022-02-07 Universal Spam Detection using Transfer Learning of BERT Model Vijay Srinivas Tida, Sonya Hsu arXiv_CL arXiv_CL Transformer Transfer_Learning Bert Classification Deep_Learning Detection Attention PDF
2022-02-07 Fine-Tuning Approach for Arabic Offensive Language Detection System: BERT-Based Model Fatemah Husain, Ozlem Uzuner arXiv_CL arXiv_CL Transfer_Learning Bert Knowledge Detection PDF
2022-02-07 Efficient Adapter Transfer of Self-Supervised Speech Models for Automatic Speech Recognition Bethan Thomas, Samuel Kessler, Salah Karout arXiv_SD arXiv_SD Transformer Recognition Bert Speech Self-Supervised Pose Speech_Recognition PDF
2022-02-07 Unifying Architectures, Tasks, and Modalities Through a Simple Sequence-to-Sequence Learning Framework Peng Wang, An Yang, Rui Men, Junyang Lin, Shuai Bai, Zhikang Li, Jianxin Ma, Chang Zhou, Jingren Zhou, Hongxia Yang arXiv_CV arXiv_CV Image_Caption Bert Pose Classification VQA Text_Generation Caption Image_Classification QA PDF
2022-02-05 Classification on Sentence Embeddings for Legal Assistance Arka Mitra arXiv_CL arXiv_CL Embedding Bert Classification Prediction PDF
2022-02-04 Transformers and the representation of biomedical background knowledge Oskar Wysocki (1,2), Zili Zhou (1,2), Paul O'Regan (2), Deborah Ferreira (1), Magdalena Wysocka (2), Dónal Landers (2), André Freitas (1,2,3) ((1) Department of Computer Science, The University of Manchester, (2) digital Experimental Cancer Medicine Team, Cancer Biomarker Centre, CRUK Manchester Institute, University of Manchester, (3) Idiap Research Institute) arXiv_AI arXiv_AI Transformer Embedding Bert Knowledge Medical Inference PDF
2022-02-04 StonkBERT: Can Language Models Predict Medium-Run Stock Price Movements? Stefan Pasch, Daniel Ehnes arXiv_AI arXiv_AI Transformer Bert Classification Language_Model PDF
2022-02-04 Temporal Attention for Language Models Guy D. Rosin, Kira Radinsky arXiv_CL arXiv_CL Transformer Bert Pose Detection Attention Language_Model PDF
2022-02-03 Self-supervised Learning with Random-projection Quantizer for Speech Recognition Chung-Cheng Chiu, James Qin, Yu Zhang, Jiahui Yu, Yonghui Wu arXiv_SD arXiv_SD Recognition Bert Speech Self-Supervised Speech_Recognition PDF
2022-02-03 A Robust Phased Elimination Algorithm for Corruption-Tolerant Gaussian Process Bandits Ilija Bogunovic, Zihan Li, Andreas Krause, Jonathan Scarlett arXiv_AI arXiv_AI Bert Optimization Adversarial Pose Action PDF
2022-02-03 mSLAM: Massively multilingual joint pre-training for speech and text Ankur Bapna, Colin Cherry, Yu Zhang, Ye Jia, Melvin Johnson, Yong Cheng, Simran Khanuja, Jason Riesa, Alexis Conneau arXiv_CL arXiv_CL Bert Zero-Shot Speech SLAM Classification Language_Model PDF
2022-02-02 ASR-Aware End-to-end Neural Diarization Aparna Khare, Eunjung Han, Yuguang Yang, Andreas Stolcke arXiv_SD arXiv_SD Recognition Bert Speech Pose Classification Detection Attention Speech_Recognition PDF
2022-02-02 L3Cube-MahaCorpus and MahaBERT: Marathi Monolingual Corpus, Marathi BERT Language Models, and Resources Raviraj Joshi arXiv_CL arXiv_CL Embedding Bert Classification Language_Model PDF
2022-02-02 RescoreBERT: Discriminative Speech Recognition Rescoring with BERT Liyan Xu, Yile Gu, Jari Kolehmainen, Haidar Khan, Ankur Gandhe, Ariya Rastrow, Andreas Stolcke, Ivan Bulyko arXiv_SD arXiv_SD Recognition Bert RNN Knowledge Speech Pose Action Speech_Recognition Language_Model PDF
2022-02-01 A Semi-Supervised Deep Clustering Pipeline for Mining Intentions From Texts Xinyu Chen, Ian Beaver arXiv_CL arXiv_CL Unsupervised Bert Face Detection GAN Language_Model PDF
2022-02-01 A Flexible Clustering Pipeline for Mining Text Intentions Xinyu Chen, Ian Beaver arXiv_CL arXiv_CL Bert Face Detection GAN Language_Model PDF
2022-02-01 Meta-Learning Hypothesis Spaces for Sequential Decision-making Parnian Kassraie, Jonas Rothfuss, Andreas Krause arXiv_AI arXiv_AI Reinforcement_Learning Bert Optimization Pose Prediction PDF
2022-01-31 Learning affective meanings that derives the social behavior using Bidirectional Encoder Representations from Transformers Moeen Mostafavi, Michael D. Porter, Dawn T. Robinson arXiv_CL arXiv_CL Transformer Bert Survey Action Sentiment PDF
2022-01-31 Memory-Efficient Backpropagation through Large Linear Layers Daniel Bershatsky, Aleksandr Mikhalev, Alexandr Katrutsa, Julia Gusak, Daniil Merkulov, Ivan Oseledets arXiv_AI arXiv_AI Transformer Bert Pose PDF
2022-01-31 Disaster Tweets Classification using BERT-Based Language Model Anh Duc Le arXiv_AI arXiv_AI Bert Knowledge Classification GAN Language_Model PDF
2022-01-29 Does Transliteration Help Multilingual Language Modeling? Ibraheem Muhammad Moosa, Mahmud Elahi Akhter, Ashfia Binte Habib arXiv_CL arXiv_CL Bert Face Language_Model PDF
2022-01-29 ScaLA: Accelerating Adaptation of Pre-Trained Transformer-Based Language Models via Efficient Large-Batch Adversarial Noise Minjia Zhang, Niranjan Uma Naresh, Yuxiong He arXiv_CL arXiv_CL Transformer Bert Optimization Adversarial Pose Language_Model PDF
2022-01-28 Protum: A New Method For Prompt Tuning Based on 'MASK' Pan He, Yuxi Chen, Yan Wang, Yanru Zhang arXiv_CL arXiv_CL Bert Pose Classification Language_Model Prediction PDF
2022-01-28 The CARE Dataset for Affective Response Detection Jane A. Yu, Alon Y. Halevy arXiv_CL arXiv_CL Recognition Bert Emotion Detection PDF
2022-01-27 Clinical-Longformer and Clinical-BigBird: Transformers for long clinical sequences Yikuan Li, Ramsey M. Wehbe, Faraz S. Ahmad, Hanyin Wang, Yuan Luo arXiv_CL arXiv_CL Transformer Recognition Bert Sparse Knowledge Pose Classification Attention Inference Language_Model PDF
2022-01-27 Going Extreme: Comparative Analysis of Hate Speech in Parler and Gab Abraham Israeli, Oren Tsur arXiv_CL arXiv_CL Transfer_Learning Bert Knowledge Speech Emotion Face Quantitative Classification Detection Sentiment PDF
2022-01-27 Grad2Task: Improved Few-shot Text Classification Using Gradients for Task Representation Jixuan Wang, Kuan-Chieh Wang, Frank Rudzicz, Michael Brudno arXiv_AI arXiv_AI Transfer_Learning Bert Text_Classification Pose Classification Relation Few-Shot Language_Model PDF
2022-01-26 DiscoScore: Evaluating Text Generation with BERT and Discourse Coherence Wei Zhao, Michael Strube, Steffen Eger arXiv_CL arXiv_CL Bert Relation Summarization Text_Generation PDF
2022-01-26 Cybertrust: From Explainable to Actionable and Interpretable AI Stephanie Galaitsi, Benjamin D. Trump, Jeffrey M. Keisler, Igor Linkov, Alexander Kott arXiv_AI arXiv_AI Bert Action Prediction Recommendation PDF
2022-01-26 Discriminative Supervised Subspace Learning for Cross-modal Retrieval Haoming Zhang, Xiao-Jun Wu, Tianyang Xu, Donglin Zhang arXiv_AI arXiv_AI Bert Pose Attention PDF
2022-01-26 FiNCAT: Financial Numeral Claim Analysis Tool Sohom Ghosh, Sudip Kumar Naskar arXiv_CL arXiv_CL Transformer Embedding Bert Language_Model PDF
2022-01-26 Self-supervised 3D Semantic Representation Learning for Vision-and-Language Navigation Sinan Tan, Mengmeng Ge, Di Guo, Huaping Liu, Fuchun Sun arXiv_CV arXiv_CV Transformer Reconstruction 3D Bert Represenation_Learning RNN Self-Supervised Pose Attention PDF
2022-01-26 Neural Grapheme-to-Phoneme Conversion with Pre-trained Grapheme Models Lu Dong, Zhi-Qiang Guo, Chao-Hong Tan, Ya-Jun Hu, Yuan Jiang, Zhen-Hua Ling arXiv_CL arXiv_CL Transformer Bert Self-Supervised Pose Attention Language_Model PDF
2022-01-25 BERTHA: Video Captioning Evaluation Via Transfer-Learned Human Assessment Luis Lebron, Yvette Graham, Kevin McGuinness, Konstantinos Kouramas, Noel E. O'Connor arXiv_CV arXiv_CV Video_Caption Bert Action Deep_Learning Caption Language_Model PDF
2022-01-25 Improving non-autoregressive end-to-end speech recognition with pre-trained acoustic and language models Keqi Deng, Zehui Yang, Shinji Watanabe, Yosuke Higuchi, Gaofeng Cheng, Pengyuan Zhang arXiv_SD arXiv_SD Transformer Recognition Bert Speech Pose Attention Speech_Recognition Inference Language_Model PDF
2022-01-24 Unified Multimodal Punctuation Restoration Framework for Mixed-Modality Corpus Yaoming Zhu, Liwei Wu, Shanbo Cheng, Mingxuan Wang arXiv_AI arXiv_AI Recognition Bert Restoration Speech Pose Speech_Recognition PDF
2022-01-24 Emotion-based Modeling of Mental Disorders on Social Media Xiaobo Guo, Yaojia Sun, Soroush Vosoughi arXiv_CL arXiv_CL Embedding Bert Pose Emotion Detection GAN Language_Model PDF
2022-01-24 Polyphone disambiguation and accent prediction using pre-trained language models in Japanese TTS front-end Rem Hida, Masaki Hamada, Chie Kamada, Emiru Tsunoo, Toshiyuki Sekiya, Toshiyuki Kumakura arXiv_SD arXiv_SD Embedding Bert Speech Pose Language_Model Prediction PDF
2022-01-24 Improving Chest X-Ray Report Generation by Leveraging Warm-Starting Aaron Nicolson, Jason Dowling, Bevan Koopman arXiv_CV arXiv_CV Transformer Bert CNN PDF
2022-01-23 An Application of Pseudo-Log-Likelihoods to Natural Language Scoring Darren Abramson, Ali Emami arXiv_AI arXiv_AI Recognition Bert Zero-Shot Adversarial Language_Model PDF
2022-01-23 A Large and Diverse Arabic Corpus for Language Modeling Abbas Raza Ali arXiv_AI arXiv_AI Bert Knowledge Language_Model PDF
2022-01-22 Collaborative Representation for SPD Matrices with Application to Image-Set Classification Li Chu, Rui Wang, Xiao-Jun Wu arXiv_CV arXiv_CV Recognition Bert Classification PDF
2022-01-21 Recurrent Neural Networks with Mixed Hierarchical Structures and EM Algorithm for Natural Language Processing Zhaoxin Luo, Michael Zhu arXiv_CL arXiv_CL Transformer Bert RNN Pose Action Classification Attention PDF
2022-01-21 Less is Less: When Are Snippets Insufficient for Human vs Machine Relevance Estimation? Gabriella Kazai, Bhaskar Mitra, Anlei Dong, Nick Craswell, Linjun Yang arXiv_AI