Bert

Bert

• 2021-07-27 A Physiologically-adapted Gold Standard for Arousal During a Stress Induced Scenario    Alice Baird, Lukas Stappen, Lukas Christ, Lea Schumann, Eva-Maria Meßner, Björn W. Schuller arXiv_CV arXiv_CV  Bert  Emotion  Relation  Activity  PDF
• 2021-07-27 gaBERT -- an Irish Language Model    James Barry, Joachim Wagner, Lauren Cassidy, Alan Cowap, Teresa Lynn, Abigail Walsh, Mícheál J. Ó Meachair, Jennifer Foster arXiv_CL arXiv_CL  Bert  Language_Model  PDF
• 2021-07-27 Emotion Stimulus Detection in German News Headlines    {Bao Minh} {Doan Dang}, Laura Oberländer, Roman Klinger arXiv_CL arXiv_CL  Bert  Emotion  Action  Detection  PDF
• 2021-07-27 Unsupervised Domain Adaptation for Hate Speech Detection Using a Data Augmentation Approach    Sheikh Muhammad Sarwar, Vanessa Murdock arXiv_CL arXiv_CL  Unsupervised  Bert  RNN  Speech  Pose  Detection  PDF
• 2021-07-26 ContextNet: A Click-Through Rate Prediction Framework Using Contextual information to Refine Feature Embedding    Zhiqiang Wang, Qingyun She, PengTao Zhang, Junlin Zhang arXiv_AI arXiv_AI  Embedding  Bert  Pose  Action  Prediction  Recommendation  PDF
• 2021-07-24 Context-aware Adversarial Training for Name Regularity Bias in Named Entity Recognition    Abbas Ghaddar, Philippe Langlais, Ahmad Rashid, Mehdi Rezagholizadeh arXiv_CL arXiv_CL  Recognition  Bert  RNN  Adversarial  Pose  PDF
• 2021-07-23 Improving Early Sepsis Prediction with Multi Modal Learning    Fred Qin, Vivek Madan, Ujjwal Ratan, Zohar Karnin, Vishaal Kapoor, Parminder Bhatia, Taha Kass-Hout arXiv_CL arXiv_CL  Multi_Modal  Bert  Pose  Detection  Medical  Prediction  PDF
• 2021-07-22 Semantic Text-to-Face GAN -ST^2FG    Manan Oza, Sukalpa Chanda, David Doermann arXiv_CV arXiv_CV  Embedding  Image_Generation  Bert  Sketch  Adversarial  Pose  Face  Attention  GAN  PDF
• 2021-07-22 Evaluation of contextual embeddings on less-resourced languages    Matej Ulčar, Aleš Žagar, Carlos S. Armendariz, Andraž Repar, Senja Pollak, Matthew Purver, Marko Robnik-Šikonja arXiv_CL arXiv_CL  Embedding  Bert  PDF
• 2021-07-22 Fristograms: Revealing and Exploiting Light Field Internals    Thorsten Herfet, Kelvin Chelli, Tobias Lange, Robin Kremer arXiv_CV arXiv_CV  Reconstruction  Segmentation  Recognition  3D  Bert  Salient  Pose  Detection  Relation  Object_Detection  PDF
• 2021-07-21 Improved Text Classification via Contrastive Adversarial Training    Lin Pan, Chung-Wei Hang, Avirup Sil, Saloni Potdar, Mo Yu arXiv_CL arXiv_CL  Transformer  Embedding  Bert  Text_Classification  Adversarial  Pose  Contrastive_Learning  Classification  PDF
• 2021-07-21 Digital Einstein Experience: Fast Text-to-Speech for Conversational AI    Joanna Rownicka, Kilian Sprenkamp, Antonio Tripiana, Volodymyr Gromoglasov, Timo P Kunz arXiv_AI arXiv_AI  Bert  Speech  Pose  Action  GAN  Prediction  PDF
• 2021-07-21 MarsExplorer: Exploration of Unknown Terrains via Deep Reinforcement Learning and Procedurally Generated Environments    Dimitrios I. Koutras, Athanasios Ch. Kapoutsis, Angelos A. Amanatiadis, Elias B. Kosmatopoulos arXiv_AI arXiv_AI  Reinforcement_Learning  Bert  PDF
• 2021-07-21 DRDF: Determining the Importance of Different Multimodal Information with Dual-Router Dynamic Framework    Haiwen Hong, Xuan Jin, Yin Zhang, Yunqing Hu, Jingfeng Zhang, Yuan He, Hui Xue arXiv_CV arXiv_CV  Bert  Pose  PDF
• 2021-07-21 CausalBERT: Injecting Causal Knowledge Into Pre-trained Models with Minimal Supervision    Zhongyang Li, Xiao Ding, Kuo Liao, Ting Liu, Bing Qin arXiv_CL arXiv_CL  Embedding  Bert  Regularization  Knowledge  Pose  Classification  Inference  QA  PDF
• 2021-07-20 Sequence Model with Self-Adaptive Sliding Window for Efficient Spoken Document Segmentation    Qinglin Zhang, Qian Chen, Yali Li, Jiaqing Liu, Wen Wang arXiv_CL arXiv_CL  Segmentation  Recognition  Bert  Speech  Pose  Summarization  Speech_Recognition  Inference  PDF
• 2021-07-19 Cross-Lingual BERT Contextual Embedding Space Mapping with Isotropic and Isometric Conditions    Haoran Xu, Philipp Koehn arXiv_CL arXiv_CL  Embedding  Bert  Relation  PDF
• 2021-07-19 Unsupervised Identification of Relevant Prior Cases    Shivangi Bithel, Sumitra S Malagi arXiv_CL arXiv_CL  Embedding  Unsupervised  Bert  Knowledge  Pose  Language_Model  PDF
• 2021-07-19 Clinical Relation Extraction Using Transformer-based Models    Xi Yang, Zehao Yu, Yi Guo, Jiang Bian, Yonghui Wu arXiv_CL arXiv_CL  Transformer  Bert  Action  Classification  Relation  Relation_Extraction  Medical  PDF
• 2021-07-19 Stock Movement Prediction with Financial News using Contextualized Embedding from BERT    Qinkai Chen arXiv_CL arXiv_CL  Transformer  Embedding  Bert  RNN  Prediction  PDF
• 2021-07-18 Stock price prediction using BERT and GAN    Priyank Sonkiya, Vikas Bajpai, Anukriti Bansal arXiv_CL arXiv_CL  Transformer  Bert  RNN  Adversarial  Pose  Emotion  Deep_Learning  Sentiment  GAN  Prediction  PDF
• 2021-07-16 The Law of Large Documents: Understanding the Structure of Legal Contracts Using Visual Cues    Allison Hegel, Marina Shah, Genevieve Peaslee, Brendan Roof, Emad Elwany arXiv_CL arXiv_CL  Transformer  Segmentation  Bert  Action  Classification  PDF
• 2021-07-16 Are Multilingual Models the Best Choice for Moderately Under-resourced Languages? A Comprehensive Assessment for Catalan    Jordi Armengol-Estapé, Casimiro Pio Carrino, Carlos Rodriguez-Penagos, Ona de Gibert Bonet, Carme Armentano-Oller, Aitor Gonzalez-Agirre, Maite Melero, Marta Villegas arXiv_CL arXiv_CL  Transformer  Recognition  Bert  Text_Classification  Speech  Action  Classification  Language_Model  PDF
• 2021-07-15 Self-Supervised Contrastive Learning with Adversarial Perturbations for Robust Pretrained Language Models    Zhao Meng, Yihan Dong, Mrinmaya Sachan, Roger Wattenhofer arXiv_CL arXiv_CL  Bert  Adversarial  Self-Supervised  Contrastive_Learning  Language_Model  PDF
• 2021-07-15 AutoBERT-Zero: Evolving BERT Backbone from Scratch    Jiahui Gao, Hang Xu, Han shi, Xiaozhe Ren, Philip L.H. Yu, Xiaodan Liang, Xin Jiang, Zhenguo Li arXiv_CL arXiv_CL  Transformer  NAS  Bert  Pose  Attention  Language_Model  PDF
• 2021-07-15 Single-image Full-body Human Relighting    Manuel Lagunas, Xin Sun, Jimei Yang, Ruben Villegas, Jianming Zhang, Zhixin Shu, Belen Masia, Diego Gutierrez arXiv_CV arXiv_CV  Reconstruction  Bert  Pose  Deep_Learning  PDF
• 2021-07-15 Spanish Language Models    Asier Gutiérrez-Fandiño, Jordi Armengol-Estapé, Marc Pàmies, Joan Llop-Palao, Joaquín Silveira-Ocampo, Casimiro Pio Carrino, Aitor Gonzalez-Agirre, Carme Armentano-Oller, Carlos Rodriguez-Penagos, Marta Villegas arXiv_AI arXiv_AI  Bert  Language_Model  PDF
• 2021-07-15 Trusting RoBERTa over BERT: Insights from CheckListing the Natural Language Inference Task    Ishan Tarunesh, Somak Aditya, Monojit Choudhury arXiv_AI arXiv_AI  Bert  Inference  PDF
• 2021-07-15 Incorporating Lambertian Priors into Surface Normals Measurement    Yakun Ju, Muwei Jian, Shaoxiang Guo, Yingyu Wang, Huiyu Zhou, Junyu Dong arXiv_CV arXiv_CV  Reconstruction  3D  Bert  Pose  Face  PDF
• 2021-07-14 From Show to Tell: A Survey on Image Captioning    Matteo Stefanini, Marcella Cornia, Lorenzo Baraldi, Silvia Cascianelli, Giuseppe Fiameni, Rita Cucchiara arXiv_CV arXiv_CV  Image_Caption  Bert  Pose  Survey  Quantitative  Relation  Text_Generation  Caption  Language_Model  PDF
• 2021-07-14 BERT Fine-Tuning for Sentiment Analysis on Indonesian Mobile Apps Reviews    Kuncahyo Setyo Nugroho, Anantha Yullian Sukmadewa, Haftittah Wuswilahaken DW, Fitra Abdurrachman Bachtiar, Novanto Yudistira arXiv_CL arXiv_CL  Transfer_Learning  Bert  Review  Sentiment  PDF
• 2021-07-14 Indonesia's Fake News Detection using Transformer Network    Aisyah Awalina, Jibran Fawaid, Rifky Yunus Krisnabayu, Novanto Yudistira arXiv_CL arXiv_CL  Transformer  Bert  RNN  Face  Detection  PDF
• 2021-07-14 Large-Scale News Classification using BERT Language Model: Spark NLP Approach    Kuncahyo Setyo Nugroho, Kuncahyo Setyo Nugroho, Novanto Yudistira arXiv_CL arXiv_CL  Bert  Face  Classification  Deep_Learning  Language_Model  PDF
• 2021-07-13 TSCAN : Dialog Structure discovery using SCAN    Apurba Nath, Aayush Kubba arXiv_AI arXiv_AI  Unsupervised  Bert  Ontology  Classification  PDF
• 2021-07-13 Using BERT Encoding to Tackle the Mad-lib Attack in SMS Spam Detection    Sergio Rojas-Galeano arXiv_CL arXiv_CL  Bert  Adversarial  Classification  Detection  Relation  Language_Model  PDF
• 2021-07-13 What do writing features tell us about AI papers?    Zining Zhu, Bai Li, Yang Xu, Frank Rudzicz arXiv_CL arXiv_CL  Bert  Attention  Prediction  PDF
• 2021-07-13 Rating Facts under Coarse-to-fine Regimes    Guojun Wu arXiv_CL arXiv_CL  Bert  Pose  Classification  PDF
• 2021-07-13 Exploiting Network Structures to Improve Semantic Representation for the Financial Domain    Chao Feng, Shi-jie We arXiv_CL arXiv_CL  Transformer  Embedding  Bert  Knowledge  Knowledge_Graph  Pose  Inference  Language_Model  PDF
• 2021-07-12 Quantifying Explainability in NLP and Analyzing Algorithms for Performance-Explainability Tradeoff    Mitchell Naylor, Christi French, Samantha Terker, Uday Kamath arXiv_CL arXiv_CL  Bert  Text_Classification  Classification  Prediction  PDF
• 2021-07-12 CoBERL: Contrastive BERT for Reinforcement Learning    Andrea Banino, Adrià Puidomenech Badia, Jacob Walker, Tim Scholtes, Jovana Mitrovic, Charles Blundell arXiv_AI arXiv_AI  Transformer  Reinforcement_Learning  3D  Bert  RNN  Pose  Prediction  PDF
• 2021-07-12 A Flexible Multi-Task Model for BERT Serving    Tianwen Wei, Jianwei Qi, Shenghuan He arXiv_CL arXiv_CL  Bert  Knowledge  Pose  PDF
• 2021-07-12 MidiBERT-Piano: Large-scale Pre-training for Symbolic Music Understanding    Yi-Hui Chou, I-Chun Chen, Chin-Jui Chang, Joann Ching, Yi-Hsuan Yang arXiv_SD arXiv_SD  Transformer  Bert  Pose  Emotion  Action  Classification  Attention  Language_Model  Prediction  PDF
• 2021-07-12 Split, embed and merge: An accurate table structure recognizer    Zhenrong Zhang, Jianshu Zhang, Jun Du arXiv_CV arXiv_CV  Recognition  Bert  Pose  Attention  PDF
• 2021-07-12 Delta Sampling R-BERT for limited data and low-light action recognition    Sanchit Hira, Ritwik Das, Abhinav Modi, Daniil Pakhomov arXiv_CV arXiv_CV  Recognition  Bert  Pose  Action_Recognition  Action  Inference  PDF
• 2021-07-10 Noise Stability Regularization for Improving BERT Fine-tuning    Hang Hua, Xingjian Li, Dejing Dou, Cheng-Zhong Xu, Jiebo Luo arXiv_CL arXiv_CL  Bert  Regularization  Pose  Language_Model  PDF
• 2021-07-09 Benchmarking for Biomedical Natural Language Processing Tasks with a Domain Specific ALBERT    Usman Naseem, Adam G. Dunn, Matloob Khushi, Jinman Kim arXiv_CL arXiv_CL  Transformer  Recognition  Bert  Action  Classification  Relation  Relation_Extraction  Medical  Language_Model  PDF
• 2021-07-09 Learning Syntactic Dense Embedding with Correlation Graph for Automatic Readability Assessment    Xinying Qiu, Yuan Chen, Hanwu Chen, Jian-Yun Nie, Yuming Shen, Dawei Lu arXiv_CL arXiv_CL  Embedding  Bert  Pose  Deep_Learning  Relation  PDF
• 2021-07-07 Identifying Hijacked Reviews    Monika Daryani, James Caverlee arXiv_AI arXiv_AI  Bert  RNN  Review  Pose  PDF
• 2021-07-07 Can Transformer Models Measure Coherence In Text? Re-Thinking the Shuffle Test    Philippe Laban, Luke Dai, Lucas Bandarkar, Marti A. Hearst arXiv_CL arXiv_CL  Transformer  Bert  Zero-Shot  PDF
• 2021-07-07 LanguageRefer: Spatial-Language Model for 3D Visual Grounding    Junha Roh, Karthik Desingh, Ali Farhadi, Dieter Fox arXiv_CV arXiv_CV  Transformer  Embedding  Point_Cloud  3D  Bert  Pose  Language_Model  PDF
• 2021-07-06 Transfer Learning for Improving Results on Russian Sentiment Datasets    Anton Golubev, Natalia Loukachevitch arXiv_CL arXiv_CL  Transfer_Learning  Bert  Sentiment_Classification  Classification  Sentiment  Inference  PDF
• 2021-07-06 A Short Note on the Relationship of Information Gain and Eluder Dimension    Kaixuan Huang, Sham M. Kakade, Jason D. Lee, Qi Lei arXiv_AI arXiv_AI  Reinforcement_Learning  Bert  Pose  Relation  PDF
• 2021-07-06 Weighted Gaussian Process Bandits for Non-stationary Environments    Yuntian Deng, Xingyu Zhou, Baekjin Kim, Ambuj Tewari, Abhishek Gupta, Ness Shroff arXiv_AI arXiv_AI  Bert  Optimization  Pose  PDF
• 2021-07-05 Experiments with adversarial attacks on text genres    Mikhail Lepekhin, Serge Sharoff arXiv_CL arXiv_CL  Transformer  Embedding  Bert  Adversarial  Classification  Prediction  PDF
• 2021-07-05 A Knowledge-based Approach for Answering Complex Questions in Persian    Romina Etezadi, Mehrnoush Shamsfard arXiv_AI arXiv_AI  Bert  Knowledge  Knowledge_Graph  Pose  Inference  QA  PDF
• 2021-07-05 Contradiction Detection in Persian Text    Zeinab Rahimi, Mehrnoush ShamsFard arXiv_CL arXiv_CL  Transfer_Learning  Recognition  Bert  Deep_Learning  Detection  PDF
• 2021-07-05 The DCU-EPFL Enhanced Dependency Parser at the IWPT 2021 Shared Task    James Barry, Alireza Mohammadshahi, Joachim Wagner, Jennifer Foster, James Henderson arXiv_CL arXiv_CL  Bert  PDF
• 2021-07-02 Language Identification of Hindi-English tweets using code-mixed BERT    Mohd Zeeshan Ansari, M M Sufyan Beg, Tanvir Ahmad, Mohd Jazib Khan, Ghazali Wasim arXiv_CL arXiv_CL  Embedding  Transfer_Learning  Bert  Knowledge  Classification  Language_Model  PDF
• 2021-07-02 Ultrasound Video Transformers for Cardiac Ejection Fraction Estimation    Hadrien Reynaud, Athanasios Vlontzos, Benjamin Hou, Arian Beqiri, Paul Leeson, Bernhard Kainz arXiv_CV arXiv_CV  Transformer  Segmentation  Bert  Pose  Action  Classification  Detection  PDF
• 2021-07-02 A Novel Deep Reinforcement Learning Based Stock Direction Prediction using Knowledge Graph and Community Aware Sentiments    Anil Berk Altuner, Zeynep Hilal Kilimci arXiv_AI arXiv_AI  Transformer  Reinforcement_Learning  Bert  Knowledge  Knowledge_Graph  Pose  Relation  Sentiment  Prediction  PDF
• 2021-07-02 He Thinks He Knows Better than the Doctors: BERT for Event Factuality Fails on Pragmatics    Nanjiang Jiang, Marie-Catherine de Marneffe arXiv_CL arXiv_CL  Bert  Face  Prediction  PDF
• 2021-07-01 A Primer on Pretrained Multilingual Language Models    Sumanth Doddapaneni, Gowtham Ramesh, Anoop Kunchukuttan, Pratyush Kumar, Mitesh M. Khapra arXiv_CL arXiv_CL  Transfer_Learning  Bert  Review  Survey  Language_Model  PDF
• 2021-07-01 Multimodal Graph-based Transformer Framework for Biomedical Relation Extraction    Sriram Pingali, Shweta Yadav, Pratik Dutta, Sriparna Saha arXiv_CL arXiv_CL  Transformer  Bert  Knowledge  Pose  Action  Relation  Relation_Extraction  Medical  PDF
• 2021-07-01 GlyphCRM: Bidirectional Encoder Representation for Chinese Character with its Glyph    Yunxin Li, Yu Zhao, Baotian Hu, Qingcai Chen, Yang Xiang, Xiaolong Wang, Yuxin Ding, Lin Ma arXiv_AI arXiv_AI  Transformer  Embedding  Bert  Pose  CNN  PDF
• 2021-07-01 Leveraging Domain Agnostic and Specific Knowledge for Acronym Disambiguation    Qiwei Zhong, Guanxiong Zeng, Danqing Zhu, Yang Zhang, Wangli Lin, Ben Chen, Jiayu Tang arXiv_AI arXiv_AI  Embedding  Bert  Knowledge  Pose  Deep_Learning  Language_Model  Prediction  PDF
• 2021-07-01 Sonority Measurement Using System, Source, and Suprasegmental Information    Bidisha Sharma, S. R. Mahadeva Prasanna arXiv_SD arXiv_SD  Recognition  Bert  Speech  Pose  Classification  Relation  Prediction  PDF
• 2021-07-01 Elbert: Fast Albert with Confidence-Window Based Early Exit    Keli Xie, Siyuan Lu, Meiqi Wang, Zhongfeng Wang arXiv_CL arXiv_CL  Bert  Pose  Inference  Language_Model  PDF
• 2021-06-30 Early Risk Detection of Pathological Gambling, Self-Harm and Depression Using BERT    Ana-Maria Bucur, Adrian Cosma, Liviu P. Dinu arXiv_CL arXiv_CL  Transformer  Bert  Detection  PDF
• 2021-06-30 Revisiting the Primacy of English in Zero-shot Cross-lingual Transfer    Iulia Turc, Kenton Lee, Jacob Eisenstein, Ming-Wei Chang, Kristina Toutanova arXiv_CL arXiv_CL  Bert  Zero-Shot  Classification  PDF
• 2021-06-30 The MultiBERTs: BERT Reproductions for Robustness Analysis    Thibault Sellam, Steve Yadlowsky, Jason Wei, Naomi Saphra, Alexander D'Amour, Tal Linzen, Jasmijn Bastings, Iulia Turc, Jacob Eisenstein, Dipanjan Das, Ian Tenney, Ellie Pavlick arXiv_CL arXiv_CL  Bert  PDF
• 2021-06-30 ChineseBERT: Chinese Pretraining Enhanced by Glyph and Pinyin Information    Zijun Sun, Xiaoya Li, Xiaofei Sun, Yuxian Meng, Xiang Ao, Qing He, Fei Wu, Jiwei Li arXiv_CL arXiv_CL  Embedding  Recognition  Bert  Text_Classification  Pose  Classification  Inference  Language_Model  Matching  PDF
• 2021-06-30 AutoLAW: Augmented Legal Reasoning through Legal Precedent Prediction    Robert Zev Mahari arXiv_CL arXiv_CL  Bert  GAN  Prediction  PDF
• 2021-06-29 Hate speech detection using static BERT embeddings    Gaurav Rajput, Narinder Singh punn, Sanjay Kumar Sonbhadra, Sonali Agarwal arXiv_CV arXiv_CV  Embedding  Bert  Speech  Detection  PDF
• 2021-06-29 New Arabic Medical Dataset for Diseases Classification    Jaafar Hammoud, Aleksandra Vatian, Natalia Dobrenko, Nikolai Vedernikov, Anatoly Shalyto, Natalia Gusarova arXiv_CL arXiv_CL  OCR  Bert  Classification  Deep_Learning  Medical  PDF
• 2021-06-29 Packing: Towards 2x NLP BERT Acceleration    Matej Kosec, Sheng Fu, Mario Michael Krell arXiv_CL arXiv_CL  Transformer  Bert  Attention  PDF
• 2021-06-28 Enhancing the Generalization for Intent Classification and Out-of-Domain Detection in SLU    Yilin Shen, Yen-Chang Hsu, Avik Ray, Hongxia Jin arXiv_AI arXiv_AI  Bert  Pose  Classification  Detection  PDF
• 2021-06-28 Traditional Machine Learning and Deep Learning Models for Argumentation Mining in Russian Texts    Irina Fishcheva, Valeriya Goloviznina, Evgeny Kotelnikov arXiv_CL arXiv_CL  Bert  Pose  Classification  Deep_Learning  Relation  PDF
• 2021-06-28 Current Landscape of the Russian Sentiment Corpora    Evgeny Kotelnikov arXiv_CL arXiv_CL  Bert  Review  Pose  Quantitative  Sentiment  PDF
• 2021-06-28 A 3D CNN Network with BERT For Automatic COVID-19 Diagnosis From CT-Scan Images    Weijun Tan, Jingfeng Liu arXiv_CV arXiv_CV  Segmentation  Embedding  3D  Bert  PDF
• 2021-06-27 A Closer Look at How Fine-tuning Changes BERT    Yichu Zhou, Vivek Srikumar arXiv_CL arXiv_CL  Bert  PDF
• 2021-06-27 AI based Presentation Creator With Customized Audio Content Delivery    Muvazima Mansoor, Srikanth Chandar, Ramamoorthy Srinath arXiv_AI arXiv_AI  Bert  Adversarial  Pose  GAN  Summarization  PDF
• 2021-06-26 Answering Chinese Elementary School Social Study Multiple Choice Questions    Daniel Lee, Chao-Chun Liang, Keh-Yih Su arXiv_CL arXiv_CL  Bert  Pose  PDF
• 2021-06-26 UMIC: An Unreferenced Metric for Image Captioning via Contrastive Learning    Hwanhee Lee, Seunghyun Yoon, Franck Dernoncourt, Trung Bui, Kyomin Jung arXiv_CV arXiv_CV  Image_Caption  Bert  Contrastive_Learning  Relation  Text_Generation  Caption  PDF
• 2021-06-26 Benchmarking Differential Privacy and Federated Learning for BERT Models    Priyam Basu, Tiasa Singha Roy, Rakshit Naidu, Zumrut Muftuoglu, Sahib Singh, Fatemehsadat Mireshghallah arXiv_CL arXiv_CL  Bert  Emotion  Medical  Language_Model  PDF
• 2021-06-25 Adapt-and-Distill: Developing Small, Fast and Effective Pretrained Language Models for Domains    Yunzhi Yao, Shaohan Huang, Wenhui Wang, Li Dong, Furu Wei arXiv_CL arXiv_CL  Bert  Knowledge  Pose  Medical  Language_Model  PDF
• 2021-06-25 iReason: Multimodal Commonsense Reasoning using Videos and Natural Language with Interpretability    Aman Chadha, Vinija Jain arXiv_AI arXiv_AI  Embedding  Video_Caption  Bert  Represenation_Learning  Knowledge  Pose  Deep_Learning  Detection  Relation  Caption  PDF
• 2021-06-24 Unsupervised Topic Segmentation of Meetings with BERT Embeddings    Alessandro Solbiati, Kevin Heffernan, Georgios Damaskinos, Shivani Poddar, Shubham Modi, Jacques Cali arXiv_CL arXiv_CL  Segmentation  Embedding  Unsupervised  Bert  PDF
• 2021-06-24 AIT-QA: Question Answering Dataset over Complex Tables in the Airline Industry    Yannis Katsis, Saneem Chemmengath, Vishwajeet Kumar, Samarth Bharadwaj, Mustafa Canim, Michael Glass, Alfio Gliozzo, Feifei Pan, Jaydeep Sen, Karthik Sankaranarayanan, Soumen Chakrabarti arXiv_AI arXiv_AI  Transformer  Bert  Zero-Shot  Pose  Relation  QA  PDF
• 2021-06-24 An Automated Knowledge Mining and Document Classification System with Multi-model Transfer Learning    Jia Wei Chong, Zhiyuan Chen, Mei Shin Oh arXiv_CL arXiv_CL  Transfer_Learning  Bert  Knowledge  Pose  Classification  PDF
• 2021-06-24 Discovering novel drug-supplement interactions using a dietary supplements knowledge graph generated from the biomedical literature    Dalton Schutte, Jake Vasilakes, Anu Bompelli, Yuqi Zhou, Marcelo Fiszman, Hua Xu, Halil Kilicoglu, Jeffrey R. Bishop, Terrence Adam, Rui Zhang arXiv_CL arXiv_CL  Bert  Knowledge  Review  Knowledge_Graph  Pose  Action  Relation  Medical  PDF
• 2021-06-23 BERT-based Multi-Task Model for Country and Province Level Modern Standard Arabic and Dialectal Arabic Identification    Abdellah El Mekki, Abdelkader El Mahdaouy, Kabil Essefar, Nabil El Mamoun, Ismail Berrada, Ahmed Khoumsi arXiv_CL arXiv_CL  Transformer  Bert  Deep_Learning  Attention  PDF
• 2021-06-23 Deep Multi-Task Model for Sarcasm Detection and Sentiment Analysis in Arabic Language    Abdelkader El Mahdaouy, Abdellah El Mekki, Kabil Essefar, Nabil El Mamoun, Ismail Berrada, Ahmed Khoumsi arXiv_CL arXiv_CL  Transformer  Bert  Knowledge  Pose  Action  Detection  Sentiment  Attention  PDF
• 2021-06-23 Classifying Textual Data with Pre-trained Vision Models through Transfer Learning and Data Transformations    Charaf Eddine Benarab arXiv_AI arXiv_AI  Embedding  Transfer_Learning  Bert  Knowledge  Pose  Sentiment  Language_Model  PDF
• 2021-06-22 LV-BERT: Exploiting Layer Variety for BERT    Weihao Yu, Zihang Jiang, Fei Chen, Qibin Hou, Jiashi Feng arXiv_AI arXiv_AI  Bert  Attention  Language_Model  PDF
• 2021-06-22 A Comprehensive Exploration of Pre-training Language Models    Tong Guo arXiv_CL arXiv_CL  Transformer  Bert  RNN  Language_Model  PDF
• 2021-06-21 Deep Learning Models in Detection of Dietary Supplement Adverse Event Signals from Twitter    Yefeng Wang, Yunpeng Zhao, Jiang Bian, Rui Zhang arXiv_CL arXiv_CL  Embedding  Bert  RNN  Knowledge  Pose  Action  Deep_Learning  Detection  Relation  Relation_Extraction  GAN  Medical  PDF
• 2021-06-21 Iterative Network Pruning with Uncertainty Regularization for Lifelong Sentiment Classification    Binzong Geng, Min Yang, Fajie Yuan, Shupeng Wang, Xiang Ao, Ruifeng Xu arXiv_AI arXiv_AI  Bert  Sentiment_Classification  Regularization  Knowledge  Review  Pose  Classification  Sentiment  PDF
• 2021-06-21 Ad Text Classification with Transformer-Based Natural Language Processing Methods    Umut Özdil, Büşra Arslan, D. Emre Taşar, Gökçe Polat, Şükrü Ozan arXiv_CL arXiv_CL  Transformer  Bert  Text_Classification  Pose  Classification  Language_Model  PDF
• 2021-06-21 Out of Context: A New Clue for Context Modeling of Aspect-based Sentiment Analysis    Bowen Xing, Ivor W. Tsang arXiv_CL arXiv_CL  Bert  RNN  Review  Pose  Action  Relation  Sentiment  Attention  PDF
• 2021-06-20 Context-Aware Legal Citation Recommendation using Deep Learning    Zihan Huang, Charles Low, Mengqiu Teng, Hongyi Zhang, Daniel E. Ho, Mark S. Krass, Matthias Grabmair arXiv_CL arXiv_CL  Bert  RNN  Deep_Learning  Recommendation  PDF
• 2021-06-19 Hybrid approach to detecting symptoms of depression in social media entries    Agnieszka Wołk, Karol Chlasta, Paweł Holas arXiv_CL arXiv_CL  Bert  Emotion  Sentiment  PDF
• 2021-06-18 BitFit: Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-models    Elad Ben Zaken, Shauli Ravfogel, Yoav Goldberg arXiv_CL arXiv_CL  Transformer  Bert  Sparse  Knowledge  PDF
• 2021-06-18 All You Can Embed: Natural Language based Vehicle Retrieval with Spatio-Temporal Transformers    Carmelo Scribano, Davide Sapienza, Giorgia Franchini, Micaela Verucchi, Marko Bertogna arXiv_CV arXiv_CV  Transformer  Embedding  Tracking  Bert  Pose  CNN  PDF
• 2021-06-18 SPBERT: Pre-training BERT on SPARQL Queries for End-to-end Question Answering over Knowledge Graphs    Hieu Tran, Long Phan, Truong-Son Nguyen arXiv_CL arXiv_CL  Transformer  Bert  Knowledge  Knowledge_Graph  Pose  Language_Model  QA  PDF
• 2021-06-18 Graph-based Joint Pandemic Concern and Relation Extraction on Twitter    Jingli Shi, Weihua Li, Sira Yongchareon, Yi Yang, Quan Bai arXiv_CL arXiv_CL  Embedding  Bert  Knowledge  Pose  Action  Deep_Learning  Detection  Relation  Relation_Extraction  Attention  CNN  PDF
• 2021-06-17 Deep reinforcement learning with automated label extraction from clinical reports accurately classifies 3D MRI brain volumes    Joseph Stember, Hrithwik Shalu arXiv_AI arXiv_AI  Reinforcement_Learning  3D  Bert  Pose  Action  Classification  Deep_Learning  Image_Classification  PDF
• 2021-06-17 LNN-EL: A Neuro-Symbolic Approach to Short-text Entity Linking    Hang Jiang, Sairam Gurajada, Qiuhao Lu, Sumit Neelam, Lucian Popa, Prithviraj Sen, Yunyao Li, Alexander Gray arXiv_AI arXiv_AI  Embedding  Bert  Knowledge  Knowledge_Graph  Pose  PDF
• 2021-06-17 Multi-head or Single-head? An Empirical Comparison for Transformer Training    Liyuan Liu, Jialu Liu, Jiawei Han arXiv_CL arXiv_CL  Transformer  Bert  Deep_Learning  Attention  PDF
• 2021-06-17 Knowledgeable or Educated Guess? Revisiting Language Models as Knowledge Bases    Boxi Cao, Hongyu Lin, Xianpei Han, Le Sun, Lingyong Yan, Meng Liao, Tong Xue, Jin Xu arXiv_AI arXiv_AI  Bert  Knowledge  Action  Language_Model  Prediction  PDF
• 2021-06-16 Algorithm to Compilation Codesign: An Integrated View of Neural Network Sparsity    Fu-Ming Guo, Austin Huang arXiv_AI arXiv_AI  Transformer  Bert  Optimization  Sparse  Regularization  Relation  Attention  Inference  Language_Model  PDF
• 2021-06-15 Self-Supervised Learning with Kernel Dependence Maximization    Yazhe Li, Roman Pogodin, Danica J. Sutherland, Arthur Gretton arXiv_AI arXiv_AI  Image_Caption  Segmentation  Semantic_Segmentation  Recognition  Bert  Self-Supervised  Classification  PDF
• 2021-06-15 BEiT: BERT Pre-Training of Image Transformers    Hangbo Bao, Li Dong, Furu Wei arXiv_CV arXiv_CV  Transformer  Segmentation  Semantic_Segmentation  Bert  Self-Supervised  Pose  Classification  Image_Classification  PDF
• 2021-06-15 Question Answering Infused Pre-training of General-Purpose Contextualized Representations    Robin Jia, Mike Lewis, Luke Zettlemoyer arXiv_CL arXiv_CL  Recognition  Bert  Zero-Shot  Pose  Detection  Sentiment  Few-Shot  Prediction  QA  PDF
• 2021-06-15 Incorporating Word Sense Disambiguation in Neural Language Models    Jan Philip Wahle, Terry Ruas, Norman Meuschke, Bela Gipp arXiv_AI arXiv_AI  Bert  Language_Model  PDF
• 2021-06-15 Knowledge-Rich BERT Embeddings for Readability Assessment    Joseph Marvin Imperial arXiv_CL arXiv_CL  Embedding  Bert  Knowledge  Pose  PDF
• 2021-06-15 Medical Code Prediction from Discharge Summary: Document to Sequence BERT using Sequence Attention    Tak-Sung Heo, Yongmin Yoo, Yeongjoon Park, Byeong-Cheol Jo arXiv_AI arXiv_AI  Transformer  Bert  Pose  Classification  Attention  Medical  Prediction  PDF
• 2021-06-15 An Automated Quality Evaluation Framework of Psychotherapy Conversations with Local Quality Estimates    Zhuohao Chen, Nikolaos Flemotomos, Karan Singla, Torrey A. Creed, David C. Atkins, Shrikanth Narayanan arXiv_CL arXiv_CL  Embedding  Bert  RNN  Pose  Action  Classification  PDF
• 2021-06-14 Can BERT Dig It? -- Named Entity Recognition for Information Retrieval in the Archaeology Domain    Alex Brandsen, Suzan Verberne, Karsten Lambers, Milco Wansleeben arXiv_CL arXiv_CL  Recognition  Bert  Knowledge  Quantitative  Prediction  PDF
• 2021-06-14 Dataset of Propaganda Techniques of the State-Sponsored Information Operation of the People's Republic of China    Rong-Ching Chang, Chun-Ming Lai, Kai-Lai Chang, Chu-Hsing Lin arXiv_AI arXiv_AI  Bert  Text_Classification  Quantitative  Classification  Detection  GAN  PDF
• 2021-06-14 Modeling Profanity and Hate Speech in Social Media with Semantic Subspaces    Vanessa Hahn, Dana Ruiter, Thomas Kleinbauer, Dietrich Klakow arXiv_CL arXiv_CL  Bert  Zero-Shot  Speech  Detection  PDF
• 2021-06-14 HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Units    Wei-Ning Hsu, Benjamin Bolte, Yao-Hung Hubert Tsai, Kushal Lakhotia, Ruslan Salakhutdinov, Abdelrahman Mohamed arXiv_AI arXiv_AI  Segmentation  Unsupervised  Bert  Represenation_Learning  Speech  Self-Supervised  Pose  Language_Model  Prediction  PDF
• 2021-06-14 Probing Pre-Trained Language Models for Disease Knowledge    Israa Alghanmi, Luis Espinosa-Anke, Steven Schockaert arXiv_AI arXiv_AI  Bert  Knowledge  Adversarial  Pose  Classification  Medical  Inference  Language_Model  PDF
• 2021-06-14 Is Einstein more agreeable and less neurotic than Hitler? A computational exploration of the emotional and personality profiles of historical persons    Arthur M. Jacobs, Annette Kinder arXiv_AI arXiv_AI  Bert  Emotion  Language_Model  PDF
• 2021-06-14 SAS: Self-Augmented Strategy for Language Model Pre-training    Yifei Xu, Jingqiao Zhang, Ru He, Liangzhu Ge, Chao Yang, Cheng Yang, Ying Nian Wu arXiv_AI arXiv_AI  Bert  Self-Supervised  Pose  Attention  Language_Model  PDF
• 2021-06-14 Pre-Trained Models: Past, Present and Future    Han Xu, Zhang Zhengyan, Ding Ning, Gu Yuxian, Liu Xiao, Huo Yuqi, Qiu Jiezhong, Zhang Liang, Han Wentao, Huang Minlie, Jin Qin, Lan Yanyan, Liu Yang, Liu Zhiyuan, Lu Zhiwu, Qiu Xipeng, Song Ruihua, Tang Jie, Wen Ji-Rong, Yuan Jinhui, Zhao Wayne Xin, Zhu Jun arXiv_AI arXiv_AI  Transfer_Learning  Bert  Knowledge  Review  Self-Supervised  Relation  PDF
• 2021-06-14 Why Can You Lay Off Heads? Investigating How BERT Heads Transfer    Ting-Rui Chiang, Yun-Nung Chen arXiv_CL arXiv_CL  Transformer  Transfer_Learning  Bert  Pose  PDF
• 2021-06-14 Bayesian dense inverse searching algorithm for real-time stereo matching in minimally invasive surgery    Jingwei Song, Qiuchen Zhu, Jianyu Lin, Maani Ghaffari arXiv_CV arXiv_CV  Bert  Pose  Face  Matching  PDF
• 2021-06-13 SASICM A Multi-Task Benchmark For Subtext Recognition    Hua Yan, Weikang Xiao, Feng Han, Jian Zhao, Furao Shen arXiv_AI arXiv_AI  Recognition  Bert  PDF
• 2021-06-12 Cross-Subject Domain Adaptation for Multi-Frame EEG Images    Junfu Chen, Yang Chen, Bi Wang arXiv_AI arXiv_AI  Bert  Pose  Classification  Attention  PDF
• 2021-06-12 A Sentence-level Hierarchical BERT Model for Document Classification with Limited Labelled Data    Jinghui Lu, Maeve Henchion, Ivan Bacher, Brian Mac Namee arXiv_CL arXiv_CL  Bert  Salient  Classification  Deep_Learning  Language_Model  PDF
• 2021-06-12 Improving Unsupervised Dialogue Topic Segmentation with Utterance-Pair Coherence Scoring    Linzi Xing, Giuseppe Carenini arXiv_CL arXiv_CL  Segmentation  Unsupervised  Bert  Face  Inference  PDF
• 2021-06-12 Explaining the Deep Natural Language Processing by Mining Textual Interpretable Features    Francesco Ventura, Salvatore Greco, Daniele Apiletti, Tania Cerquitelli arXiv_AI arXiv_AI  Bert  RNN  Knowledge  Pose  Classification  Relation  Sentiment  Language_Model  Prediction  PDF
• 2021-06-11 N-Best ASR Transformer: Enhancing SLU Performance using Multiple ASR Hypotheses    Karthik Ganesan, Pakhi Bamdev, Jaivarsan B, Amresh Venugopal, Abhinav Tushar arXiv_CL arXiv_CL  Transformer  Bert  Speech  PDF
• 2021-06-11 Dynamic Language Models for Continuously Evolving Content    Spurthi Amba Hombaiah, Tao Chen, Mingyang Zhang, Michael Bendersky, Marc Najork arXiv_CL arXiv_CL  Bert  Pose  Language_Model  Prediction  PDF
• 2021-06-11 BoB: BERT Over BERT for Training Persona-based Dialogue Models from Limited Personalized Data    Haoyu Song, Yan Wang, Kaiyan Zhang, Wei-Nan Zhang, Ting Liu arXiv_AI arXiv_AI  Bert  Pose  Inference  PDF
• 2021-06-11 RefBERT: Compressing BERT by Referencing to Pre-computed Representations    Xinyi Wang, Haiqin Yang, Liang Zhao, Yang Mo, Jianping Shen arXiv_CL arXiv_CL  Bert  Knowledge  Pose  Inference  Language_Model  PDF
• 2021-06-10 Cross-lingual Emotion Detection    Sabit Hassan, Shaden Shaar, Kareem Darwish arXiv_CL arXiv_CL  Bert  Emotion  Classification  Detection  PDF
• 2021-06-10 A Semi-supervised Multi-task Learning Approach to Classify Customer Contact Intents    Li Dong, Matthew C. Spencer, Amir Biagi arXiv_AI arXiv_AI  Bert  Pose  Classification  Prediction  PDF
• 2021-06-10 GroupBERT: Enhanced Transformer Architecture with Efficient Grouped Structures    Ivan Chelombiev, Daniel Justus, Douglas Orr, Anastasia Dietrich, Frithjof Gressmann, Alexandros Koliousis, Carlo Luschi arXiv_CL arXiv_CL  Transformer  Bert  Represenation_Learning  Action  Attention  CNN  Language_Model  PDF
• 2021-06-10 Linguistically Informed Masking for Representation Learning in the Patent Domain    Sophia Althammer, Mark Buckley, Sebastian Hofstätter, Allan Hanbury arXiv_CL arXiv_CL  Recognition  Bert  Represenation_Learning  Pose  Classification  Language_Model  Matching  PDF
• 2021-06-10 Marginal Utility Diminishes: Exploring the Minimum Knowledge for BERT Knowledge Distillation    Yuanxin Liu, Fandong Meng, Zheng Lin, Weiping Wang, Jie Zhou arXiv_CL arXiv_CL  Bert  Knowledge  Pose  Action  PDF
• 2021-06-10 MusicBERT: Symbolic Music Understanding with Large-Scale Pre-Training    Mingliang Zeng, Xu Tan, Rui Wang, Zeqian Ju, Tao Qin, Tie-Yan Liu arXiv_CL arXiv_CL  Bert  Represenation_Learning  Emotion  Classification  Matching  PDF
• 2021-06-10 Supervising the Transfer of Reasoning Patterns in VQA    Corentin Kervadec, Christian Wolf, Grigory Antipov, Moez Baccouche, Madiha Nadri arXiv_CV arXiv_CV  Bert  Regularization  Knowledge  Self-Supervised  Pose  VQA  Attention  Prediction  QA  PDF
• 2021-06-10 AMU-EURANOVA at CASE 2021 Task 1: Assessing the stability of multilingual BERT    Léo Bouscarrat (LIS, TALEP, QARMA), Antoine Bonnefoy, Cécile Capponi (LIS, QARMA), Carlos Ramisch (LIS, TALEP) arXiv_AI arXiv_AI  Bert  Action  PDF
• 2021-06-10 Convolutions and Self-Attention: Re-interpreting Relative Positions in Pre-trained Language Models    Tyler A. Chang, Yifan Xu, Weijian Xu, Zhuowen Tu arXiv_CL arXiv_CL  Transformer  Embedding  Bert  Pose  Relation  Attention  CNN  Language_Model  PDF
• 2021-06-09 Psycholinguistic Tripartite Graph Network for Personality Detection    Tao Yang, Feifan Yang, Haolan Ouyang, Xiaojun Quan arXiv_CL arXiv_CL  Embedding  Bert  Knowledge  Pose  Detection  Attention  PDF
• 2021-06-09 Auto-tagging of Short Conversational Sentences using Natural Language Processing Methods    Şükrü Ozan, D. Emre Taşar arXiv_CL arXiv_CL  Transformer  Bert  Attention  Language_Model  QA  PDF
• 2021-06-09 Phraseformer: Multimodal Key-phrase Extraction using Transformer and Graph Embedding    Narjes Nikzad-Khasmakhi, Mohammad-Reza Feizi-Derakhshi, Meysam Asgari-Chenaghlu, Mohammad-Ali Balafar, Ali-Reza Feizi-Derakhshi, Taymaz Rahkar-Farshi, Majid Ramezani, Zoleikha Jahanbakhsh-Nagadeh, Elnaz Zafarani-Moattar, Mehrdad Ranjbar-Khadivi arXiv_AI arXiv_AI  Transformer  Embedding  Bert  Action  Classification  PDF
• 2021-06-09 Automatic Sexism Detection with Multilingual Transformer Models    Schütz Mina, Boeck Jaqueline, Liakhovets Daria, Slijepčević Djordje, Kirchknopf Armin, Hecht Manuel, Bogensperger Johannes, Schlarb Sven, Schindler Alexander, Zeppelzauer Matthias arXiv_AI arXiv_AI  Transformer  Unsupervised  Bert  Classification  Detection  PDF
• 2021-06-09 Probing Multilingual Language Models for Discourse    Murathan Kurfalı, Robert Östling arXiv_CL arXiv_CL  Bert  Zero-Shot  Knowledge  Language_Model  PDF
• 2021-06-09 Sentence Embeddings using Supervised Contrastive Learning    Danqi Liao arXiv_CL arXiv_CL  Embedding  Unsupervised  Bert  Pose  Contrastive_Learning  PDF
• 2021-06-08 Speech BERT Embedding For Improving Prosody in Neural TTS    Liping Chen, Yan Deng, Xi Wang, Frank K. Soong, Lei He arXiv_SD arXiv_SD  Transformer  Embedding  Bert  Speech  Pose  PDF
• 2021-06-08 Cheap and Good? Simple and Effective Data Augmentation for Low Resource Machine Reading    Hoang Van, Vikas Yadav, Mihai Surdeanu arXiv_AI arXiv_AI  Bert  Pose  Action  QA  PDF
• 2021-06-08 Ultra-Fine Entity Typing with Weak Supervision from a Masked Language Model    Hongliang Dai, Yangqiu Song, Haixun Wang arXiv_CL arXiv_CL  Bert  Pose  Language_Model  PDF
• 2021-06-07 Neural Abstractive Unsupervised Summarization of Online News Discussions    Ignacio Tampe Palma, Marcelo Mendoza, Evangelos Milios arXiv_CL arXiv_CL  Unsupervised  Bert  Attention  Summarization  PDF
• 2021-06-07 Measuring and Improving BERT's Mathematical Abilities by Predicting the Order of Reasoning    Piotr Piękos, Henryk Michalewski, Mateusz Malinowski arXiv_AI arXiv_AI  Bert  Pose  Language_Model  Prediction  PDF
• 2021-06-07 RoSearch: Search for Robust Student Architectures When Distilling Pre-trained Language Models    Xin Guo, Jianlei Yang, Haoyi Zhou, Xucheng Ye, Jianxin Li arXiv_AI arXiv_AI  Bert  Knowledge  Adversarial  Pose  Relation  Language_Model  PDF
• 2021-06-07 BERTGEN: Multi-task Generation through BERT    Faidon Mitzalis, Ozan Caglayan, Pranava Madhyastha, Lucia Specia arXiv_CL arXiv_CL  Image_Caption  Bert  Zero-Shot  Caption  PDF
• 2021-06-07 Never guess what I heard... Rumor Detection in Finnish News: a Dataset and a Baseline    Mika Hämäläinen, Khalid Alnajjar, Niko Partanen, Jack Rueter arXiv_CL arXiv_CL  Bert  RNN  Detection  Language_Model  PDF
• 2021-06-07 LAWDR: Language-Agnostic Weighted Document Representations from Pre-trained Models    Hongyu Gong, Vishrav Chaudhary, Yuqing Tang, Francisco Guzmán arXiv_AI arXiv_AI  Embedding  Unsupervised  Transfer_Learning  Bert  Represenation_Learning  Pose  Language_Model  PDF
• 2021-06-06 Transient Chaos in BERT    Katsuma Inoue, Soh Ohara, Yasuo Kuniyoshi, Kohei Nakajima arXiv_AI arXiv_AI  Transformer  Bert  Action  PDF
• 2021-06-06 Identifying Populist Paragraphs in Text: A machine-learning approach    Jogilė Ulinkskaitė, Lukas Pukelis arXiv_CL arXiv_CL  Bert  Text_Classification  Classification  PDF
• 2021-06-06 Causal Abstractions of Neural Networks    Atticus Geiger, Hanson Lu, Thomas Icard, Christopher Potts arXiv_AI arXiv_AI  Bert  Pose  Action  Inference  PDF
• 2021-06-05 BERTnesia: Investigating the capture and forgetting of knowledge in BERT    Jonas Wallat, Jaspreet Singh, Avishek Anand arXiv_CL arXiv_CL  Bert  Knowledge  Relation  Language_Model  PDF
• 2021-06-04 BERT based sentiment analysis: A software engineering perspective    Himanshu Batra, Narinder Singh Punn, Sanjay Kumar Sonbhadra, Sonali Agarwal arXiv_CV arXiv_CV  Transformer  Bert  Text_Classification  Pose  Classification  Sentiment  Recommendation  PDF
• 2021-06-04 Do Syntactic Probes Probe Syntax? Experiments with Jabberwocky Probing    Rowan Hall Maudslay, Ryan Cotterell arXiv_CL arXiv_CL  Bert  Knowledge  Language_Model  PDF
• 2021-06-04 You Only Compress Once: Towards Effective and Elastic BERT Compression via Exploit-Explore Stochastic Nature Gradient    Shaokun Zhang, Xiawu Zheng, Chenyi Yang, Yuchao Li, Yan Wang, Fei Chao, Mengdi Wang, Shen Li, Jun Yang, Rongrong Ji arXiv_CL arXiv_CL  Bert  Optimization  Pose  Inference  PDF
• 2021-06-04 Dutch Named Entity Recognition and De-identification Methods for the Human Resource Domain    Chaïm van Toledo, Friso van Dijk, Marco Spruit arXiv_CL arXiv_CL  Transformer  Recognition  Bert  PDF
• 2021-06-04 ERNIE-Tiny : A Progressive Distillation Framework for Pretrained Transformer Compression    Weiyue Su, Xuyi Chen, Shikun Feng, Jiaxiang Liu, Weixin Liu, Yu Sun, Hao Tian, Hua Wu, Haifeng Wang arXiv_CL arXiv_CL  Transformer  Bert  Knowledge  Pose  Inference  Language_Model  PDF
• 2021-06-04 BERTTune: Fine-Tuning Neural Machine Translation with BERTScore    Inigo Jauregi Unanue, Jacob Parnell, Massimo Piccardi arXiv_CL arXiv_CL  Embedding  Bert  Pose  Prediction  PDF
• 2021-06-04 Towards Equal Gender Representation in the Annotations of Toxic Language Detection    Elizabeth Excell, Noura Al Moubayed arXiv_AI arXiv_AI  Bert  Detection  Prediction  PDF
• 2021-06-03 Syntax-augmented Multilingual BERT for Cross-lingual Transfer    Wasi Uddin Ahmad, Haoran Li, Kai-Wei Chang, Yashar Mehdad arXiv_CL arXiv_CL  Transfer_Learning  Recognition  Bert  Text_Classification  Classification  QA  PDF
• 2021-06-03 Embedded Deep Regularized Block HSIC Thermomics for Early Diagnosis of Breast Cancer    Bardia Yousefi, Hossein Memarzadeh Sharifipour, Xavier P.V. Maldague arXiv_CV arXiv_CV  Embedding  Bert  Pose  Detection  PDF
• 2021-06-03 CCPM: A Chinese Classical Poetry Matching Dataset    Wenhao Li, Fanchao Qi, Maosong Sun, Xiaoyuan Yi, Jiarui Zhang arXiv_CL arXiv_CL  Bert  Pose  Sentiment  Matching  PDF
• 2021-06-03 Defending Democracy: Using Deep Learning to Identify and Prevent Misinformation    Anusua Trivedi, Alyssa Suhm, Prathamesh Mahankal, Subhiksha Mukuntharaj, Meghana D. Parab, Malvika Mohan, Meredith Berger, Arathi Sethumadhavan, Ashish Jaiman, Rahul Dodhia arXiv_AI arXiv_AI  Transformer  OCR  Bert  Deep_Learning  Detection  PDF
• 2021-06-03 The Case for Translation-Invariant Self-Attention in Transformer-Based Language Models    Ulme Wennberg, Gustav Eje Henter arXiv_AI arXiv_AI  Transformer  Embedding  Bert  Pose  Attention  Language_Model  PDF
• 2021-06-03 Template-Based Named Entity Recognition Using BART    Leyang Cui, Yu Wu, Jian Liu, Sen Yang, Yue Zhang arXiv_CL arXiv_CL  Recognition  Bert  Knowledge  Pose  Few-Shot  Inference  Language_Model  PDF
• 2021-06-03 Auto-tagging of Short Conversational Sentences using Transformer Methods    D. Emre Taşar, Şükrü Ozan, Umut Özdil, M. Fatih Akca, Oğuzhan Ölmez, Semih Gülüm, Seçilay Kutal, Ceren Belhan arXiv_CL arXiv_CL  Transformer  Bert  Speech  Pose  Classification  PDF
• 2021-06-03 Bilingual Alignment Pre-training for Zero-shot Cross-lingual Transfer    Ziqing Yang, Wentao Ma, Yiming Cui, Jiani Ye, Wanxiang Che, Shijin Wang arXiv_CL arXiv_CL  Embedding  Bert  Zero-Shot  Knowledge  Pose  Face  Language_Model  Prediction  QA  PDF
• 2021-06-03 Generate, Prune, Select: A Pipeline for Counterspeech Generation against Online Hate Speech    Wanzheng Zhu, Suma Bhat arXiv_CL arXiv_CL  Bert  Speech  Pose  PDF
• 2021-06-03 Tail-to-Tail Non-Autoregressive Sequence Prediction for Chinese Grammatical Error Correction    Piji Li, Shuming Shi arXiv_AI arXiv_AI  Transformer  Bert  Detection  Prediction  PDF
• 2021-06-03 Self-Guided Contrastive Learning for BERT Sentence Representations    Taeuk Kim, Kang Min Yoo, Sang-goo Lee arXiv_AI arXiv_AI  Transformer  Embedding  Bert  Represenation_Learning  Self-Supervised  Pose  Contrastive_Learning  Inference  PDF
• 2021-06-03 Automatically Detecting Cyberbullying Comments on Online Game Forums    Hanh Hong-Phuc Vo, Hieu Trung Tran, Son T. Luu arXiv_CL arXiv_CL  Bert  Speech  Classification  PDF
• 2021-06-03 The Limitations of Limited Context for Constituency Parsing    Yuchen Li, Andrej Risteski arXiv_CL arXiv_CL  Unsupervised  Bert  RNN  Language_Model  PDF
• 2021-06-03 MPC-BERT: A Pre-Trained Language Model for Multi-Party Conversation Understanding    Jia-Chen Gu, Chongyang Tao, Zhen-Hua Ling, Can Xu, Xiubo Geng, Daxin Jiang arXiv_CL arXiv_CL  Recognition  Bert  Restoration  Self-Supervised  Detection  Language_Model  Prediction  PDF
• 2021-06-03 BERT meets LIWC: Exploring State-of-the-Art Language Models for Predicting Communication Behavior in Couples' Conflict Interactions    Jacopo Biggiogera, George Boateng, Peter Hilpert, Matthew Vowels, Guy Bodenmann, Mona Neysari, Fridtjof Nussbeck, Tobias Kowatsch arXiv_CL arXiv_CL  Bert  Action  Relation  Language_Model  Prediction  PDF
• 2021-06-03 'You made me feel this way': Investigating Partners' Influence in Predicting Emotions in Couples' Conflict Interactions using Speech Data    George Boateng, Peter Hilpert, Guy Bodenmann, Mona Neysari, Tobias Kowatsch arXiv_CL arXiv_CL  Bert  Speech  Emotion  Action  Prediction  PDF
• 2021-06-02 Evaluating the Efficacy of Summarization Evaluation across Languages    Fajri Koto, Jey Han Lau, Timothy Baldwin arXiv_CL arXiv_CL  Bert  Summarization  PDF
• 2021-06-02 BERT-Defense: A Probabilistic Model Based on BERT to Combat Cognitively Inspired Orthographic Adversarial Attacks    Yannik Keller, Jan Mackensen, Steffen Eger arXiv_CL arXiv_CL  Segmentation  Bert  Adversarial  Pose  Deep_Learning  Language_Model  PDF
• 2021-06-02 Decision Transformer: Reinforcement Learning via Sequence Modeling    Lili Chen, Kevin Lu, Aravind Rajeswaran, Kimin Lee, Aditya Grover, Michael Laskin, Pieter Abbeel, Aravind Srinivas, Igor Mordatch arXiv_AI arXiv_AI  Transformer  Reinforcement_Learning  Bert  Action  Language_Model  PDF
• 2021-06-02 On the Distribution, Sparsity, and Inference-time Quantization of Attention Values in Transformers    Tianchu Ji, Shraddhan Jain, Michael Ferdman, Peter Milder, H. Andrew Schwartz, Niranjan Balasubramanian arXiv_CL arXiv_CL  Transformer  Quantization  Bert  Optimization  Sentiment  Attention  Inference  PDF
• 2021-06-02 Multilingual Medical Question Answering and Information Retrieval for Rural Health Intelligence Access    Vishal Vinod, Susmit Agrawal, Vipul Gaurav, Pallavi R, Savita Choudhary arXiv_CL arXiv_CL  Embedding  Recognition  Bert  Summarization  Medical  PDF
• 2021-06-02 Differential Privacy for Text Analytics via Natural Text Sanitization    Xiang Yue, Minxin Du, Tianhao Wang, Yaliang Li, Huan Sun, Sherman S. M. Chow arXiv_CL arXiv_CL  Bert  Knowledge  Pose  Inference  Language_Model  PDF
• 2021-06-02 T-BERT -- Model for Sentiment Analysis of Micro-blogs Integrating Topic Model and BERT    Sarojadevi Palani, Prabhu Rajagopal, Sidharth Pancholi arXiv_AI arXiv_AI  Transformer  Embedding  Unsupervised  Bert  Sentiment_Classification  Pose  Classification  Sentiment  PDF
• 2021-06-02 belabBERT: a Dutch RoBERTa-based language model applied to psychiatric classification    Joppe Wouts, Janna de Boer, Alban Voppel, Sanne Brederoo, Sander van Splunter, Iris Sommer arXiv_CL arXiv_CL  Recognition  Bert  Text_Classification  Classification  Language_Model  PDF
• 2021-06-02 One Teacher is Enough? Pre-trained Language Model Distillation from Multiple Teachers    Chuhan Wu, Fangzhao Wu, Yongfeng Huang arXiv_CL arXiv_CL  Bert  Knowledge  Pose  Language_Model  Prediction  PDF
• 2021-06-02 MathBERT: A Pre-trained Language Model for General NLP Tasks in Mathematics Education    Jia Tracy Shen, Michiharu Yamashita, Ethan Prihar, Neil Heffernan, Xintao Wu, Dongwon Lee arXiv_AI arXiv_AI  Transfer_Learning  Bert  Knowledge  Pose  Language_Model  Prediction  PDF
• 2021-06-02 Exploiting Global Contextual Information for Document-level Named Entity Recognition    Zanbo Wang, Wei Wei, Xianling Mao, Shanshan Feng, Pan Zhou, Zhiyong He, Sheng Jiang arXiv_AI arXiv_AI  Recognition  Bert  Pose  Attention  PDF
• 2021-06-01 On using distributed representations of source code for the detection of C security vulnerabilities    David Coimbra, Sofia Reis, Rui Abreu, Corina Păsăreanu, Hakan Erdogmus arXiv_AI arXiv_AI  Transformer  Bert  Detection  PDF
• 2021-06-01 You Only Look at One Sequence: Rethinking Transformer in Vision through Object Detection    Yuxin Fang, Bencheng Liao, Xinggang Wang, Jiemin Fang, Jiyang Qi, Rui Wu, Jianwei Niu, Wenyu Liu arXiv_AI arXiv_AI  Transformer  Recognition  Bert  Knowledge  Detection  Object_Detection  PDF
• 2021-06-01 Validating GAN-BioBERT: A Methodology For Assessing Reporting Trends In Clinical Trials    Joshua J Myszewski, Emily Klossowski, Patrick Meyer, Kristin Bevil, Lisa Klesius, Kristopher M Schroeder arXiv_CL arXiv_CL  Transformer  Bert  Sentiment_Classification  Pose  Classification  Sentiment  Attention  GAN  PDF
• 2021-06-01 Using Integrated Gradients to explain Linguistic Acceptability learnt by BERT    Anmol Nayak, Hari Prasad Timmapathini arXiv_CL arXiv_CL  Bert  Knowledge  Relation  Attention  Prediction  PDF
• 2021-06-01 SHUOWEN-JIEZI: Linguistically Informed Tokenizers For Chinese Language Model Pretraining    Chenglei Si, Zhengyan Zhang, Yingfa Chen, Fanchao Qi, Xiaozhi Wang, Zhiyuan Liu, Maosong Sun arXiv_CL arXiv_CL  Segmentation  Bert  Pose  Language_Model  PDF
• 2021-06-01 Volta at SemEval-2021 Task 9: Statement Verification and Evidence Finding with Tables using TAPAS and Transfer Learning    Devansh Gautam, Kshitij Gupta, Manish Shrivastava arXiv_CL arXiv_CL  Transfer_Learning  Bert  Classification  PDF
• 2021-06-01 Volta at SemEval-2021 Task 6: Towards Detecting Persuasive Texts and Images using Textual and Multimodal Ensemble    Kshitij Gupta, Devansh Gautam, Radhika Mamidi arXiv_CV arXiv_CV  Transfer_Learning  Bert  Pose  Classification  Detection  PDF
• 2021-06-01 Improving Automatic Hate Speech Detection with Multiword Expression Features    Nicolas Zampieri, Irina Illina, Dominique Fohr arXiv_CL arXiv_CL  Embedding  Bert  Speech  Pose  Detection  Attention  Language_Model  PDF
• 2021-06-01 Improving Formality Style Transfer with Context-Aware Rule Injection    Zonghai Yao, Hong Yu arXiv_CL arXiv_CL  Style_Transfer  Bert  Sentiment  PDF
• 2021-05-31 Training ELECTRA Augmented with Multi-word Selection    Jiaming Shen, Jialu Liu, Tianqi Liu, Cong Yu, Jiawei Han arXiv_CL arXiv_CL  Bert  Pose  Classification  Attention  PDF
• 2021-05-31 How transfer learning impacts linguistic knowledge in deep NLP models?    Nadir Durrani, Hassan Sajjad, Fahim Dalvi arXiv_CL arXiv_CL  Transfer_Learning  Bert  Knowledge  Language_Model  PDF
• 2021-05-31 A Multilingual Modeling Method for Span-Extraction Reading Comprehension    Gaochen Wu, Bin Xu, Dejie Chang, Bangchang Liu arXiv_AI arXiv_AI  Bert  Knowledge  Pose  Action  Relation  Attention  PDF
• 2021-05-31 Zero-shot Fact Verification by Claim Generation    Liangming Pan, Wenhu Chen, Wenhan Xiong, Min-Yen Kan, William Yang Wang arXiv_AI arXiv_AI  Bert  Zero-Shot  QA  PDF
• 2021-05-30 MLPruning: A Multilevel Structured Pruning Framework for Transformer-based Models    Zhewei Yao, Linjian Ma, Sheng Shen, Kurt Keutzer, Michael W. Mahoney arXiv_CL arXiv_CL  Transformer  Bert  Sparse  Regularization  Pose  Inference  PDF
• 2021-05-30 A Compression-Compilation Framework for On-mobile Real-time BERT Applications    Wei Niu, Zhenglun Kong, Geng Yuan, Weiwen Jiang, Jiexiong Guan, Caiwen Ding, Pu Zhao, Sijia Liu, Bin Ren, Yanzhi Wang arXiv_AI arXiv_AI  Transformer  NAS  Bert  Optimization  Pose  Deep_Learning  Text_Generation  QA  PDF
• 2021-05-30 Neural Models for Offensive Language Detection    Ehab Hamdy arXiv_AI arXiv_AI  Transformer  Bert  Detection  Inference  PDF
• 2021-05-30 NAS-BERT: Task-Agnostic and Adaptive-Size BERT Compression with Neural Architecture Search    Jin Xu, Xu Tan, Renqian Luo, Kaitao Song, Jian Li, Tao Qin, Tie-Yan Liu arXiv_AI arXiv_AI  NAS  Bert  Self-Supervised  Pose  Language_Model  PDF
• 2021-05-29 Sentiment analysis in tweets: an assessment study from classical to modern text representation models    Sérgio Barreto, Ricardo Moura, Jonnathan Carvalho, Aline Paes, Alexandre Plastino arXiv_AI arXiv_AI  Transformer  Embedding  Bert  Sentiment_Classification  Classification  Sentiment  Attention  Language_Model  PDF
• 2021-05-29 Constructing Flow Graphs from Procedural Cybersecurity Texts    Kuntal Kumar Pal, Kazuaki Kashihara, Pratyay Banerjee, Swaroop Mishra, Ruoyu Wang, Chitta Baral arXiv_AI arXiv_AI  Embedding  Bert  Pose  PDF
• 2021-05-29 A Simple Voting Mechanism for Online Sexist Content Identification    Chao Feng arXiv_CL arXiv_CL  Bert  Detection  Language_Model  Prediction  PDF
• 2021-05-29 CommitBERT: Commit Message Generation Using Pre-Trained Programming Language Model    Tae-Hwan Jung arXiv_CL arXiv_CL  Bert  Pose  NMT  Language_Model  PDF
• 2021-05-29 UFC-BERT: Unifying Multi-Modal Controls for Conditional Image Synthesis    Zhu Zhang, Jianxin Ma, Chang Zhou, Rui Men, Zhikang Li, Ming Ding, Jie Tang, Jingren Zhou, Hongxia Yang arXiv_CV arXiv_CV  Transformer  Bert  Pose  GAN  PDF
• 2021-05-28 Weighted Training for Cross-Task Learning    Shuxiao Chen, Koby Crammer, Hangfeng He, Dan Roth, Weijie J. Su arXiv_CL arXiv_CL  Recognition  Bert  Speech  Pose  Detection  PDF
• 2021-05-28 What if This Modified That? Syntactic Interventions via Counterfactual Embeddings    Mycal Tucker, Peng Qian, Roger Levy arXiv_CL arXiv_CL  Embedding  Bert  Pose  Language_Model  Prediction  PDF
• 2021-05-28 Accelerating BERT Inference for Sequence Labeling via Early-Exit    Xiaonan Li, Yunfan Shao, Tianxiang Sun, Hang Yan, Xipeng Qiu, Xuanjing Huang arXiv_AI arXiv_AI  Bert  Pose  Inference  PDF
• 2021-05-28 Domain-Adaptive Pretraining Methods for Dialogue Understanding    Han Wu, Kun Xu, Linfeng Song, Lifeng Jin, Haisong Zhang, Linqi Song arXiv_AI arXiv_AI  Bert  Relation  Language_Model  PDF
• 2021-05-28 SciFive: a text-to-text transformer model for biomedical literature    Long N. Phan, James T. Anibal, Hieu Tran, Shaurya Chanana, Erol Bahadroglu, Alec Peltekian, Grégoire Altan-Bonnet arXiv_AI arXiv_AI  Transformer  Bert  Action  Relation  Relation_Extraction  Text_Generation  Medical  Inference  PDF
• 2021-05-27 Leveraging Linguistic Coordination in Reranking N-Best Candidates For End-to-End Response Selection Using BERT    Mingzhi Yu (1), Diane Litman (1), ((1) University of Pittsburgh) arXiv_CL arXiv_CL  Bert  Pose  Language_Model  PDF
• 2021-05-27 Verb Sense Clustering using Contextualized Word Representations for Semantic Frame Induction    Kosuke Yamada, Ryohei Sasano, Koichi Takeda arXiv_CL arXiv_CL  Bert  PDF
• 2021-05-27 RAW-C: Relatedness of Ambiguous Words--in Context    Sean Trott, Benjamin Bergen arXiv_CL arXiv_CL  Embedding  Bert  Pose  PDF
• 2021-05-27 CoSQA: 20,000+ Web Queries for Code Search and Question Answering    Junjie Huang, Duyu Tang, Linjun Shou, Ming Gong, Ke Xu, Daxin Jiang, Ming Zhou, Nan Duan arXiv_CL arXiv_CL  Bert  Contrastive_Learning  QA  Matching  PDF
• 2021-05-27 Path-based knowledge reasoning with textual semantic information for medical knowledge graph completion    Yinyu Lan, Shizhu He, Xiangrong Zeng, Shengping Liu, Jun Zhao arXiv_AI arXiv_AI  Bert  Sparse  Knowledge  Knowledge_Graph  Pose  Relation  Attention  Medical  PDF
• 2021-05-27 Corpus-Level Evaluation for Event QA: The IndiaPoliceEvents Corpus Covering the 2002 Gujarat Violence    Andrew Halterman, Katherine A. Keith, Sheikh Muhammad Sarwar, Brendan O'Connor arXiv_CL arXiv_CL  Bert  Zero-Shot  Action  Classification  Activity  Inference  Prediction  QA  PDF
• 2021-05-27 Contrastive Fine-tuning Improves Robustness for Neural Rankers    Xiaofei Ma, Cicero Nogueira dos Santos, Andrew O. Arnold arXiv_CL arXiv_CL  Bert  Zero-Shot  Pose  Matching  PDF
• 2021-05-26 BERTifying the Hidden Markov Model for Multi-Source Weakly Supervised Named Entity Recognition    Yinghao Li, Pranav Shetty, Lucas Liu, Chao Zhang, Le Song arXiv_CL arXiv_CL  Embedding  Unsupervised  Recognition  Bert  Weakly_Supervised  Pose  Prediction  PDF
• 2021-05-26 Zero-shot Medical Entity Retrieval without Annotation: Learning From Rich Knowledge Graph Semantics    Luyang Kong, Christopher Winestock, Parminder Bhatia arXiv_AI arXiv_AI  Bert  Zero-Shot  Knowledge  Knowledge_Graph  Pose  Medical  PDF
• 2021-05-26 Deception detection in text and its relation to the cultural dimension of individualism/collectivism    Katerina Papantoniou, Panagiotis Papadakos, Theodore Patkos, Giorgos Flouris, Ion Androutsopoulos, Dimitris Plexousakis arXiv_CL arXiv_CL  Embedding  Bert  Knowledge  Classification  Detection  Relation  Sentiment  PDF
• 2021-05-26 SentEmojiBot: Empathising Conversations Generation with Emojis    Akhilesh Ravi, Amit Yadav, Jainish Chauhan, Jatin Dholakia, Naman Jain, Mayank Singh arXiv_CL arXiv_CL  Transformer  Bert  Knowledge  Pose  Emotion  Face  QA  PDF
• 2021-05-26 Unsupervised Pronoun Resolution via Masked Noun-Phrase Prediction    Ming Shen, Pratyay Banerjee, Chitta Baral arXiv_CL arXiv_CL  Unsupervised  Bert  Pose  Few-Shot  Prediction  PDF
• 2021-05-25 Context-Sensitive Visualization of Deep Learning Natural Language Processing Models    Andrew Dunn, Diana Inkpen, Răzvan Andonie arXiv_CL arXiv_CL  Transformer  Bert  Pose  Face  Classification  Deep_Learning  Relation  PDF
• 2021-05-25 NukeLM: Pre-Trained and Fine-Tuned Language Models for the Nuclear and Energy Domains    Lee Burke, Karl Pazdernik, Daniel Fortin, Benjamin Wilson, Rustam Goychayev, John Mattingly arXiv_CL arXiv_CL  Recognition  Bert  Text_Classification  Knowledge  Classification  Language_Model  PDF
• 2021-05-25 Super Tickets in Pre-Trained Language Models: From Model Compression to Improving Generalization    Chen Liang, Simiao Zuo, Minshuo Chen, Haoming Jiang, Xiaodong Liu, Pengcheng He, Tuo Zhao, Weizhu Chen arXiv_CL arXiv_CL  Bert  Language_Model  PDF
• 2021-05-25 Extending the Abstraction of Personality Types based on MBTI with Machine Learning and Natural Language Processing    Carlos Basto arXiv_AI arXiv_AI  Bert  Optimization  RNN  Action  Sentiment  Attention  PDF
• 2021-05-25 ConSERT: A Contrastive Framework for Self-Supervised Sentence Representation Transfer    Yuanmeng Yan, Rumei Li, Sirui Wang, Fuzheng Zhang, Wei Wu, Weiran Xu arXiv_AI arXiv_AI  Unsupervised  Bert  Self-Supervised  Contrastive_Learning  Language_Model  PDF
• 2021-05-25 ViBERTgrid: A Jointly Trained Multi-Modal 2D Document Representation for Key Information Extraction from Documents    Weihong Lin, Qifang Gao, Lei Sun, Zhuoyao Zhong, Kai Hu, Qin Ren, Qiang Huo arXiv_CV arXiv_CV  Segmentation  Embedding  Bert  Pose  Action  Detection  Object_Detection  PDF
• 2021-05-25 TR-BERT: Dynamic Token Reduction for Accelerating BERT Inference    Deming Ye, Yankai Lin, Yufei Huang, Maosong Sun arXiv_CL arXiv_CL  Reinforcement_Learning  Bert  Pose  Attention  Inference  Language_Model  PDF
• 2021-05-25 Personalized Transformer for Explainable Recommendation    Lei Li, Yongfeng Zhang, Li Chen arXiv_AI arXiv_AI  Transformer  Bert  Review  Summarization  Language_Model  Recommendation  PDF
• 2021-05-25 Multi-view 3D Reconstruction of a Texture-less Smooth Surface of Unknown Generic Reflectance    Ziang Cheng, Hongdong Li, Yuta Asano, Yinqiang Zheng, Imari Sato arXiv_CV arXiv_CV  Reconstruction  3D  Bert  Optimization  Pose  Face  PDF
• 2021-05-24 Learning Better Visual Dialog Agents with Pretrained Visual-Linguistic Representation    Tao Tu, Qing Ping, Govind Thattai, Gokhan Tur, Prem Natarajan arXiv_CV arXiv_CV  Tracking  Bert  Sparse  Pose  Relation  PDF
• 2021-05-24 Diacritics Restoration using BERT with Analysis on Czech language    Jakub Náplava, Milan Straka, Jana Straková arXiv_CL arXiv_CL  Embedding  Bert  Restoration  Pose  Prediction  PDF
• 2021-05-24 Classifying Math KCs via Task-Adaptive Pre-Trained BERT    Jia Tracy Shen, Michiharu Yamashita, Ethan Prihar, Neil Heffernan, Xintao Wu, Sean McGrew, Dongwon Lee arXiv_AI arXiv_AI  Bert  Knowledge  Pose  Classification  GAN  Prediction  PDF
• 2021-05-24 Multi-modal Understanding and Generation for Medical Images and Text via Vision-Language Pre-Training    Jong Hak Moon, Hyungyung Lee, Woncheol Shin, Edward Choi arXiv_CV arXiv_CV  Image_Caption  Transformer  Bert  Represenation_Learning  Pose  Classification  VQA  Attention  Medical  Caption  PDF
• 2021-05-24 Neural Language Models for Nineteenth-Century English    Kasra Hosseini, Kaspar Beelen, Giovanni Colavizza, Mariona Coll Ardanuy arXiv_CL arXiv_CL  Bert  Language_Model  PDF
• 2021-05-24 RobeCzech: Czech RoBERTa, a monolingual contextualized language representation model    Milan Straka, Jakub Náplava, Jana Straková, David Samuel arXiv_CL arXiv_CL  Transformer  Bert  PDF
• 2021-05-24 DaN+: Danish Nested Named Entities and Lexical Normalization    Barbara Plank, Kristian Nørgaard Jensen, Rob van der Goot arXiv_CL arXiv_CL  Recognition  Bert  PDF
• 2021-05-24 De-identification of Privacy-related Entities in Job Postings    Kristian Nørgaard Jensen, Mike Zhang, Barbara Plank arXiv_CL arXiv_CL  Transformer  Embedding  Bert  RNN  Medical  PDF
• 2021-05-24 Using Adversarial Attacks to Reveal the Statistical Bias in Machine Reading Comprehension Models    Jieyu Lin, Jiajie Zou, Nai Ding arXiv_CL arXiv_CL  Bert  Adversarial  Pose  Language_Model  PDF
• 2021-05-23 CiteWorth: Cite-Worthiness Detection for Improved Scientific Document Understanding    Dustin Wright, Isabelle Augenstein arXiv_CL arXiv_CL  Bert  Detection  Language_Model  PDF
• 2021-05-23 Killing Two Birds with One Stone: Stealing Model and Inferring Attribute from BERT-based APIs    Lingjuan Lyu, Xuanli He, Fangzhao Wu, Lichao Sun arXiv_CL arXiv_CL  Bert  Adversarial  Pose  Action  Inference  PDF
• 2021-05-22 AutoLRS: Automatic Learning-Rate Schedule by Bayesian Optimization on the Fly    Yuchen Jin, Tianyi Zhou, Liangyu Zhao, Yibo Zhu, Chuanxiong Guo, Marco Canini, Arvind Krishnamurthy arXiv_AI arXiv_AI  Transformer  Bert  Optimization  Pose  Prediction  PDF
• 2021-05-22 Denoising Noisy Neural Networks: A Bayesian Approach with Compensation    Yulin Shao, Soung Chang Liew, Deniz Gunduz arXiv_CV arXiv_CV  Bert  Denoising  Inference  PDF
• 2021-05-21 Stance Detection with BERT Embeddings for Credibility Analysis of Information on Social Media    Hema Karande, Rahee Walambe, Victor Benjamin, Ketan Kotecha, T. S. Raghu arXiv_AI arXiv_AI  Embedding  Bert  Pose  Action  Detection  Attention  PDF
• 2021-05-21 Aligning Visual Prototypes with BERT Embeddings for Few-Shot Learning    Kun Yan, Zied Bouraoui, Ping Wang, Shoaib Jameel, Steven Schockaert arXiv_CV arXiv_CV  Embedding  Bert  Pose  Few-Shot  Language_Model  PDF
• 2021-05-21 A Non-Linear Structural Probe    Jennifer C. White, Tiago Pimentel, Naomi Saphra, Ryan Cotterell arXiv_CL arXiv_CL  Bert  Regularization  Knowledge  Attention  PDF
• 2021-05-21 Towards Automatic Comparison of Data Privacy Documents: A Preliminary Experiment on GDPR-like Laws    Kornraphop Kawintiranon, Yaguang Liu arXiv_CL arXiv_CL  Bert  PDF
• 2021-05-20 Data Curation and Quality Assurance for Machine Learning-based Cyber Intrusion Detection    Haihua Chen, Ngan Tran, Anand Sagar Thumati, Jay Bhuyan, Junhua Ding arXiv_AI arXiv_AI  Bert  Pose  Deep_Learning  Detection  Attention  PDF
• 2021-05-20 A comprehensive comparative evaluation and analysis of Distributional Semantic Models    Alessandro Lenci, Magnus Sahlgren, Patrick Jeuniaux, Amaru Cuba Gyllensten, Martina Miliani arXiv_AI arXiv_AI  Transformer  Embedding  Bert  Speech  Language_Model  PDF
• 2021-05-20 Intra-Document Cascading: Learning to Select Passages for Neural Document Ranking    Sebastian Hofstätter, Bhaskar Mitra, Hamed Zamani, Nick Craswell, Allan Hanbury arXiv_CL arXiv_CL  Transformer  Bert  Knowledge  Pose  Deep_Learning  Inference  Language_Model  PDF
• 2021-05-20 KLUE: Korean Language Understanding Evaluation    Sungjoon Park, Jihyung Moon, Sungdong Kim, Won Ik Cho, Jiyoon Han, Jangwon Park, Chisung Song, Junseong Kim, Yongsook Song, Taehwan Oh, Joohong Lee, Juhyun Oh, Sungwon Lyu, Younghoon Jeong, Inkwon Lee, Sangwoo Seo, Dongjun Lee, Hyunwoo Kim, Myeonghwa Lee, Seongbo Jang, Seungwon Do, Sunkyoung Kim, Kyungtae Lim, Jongwon Lee, Kyumin Park, Jamin Shin, Seonghyun Kim, Lucy Park, Alice Oh, Jungwoo Ha, Kyunghyun Cho Alice Oh Jungwoo Ha Kyunghyun Cho arXiv_CL arXiv_CL  Tracking  Recognition  Bert  Pose  Action  Classification  Detection  Relation  Relation_Extraction  Inference  Language_Model  PDF
• 2021-05-20 Towards Target-dependent Sentiment Classification in News Articles    Felix Hamborg, Karsten Donnay, Bela Gipp arXiv_CL arXiv_CL  Bert  Sentiment_Classification  Review  Classification  Relation  Sentiment  PDF
• 2021-05-20 Dependency Parsing with Bottom-up Hierarchical Pointer Networks    Daniel Fernández-González, Carlos Gómez-Rodríguez arXiv_CL arXiv_CL  Embedding  Bert  Pose  PDF
• 2021-05-19 A Privacy-Preserving Approach to Extraction of Personal Information through Automatic Annotation and Federated Learning    Rajitha Hathurusinghe, Isar Nejadgholi, Miodrag Bolic arXiv_CL arXiv_CL  Bert  Pose  Action  GAN  PDF
• 2021-05-19 Explainable Tsetlin Machine framework for fake news detection with credibility score assessment    Bimal Bhattarai, Ole-Christoffer Granmo, Lei Jiao arXiv_AI arXiv_AI  Bert  Pose  Classification  Deep_Learning  Detection  PDF
• 2021-05-19 Combining GCN and Transformer for Chinese Grammatical Error Detection    Jinhong Zhang arXiv_CL arXiv_CL  Transformer  Embedding  Bert  Detection  PDF
• 2021-05-19 Methods for Detoxification of Texts for the Russian Language    Daryna Dementieva, Daniil Moskovskiy, Varvara Logacheva, David Dale, Olga Kozlova, Nikita Semenov, Alexander Panchenko arXiv_CL arXiv_CL  Unsupervised  Style_Transfer  Bert  PDF
• 2021-05-19 Partner Matters! An Empirical Study on Fusing Personas for Personalized Response Selection in Retrieval-Based Chatbots    Jia-Chen Gu, Hui Liu, Zhen-Hua Ling, Quan Liu, Zhigang Chen, Xiaodan Zhu arXiv_CL arXiv_CL  Transformer  Bert  Knowledge  QA  Matching  PDF
• 2021-05-19 Do Models Learn the Directionality of Relations? A New Evaluation Task: Relation Direction Recognition    Shengfei Lyu, Xingyu Wu, Jinlong Li, Qiuju Chen, Huanhuan Chen arXiv_CL arXiv_CL  Recognition  Bert  Pose  Classification  Relation  PDF
• 2021-05-19 Improving Adverse Drug Event Extraction with SpanBERT on Different Text Typologies    Beatrice Portelli, Daniele Passabì, Edoardo Lenzi, Giuseppe Serra, Enrico Santus, Emmanuele Chersoni arXiv_CL arXiv_CL  Transformer  Bert  Pose  Action  PDF
• 2021-05-18 Effective Attention Sheds Light On Interpretability    Kaiser Sun, Ana Marasović arXiv_CL arXiv_CL  Transformer  Bert  Pose  Attention  Language_Model  PDF
• 2021-05-18 DRILL: Dynamic Representations for Imbalanced Lifelong Learning    Kyra Ahrens, Fares Abawi, Stefan Wermter arXiv_CL arXiv_CL  Bert  Text_Classification  Knowledge  Pose  Classification  GAN  Language_Model  PDF
• 2021-05-18 Relation Classification with Entity Type Restriction    Shengfei Lyu, Huanhuan Chen arXiv_CL arXiv_CL  Bert  Pose  Classification  Relation  PDF
• 2021-05-17 Pay Attention to MLPs    Hanxiao Liu, Zihang Dai, David R. So, Quoc V. Le arXiv_CV arXiv_CV  Transformer  Bert  Pose  Deep_Learning  Attention  PDF
• 2021-05-16 How is BERT surprised? Layerwise detection of linguistic anomalies    Bai Li, Zining Zhu, Guillaume Thomas, Yang Xu, Frank Rudzicz arXiv_CL arXiv_CL  Transformer  Bert  Detection  Relation  Language_Model  PDF
• 2021-05-15 DirectQE: Direct Pretraining for Machine Translation Quality Estimation    Qu Cui, Shujian Huang, Jiahuan Li, Xiang Geng, Zaixiang Zheng, Guoping Huang, Jiajun Chen arXiv_CL arXiv_CL  Bert  Pose  Detection  Object_Detection  PDF
• 2021-05-15 Lexicon Enhanced Chinese Sequence Labelling Using BERT Adapter    Wei Liu, Xiyan Fu, Yue Zhang, Wenming Xiao arXiv_CL arXiv_CL  Segmentation  Recognition  Bert  Knowledge  Speech  Pose  PDF
• 2021-05-15 The Low-Dimensional Linear Geometry of Contextualized Word Representations    Evan Hernandez, Jacob Andreas arXiv_CL arXiv_CL  Bert  Relation  PDF
• 2021-05-14 BERT Busters: Outlier LayerNorm Dimensions that Disrupt BERT    Olga Kovaleva, Saurabh Kulshreshtha, Anna Rogers, Anna Rumshisky arXiv_CL arXiv_CL  Transformer  Bert  PDF
• 2021-05-14 Counterfactual Interventions Reveal the Causal Effect of Relative Clause Representations on Agreement Prediction    Shauli Ravfogel, Grusha Prasad, Tal Linzen, Yoav Goldberg arXiv_CL arXiv_CL  Bert  Pose  Language_Model  Prediction  PDF
• 2021-05-14 Classifying Long Clinical Documents with Pre-trained Transformers    Xin Su, Timothy Miller, Xiyu Ding, Majid Afshar, Dmitriy Dligach arXiv_CL arXiv_CL  Transformer  Bert  Language_Model  PDF
• 2021-05-14 Out-of-Manifold Regularization in Contextual Embedding Space for Text Classification    Seonghyeon Lee, Dongha Lee, Hwanjo Yu arXiv_AI arXiv_AI  Embedding  Bert  Text_Classification  Regularization  Pose  Classification  PDF
• 2021-05-14 DaLAJ - a dataset for linguistic acceptability judgments for Swedish: Format, baseline, sharing    Elena Volodina, Yousuf Ali Mohammed, Julia Klezl arXiv_CL arXiv_CL  Embedding  Bert  Classification  PDF
• 2021-05-13 Distilling BERT for low complexity network training    Bansidhar Mangalwedhekar arXiv_CL arXiv_CL  Bert  RNN  Sentiment  Attention  Inference  PDF
• 2021-05-13 Are Larger Pretrained Language Models Uniformly Better? Comparing Performance at the Instance Level    Ruiqi Zhong, Dhruba Ghosh, Dan Klein, Jacob Steinhardt arXiv_AI arXiv_AI  Bert  Language_Model  Prediction  PDF
• 2021-05-12 Better than BERT but Worse than Baseline    Boxiang Liu, Jiaji Huang, Xingyu Cai, Kenneth Church arXiv_CL arXiv_CL  Bert  PDF
• 2021-05-12 Go Beyond Plain Fine-tuning: Improving Pretrained Models for Social Commonsense    Ting-Yun Chang, Yang Liu, Karthik Gopalakrishnan, Behnam Hedayatnia, Pei Zhou, Dilek Hakkani-Tur arXiv_CL arXiv_CL  Bert  Pose  Emotion  Language_Model  QA  PDF
• 2021-05-12 MATE-KD: Masked Adversarial TExt, a Companion to Knowledge Distillation    Ahmad Rashid, Vasileios Lioutas, Mehdi Rezagholizadeh arXiv_CL arXiv_CL  Bert  Knowledge  Adversarial  Language_Model  PDF
• 2021-05-12 Playing Codenames with Language Graphs and Word Embeddings    Divya Koyyalagunta, Anna Sun, Rachel Lea Draelos, Cynthia Rudin arXiv_AI arXiv_AI  Embedding  Bert  Pose  Relation  Language_Model  PDF
• 2021-05-12 Kleister: Key Information Extraction Datasets Involving Long Documents with Complex Layouts    Tomasz Stanisławek, Filip Graliński, Anna Wróblewska, Dawid Lipiński, Agnieszka Kaliska, Paulina Rosalska, Bartosz Topolski, Przemysław Biecek arXiv_CL arXiv_CL  Bert  Pose  Action  GAN  PDF
• 2021-05-12 Building a Question and Answer System for News Domain    Sandipan Basu, Aravind Gaddala, Pooja Chetan, Garima Tiwari, Narayana Darapaneni, Sadwik Parvathaneni, Anwesh Reddy Paduri arXiv_AI arXiv_AI  Transformer  Embedding  Transfer_Learning  Bert  RNN  Attention  PDF
• 2021-05-12 BertGCN: Transductive Text Classification by Combining GCN and BERT    Yuxiao Lin, Yuxian Meng, Xiaofei Sun, Qinghong Han, Kun Kuang, Jiwei Li, Fei Wu arXiv_CL arXiv_CL  Bert  Text_Classification  Pose  Classification  PDF
• 2021-05-12 Priberam at MESINESP Multi-label Classification of Medical Texts Task    Ruben Cardoso, Zita Marinho, Afonso Mendes, Sebastião Miranda arXiv_CL arXiv_CL  Bert  Classification  Medical  Recommendation  PDF
• 2021-05-12 Priberam Labs at the NTCIR-15 SHINRA2020-ML: Classification Task    Ruben Cardoso, Afonso Mendes, Andre Lamurias arXiv_CL arXiv_CL  Embedding  Bert  Zero-Shot  Knowledge  Pose  Ontology  Classification  GAN  PDF
• 2021-05-12 Evaluating Gender Bias in Natural Language Inference    Shanya Sharma, Manan Dey, Koustuv Sinha arXiv_CL arXiv_CL  Bert  Pose  Detection  Inference  Prediction  PDF
• 2021-05-12 OCHADAI-KYODAI at SemEval-2021 Task 1: Enhancing ModelGeneralization and Robustness for Lexical Complexity Prediction    Yuki Taya, Lis Kanashiro Pereira, Fei Cheng, Ichiro Kobayashi arXiv_CL arXiv_CL  Transformer  Bert  Adversarial  Pose  Prediction  PDF
• 2021-05-12 UIUC_BioNLP at SemEval-2021 Task 11: A Cascade of Neural Models for Structuring Scholarly NLP Contributions    Haoyang Liu, M. Janina Sarol, Halil Kilicoglu arXiv_CL arXiv_CL  Recognition  Bert  Pose  Action  Classification  PDF
• 2021-05-11 Addressing 'Documentation Debt' in Machine Learning Research: A Retrospective Datasheet for BookCorpus    Jack Bandy, Nicholas Vincent arXiv_CL arXiv_CL  Bert  Sparse  Language_Model  PDF
• 2021-05-11 Integrating extracted information from bert and multiple embedding methods with the deep neural network for humour detection    Rida Miraj, Masaki Aono arXiv_AI arXiv_AI  Embedding  Bert  Pose  Detection  Language_Model  PDF
• 2021-05-11 BERT is to NLP what AlexNet is to CV: Can Pre-Trained Language Models Identify Analogies?    Asahi Ushio, Luis Espinosa-Anke, Steven Schockaert, Jose Camacho-Collados arXiv_CL arXiv_CL  Transformer  Embedding  Unsupervised  Bert  Knowledge  Relation  Attention  Language_Model  PDF
• 2021-05-11 Role of Artificial Intelligence in Detection of Hateful Speech for Hinglish Data on Social Media    Ananya Srivastava, Mohammed Hasan, Bhargav Yagnik, Rahee Walambe, Ketan Kotecha arXiv_CL arXiv_CL  Transformer  Embedding  Bert  Speech  Pose  Detection  Language_Model  PDF
• 2021-05-11 Benchmarking down-scaled pre-trained language models    M. Aßenmacher, P. Schulze, C. Heumann arXiv_CL arXiv_CL  Transformer  Bert  Language_Model  PDF
• 2021-05-10 Assessing the Syntactic Capabilities of Transformer-based Multilingual Language Models    Laura Pérez-Mayos, Alba Táboas García, Simon Mille, Leo Wanner arXiv_CL arXiv_CL  Transformer  Bert  Optimization  Language_Model  PDF
• 2021-05-10 R2D2: Relational Text Decoding with Transformers    Aryan Arbabi, Mingqiu Wang, Laurent El Shafey, Nan Du, Izhak Shafran arXiv_CL arXiv_CL  Transformer  Bert  Pose  Action  Relation  Attention  Text_Generation  Medical  PDF
• 2021-05-10 Automatic Classification of Human Translation and Machine Translation: A Study from the Perspective of Lexical Diversity    Yingxue Fu, Mark-Jan Nederhof arXiv_CL arXiv_CL  Bert  Classification  Relation  Attention  PDF
• 2021-05-10 SRLF: A Stance-aware Reinforcement Learning Framework for Content-based Rumor Detection on Social Media    Chunyuan Yuan, Wanhui Qian, Qianwen Ma, Wei Zhou, Songlin Hu arXiv_AI arXiv_AI  Reinforcement_Learning  Bert  Pose  Detection  PDF
• 2021-05-09 Which transformer architecture fits my data? A vocabulary bottleneck in self-attention    Noam Wies, Yoav Levine, Daniel Jannai, Amnon Shashua arXiv_CL arXiv_CL  Transformer  Embedding  Bert  Attention  PDF
• 2021-05-09 FNet: Mixing Tokens with Fourier Transforms    James Lee-Thorp, Joshua Ainslie, Ilya Eckstein, Santiago Ontanon arXiv_CL arXiv_CL  Transformer  Bert  Text_Classification  Classification  Relation  Attention  Matching  PDF
• 2021-05-08 Enhancing Transformers with Gradient Boosted Decision Trees for NLI Fine-Tuning    Benjamin Minixhofer, Milan Gritta, Ignacio Iacobacci arXiv_CL arXiv_CL  Transformer  Transfer_Learning  Bert  Classification  Inference  Language_Model  PDF
• 2021-05-08 NLP-IIS@UT at SemEval-2021 Task 4: Machine Reading Comprehension using the Long Document Transformer    Hossein Basafa, Sajad Movahedi, Ali Ebrahimi, Azadeh Shakery, Heshaam Faili arXiv_CL arXiv_CL  Transformer  Bert  Pose  Language_Model  PDF
• 2021-05-07 Understanding by Understanding Not: Modeling Negation in Language Models    Arian Hosseini, Siva Reddy, Dzmitry Bahdanau, R Devon Hjelm, Alessandro Sordoni, Aaron Courville arXiv_CL arXiv_CL  Bert  Pose  Language_Model  PDF
• 2021-05-07 Empirical Evaluation of Pre-trained Transformers for Human-Level NLP: The Role of Sample Size and Dimensionality    Adithya V Ganesan, Matthew Matero, Aravind Reddy Ravula, Huy Vu, H. Andrew Schwartz arXiv_CL arXiv_CL  Transformer  Embedding  Bert  Pose  Language_Model  PDF
• 2021-05-07 Adapting by Pruning: A Case Study on BERT    Yang Gao, Nicolo Colombo, Wei Wang arXiv_CL arXiv_CL  Bert  Pose  PDF
• 2021-05-06 Aligning Subtitles in Sign Language Videos    Hannah Bull, Triantafyllos Afouras, Gül Varol, Samuel Albanie, Liliane Momeni, Andrew Zisserman arXiv_CV arXiv_CV  Transformer  Embedding  Recognition  Bert  Pose  Attention  Prediction  PDF
• 2021-05-06 Adapting Monolingual Models: Data can be Scarce when Language Similarity is High    Wietse de Vries, Martijn Bartelds, Malvina Nissim, Martijn Wieling arXiv_CL arXiv_CL  Transformer  Transfer_Learning  Bert  Zero-Shot  PDF
• 2021-05-06 Introducing Information Retrieval for Biomedical Informatics Students    Sanya B. Taneja, Richard D. Boyce, William T. Reynolds, Denis Newman-Griffis arXiv_CL arXiv_CL  Bert  Medical  Language_Model  PDF
• 2021-05-06 Bird's Eye: Probing for Linguistic Graph Structures with a Simple Information-Theoretic Approach    Yifan Hou, Mrinmaya Sachan arXiv_CL arXiv_CL  Bert  Pose  PDF
• 2021-05-06 TABBIE: Pretrained Representations of Tabular Data    Hiroshi Iida, Dung Thai, Varun Manjunatha, Mohit Iyyer arXiv_CL arXiv_CL  Embedding  Bert  Represenation_Learning  Self-Supervised  Detection  Language_Model  Prediction  PDF
• 2021-05-06 Exploring Explicit and Implicit Visual Relationships for Image Captioning    Zeliang Song, Xiaofei Zhou arXiv_CV arXiv_CV  Image_Caption  Transformer  Bert  Salient  Pose  Action  Relation  Visual_Relation  Caption  CNN  PDF
• 2021-05-05 Rare Disease Identification from Clinical Notes with Ontologies and Weak Supervision    Hang Dong, Víctor Suárez-Paniagua, Huayu Zhang, Minhong Wang, Emma Whitfield, Honghan Wu arXiv_CL arXiv_CL  Transformer  Bert  Pose  Ontology  Face  Medical  Matching  PDF
• 2021-05-04 HerBERT: Efficiently Pretrained Transformer-based Language Model for Polish    Robert Mroczkowski, Piotr Rybak, Alina Wróblewska, Ireneusz Gawlik arXiv_CL arXiv_CL  Transformer  Bert  Knowledge  Pose  Language_Model  PDF
• 2021-05-03 Unreasonable Effectiveness of Rule-Based Heuristics in Solving Russian SuperGLUE Tasks    Tatyana Iazykova, Denis Kapelyushnik, Olga Bystrova, Andrey Kutuzov arXiv_CL arXiv_CL  Bert  Language_Model  Recommendation  PDF
• 2021-05-03 Goldilocks: Just-Right Tuning of BERT for Technology-Assisted Review    Eugene Yang, Sean MacAvaney, David D. Lewis, Ophir Frieder arXiv_CL arXiv_CL  Transformer  Bert  Text_Classification  Review  Classification  Language_Model  PDF
• 2021-05-03 Leveraging Deep Representations of Radiology Reports in Survival Analysis for Predicting Heart Failure Patient Mortality    Hyun Gi Lee, Evan Sholle, Ashley Beecy, Subhi Al'Aref, Yifan Peng arXiv_CL arXiv_CL  Bert  Action  Prediction  PDF
• 2021-05-03 Looking for COVID-19 misinformation in multilingual social media texts    Raj Ratn Pranesh, Mehrdad Farokhnejad, Ambesh Shekhar, Genoveva Vargas-Solar arXiv_CL arXiv_CL  Bert  Pose  PDF
• 2021-05-02 Larger-Scale Transformers for Multilingual Masked Language Modeling    Naman Goyal, Jingfei Du, Myle Ott, Giri Anantharaman, Alexis Conneau arXiv_CL arXiv_CL  Transformer  Bert  Language_Model  PDF
• 2021-05-02 Augmenting Sequential Recommendation with Pseudo-Prior Items via Reversely Pre-training Transformer    Zhiwei Liu, Ziwei Fan, Yu Wang, Philip S. Yu arXiv_AI arXiv_AI  Transformer  Bert  Pose  Relation  Recommendation  PDF
• 2021-05-02 MathBERT: A Pre-Trained Model for Mathematical Formula Understanding    Shuai Peng, Ke Yuan, Liangcai Gao, Zhi Tang arXiv_AI arXiv_AI  Bert  Knowledge  Pose  Classification  PDF
• 2021-05-01 When to Fold'em: How to answer Unanswerable questions    Marshall Ho, Zhipeng Zhou, Judith He arXiv_CL arXiv_CL  Bert  Language_Model  QA  PDF
• 2021-05-01 MRCBert: A Machine Reading ComprehensionApproach for Unsupervised Summarization    Saurabh Jain, Guokai Tang, Lim Sze Chi arXiv_AI arXiv_AI  Unsupervised  Transfer_Learning  Bert  Review  Summarization  PDF
• 2021-04-30 Paraphrastic Representations at Scale    John Wieting, Kevin Gimpel, Graham Neubig, Taylor Berg-Kirkpatrick arXiv_CL arXiv_CL  Unsupervised  Bert  Inference  PDF
• 2021-04-30 BERT Meets Relational DB: Contextual Representations of Relational Databases    Siddhant Arora, Vinayak Gupta, Garima Gaur, Srikanta Bedathur arXiv_CL arXiv_CL  Embedding  Bert  Represenation_Learning  Relation  Attention  PDF
• 2021-04-30 Chop Chop BERT: Visual Question Answering by Chopping VisualBERT's Heads    Chenyu Gao, Qi Zhu, Peng Wang, Qi Wu arXiv_CV arXiv_CV  Transformer  Bert  VQA  Attention  QA  PDF
• 2021-04-29 The Interspeech Zero Resource Speech Challenge 2021: Spoken language modelling    Ewan Dunbar, Mathieu Bernard, Nicolas Hamilakis, Tu Anh Nguyen, Maureen de Seyssel, Patricia Rozé, Morgane Rivière, Eugene Kharitonov, Emmanuel Dupoux arXiv_AI arXiv_AI  Bert  RNN  Speech  Language_Model  PDF
• 2021-04-29 Let's Play Mono-Poly: BERT Can Reveal Words' Polysemy Level and Partitionability into Senses    Aina Garí Soler, Marianna Apidianaki arXiv_CL arXiv_CL  Embedding  Bert  Knowledge  Pose  Language_Model  PDF
• 2021-04-28 Multi-Task Learning of Query Intent and Named Entities using Transfer Learning    Shalin Shah, Ryan Siskind arXiv_CL arXiv_CL  Transfer_Learning  Recognition  Bert  Deep_Learning  PDF
• 2021-04-28 Improving BERT Model Using Contrastive Learning for Biomedical Relation Extraction    Peng Su, Yifan Peng, K. Vijay-Shanker arXiv_CL arXiv_CL  Bert  Knowledge  Contrastive_Learning  Action  Relation  Relation_Extraction  Medical  Prediction  PDF
• 2021-04-28 Societal Biases in Retrieved Contents: Measurement Framework and Adversarial Mitigation for BERT Rankers    Navid Rekabsaz, Simone Kopeinik, Markus Schedl arXiv_AI arXiv_AI  Bert  Adversarial  Pose  Deep_Learning  PDF
• 2021-04-28 MelBERT: Metaphor Detection via Contextualized Late Interaction using Metaphorical Identification Theories    Minjin Choi, Sunkyung Lee, Eunseong Choi, Heesoo Park, Junhyuk Lee, Dongwon Lee, Jongwuk Lee arXiv_CL arXiv_CL  Bert  Pose  Action  Detection  PDF
• 2021-04-28 AraStance: A Multi-Country and Multi-Domain Dataset of Arabic Stance Detection for Fact Checking    Tariq Alhindi, Amal Alabdulkarim, Ali Alshehri, Muhammad Abdul-Mageed, Preslav Nakov arXiv_CL arXiv_CL  Bert  Detection  Prediction  PDF
• 2021-04-27 Semi-supervised Interactive Intent Labeling    Saurav Sahay, Eda Okur, Nagib Hakim, Lama Nachman arXiv_CL arXiv_CL  Embedding  Enhancement  Bert  PDF
• 2021-04-27 UoT-UWF-PartAI at SemEval-2021 Task 5: Self Attention Based Bi-GRU with Multi-Embedding Representation for Toxicity Highlighter    Hamed Babaei Giglou, Taher Rahgooy, Mostafa Rahgouy, Jafar Razmara arXiv_CL arXiv_CL  Embedding  Bert  Pose  Detection  Attention  PDF
• 2021-04-26 Computational Performance of Deep Reinforcement Learning to find Nash Equilibria    Christoph Graf, Viktor Zobernig, Johannes Schmidt, Claude Klöckl arXiv_AI arXiv_AI  Reinforcement_Learning  Bert  Pose  Action  PDF
• 2021-04-26 Phrase break prediction with bidirectional encoder representations in Japanese text-to-speech synthesis    Kosuke Futamata, Byeongseon Park, Ryuichi Yamamoto, Kentaro Tachibana arXiv_CL arXiv_CL  Bert  RNN  Speech  Pose  Language_Model  Prediction  PDF
• 2021-04-25 Potential Idiomatic Expression -English: Corpus for Classes of Idioms    Tosin P. Adewumi, Saleha Javed, Roshanak Vadoodi, Aparajita Tripathy, Konstantina Nikolaidou, Foteini Liwicki, Marcus Liwicki arXiv_CL arXiv_CL  Bert  Knowledge  Speech  Classification  PDF
• 2021-04-24 Extract then Distill: Efficient and Effective Task-Agnostic BERT Distillation    Cheng Chen, Yichun Yin, Lifeng Shang, Zhi Wang, Xin Jiang, Xiao Chen, Qun Liu arXiv_CL arXiv_CL  Bert  Knowledge  Pose  PDF
• 2021-04-23 Playing Lottery Tickets with Vision and Language    Zhe Gan, Yen-Chun Chen, Linjie Li, Tianlong Chen, Yu Cheng, Shuohang Wang, Jingjing Liu arXiv_CV arXiv_CV  Transformer  Bert  Adversarial  VQA  QA  Matching  PDF
• 2021-04-23 Towards Trustworthy Deception Detection: Benchmarking Model Robustness across Domains, Modalities, and Languages    Maria Glenski, Ellyn Ayton, Robin Cosbey, Dustin Arendt, Svitlana Volkova arXiv_CL arXiv_CL  Embedding  Bert  Text_Classification  RNN  Classification  Detection  PDF
• 2021-04-23 Claim Detection in Biomedical Twitter Posts    Amelie Wührl, Roman Klinger arXiv_CL arXiv_CL  Embedding  Transfer_Learning  Bert  Classification  Detection  Medical  PDF
• 2021-04-23 QMUL-SDS at SCIVER: Step-by-Step Binary Classification for Scientific Claim Verification    Xia Zeng, Arkaitz Zubiaga arXiv_CL arXiv_CL  Bert  Pose  Classification  Prediction  PDF
• 2021-04-23 Optimizing small BERTs trained for German NER    Jochen Zöllner, Konrad Sperfeld, Christoph Wick, Roger Labahn arXiv_AI arXiv_AI  Bert  Pose  Language_Model  PDF
• 2021-04-23 Multimodal Fusion with BERT and Attention Mechanism for Fake News Detection    Nguyen Manh Duc Tuan, Pham Quang Nhat Minh arXiv_CL arXiv_CL  Bert  Pose  Detection  Relation  Attention  PDF
• 2021-04-23 Analysing Cyberbullying using Natural Language Processing by Understanding Jargon in Social Media    Bhumika Bhatia, Anuj Verma, Anjum, Rahul Katarya arXiv_CL arXiv_CL  Bert  RNN  Speech  Action  Classification  PDF
• 2021-04-23 Literature review on vulnerability detection using NLP technology    Jiajie Wu arXiv_AI arXiv_AI  Bert  Review  Face  Survey  Detection  PDF
• 2021-04-23 BERT-CoQAC: BERT-based Conversational Question Answering in Context    Munazza Zaib, Dai Hoang Tran, Subhash Sagar, Adnan Mahmood, Wei E. Zhang, Quan Z. Sheng arXiv_CL arXiv_CL  Bert  Pose  Language_Model  QA  PDF
• 2021-04-22 On Geodesic Distances and Contextual Embedding Compression for Text Classification    Rishi Jha, Kai Mihata arXiv_CL arXiv_CL  Transformer  Embedding  Bert  Text_Classification  Pose  Classification  PDF
• 2021-04-22 COVID-19 and Big Data: Multi-faceted Analysis for Spatio-temporal Understanding of the Pandemic with Social Media Conversations    Shayan Fazeli, Davina Zamanzadeh, Anaelia Ovalle, Thu Nguyen, Gilbert Gee, Majid Sarrafzadeh arXiv_CL arXiv_CL  Tracking  Bert  Pose  Face  Attention  PDF
• 2021-04-21 Disfluency Detection with Unlabeled Data and Small BERT Models    Johann C. Rocholl, Vicky Zayats, Daniel D. Walker, Noah B. Murad, Aaron Schneider, Daniel J. Liebling arXiv_CL arXiv_CL  Recognition  Bert  Speech  Detection  Speech_Recognition  Inference  PDF
• 2021-04-21 Using CNNs for AD classification based on spatial correlation of BOLD signals during the observation    Nazanin Beheshti, Lennart Johnsson arXiv_CV arXiv_CV  Bert  Classification  Relation  CNN  PDF
• 2021-04-21 Improving BERT Pretraining with Syntactic Supervision    Giorgos Tziafas, Konstantinos Kogkalidis, Gijs Wijnholds, Michael Moortgat arXiv_CL arXiv_CL  Transformer  Unsupervised  Bert  PDF
• 2021-04-21 PALI at SemEval-2021 Task 2: Fine-Tune XLM-RoBERTa for Word in Context Disambiguation    Shuyi Xie, Jian Ma, Haiqin Yang, Lianxin Jiang, Yang Mo, Jianping Shen arXiv_AI arXiv_AI  Embedding  Bert  Adversarial  Prediction  PDF
• 2021-04-21 Sattiy at SemEval-2021 Task 9: An Ensemble Solution for Statement Verification and Evidence Finding with Tables    Xiaoyi Ruan, Meizhi Jin, Jian Ma, Haiqin Yang, Lianxin Jiang, Yang Mo, Mengyuan Zhou arXiv_AI arXiv_AI  Bert  Language_Model  PDF
• 2021-04-21 Discriminative Self-training for Punctuation Prediction    Qian Chen, Wen Wang, Mengzhe Chen, Qinglin Zhang arXiv_CL arXiv_CL  Recognition  Bert  Speech  Pose  Speech_Recognition  Prediction  PDF
• 2021-04-20 UIT-ISE-NLP at SemEval-2021 Task 5: Toxic Spans Detection with BiLSTM-CRF and Toxic Bert Comment Classification    Son T. Luu, Ngan Luu-Thuy Nguyen arXiv_CL arXiv_CL  Bert  RNN  Classification  Detection  PDF
• 2021-04-20 Measuring Shifts in Attitudes Towards COVID-19 Measures in Belgium Using Multilingual BERT    Kristen Scott, Pieter Delobelle, Bettina Berendt arXiv_CL arXiv_CL  Bert  PDF
• 2021-04-20 X-METRA-ADA: Cross-lingual Meta-Transfer Learning Adaptation to Natural Language Understanding and Question Answering    Meryem M'hamdi, Doo Soon Kim, Franck Dernoncourt, Trung Bui, Xiang Ren, Jonathan May arXiv_CL arXiv_CL  Transfer_Learning  Bert  Zero-Shot  Optimization  Pose  Attention  PDF
• 2021-04-20 Efficient pre-training objectives for Transformers    Luca Di Liello, Matteo Gabburo, Alessandro Moschitti arXiv_CL arXiv_CL  Transformer  Bert  Pose  PDF
• 2021-04-19 Modeling 'Newsworthiness' for Lead-Generation Across Corpora    Alexander Spangher, Nanyun Peng, Jonathan May, Emilio Ferrara arXiv_CL arXiv_CL  Bert  Pose  PDF
• 2021-04-19 Neural Language Models with Distant Supervision to Identify Major Depressive Disorder from Clinical Notes    Bhavani Singh Agnikula Kshatriya, Nicolas A Nunez, Manuel Gardea- Resendez, Euijung Ryu, Brandon J Coombes, Sunyang Fu, Mark A Frye, Joanna M Biernacka, Yanshan Wang arXiv_AI arXiv_AI  Transformer  Unsupervised  Bert  Text_Classification  Pose  Classification  Language_Model  PDF
• 2021-04-19 Operationalizing a National Digital Library: The Case for a Norwegian Transformer Model    Per E Kummervold, Javier de la Rosa, Freddy Wetjen, Svein Arne Brygfjeld arXiv_CL arXiv_CL  Transformer  Recognition  OCR  Bert  Optical_Character  Classification  Language_Model  PDF
• 2021-04-19 PyPlutchik: visualising and comparing emotion-annotated corpora    Alfonso Semeraro, Salvatore Vilella, Giancarlo Ruffo arXiv_CL arXiv_CL  Bert  Pose  Emotion  Detection  PDF
• 2021-04-19 Understanding Chinese Video and Language via Contrastive Multimodal Pre-Training    Chenyi Lei, Shixian Luo, Yong Liu, Wanggui He, Jiamang Wang, Guoxin Wang, Haihong Tang, Chunyan Miao, Houqiang Li arXiv_CV arXiv_CV  Bert  Pose  Contrastive_Learning  Relation  Language_Model  PDF
• 2021-04-19 Probing for Bridging Inference in Transformer Language Models    Onkar Pandit, Yufang Hou arXiv_CL arXiv_CL  Transformer  Bert  Relation  Attention  Inference  Language_Model  Prediction  PDF
• 2021-04-19 BERTić -- The Transformer Language Model for Bosnian, Croatian, Montenegrin and Serbian    Nikola Ljubešić, Davor Lauc arXiv_CL arXiv_CL  Transformer  Recognition  Bert  Speech  Face  Language_Model  Prediction  PDF
• 2021-04-19 BigGreen at SemEval-2021 Task 1: Lexical Complexity Prediction with Assembly Models    Aadil Islam, Weicheng Ma, Soroush Vosoughi arXiv_AI arXiv_AI  Transformer  Bert  Attention  Prediction  PDF
• 2021-04-19 Sentiment Classification in Swahili Language Using Multilingual BERT    Gati L. Martin, Medard E. Mswahili, Young-Seob Jeong arXiv_CL arXiv_CL  Bert  Sentiment_Classification  Review  Speech  Emotion  Classification  Sentiment  PDF
• 2021-04-18 Language in a Box: Grounding Language Learning in Real-World Human-Machine Interaction    Federico Bianchi, Ciro Greco, Jacopo Tagliabue arXiv_CL arXiv_CL  Unsupervised  Bert  Zero-Shot  Action  Inference  Language_Model  PDF
• 2021-04-18 SimCSE: Simple Contrastive Learning of Sentence Embeddings    Tianyu Gao, Xingcheng Yao, Danqi Chen arXiv_CL arXiv_CL  Embedding  Unsupervised  Bert  Contrastive_Learning  Relation  Inference  PDF
• 2021-04-18 FedNLP: A Research Platform for Federated Learning in Natural Language Processing    Bill Yuchen Lin, Chaoyang He, Zihang Zeng, Hulin Wang, Yufen Huang, Mahdi Soltanolkotabi, Xiang Ren, Salman Avestimehr arXiv_AI arXiv_AI  Transformer  Bert  Text_Classification  Face  Classification  GAN  Language_Model  PDF
• 2021-04-18 Keyphrase Generation with Fine-Grained Evaluation-Guided Reinforcement Learning    Yichao Luo, Yige Xu, Jiacheng Ye, Xipeng Qiu, Qi Zhang arXiv_CL arXiv_CL  Reinforcement_Learning  Bert  Pose  Prediction  PDF
• 2021-04-18 Zero-shot Cross-lingual Transfer of Neural Machine Translation with Multilingual Pretrained Encoders    Guanhua Chen, Shuming Ma, Yun Chen, Li Dong, Dongdong Zhang, Jia Pan, Wenping Wang, Furu Wei arXiv_CL arXiv_CL  Bert  Zero-Shot  Pose  NMT  PDF
• 2021-04-18 CEAR: Cross-Entity Aware Reranker for Knowledge Base Completion    Keshav Kolluru, Mayank Singh Chauhan, Yatin Nandwani, Parag Singla, Mausam arXiv_CL arXiv_CL  Embedding  Bert  Knowledge  Attention  Language_Model  Prediction  PDF
• 2021-04-18 Rethinking Network Pruning -- under the Pre-train and Fine-tune Paradigm    Dongkuan Xu, Ian E.H. Yen, Jinxi Zhao, Zhibin Xiao arXiv_AI arXiv_AI  Transformer  Bert  Sparse  Knowledge  CNN  Language_Model  Prediction  PDF
• 2021-04-18 Dual-View Distilled BERT for Sentence Embedding    Xingyi Cheng arXiv_AI arXiv_AI  Embedding  Bert  Pose  Action  Attention  Matching  PDF
• 2021-04-18 When Does Pretraining Help? Assessing Self-Supervised Learning for Law and the CaseHOLD Dataset    Lucia Zheng, Neel Guha, Brandon R. Anderson, Peter Henderson, Daniel E. Ho arXiv_CL arXiv_CL  Transformer  Embedding  Bert  RNN  Self-Supervised  PDF
• 2021-04-18 Worst of Both Worlds: Biases Compound in Pre-trained Vision-and-Language Models    Tejas Srinivasan, Yonatan Bisk arXiv_CL arXiv_CL  Bert  Attention  Language_Model  PDF
• 2021-04-17 DiS-ReX: A Multilingual Dataset for Distantly Supervised Relation Extraction    Abhyuday Bhartiya, Kartikeya Badola, Mausam arXiv_CL arXiv_CL  Bert  Pose  Action  Relation  Relation_Extraction  Attention  PDF
• 2021-04-17 IITP in COLIEE@ICAIL 2019: Legal Information Retrieval usingBM25 and BERT    Baban Gain, Dibyanayan Bandyopadhyay, Tanik Saikh, Asif Ekbal arXiv_AI arXiv_AI  Bert  Action  Deep_Learning  PDF
• 2021-04-17 Improving Zero-Shot Cross-Lingual Transfer Learning via Robust Training    Kuan-Hao Huang, Wasi Uddin Ahmad, Nanyun Peng, Kai-Wei Chang arXiv_CL arXiv_CL  Embedding  Transfer_Learning  Bert  Zero-Shot  Text_Classification  Adversarial  Pose  Classification  Language_Model  PDF
• 2021-04-17 UPB at SemEval-2021 Task 5: Virtual Adversarial Training for Toxic Spans Detection    Andrei Paraschiv, Dumitru-Clementin Cercel, Mihai Dascalu arXiv_CL arXiv_CL  Transformer  Bert  Adversarial  Detection  PDF
• 2021-04-17 Emotion Classification in a Resource Constrained Language Using Transformer-based Approach    Avishek Das, Omar Sharif, Mohammed Moshiul Hoque, Iqbal H. Sarker arXiv_CL arXiv_CL  Transformer  Bert  RNN  Pose  Emotion  Classification  PDF
• 2021-04-17 Multi-source Neural Topic Modeling in Multi-view Embedding Spaces    Pankaj Gupta, Yatin Chaudhary, Hinrich Schütze arXiv_AI arXiv_AI  Embedding  Bert  Sparse  Knowledge  Medical  PDF
• 2021-04-17 The Topic Confusion Task: A Novel Scenario for Authorship Attribution    Malik H. Altakrori (1 and 3), Jackie Chi Kit Cheung (1 and 3), Benjamin C. M. Fung (2 and 3) ((1) School of Computer Science -McGill University, (2) School of Information Studies-McGill University, (3) Mila) arXiv_CL arXiv_CL  Bert  Speech  Pose  Language_Model  PDF
• 2021-04-17 Learning to Share by Masking the Non-shared for Multi-domain Sentiment Classification    Jianhua Yuan, Yanyan Zhao, Bing Qin, Ting Liu arXiv_CL arXiv_CL  Bert  Sentiment_Classification  Knowledge  Pose  Classification  Sentiment  PDF
• 2021-04-17 Frequency-based Distortions in Contextualized Word Embeddings    Kaitlyn Zhou, Kawin Ethayarajh, Dan Jurafsky arXiv_CL arXiv_CL  Embedding  Bert  Relation  PDF
• 2021-04-17 A multilabel approach to morphosyntactic probing    Naomi Tachikawa Shapiro, Amandalynne Paullada, Shane Steinert-Threlkeld arXiv_CL arXiv_CL  Embedding  Bert  Zero-Shot  Language_Model  PDF
• 2021-04-17 Hierarchical Transformer Networks for Longitudinal Clinical Document Classification    Yuqi Si, Kirk Roberts arXiv_CL arXiv_CL  Transformer  Bert  Pose  Classification  Prediction  PDF
• 2021-04-17 Identifying the Limits of Cross-Domain Knowledge Transfer for Pretrained Models    Zhengxuan Wu, Nelson F. Liu, Christopher Potts arXiv_CL arXiv_CL  Embedding  Bert  RNN  Knowledge  Classification  Language_Model  PDF
• 2021-04-16 BERT memorisation and pitfalls in low-resource scenarios    Michael Tänzer, Sebastian Ruder, Marek Rei arXiv_CL arXiv_CL  Recognition  Bert  Pose  Few-Shot  PDF
• 2021-04-16 Membership Inference Attack Susceptibility of Clinical Language Models    Abhyuday Jagannatha, Bhanu Pratap Singh Rawat, Hong Yu arXiv_CL arXiv_CL  Bert  Medical  Inference  Language_Model  PDF
• 2021-04-16 Capturing Row and Column Semantics in Transformer Based Question Answering over Tables    Michael Glass, Mustafa Canim, Alfio Gliozzo, Saneem Chemmengath, Rishav Chakravarti, Avi Sil, Feifei Pan, Samarth Bharadwaj, Nicolas Rodolfo Fauceglia arXiv_AI arXiv_AI  Transformer  Embedding  Bert  Pose  Action  QA  PDF
• 2021-04-16 AMMU -- A Survey of Transformer-based Biomedical Pretrained Language Models    Katikapalli Subramanyam Kalyan, Ajit Rajasekharan, Sivanesan Sangeetha arXiv_AI arXiv_AI  Transformer  Embedding  Transfer_Learning  Bert  Self-Supervised  Survey  Medical  Language_Model  PDF
• 2021-04-16 Data Augmentation for Voice-Assistant NLU using BERT-based Interchangeable Rephrase    Akhila Yerukola, Mason Bretan, Hongxia Jin arXiv_CL arXiv_CL  Bert  Classification  Attention  PDF
• 2021-04-16 Editing Factual Knowledge in Language Models    Nicola De Cao, Wilker Aziz, Ivan Titov arXiv_AI arXiv_AI  Bert  Optimization  Knowledge  Inference  Language_Model  Prediction  PDF
• 2021-04-16 Towards Variable-Length Textual Adversarial Attacks    Junliang Guo, Zhirui Zhang, Linlin Zhang, Linli Xu, Boxing Chen, Enhong Chen, Weihua Luo arXiv_CL arXiv_CL  Bert  Adversarial  Pose  Classification  PDF
• 2021-04-16 Temporal Adaptation of BERT and Performance on Downstream Document Classification: Insights from Social Media    Paul Röttger, Janet B. Pierrehumbert arXiv_CL arXiv_CL  Bert  Pose  Classification  Language_Model  PDF
• 2021-04-16 Fast, Effective and Self-Supervised: Transforming Masked LanguageModels into Universal Lexical and Sentence Encoders    Fangyu Liu, Ivan Vulić, Anna Korhonen, Nigel Collier arXiv_AI arXiv_AI  Bert  Knowledge  Self-Supervised  Pose  Contrastive_Learning  Language_Model  PDF
• 2021-04-16 BERT2Code: Can Pretrained Language Models be Leveraged for Code Search?    Abdullah Al Ishtiaq, Masum Hasan, Md. Mahim Anjum Haque, Kazi Sajeed Mehrab, Tanveer Muttaqueen, Tahmid Hasan, Anindya Iqbal, Rifat Shahriyar arXiv_CL arXiv_CL  Embedding  Bert  Relation  Language_Model  PDF
• 2021-04-16 Probing Across Time: What Does RoBERTa Know and When?    Leo Z. Liu, Yizhong Wang, Jungo Kasai, Hannaneh Hajishirzi, Noah A. Smith arXiv_CL arXiv_CL  Bert  Knowledge  Action  Language_Model  PDF
• 2021-04-16 Are Classes Clusters?    Kees Varekamp arXiv_CL arXiv_CL  Embedding  Unsupervised  Bert  Text_Classification  Review  Pose  Classification  PDF
• 2021-04-15 Sublanguage: A Serious Issue Affects Pretrained Models in Legal Domain    Ha-Thanh Nguyen, Le-Minh Nguyen arXiv_AI arXiv_AI  Bert  Knowledge  Pose  Deep_Learning  PDF
• 2021-04-15 Does BERT Pretrained on Clinical Notes Reveal Sensitive Data?    Eric Lehman, Sarthak Jain, Karl Pichotta, Yoav Goldberg, Byron C. Wallace arXiv_AI arXiv_AI  Transformer  Bert  PDF
• 2021-04-15 How to Train BERT with an Academic Budget    Peter Izsak, Moshe Berchansky, Omer Levy arXiv_AI arXiv_AI  Bert  Optimization  Action  Language_Model  PDF
• 2021-04-15 Are Multilingual BERT models robust? A Case Study on Adversarial Attacks for Multilingual Question Answering    Sara Rosenthal, Mihaela Bornea, Avirup Sil arXiv_CL arXiv_CL  Bert  Adversarial  QA  PDF
• 2021-04-15 SINA-BERT: A pre-trained Language Model for Analysis of Medical Texts in Persian    Nasrin Taghizadeh, Ehsan Doostmohammadi, Elham Seifossadat, Hamid R. Rabiee, Maedeh S. Tahaei arXiv_CL arXiv_CL  Bert  Sentiment  Medical  Language_Model  PDF
• 2021-04-15 Rethinking Automatic Evaluation in Sentence Simplification    Thomas Scialom, Louis Martin, Jacopo Staiano, Éric Villemonte de la Clergerie, Benoît Sagot arXiv_CL arXiv_CL  Bert  Pose  Relation  Summarization  PDF
• 2021-04-15 A Sample-Based Training Method for Distantly Supervised Relation Extraction with Pre-Trained Transformers    Mehrdad Nasser, Mohamad Bagher Sajadi, Behrouz Minaei-Bidgoli arXiv_AI arXiv_AI  Transformer  Bert  Pose  Action  Relation  Relation_Extraction  Prediction  PDF
• 2021-04-15 Privacy-Adaptive BERT for Natural Language Understanding    Chen Qu, Weize Kong, Liu Yang, Mingyang Zhang, Michael Bendersky, Marc Najork arXiv_CL arXiv_CL  Embedding  Bert  Knowledge  Pose  Language_Model  PDF
• 2021-04-15 UIT-E10dot3 at SemEval-2021 Task 5: Toxic Spans Detection with Named Entity Recognition and Question-Answering Approaches    Phu Gia Hoang, Luan Thanh Nguyen, Kiet Van Nguyen arXiv_CL arXiv_CL  Recognition  Bert  Detection  PDF
• 2021-04-15 BERT based Transformers lead the way in Extraction of Health Information from Social Media    Sidharth R, Abhiraj Tiwari, Parthivi Choubey, Saisha Kashyap, Sahil Khose, Kumud Lakara, Nishesh Singh, Ujjwal Verma arXiv_CL arXiv_CL  Transformer  Bert  Action  Classification  PDF
• 2021-04-15 NT5?! Training T5 to Perform Numerical Reasoning    Peng-Jian Yang, Ying Ting Chen, Yuechan Chen, Daniel Cer arXiv_CL arXiv_CL  Bert  PDF
• 2021-04-15 Emotion Dynamics Modeling via BERT    Haiqin Yang, Jianping Shen arXiv_AI arXiv_AI  Recognition  Bert  Represenation_Learning  RNN  Pose  Emotion  PDF
• 2021-04-15 TorontoCL at CMCL 2021 Shared Task: RoBERTa with Multi-Stage Fine-Tuning for Eye-Tracking Prediction    Bai Li, Frank Rudzicz arXiv_CL arXiv_CL  Transformer  Tracking  Bert  Prediction  PDF
• 2021-04-15 Lattice-BERT: Leveraging Multi-Granularity Representations in Chinese Pre-trained Language Models    Yuxuan Lai, Yijia Liu, Yansong Feng, Songfang Huang, Dongyan Zhao arXiv_CL arXiv_CL  Transformer  Bert  Pose  Attention  Language_Model  Prediction  PDF
• 2021-04-15 UHD-BERT: Bucketed Ultra-High Dimensional Sparse Representations for Full Ranking    Kyoung-Rok Jang, Junmo Kang, Giwon Hong, Sung-Hyon Myaeng, Joohee Park, Taewon Yoon, Heecheol Seo arXiv_CL arXiv_CL  Embedding  Bert  Sparse  Pose  Language_Model  Matching  PDF
• 2021-04-14 Annealing Knowledge Distillation    Aref Jafari, Mehdi Rezagholizadeh, Pranav Sharma, Ali Ghodsi arXiv_CL arXiv_CL  Bert  Knowledge  Pose  Classification  Image_Classification  Inference  PDF
• 2021-04-14 Disentangling Representations of Text by Masking Transformers    Xiongyi Zhang, Jan-Willem van de Meent, Byron C. Wallace arXiv_CL arXiv_CL  Transformer  Bert  Sparse  Review  Adversarial  Pose  Sentiment  PDF
• 2021-04-14 On the Robustness of Goal Oriented Dialogue Systems to Real-world Noise    Jason Krone, Sailik Sengupta, Saab Mansoor arXiv_AI arXiv_AI  Bert  Classification  PDF
• 2021-04-14 An Interpretability Illusion for BERT    Tolga Bolukbasi, Adam Pearce, Ann Yuan, Andy Coenen, Emily Reif, Fernanda Viégas, Martin Wattenberg arXiv_CL arXiv_CL  Embedding  Bert  PDF
• 2021-04-14 Static Embeddings as Efficient Knowledge Bases?    Philipp Dufter, Nora Kassner, Hinrich Schütze arXiv_CL arXiv_CL  Embedding  Bert  Knowledge  Pose  Language_Model  Matching  PDF
• 2021-04-14 Dependency Parsing based Semantic Representation Learning with Graph Neural Network for Enhancing Expressiveness of Text-to-Speech    Yixuan Zhou, Changhe Song, Jingbei Li, Zhiyong Wu, Helen Meng arXiv_CL arXiv_CL  Transformer  Embedding  Bert  Represenation_Learning  Speech  Pose  Relation  PDF
• 2021-04-14 Revisiting Light Field Rendering with Deep Anti-Aliasing Neural Network    Gaochang Wu, Yebin Liu, Lu Fang, Tianyou Chai arXiv_CV arXiv_CV  Reconstruction  Bert  Optimization  Pose  Deep_Learning  PDF
• 2021-04-14 Towards BERT-based Automatic ICD Coding: Limitations and Opportunities    Damian Pascual, Sandro Luck, Roger Wattenhofer arXiv_AI arXiv_AI  Transformer  Bert  Classification  Medical  PDF
• 2021-04-13 Large-Scale Contextualised Language Modelling for Norwegian    Andrey Kutuzov, Jeremy Barnes, Erik Velldal, Lilja Øvrelid, Stephan Oepen arXiv_CL arXiv_CL  Bert  Language_Model  PDF
• 2021-04-13 BERT Embeddings Can Track Context in Conversational Search    Rafael Ferreira, David Semedo, Joao Magalhaes arXiv_CL arXiv_CL  Transformer  Embedding  Tracking  Bert  Pose  Action  PDF
• 2021-04-13 Zhestyatsky at SemEval-2021 Task 2: ReLU over Cosine Similarity for BERT Fine-tuning    Boris Zhestiankin, Maria Ponomareva arXiv_CL arXiv_CL  Bert  Language_Model  PDF
• 2021-04-13 Mediators in Determining what Processing BERT Performs First    Aviv Slobodkin, Leshem Choshen, Omri Abend arXiv_CL arXiv_CL  Bert  Prediction  PDF
• 2021-04-13 Understanding Transformers for Bot Detection in Twitter    Andres Garcia-Silva, Cristian Berrio, Jose Manuel Gomez-Perez arXiv_CL arXiv_CL  Transformer  Bert  Classification  Detection  Language_Model  PDF
• 2021-04-13 UPB at SemEval-2021 Task 7: Adversarial Multi-Task Learning for Detecting and Rating Humor and Offense    Răzvan-Alexandru Smădu, Dumitru-Clementin Cercel, Mihai Dascalu arXiv_AI arXiv_AI  Transformer  Embedding  Bert  Text_Classification  RNN  Adversarial  Classification  PDF
• 2021-04-13 Semantic maps and metrics for science Semantic maps and metrics for science using deep transformer encoders    Brendan Chambers, James Evans arXiv_AI arXiv_AI  Transformer  Embedding  Bert  Face  PDF
• 2021-04-13 Discourse Probing of Pretrained Language Models    Fajri Koto, Jey Han Lau, Timothy Baldwin arXiv_CL arXiv_CL  Bert  Relation  Language_Model  PDF
• 2021-04-12 BERT based freedom to operate patent analysis    Michael Freunek, André Bodmer arXiv_CL arXiv_CL  Bert  PDF
• 2021-04-12 Fighting the COVID-19 Infodemic with a Holistic BERT Ensemble    Giorgos Tziafas, Konstantinos Kogkalidis, Tommaso Caselli arXiv_CL arXiv_CL  Transformer  Bert  Detection  Prediction  PDF
• 2021-04-12 WHOSe Heritage: Classification of UNESCO World Heritage 'Outstanding Universal Value' Documents with Smoothed Labels    Nan Bai, Renqian Luo, Pirouz Nourian, Ana Pereira Roders arXiv_CL arXiv_CL  Bert  Knowledge  Classification  Relation  PDF
• 2021-04-12 Fine-Tuning Transformers for Identifying Self-Reporting Potential Cases and Symptoms of COVID-19 in Tweets    Max Fleming, Priyanka Dondeti, Caitlin N. Dreisbach, Adam Poliak arXiv_CL arXiv_CL  Transformer  Bert  PDF
• 2021-04-12 Multilingual Language Models Predict Human Reading Behavior    Nora Hollenstein, Federico Pirovano, Ce Zhang, Lena Jäger, Lisa Beinborn arXiv_CL arXiv_CL  Transformer  Tracking  Bert  Language_Model  PDF
• 2021-04-12 Learning to Remove: Towards Isotropic Pre-trained BERT Embedding    Yuxin Liang, Rui Cao, Jie Zheng, Jie Ren, Ling Gao arXiv_CL arXiv_CL  Embedding  Bert  Pose  Language_Model  PDF
• 2021-04-11 One Ring to Rule Them All: a simple solution to multi-view 3D-Reconstruction of shapes with unknown BRDF via a small Recurrent ResNet    Ziang Cheng, Hongdong Li, Richard Hartley, Yinqiang Zheng, Imari Sato arXiv_CV arXiv_CV  Reconstruction  3D  Bert  Optimization  Pose  Face  PDF
• 2021-04-11 Does syntax matter? A strong baseline for Aspect-based Sentiment Analysis with RoBERTa    Junqi Dai, Hang Yan, Tianxiang Sun, Pengfei Liu, Xipeng Qiu arXiv_CL arXiv_CL  Bert  Sentiment  PDF
• 2021-04-11 Innovative Bert-based Reranking Language Models for Speech Recognition    Shih-Hsuan Chiu, Berlin Chen arXiv_CL arXiv_CL  Transformer  Unsupervised  Recognition  Bert  RNN  Speech  Pose  Speech_Recognition  Language_Model  Prediction  PDF
• 2021-04-11 UniDrop: A Simple yet Effective Technique to Improve Transformer without Extra Cost    Zhen Wu, Lijun Wu, Qi Meng, Yingce Xia, Shufang Xie, Tao Qin, Xinyu Dai, Tie-Yan Liu arXiv_CL arXiv_CL  Transformer  Bert  Text_Classification  Regularization  Pose  Classification  PDF
• 2021-04-10 FreSaDa: A French Satire Data Set for Cross-Domain Satire Detection    Radu Tudor Ionescu, Adrian Gabriel Chifu arXiv_CL arXiv_CL  Embedding  Unsupervised  Bert  Pose  Classification  Detection  PDF
• 2021-04-10 Non-autoregressive Transformer-based End-to-end ASR using BERT    Fu-Hao Yu, Kuan-Yu Chen arXiv_CL arXiv_CL  Transformer  Recognition  Bert  Speech  Pose  Attention  Speech_Recognition  Inference  Language_Model  PDF
• 2021-04-10 MIPT-NSU-UTMN at SemEval-2021 Task 5: Ensembling Learning with Pre-trained Language Models for Toxic Spans Detection    Mikhail Kotyushev, Anna Glazkova, Dmitry Morozov arXiv_AI arXiv_AI  Bert  Detection  Language_Model  PDF
• 2021-04-10 ZS-BERT: Towards Zero-Shot Relation Extraction with Attribute Representation Learning    Chih-Yao Chen, Cheng-Te Li arXiv_CL arXiv_CL  Embedding  Bert  Zero-Shot  Represenation_Learning  Knowledge  Pose  Action  Classification  Relation  Relation_Extraction  Prediction  PDF
• 2021-04-09 Text2Chart: A Multi-Staged Chart Generator from Natural Language Text    Md. Mahinur Rashid, Hasin Kawsar Jahan, Annysha Huzzat, Riyasaat Ahmed Rahul, Tamim Bin Zakir, Farhana Meem, Md. Saddam Hossain Mukta, Swakkhar Shatabda arXiv_CL arXiv_CL  Embedding  Bert  RNN  Pose  Prediction  PDF
• 2021-04-09 Explaining Neural Network Predictions on Sentence Pairs via Learning Word-Group Masks    Hanjie Chen, Song Feng, Jatin Ganhotra, Hui Wan, Chulaka Gunasekara, Sachindra Joshi, Yangfeng Ji arXiv_CL arXiv_CL  Bert  Pose  Action  Relation  Attention  Inference  Prediction  PDF
• 2021-04-09 KI-BERT: Infusing Knowledge Context for Better Language and Domain Understanding    Keyur Faldu, Amit Sheth, Prashant Kikani, Hemang Akabari arXiv_AI arXiv_AI  Transformer  Embedding  Bert  Knowledge  Knowledge_Graph  Pose  Deep_Learning  Relation  Attention  PDF
• 2021-04-09 Transformers: 'The End of History' for NLP?    Anton Chernyavskiy, Dmitry Ilvovsky, Preslav Nakov arXiv_CL arXiv_CL  Transformer  Segmentation  Bert  Pose  PDF
• 2021-04-09 BERT-based Chinese Text Classification for Emergency Domain with a Novel Loss Function    Zhongju Wang, Long Wang, Chao Huang, Xiong Luo arXiv_AI arXiv_AI  Transformer  Bert  Text_Classification  Optimization  Pose  Classification  PDF
• 2021-04-09 Know What and Know Where: An Object-and-Room Informed Sequential BERT for Indoor Vision-Language Navigation    Yuankai Qi, Zizheng Pan, Yicong Hong, Ming-Hsuan Yang, Anton van den Hengel, Qi Wu arXiv_CV arXiv_CV  Bert  Pose  Matching  PDF
• 2021-04-08 AlephBERT:A Hebrew Large Pre-Trained Language Model to Start-off your Hebrew NLP Application With    Amit Seker, Elron Bandel, Dan Bareket, Idan Brusilovsky, Refael Shaked Greenfeld, Reut Tsarfaty arXiv_CL arXiv_CL  Segmentation  Recognition  Bert  Speech  Sentiment  Language_Model  PDF
• 2021-04-08 COVID-19 Named Entity Recognition for Vietnamese    Thinh Hung Truong, Mai Hoang Dao, Dat Quoc Nguyen arXiv_CL arXiv_CL  Segmentation  Recognition  Bert  Language_Model  PDF
• 2021-04-08 Probing BERT in Hyperbolic Spaces    Boli Chen, Yao Fu, Guangwei Xu, Pengjun Xie, Chuanqi Tan, Mosha Chen, Liping Jing arXiv_CL arXiv_CL  Embedding  Bert  Pose  Sentiment  PDF
• 2021-04-08 Uppsala NLP at SemEval-2021 Task 2: Multilingual Language Models for Fine-tuning and Feature Extraction in Word-in-Context Disambiguation    Huiling You, Xingran Zhu, Sara Stymne arXiv_CL arXiv_CL  Bert  Action  Language_Model  PDF
• 2021-04-08 Layer Reduction: Accelerating Conformer-Based Self-Supervised Model via Layer Consistency    Jinchuan Tian, Rongzhi Gu, Helin Wang, Yuexian Zou arXiv_CL arXiv_CL  Transformer  Embedding  Recognition  Bert  Speech  Self-Supervised  Pose  Classification  Speech_Recognition  Inference  PDF
• 2021-04-08 Lone Pine at SemEval-2021 Task 5: Fine-Grained Detection of Hate Speech Using BERToxic    Yakoob Khan, Weicheng Ma, Soroush Vosoughi arXiv_CL arXiv_CL  Bert  Speech  Pose  Detection  PDF
• 2021-04-07 Interpreting Verbal Metaphors by Paraphrasing    Rui Mao, Chenghua Lin, Frank Guerin arXiv_CL arXiv_CL  Unsupervised  Bert  PDF
• 2021-04-07 Speak or Chat with Me: End-to-End Spoken Language Understanding System with Flexible Inputs    Sujeong Cha, Wangrui Hou, Hyun Jung, My Phung, Michael Picheny, Hong-Kwang Kuo, Samuel Thomas, Edmilson Morais arXiv_CL arXiv_CL  Embedding  Recognition  Bert  Speech  Pose  Classification  Speech_Recognition  PDF
• 2021-04-07 Combining Pre-trained Word Embeddings and Linguistic Features for Sequential Metaphor Identification    Rui Mao, Chenghua Lin, Frank Guerin arXiv_CL arXiv_CL  Embedding  Bert  RNN  Speech  PDF
• 2021-04-07 BreakingBERT@IITK at SemEval-2021 Task 9 : Statement Verification and Evidence Finding with Tables    Aditya Jindal, Ankur Gupta, Jaya Srivastava, Preeti Menghwani, Vijit Malik, Vishesh Kaushik, Ashutosh Modi arXiv_CL arXiv_CL  Bert  Pose  Inference  Prediction  PDF
• 2021-04-07 Better Neural Machine Translation by Extracting Linguistic Information from BERT    Hassan S. Shavarani, Anoop Sarkar arXiv_CL arXiv_CL  Transformer  Embedding  Bert  NMT  PDF
• 2021-04-06 MuSLCAT: Multi-Scale Multi-Level Convolutional Attention Transformer for Discriminative Music Modeling on Raw Waveforms    Kai Middlebrook, Shyam Sudhakaran, David Guy Brizan arXiv_SD arXiv_SD  Transformer  Recognition  Bert  Pose  Action  Attention  CNN  PDF
• 2021-04-06 hBert + BiasCorp -- Fighting Racism on the Web    Olawale Onabola, Zhuang Ma, Yang Xie, Benjamin Akera, Abdulrahman Ibraheem, Jia Xue, Dianbo Liu, Yoshua Bengio arXiv_CL arXiv_CL  Bert  PDF
• 2021-04-05 Semantic Distance: A New Metric for ASR Performance Analysis Towards Spoken Language Understanding    Suyoun Kim, Abhinav Arora, Duc Le, Ching-Feng Yeh, Christian Fuegen, Ozlem Kalinli, Michael L. Seltzer arXiv_CL arXiv_CL  Transformer  Embedding  Recognition  Bert  Speech  Pose  Speech_Recognition  Language_Model  PDF
• 2021-04-05 Exploring Transformers in Emotion Recognition: a comparison of BERT, DistillBERT, RoBERTa, XLNet and ELECTRA    Diogo Cortiz arXiv_CL arXiv_CL  Transformer  Recognition  Bert  Emotion  Language_Model  PDF
• 2021-04-05 Intent detection and slot filling for Vietnamese    Mai Hoang Dao, Thinh Hung Truong, Dat Quoc Nguyen arXiv_CL arXiv_CL  Embedding  Bert  Pose  Detection  Attention  PDF
• 2021-04-05 What's the best place for an AI conference, Vancouver or ______: Why completing comparative questions is difficult    Avishai Zagoury, Einat Minkov, Idan Szpektor, William W. Cohen arXiv_CL arXiv_CL  Bert  Knowledge  Action  Language_Model  PDF
• 2021-04-05 BBAEG: Towards BERT-based Biomedical Adversarial Example Generation for Text Classification    Ishani Mondal arXiv_CL arXiv_CL  Bert  Text_Classification  Review  Adversarial  Pose  Classification  Deep_Learning  Medical  Language_Model  Prediction  PDF
• 2021-04-05 WhiteningBERT: An Easy Unsupervised Sentence Embedding Approach    Junjie Huang, Duyu Tang, Wanjun Zhong, Shuai Lu, Linjun Shou, Ming Gong, Daxin Jiang, Nan Duan arXiv_CL arXiv_CL  Embedding  Unsupervised  Bert  Matching  PDF
• 2021-04-04 Improving Pretrained Models for Zero-shot Multi-label Text Classification through Reinforced Label Hierarchy Reasoning    Hui Liu, Danqing Zhang, Bing Yin, Xiaodan Zhu arXiv_CL arXiv_CL  Bert  Zero-Shot  Text_Classification  Pose  Classification  Inference  Prediction  Matching  PDF
• 2021-04-04 KnowGraph@IITK at SemEval-2021 Task 11: Building KnowledgeGraph for NLP Research    Shashank Shailabh, Sajal Chaurasia, Ashutosh Modi arXiv_CL arXiv_CL  Transformer  Bert  RNN  Knowledge  Knowledge_Graph  Pose  Action  Language_Model  Prediction  PDF
• 2021-04-04 MCL@IITK at SemEval-2021 Task 2: Multilingual and Cross-lingual Word-in-Context Disambiguation using Augmented Data, Signals, and Transformers    Rohan Gupta, Jay Mundra, Deepak Mahajan, Ashutosh Modi arXiv_CL arXiv_CL  Transformer  Bert  Zero-Shot  Pose  Classification  Language_Model  PDF
• 2021-04-04 ReCAM@IITK at SemEval-2021 Task 4: BERT and ALBERT based Ensemble for Abstract Word Prediction    Abhishek Mittal, Ashutosh Modi arXiv_AI arXiv_AI  Bert  Language_Model  Prediction  PDF
• 2021-04-03 Exploring the Role of BERT Token Representations to Explain Sentence Probing Results    Hosein Mohebbi, Ali Modarressi, Mohammad Taher Pilehvar arXiv_CL arXiv_CL  Bert  Knowledge  Classification  PDF
• 2021-04-03 Unsupervised Domain Adaptation with Global and Local Graph Neural Networks in Limited Labeled Data Scenario: Application to Disaster Management    Samujjwal Ghosh, Subhadeep Maji, Maunendra Sankar Desarkar arXiv_CL arXiv_CL  Unsupervised  Bert  Pose  Action  Classification  PDF
• 2021-04-03 MMBERT: Multimodal BERT Pretraining for Improved Medical VQA    Yash Khare, Viraj Bagal, Minesh Mathew, Adithi Devi, U Deva Priyakumar, CV Jawahar arXiv_CV arXiv_CV  Transformer  Bert  Self-Supervised  Pose  VQA  Attention  Medical  Caption  Language_Model  QA  PDF
• 2021-04-03 Counts@IITK at SemEval-2021 Task 8: SciBERT Based Entity And Semantic Relation Extraction For Scientific Data    Akash Gangwar, Sabhay Jain, Shubham Sourav, Ashutosh Modi arXiv_CL arXiv_CL  Embedding  Bert  Action  Classification  Relation  Relation_Extraction  PDF
• 2021-04-02 The Coronavirus is a Bioweapon: Analysing Coronavirus Fact-Checked Stories    Lynnette Hui Xian Ng, Kathleen M. Carley arXiv_CL arXiv_CL  Bert  PDF
• 2021-04-02 IITK@LCP at SemEval 2021 Task 1: Classification for Lexical Complexity Regression Task    Neil Rajiv Shirude, Sagnik Mukherjee, Tushar Shandhilya, Ananta Mukherjee, Ashutosh Modi arXiv_CL arXiv_CL  Bert  Classification  Prediction  PDF
• 2021-04-01 Effect of Radiology Report Labeler Quality on Deep Learning Models for Chest X-Ray Interpretation    Saahil Jain, Akshay Smit, Andrew Y. Ng, Pranav Rajpurkar arXiv_CV arXiv_CV  Bert  Classification  Deep_Learning  Image_Classification  PDF
• 2021-04-01 PhySG: Inverse Rendering with Spherical Gaussians for Physics-based Material Editing and Relighting    Kai Zhang, Fujun Luan, Qianqian Wang, Kavita Bala, Noah Snavely arXiv_CV arXiv_CV  Reconstruction  Bert  PDF
• 2021-04-01 HLE-UPC at SemEval-2021 Task 5: Multi-Depth DistilBERT for Toxic Spans Detection    Rafel Palliser, Albert Rial arXiv_AI arXiv_AI  Embedding  Bert  Pose  Quantitative  Detection  PDF
• 2021-03-31 Analysis on Image Set Visual Question Answering    Abhinav Khattar, Aviral Joshi, Har Simrat Singh, Pulkit Goel, Rohit Prakash Barnwal arXiv_CV arXiv_CV  Bert  Regularization  Adversarial  VQA  QA  PDF
• 2021-03-31 A Statistical Analysis of Summarization Evaluation Metrics using Resampling Methods    Daniel Deutsch, Rotem Dror, Dan Roth arXiv_CL arXiv_CL  Bert  Pose  Relation  Summarization  QA  PDF
• 2021-03-31 Quantum Optimization for Training Quantum Neural Networks    Yidong Liao, Min-Hsiu Hsieh, Chris Ferrie arXiv_AI arXiv_AI  Bert  Optimization  PDF
• 2021-03-30 Grounding Dialogue Systems via Knowledge Graph Aware Decoding with Pre-trained Transformers    Debanjan Chaudhuri, Md Rashad Al Hasan Rony, Jens Lehmann arXiv_CL arXiv_CL  Transformer  Bert  Knowledge  Knowledge_Graph  Pose  Action  Relation  Inference  PDF
• 2021-03-30 Kaleido-BERT: Vision-Language Pre-training on Fashion Domain    Mingchen Zhuge, Dehong Gao, Deng-Ping Fan, Linbo Jin, Ben Chen, Haoming Zhou, Minghui Qiu, Ling Shao arXiv_CV arXiv_CV  Transformer  Recognition  Bert  Image_Retrieval  Self-Supervised  Relation  Caption  PDF
• 2021-03-30 Grounding Open-Domain Instructions to Automate Web Support Tasks    Nancy Xu, Sam Masling, Michael Du, Giovanni Campagna, Larry Heck, James Landay, Monica S Lam arXiv_CL arXiv_CL  Bert  RNN  Action  PDF
• 2021-03-29 Contextual Text Embeddings for Twi    Paul Azunre, Salomey Osei, Salomey Addo, Lawrence Asamoah Adu-Gyamfi, Stephen Moore, Bernard Adabankah, Bernard Opoku, Clara Asare-Nyarko, Samuel Nyarko, Cynthia Amoaba, Esther Dansoa Appiah, Felix Akwerh, Richard Nii Lante Lawson, Joel Budu, Emmanuel Debrah, Nana Boateng, Wisdom Ofori, Edwin Buabeng-Munkoh, Franklin Adjei, Isaac Kojo Essel Ampomah, Joseph Otoo, Reindorf Borkor, Standylove Birago Mensah, Lucien Mensah, Mark Amoako Marcel, Anokye Acheampong Amponsah, James Ben Hayfron-Acquah arXiv_AI arXiv_AI  Transformer  Embedding  Recognition  Bert  Sentiment_Classification  Knowledge  Speech  Face  NMT  Classification  Sentiment  Language_Model  PDF
• 2021-03-29 eDarkTrends: Harnessing Social Media Trends in Substance use disorders for Opioid Listings on Cryptomarket    Usha Lokala, Francois Lamy, Triyasha Ghosh Dastidar, Kaushik Roy, Raminta Daniulaityte, Srinivasan Parthasarathy, Amit Sheth arXiv_AI arXiv_AI  Bert  Ontology  Emotion  Action  Deep_Learning  Relation  Sentiment  PDF
• 2021-03-29 Retraining DistilBERT for a Voice Shopping Assistant by Using Universal Dependencies    Pratik Jayarao, Arpit Sharma arXiv_AI arXiv_AI  Bert  Detection  Sentiment  Language_Model  PDF
• 2021-03-29 Towards High Fidelity Monocular Face Reconstruction with Rich Reflectance using Self-supervised Learning and Ray Tracing    Abdallah Dib, Cedric Thebault, Junghyun Ahn, Philippe-Henri Gosselin, Christian Theobalt, Louis Chevallier arXiv_CV arXiv_CV  Reconstruction  Bert  Optimization  Self-Supervised  Pose  Face  PDF
• 2021-03-29 Whitening Sentence Representations for Better Semantics and Faster Retrieval    Jianlin Su, Jiarun Cao, Weijie Liu, Yangyiwen Ou arXiv_AI arXiv_AI  Bert  PDF
• 2021-03-28 PnG BERT: Augmented BERT on Phonemes and Graphemes for Neural TTS    Ye Jia, Heiga Zen, Jonathan Shen, Yu Zhang, Yonghui Wu arXiv_CL arXiv_CL  Bert  Speech  Self-Supervised  PDF
• 2021-03-27 Machine Learning Meets Natural Language Processing -- The story so far    N.-I. Galanis, P. Vafiadis, K.-G. Mirzaev, G.A. Papakostas arXiv_AI arXiv_AI  Transformer  Bert  Attention  PDF
• 2021-03-27 Unsupervised Self-Training for Sentiment Analysis of Code-Switched Data    Akshat Gupta, Sargam Menghani, Sai Krishna Rallabandi, Alan W Black arXiv_CL arXiv_CL  Unsupervised  Bert  Zero-Shot  Review  Pose  Face  Sentiment  PDF
• 2021-03-26 Composable Learning with Sparse Kernel Representations    Ekaterina Tolstaya, Ethan Stump, Alec Koppel, Alejandro Ribeiro arXiv_RO