Bert

Bert

• 2022-09-27 A general-purpose material property data extraction pipeline from large polymer corpora using Natural Language Processing    Pranav Shetty, Arunkumar Chitteth Rajan, Christopher Kuenneth, Sonkakshi Gupta, Lakshmi Prerana Panchumarti, Lauren Holm, Chao Zhang, Rampi Ramprasad arXiv_CL arXiv_CL  Recognition  Bert  Pose  Action  Relation  Language_Model  PDF
• 2022-09-26 Towards Simple and Efficient Task-Adaptive Pre-training for Text Classification    Arnav Ladkat, Aamir Miyajiwala, Samiksha Jagadale, Rekha Kulkarni, Raviraj Joshi arXiv_CL arXiv_CL  Embedding  Bert  Text_Classification  Pose  Classification  Language_Model  PDF
• 2022-09-26 Out-of-Distribution Detection with Hilbert-Schmidt Independence Optimization    Jingyang Lin, Yu Wang, Qi Cai, Yingwei Pan, Ting Yao, Hongyang Chao, Tao Mei arXiv_CV arXiv_CV  Bert  Optimization  Pose  Detection  Inference  PDF
• 2022-09-26 Do ever larger octopi still amplify reporting biases? Evidence from judgments of typical colour    Fangyu Liu, Julian Martin Eisenschlos, Jeremy R. Cole, Nigel Collier arXiv_AI arXiv_AI  Bert  Face  Language_Model  PDF
• 2022-09-26 The Ability of Self-Supervised Speech Models for Audio Representations    Tung-Yu Wu, Chen-An Li, Tzu-Han Lin, Tsu-Yuan Hsu, Hung-Yi Lee arXiv_AI arXiv_AI  Embedding  Bert  Represenation_Learning  Speech  Self-Supervised  Pose  PDF
• 2022-09-26 Taking a Respite from Representation Learning for Molecular Property Prediction    Jianyuan Deng, Zhibo Yang, Hehe Wang, Iwao Ojima, Dimitris Samaras, Fusheng Wang arXiv_AI arXiv_AI  Bert  Represenation_Learning  Self-Supervised  Activity  Prediction  PDF
• 2022-09-24 Can Transformer Models Effectively Detect Software Aspects in StackOverflow Discussion?    Nibir Chandra Mandal, Tashreef Muhammad, G. M. Shahariar arXiv_CL arXiv_CL  Transformer  Bert  Sentiment  PDF
• 2022-09-24 Dead or Murdered? Predicting Responsibility Perception in Femicide News Reports    Gosse Minnema, Sara Gemelli, Chiara Zanchi, Tommaso Caselli, Malvina Nissim arXiv_CL arXiv_CL  Bert  Salient  Survey  PDF
• 2022-09-24 Learning Chess With Language Models and Transformers    Michael DeLeo, Erhan Guven arXiv_AI arXiv_AI  Transformer  Unsupervised  Bert  Few-Shot  Language_Model  PDF
• 2022-09-23 Promptagator: Few-shot Dense Retrieval From 8 Examples    Zhuyun Dai, Vincent Y. Zhao, Ji Ma, Yi Luan, Jianmo Ni, Jing Lu, Anton Bakalov, Kelvin Guu, Keith B. Hall, Ming-Wei Chang arXiv_CL arXiv_CL  Bert  Knowledge  Pose  Few-Shot  Language_Model  PDF
• 2022-09-23 IDEA: Interactive DoublE Attentions from Label Embedding for Text Classification    Ziyuan Wang, Hailiang Huang, Songqiao Han arXiv_AI arXiv_AI  Embedding  Bert  Text_Classification  Pose  Classification  Attention  Matching  PDF
• 2022-09-23 Extending Word-Level Quality Estimation for Post-Editing Assistance    Yizhen Wei, Takehito Utsuro, Masaaki Nagata arXiv_CL arXiv_CL  Bert  Pose  PDF
• 2022-09-22 Scope of Pre-trained Language Models for Detecting Conflicting Health Information    Joseph Gatto, Madhusudan Basak, Sarah M. Preum arXiv_CL arXiv_CL  Bert  Pose  Detection  Language_Model  PDF
• 2022-09-22 MonoByte: A Pool of Monolingual Byte-level Language Models    Hugo Abonizio, Leandro Rodrigues de Souza, Roberto Lotufo, Rodrigo Nogueira arXiv_CL arXiv_CL  Embedding  Bert  Zero-Shot  Language_Model  QA  PDF
• 2022-09-22 Adaptation of domain-specific transformer models with text oversampling for sentiment analysis of social media posts on Covid-19 vaccines    Anmol Bansal, Arjun Choudhry, Anubhav Sharma, Seba Susan arXiv_CL arXiv_CL  Transformer  Bert  Classification  Sentiment  Language_Model  PDF
• 2022-09-22 AIR-JPMC@SMM4H'22: Classifying Self-Reported Intimate Partner Violence in Tweets with Multiple BERT-based Models    Alec Candidato, Akshat Gupta, Xiaomo Liu, Sameena Shah arXiv_CL arXiv_CL  Bert  Classification  PDF
• 2022-09-21 Assessing ASR Model Quality on Disordered Speech using BERTScore    Jimmy Tobin, Qisheng Li, Subhashini Venugopalan, Katie Seaver, Richard Cave, Katrin Tomanek arXiv_CL arXiv_CL  Recognition  Bert  Speech  Action  Speech_Recognition  Text_Generation  Prediction  PDF
• 2022-09-21 Representing Affect Information in Word Embeddings    Yuhan Zhang, Wenqi Chen, Ruihan Zhang, Xiajie Zhang arXiv_CL arXiv_CL  Embedding  Bert  Salient  Knowledge  Emotion  Classification  Relation  Language_Model  PDF
• 2022-09-21 Subject Verb Agreement Error Patterns in Meaningless Sentences: Humans vs. BERT    Karim Lasri, Olga Seminck, Alessandro Lenci, Thierry Poibeau arXiv_CL arXiv_CL  Bert  Knowledge  Language_Model  PDF
• 2022-09-21 SMTCE: A Social Media Text Classification Evaluation Benchmark and BERTology Models for Vietnamese    Luan Thanh Nguyen, Kiet Van Nguyen, Ngan Luu-Thuy Nguyen arXiv_CL arXiv_CL  Bert  Text_Classification  Pose  Classification  PDF
• 2022-09-21 Bias at a Second Glance: A Deep Dive into Bias for German Educational Peer-Review Data Modeling    Thiemo Wambsganss, Vinitra Swamy, Roman Rietsche, Tanja Käser arXiv_CL arXiv_CL  Embedding  Bert  Review  Language_Model  PDF
• 2022-09-21 Extreme Multi-Domain, Multi-Task Learning With Unified Text-to-Text Transfer Transformers    Adebayo Oshingbesan, Courage Ekoh, Germann Atakpa, Yonah Byaruagaba arXiv_CL arXiv_CL  Transformer  Transfer_Learning  Bert  Knowledge  Relation  Summarization  PDF
• 2022-09-20 Can we do that simpler? Simple, Efficient, High-Quality Evaluation Metrics for NLG    Jens Grünwald, Christoph Leiter, Steffen Eger arXiv_CL arXiv_CL  Transformer  Bert  Inference  PDF
• 2022-09-20 Unsupervised Early Exit in DNNs with Multiple Exits    Hari Narayan N U, Manjesh K. Hanawal, Avinash Bhardwaj arXiv_AI arXiv_AI  Unsupervised  Bert  Face  Inference  Prediction  PDF
• 2022-09-20 One-to-Many Semantic Communication Systems: Design, Implementation, Performance Evaluation    Han Hu, Xingwu Zhu, Fuhui Zhou, Wei Wu, Rose Qingyang Hu, Hongbo Zhu arXiv_CL arXiv_CL  Transfer_Learning  Bert  Pose  PDF
• 2022-09-19 TimberTrek: Exploring and Curating Sparse Decision Trees with Interactive Visualization    Zijie J. Wang, Chudi Zhong, Rui Xin, Takuya Takagi, Zhi Chen, Duen Horng Chau, Cynthia Rudin, Margo Seltzer arXiv_AI arXiv_AI  Bert  Sparse  Knowledge  PDF
• 2022-09-19 ALEXSIS-PT: A New Resource for Portuguese Lexical Simplification    Kai North, Marcos Zampieri, Tharindu Ranasinghe arXiv_AI arXiv_AI  Bert  PDF
• 2022-09-19 Tree-based Text-Vision BERT for Video Search in Baidu Video Advertising    Tan Yu, Jie Liu, Yi Yang, Yi Li, Hongliang Fei, Ping Li arXiv_CV arXiv_CV  Bert  Attention  Video_Retrieval  PDF
• 2022-09-17 From Disfluency Detection to Intent Detection and Slot Filling    Mai Hoang Dao, Thinh Hung Truong, Dat Quoc Nguyen arXiv_CL arXiv_CL  Bert  Detection  Language_Model  PDF
• 2022-09-17 Watch What You Pretrain For: Targeted, Transferable Adversarial Examples on Self-Supervised Speech Recognition models    Raphael Olivier, Bhiksha Raj arXiv_CL arXiv_CL  Transformer  Recognition  Bert  Knowledge  Adversarial  Speech  Self-Supervised  Pose  Speech_Recognition  PDF
• 2022-09-17 Detecting Generated Scientific Papers using an Ensemble of Transformer Models    Anna Glazkova, Maksim Glazkov arXiv_AI arXiv_AI  Transformer  Bert  Detection  PDF
• 2022-09-15 TwHIN-BERT: A Socially-Enriched Pre-trained Language Model for Multilingual Tweet Representations    Xinyang Zhang, Yury Malkov, Omar Florez, Serim Park, Brian McWilliams, Jiawei Han, Ahmed El-Kishky arXiv_CL arXiv_CL  Bert  Language_Model  Prediction  Recommendation  PDF
• 2022-09-15 Machine Reading, Fast and Slow: When Do Models 'Understand' Language?    Sagnik Ray Choudhury, Anna Rogers, Isabelle Augenstein arXiv_CL arXiv_CL  Bert  Salient  Pose  Deep_Learning  PDF
• 2022-09-15 Rethinking Round-trip Translation for Automatic Machine Translation Evaluation    Terry Yue Zhuo, Qiongkai Xu, Xuanli He, Trevor Cohn arXiv_CL arXiv_CL  Bert  Pose  PDF
• 2022-09-15 Linear Transformations for Cross-lingual Sentiment Analysis    Pavel Přibáň, Jakub Šmíd, Adam Mištera, Pavel Král arXiv_CL arXiv_CL  Embedding  Bert  Zero-Shot  RNN  Classification  Sentiment  PDF
• 2022-09-15 Learning to Exploit Elastic Actuators for Quadruped Locomotion    Antonin Raffin, Daniel Seidel, Jens Kober, Alin Albu-Schäffer, João Silvério, Freek Stulp arXiv_RO arXiv_RO  Reinforcement_Learning  Bert  Pose  Action  PDF
• 2022-09-15 Knowledge Graph Completion with Pre-trained Multimodal Transformer and Twins Negative Sampling    Yichi Zhang, Wen Zhang arXiv_CL arXiv_CL  Transformer  Embedding  Bert  Knowledge  Knowledge_Graph  Pose  Prediction  PDF
• 2022-09-15 uChecker: Masked Pretrained Language Models as Unsupervised Chinese Spelling Checkers    Piji Li arXiv_CL arXiv_CL  Unsupervised  Bert  Pose  Detection  Language_Model  PDF
• 2022-09-15 VIPHY: Probing 'Visible' Physical Commonsense Knowledge    Shikhar Singh, Ehsan Qasemi, Muhao Chen arXiv_CL arXiv_CL  Bert  Knowledge  Caption  Language_Model  PDF
• 2022-09-14 On the State of the Art in Authorship Attribution and Authorship Verification    Jacob Tyo, Bhuwan Dhingra, Zachary C. Lipton arXiv_AI arXiv_AI  Bert  Survey  PDF
• 2022-09-14 LibertyMFD: A Lexicon to Assess the Moral Foundation of Liberty    Oscar Araque, Lorenzo Gatti, Kyriaki Kalimeri arXiv_CL arXiv_CL  Bert  Pose  PDF
• 2022-09-14 Automated Fidelity Assessment for Strategy Training in Inpatient Rehabilitation using Natural Language Processing    Hunter Osterhoudt, Courtney E. Schneider, Haneef A Mohammad, Minmei Shih, Alexandra E. Harper, Leming Zhou, Elizabeth R Skidmore, Yanshan Wang arXiv_CL arXiv_CL  Transformer  Bert  RNN  PDF
• 2022-09-14 Toward Improving Health Literacy in Patient Education Materials with Neural Machine Translation Models    David Oniani, Sreekanth Sreekumar, Renuk DeAlmeida, Dinuk DeAlmeida, Vivian Hui, Young Ji Lee, Yiye Zhang, Leming Zhou, Yanshan Wang arXiv_CL arXiv_CL  Transformer  Bert  RNN  Pose  NMT  Medical  PDF
• 2022-09-14 Pre-training for Information Retrieval: Are Hyperlinks Fully Explored?    Jiawen Wu, Xinyu Zhang, Yutao Zhu, Zheng Liu, Zikai Guo, Zhaoye Fei, Ruofei Lai, Yongkang Wu, Zhao Cao, Zhicheng Dou arXiv_AI arXiv_AI  Bert  Pose  Relation  Language_Model  Matching  PDF
• 2022-09-14 BERT-based Ensemble Approaches for Hate Speech Detection    Khouloud Mnassri, Praboda Rajapaksha, Reza Farahbakhsh, Noel Crespi arXiv_CL arXiv_CL  Transformer  Bert  Speech  Classification  Detection  Language_Model  PDF
• 2022-09-13 CNN-Trans-Enc: A CNN-Enhanced Transformer-Encoder On Top Of Static BERT representations for Document Classification    Charaf Eddine Benarab, Shenglin Gui arXiv_CL arXiv_CL  Transformer  Embedding  Bert  Text_Classification  Pose  Classification  CNN  PDF
• 2022-09-13 Pre-training Transformers on Indian Legal Text    Shounak Paul, Arpan Mandal, Pawan Goyal, Saptarshi Ghosh arXiv_AI arXiv_AI  Transformer  Segmentation  Semantic_Segmentation  Bert  Language_Model  Prediction  PDF
• 2022-09-13 Don't Judge a Language Model by Its Last Layer: Contrastive Learning with Layer-Wise Attention Pooling    Dongsuk Oh, Yejin Kim, Hodong Lee, H. Howie Huang, Heuiseok Lim arXiv_AI arXiv_AI  Embedding  Unsupervised  Bert  Contrastive_Learning  Attention  Language_Model  PDF
• 2022-09-13 SkIn: Skimming-Intensive Long-Text Classification Based on BERT and Application to Medical Corpus    Yufeng Zhao, Haiying Che arXiv_AI arXiv_AI  Bert  Text_Classification  Knowledge  Pose  Classification  Medical  PDF
• 2022-09-13 Robin: A Novel Online Suicidal Text Corpus of Substantial Breadth and Scale    Daniel DiPietro, Vivek Hazari, Soroush Vosoughi arXiv_CL arXiv_CL  Bert  Classification  Detection  Sentiment  Language_Model  PDF
• 2022-09-12 DECK: Behavioral Tests to Improve Interpretability and Generalizability of BERT Models Detecting Depression from Text    Jekaterina Novikova, Ksenia Shkaruta arXiv_CL arXiv_CL  Bert  PDF
• 2022-09-12 Classification of hazard event via language fractal    Zhenhua Wang, Dong Gao, Bin Wang, Ming Ren arXiv_CL arXiv_CL  Bert  Pose  Classification  Deep_Learning  Attention  PDF
• 2022-09-11 Probing for Understanding of English Verb Classes and Alternations in Large Pre-trained Language Models    David K. Yi, James V. Bruno, Jiayu Han, Peter Zukerman, Shane Steinert-Threlkeld arXiv_CL arXiv_CL  Embedding  Bert  Language_Model  Prediction  PDF
• 2022-09-10 Code Compliance Assessment as a Learning Problem    Neela Sawant, Srinivasan H. Sengamedu arXiv_AI arXiv_AI  Embedding  Bert  Zero-Shot  Review  Classification  Detection  Relation  Prediction  PDF
• 2022-09-10 Yes, DLGM! A novel hierarchical model for hazard classification    Zhenhua Wang, Ming Ren, Dong Gao, Bin Wang arXiv_CL arXiv_CL  Bert  Pose  Classification  Deep_Learning  PDF
• 2022-09-09 Trigger Warnings: Bootstrapping a Violence Detector for FanFiction    Magdalena Wolska, Christopher Schröder, Ole Borchardt, Benno Stein, Martin Potthast arXiv_CL arXiv_CL  Bert  Classification  Detection  Object_Detection  PDF
• 2022-09-09 Automatic Readability Assessment of German Sentences with Transformer Ensembles    Patrick Gustav Blaneck, Tobias Bornheim, Niklas Grieger, Stephan Bialonski arXiv_CL arXiv_CL  Transformer  Bert  Deep_Learning  Language_Model  Prediction  PDF
• 2022-09-09 EchoCoTr: Estimation of the Left Ventricular Ejection Fraction from Spatiotemporal Echocardiography    Rand Muhtaseb, Mohammad Yaqub arXiv_CV arXiv_CV  Transformer  Video_Caption  Bert  Pose  Face  Action  Medical  CNN  PDF
• 2022-09-09 Activity report analysis with automatic single or multispan answer extraction    Ravi Choudhary, Arvind Krishna Sridhar, Erik Visser arXiv_CL arXiv_CL  Bert  Pose  Action  Detection  Activity  QA  PDF
• 2022-09-09 MaxMatch-Dropout: Subword Regularization for WordPiece    Tatsuya Hiraoka arXiv_CL arXiv_CL  Bert  Text_Classification  Regularization  Pose  Classification  Language_Model  Matching  PDF
• 2022-09-09 PoxVerifi: An Information Verification System to Combat Monkeypox Misinformation    Akaash Kolluri, Kami Vinton, Dhiraj Murthy arXiv_CL arXiv_CL  Bert  Review  GAN  PDF
• 2022-09-08 Transformer-based classification of premise in tweets related to COVID-19    Vadim Porvatov, Natalia Semenova arXiv_AI arXiv_AI  Transformer  Bert  Pose  Classification  Prediction  PDF
• 2022-09-08 Applying Transformer-based Text Summarization for Keyphrase Generation    Anna Glazkova, Dmitry Morozov arXiv_AI arXiv_AI  Transformer  Unsupervised  Bert  Action  Summarization  PDF
• 2022-09-08 CLaCLab at SocialDisNER: Using Medical Gazetteers for Named-Entity Recognition of Disease Mentions in Spanish Tweets    Harsh Verma, Parsa Bagherzadeh, Sabine Bergler arXiv_AI arXiv_AI  Transformer  Recognition  Bert  Medical  PDF
• 2022-09-07 AILAB-Udine@SMM4H 22: Limits of Transformers and BERT Ensembles    Beatrice Portelli, Simone Scaboro, Emmanuele Chersoni, Enrico Santus, Giuseppe Serra arXiv_CL arXiv_CL  Transformer  Bert  Text_Classification  Action  Classification  PDF
• 2022-09-07 Dual Instrumental Method for Confounded Kernelized Bandits    Xueping Gong, Jiheng Zhang arXiv_AI arXiv_AI  Bert  Pose  PDF
• 2022-09-07 On the Effectiveness of Compact Biomedical Transformers    Omid Rohanian, Mohammadmahdi Nouriborji, Samaneh Kouchaki, David A. Clifton arXiv_CL arXiv_CL  Transformer  Embedding  Bert  Knowledge  Face  Medical  Language_Model  PDF
• 2022-09-07 DM$^2$S$^2$: Deep Multi-Modal Sequence Sets with Hierarchical Modality Attention    Shunsuke Kitada, Yuki Iwazaki, Riku Togashi, Hitoshi Iyatomi arXiv_AI arXiv_AI  Bert  Pose  Relation  Attention  Prediction  PDF
• 2022-09-07 Non-Standard Vietnamese Word Detection and Normalization for Text-to-Speech    Huu-Tien Dang, Thi-Hai-Yen Vuong, Xuan-Hieu Phan arXiv_CL arXiv_CL  Bert  RNN  Speech  Pose  Face  Detection  Matching  PDF
• 2022-09-06 Multilingual Bidirectional Unsupervised Translation Through Multilingual Finetuning and Back-Translation    Bryan Li, Ajay Patel, Chris Callison-Burch, Mohammad Sadegh Rasooli arXiv_CL arXiv_CL  Unsupervised  Bert  Zero-Shot  Pose  NMT  PDF
• 2022-09-06 'Mama Always Had a Way of Explaining Things So I Could Understand'': A Dialogue Corpus for Learning to Construct Explanations    Henning Wachsmuth, Milad Alshomary arXiv_CL arXiv_CL  Bert  PDF
• 2022-09-06 Comparing Methods for Extractive Summarization of Call Centre Dialogue    Alexandra N. Uma, Dmitry Sityaev arXiv_CL arXiv_CL  Bert  Pose  Summarization  PDF
• 2022-09-06 Layer or Representation Space:What makes BERT-based Evaluation Metrics Robust?    Doan Nam Long Vu, Nafise Sadat Moosavi, Steffen Eger arXiv_CL arXiv_CL  Embedding  Bert  Relation  Text_Generation  PDF
• 2022-09-06 Reference Resolution and Context Change in Multimodal Situated Dialogue for Exploring Data Visualizations    Abhinav Kumar, Barbara Di Eugenio, Abari Bhattacharya, Jillian Aurisano, Andrew Johnson arXiv_CL arXiv_CL  Transformer  Transfer_Learning  Bert  Gesture  RNN  Salient  Deep_Learning  PDF
• 2022-09-05 Evaluating the Susceptibility of Pre-Trained Language Models via Handcrafted Adversarial Examples    Hezekiah J. Branch, Jonathan Rodriguez Cefalu, Jeremy McHugh, Leyla Hujer, Aditya Bahl, Daniel del Castillo Iglesias, Ron Heichman, Ramesh Darwishi arXiv_CL arXiv_CL  Transformer  Unsupervised  Bert  Text_Classification  Adversarial  Speech  Classification  Language_Model  PDF
• 2022-09-05 Distilling the Knowledge of BERT for CTC-based ASR    Hayato Futami, Hirofumi Inaguma, Masato Mimura, Shinsuke Sakai, Tatsuya Kawahara arXiv_CL arXiv_CL  Recognition  Bert  Knowledge  Speech  Pose  Classification  Attention  Speech_Recognition  Inference  Language_Model  Prediction  PDF
• 2022-09-05 Query-focused Extractive Summarisation for Biomedical and COVID-19 Complex Question Answering    Diego Mollá (Macquarie University, Sydney, Australia) arXiv_CL arXiv_CL  Bert  Classification  GAN  Medical  PDF
• 2022-09-05 ChemBERTa-2: Towards Chemical Foundation Models    Walid Ahmad, Elana Simon, Seyone Chithrananda, Gabriel Grand, Bharath Ramsundar arXiv_AI arXiv_AI  Bert  Salient  Knowledge  Self-Supervised  Prediction  PDF
• 2022-09-04 Generalization in Neural Networks: A Broad Survey    Chris Rohlfs arXiv_AI arXiv_AI  Transfer_Learning  Bert  Knowledge  Review  Knowledge_Graph  Survey  Action  Relation  Few-Shot  PDF
• 2022-09-03 A Variational Approach to the Quantum Separability Problem    Mirko Consiglio, Tony John George Apollaro, Marcin Wieśniak arXiv_CV arXiv_CV  Bert  Optimization  Pose  VQA  QA  PDF
• 2022-09-03 Multilingual ColBERT-X    Dawn Lawrie, Eugene Yang, Douglas W. Oard, James Mayfield arXiv_CL arXiv_CL  Bert  Language_Model  PDF
• 2022-09-02 GReS: Graphical Cross-domain Recommendation for Supply Chain Platform    Zhiwen Jing, Ziliang Zhao, Yang Feng, Xiaochen Ma, Nan Wu, Shengqiao Kang, Cheng Yang, Yujia Zhang, Hao Guo arXiv_AI arXiv_AI  Bert  Sparse  Pose  Recommendation  PDF
• 2022-09-02 FOLIO: Natural Language Reasoning with First-Order Logic    Simeng Han, Hailey Schoelkopf, Yilun Zhao, Zhenting Qi, Martin Riddell, Luke Benson, Lucy Sun, Ekaterina Zubova, Yujie Qiao, Matthew Burtell, David Peng, Jonathan Fan, Yixin Liu, Brian Wong, Malcolm Sailor, Ansong Ni, Linyong Nan, Jungo Kasai, Tao Yu, Rui Zhang, Shafiq Joty, Alexander R. Fabbri, Wojciech Kryscinski, Xi Victoria Lin, Caiming Xiong, Dragomir Radev arXiv_CL arXiv_CL  Bert  Few-Shot  Inference  Language_Model  PDF
• 2022-09-01 Multi-Scale Contrastive Co-Training for Event Temporal Relation Extraction    Hao-Ren Yao, Luke Breitfeller, Aakanksha Naik, Chunxiao Zhou, Carolyn Rose arXiv_AI arXiv_AI  Transformer  Embedding  Reinforcement_Learning  Bert  Contrastive_Learning  Action  Relation  Relation_Extraction  Language_Model  Prediction  PDF
• 2022-09-01 Negation detection in Dutch clinical texts: an evaluation of rule-based and machine learning methods    Bram van Es, Leon C. Reteig, Sander C. Tan, Marijn Schraagen, Myrthe M. Hemker, Sebastiaan R.S. Arends, Miguel A.R. Rios, Saskia Haitjema arXiv_CL arXiv_CL  Bert  RNN  Action  Classification  Detection  Medical  PDF
• 2022-09-01 Generating Coherent Drum Accompaniment With Fills And Improvisations    Rishabh Dahale, Vaibhav Talwadker, Preeti Rao, Prateek Verma arXiv_SD arXiv_SD  Transformer  Bert  Pose  Deep_Learning  PDF
• 2022-09-01 Enhancing Semantic Understanding with Self-supervised Methods for Abstractive Dialogue Summarization    Hyunjae Lee, Jaewoong Yun, Hyunjin Choi, Seongho Joe, Youngjune L. Gwon arXiv_AI arXiv_AI  Embedding  Bert  Self-Supervised  Summarization  Language_Model  PDF
• 2022-09-01 Isotropic Representation Can Improve Dense Retrieval    Euna Jung, Jungwon Park, Jaekeol Choi, Sungyoon Kim, Wonjong Rhee arXiv_CL arXiv_CL  Unsupervised  Bert  Pose  PDF
• 2022-08-31 The Fellowship of the Authors: Disambiguating Names from Social Network Context    Ryan Muther, David Smith arXiv_CL arXiv_CL  Unsupervised  Bert  Sparse  Inference  Language_Model  PDF
• 2022-08-31 Few-Shot Learning for Clinical Natural Language Processing Using Siamese Neural Networks    David Oniani, Sonish Sivarajkumar, Yanshan Wang arXiv_CL arXiv_CL  Embedding  Recognition  Bert  Text_Classification  Pose  Classification  Deep_Learning  Few-Shot  Language_Model  PDF
• 2022-08-30 MultiCoNER: A Large-scale Multilingual dataset for Complex Named Entity Recognition    Shervin Malmasi, Anjie Fang, Besnik Fetahu, Sudipta Kar, Oleg Rokhlenko arXiv_CL arXiv_CL  Recognition  Bert  Pose  Action  Language_Model  PDF
• 2022-08-30 Expressions Causing Differences in Emotion Recognition in Social Networking Service Documents    Tsubasa Nakagawa, Shunsuke Kitada, Hitoshi Iyatomi arXiv_CL arXiv_CL  Transformer  Recognition  Bert  Pose  Emotion  Detection  Object_Detection  PDF
• 2022-08-30 Transformers with Learnable Activation Functions    Haishuo Fang, Ji-Ung Lee, Nafise Sadat Moosavi, Iryna Gurevych arXiv_CL arXiv_CL  Transformer  Bert  Pose  Language_Model  PDF
• 2022-08-30 SwiftPruner: Reinforced Evolutionary Pruning for Efficient Ad Relevance    Li Lyna Zhang, Youkow Homma, Yujing Wang, Min Wu, Mao Yang, Ruofei Zhang, Ting Cao, Wei Shen arXiv_AI arXiv_AI  Transformer  Bert  Sparse  Pose  Inference  Prediction  PDF
• 2022-08-29 Combating high variance in Data-Scarce Implicit Hate Speech Classification    Debaditya Pal, Kaustubh Chaudhari, Harsh Sharma arXiv_CL arXiv_CL  Transformer  Bert  Optimization  Regularization  Speech  Classification  Detection  PDF
• 2022-08-29 Multi-dimensional Racism Classification during COVID-19: Stigmatization, Offensiveness, Blame, and Exclusion    Xin Pei, Deval Mehta arXiv_AI arXiv_AI  Bert  Classification  Detection  Prediction  PDF
• 2022-08-28 Training Text-To-Speech Systems From Synthetic Data: A Practical Approach For Accent Transfer Tasks    Lev Finkelstein, Heiga Zen, Norman Casagrande, Chun-an Chan, Ye Jia, Tom Kenter, Alexey Petelin, Jonathan Shen, Vincent Wan, Yu Zhang, Yonghui Wu, Rob Clark arXiv_SD arXiv_SD  Bert  Speech  PDF
• 2022-08-27 MDIA: A Benchmark for Multilingual Dialogue Generation in 46 Languages    Qingyu Zhang, Xiaoyu Shen, Ernie Chang, Jidong Ge, Pengke Chen arXiv_CL arXiv_CL  Bert  Zero-Shot  Few-Shot  QA  PDF
• 2022-08-26 Task-specific Pre-training and Prompt Decomposition for Knowledge Graph Population with Language Models    Tianyi Li, Wenyu Huang, Nikos Papasarantopoulos, Pavlos Vougiouklis, Jeff Z. Pan arXiv_CL arXiv_CL  Bert  Knowledge  Knowledge_Graph  Language_Model  PDF
• 2022-08-25 A Compact Pretraining Approach for Neural Language Models    Shahriar Golchin, Mihai Surdeanu, Nazgol Tavabi, Ata Kiapour arXiv_CL arXiv_CL  Bert  Language_Model  PDF
• 2022-08-24 Addressing Token Uniformity in Transformers via Singular Value Transformation    Hanqi Yan, Lin Gui, Wenjie Li, Yulan He arXiv_CL arXiv_CL  Transformer  Embedding  Bert  Pose  Attention  Language_Model  PDF
• 2022-08-24 IndicSUPERB: A Speech Processing Universal Performance Benchmark for Indian languages    Tahir Javed, Kaushal Santosh Bhogale, Abhigyan Raman, Anoop Kunchukuttan, Pratyush Kumar, Mitesh M. Khapra arXiv_CL arXiv_CL  Recognition  Bert  Speech  Self-Supervised  Speech_Recognition  Language_Model  PDF
• 2022-08-24 DPTDR: Deep Prompt Tuning for Dense Passage Retrieval    Zhengyang Tang, Benyou Wang, Ting Yao arXiv_CL arXiv_CL  Bert  Pose  Language_Model  PDF
• 2022-08-23 The Alberta Plan for AI Research    Richard S. Sutton, Michael H. Bowling, Patrick M. Pilarski arXiv_AI arXiv_AI  Bert  PDF
• 2022-08-23 K-MHaS: A Multi-label Hate Speech Detection Dataset in Korean Online News Comment    Jean Lee, Taejun Lim, Heejun Lee, Bogeun Jo, Yangsok Kim, Heegeun Yoon, Soyeon Caren Han arXiv_AI arXiv_AI  Bert  Speech  Pose  Classification  Detection  PDF
• 2022-08-22 PoseBERT: A Generic Transformer Module for Temporal 3D Human Modeling    Fabien Baradel, Romain Brégier, Thibault Groueix, Philippe Weinzaepfel, Yannis Kalantidis, Grégory Rogez arXiv_CV arXiv_CV  Transformer  3D  Bert  Pose_Estimation  Pose  Prediction  PDF
• 2022-08-21 MockingBERT: A Method for Retroactively Adding Resilience to NLP Models    Jan Jezabek, Akash Singh arXiv_CL arXiv_CL  Transformer  Bert  Adversarial  Pose  PDF
• 2022-08-21 A Syntax Aware BERT for Identifying Well-Formed Queries in a Curriculum Framework    Avinash Madasu, Anvesh Rao Vijjini arXiv_CL arXiv_CL  Transformer  Bert  Speech  Pose  Language_Model  PDF
• 2022-08-21 CMSBERT-CLR: Context-driven Modality Shifting BERT with Contrastive Learning for linguistic, visual, acoustic Representations    Junghun Kim, Jihie Kim arXiv_CL arXiv_CL  Embedding  Bert  Optimization  Contrastive_Learning  Sentiment  PDF
• 2022-08-20 BSpell: A CNN-blended BERT Based Bengali Spell Checker    Chowdhury Rafeed Rahman, MD. Hasibur Rahman, Samiha Zakir, Mohammad Rafsan, Mohammed Eunus Ali arXiv_CL arXiv_CL  Bert  Pose  PDF
• 2022-08-20 Combining Compressions for Multiplicative Size Scaling on Natural Language Tasks    Rajiv Movva, Jinhao Lei, Shayne Longpre, Ajay Gupta, Chris DuBois arXiv_CL arXiv_CL  Quantization  Bert  Knowledge  Action  Quantitative  Inference  PDF
• 2022-08-20 Representing Knowledge by Spans: A Knowledge-Enhanced Model for Information Extraction    Jiacheng Li, Yannis Katsis, Tyler Baldwin, Ho-Cheol Kim, Andrew Bartko, Julian McAuley, Chun-Nan Hsu arXiv_AI arXiv_AI  Transformer  Embedding  Unsupervised  Bert  Knowledge  Knowledge_Graph  Pose  Action  Relation  Relation_Extraction  Language_Model  PDF
• 2022-08-20 Pretrained Language Encoders are Natural Tagging Frameworks for Aspect Sentiment Triplet Extraction    Yanjie Gou, Yinjie Lei, Lingqiao Liu, Yong Dai, Chunxu Shen, Yongqi Tong arXiv_CL arXiv_CL  Recognition  Bert  Knowledge  Action  Detection  Relation  Sentiment  Attention  PDF
• 2022-08-20 Using Multi-Encoder Fusion Strategies to Improve Personalized Response Selection    Souvik Das, Sougata Saha, Rohini K. Srihari arXiv_AI arXiv_AI  Bert  Emotion  Action  Relation  PDF
• 2022-08-19 Graph-Augmented Cyclic Learning Framework for Similarity Estimation of Medical Clinical Notes    Can Zheng, Yanshan Wang, Xiaowei Jia arXiv_CL arXiv_CL  Bert  Knowledge  Relation  Medical  Language_Model  PDF
• 2022-08-19 Crafting Monocular Cues and Velocity Guidance for Self-Supervised Multi-Frame Depth Learning    Xiaofeng Wang, Zheng Zhu, Guan Huang, Xu Chi, Yun Ye, Ziwei Chen, Xingang Wang arXiv_CV arXiv_CV  Bert  Self-Supervised  Pose  Face  PDF
• 2022-08-19 UniCausal: Unified Benchmark and Model for Causal Text Mining    Fiona Anting Tan, Xinyu Zuo, See-Kiong Ng arXiv_CL arXiv_CL  Bert  Pose  Action  Classification  Detection  PDF
• 2022-08-19 MonaCoBERT: Monotonic attention based ConvBERT for Knowledge Tracing    Unggi Lee, Yonghyun Park, Yujin Kim, Seongyune Choi, Hyeoncheol Kim arXiv_AI arXiv_AI  Embedding  Bert  Knowledge  Pose  Quantitative  Relation  Attention  CNN  PDF
• 2022-08-18 VAuLT: Augmenting the Vision-and-Language Transformer with the Propagation of Deep Language Representations    Georgios Chochlakis, Tejas Srinivasan, Jesse Thomason, Shrikanth Narayanan (University of Southern California) arXiv_CV arXiv_CV  Image_Caption  Transformer  Bert  Pose  Relation  Caption  Inference  Language_Model  PDF
• 2022-08-17 Analyzing Robustness of End-to-End Neural Models for Automatic Speech Recognition    Goutham Rajendran, Wei Zou arXiv_CL arXiv_CL  Recognition  Bert  Adversarial  Speech  Speech_Recognition  Inference  Prediction  PDF
• 2022-08-17 EmoMent: An Emotion Annotated Mental Health Corpus from two South Asian Countries    Thushari Atapattu, Mahen Herath, Charitha Elvitigala, Piyanjali de Zoysa, Kasun Gunawardana, Menasha Thilakaratne, Kasun de Zoysa, Katrina Falkner arXiv_CL arXiv_CL  Bert  Emotion  Face  PDF
• 2022-08-17 Extracting Medication Changes in Clinical Narratives using Pre-trained Language Models    Giridhar Kaushik Ramachandran, Kevin Lybarger, Yaya Liu, Diwakar Mahajan, Jennifer J. Liang, Ching-Huei Tsou, Meliha Yetisgen, Özlem Uzuner arXiv_CL arXiv_CL  Bert  Pose  Action  Classification  Language_Model  PDF
• 2022-08-17 Summarizing Patients Problems from Hospital Progress Notes Using Pre-trained Sequence-to-Sequence Models    Yanjun Gao, Dmitry Dligach, Timothy Miller, Dongfang Xu, Matthew M. Churpek, Majid Afshar arXiv_CL arXiv_CL  Transformer  Embedding  Bert  Knowledge  Pose  Summarization  Medical  Language_Model  PDF
• 2022-08-17 Transformer Encoder for Social Science    Haosen Ge, In Young Park, Xuancheng Qian, Grace Zeng arXiv_CL arXiv_CL  Transformer  Bert  Pose  PDF
• 2022-08-16 BERTifying Sinhala -- A Comprehensive Analysis of Pre-trained Language Models for Sinhala Text Classification    Vinura Dhananjaya, Piyumal Demotte, Surangika Ranathunga, Sanath Jayasena arXiv_CL arXiv_CL  Bert  Text_Classification  Classification  Language_Model  Recommendation  PDF
• 2022-08-16 BERT to Detect Multiword Expressions    Damith Premasiri, Tharindu Ranasinghe arXiv_CL arXiv_CL  Transformer  Bert  RNN  Action  PDF
• 2022-08-15 MENLI: Robust Evaluation Metrics from Natural Language Inference    Yanran Chen, Steffen Eger arXiv_CL arXiv_CL  Bert  Adversarial  Pose  Summarization  Inference  PDF
• 2022-08-15 Z-BERT-A: a zero-shot Pipeline for Unknown Intent detection    Daniele Comi, Dimitrios Christofidellis, Pier Francesco Piazza, Matteo Manica arXiv_CL arXiv_CL  Transformer  Bert  Zero-Shot  Pose  Classification  Detection  Inference  Language_Model  PDF
• 2022-08-15 Continuous Active Learning Using Pretrained Transformers    Nima Sadri, Gordon V. Cormack arXiv_AI arXiv_AI  Transformer  Bert  PDF
• 2022-08-14 Text Difficulty Study: Do machines behave the same as humans regarding text difficulty?    Bowen Chen, Xiao Ding, Li Du, Qin Bing, Ting Liu arXiv_CL arXiv_CL  Bert  RNN  Pose  Attention  Matching  PDF
• 2022-08-13 Interpreting BERT-based Text Similarity via Activation and Saliency Maps    Itzik Malkiel, Dvir Ginzburg, Oren Barkan, Avi Caciularu, Jonathan Weill, Noam Koenigstein arXiv_CL arXiv_CL  Transformer  Embedding  Unsupervised  Bert  Salient  Prediction  PDF
• 2022-08-13 MetricBERT: Text Representation Learning via Self-Supervised Triplet Training    Itzik Malkiel, Dvir Ginzburg, Oren Barkan, Avi Caciularu, Yoni Weill, Noam Koenigstein arXiv_CL arXiv_CL  Bert  Represenation_Learning  Self-Supervised  Recommendation  PDF
• 2022-08-12 Automated Utterance Labeling of Conversations Using Natural Language Processing    Maria Laricheva, Chiyu Zhang, Yan Liu, Guanyu Chen, Terence Tracey, Richard Young, Giuseppe Carenini arXiv_CL arXiv_CL  Bert  Pose  Emotion  Classification  Deep_Learning  PDF
• 2022-08-12 Is Your Model Sensitive? SPeDaC: A New Benchmark for Detecting and Classifying Sensitive Personal Data    Gaia Gambarelli, Aldo Gangemi, Rocco Tripodi arXiv_AI arXiv_AI  Bert  Classification  Detection  PDF
• 2022-08-11 A Twitter-Driven Deep Learning Mechanism for the Determination of Vehicle Hijacking Spots in Cities    Taahir Aiyoob Patel, Clement N. Nyirenda arXiv_CL arXiv_CL  Transformer  Bert  Pose  Deep_Learning  CNN  PDF
• 2022-08-11 Word-Embeddings Distinguish Denominal and Root-Derived Verbs in Semitic    Ido Benbaji (MIT), Omri Doron (MIT), Adèle Hénot-Mortier (MIT) arXiv_AI arXiv_AI  Embedding  Bert  Pose  Relation  Language_Model  PDF
• 2022-08-11 A Model of Anaphoric Ambiguities using Sheaf Theoretic Quantum-like Contextuality and BERT    Kin Ian Lo (University College London, London, UK), Mehrnoosh Sadrzadeh (University College London, London, UK), Shane Mansfield (Quandela, Paris, France) arXiv_AI arXiv_AI  Embedding  Bert  Pose  PDF
• 2022-08-11 Searching for chromate replacements using natural language processing and machine learning algorithms    Shujing Zhao, Nick Birbilis arXiv_CL arXiv_CL  Embedding  Bert  Knowledge  Pose  Quantitative  Relation  Language_Model  PDF
• 2022-08-10 Learning Two-Player Mixture Markov Games: Kernel Function Approximation and Correlated Equilibrium    Chris Junchi Li, Dongruo Zhou, Quanquan Gu, Michael I. Jordan arXiv_AI arXiv_AI  Bert  Pose  Face  Action  PDF
• 2022-08-10 Multi-View Pre-Trained Model for Code Vulnerability Identification    Xuxiang Jiang, Yinhao Xiao, Jun Wang, Wei Zhang arXiv_AI arXiv_AI  Bert  Pose  Contrastive_Learning  PDF
• 2022-08-09 Emotion Detection From Tweets Using a BERT and SVM Ensemble Model    Ionuţ-Alexandru Albu, Stelian Spînu arXiv_CL arXiv_CL  Transformer  Recognition  Bert  Pose  Emotion  Detection  PDF
• 2022-08-09 Attention Hijacking in Trojan Transformers    Weimin Lyu, Songzhu Zheng, Tengfei Ma, Haibin Ling, Chao Chen arXiv_AI arXiv_AI  Transformer  Bert  Pose  Detection  Object_Detection  Attention  PDF
• 2022-08-09 A Multimodal Transformer: Fusing Clinical Notes with Structured EHR Data for Interpretable In-Hospital Mortality Prediction    Weimin Lyu, Xinyu Dong, Rachel Wong, Songzhu Zheng, Kayley Abell-Hart, Fusheng Wang, Chao Chen arXiv_CL arXiv_CL  Transformer  Bert  Pose  Prediction  PDF
• 2022-08-09 Exploring Hate Speech Detection with HateXplain and BERT    Arvind Subramaniam, Aryan Mehra, Sayani Kundu arXiv_CL arXiv_CL  Bert  Speech  Classification  Detection  Attention  Prediction  PDF
• 2022-08-07 SciAnnotate: A Tool for Integrating Weak Labeling Sources for Sequence Labeling    Mengyang Liu, Haozheng Luo, Leonard Thong, Yinghao Li, Chao Zhang, Le Song arXiv_CL arXiv_CL  Recognition  Bert  Face  Denoising  Language_Model  PDF
• 2022-08-06 HSIC-InfoGAN: Learning Unsupervised Disentangled Representations by Maximising Approximated Mutual Information    Xiao Liu, Spyridon Thermos, Pedro Sanchez, Alison Q. O'Neil, Sotirios A. Tsaftaris arXiv_CV arXiv_CV  Unsupervised  Bert  GAN  Medical  PDF
• 2022-08-05 Leveraging Distributional Bias for Reactive Collision Avoidance under Uncertainty: A Kernel Embedding Approach    Anish Gupta, Arun Kumar Singh, K. Madhava Krishna arXiv_RO arXiv_RO  Embedding  Bert  Pose  Activity  Matching  PDF
• 2022-08-03 A Study of Modeling Rising Intonation in Cantonese Neural Speech Synthesis    Qibing Bai, Tom Ko, Yu Zhang arXiv_SD arXiv_SD  Bert  Speech  Pose  Language_Model  PDF
• 2022-08-03 KPI-BERT: A Joint Named Entity Recognition and Relation Extraction Model for Financial Reports    Lars Hillebrand, Tobias Deußer, Tim Dilmaghani, Bernd Kliem, Rüdiger Loitz, Christian Bauckhage, Rafet Sifa arXiv_AI arXiv_AI  Transformer  Recognition  Bert  RNN  Knowledge  Action  Relation  Relation_Extraction  Prediction  PDF
• 2022-08-03 Efficient Fine-Tuning of Compressed Language Models with Learners    Danilo Vucetic, Mohammadreza Tayaranian, Maryam Ziaeefard, James J. Clark, Brett H. Meyer, Warren J. Gross arXiv_CL arXiv_CL  Bert  Inference  Language_Model  PDF
• 2022-08-03 Cross-lingual Approaches for the Detection of Adverse Drug Reactions in German from a Patient's Perspective    Lisa Raithel, Philippe Thomas, Roland Roller, Oliver Sapina, Sebastian Möller, Pierre Zweigenbaum arXiv_CL arXiv_CL  Bert  Action  Classification  Detection  Few-Shot  Medical  PDF
• 2022-08-03 Introducing BEREL: BERT Embeddings for Rabbinic-Encoded Language    Avi Shmidman, Joshua Guedalia, Shaltiel Shmidman, Cheyn Shmuel Shmidman, Eli Handel, Moshe Koppel arXiv_CL arXiv_CL  Embedding  Bert  Language_Model  PDF
• 2022-08-02 Exploring Gender Bias in Retrieval Models    Dhanasekar Sundararaman, Vivek Subramanian arXiv_CL arXiv_CL  Bert  Zero-Shot  Action  PDF
• 2022-08-02 BERT4Loc: BERT for Location -- POI Recommender System    Syed Raza Bashir, Vojislav Misic arXiv_AI arXiv_AI  Transformer  Bert  Pose  Recommendation  PDF
• 2022-08-02 A Comparative Study on COVID-19 Fake News Detection Using Different Transformer Based Models    Sajib Kumar Saha Joy, Dibyo Fabian Dofadar, Riyo Hayat Khan, Md. Sabbir Ahmed, Rafeed Rahman arXiv_CL arXiv_CL  Transformer  Bert  RNN  Detection  PDF
• 2022-08-02 Bias in -Contextual Clinical Word Embeddings    Gizem Sogancioglu, Fabian Mijsters, Amar van Uden, Jelle Peperzak arXiv_CL arXiv_CL  Embedding  Bert  Relation  Medical  PDF
• 2022-08-02 BEIKE NLP at SemEval-2022 Task 4: Prompt-Based Paragraph Classification for Patronizing and Condescending Language Detection    Yong Deng, Chenxiao Dou, Liangyu Chen, Deqiang Miao, Xianghui Sun, Baochang Ma, Xiangang Li arXiv_CL arXiv_CL  Bert  Text_Classification  Classification  Detection  Language_Model  PDF
• 2022-08-02 Automatic Classification of Bug Reports Based on Multiple Text Information and Reports' Intention    Fanqi Meng, Xuesong Wang, Jingdong Wang, Peifang Wang arXiv_CL arXiv_CL  Tracking  Bert  Pose  Classification  PDF
• 2022-08-01 BabelBERT: Massively Multilingual Transformers Meet a Massively Multilingual Lexical Resource    Tommaso Green, Simone Paolo Ponzetto, Goran Glavaš arXiv_CL arXiv_CL  Transformer  Embedding  Bert  Knowledge  Pose  Language_Model  PDF
• 2022-08-01 giMLPs: Gate with Inhibition Mechanism in MLPs    Cheng Kang, Jindich Prokop, Lei Tong, Huiyu Zhou, Yong Hu, Daneil Novak arXiv_CL arXiv_CL  Bert  Classification  Attention  Image_Classification  PDF
• 2022-08-01 DictBERT: Dictionary Description Knowledge Enhanced Language Model Pre-training via Contrastive Learning    Qianglong Chen, Feng-Lin Li, Guohai Xu, Ming Yan, Ji Zhang, Yin Zhang arXiv_CL arXiv_CL  Bert  Knowledge  Knowledge_Graph  Pose  Contrastive_Learning  Action  Relation  Relation_Extraction  Attention  Language_Model  Prediction  QA  PDF
• 2022-07-31 Mismatching-Aware Unsupervised Translation Quality Estimation For Low-Resource Languages    Fatemeh Azadi, Heshaam Faili, Mohammad Javad Dousti arXiv_CL arXiv_CL  Unsupervised  Bert  Zero-Shot  Pose  Relation  Attention  Matching  PDF
• 2022-07-30 A Survey on Masked Autoencoder for Self-supervised Learning in Vision and Beyond    Chaoning Zhang, Chenshuang Zhang, Junha Song, John Seon Keun Yi, Kang Zhang, In So Kweon arXiv_AI arXiv_AI  Bert  Review  Self-Supervised  Contrastive_Learning  Survey  Denoising  Attention  Prediction  PDF
• 2022-07-29 SERCNN: Stacked Embedding Recurrent Convolutional Neural Network in Detecting Depression on Twitter    Heng Ee Tay, Mei Kuan Lim, Chun Yong Chong arXiv_AI arXiv_AI  Embedding  Bert  Pose  Activity  CNN  Inference  PDF
• 2022-07-29 Curriculum Learning for Data-Efficient Vision-Language Alignment    Tejas Srinivasan, Xiang Ren, Jesse Thomason arXiv_AI arXiv_AI  Bert  Zero-Shot  Image_Retrieval  Ontology  Contrastive_Learning  PDF
• 2022-07-29 Code Comment Inconsistency Detection with BERT and Longformer    Theo Steiner, Rui Zhang arXiv_CL arXiv_CL  Bert  Pose  Detection  Inference  Language_Model  PDF
• 2022-07-28 Aztec curve: proposal for a new space-filling curve    Diego Ayala, Daniel Durini, Jose Rangel-Magdaleno arXiv_CV arXiv_CV  Bert  Review  Pose  PDF
• 2022-07-28 Multi-Step Deductive Reasoning Over Natural Language: An Empirical Study on Out-of-Distribution Generalisation    Qiming Bao, Alex Yuxuan Peng, Tim Hartill, Neset Tan, Zhenyun Deng, Michael Witbrock, Jiamou Liu arXiv_AI arXiv_AI  Bert  RNN  Deep_Learning  Attention  Inference  PDF
• 2022-07-28 Sequence to sequence pretraining for a less-resourced Slovenian language    Matej Ulčar, Marko Robnik-Šikonja arXiv_CL arXiv_CL  Bert  Classification  Summarization  Text_Generation  Language_Model  PDF
• 2022-07-28 MLRIP: Pre-training a military language representation model with informative factual knowledge and professional knowledge base    Hui Li, Xuekang Yang, Xin Zhao, Lin Yu, Jiping Zheng, Wei Sun arXiv_CL arXiv_CL  Bert  Knowledge  Pose  Action  Relation  Relation_Extraction  Language_Model  PDF
• 2022-07-28 SDBERT: SparseDistilBERT, a faster and smaller BERT model    Devaraju Vinoda, Pawan Kumar Yadav arXiv_CL arXiv_CL  Transformer  Bert  Sparse  Knowledge  Attention  PDF
• 2022-07-27 Detecting Spam Reviews on Vietnamese E-commerce Websites    Co Van Dinh, Son T. Luu, Anh Gia-Tuan Nguyen arXiv_AI arXiv_AI  Bert  Review  Pose  Classification  PDF
• 2022-07-27 SoundChoice: Grapheme-to-Phoneme Models with Semantic Disambiguation    Artem Ploujnikov, Mirco Ravanelli arXiv_SD arXiv_SD  Embedding  Recognition  Bert  Speech  Pose  Classification  Speech_Recognition  Language_Model  PDF
• 2022-07-27 Point-McBert: A Multi-choice Self-supervised Framework for Point Cloud Pre-training    Kexue Fu, Mingzhi Yuan, Manning Wang arXiv_CV arXiv_CV  Transformer  Segmentation  Point_Cloud  Bert  Self-Supervised  Pose  Classification  Few-Shot  Language_Model  PDF
• 2022-07-26 When BERT Fails -- The Limits of EHR Classification    Augusto Garcia-Agundez, Carsten Eickhoff arXiv_CL arXiv_CL  Transformer  Bert  Classification  Prediction  PDF
• 2022-07-26 Learning structures of the French clinical language:development and validation of word embedding models using 21 million clinical reports from electronic health records    Basile Dura, Charline Jean, Xavier Tannier, Alice Calliger, Romain Bey, Antoine Neuraz, Rémi Flicoteaux arXiv_CL arXiv_CL  Embedding  Transfer_Learning  Bert  Medical  Language_Model  PDF
• 2022-07-26 Bundle MCR: Towards Conversational Bundle Recommendation    Zhankui He, Handong Zhao, Tong Yu, Sungchul Kim, Fan Du, Julian McAuley arXiv_AI arXiv_AI  Bert  Pose  Action  Recommendation  PDF
• 2022-07-25 Fine-Tuning BERT for Automatic ADME Semantic Labeling in FDA Drug Labeling to Enhance Product-Specific Guidance Assessment    Yiwen Shi, Jing Wang, Ping Ren, Taha ValizadehAslani, Yi Zhang, Meng Hu, Hualou Liang arXiv_CL arXiv_CL  Transformer  Transfer_Learning  Bert  Knowledge  Attention  Language_Model  PDF
• 2022-07-25 UrduFake@FIRE2020: Shared Track on Fake News Identification in Urdu    Maaz Amjad, Grigori Sidorov, Alisa Zhila, Alexander Gelbukh, Paolo Rosso arXiv_CL arXiv_CL  Bert  Pose  Classification  Detection  PDF
• 2022-07-25 Overview of the Shared Task on Fake News Detection in Urdu at FIRE 2020    Maaz Amjad, Grigori Sidorov, Alisa Zhila, Alexander Gelbukh, Paolo Rosso arXiv_CL arXiv_CL  Bert  Pose  Classification  Detection  PDF
• 2022-07-25 nLMVS-Net: Deep Non-Lambertian Multi-View Stereo    Kohei Yamashita, Yuto Enyo, Shohei Nobuhara, Ko Nishino arXiv_CV arXiv_CV  Reconstruction  Bert  Face  Quantitative  PDF
• 2022-07-24 A Cognitive Study on Semantic Similarity Analysis of Large Corpora: A Transformer-based Approach    Praneeth Nemani, Satyanarayana Vollala arXiv_AI arXiv_AI  Transformer  Recognition  Bert  RNN  Action  Relation  Attention  Matching  PDF
• 2022-07-24 Kernel Relative-prototype Spectral Filtering for Few-shot Learning    Tao Zhang, Wu Huang arXiv_AI arXiv_AI  Bert  Regularization  Pose  Classification  Few-Shot  PDF
• 2022-07-24 No More Fine-Tuning? An Experimental Evaluation of Prompt Tuning in Code Intelligence    Chaozheng Wang, Yuanhang Yang, Cuiyun Gao, Yun Peng, Hongyu Zhang, Michael R. Lyu arXiv_AI arXiv_AI  Bert  Knowledge  Summarization  Prediction  PDF
• 2022-07-23 Better Reasoning Behind Classification Predictions with BERT for Fake News Detection    Daesoo Lee arXiv_CL arXiv_CL  Embedding  Bert  Self-Supervised  Pose  Classification  Detection  Prediction  PDF
• 2022-07-23 Vaccine Discourse on Twitter During the COVID-19 Pandemic    Gabriel Lindelöf, Talayeh Aledavood, Barbara Keller arXiv_CL arXiv_CL  Bert  PDF
• 2022-07-23 Catch Me If You Can: Deceiving Stance Detection and Geotagging Models to Protect Privacy of Individuals on Twitter    Dilara Dogan, Bahadir Altun, Muhammed Said Zengin, Mucahid Kutlu, Tamer Elsayed arXiv_CL arXiv_CL  Bert  Salient  Detection  PDF
• 2022-07-23 PS-NeRF: Neural Inverse Rendering for Multi-view Photometric Stereo    Wenqi Yang, Guanying Chen, Chaofeng Chen, Zhenfang Chen, Kwan-Yee K. Wong arXiv_AI arXiv_AI  Reconstruction  Bert  Optimization  Pose  Face  PDF
• 2022-07-22 Assessing mortality prediction through different representation models based on concepts extracted from clinical notes    Hoda Memarzadeh, Nasser Ghadiri, Maryam Lotfi Shahreza arXiv_CL arXiv_CL  Transformer  Embedding  Bert  Pose  Medical  Prediction  PDF
• 2022-07-20 Integrating Linguistic Theory and Neural Language Models    Bai Li arXiv_CL arXiv_CL  Transformer  Bert  Knowledge  Pose  Face  Language_Model  PDF
• 2022-07-19 Enhancing Collaborative Filtering Recommender with Prompt-Based Sentiment Analysis    Elliot Dang, Zheyuan Hu, Tong Li arXiv_CL arXiv_CL  Bert  Review  Sentiment  Recommendation  PDF
• 2022-07-19 On the Usability of Transformers-based models for a French Question-Answering task    Oralie Cattan, Christophe Servan, Sophie Rosset arXiv_AI arXiv_AI  Transformer  Transfer_Learning  Bert  Optimization  Pose  Language_Model  PDF
• 2022-07-19 PiC: A Phrase-in-Context Dataset for Phrase Understanding and Semantic Search    Thang M. Pham, Seunghyun Yoon, Trung Bui, Anh Nguyen arXiv_AI arXiv_AI  Embedding  Bert  Pose  QA  PDF
• 2022-07-18 Selection Bias Induced Spurious Correlations in Large Language Models    Emily McMilin arXiv_AI arXiv_AI  Bert  Relation  Language_Model  PDF
• 2022-07-17 Representation Learning of Image Schema    Fajrian Yunus, Chloé Clavel, Catherine Pelachaud arXiv_AI arXiv_AI  Embedding  Bert  Gesture  Represenation_Learning  Pose  PDF
• 2022-07-17 Troll Tweet Detection Using Contextualized Word Representations    Seyhmus Yilmaz, Sultan Zavrak arXiv_AI arXiv_AI  Embedding  Bert  Pose  Classification  Deep_Learning  Detection  PDF
• 2022-07-17 Natural language processing for clusterization of genes according to their functions    Vladislav Dordiuk, Ekaterina Demicheva, Fernando Polanco Espino, Konstantin Ushenin arXiv_CL arXiv_CL  Bert  Review  Pose  Language_Model  PDF
• 2022-07-17 ELECTRA is a Zero-Shot Learner, Too    Shiwen Ni, Hung-Yu Kao arXiv_CL arXiv_CL  Bert  Zero-Shot  Pose  Detection  Few-Shot  Language_Model  PDF
• 2022-07-17 Aspect-specific Context Modeling for Aspect-based Sentiment Analysis    Fang Ma, Chen Zhang, Bo Zhang, Dawei Song arXiv_CL arXiv_CL  Bert  Adversarial  Pose  Sentiment  Attention  Language_Model  PDF
• 2022-07-15 Probing Semantic Grounding in Language Models of Code with Representational Similarity Analysis    Shounak Naik, Rajaswa Patil, Swati Agarwal, Veeky Baths arXiv_CL arXiv_CL  Bert  Pose  Language_Model  PDF
• 2022-07-15 POET: Training Neural Networks on Tiny Devices with Integrated Rematerialization and Paging    Shishir G. Patil, Paras Jain, Prabal Dutta, Ion Stoica, Joseph E. Gonzalez arXiv_CV arXiv_CV  Bert  PDF
• 2022-07-15 Position Prediction as an Effective Pretraining Strategy    Shuangfei Zhai, Navdeep Jaitly, Jason Ramapuram, Dan Busbridge, Tatiana Likhomanenko, Joseph Yitan Cheng, Walter Talbott, Chen Huang, Hanlin Goh, Joshua Susskind arXiv_CV arXiv_CV  Transformer  Reconstruction  Embedding  Unsupervised  Recognition  Bert  Regularization  Speech  Self-Supervised  Pose  Classification  Relation  Speech_Recognition  Prediction  PDF
• 2022-07-15 A Systematic Review and Replicability Study of BERT4Rec for Sequential Recommendation    Aleksandr Petrov, Craig Macdonald arXiv_AI arXiv_AI  Transformer  Bert  Review  Pose  Face  Attention  Recommendation  PDF
• 2022-07-15 Z-Index at CheckThat! Lab 2022: Check-Worthiness Identification on Tweet Text    Prerona Tarannum, Firoj Alam, Md. Arid Hasan, Sheak Rashed Haider Noori arXiv_CL arXiv_CL  Transformer  Bert  PDF
• 2022-07-14 Bootstrapped Masked Autoencoders for Vision BERT Pretraining    Xiaoyi Dong, Jianmin Bao, Ting Zhang, Dongdong Chen, Weiming Zhang, Lu Yuan, Dong Chen, Fang Wen, Nenghai Yu arXiv_CV arXiv_CV  Segmentation  Semantic_Segmentation  Bert  Pose  Detection  Object_Detection  Prediction  PDF
• 2022-07-14 A Single Self-Supervised Model for Many Speech Modalities Enables Zero-Shot Modality Transfer    Wei-Ning Hsu, Bowen Shi arXiv_AI arXiv_AI  Recognition  Bert  Zero-Shot  Speech  Self-Supervised  Speech_Recognition  Prediction  PDF
• 2022-07-14 Language Modelling with Pixels    Phillip Rust, Jonas F. Lotz, Emanuele Bugliarello, Elizabeth Salesky, Miryam de Lhoneux, Desmond Elliott arXiv_AI arXiv_AI  Embedding  Bert  Language_Model  PDF
• 2022-07-14 Multilinguals at SemEval-2022 Task 11: Complex NER in Semantically Ambiguous Settings for Low Resource Languages    Amit Pandey, Swayatta Daw, Narendra Babu Unnam, Vikram Pudi arXiv_AI arXiv_AI  Unsupervised  Bert  RNN  Language_Model  PDF
• 2022-07-14 BERTIN: Efficient Pre-Training of a Spanish Language Model using Perplexity Sampling    Javier de la Rosa, Eduardo G. Ponferrada, Paulo Villegas, Pablo Gonzalez de Prado Salas, Manu Romero, Marıa Grandury arXiv_AI arXiv_AI  Transformer  Bert  Language_Model  PDF
• 2022-07-14 Improving Multi-Interest Network with Stable Learning    Zhaocheng Liu, Yingtao Luo, Di Zeng, Qiang Liu, Daqing Chang, Dongying Kong, Zhi Chen arXiv_AI arXiv_AI  Bert  Pose  Relation  Prediction  Recommendation  PDF
• 2022-07-14 Overview of Abusive and Threatening Language Detection in Urdu at FIRE 2021    Maaz Amjad, Alisa Zhila, Grigori Sidorov, Andrey Labunets, Sabur Butta, Hamza Imam Amjad, Oxana Vitman, Alexander Gelbukh arXiv_CL arXiv_CL  Transformer  Bert  Pose  Classification  Detection  PDF
• 2022-07-14 Active Data Pattern Extraction Attacks on Generative Language Models    Bargav Jayaraman, Esha Ghosh, Huseyin Inan, Melissa Chase, Sambuddha Roy, Wei Dai arXiv_CL arXiv_CL  Bert  Action  Language_Model  PDF
• 2022-07-13 Graph Neural Network Bandits    Parnian Kassraie, Andreas Krause, Ilija Bogunovic arXiv_AI arXiv_AI  Embedding  Bert  Optimization  PDF
• 2022-07-13 A Transfer Learning Based Model for Text Readability Assessment in German    Salar Mohtaj, Babak Naderi, Sebastian Möller, Faraz Maschhur, Chuyang Wu, Max Reinhard arXiv_AI arXiv_AI  Transfer_Learning  Bert  Pose  Action  Language_Model  PDF
• 2022-07-13 Developing a Component Comment Extractor from Product Reviews on E-Commerce Sites    Shogo Anda, Masato Kikuchi, Tadachika Ozono arXiv_CL arXiv_CL  Bert  Review  Matching  PDF
• 2022-07-13 Exploiting Word Semantics to Enrich Character Representations of Chinese Pre-trained Models    Wenbiao Li, Rui Sun, Yunfang Wu arXiv_CL arXiv_CL  Segmentation  Embedding  Bert  Sentiment_Classification  Pose  Classification  Sentiment  Attention  Inference  Matching  PDF
• 2022-07-12 A Novel DeBERTa-based Model for Financial Question Answering Task    Yanbo J. Wang, Yuming Li, Hui Qin, Yuhang Guan, Sheng Chen arXiv_CL arXiv_CL  Bert  Optimization  Language_Model  QA  PDF
• 2022-07-12 How Do Multilingual Encoders Learn Cross-lingual Representation?    Shijie Wu arXiv_CL arXiv_CL  Bert  Optimization  Represenation_Learning  PDF
• 2022-07-12 Using Paraphrases to Study Properties of Contextual Embeddings    Laura Burdick, Jonathan K. Kummerfeld, Rada Mihalcea arXiv_CL arXiv_CL  Embedding  Bert  PDF
• 2022-07-12 Forecasting COVID-19 spreading trough an ensemble of classical and machine learning models: Spain's case study    Ignacio Heredia Cacha, Judith Sainz-Pardo Díaz, María Castrillo Melguizo, Álvaro López García arXiv_AI arXiv_AI  Bert  Prediction  PDF
• 2022-07-11 Overview of the Shared Task on Fake News Detection in Urdu at FIRE 2021    Maaz Amjad, Sabur Butt, Hamza Imam Amjad, Alisa Zhila, Grigori Sidorov, Alexander Gelbukh arXiv_CL arXiv_CL  Transformer  Embedding  Bert  Pose  Classification  Detection  GAN  PDF
• 2022-07-11 Learning an evolved mixture model for task-free continual learning    Fei Ye, Adrian G. Bors arXiv_AI arXiv_AI  Bert  Knowledge  Pose  Deep_Learning  PDF
• 2022-07-11 Multi-level Fusion of Wav2vec 2.0 and BERT for Multimodal Emotion Recognition    Zihan Zhao, Yanfeng Wang, Yu Wang arXiv_CL arXiv_CL  Embedding  Transfer_Learning  Recognition  Bert  Speech  Pose  Emotion  Face  Action  Attention  PDF
• 2022-07-11 Learning Large-scale Universal User Representation with Sparse Mixture of Experts    Caigao Jiang, Siqiao Xue, James Zhang, Lingyue Liu, Zhibo Zhu, Hongyan Hao arXiv_CL arXiv_CL  Transformer  Embedding  Bert  Sparse  Pose  Action  PDF
• 2022-07-11 Edge-preserving Near-light Photometric Stereo with Neural Surfaces    Heng Guo, Hiroaki Santo, Boxin Shi, Yasuyuki Matsushita arXiv_CV arXiv_CV  Reconstruction  3D  Bert  Face  PDF
• 2022-07-10 Myers-Briggs personality classification from social media text using pre-trained language models    Vitor Garcia dos Santos, Ivandré Paraboni arXiv_CL arXiv_CL  Transformer  Embedding  Bert  Text_Classification  Classification  Sentiment  Language_Model  PDF
• 2022-07-10 Multilingual Persuasion Detection: Video Games as an Invaluable Data Source for NLP    Teemu Pöyhönen, Mika Hämäläinen, Khalid Alnajjar arXiv_CL arXiv_CL  Bert  Detection  PDF
• 2022-07-08 ABB-BERT: A BERT model for disambiguating abbreviations and contractions    Prateek Kacker, Andi Cupallari, Aswin Gridhar Subramanian, Nimit Jain arXiv_CL arXiv_CL  Bert  Pose  Action  PDF
• 2022-07-08 Hidden Schema Networks    Ramsés J. Sánchez, Lukas Conrads, Pascal Welke, Kostadin Cvejoski, César Ojeda arXiv_AI arXiv_AI  Bert  Pose  Quantitative  Relation  Language_Model  PDF
• 2022-07-08 Computationally Identifying Funneling and Focusing Questions in Classroom Discourse    Sterling Alic, Dorottya Demszky, Zid Mancenido, Jing Liu, Heather Hill, Dan Jurafsky arXiv_CL arXiv_CL  Unsupervised  Bert  Pose  Relation  PDF
• 2022-07-07 AsNER -- Annotated Dataset and Baseline for Assamese Named Entity recognition    Dhrubajyoti Pathak, Sukumar Nandi, Priyankoo Sarmah arXiv_AI arXiv_AI  Embedding  Recognition  Bert  RNN  Speech  Pose  PDF
• 2022-07-07 Neural Language Models are not Born Equal to Fit Brain Data, but Training Helps    Alexandre Pasquiou (PARIETAL, UNICOG-U992), Yair Lakretz (UNICOG-U992), John Hale, Bertrand Thirion (PARIETAL), Christophe Pallier (UNICOG-U992) arXiv_AI arXiv_AI  Transformer  Bert  RNN  Activity  Language_Model  Prediction  PDF
• 2022-07-07 Multimodal E-Commerce Product Classification Using Hierarchical Fusion    Tsegaye Misikir Tashu, Sara Fattouh, Peter Kiss, Tomas Horvath arXiv_AI arXiv_AI  Embedding  Bert  Pose  Classification  PDF
• 2022-07-07 Active Learning and Multi-label Classification for Ellipsis and Coreference Detection in Conversational Question-Answering    Quentin Brabant, Lina Maria Rojas-Barahona, Claire Gardent arXiv_CL arXiv_CL  Bert  Pose  Classification  Detection  PDF
• 2022-07-07 A Large Scale Search Dataset for Unbiased Learning to Rank    Lixin Zou, Haitao Mao, Xiaokai Chu, Jiliang Tang, Wenwen Ye, Shuaiqiang Wang, Dawei Yin arXiv_AI arXiv_AI  Bert  Optimization  Action  Deep_Learning  Language_Model  PDF
• 2022-07-07 Sensitivity Analysis on Transferred Neural Architectures of BERT and GPT-2 for Financial Sentiment Analysis    Tracy Qian, Andy Xie, Camille Bruckmann arXiv_CL arXiv_CL  Transformer  Embedding  Bert  Deep_Learning  Sentiment  PDF
• 2022-07-06 On The Universality of Diagrams for Causal Inference and The Causal Reproducing Property    Sridhar Mahadevan arXiv_AI arXiv_AI  Bert  Pose  Relation  Inference  PDF
• 2022-07-06 Effective and Efficient Training for Sequential Recommendation using Recency Sampling    Aleksandr Petrov, Craig Macdonald arXiv_AI arXiv_AI  Bert  Pose  Action  Prediction  Recommendation  PDF
• 2022-07-06 The Role of Complex NLP in Transformers for Text Ranking?    David Rau, Jaap Kamps arXiv_AI arXiv_AI  Transformer  Embedding  Bert  Attention  Language_Model  PDF
• 2022-07-06 Aspect-Based Sentiment Analysis using Local Context Focus Mechanism with DeBERTa    Tianyu Zhao, Junping Du, Zhe Xu, Ang Li, Zeli Guan arXiv_CL arXiv_CL  Transformer  Bert  Self-Supervised  Pose  Emotion  Sentiment  Attention  Language_Model  PDF
• 2022-07-05 Putting the Con in Context: Identifying Deceptive Actors in the Game of Mafia    Samee Ibraheem, Gaoyue Zhou, John DeNero arXiv_AI arXiv_AI  Bert  Text_Classification  Classification  PDF
• 2022-07-05 Betti numbers of attention graphs is all you really need    Laida Kushnareva, Dmitri Piontkovski, Irina Piontkovskaya arXiv_CL arXiv_CL  Bert  Text_Classification  Knowledge  Classification  Attention  PDF
• 2022-07-05 ASR-Generated Text for Language Model Pre-training Applied to Speech Tasks    Valentin Pelloin, Franck Dary, Nicolas Herve, Benoit Favre, Nathalie Camelin, Antoine Laurent, Laurent Besacier arXiv_CL arXiv_CL  Bert  Speech  Classification  Language_Model  PDF
• 2022-07-04 BERT, can HE predict contrastive focus? Predicting and controlling prominence in neural TTS using a language model    Brooke Stephenson, Laurent Besacier, Laurent Girin, Thomas Hueber arXiv_CL arXiv_CL  Transformer  Bert  Knowledge  Speech  Language_Model  Prediction  PDF
• 2022-07-04 A Cascade Model for Argument Mining in Japanese Political Discussions: the QA Lab-PoliInfo-3 Case Study    Ramon Ruiz-Dolz arXiv_CL arXiv_CL  Embedding  Bert  Classification  Detection  Relation  QA  PDF
• 2022-07-04 Using contextual sentence analysis models to recognize ESG concepts    Elvys Linhares Pontes, Mohamed Benjannet, Jose G. Moreno, Antoine Doucet arXiv_CL arXiv_CL  Bert  Pose  PDF
• 2022-07-02 A Multi-Task BERT Model for Schema-Guided Dialogue State Tracking    Eleftherios Kapelonis, Efthymios Georgiou, Alexandros Potamianos arXiv_CL arXiv_CL  Transformer  Tracking  Bert  Zero-Shot  Pose  Prediction  PDF
• 2022-07-02 An End-to-End Set Transformer for User-Level Classification of Depression and Gambling Disorder    Ana-Maria Bucur, Adrian Cosma, Liviu P. Dinu, Paolo Rosso arXiv_CL arXiv_CL  Transformer  Bert  Pose  Action  Classification  Detection  Attention  PDF
• 2022-07-02 GUIM -- General User and Item Embedding with Mixture of Representation in E-commerce    Chao Yang, Ru He, Fangquan Lin, Suoyuan Song, Jingqiao Zhang, Cheng Yang arXiv_AI arXiv_AI  Embedding  Bert  Pose  Contrastive_Learning  Action  Recommendation  PDF
• 2022-07-01 Improving Low-Resource Speech Recognition with Pretrained Speech Models: Continued Pretraining vs. Semi-Supervised Training    Mitchell DeHaven, Jayadev Billa arXiv_CL arXiv_CL  Transformer  Recognition  Bert  Speech  Self-Supervised  Speech_Recognition  PDF
• 2022-07-01 Is neural language acquisition similar to natural? A chronological probing study    Ekaterina Voloshina, Oleg Serikov, Tatiana Shavrina arXiv_CL arXiv_CL  Transformer  Bert  Knowledge  Language_Model  PDF
• 2022-07-01 FitHuBERT: Going Thinner and Deeper for Knowledge Distillation of Speech Self-Supervised Learning    Yeonghyeon Lee, Kangwook Jang, Jahyun Goo, Youngmoon Jung, Hoirin Kim arXiv_CL arXiv_CL  Recognition  Bert  Knowledge  Speech  Self-Supervised  Pose  Inference  PDF
• 2022-07-01 A Polyphone BERT for Polyphone Disambiguation in Mandarin Chinese    Song Zhang, Ken Zheng, Xiaoxu Zhu, Baoxiang Li arXiv_CL arXiv_CL  Embedding  Bert  Speech  Pose  PDF
• 2022-06-30 Two-Stage Classifier for COVID-19 Misinformation Detection Using BERT: a Study on Indonesian Tweets    Douglas Raevan Faisal, Rahmad Mahendra arXiv_CL arXiv_CL  Bert  Text_Classification  RNN  Pose  Classification  Detection  Language_Model  Prediction  PDF
• 2022-06-30 Domain Adaptive Pretraining for Multilingual Acronym Extraction    Usama Yaseen, Stefan Langer arXiv_CL arXiv_CL  Embedding  Bert  RNN  Action  PDF
• 2022-06-30 The Topological BERT: Transforming Attention into Topology for Natural Language Processing    Ilan Perez, Raphael Reinauer arXiv_CL arXiv_CL  Transformer  Bert  Knowledge  Review  Adversarial  Pose  Attention  PDF
• 2022-06-30 Compressing Pre-trained Transformers via Low-Bit NxM Sparsity for Natural Language Understanding    Connor Holmes, Minjia Zhang, Yuxiong He, Bo Wu arXiv_AI arXiv_AI  Transformer  Quantization  Bert  Pose  QA  PDF
• 2022-06-29 Two-Stage COVID19 Classification Using BERT Features    Weijun Tan, Qi Yao, Jingfeng Liu arXiv_CV arXiv_CV  Embedding  3D  Bert  Pose  Action  Classification  PDF
• 2022-06-29 Improving Deliberation by Text-Only and Semi-Supervised Training    Ke Hu, Tara N. Sainath, Yanzhang He, Rohit Prabhavalkar, Trevor Strohman, Sepand Mavandadi, Weiran Wang arXiv_SD arXiv_SD  Transformer  Bert  Speech  Pose  Attention  Language_Model  PDF
• 2022-06-29 Towards a Data-Driven Requirements Engineering Approach: Automatic Analysis of User Reviews    Jialiang Wei, Anne-Lise Courbis, Thomas Lambolais, Binbin Xu, Pierre Louis Bernard, Gérard Dray arXiv_CL arXiv_CL  Bert  Review  Classification  Language_Model  PDF
• 2022-06-29 Simple and Effective Multi-sentence TTS with Expressive and Coherent Prosody    Peter Makarov, Ammar Abbas, Mateusz Łajszczak, Arnaud Joly, Sri Karlapati, Alexis Moinet, Thomas Drugman, Penny Karanasou arXiv_CL arXiv_CL  Transformer  Bert  Speech  Language_Model  PDF
• 2022-06-29 Chinese Word Sense Embedding with SememeWSD and Synonym Set    Yangxi Zhou, Junping Du, Zhe Xue, Ang Li, Zeli Guan arXiv_CL arXiv_CL  Embedding  Unsupervised  Bert  Pose  PDF
• 2022-06-28 Bottleneck Low-rank Transformers for Low-resource Spoken Language Understanding    Pu Wang, Hugo Van hamme arXiv_CL arXiv_CL  Transformer  Bert  Pose  Attention  PDF
• 2022-06-28 BertNet: Harvesting Knowledge Graphs from Pretrained Language Models    Shibo Hao, Bowen Tan, Kaiwen Tang, Hengzhe Zhang, Eric P Xing, Zhiting Hu arXiv_CL arXiv_CL  Bert  Knowledge  Knowledge_Graph  Action  Relation  Language_Model  PDF
• 2022-06-28 Kwame for Science: An AI Teaching Assistant for Science Education in West Africa    George Boateng, Samuel John, Andrew Glago, Samuel Boateng, Victor Kumbol arXiv_CL arXiv_CL  Bert  PDF
• 2022-06-26 Contextual embedding and model weighting by fusing domain knowledge on Biomedical Question Answering    Yuxuan Lu, Jingya Yan, Zhixuan Qi, Zhongzheng Ge, Yongping Du arXiv_AI arXiv_AI  Embedding  Unsupervised  Bert  Knowledge  Pose  Medical  QA  PDF
• 2022-06-25 Modeling Oceanic Variables with Dynamic Graph Neural Networks    Caio F. D. Netto, Marcel R. de Barros, Jefferson F. Coelho, Lucas P. de Freitas, Felipe M. Moreno, Marlon S. Mathias, Marcelo Dottori, Fábio G. Cozman, Anna H. R. Costa, Edson S. Gomi, Eduardo A. Tannuri arXiv_AI arXiv_AI  Transformer  Bert  RNN  Knowledge  Face  Relation  PDF
• 2022-06-25 Evaluation of Semantic Answer Similarity Metrics    Farida Mustafazade, Peter Ebbinghaus arXiv_AI arXiv_AI  Transformer  Bert  Knowledge  Pose  Relation  Prediction  QA  PDF
• 2022-06-25 Synthesizing Personalized Non-speech Vocalization from Discrete Speech Representations    Chin-Cheng Hsu arXiv_CL arXiv_CL  Bert  Speech  Few-Shot  PDF
• 2022-06-25 Self-supervision and Learnable STRFs for Age, Emotion, and Country Prediction    Roshan Sharma, Tyler Vuong, Mark Lindsey, Hira Dhamyal, Rita Singh, Bhiksha Raj arXiv_AI arXiv_AI  Bert  Self-Supervised  Pose  Emotion  GAN  Prediction  PDF
• 2022-06-24 Predicting within and across language phoneme recognition performance of self-supervised learning speech pre-trained models    Hang Ji, Tanvina Patel, Odette Scharenborg arXiv_SD arXiv_SD  Recognition  Bert  Speech  Self-Supervised  Prediction  PDF
• 2022-06-24 Using BERT Embeddings to Model Word Importance in Conversational Transcripts for Deaf and Hard of Hearing Users    Akhter Al Amin, Saad Hassan, Cecilia O. Alm, Matt Huenerfauth arXiv_CL arXiv_CL  Embedding  Bert  Classification  Relation  Caption  Language_Model  PDF
• 2022-06-24 Text and author-level political inference using heterogeneous knowledge representations    Samuel Caetano da Silva, Ivandre Paraboni arXiv_CL arXiv_CL  Transformer  Bert  Knowledge  Inference  Language_Model  PDF
• 2022-06-24 Unified BERT for Few-shot Natural Language Understanding    JunYu Lu, Ping Yang, JiaXing Zhang, RuYi Gan, Jing Yang arXiv_CL arXiv_CL  Bert  Zero-Shot  Knowledge  Pose  Action  Classification  Few-Shot  Language_Model  PDF
• 2022-06-24 A multi-model-based deep learning framework for short text multiclass classification with the imbalanced and extremely small data set    Jiajun Tong, Zhixiao Wang, Xiaobin Rui arXiv_CL arXiv_CL  Transformer  Bert  Text_Classification  RNN  Pose  Classification  Deep_Learning  PDF
• 2022-06-23 BERT Rankers are Brittle: a Study using Adversarial Document Perturbations    Yumeng Wang, Lijun Lyu, Avishek Anand arXiv_AI arXiv_AI  Bert  Optimization  Adversarial  Pose  Emotion  Prediction  PDF
• 2022-06-23 Towards WinoQueer: Developing a Benchmark for Anti-Queer Bias in Large Language Models    Virginia K. Felkner, Ho-Chun Herbert Chang, Eugene Jang, Jonathan May arXiv_CL arXiv_CL  Bert  Pose  Detection  Language_Model  PDF
• 2022-06-22 Answer Fast: Accelerating BERT on the Tensor Streaming Processor    Ibrahim Ahmed, Sahil Parmar, Matthew Boyd, Michael Beidler, Kris Kang, Bill Liu, Kyle Roach, John Kim, Dennis Abts arXiv_CL arXiv_CL  Transformer  Recognition  Bert  Speech  Speech_Recognition  Inference  PDF
• 2022-06-22 Surgical-VQA: Visual Question Answering in Surgical Scenes using Transformer    Lalithkumar Seenivasan, Mobarakol Islam, Adithya Krishna, Hongliang Ren arXiv_AI arXiv_AI  Transformer  Recognition  Bert  Action  Classification  VQA  Medical  QA  PDF
• 2022-06-22 Efficient and effective training of language and graph neural network models    Vassilis N. Ioannidis, Xiang Song, Da Zheng, Houyu Zhang, Jun Ma, Yi Xu, Belinda Zeng, Trishul Chilimbi, George Karypis arXiv_CL arXiv_CL  Bert  Optimization  Pose  Classification  Language_Model  Prediction  PDF
• 2022-06-21 An Automatic and Efficient BERT Pruning for Edge AI Systems    Shaoyi Huang, Ning Liu, Yueying Liang, Hongwu Peng, Hongjia Li, Dongkuan Xu, Mimi Xie, Caiwen Ding arXiv_AI arXiv_AI  Transformer  OCR  Bert  Pose  Deep_Learning  Relation  Inference  PDF
• 2022-06-21 CoCoPIE XGen: A Full-Stack AI-Oriented Optimizing Framework    Xiaofeng Li, Bin Ren, Xipeng Shen, Yanzhi Wang arXiv_AI arXiv_AI  Transformer  Bert  Optimization  Autonomous  PDF
• 2022-06-21 KnowDA: All-in-One Knowledge Mixture Model for Data Augmentation in Few-Shot NLP    Yufei Wang, Jiayi Zheng, Can Xu, Xiubo Geng, Tao Shen, Chongyang Tao, Daxin Jiang arXiv_CL arXiv_CL  Bert  Knowledge  Pose  Few-Shot  Denoising  Language_Model  PDF
• 2022-06-21 TAPHSIR: Towards AnaPHoric Ambiguity Detection and ReSolution In Requirements    Saad Ezzini, Sallam Abualhaija, Chetan Arora, Mehrdad Sabetzadeh arXiv_CL arXiv_CL  Bert  Review  Pose  Detection  Language_Model  PDF
• 2022-06-21 Knowledge Graph Fusion for Language Model Fine-tuning    Nimesh Bhana, Terence L. van Zyl arXiv_CL arXiv_CL  Embedding  Bert  Knowledge  Knowledge_Graph  Language_Model  PDF
• 2022-06-21 Supervision-Guided Codebooks for Masked Prediction in Speech Pre-training    Chengyi Wang, Yiming Wang, Yu Wu, Sanyuan Chen, Jinyu Li, Shujie Liu, Furu Wei arXiv_SD arXiv_SD  Unsupervised  Recognition  Bert  Speech  Self-Supervised  Pose  Speech_Recognition  Prediction  PDF
• 2022-06-20 Variational Quantum and Quantum-Inspired Clustering    Pablo Bermejo, Roman Orus arXiv_AI arXiv_AI  Bert  Optimization  PDF
• 2022-06-20 Fewer Errors, but More Stereotypes? The Effect of Model Size on Gender Bias    Yarden Tal, Inbal Magar, Roy Schwartz arXiv_CL arXiv_CL  Bert  Language_Model  PDF
• 2022-06-20 Geo-NI: Geometry-aware Neural Interpolation for Light Field Rendering    Gaochang Wu, Yuemei Zhou, Yebin Liu, Lu Fang, Tianyou Chai arXiv_CV arXiv_CV  Reconstruction  Bert  Pose  PDF
• 2022-06-20 SPBERTQA: A Two-Stage Question Answering System Based on Sentence Transformers for Medical Texts    Nhung Thi-Hong Nguyen, Phuong Phan-Dieu Ha, Luan Thanh Nguyen, Kiet Van Nguyen, Ngan Luu-Thuy Nguyen arXiv_CL arXiv_CL  Transformer  Bert  Pose  Attention  Medical  QA  PDF
• 2022-06-20 Domain-Adaptive Text Classification with Structured Knowledge from Unlabeled Data    Tian Li, Xiang Chen, Zhen Dong, Weijiang Yu, Yijun Yan, Kurt Keutzer, Shanghang Zhang arXiv_CL arXiv_CL  Bert  Sentiment_Classification  Text_Classification  Knowledge  Knowledge_Graph  Pose  Classification  Relation  Sentiment  Language_Model  PDF
• 2022-06-18 Automatic Summarization of Russian Texts: Comparison of Extractive and Abstractive Methods    Valeriya Goloviznina, Evgeny Kotelnikov arXiv_CL arXiv_CL  Transformer  Bert  Summarization  Text_Generation  Language_Model  PDF
• 2022-06-18 Argumentative Text Generation in Economic Domain    Irina Fishcheva, Dmitriy Osadchiy, Klavdiya Bochenina, Evgeny Kotelnikov arXiv_CL arXiv_CL  Transformer  Bert  Text_Generation  Language_Model  PDF
• 2022-06-18 RuArg-2022: Argument Mining Evaluation    Evgeny Kotelnikov, Natalia Loukachevitch, Irina Nikishina, Alexander Panchenko arXiv_CL arXiv_CL  Bert  Classification  Detection  Relation  GAN  Inference  PDF
• 2022-06-18 Collocation2Text: Controllable Text Generation from Guide Phrases in Russian    Sergey Vychegzhanin, Evgeny Kotelnikov arXiv_CL arXiv_CL  Bert  Pose  Text_Generation  Language_Model  PDF
• 2022-06-18 GAN2X: Non-Lambertian Inverse Rendering of Image GANs    Xingang Pan, Ayush Tewari, Lingjie Liu, Christian Theobalt arXiv_CV arXiv_CV  Reconstruction  Unsupervised  3D  Bert  Pose  Face  GAN  PDF
• 2022-06-18 VReBERT: A Simple and Flexible Transformer for Visual Relationship Detection    Yu Cui, Moshiur Farazi arXiv_AI arXiv_AI  Transformer  Bert  Zero-Shot  Pose  Detection  Relation  Visual_Relation  Prediction  PDF
• 2022-06-17 niksss at HinglishEval: Language-agnostic BERT-based Contextual Embeddings with Catboost for Quality Evaluation of the Low-Resource Synthetically Generated Code-Mixed Hinglish Text    Nikhil Singh arXiv_CL arXiv_CL  Embedding  Bert  Text_Generation  Prediction  PDF
• 2022-06-17 BITS Pilani at HinglishEval: Quality Evaluation for Code-Mixed Hinglish Text Using Transformers    Shaz Furniturewala, Vijay Kumari, Amulya Ratna Dash, Hriday Kedia, Yashvardhan Sharma arXiv_CL arXiv_CL  Transformer  Bert  Pose  PDF
• 2022-06-17 Local Slot Attention for Vision-and-Language Navigation    Yifeng Zhuang, Qiang Sun, Yanwei Fu, Lifeng Chen, Xiangyang Sue arXiv_CV arXiv_CV  Transformer  Segmentation  Bert  Pose  Attention  PDF
• 2022-06-17 MSDF: A General Open-Domain Multi-Skill Dialog Framework    Yu Zhao, Xinshuo Hu, Yunxin Li, Baotian Hu, Dongfang Li, Sichao Chen, Xiaolong Wang arXiv_AI arXiv_AI  Bert  Knowledge  Pose  Recommendation  PDF
• 2022-06-16 Deep Multi-Task Models for Misogyny Identification and Categorization on Arabic Social Media    Abdelkader El Mahdaouy, Abdellah El Mekki, Ahmed Oumar, Hajar Mousannif, Ismail Berrada arXiv_CL arXiv_CL  Bert  Speech  Attention  Language_Model  PDF
• 2022-06-16 Prioritized Training on Points that are Learnable, Worth Learning, and Not Yet Learnt    Sören Mindermann, Jan Brauner, Muhammed Razzak, Mrinank Sharma, Andreas Kirsch, Winnie Xu, Benedikt Höltgen, Aidan N. Gomez, Adrien Morisot, Sebastian Farquhar, Yarin Gal arXiv_AI arXiv_AI  Bert  Optimization  PDF
• 2022-06-16 An Open-Domain QA System for e-Governance    Radu Ion, Andrei-Marius Avram, Vasile Păiş, Maria Mitrofan, Verginica Barbu Mititelu, Elena Irimia, Valentin Badea arXiv_CL arXiv_CL  Bert  Action  QA  PDF
• 2022-06-16 DRAFT: A Novel Framework to Reduce Domain Shifting in Self-supervised Learning and Its Application to Children's ASR    Ruchao Fan, Abeer Alwan arXiv_SD arXiv_SD  Recognition  Bert  Knowledge  Speech  Self-Supervised  Pose  Speech_Recognition  PDF
• 2022-06-15 Neural Network Normal Estimation and Bathymetry Reconstruction from Sidescan Sonar    Yiping Xie, Nils Bore, John Folkesson arXiv_AI arXiv_AI  Reconstruction  Bert  Optimization  Sparse  Represenation_Learning  Pose  Face  Survey  Deep_Learning  CNN  PDF
• 2022-06-15 Alexa Teacher Model: Pretraining and Distilling Multi-Billion-Parameter Encoders for Natural Language Understanding Systems    Jack FitzGerald, Shankar Ananthakrishnan, Konstantine Arkoudas, Davide Bernardi, Abhishek Bhagia, Claudio Delli Bovi, Jin Cao, Rakesh Chada, Amit Chauhan, Luoxin Chen, Anurag Dwarakanath, Satyam Dwivedi, Turan Gojayev, Karthik Gopalakrishnan, Thomas Gueudre, Dilek Hakkani-Tur, Wael Hamza, Jonathan Hueser, Kevin Martin Jose, Haidar Khan, Beiye Liu, Jianhua Lu, Alessandro Manzotti, Pradeep Natarajan, Karolina Owczarzak, Gokmen Oz, Enrico Palumbo, Charith Peris, Chandana Satya Prakash, Stephen Rawls, Andy Rosenbaum, Anjali Shenoy, Saleh Soltan, Mukund Harakere Sridhar, Liz Tan, Fabian Triefenbach, Pan Wei, Haiyang Yu, Shuai Zheng, Gokhan Tur, Prem Natarajan arXiv_AI arXiv_AI  Embedding  Bert  Action  Classification  Inference  PDF
• 2022-06-15 Detecting Harmful Online Conversational Content towards LGBTQIA+ Individuals    Jamell Dacon, Harry Shomer, Shaylynn Crum-Dacon, Jiliang Tang arXiv_CL arXiv_CL  Bert  Speech  Detection  Language_Model  PDF
• 2022-06-15 Estimating Confidence of Predictions of Individual Classifiers and Their Ensembles for the Genre Classification Task    Mikhail Lepekhin, Serge Sharoff arXiv_CL arXiv_CL  Transformer  Bert  Text_Classification  Classification  Prediction  PDF
• 2022-06-14 SBERT studies Meaning Representations: Decomposing Sentence Embeddings into Explainable AMR Meaning Features    Juri Opitz, Anette Frank arXiv_CL arXiv_CL  Embedding  Bert  Pose  Face  Relation  Language_Model  PDF
• 2022-06-14 RDU: A Region-based Approach to Form-style Document Understanding    Fengbin Zhu, Chao Wang, Wenqiang Lei, Ziyang Liu, Tat Seng Chua arXiv_CL arXiv_CL  Recognition  OCR  Bert  Optical_Character  Pose  Face  Action  Detection  Object_Detection  Attention  Prediction  PDF
• 2022-06-13 Transition-based Abstract Meaning Representation Parsing with Contextual Embeddings    Yichao Liang arXiv_AI arXiv_AI  Embedding  Bert  Pose  Language_Model  PDF
• 2022-06-13 Making Sense of Dependence: Efficient Black-box Explanations Using Dependence Measure    Paul Novello, Thomas Fel, David Vigouroux arXiv_CV arXiv_CV  Embedding  Bert  Pose  Action  Detection  Object_Detection  PDF
• 2022-06-11 Investigation of Ensemble features of Self-Supervised Pretrained Models for Automatic Speech Recognition    A Arunkumar, Vrunda N Sukhadia, S. Umesh arXiv_CL arXiv_CL  Embedding  Recognition  Bert  Speech  Self-Supervised  Pose  Speech_Recognition  PDF
• 2022-06-11 CodeS: A Distribution Shift Benchmark Dataset for Source Code Learning    Qiang Hu, Yuejun Guo, Xiaofei Xie, Maxime Cordy, Lei Ma, Mike Papadakis, Yves Le Traon arXiv_AI arXiv_AI  Bert  Knowledge  Pose  Classification  Deep_Learning  Detection  Object_Detection  PDF
• 2022-06-11 Comparative Snippet Generation    Saurabh Jain, Yisong Miao, Min-Yen Kan arXiv_CL arXiv_CL  Bert  Review  PDF
• 2022-06-10 Sort by Structure: Language Model Ranking as Dependency Probing    Max Müller-Eberstein, Rob van der Goot, Barbara Plank arXiv_CL arXiv_CL  Embedding  Bert  Pose  Language_Model  Prediction  PDF
• 2022-06-10 Emoji-based Fine-grained Attention Network for Sentiment Analysis in the Microblog Comments    Deng Yang, Liu Kejian, Yang Cheng, Feng Yuanyuan, Li Weihao arXiv_CL arXiv_CL  Embedding  Bert  Sentiment_Classification  RNN  Pose  Emotion  Action  Classification  Sentiment  Attention  PDF
• 2022-06-09 SsciBERT: A Pre-trained Language Model for Social Science Texts    Si Shen, Jiangfeng Liu, Litao Lin, Ying Huang, Lin Zhang, Chang Liu, Yutong Feng, Dongbo Wang arXiv_CL arXiv_CL  Recognition  Bert  Pose  Classification  Language_Model  PDF
• 2022-06-09 Joint Encoder-Decoder Self-Supervised Pre-training for ASR    Arunkumar A, Umesh S arXiv_CL arXiv_CL  Embedding  Recognition  Bert  Speech  Self-Supervised  Pose  Speech_Recognition  Language_Model  Prediction  PDF
• 2022-06-09 Analyzing Folktales of Different Regions Using Topic Modeling and Clustering    Jacob Werzinsky, Zhiyan Zhong, Xuedan Zou arXiv_CL arXiv_CL  Bert  Relation  Sentiment  PDF
• 2022-06-08 Abstraction not Memory: BERT and the English Article System    Harish Tayyar Madabushi, Dagmar Divjak, Petar Milin arXiv_CL arXiv_CL  Bert  Action  Prediction  PDF
• 2022-06-07 Always Keep your Target in Mind: Studying Semantics and Improving Performance of Neural Lexical Substitution    Nikolay Arefyev, Boris Sheludko, Alexander Podolskiy, Alexander Panchenko arXiv_CL arXiv_CL  Bert  Action  Relation  Relation_Extraction  Language_Model  PDF
• 2022-06-07 Searching for Optimal Subword Tokenization in Cross-domain NER    Ruotian Ma, Yiding Tan, Xin Zhou, Xuanting Chen, Di Liang, Sirui Wang, Wei Wu, Tao Gui, Qi Zhang arXiv_AI arXiv_AI  Unsupervised  Bert  Represenation_Learning  Pose  Classification  PDF
• 2022-06-07 OCHADAI at SemEval-2022 Task 2: Adversarial Training for Multilingual Idiomaticity Detection    Lis Kanashiro Pereira, Ichiro Kobayashi arXiv_CL arXiv_CL  Transformer  Bert  Zero-Shot  Knowledge  Adversarial  Pose  Detection  Language_Model  PDF
• 2022-06-06 Global Mixup: Eliminating Ambiguity with Clustering    Xiangjin Xie, Yangning Li, Wang Chen, Kai Ouyang, Li Jiang, Haitao Zheng arXiv_AI arXiv_AI  Bert  RNN  Pose  Relation  PDF
• 2022-06-06 What do tokens know about their characters and how do they know it?    Ayush Kaushal, Kyle Mahowald arXiv_CL arXiv_CL  Embedding  Bert  Knowledge  Speech  Relation  Language_Model  PDF
• 2022-06-06 A computational psycholinguistic evaluation of the syntactic abilities of Galician BERT models at the interface of dependency resolution and training time    Iria de-Dios-Flores, Marcos Garcia arXiv_CL arXiv_CL  Transformer  Bert  Pose  Face  Prediction  PDF
• 2022-06-06 A sentiment analysis model for car review texts based on adversarial training and whole word mask BERT    Xingchen Liu, Yawen Li, Yingxia Shao, Ang Li, Jian Liang arXiv_CL arXiv_CL  Bert  Review  Adversarial  Pose  Sentiment  PDF
• 2022-06-05 Sentiment Analysis of Online Travel Reviews Based on Capsule Network and Sentiment Lexicon    Jia Wang, Junping Du, Yingxia Shao, Ang Li arXiv_AI arXiv_AI  Bert  Sentiment_Classification  Review  Pose  Emotion  Classification  Sentiment  Language_Model  PDF
• 2022-06-05 Speech Detection Task Against Asian Hate: BERT the Central, While Data-Centric Studies the Crucial    Xin Lian arXiv_CL arXiv_CL  Bert  Speech  Detection  PDF
• 2022-06-04 Comparing Performance of Different Linguistically-Backed Word Embeddings for Cyberbullying Detection    Juuso Eronen, Michal Ptaszynski, Fumito Masui arXiv_AI arXiv_AI  Embedding  Bert  Speech  Pose  Detection  Relation  Language_Model  PDF
• 2022-06-04 ZeroQuant: Efficient and Affordable Post-Training Quantization for Large-Scale Transformers    Zhewei Yao, Reza Yazdani Aminabadi, Minjia Zhang, Xiaoxia Wu, Conglong Li, Yuxiong He arXiv_CL arXiv_CL  Transformer  Quantization  Bert  Knowledge  Attention  Inference  Language_Model  PDF
• 2022-06-04 Extreme Compression for Pre-trained Transformers Made Simple and Efficient    Xiaoxia Wu, Zhewei Yao, Minjia Zhang, Conglong Li, Yuxiong He arXiv_CL arXiv_CL  Transformer  Quantization  Bert  Knowledge  Pose  PDF
• 2022-06-03 Extracting Similar Questions From Naturally-occurring Business Conversations    Xiliang Zhu, David Rossouw, Shayna Gardiner, Simon Corston-Oliver arXiv_AI arXiv_AI  Embedding  Bert  PDF
• 2022-06-03 Findings of the The RuATD Shared Task 2022 on Artificial Text Detection in Russian    Tatiana Shamardina, Vladislav Mikhailov, Daniil Chernianskii, Alena Fenogenova, Marat Saidov, Anastasiya Valeeva, Tatiana Shavrina, Ivan Smurov, Elena Tutubalina, Ekaterina Artemova arXiv_CL arXiv_CL  Bert  Zero-Shot  Classification  Detection  GAN  Summarization  PDF
• 2022-06-03 TCE at Qur'an QA 2022: Arabic Language Question Answering Over Holy Qur'an Using a Post-Processed Ensemble of BERT-based Models    Mohammed ElKomy, Amany M. Sarhan arXiv_CL arXiv_CL  Bert  Pose  Prediction  QA  PDF
• 2022-06-02 MMTM: Multi-Tasking Multi-Decoder Transformer for Math Word Problems    Keyur Faldu, Amit Sheth, Prashant Kikani, Darshan Patel arXiv_CL arXiv_CL  Transformer  Bert  Adversarial  Relation  PDF
• 2022-06-01 A Multi-Policy Framework for Deep Learning-Based Fake News Detection    João Vitorino, Tiago Dias, Tiago Fonseca, Nuno Oliveira, Isabel Praça arXiv_CL arXiv_CL  Transformer  Bert  RNN  Pose  Deep_Learning  Detection  PDF
• 2022-06-01 Vietnamese Hate and Offensive Detection using PhoBERT-CNN and Social Media Streaming Data    Khanh Q. Tran, An T. Nguyen, Phu Gia Hoang, Canh Duc Luu, Trong-Hop Do, Kiet Van Nguyen arXiv_AI arXiv_AI  Bert  Speech  Pose  Face  Classification  Detection  PDF
• 2022-06-01 Assessing Group-level Gender Bias in Professional Evaluations: The Case of Medical Student End-of-Shift Feedback    Emmy Liu, Michael Henry Tessler, Nicole Dubosh, Katherine Mosher Hiller, Roger Levy arXiv_CL arXiv_CL  Bert  Quantitative  Medical  Recommendation  PDF
• 2022-06-01 Order-sensitive Shapley Values for Evaluating Conceptual Soundness of NLP Models    Kaiji Lu, Anupam Datta arXiv_AI arXiv_AI  Bert  Adversarial  Face  Sentiment  Language_Model  PDF
• 2022-05-31 CodeAttack: Code-based Adversarial Attacks for Pre-Trained Programming Language Models    Akshita Jha, Chandan K. Reddy arXiv_CL arXiv_CL  Bert  Adversarial  Pose  Summarization  Language_Model  PDF
• 2022-05-31 Knowledge Graph -- Deep Learning: A Case Study in Question Answering in Aviation Safety Domain    Ankush Agarwal, Raj Gite, Shreya Laddha, Pushpak Bhattacharyya, Satyanarayan Kar, Asif Ekbal, Prabhjit Thind, Rajesh Zele, Ravi Shankar arXiv_AI arXiv_AI  Bert  Knowledge  Knowledge_Graph  Pose  Face  Deep_Learning  QA  PDF
• 2022-05-31 Do self-supervised speech models develop human-like perception biases?    Juliette Millet, Ewan Dunbar arXiv_CL arXiv_CL  Bert  Speech  Self-Supervised  Prediction  PDF
• 2022-05-31 EMS: Efficient and Effective Massively Multilingual Sentence Representation Learning    Zhuoyuan Mao, Chenhui Chu, Sadao Kurohashi arXiv_CL arXiv_CL  Reconstruction  Bert  Sentiment_Classification  Zero-Shot  Represenation_Learning  Pose  Contrastive_Learning  Classification  Sentiment  PDF
• 2022-05-31 Multilingual Transformers for Product Matching -- Experiments and a New Benchmark in Polish    Michał Mo{ż}d{ż}onek, Anna Wróblewska, Sergiy Tkachuk, Szymon Łukasik arXiv_CL arXiv_CL  Transformer  Bert  Pose  Matching  PDF
• 2022-05-31 hmBERT: Historical Multilingual Language Models for Named Entity Recognition    Stefan Schweter, Luisa März, Katharina Schmid, Erion Çano arXiv_CL arXiv_CL  Recognition  OCR  Bert  Optical_Character  Pose  GAN  Language_Model  PDF
• 2022-05-31 A Unified Framework for Emotion Identification and Generation in Dialogues    Avinash Madasu, Mauajama Firdaus, Asif Eqbal arXiv_AI arXiv_AI  Bert  Pose  Emotion  Action  Classification  QA  PDF
• 2022-05-31 FinBERT-MRC: financial named entity recognition using BERT under the machine reading comprehension paradigm    Yuzhe Zhang, Hong Zhang arXiv_CL arXiv_CL  Recognition  Bert  RNN  Knowledge  Pose  Action  PDF
• 2022-05-30 A multimodal model with Twitter FinBERT embeddings for extreme price movement prediction of Bitcoin    Yanzhao Zou, Dorien Herremans arXiv_CL arXiv_CL  Embedding  Bert  Pose  CNN  Prediction  PDF
• 2022-05-30 Automatic Short Math Answer Grading via In-context Meta-learning    Mengxue Zhang, Sami Baral, Neil Heffernan, Andrew Lan arXiv_CL arXiv_CL  Bert  Pose  Language_Model  PDF
• 2022-05-30 Rites de Passage: Elucidating Displacement to Emplacement of Refugees    Aparup Khatua, Wolfgang Nejdl arXiv_CL arXiv_CL  Transformer  Recognition  Bert  RNN  Pose  Language_Model  PDF
• 2022-05-29 COVID-19 Literature Mining and Retrieval using Text Mining Approaches    Sanku Satya Uday, Satti Thanuja Pavani, T. Jaya Lakshmi, Rohit Chivukula arXiv_CL arXiv_CL  Bert  Pose  GAN  Language_Model  PDF
• 2022-05-29 L3Cube-MahaNLP: Marathi Natural Language Processing Datasets, Models, and Library    Raviraj Joshi arXiv_CL arXiv_CL  Transformer  Unsupervised  Recognition  Bert  Speech  Detection  Sentiment  Language_Model  PDF
• 2022-05-29 Urdu News Article Recommendation Model using Natural Language Processing Techniques    Syed Zain Abbas, Dr. Arif ur Rahman, Abdul Basit Mughal, Syed Mujtaba Haider arXiv_CL arXiv_CL  Bert  Pose  Language_Model  Recommendation  PDF
• 2022-05-29 Micro-Expression Recognition Based on Attribute Information Embedding and Cross-modal Contrastive Learning    Yanxin Song, Jianzong Wang, Tianbo Wu, Zhangcheng Huang, Jing Xiao arXiv_AI arXiv_AI  Embedding  Recognition  3D  Bert  Pose  Contrastive_Learning  Action  Attention  PDF
• 2022-05-28 Multimodal Fake News Detection via CLIP-Guided Learning    Yangming Zhou, Qichao Ying, Zhenxing Qian, Sheng Li, Xinpeng Zhang arXiv_CV arXiv_CV  Bert  Pose  Detection  Attention  PDF
• 2022-05-28 Is Lip Region-of-Interest Sufficient for Lipreading?    Jing-Xuan Zhang, Gen-Shun Wan, Jia Pan arXiv_CV arXiv_CV  Recognition  Bert  Speech  Self-Supervised  Pose  Emotion  Face  Speech_Recognition  PDF
• 2022-05-27 Self-supervised models of audio effectively explain human cortical responses to speech    Aditya R. Vaidya, Shailee Jain, Alexander G. Huth arXiv_CL arXiv_CL  Bert  Represenation_Learning  Speech  Self-Supervised  Language_Model  Prediction  PDF
• 2022-05-27 Multimodal Masked Autoencoders Learn Transferable Representations    Xinyang Geng, Hao Liu, Lisa Lee, Dale Schuurams, Sergey Levine, Pieter Abbeel arXiv_CV arXiv_CV  Bert  Pose  Contrastive_Learning  Prediction  PDF
• 2022-05-27 UAlberta at SemEval 2022 Task 2: Leveraging Glosses and Translations for Multilingual Idiomaticity Detection    Bradley Hauer, Seeratpal Jaura, Talgat Omarov, Grzegorz Kondrak arXiv_CL arXiv_CL  Bert  Knowledge  Detection  PDF
• 2022-05-27 Understanding Long Programming Languages with Structure-Aware Sparse Attention    Tingting Liu, Chengyu Wang, Cen Chen, Ming Gao, Aoying Zhou arXiv_AI arXiv_AI  Transformer  Bert  Sparse  Relation  Attention  Language_Model  PDF
• 2022-05-26 Experimental Design for Linear Functionals in Reproducing Kernel Hilbert Spaces    Mojmír Mutný, Andreas Krause arXiv_AI arXiv_AI  Bert  PDF
• 2022-05-26 The Document Vectors Using Cosine Similarity Revisited    Zhang Bingyu, Nikolay Arefyev arXiv_AI arXiv_AI  Transformer  Bert  Review  Pose  Sentiment  PDF
• 2022-05-26 Federated Split BERT for Heterogeneous Text Classification    Zhengyang Li, Shijing Si, Jianzong Wang, Jing Xiao arXiv_AI arXiv_AI  Quantization  Bert  Text_Classification  Pose  Classification  PDF
• 2022-05-26 Leveraging Dependency Grammar for Fine-Grained Offensive Language Detection using Graph Convolutional Networks    Divyam Goel, Raksha Sharma arXiv_CL arXiv_CL  Embedding  Bert  RNN  Pose  Deep_Learning  Detection  CNN  PDF
• 2022-05-26 Matryoshka Representations for Adaptive Deployment    Aditya Kusupati, Gantavya Bhatt, Aniket Rege, Matthew Wallingford, Aditya Sinha, Vivek Ramanujan, William Howard-Snyder, Kaifeng Chen, Sham Kakade, Prateek Jain, Ali Farhadi arXiv_CV arXiv_CV  Embedding  Bert  Represenation_Learning  Pose  Classification  Few-Shot  Inference  PDF
• 2022-05-25 BiT: Robustly Binarized Multi-distilled Transformer    Zechun Liu, Barlas Oguz, Aasish Pappu, Lin Xiao, Scott Yih, Meng Li, Raghuraman Krishnamoorthi, Yashar Mehdad arXiv_CL arXiv_CL  Transformer  Bert  Optimization  PDF
• 2022-05-25 Transcormer: Transformer for Sentence Scoring with Sliding Language Modeling    Kaitao Song, Yichong Leng, Xu Tan, Yicheng Zou, Tao Qin, Dongsheng Li arXiv_CL arXiv_CL  Transformer  Bert  Pose  Attention  Language_Model  PDF
• 2022-05-25 Train Flat, Then Compress: Sharpness-Aware Minimization Learns More Compressible Models    Clara Na, Sanket Vaibhav Mehta, Emma Strubell arXiv_AI arXiv_AI  Quantization  Bert  Optimization  Pose  Classification  PDF
• 2022-05-25 Discovering Language-neutral Sub-networks in Multilingual Language Models    Negar Foroutan, Mohammadreza Banaei, Remi Lebret, Antoine Bosselut, Karl Aberer arXiv_CL arXiv_CL  Bert  Language_Model  PDF
• 2022-05-25 Lifelong Learning Natural Language Processing Approach for Multilingual Data Classification    Jędrzej Kozal, Michał Leś, Paweł Zyblewski, Paweł Ksieniewicz, Michał Woźniak arXiv_CL arXiv_CL  Transformer  Bert  Knowledge  Pose  Classification  Deep_Learning  Detection  PDF
• 2022-05-25 ORCA: Interpreting Prompted Language Models via Locating Supporting Data Evidence in the Ocean of Pretraining Data    Xiaochuang Han, Yulia Tsvetkov arXiv_CL arXiv_CL  Bert  Zero-Shot  Knowledge  Pose  Sentiment  Language_Model  PDF
• 2022-05-25 RobustLR: Evaluating Robustness to Logical Perturbation in Deductive Reasoning    Soumya Sanyal, Zeyi Liao, Xiang Ren arXiv_CL arXiv_CL  Transformer  Bert  Pose  Language_Model  PDF
• 2022-05-25 RLPrompt: Optimizing Discrete Text Prompts With Reinforcement Learning    Mingkai Deng, Jianyu Wang, Cheng-Ping Hsieh, Yihan Wang, Han Guo, Tianmin Shu, Meng Song, Eric P. Xing, Zhiting Hu arXiv_CL arXiv_CL  Embedding  Unsupervised  Style_Transfer  Reinforcement_Learning  Bert  Optimization  Pose  Classification  Few-Shot  Language_Model  PDF
• 2022-05-25 Is a Question Decomposition Unit All We Need?    Pruthvi Patel, Swaroop Mishra, Mihir Parmar, Chitta Baral arXiv_AI arXiv_AI  Bert  Pose  Language_Model  PDF
• 2022-05-25 Text-to-Face Generation with StyleGAN2    D. M. A. Ayanthi, Sarasi Munasinghe arXiv_CV arXiv_CV  Embedding  Bert  Adversarial  Pose  Face  GAN  PDF
• 2022-05-25 Sparse*BERT: Sparse Models are Robust    Daniel Campos, Alexandre Marques, Tuan Nguyen, Mark Kurtz, ChengXiang Zhai arXiv_AI arXiv_AI  Quantization  Bert  Sparse  Medical  Inference  Language_Model  PDF
• 2022-05-25 Towards Understanding Label Regularization for Fine-tuning Pre-trained Language Models    Ivan Kobyzev, Aref Jafari, Mehdi Rezagholizadeh, Tianda Li, Alan Do-Omri, Peng Lu, Ali Ghodsi, Pascal Poupart arXiv_CL arXiv_CL  Bert  Regularization  Knowledge  Language_Model  Prediction  PDF
• 2022-05-25 VulBERTa: Simplified Source Code Pre-Training for Vulnerability Detection    Hazim Hanif, Sergio Maffeis arXiv_AI arXiv_AI  Bert  Knowledge  Deep_Learning  Detection  PDF
• 2022-05-24 Sparse Mixers: Combining MoE and Mixing to build a more efficient BERT    James Lee-Thorp, Joshua Ainslie arXiv_CL arXiv_CL  Bert  Sparse  Inference  PDF
• 2022-05-24 K-12BERT: BERT for K-12 education    Vasu Goel, Dhruv Sahnan, Venktesh V, Gaurav Sharma, Deep Dwivedi, Mukesh Mohania arXiv_CL arXiv_CL  Bert  Knowledge  Pose  Language_Model  PDF
• 2022-05-24 Garden-Path Traversal within GPT-2    William Jurayj, William Rudman, Carsten Eickhoff arXiv_CL arXiv_CL  Transformer  Bert  Language_Model  PDF
• 2022-05-24 GeoMLAMA: Geo-Diverse Commonsense Probing on Multilingual Pre-Trained Language Models    Da Yin, Hritik Bansal, Masoud Monajatipoor, Liunian Harold Li, Kai-Wei Chang arXiv_CL arXiv_CL  Bert  Knowledge  Relation  Language_Model  PDF
• 2022-05-24 Partial-input baselines show that NLI models can ignore context, but they don't    Neha Srikanth, Rachel Rudinger arXiv_CL arXiv_CL  Bert  Relation  Inference  PDF
• 2022-05-24 RetroMAE: Pre-training Retrieval-oriented Transformers via Masked Auto-Encoder    Zheng Liu, Yingxia Shao arXiv_CL arXiv_CL  Transformer  Reconstruction  Embedding  Bert  Pose  PDF
• 2022-05-24 Word-order typology in Multilingual BERT: A case study in subordinate-clause detection    Dmitry Nikolaev, Sebastian Padó arXiv_CL arXiv_CL  Bert  Zero-Shot  Action  Detection  PDF
• 2022-05-24 Formulating Few-shot Fine-tuning Towards Language Model Pre-training: A Pilot Study on Named Entity Recognition    Zihan Wang, Kewen Zhao, Zilong Wang, Jingbo Shang arXiv_AI arXiv_AI  Recognition  Bert  Pose  Few-Shot  Language_Model  Prediction  PDF
• 2022-05-24 On the Role of Bidirectionality in Language Model Pre-Training    Mikel Artetxe, Jingfei Du, Naman Goyal, Luke Zettlemoyer, Ves Stoyanov arXiv_AI arXiv_AI  Bert  Zero-Shot  Pose  Attention  Language_Model  Prediction  PDF
• 2022-05-23 FlexiBERT: Are Current Transformer Architectures too Homogeneous and Rigid?    Shikhar Tuli, Bhishma Dedhia, Shreshth Tuli, Niraj K. Jha arXiv_CL arXiv_CL  Transformer  NAS  Embedding  Bert  Optimization  Pose  Language_Model  PDF
• 2022-05-23 Simple Recurrence Improves Masked Language Models    Tao Lei, Ran Tian, Jasmijn Bastings, Ankur P. Parikh arXiv_AI arXiv_AI  Transformer  Bert  Optimization  Language_Model  PDF
• 2022-05-23 Learning to Ignore Adversarial Attacks    Yiming Zhang, Yangqiaoyu Zhou, Samuel Carton, Chenhao Tan arXiv_AI arXiv_AI  Bert  Adversarial  PDF
• 2022-05-23 On the Paradox of Learning to Reason from Data    Honghua Zhang, Liunian Harold Li, Tao Meng, Kai-Wei Chang, Guy Van den Broeck arXiv_AI arXiv_AI  Bert  PDF
• 2022-05-23 Multilingual Extraction and Categorization of Lexical Collocations with Graph-aware Transformers    Luis Espinosa-Anke, Alexander Shvets, Alireza Mohammadshahi, James Henderson, Leo Wanner arXiv_CL arXiv_CL  Transformer  Recognition  Bert  Action  PDF
• 2022-05-23 Outliers Dimensions that Disrupt Transformers Are Driven by Frequency    Giovanni Puccetti, Anna Rogers, Aleksandr Drozd, Felice Dell'Orletta arXiv_AI arXiv_AI  Transformer  Embedding  Bert  Relation  Attention  Language_Model  PDF
• 2022-05-23 ScholarBERT: Bigger is Not Always Better    Zhi Hong, Aswathy Ajith, Gregory Pauloski, Eamon Duede, Carl Malamud, Roger Magoulas, Kyle Chard, Ian Foster arXiv_CL arXiv_CL  Transformer  Bert  Language_Model  PDF
• 2022-05-23 Sample Efficient Approaches for Idiomaticity Detection    Dylan Phelps, Xuan-Rui Fan, Edward Gow-Smith, Harish Tayyar Madabushi, Carolina Scarton, Aline Villavicencio arXiv_CL arXiv_CL  Transformer  Embedding  Bert  Classification  Detection  Few-Shot  Language_Model  PDF
• 2022-05-23 Prompt Tuning for Discriminative Pre-trained Language Models    Yuan Yao, Bowen Dong, Ao Zhang, Zhengyan Zhang, Ruobing Xie, Zhiyuan Liu, Leyu Lin, Maosong Sun, Jianyong Wang arXiv_AI arXiv_AI  Bert  Text_Classification  Knowledge  Classification  Language_Model  PDF
• 2022-05-23 RuNNE-2022 Shared Task: Recognizing Nested Named Entities    Ekaterina Artemova, Maxim Zmeev, Natalia Loukachevitch, Igor Rozhkov, Tatiana Batura, Vladimir Ivanov, Elena Tutubalina arXiv_CL arXiv_CL  Recognition  Bert  Few-Shot  GAN  PDF
• 2022-05-23 DistilCamemBERT: a distillation of the French model CamemBERT    Cyrile Delestre, Abibatou Amar arXiv_CL arXiv_CL  Transformer  Bert  PDF
• 2022-05-23 TempLM: Distilling Language Models into Template-Based Generators    Tianyi Zhang, Mina Lee, Lisa Li, Ende Shen, Tatsunori B. Hashimoto arXiv_CL arXiv_CL  Bert  Pose  Text_Generation  Language_Model  PDF
• 2022-05-23 Artificial intelligence for topic modelling in Hindu philosophy: mapping themes between the Upanishads and the Bhagavad Gita    Rohitash Chandra, Mukul Ranjan arXiv_CL arXiv_CL  Embedding  Bert  Deep_Learning  Language_Model  PDF
• 2022-05-23 Parameter-Efficient Sparsity for Large Language Models Fine-Tuning    Yuchao Li, Fuli Luo, Chuanqi Tan, Mengdi Wang, Songfang Huang, Shen Li, Junjie Bai arXiv_AI arXiv_AI  Bert  Sparse  Pose  Language_Model  PDF
• 2022-05-22 A Graph Enhanced BERT Model for Event Prediction    Li Du, Xiao Ding, Yue Zhang, Kai Xiong, Ting Liu, Bing Qin arXiv_AI arXiv_AI  Bert  Pose  Relation  Prediction  PDF
• 2022-05-22 A Domain-adaptive Pre-training Approach for Language Bias Detection in News    Jan-David Krieger, Timo Spinde, Terry Ruas, Juhi Kulshrestha, Bela Gipp arXiv_CL arXiv_CL  Transformer  Bert  Pose  Face  Detection  PDF
• 2022-05-22 Do Deep Learning Models and News Headlines Outperform Conventional Prediction Techniques on Forex Data?    Sucharita Atha, Bharath Kumar Bolla arXiv_AI arXiv_AI  Embedding  Bert  RNN  Deep_Learning  Sentiment  Language_Model  Prediction  PDF
• 2022-05-21 Life after BERT: What do Other Muppets Understand about Language?    Vladislav Lialin, Kevin Zhao, Namrata Shivagunde, Anna Rumshisky arXiv_CL arXiv_CL  Transformer  Bert  Zero-Shot  PDF
• 2022-05-21 Revisiting Pre-trained Language Models and their Evaluation for Arabic Natural Language Understanding    Abbas Ghaddar, Yimeng Wu, Sunyam Bagga, Ahmad Rashid, Khalil Bibi, Mehdi Rezagholizadeh, Chao Xing, Yasheng Wang, Duan Xinyu, Zhefeng Wang, Baoxing Huai, Xin Jiang, Qun Liu, Philippe Langlais arXiv_CL arXiv_CL  Bert  Language_Model  PDF
• 2022-05-21 HLATR: Enhance Multi-stage Text Retrieval with Hybrid List Aware Transformer Reranking    Yanzhao Zhang, Dingkun Long, Guangwei Xu, Pengjun Xie arXiv_CL arXiv_CL  Transformer  Bert  Optimization  Language_Model  PDF
• 2022-05-21 Pre-training Data Quality and Quantity for a Low-Resource Language: New Corpus and BERT Models for Maltese    Kurt Micallef, Albert Gatt, Marc Tanti, Lonneke van der Plas, Claudia Borg arXiv_CL arXiv_CL  Recognition  Bert  Speech  Action  Classification  Sentiment  Language_Model  PDF
• 2022-05-21 Deeper vs Wider: A Revisit of Transformer Configuration    Fuzhao Xue, Jianghai Chen, Aixin Sun, Xiaozhe Ren, Zangwei Zheng, Xiaoxin He, Xin Jiang, Yang You arXiv_AI arXiv_AI  Transformer  Bert  Pose  PDF
• 2022-05-20 Pre-training Transformer Models with Sentence-Level Objectives for Answer Sentence Selection    Luca Di Liello, Siddhant Garg, Luca Soldaini, Alessandro Moschitti arXiv_CL arXiv_CL  Transformer  Bert  Pose  QA  PDF
• 2022-05-20 Current Trends and Approaches in Synonyms Extraction: Potential Adaptation to Arabic    Eman Naser-Karajah, Nabil Arman, Mustafa Jarrar arXiv_AI arXiv_AI  Embedding  Bert  Survey  Action  Deep_Learning  Attention  PDF
• 2022-05-20 Progressive Class Semantic Matching for Semi-supervised Text Classification    Hai-Ming Xu, Lingqiao Liu, Ehsan Abbasnejad arXiv_AI arXiv_AI  Bert  Text_Classification  Pose  Classification  Language_Model  Matching  PDF
• 2022-05-20 Exploring Extreme Parameter Compression for Pre-trained Language Models    Yuxin Ren, Benyou Wang, Lifeng Shang, Xin Jiang, Qun Liu arXiv_CL arXiv_CL  Transformer  Reconstruction  Embedding  Bert  Knowledge  Pose  Attention  Inference  Language_Model  PDF
• 2022-05-19 Automated Scoring for Reading Comprehension via In-context BERT Tuning    Nigel Fernandez, Aritra Ghosh, Naiming Liu, Zichao Wang, Benoît Choffin, Richard Baraniuk, Andrew Lan arXiv_AI arXiv_AI  Bert  Language_Model  PDF
• 2022-05-19 Enhancing Slot Tagging with Intent Features for Task Oriented Natural Language Understanding using BERT    Shruthi Hariharan, Vignesh Kumar Krishnamurthy, Utkarsh, Jayantha Gowda Sarapanahalli arXiv_AI arXiv_AI  Bert  Detection  Relation  PDF
• 2022-05-19 PLAID: An Efficient Engine for Late Interaction Retrieval    Keshav Santhanam, Omar Khattab, Christopher Potts, Matei Zaharia arXiv_CL arXiv_CL  Bert  Action  Language_Model  PDF
• 2022-05-19 ArabGlossBERT: Fine-Tuning BERT on Context-Gloss Pairs for WSD    Moustafa Al-Hajj, Mustafa Jarrar arXiv_AI arXiv_AI  Transformer  Bert  Ontology  Classification  PDF
• 2022-05-19 Collision Detection Accelerated: An Optimization Perspective    Louis Montaut, Quentin Le Lidec, Josef Sivic, Justin Carpentier arXiv_RO arXiv_RO  Bert  Optimization  Pose  Detection  PDF
• 2022-05-19 Named Entity Recognition, Multi-Task Learning, Nested Entities, BERT, Arabic NER Corpus    Mustafa Jarrar, Mohammed Khalilia, Sana Ghanem arXiv_AI arXiv_AI  Recognition  Bert  GAN  PDF
• 2022-05-19 Acceptability Judgements via Examining the Topology of Attention Maps    Daniil Cherniavskii, Eduard Tulchinskii, Vladislav Mikhailov, Irina Proskurina, Laida Kushnareva, Ekaterina Artemova, Serguei Barannikov, Irina Piontkovskaya, Dmitri Piontkovski, Evgeny Burnaev arXiv_CL arXiv_CL  Transformer  Bert  Knowledge  Attention  PDF
• 2022-05-19 Psychiatric Scale Guided Risky Post Screening for Early Detection of Depression    Zhiling Zhang, Siyuan Chen, Mengyue Wu, Kenny Q. Zhu arXiv_CL arXiv_CL  Bert  Pose  Face  Detection  Attention  Inference  Prediction  PDF
• 2022-05-19 A Weakly-Supervised Iterative Graph-Based Approach to Retrieve COVID-19 Misinformation Topics    Harry Wang, Sharath Chandra Guntuku arXiv_CL arXiv_CL  Embedding  Bert  Pose  Action  Quantitative  PDF
• 2022-05-18 Debiasing Neural Retrieval via In-batch Balancing Regularization    Yuantong Li, Xiaokai Wei, Zijian Wang, Shen Wang, Parminder Bhatia, Xiaofei Ma, Andrew Arnold arXiv_AI arXiv_AI  Bert  Regularization  Pose  PDF
• 2022-05-18 LeRaC: Learning Rate Curriculum    Florinel-Alin Croitoru, Nicolae-Catalin Ristea, Radu Tudor Ionescu, Nicu Sebe arXiv_CV arXiv_CV  Transformer  Bert  RNN  Pose  CNN  PDF
• 2022-05-18 ERNIE-Search: Bridging Cross-Encoder with Dual-Encoder via Self On-the-fly Distillation for Dense Passage Retrieval    Yuxiang Lu, Yiding Liu, Jiaxiang Liu, Yunsheng Shi, Zhengjie Huang, Shikun Feng Yu Sun, Hao Tian, Hua Wu, Shuaiqiang Wang, Dawei Yin, Haifeng Wang arXiv_CL arXiv_CL  Bert  Knowledge  Pose  Action  Language_Model  QA  PDF
• 2022-05-18 Masked Autoencoders As Spatiotemporal Learners    Christoph Feichtenhofer, Haoqi Fan, Yanghao Li, Kaiming He arXiv_CV arXiv_CV  Transformer  Embedding  Bert  Represenation_Learning  Knowledge  PDF
• 2022-05-17 ViralBERT: A User Focused BERT-Based Approach to Virality Prediction    Rikaz Rameez, Hossein A. Rahmani, Emine Yilmaz arXiv_CL arXiv_CL  Bert  Pose  Emotion  Sentiment  Prediction  PDF
• 2022-05-17 Feature Aggregation in Zero-Shot Cross-Lingual Transfer Using Multilingual BERT    Beiduo Chen, Wu Guo, Quan Liu, Kun Tao arXiv_CL arXiv_CL  Transformer  Recognition  Bert  Zero-Shot  Pose  Attention  Language_Model  PDF
• 2022-05-17 SAMU-XLSR: Semantically-Aligned Multimodal Utterance-level Cross-Lingual Speech Representation    Sameer Khurana, Antoine Laurent, James Glass arXiv_CL arXiv_CL  Embedding  Bert  Represenation_Learning  Speech  Pose  PDF
• 2022-05-17 SEMI-FND: Stacked Ensemble Based Multimodal Inference For Faster Fake News Detection    Prabhav Singh, Ridam Srivastava, K.P.S. Rana, Vineet Kumar arXiv_AI arXiv_AI  NAS  Bert  Detection  Inference  PDF
• 2022-05-16 Harnessing Multilingual Resources to Question Answering in Arabic    Khalid Alnajjar, Mika Hämäläinen arXiv_CL arXiv_CL  Bert  PDF
• 2022-05-15 Transkimmer: Transformer Learns to Layer-wise Skim    Yue Guan, Zhengyi Li, Jingwen Leng, Zhouhan Lin, Minyi Guo arXiv_CL arXiv_CL  Transformer  Bert  Optimization  Pose  PDF
• 2022-05-15 TiBERT: Tibetan Pre-trained Language Model    Yuan Sun, Sisi Liu, Junjie Deng, Xiaobing Zhao arXiv_AI arXiv_AI  Bert  Text_Classification  Classification  Language_Model  PDF
• 2022-05-15 Topic Modelling on Consumer Financial Protection Bureau Data: An Approach Using BERT Based Embeddings    Vasudeva Raju Sangaraju, Bharath Kumar Bolla, Deepak Kumar Nayak, Jyothsna Kh arXiv_AI arXiv_AI  Embedding  Bert  Review  Relation  Sentiment  PDF
• 2022-05-15 Discovering Latent Concepts Learned in BERT    Fahim Dalvi, Abdul Rafae Khan, Firoj Alam, Nadir Durrani, Jia Xu, Hassan Sajjad arXiv_CL arXiv_CL  Unsupervised  Bert  Knowledge  Relation  PDF
• 2022-05-15 Learning Lip-Based Audio-Visual Speaker Embeddings with AV-HuBERT    Bowen Shi, Abdelrahman Mohamed, Wei-Ning Hsu arXiv_CV arXiv_CV  Embedding  Bert  Represenation_Learning  Speech  Self-Supervised  Pose  PDF
• 2022-05-14 Naturalistic Causal Probing for Morpho-Syntax    Afra Amini, Tiago Pimentel, Clara Meister, Ryan Cotterell arXiv_CL arXiv_CL  Bert  Prediction  PDF
• 2022-05-13 Bootstrapping Text Anonymization Models with Distant Supervision    Anthi Papadopoulou, Pierre Lison, Lilja Øvrelid, Ildikó Pilán arXiv_CL arXiv_CL  Bert  Knowledge  Knowledge_Graph  Pose  Language_Model  PDF
• 2022-05-13 PathologyBERT -- Pre-trained Vs. A New Transformer Language Model for Pathology Domain    Thiago Santos, Amara Tariq, Susmita Das, Kavyasree Vayalpati, Geoffrey H. Smith, Hari Trivedi, Imon Banerjee arXiv_CL arXiv_CL  Transformer  Surveillance  Bert  Pose  Face  Classification  Language_Model  PDF
• 2022-05-13 A Study of the Attention Abnormality in Trojaned BERTs    Weimin Lyu, Songzhu Zheng, Tengfei Ma, Chao Chen arXiv_AI arXiv_AI  Transformer  Bert  Knowledge  Pose  Quantitative  Detection  Object_Detection  Attention  PDF
• 2022-05-13 Analyzing Hate Speech Data along Racial, Gender and Intersectional Axes    Antonis Maronikolakis, Philip Baader, Hinrich Schütze arXiv_AI arXiv_AI  Bert  Speech  PDF
• 2022-05-13 Improving Contextual Representation with Gloss Regularized Pre-training    Yu Lin, Zhecheng An, Peihao Wu, Zejun Ma arXiv_AI arXiv_AI  Embedding  Unsupervised  Bert  Pose  Inference  Language_Model  PDF
• 2022-05-12 Beyond Static Models and Test Sets: Benchmarking the Potential of Pre-trained Models Across Tasks and Languages    Kabir Ahuja, Sandipan Dandapat, Sunayana Sitaram, Monojit Choudhury arXiv_CL arXiv_CL  Bert  Pose  Language_Model  Prediction  PDF
• 2022-05-12 ScAN: Suicide Attempt and Ideation Events Dataset    Bhanu Pratap Singh Rawat, Samuel Kovaly, Wilfred R. Pigeon, Hong Yu arXiv_AI arXiv_AI  Surveillance  Bert  Classification  Detection  Medical  Prediction  PDF
• 2022-05-12 Is the Computation of Abstract Sameness Relations Human-Like in Neural Language Models?    Lukas Thoma, Benjamin Roth arXiv_CL arXiv_CL  Bert  Face  Relation  Language_Model  PDF
• 2022-05-12 FPSRS: A Fusion Approach for Paper Submission Recommendation System    Son T. Huynh, Nhi Dang, Dac H. Nguyen, Phong T. Huynh, Binh T. Nguyen arXiv_CV arXiv_CV  Bert  RNN  Pose  Action  Recommendation  PDF
• 2022-05-12 AppTek's Submission to the IWSLT 2022 Isometric Spoken Language Translation Task    Patrick Wilken, Evgeny Matusov arXiv_CL arXiv_CL  Transformer  Bert  PDF
• 2022-05-11 Dimension-adaptive machine-learning-based quantum state reconstruction    Sanjaya Lohani, Sangita Regmi, Joseph M. Lukens, Ryan T. Glasser, Thomas A. Searles, Brian T. Kirby arXiv_AI arXiv_AI  Reconstruction  Bert  Matching  PDF
• 2022-05-11 Ontology-Based and Weakly Supervised Rare Disease Phenotyping from Clinical Notes    Hang Dong, Víctor Suárez-Paniagua, Huayu Zhang, Minhong Wang, Arlene Casey, Emma Davidson, Jiaoyan Chen, Beatrice Alex, William Whiteley, Honghan Wu arXiv_CL arXiv_CL  Transformer  Recognition  Bert  Weakly_Supervised  Pose  Ontology  Face  Medical  Matching  PDF
• 2022-05-11 Aggregating Pairwise Semantic Differences for Few-Shot Claim Veracity Classification    Xia Zeng, Arkaitz Zubiaga arXiv_AI arXiv_AI  Bert  Classification  Few-Shot  Language_Model  PDF
• 2022-05-11 Query-Based Keyphrase Extraction from Long Documents    Martin Docekal, Pavel Smrz arXiv_CL arXiv_CL  Transformer  Bert  Action  PDF
• 2022-05-11 Towards Unified Prompt Tuning for Few-shot Text Classification    Jianing Wang, Chengyu Wang, Fuli Luo, Chuanqi Tan, Minghui Qiu, Fei Yang, Qiuhui Shi, Songfang Huang, Ming Gao arXiv_AI arXiv_AI  Bert  Text_Classification  Knowledge  Self-Supervised  Pose  Classification  Few-Shot  Language_Model  PDF
• 2022-05-10 Problems with Cosine as a Measure of Embedding Similarity for High Frequency Words    Kaitlyn Zhou, Kawin Ethayarajh, Dallas Card, Dan Jurafsky arXiv_AI arXiv_AI  Embedding  Bert  QA  PDF
• 2022-05-10 Fundamental limitations on optimization in variational quantum algorithms    Hao-Kai Zhang, Chengkai Zhu, Geng Liu, Xin Wang arXiv_CV arXiv_CV  Bert  Optimization  VQA  QA  PDF
• 2022-05-09 Behind the Mask: Demographic bias in name detection for PII masking    Courtney Mansfield, Amandalynne Paullada, Kristen Howell arXiv_CL arXiv_CL  Bert  Pose  Action  Detection  PDF
• 2022-05-09 Long Document Re-ranking with Modular Re-ranker    Luyu Gao, Jamie Callan arXiv_CL arXiv_CL  Transformer  Bert  Pose  Action  Attention  Language_Model  PDF
• 2022-05-09 A Dataset and BERT-based Models for Targeted Sentiment Analysis on Turkish Texts    M. Melih Mutlu, Arzucan Özgür arXiv_CL arXiv_CL  Bert  Pose  Sentiment  Attention  PDF
• 2022-05-09 A Balanced Data Approach for Evaluating Cross-Lingual Transfer: Mapping the Linguistic Blood Bank    Dan Malkin, Tomasz Limisiewicz, Gabriel Stanovsky arXiv_AI arXiv_AI  Bert  Zero-Shot  Relation  Language_Model  PDF
• 2022-05-09 Automated Evaluation for Student Argumentative Writing: A Survey    Xinyu Wang, Yohan Lee, Juneyoung Park arXiv_CL arXiv_CL  Bert  Survey  GAN  PDF
• 2022-05-09 Improving negation detection with negation-focused pre-training    Thinh Hung Truong, Timothy Baldwin, Trevor Cohn, Karin Verspoor arXiv_CL arXiv_CL  Bert  Pose  Detection  Language_Model  PDF
• 2022-05-08 On the Use of BERT for Automated Essay Scoring: Joint Learning of Multi-Scale Essay Representation    Yongjie Wang, Chuan Wang, Ruobing Li, Hui Lin arXiv_AI arXiv_AI  Transfer_Learning  Bert  RNN  Pose  Deep_Learning  PDF
• 2022-05-08 Silence is Sweeter Than Speech: Self-Supervised Model Using Silence to Store Speaker Information    Chi-Luen Feng, Po-chun Hsu, Hung-yi Lee arXiv_SD arXiv_SD  Bert  Speech  Self-Supervised  PDF
• 2022-05-07 AKI-BERT: a Pre-trained Clinical Language Model for Early Prediction of Acute Kidney Injury    Chengsheng Mao, Liang Yao, Yuan Luo arXiv_CL arXiv_CL  Transformer  Bert  Action  Medical  Language_Model  Prediction  PDF
• 2022-05-07 Number Entity Recognition    Dhanasekar Sundararaman, Vivek Subramanian, Guoyin Wang, Liyan Xu, Lawrence Carin arXiv_CL arXiv_CL  Embedding  Recognition  Bert  Pose  Classification  PDF
• 2022-05-06 A Data Cartography based MixUp for Pre-trained Language Models    Seo Yeon Park, Cornelia Caragea arXiv_CL arXiv_CL  Bert  Pose  Language_Model  PDF
• 2022-05-06 BDIS: Bayesian Dense Inverse Searching Method for Real-Time Stereo Surgical Image Matching    Jingwei Song, Qiuchen Zhu, Jianyu Lin, Maani Ghaffari arXiv_CV arXiv_CV  3D  Bert  Pose  Face  Prediction  Matching  PDF
• 2022-05-05 RaFoLa: A Rationale-Annotated Corpus for Detecting Indicators of Forced Labour    Erick Mendez Guzman, Viktor Schlegel, Riza Batista-Navarro arXiv_CL arXiv_CL  Transformer  Bert  Text_Classification  Knowledge  Pose  Action  Classification  Detection  Attention  GAN  PDF
• 2022-05-05 Exploiting Global and Local Hierarchies for Hierarchical Text Classification    Ting Jiang, Deqing Wang, Leilei Sun, Zhongzhi Chen, Fuzhen Zhuang, Qinghong Yang arXiv_CL arXiv_CL  Bert  Text_Classification  Knowledge  Pose  Classification  PDF
• 2022-05-05 View-labels Are Indispensable: A Multifacet Complementarity Study of Multi-view Clustering    Chuanxing Geng, Aiyang Han, Songcan Chen arXiv_CV arXiv_CV  Embedding  Bert  Knowledge  Contrastive_Learning  Face  Attention  PDF
• 2022-05-05 Understanding Transfer Learning for Chest Radiograph Clinical Report Generation with Modified Transformer Architectures    Edward Vendrow, Ethan Schonfeld arXiv_AI arXiv_AI  Image_Caption  Transformer  Embedding  Transfer_Learning  Bert  Pose  Medical  Caption  PDF
• 2022-05-04 Using virtual edges to extract keywords from texts modeled as complex networks    Jorge A. V. Tohalino, Thiago C. Silva, Diego R. Amancio arXiv_CL arXiv_CL  Embedding  Bert  Action  Language_Model  PDF
• 2022-05-04 Hyperbolic Relevance Matching for Neural Keyphrase Extraction    Mingyang Song, Yi Feng, Liping Jing arXiv_CL arXiv_CL  Embedding  Bert  Action  Matching  PDF
• 2022-05-04 Unsupervised Domain Adaptation Learning for Hierarchical Infant Pose Recognition with Synthetic Data    Cheng-Yen Yang, Zhongyu Jiang, Shih-Yu Gu, Jenq-Neng Hwang, Jang-Hee Yoo arXiv_CV arXiv_CV  Unsupervised  Recognition  3D  Bert  Optimization  Pose  Inference  PDF
• 2022-05-03 Explain and Conquer: Personalised Text-based Reviews to Achieve Transparency    Iñigo López-Riobóo Botana (1), Verónica Bolón-Canedo (1), Bertha Guijarro-Berdiñas (1), Amparo Alonso-Betanzos (1) ((1) University of A Coruña - Research Center on Information and Communication Technologies (CITIC)) arXiv_AI arXiv_AI  Transformer  Bert  Review  Pose  Action  Relation  Language_Model  Recommendation  PDF
• 2022-05-03 Efficient Fine-Tuning of BERT Models on the Edge    Danilo Vucetic, Mohammadreza Tayaranian, Maryam Ziaeefard, James J. Clark, Brett H. Meyer, Warren J. Gross arXiv_CL arXiv_CL  Bert  Pose  Inference  PDF
• 2022-05-03 Evaluating Deep Taylor Decomposition for Reliability Assessment in the Wild    Stephanie Brandl, Daniel Hershcovich, Anders Søgaard arXiv_CL arXiv_CL  Bert  PDF
• 2022-05-03 Kompetencer: Fine-grained Skill Classification in Danish Job Postings via Distant Supervision and Transfer Learning    Mike Zhang, Kristian Nørgaard Jensen, Barbara Plank arXiv_CL arXiv_CL  Transfer_Learning  Bert  Zero-Shot  Classification  Few-Shot  PDF
• 2022-05-03 Finding patterns in Knowledge Attribution for Transformers    Jeevesh Juneja, Ritu Agarwal arXiv_CL arXiv_CL  Transformer  Bert  Knowledge  Relation  PDF
• 2022-05-03 Predicting Issue Types with seBERT    Alexander Trautsch, Steffen Herbold arXiv_CL arXiv_CL  Transformer  Bert  Language_Model  Prediction  PDF
• 2022-05-03 SemAttack: Natural Textual Attacks via Different Semantic Spaces    Boxin Wang, Chejian Xu, Xiangyu Liu, Yu Cheng, Bo Li arXiv_CL arXiv_CL  Embedding  Bert  Knowledge  Adversarial  Pose  Language_Model  PDF
• 2022-05-02 Multi-Task Text Classification using Graph Convolutional Networks for Large-Scale Low Resource Language    Mounika Marreddy, Subba Reddy Oota, Lakshmi Sireesha Vakada, Venkata Charan Chinni, Radhika Mamidi arXiv_AI arXiv_AI  Transformer  Reconstruction  Embedding  Bert  Text_Classification  Speech  Pose  Emotion  Quantitative  Classification  Detection  Sentiment  CNN  PDF
• 2022-05-02 Entity-aware Transformers for Entity Search    Emma J. Gerritse, Faegheh Hasibi, Arjen P. de Vries arXiv_CL arXiv_CL  Transformer  Embedding  Bert  Knowledge  Knowledge_Graph  Relation  Language_Model  PDF
• 2022-05-02 Improving Students' Academic Performance with AI and Semantic Technologies    Yixin Cheng arXiv_AI arXiv_AI  Bert  RNN  Review  Prediction  PDF
• 2022-05-02 Teaching BERT to Wait: Balancing Accuracy and Latency for Streaming Disfluency Detection    Angelica Chen, Vicky Zayats, Daniel D. Walker, Dirk Padfield arXiv_CL arXiv_CL  Transformer  Bert  Speech  Pose  Detection  Prediction  PDF
• 2022-05-01 Medical Coding with Biomedical Transformer Ensembles and Zero/Few-shot Learning    Angelo Ziletti, Alan Akbik, Christoph Berns, Thomas Herold, Marion Legler, Martina Viell arXiv_CL arXiv_CL  Transformer  Bert  Classification  Few-Shot  Medical  Matching  PDF
• 2022-05-01 Detecting COVID-19 Conspiracy Theories with Transformers and TF-IDF    Haoming Guo, Tianyi Huang, Huixuan Huang, Mingyue Fan, Gerald Friedland arXiv_CL arXiv_CL  Transformer  Bert  Detection  PDF
• 2022-04-30 LayoutBERT: Masked Language Layout Model for Object Insertion    Kerem Turgutlu, Sanat Sharma, Jayant Kumar arXiv_AI arXiv_AI  Bert  Knowledge  Self-Supervised  Pose  Quantitative  Attention  Language_Model  PDF
• 2022-04-30 HateCheckHIn: Evaluating Hindi Hate Speech Detection Models    Mithun Das, Punyajoy Saha, Binny Mathew, Animesh Mukherjee arXiv_CL arXiv_CL  Transformer  Bert  Speech  Pose  Detection  PDF
• 2022-04-30 Solution of DeBERTaV3 on CommonsenseQA    Letian Peng, Zuchao Li, Hai Zhao arXiv_CL arXiv_CL  Bert  Text_Classification  Classification  Inference  QA  PDF
• 2022-04-29 ExaASC: A General Target-Based Stance Detection Corpus in Arabic Language    Mohammad Mehdi Jaziriyan, Ahmad Akbari, Hamed Karbasi arXiv_CL arXiv_CL  Bert  Pose  Detection  PDF
• 2022-04-29 QRelScore: Better Evaluating Generated Questions with Deeper Understanding of Context-aware Relevance    Xiaoqiang Wang, Bang Liu, Siliang Tang, Lingfei Wu arXiv_CL arXiv_CL  Bert  Adversarial  Pose  Relation  Language_Model  Matching  PDF
• 2022-04-29 Czech Dataset for Cross-lingual Subjectivity Classification    Pavel Přibáň, Josef Steinberger arXiv_CL arXiv_CL  Bert  Zero-Shot  Knowledge  Review  Pose  Classification  PDF
• 2022-04-28 Machine Learning for Violence Risk Assessment Using Dutch Clinical Notes    Pablo Mosteiro, Emil Rijcken, Kalliopi Zervanou, Uzay Kaymak, Floortje Scheepers, Marco Spruit arXiv_CL arXiv_CL  Bert  PDF
• 2022-04-28 UM6P-CS at SemEval-2022 Task 11: Enhancing Multilingual and Code-Mixed Complex Named Entity Recognition via Pseudo Labels using Multilingual Transformer    Abdellah El Mekki, Abdelkader El Mahdaouy, Mohammed Akallouch, Ismail Berrada, Ahmed Khoumsi arXiv_CL arXiv_CL  Transformer  Recognition  Bert  Pose  Classification  PDF
• 2022-04-28 RobBERTje: a Distilled Dutch BERT Model    Pieter Delobelle, Thomas Winters, Bettina Berendt arXiv_CL arXiv_CL  Bert  Attention  Language_Model  PDF
• 2022-04-28 A Survey on Sentence Embedding Models Performance for Patent Analysis    Hamid Bekamiri, Daniel S. Hain, Roman Jurowetzki arXiv_CL arXiv_CL  Embedding  Bert  Knowledge  Survey  Classification  PDF
• 2022-04-27 TimeBERT: Enhancing Pre-Trained Language Representations with Temporal Information    Jiexin Wang, Adam Jatowt, Masatoshi Yoshikawa arXiv_CL arXiv_CL  Bert  PDF
• 2022-04-27 RigoBERTa: A State-of-the-Art Language Model For Spanish    Alejandro Vaca Serrano, Guillem Garcia Subies, Helena Montoro Zamorano, Nuria Aldama Garcia, Doaa Samy, David Betancur Sanchez, Antonio Moreno Sandoval, Marta Guerrero Nieto, Alvaro Barbero Jimenez arXiv_CL arXiv_CL  Bert  Language_Model  PDF
• 2022-04-27 SkillSpan: Hard and Soft Skill Extraction from English Job Postings    Mike Zhang, Kristian Nørgaard Jensen, Sif Dam Sonniks, Barbara Plank arXiv_CL arXiv_CL  Bert  Action  GAN  Language_Model  PDF
• 2022-04-27 Modern Baselines for SPARQL Semantic Parsing    Debayan Banerjee, Pranav Ajit Nair, Jivat Neet Kaur, Ricardo Usbeck, Chris Biemann arXiv_CL arXiv_CL  Embedding  Bert  Knowledge  Knowledge_Graph  Relation  Language_Model  PDF
• 2022-04-27 Multimodal Transformer-based Model for Buchwald-Hartwig and Suzuki-Miyaura Reaction Yield Prediction    Shimaa Baraka, Ahmed M. El Kerdawy arXiv_AI arXiv_AI  Transformer  Bert  Action  Prediction  PDF
• 2022-04-27 UBERT: A Novel Language Model for Synonymy Prediction at Scale in the UMLS Metathesaurus    Thilini Wijesiriwardene, Vinh Nguyen, Goonmeet Bajaj, Hong Yung Yip, Vishesh Javangula, Yuqing Mao, Kin Wah Fung, Srinivasan Parthasarathy, Amit P. Sheth, Olivier Bodenreider arXiv_AI arXiv_AI  Bert  Deep_Learning  Medical  Language_Model  Prediction  PDF
• 2022-04-27 Better Query Graph Selection for Knowledge Base Question Answering    Yonghui Jia, Wenliang Chen arXiv_CL arXiv_CL  Bert  Knowledge  Pose  Action  QA  PDF
• 2022-04-26 MILES: Visual BERT Pre-training with Injected Language Semantics for Video-text Retrieval    Yuying Ge, Yixiao Ge, Xihui Liu, Alex Jinpeng Wang, Jianping Wu, Ying Shan, Xiaohu Qie, Ping Luo arXiv_CV arXiv_CV  Reconstruction  Recognition  Bert  Zero-Shot  Action_Recognition  Action  Prediction  Video_Retrieval  PDF
• 2022-04-26 Science Checker: Extractive-Boolean Question Answering For Scientific Fact Checking    Loïc Rakotoson, Charles Letaillieur, Sylvain Massip, Fréjus Laleye arXiv_AI arXiv_AI  Bert  Knowledge  Pose  Classification  Summarization  Medical  QA  PDF
• 2022-04-26 Approach to Predicting News -- A Precise Multi-LSTM Network With BERT    Chia-Lin Chen (1), Pei-Yu Huang (2), Yi-Ting Huang (3), Chun Lin (3) ((1) Computer Science and Engineering, National Sun Yat-sen University, Kaohsiung, Taiwan, (2) Management and Digital Innovation, University of London, Singapore, (3) Institute of Information Science, Academia Sinica, Taipei, Taiwan) arXiv_CL arXiv_CL  Transformer  Embedding  OCR  Bert  RNN  PDF
• 2022-04-26 Pretraining Chinese BERT for Detecting Word Insertion and Deletion Errors    Cong Zhou, Yong Dai, Duyu Tang, Enbo Zhao, Zhangyin Feng, Li Kuang, Shuming Shi arXiv_CL arXiv_CL  Bert  Inference  Language_Model  Prediction  PDF
• 2022-04-25 ED2LM: Encoder-Decoder to Language Model for Faster Document Re-ranking Inference    Kai Hui, Honglei Zhuang, Tao Chen, Zhen Qin, Jing Lu, Dara Bahri, Ji Ma, Jai Prakash Gupta, Cicero Nogueira dos Santos, Yi Tay, Don Metzler arXiv_CL arXiv_CL  Embedding  Bert  Pose  Attention  Inference  Language_Model  PDF
• 2022-04-24 Twitter-Based Gender Recognition Using Transformers    Zahra Movahedi Nia, Ali Ahmadi, Bruce Mellado, Jianhong Wu, James Orbinski, Ali Agary, Jude Dzevela Kong arXiv_AI arXiv_AI  Transformer  Recognition  Bert  Text_Classification  Pose  Emotion  Classification  Sentiment  PDF
• 2022-04-24 Learning to Win Lottery Tickets in BERT Transfer via Task-agnostic Mask Training    Yuanxin Liu, Fandong Meng, Zheng Lin, Peng Fu, Yanan Cao, Weiping Wang, Jie Zhou arXiv_CL arXiv_CL  Transfer_Learning  Bert  Pose  Language_Model  Matching  PDF