Bert

Bert

• 2021-10-15 Intent-based Product Collections for E-commerce using Pretrained Language Models    Hiun Kim, Jisu Jeong, Kyung-Min Kim, Dongjun Lee, Hyun Dong Lee, Dongpil Seo, Jeeseung Han, Dong Wook Park, Ji Ae Heo, Rak Yeong Kim arXiv_CL arXiv_CL  Bert  Relation  Language_Model  Matching  PDF
• 2021-10-15 Generating Natural Language Adversarial Examples through An Improved Beam Search Algorithm    Tengfei Zhao, Zhaocheng Ge, Hanping Hu, Dingmeng Shi arXiv_AI arXiv_AI  Bert  RNN  Adversarial  Pose  PDF
• 2021-10-15 Tracing Origins: Coref-aware Machine Reading Comprehension    Baorong Huang, Zhuosheng Zhang, Hai Zhao arXiv_CL arXiv_CL  Embedding  Bert  Relation  CNN  Language_Model  PDF
• 2021-10-15 Span Detection for Aspect-Based Sentiment Analysis in Vietnamese    Kim Thi-Thanh Nguyen, Sieu Khai Huynh, Luong Luc Phan, Phuc Huynh Pham, Duc-Vu Nguyen, Kiet Van Nguyen arXiv_CL arXiv_CL  Embedding  Recognition  Bert  Sentiment_Classification  RNN  Pose  Emotion  Classification  Detection  Sentiment  PDF
• 2021-10-15 A Multilingual Bag-of-Entities Model for Zero-Shot Cross-Lingual Text Classification    Sosuke Nishikawa, Ikuya Yamada, Yoshimasa Tsuruoka, Isao Echizen arXiv_CL arXiv_CL  Embedding  Bert  Zero-Shot  Text_Classification  Pose  Classification  Language_Model  PDF
• 2021-10-14 BI-RADS BERT & Using Section Tokenization to Understand Radiology Reports    Grey Kuling, Dr. Belinda Curpen, Anne L. Martel arXiv_AI arXiv_AI  Embedding  Enhancement  Bert  Pose  Action  PDF
• 2021-10-14 A Simple, Strong and Robust Baseline for Distantly Supervised Relation Extraction    Vipul Rathore, Kartikeya Badola, Mausam, Parag Singla arXiv_CL arXiv_CL  Bert  Action  Relation  Relation_Extraction  Attention  Language_Model  PDF
• 2021-10-14 Evaluating Off-the-Shelf Machine Listening and Natural Language Models for Automated Audio Captioning    Benno Weck, Xavier Favory, Konstantinos Drossos, Xavier Serra arXiv_CL arXiv_CL  Transformer  Embedding  Bert  Attention  Caption  Language_Model  PDF
• 2021-10-14 P-Adapters: Robustly Extracting Factual Information from Language Models with Diverse Prompts    Benjamin Newman, Prafulla Kumar Choubey, Nazneen Rajani arXiv_CL arXiv_CL  Embedding  Bert  Attention  Language_Model  PDF
• 2021-10-14 Building Chinese Biomedical Language Models via Multi-Level Text Discrimination    Quan Wang, Songtai Dai, Benfeng Xu, Yajuan Lyu, Yong Zhu, Hua Wu, Haifeng Wang arXiv_AI arXiv_AI  Bert  Medical  Language_Model  PDF
• 2021-10-14 Context-gloss Augmentation for Improving Word Sense Disambiguation    Guan-Ting Lin, Manuel Giambi arXiv_CL arXiv_CL  Bert  Knowledge  Pose  PDF
• 2021-10-14 MoFE: Mixture of Factual Experts for Controlling Hallucinations in Abstractive Summarization    Prafulla Kumar Choubey, Jesse Vig, Wenhao Liu, Nazneen Fatema Rajani arXiv_CL arXiv_CL  Reinforcement_Learning  Bert  Pose  Summarization  PDF
• 2021-10-14 Causally Estimating the Sensitivity of Neural NLP Models to Spurious Features    Yunxiang Zhang, Liangming Pan, Samson Tan, Min-Yen Kan arXiv_CL arXiv_CL  Bert  RNN  Quantitative  Relation  Inference  Prediction  PDF
• 2021-10-14 bert2BERT: Towards Reusable Pretrained Language Models    Cheng Chen, Yichun Yin, Lifeng Shang, Xin Jiang, Yujia Qin, Fengyu Wang, Zhi Wang, Xiao Chen, Zhiyuan Liu, Qun Liu arXiv_CL arXiv_CL  Transformer  Bert  Knowledge  Pose  Language_Model  PDF
• 2021-10-14 Identifying Introductions in Podcast Episodes from Automatically Generated Transcripts    Elise Jing, Kristiana Schneck, Dennis Egan, Scott A. Waterman arXiv_CL arXiv_CL  Transformer  Segmentation  Embedding  Recognition  Bert  Speech  Pose  GAN  Speech_Recognition  PDF
• 2021-10-13 Towards Efficient NLP: A Standard Evaluation and A Strong Baseline    Xiangyang Liu, Tianxiang Sun, Junliang He, Lingling Wu, Xinyu Zhang, Hao Jiang, Zhao Cao, Xuanjing Huang, Xipeng Qiu arXiv_AI arXiv_AI  Bert  Language_Model  PDF
• 2021-10-13 Language Modelling via Learning to Rank    Arvid Frydenlund, Gagandeep Singh, Frank Rudzicz arXiv_CL arXiv_CL  Transformer  Bert  Knowledge  Language_Model  Prediction  PDF
• 2021-10-13 MDERank: A Masked Document Embedding Rank Approach for Unsupervised Keyphrase Extraction    Linhan Zhang, Qian Chen, Wen Wang, Chong Deng, Shiliang Zhang, Bing Li, Wei Wang, Xin Cao arXiv_CL arXiv_CL  Embedding  Unsupervised  Bert  Self-Supervised  Pose  Action  PDF
• 2021-10-13 Maximizing Efficiency of Language Model Pre-training for Learning Representation    Junmo Kang, Suwon Shin, Jeonghwan Kim, Jaeyoung Jo, Sung-Hyon Myaeng arXiv_CL arXiv_CL  Bert  Pose  Detection  Language_Model  PDF
• 2021-10-13 EventBERT: A Pre-Trained Model for Event Correlation Reasoning    Yucheng Zhou, Xiubo Geng, Tao Shen, Guodong Long, Daxin Jiang arXiv_CL arXiv_CL  Unsupervised  Bert  Zero-Shot  Knowledge  Pose  Relation  PDF
• 2021-10-13 Differentially Private Fine-tuning of Language Models    Da Yu, Saurabh Naik, Arturs Backurs, Sivakanth Gopi, Huseyin A. Inan, Gautam Kamath, Janardhan Kulkarni, Yin Tat Lee, Andre Manoel, Lukas Wutschitz, Sergey Yekhanin, Huishuai Zhang arXiv_CL arXiv_CL  Bert  Sparse  Pose  Language_Model  PDF
• 2021-10-13 Dict-BERT: Enhancing Language Model Pre-training with Dictionary    Wenhao Yu, Chenguang Zhu, Yuwei Fang, Donghan Yu, Shuohang Wang, Yichong Xu, Michael Zeng, Meng Jiang arXiv_CL arXiv_CL  Embedding  Bert  Self-Supervised  Pose  Language_Model  PDF
• 2021-10-13 Understanding of Emotion Perception from Art    Digbalay Bose, Krishna Somandepalli, Souvik Kundu, Rimita Lahiri, Jonathan Gratch, Shrikanth Narayanan arXiv_CV arXiv_CV  Transformer  Bert  Emotion  Classification  Caption  PDF
• 2021-10-13 Fake News Detection in Spanish Using Deep Learning Techniques    Kevin Martínez-Gallego, Andrés M. Álvarez-Ortiz, Julián D. Arias-Londoño arXiv_CL arXiv_CL  Embedding  Bert  RNN  Pose  Deep_Learning  Detection  PDF
• 2021-10-13 Improving Graph-based Sentence Ordering with Iteratively Predicted Pairwise Orderings    Shaopeng Lai, Ante Wang, Fandong Meng, Jie Zhou, Yubin Ge, Jiali Zeng, Junfeng Yao, Degen Huang, Jinsong Su arXiv_CL arXiv_CL  Bert  Pose  PDF
• 2021-10-12 ALL Dolphins Are Intelligent and SOME Are Friendly: Probing BERT for Nouns' Semantic Properties and their Prototypicality    Marianna Apidianaki, Aina Garí Soler arXiv_CL arXiv_CL  Bert  Knowledge  Classification  Language_Model  PDF
• 2021-10-12 Time Masking for Temporal Language Models    Guy D. Rosin, Ido Guy, Kira Radinsky arXiv_CL arXiv_CL  Bert  Pose  Detection  Language_Model  Prediction  PDF
• 2021-10-12 Learning Compact Metrics for MT    Amy Pu, Hyung Won Chung, Ankur P. Parikh, Sebastian Gehrmann, Thibault Sellam arXiv_CL arXiv_CL  Bert  Knowledge  Text_Generation  Language_Model  PDF
• 2021-10-12 Planning Sensing Sequences for Subsurface 3D Tumor Mapping    Brian Y. Cho, Tucker Hermans, Alan Kuntz arXiv_RO arXiv_RO  3D  Bert  Optimization  Knowledge  Pose  Face  Action  PDF
• 2021-10-12 Extracting Feelings of People Regarding COVID-19 by Social Network Mining    Hamed Vahdat-Nejad, Fatemeh Salmani, Mahdi Hajiabadi, Faezeh Azizi, Sajedeh Abbasi, Mohadese Jamalian, Reyhane Mosafer, Hamideh Hajiabadi arXiv_CL arXiv_CL  Bert  Knowledge  Pose  Sentiment  PDF
• 2021-10-12 LaoPLM: Pre-trained Language Models for Lao    Nankai Lin, Yingwen Fu, Ziyu Yang, Shengyi Jiang arXiv_CL arXiv_CL  Transformer  Bert  Text_Classification  Speech  Classification  Language_Model  PDF
• 2021-10-12 BERTraffic: A Robust BERT-Based Approach for Speaker Change Detection and Role Identification of Air-Traffic Communications    Juan Zuluaga-Gomez, Seyyed Saeed Sarfjoo, Amrutha Prasad, Iuliia Nigmatulina, Petr Motlicek, Oliver Ohneiser, Hartmut Helmke arXiv_CL arXiv_CL  Segmentation  Recognition  Bert  Speech  Pose  Detection  Speech_Recognition  Activity  PDF
• 2021-10-12 UniSpeech-SAT: Universal Speech Representation Learning with Speaker Aware Pre-Training    Sanyuan Chen, Yu Wu, Chengyi Wang, Zhengyang Chen, Zhuo Chen, Shujie Liu, Jian Wu, Yao Qian, Furu Wei, Jinyu Li, Xiangzhan Yu arXiv_CL arXiv_CL  Unsupervised  Recognition  Bert  Represenation_Learning  Speech  Self-Supervised  Pose  Action  Speech_Recognition  PDF
• 2021-10-12 Rethinking the Spatial Route Prior in Vision-and-Language Navigation    Xinzhe Zhou, Wei Liu, Yadong Mu arXiv_CV arXiv_CV  Bert  Classification  PDF
• 2021-10-12 LightSeq: Accelerated Training for Transformer-based Models on GPUs    Xiaohui Wang, Ying Xiong, Xian Qian, Yang Wei, Lei Li, Mingxuan Wang arXiv_CL arXiv_CL  Transformer  Recognition  Bert  Optimization  Speech  Pose  Speech_Recognition  Inference  PDF
• 2021-10-11 Bottom-Up Constituency Parsing and Nested Named Entity Recognition with Pointer Networks    Songlin Yang, Kewei Tu arXiv_CL arXiv_CL  Recognition  Bert  Pose  Prediction  PDF
• 2021-10-11 SignBERT: Pre-Training of Hand-Model-Aware Representation for Sign Language Recognition    Hezhen Hu, Weichao Zhao, Wengang Zhou, Yuechen Wang, Houqiang Li arXiv_CV arXiv_CV  Recognition  Bert  Gesture  Self-Supervised  Pose  Prediction  PDF
• 2021-10-11 Improving Gender Fairness of Pre-Trained Language Models without Catastrophic Forgetting    Zahra Fatemi, Chen Xing, Wenhao Liu, Caiming Xiong arXiv_CL arXiv_CL  Embedding  Bert  Pose  Language_Model  PDF
• 2021-10-11 TEET! Tunisian Dataset for Toxic Speech Detection    Slim Gharbi, Heger Arfaoui, Hatem Haddad, Mayssa Kchaou arXiv_AI arXiv_AI  Bert  Speech  Pose  Classification  Deep_Learning  Detection  PDF
• 2021-10-11 Multi-modal Self-supervised Pre-training for Regulatory Genome Across Cell Types    Shentong Mo, Xi Fu, Chenyang Hong, Yizhen Chen, Yuxuan Zheng, Xiangru Tang, Zhiqiang Shen, Eric P Xing, Yanyan Lan arXiv_AI arXiv_AI  Bert  Self-Supervised  Pose  Action  Classification  Deep_Learning  Prediction  PDF
• 2021-10-11 Offensive Language Detection with BERT-based models, By Customizing Attention Probabilities    Peyman Alavi, Pouria Nikvand, Mehrnoush Shamsfard arXiv_AI arXiv_AI  Transformer  Embedding  Bert  RNN  Detection  Attention  PDF
• 2021-10-10 PASTE: A Tagging-Free Decoding Framework Using Pointer Networks for Aspect Sentiment Triplet Extraction    Rajdeep Mukherjee, Tapas Nayak, Yash Butala, Sourangshu Bhattacharya, Pawan Goyal arXiv_CL arXiv_CL  Bert  Review  Pose  Action  Sentiment  PDF
• 2021-10-10 Towards High-fidelity Singing Voice Conversion with Acoustic Reference and Contrastive Predictive Coding    Chao Wang, Zhonghao Li, Benlai Tang, Xiang Yin, Yuan Wan, Yibiao Yu, Zejun Ma arXiv_CL arXiv_CL  Recognition  Bert  Speech  Pose  Speech_Recognition  PDF
• 2021-10-10 SuperShaper: Task-Agnostic Super Pre-training of BERT Models with Variable Hidden Dimensions    Vinod Ganesan, Gowtham Ramesh, Pratyush Kumar arXiv_CL arXiv_CL  Transformer  NAS  Bert  Pose  Language_Model  PDF
• 2021-10-10 Can Audio Captions Be Evaluated with Image Caption Metrics?    Zelin Zhou, Zhiling Zhang, Xuenan Xu, Zeyu Xie, Mengyue Wu, Kenny Q. Zhu arXiv_CL arXiv_CL  Image_Caption  Bert  Pose  Detection  Relation  Object_Detection  Caption  PDF
• 2021-10-09 An Exploration of Self-Supervised Pretrained Representations for End-to-End Speech Recognition    Xuankai Chang, Takashi Maekaku, Pengcheng Guo, Jing Shi, Yen-Ju Lu, Aswin Shanmugam Subramanian, Tianzi Wang, Shu-wen Yang, Yu Tsao, Hung-yi Lee, Shinji Watanabe arXiv_CL arXiv_CL  Recognition  Bert  Speech  Self-Supervised  Speech_Recognition  PDF
• 2021-10-09 An Isotropy Analysis in the Multilingual BERT Embedding Space    Sara Rajaee, Mohammad Taher Pilehvar arXiv_CL arXiv_CL  Embedding  Bert  Knowledge  Attention  PDF
• 2021-10-09 Leveraging recent advances in Pre-Trained Language Models forEye-Tracking Prediction    Varun Madhavan, Aditya Girish Pawate, Shraman Pal, Abhranil Chandra arXiv_CL arXiv_CL  Transformer  Tracking  Bert  Language_Model  Prediction  PDF
• 2021-10-09 Using multiple reference audios and style embedding constraints for speech synthesis    Cheng Gong, Longbiao Wang, Zhenhua Ling, Ju Zhang, Jianwu Dang arXiv_AI arXiv_AI  Transformer  Embedding  Bert  Speech  Pose  Inference  PDF
• 2021-10-09 Arabic Speech Emotion Recognition Employing Wav2vec2.0 and HuBERT Based on BAVED Dataset    Omar Mohamed, Salah A. Aly arXiv_AI arXiv_AI  Recognition  Bert  Represenation_Learning  Speech  Emotion  Deep_Learning  Speech_Recognition  PDF
• 2021-10-08 Global Explainability of BERT-Based Evaluation Metrics by Disentangling along Linguistic Factors    Marvin Kaster, Wei Zhao, Steffen Eger arXiv_CL arXiv_CL  Bert  Adversarial  Pose  Text_Generation  Language_Model  PDF
• 2021-10-08 Local and Global Context-Based Pairwise Models for Sentence Ordering    Ruskin Raj Manku, Aditya Jyoti Paul arXiv_CL arXiv_CL  Transformer  Bert  Pose  Prediction  PDF
• 2021-10-08 Development of an Extractive Title Generation System Using Titles of Papers of Top Conferences for Intermediate English Students    Kento Kaku, Masato Kikuchi, Tadachika Ozono, Toramatsu Shintani arXiv_CL arXiv_CL  Bert  PDF
• 2021-10-08 Text analysis and deep learning: A network approach    Ingo Marquart arXiv_CL arXiv_CL  Transformer  Unsupervised  Bert  Knowledge  Review  Pose  Deep_Learning  Relation  Language_Model  PDF
• 2021-10-08 ALL-IN-ONE: Multi-Task Learning BERT models for Evaluating Peer Assessments    Qinjin Jia, Jialin Cui, Yunkai Xiao, Chengyuan Liu, Parvez Rashid, Edward F. Gehringer arXiv_CL arXiv_CL  Bert  Review  Deep_Learning  PDF
• 2021-10-08 Speeding up Deep Model Training by Sharing Weights and Then Unsharing    Shuo Yang, Le Hou, Xiaodan Song, Qiang Liu, Denny Zhou arXiv_CL arXiv_CL  Transformer  Bert  Pose  PDF
• 2021-10-07 Attention is All You Need? Good Embeddings with Statistics are enough: Audio Understanding WITHOUT Convolutions/Transformers/BERTs/Mixers/Attention/RNNs or    Prateek Verma arXiv_AI arXiv_AI  Transformer  Embedding  Bert  Represenation_Learning  RNN  Classification  Deep_Learning  Attention  CNN  PDF
• 2021-10-07 A Comparative Study of Transformer-Based Language Models on Extractive Question Answering    Kate Pearce, Tiffany Zhan, Aneesh Komanduri, Justin Zhan arXiv_CL arXiv_CL  Transformer  Bert  RNN  Pose  Language_Model  QA  PDF
• 2021-10-06 NUS-IDS at FinCausal 2021: Dependency Tree in Graph Neural Network for Better Cause-Effect Span Detection    Fiona Anting Tan, See-Kiong Ng arXiv_CL arXiv_CL  Embedding  Bert  Detection  Relation  PDF
• 2021-10-06 CCO-VOXEL: Chance Constrained Optimization over Uncertain Voxel-Grid Representation for Safe Trajectory Planning    Sudarshan S Harithas, Rishabh Dev Yadav, Deepak Singh, Arun Kumar Singh, K Madhava Krishna arXiv_RO arXiv_RO  Embedding  Bert  Optimization  PDF
• 2021-10-06 PSG HASOC-Dravidian CodeMixFIRE2021: Pretrained Transformers for Offensive Language Identification in Tanglish    Sean Benhur, Kanchana Sivanraju arXiv_CL arXiv_CL  Transformer  Bert  Speech  PDF
• 2021-10-06 KNN-BERT: Fine-Tuning Pre-Trained Models with KNN Classifier    Linyang Li, Demin Song, Ruotian Ma, Xipeng Qiu, Xuanjing Huang arXiv_CL arXiv_CL  Bert  Text_Classification  Adversarial  Contrastive_Learning  Face  Classification  Few-Shot  Prediction  PDF
• 2021-10-06 PoNet: Pooling Network for Efficient Token Mixing in Long Sequences    Chao-Hong Tan, Qian Chen, Wen Wang, Qinglin Zhang, Siqi Zheng, Zhen-Hua Ling arXiv_AI arXiv_AI  Transformer  Transfer_Learning  Bert  Sparse  Speech  Pose  Action  Attention  PDF
• 2021-10-05 Word Acquisition in Neural Language Models    Tyler A. Chang, Benjamin K. Bergen arXiv_CL arXiv_CL  Transformer  Bert  RNN  Action  Language_Model  Prediction  PDF
• 2021-10-05 Disambiguation-BERT for N-best Rescoring in Low-Resource Conversational ASR    Pablo Ortiz, Simen Burud arXiv_CL arXiv_CL  Recognition  Bert  Speech  Speech_Recognition  Language_Model  PDF
• 2021-10-05 Learning Sense-Specific Static Embeddings using Contextualised Word Embeddings as a Proxy    Yi Zhou, Danushka Bollegala arXiv_CL arXiv_CL  Embedding  Bert  Pose  Language_Model  PDF
• 2021-10-05 Analyzing the Impact of COVID-19 on Economy from the Perspective of Users Reviews    Fatemeh Salmani, Hamed Vahdat-Nejad, Hamideh Hajiabadi arXiv_CL arXiv_CL  Bert  Review  Pose  Sentiment  PDF
• 2021-10-05 ur-iw-hnt at GermEval 2021: An Ensembling Strategy with Multiple BERT Models    Hoai Nam Tran, Udo Kruschwitz arXiv_AI arXiv_AI  Bert  PDF
• 2021-10-05 FoodChem: A food-chemical relation extraction model    Gjorgjina Cenikj, Barbara Koroušić Seljak, Tome Eftimov arXiv_CL arXiv_CL  Transformer  Bert  Review  Pose  Action  Classification  Relation  Relation_Extraction  Medical  PDF
• 2021-10-05 DistilHuBERT: Speech Representation Learning by Layer-wise Distillation of Hidden-unit BERT    Heng-Jui Chang, Shu-wen Yang, Hung-yi Lee arXiv_CL arXiv_CL  Bert  Represenation_Learning  Speech  Self-Supervised  PDF
• 2021-10-05 ASR Rescoring and Confidence Estimation with ELECTRA    Hayato Futami, Hirofumi Inaguma, Masato Mimura, Shinsuke Sakai, Tatsuya Kawahara arXiv_CL arXiv_CL  Recognition  Bert  Speech  Pose  Detection  Speech_Recognition  Inference  Language_Model  PDF
• 2021-10-05 Attention Augmented Convolutional Transformer for Tabular Time-series    Sharath M Shankaranarayana, Davor Runje arXiv_AI arXiv_AI  Transformer  Embedding  Quantization  Bert  Represenation_Learning  Pose  Classification  Attention  CNN  Language_Model  PDF
• 2021-10-04 Privacy enabled Financial Text Classification using Differential Privacy and Federated Learning    Priyam Basu, Tiasa Singha Roy, Rakshit Naidu, Zumrut Muftuoglu arXiv_CL arXiv_CL  Transformer  Bert  Text_Classification  Pose  Classification  Detection  Sentiment  PDF
• 2021-10-04 Towards Theme Detection in Personal Finance Questions    John Xi Qiu, Adam Faulkner, Aysu Ezen Can arXiv_CL arXiv_CL  Tracking  Bert  Classification  Detection  PDF
• 2021-10-04 Generalization in NLI: Ways To Go Beyond Simple Heuristics    Prajjwal Bhargava, Aleksandr Drozd, Anna Rogers arXiv_CL arXiv_CL  Transformer  Bert  Adversarial  PDF
• 2021-10-04 JuriBERT: A Masked-Language Model Adaptation for French Legal Text    Stella Douka, Hadi Abdine, Michalis Vazirgiannis, Rajaa El Hamdani, David Restrepo Amariles arXiv_CL arXiv_CL  Bert  Language_Model  PDF
• 2021-10-03 Hybrid Event Shaping to Stabilize Periodic Hybrid Orbits    James Zhu, Nathan J. Kong, George Council, Aaron M. Jonhson arXiv_RO arXiv_RO  Bert  Optimization  Action  PDF
• 2021-10-03 Adversarial Examples Generation for Reducing Implicit Gender Bias in Pre-trained Models    Wenqian Ye, Fei Xu, Yaojia Huang, Cassie Huang, Ji A arXiv_CL arXiv_CL  Bert  Adversarial  Pose  Language_Model  PDF
• 2021-10-02 Artificial intelligence for Sustainable Energy: A Contextual Topic Modeling and Content Analysis    Tahereh Saheb, Mohammad Dehghani arXiv_AI arXiv_AI  Bert  Optimization  Knowledge  Pose  PDF
• 2021-10-02 Swiss-Judgment-Prediction: A Multilingual Legal Judgment Prediction Benchmark    Joel Niklaus, Ilias Chalkidis, Matthias Stürmer arXiv_CL arXiv_CL  Bert  Prediction  PDF
• 2021-10-01 Low Frequency Names Exhibit Bias and Overfitting in Contextualizing Language Models    Robert Wolfe, Aylin Caliskan arXiv_AI arXiv_AI  Bert  Language_Model  PDF
• 2021-10-01 Improving Punctuation Restoration for Speech Transcripts via External Data    Xue-Yong Fu, Cheng Chen, Md Tahmid Rahman Laskar, Shashi Bhushan TN, Simon Corston-Oliver arXiv_CL arXiv_CL  Recognition  Bert  Restoration  Speech  Pose  Speech_Recognition  Language_Model  PDF
• 2021-10-01 Unpacking the Interdependent Systems of Discrimination: Ableist Bias in NLP Systems through an Intersectional Lens    Saad Hassan, Matt Huenerfauth, Cecilia Ovesdotter Alm arXiv_AI arXiv_AI  Bert  Language_Model  Prediction  PDF
• 2021-10-01 BERT4GCN: Using BERT Intermediate Layers to Augment GCN for Aspect-based Sentiment Classification    Zeguan Xiao, Jiarun Wu, Qingliang Chen, Congjian Deng arXiv_CL arXiv_CL  Embedding  Bert  Sentiment_Classification  Knowledge  Pose  Classification  Sentiment  CNN  Language_Model  PDF
• 2021-10-01 Building an Efficient and Effective Retrieval-based Dialogue System via Mutual Learning    Chongyang Tao, Jiazhan Feng, Chang Liu, Juntao Li, Xiubo Geng, Daxin Jiang arXiv_CL arXiv_CL  Bert  Pose  Attention  Language_Model  PDF
• 2021-10-01 Span Labeling Approach for Vietnamese and Chinese Word Segmentation    Duc-Vu Nguyen, Linh-Bao Vo, Dang Van Thin, Ngan Luu-Thuy Nguyen arXiv_CL arXiv_CL  Segmentation  Bert  Memory_Networks  Pose  Inference  Language_Model  PDF
• 2021-09-30 MatSciBERT: A Materials Domain Language Model for Text Mining and Information Extraction    Tanishq Gupta, Mohd Zaki, N. M. Anoop Krishnan, Mausam arXiv_CL arXiv_CL  Transformer  Recognition  Bert  Optimization  Knowledge  Review  Action  Classification  Relation  Relation_Extraction  Language_Model  PDF
• 2021-09-30 SlovakBERT: Slovak Masked Language Model    Matúš Pikuliak, Štefan Grivalský, Martin Konôpka, Miroslav Blšták, Martin Tamajka, Viktor Bachratý, Marián Šimko, Pavol Balážik, Michal Trnka, Filip Uhlárik arXiv_CL arXiv_CL  Transformer  Bert  Speech  Sentiment  Language_Model  PDF
• 2021-09-30 Prose2Poem: The blessing of Transformer-based Language Models in translating Prose to Persian Poetry    Reza Khanmohammadi, Mitra Sadat Mirshafiee, Yazdan Rezaee Jouryabi, Seyed Abolghasem Mirroshandel arXiv_CL arXiv_CL  Transformer  Bert  Speech  NMT  Language_Model  PDF
• 2021-09-30 BERT got a Date: Introducing Transformers to Temporal Tagging    Satya Almasian, Dennis Aumiller, Michael Gertz arXiv_CL arXiv_CL  Transformer  Bert  Classification  Language_Model  PDF
• 2021-09-30 COVID-19 Fake News Detection Using Bidirectiona lEncoder Representations from Transformers Based Models    Yuxiang Wang, Yongheng Zhang, Xuebo Li, Xinyao Yu arXiv_CL arXiv_CL  Transformer  Bert  RNN  Classification  Detection  PDF
• 2021-09-29 Classifying Tweet Sentiment Using the Hidden State and Attention Matrix of a Fine-tuned BERTweet Model    Tommaso Macrì, Freya Murphy, Yunfan Zou, Yves Zumbach arXiv_CL arXiv_CL  Embedding  Bert  Sentiment_Classification  Pose  Classification  Sentiment  Attention  PDF
• 2021-09-29 StoryDB: Broad Multi-language Narrative Dataset    Alexey Tikhonov, Igor Samenko, Ivan P. Yamshchikov arXiv_CL arXiv_CL  Bert  Language_Model  PDF
• 2021-09-29 Hierarchical Character Tagger for Short Text Spelling Error Correction    Mengyi Gao, Canran Xu, Peng Shi arXiv_CL arXiv_CL  Transformer  Bert  Pose  Inference  Language_Model  PDF
• 2021-09-29 BLEU, METEOR, BERTScore: Evaluation of Metrics Performance in Assessing Critical Translation Errors in Sentiment-oriented Text    Hadeel Saadany, Constantin Orasan arXiv_CL arXiv_CL  Bert  Speech  Sentiment  PDF
• 2021-09-28 Shaking Syntactic Trees on the Sesame Street: Multilingual Probing with Controllable Perturbations    Ekaterina Taktasheva, Vladislav Mikhailov, Ekaterina Artemova arXiv_CL arXiv_CL  Transformer  Embedding  Bert  Pose  Attention  GAN  Language_Model  PDF
• 2021-09-28 How Different Text-preprocessing Techniques Using The BERT Model Affect The Gender Profiling of Authors    Esam Alzahrani, Leon Jololian arXiv_CL arXiv_CL  Transformer  Transfer_Learning  Bert  Review  Pose  Face  PDF
• 2021-09-28 Template-free Prompt Tuning for Few-shot NER    Ruotian Ma, Xin Zhou, Tao Gui, Yiding Tan, Qi Zhang, Xuanjing Huang arXiv_CL arXiv_CL  Bert  Pose  Few-Shot  GAN  Prediction  PDF
• 2021-09-28 Exploring Teacher-Student Learning Approach for Multi-lingual Speech-to-Intent Classification    Bidisha Sharma, Maulik Madhavi, Xuehao Zhou, Haizhou Li arXiv_AI arXiv_AI  Transformer  Bert  Knowledge  Speech  Classification  PDF
• 2021-09-27 FQuAD2.0: French Question Answering and knowing that you know nothing    Quentin Heinrich, Gautier Viaud, Wacim Belblidia arXiv_AI arXiv_AI  Bert  Adversarial  Pose  Classification  Language_Model  Prediction  PDF
• 2021-09-27 Knowledge-Aware Neural Networks for Medical Forum Question Classification    Soumyadeep Roy, Sudip Chakraborty, Aishik Mandal, Gunjan Balde, Prakhar Sharma, Anandhavelu Natarajan, Megha Khosla, Shamik Sural, Niloy Ganguly arXiv_CL arXiv_CL  Bert  Knowledge  Classification  Medical  PDF
• 2021-09-27 Improving Stack Overflow question title generation with copying enhanced CodeBERT model and bi-modal information    Fengji Zhang, Jacky Keung, Xiao Yu, Zhiwen Xie, Zhen Yang, Caoyuan Ma, Zhimin Zhang arXiv_AI arXiv_AI  Transformer  Bert  RNN  Pose  Deep_Learning  Attention  PDF
• 2021-09-27 Trans-Encoder: Unsupervised sentence-pair modelling through self- and mutual-distillations    Fangyu Liu, Serhii Havrylov, Yunlong Jiao, Jordan Massiah, Emine Yilmaz arXiv_AI arXiv_AI  Unsupervised  Bert  Knowledge  Pose  Action  Attention  Language_Model  PDF
• 2021-09-27 Patterns of Lexical Ambiguity in Contextualised Language Models    Janosch HaberandMassimo Poesio arXiv_CL arXiv_CL  Embedding  Bert  Relation  Language_Model  PDF
• 2021-09-27 Understanding and Overcoming the Challenges of Efficient Transformer Quantization    Yelysei Bondarenko, Markus Nagel, Tijmen Blankevoort arXiv_AI arXiv_AI  Transformer  Embedding  Quantization  Bert  Attention  Inference  PDF
• 2021-09-27 MFAQ: a Multilingual FAQ Dataset    Maxime De Bruyn, Ehsan Lotfi, Jeska Buhmann, Walter Daelemans arXiv_CL arXiv_CL  Bert  PDF
• 2021-09-27 Investigating Non-local Features for Neural Constituency Parsing    Leyang Cui, Sen Yang, Yue Zhang arXiv_CL arXiv_CL  Bert  PDF
• 2021-09-27 An Adaptive PID Autotuner for Multicopters with Experimental Results    John Spencer, Joonghyun Lee, Juan Augusto Paredes, Ankit Goel, Dennis Bernstein arXiv_AI arXiv_AI  Bert  PDF
• 2021-09-27 Multiplicative Position-aware Transformer Models for Language Understanding    Zhiheng Huang, Davis Liang, Peng Xu, Bing Xiang arXiv_AI arXiv_AI  Transformer  Embedding  Bert  Review  Pose  Attention  PDF
• 2021-09-27 Effective Use of Graph Convolution Network and Contextual Sub-Tree forCommodity News Event Extraction    Meisin Lee, Lay-Ki Soon, Eu-Gene Siew arXiv_AI arXiv_AI  Bert  Pose  Action  Classification  Relation  CNN  Language_Model  Prediction  PDF
• 2021-09-27 Rumour Detection via Zero-shot Cross-lingual Transfer Learning    Lin Tian, Xiuzhen Zhang, Jey Han Lau arXiv_CL arXiv_CL  Transfer_Learning  Bert  Zero-Shot  Pose  Detection  Language_Model  PDF
• 2021-09-26 On the Prunability of Attention Heads in Multilingual BERT    Aakriti Budhraja, Madhura Pande, Pratyush Kumar, Mitesh M. Khapra arXiv_CL arXiv_CL  Bert  Attention  PDF
• 2021-09-26 Improving Question Answering Performance Using Knowledge Distillation and Active Learning    Yasaman Boreshban, Seyed Morteza Mirbostani, Gholamreza Ghassem-Sani, Seyed Abolghasem Mirroshandel, Shahin Amiriparian arXiv_CL arXiv_CL  Transformer  Bert  Knowledge  Pose  QA  PDF
• 2021-09-26 Electoral Programs of German Parties 2021: A Computational Analysis Of Their Comprehensibility and Likeability Based On SentiArt    Arthur M. Jacobs, Annette Kinder arXiv_CL arXiv_CL  Bert  Emotion  Quantitative  Sentiment  Prediction  PDF
• 2021-09-25 DziriBERT: a Pre-trained Language Model for the Algerian Dialect    Amine Abdaoui, Mohamed Berrimi, Mourad Oussalah, Abdelouahab Moussaoui arXiv_CL arXiv_CL  Transformer  Bert  Attention  Language_Model  PDF
• 2021-09-25 Finetuning Transformer Models to Build ASAG System    Mithun Thakkar arXiv_AI arXiv_AI  Transformer  Bert  Face  Relation  PDF
• 2021-09-25 Pushing on Text Readability Assessment: A Transformer Meets Handcrafted Linguistic Features    Bruce W. Lee, Yoo Sung Jang, Jason Hyung-Jong Lee arXiv_AI arXiv_AI  Transformer  Bert  Action  Classification  PDF
• 2021-09-24 RuleBert: Teaching Soft Rules to Pre-trained Language Models    Mohammed Saeed, Naser Ahmadi, Preslav Nakov, Paolo Papotti arXiv_AI arXiv_AI  Bert  Knowledge  Pose  Classification  Language_Model  Prediction  PDF
• 2021-09-24 Robustness and Sensitivity of BERT Models Predicting Alzheimer's Disease from Text    Jekaterina Novikova arXiv_CL arXiv_CL  Bert  Classification  PDF
• 2021-09-24 Dense Contrastive Visual-Linguistic Pretraining    Lei Shi, Kai Shuang, Shijie Geng, Peng Gao, Zuohui Fu, Gerard de Melo, Yunpeng Chen, Sen Su arXiv_CV arXiv_CV  Bert  Sparse  Represenation_Learning  Adversarial  Self-Supervised  Pose  Contrastive_Learning  Classification  PDF
• 2021-09-24 Lacking the embedding of a word? Look it up into a traditional dictionary    Elena Sofia Ruzzetti, Leonardo Ranaldi, Michele Mastromattei, Francesca Fallucchi, Fabio Massimo Zanzotto arXiv_AI arXiv_AI  Embedding  Bert  Pose  PDF
• 2021-09-24 DACT-BERT: Differentiable Adaptive Computation Time for an Efficient BERT Inference    Cristóbal Eyzaguirre, Felipe del Río, Vladimir Araujo, Álvaro Soto arXiv_AI arXiv_AI  Transformer  Bert  Pose  Inference  Language_Model  PDF
• 2021-09-24 AES Are Both Overstable And Oversensitive: Explaining Why And Proposing Defenses    Yaman Kumar Singla, Swapnil Parekh, Somesh Singh, Junyi Jessy Li, Rajiv Ratn Shah, Changyou Chen arXiv_AI arXiv_AI  Embedding  Bert  Represenation_Learning  Adversarial  Speech  Pose  Detection  PDF
• 2021-09-23 MARMOT: A Deep Learning Framework for Constructing Multimodal Representations for Vision-and-Language Tasks    Patrick Y. Wu, Walter R. Mebane Jr arXiv_CV arXiv_CV  Bert  Pose  Classification  Deep_Learning  Activity  Language_Model  PDF
• 2021-09-23 Putting Words in BERT's Mouth: Navigating Contextualized Vector Spaces with Pseudowords    Taelin Karidi, Yichu Zhou, Nathan Schneider, Omri Abend, Vivek Srikumar arXiv_CL arXiv_CL  Embedding  Bert  Prediction  PDF
• 2021-09-23 ParaShoot: A Hebrew Question Answering Dataset    Omri Keren, Omer Levy arXiv_CL arXiv_CL  Bert  PDF
• 2021-09-23 Breaking BERT: Understanding its Vulnerabilities for Named Entity Recognition through Adversarial Attack    Anne Dirkson, Suzan Verberne, Wessel Kraaij arXiv_CL arXiv_CL  Recognition  Bert  Adversarial  PDF
• 2021-09-22 Alzheimers Dementia Detection using Acoustic & Linguistic features and Pre-Trained BERT    Akshay Valsaraj, Ithihas Madala, Nikhil Garg, Veeky Baths arXiv_CL arXiv_CL  Recognition  Bert  Speech  Action  Classification  Deep_Learning  Detection  PDF
• 2021-09-22 Small-Bench NLP: Benchmark for small single GPU trained models in Natural Language Processing    Kamal Raj Kanakarajan, Bhuvana Kundumani, Malaikannan Sankarasubbu arXiv_CL arXiv_CL  Bert  Language_Model  PDF
• 2021-09-22 Role of Language Relatedness in Multilingual Fine-tuning of Language Models: A Case Study in Indo-Aryan Languages    Tejas Indulal Dhamecha, Rudra Murthy V, Samarth Bharadwaj, Karthik Sankaranarayanan, Pushpak Bhattacharyya arXiv_CL arXiv_CL  Bert  Classification  Language_Model  Prediction  PDF
• 2021-09-22 Unsupervised Contextualized Document Representation    Ankur Gupta, Vivek Gupta arXiv_CL arXiv_CL  Embedding  Unsupervised  Bert  Sparse  Classification  Matching  PDF
• 2021-09-22 DialogueBERT: A Self-Supervised Learning based Dialogue Pre-training Encoder    Zhenyu Zhang, Tao Guo, Meng Chen arXiv_AI arXiv_AI  Embedding  Recognition  Bert  Self-Supervised  Pose  Emotion  Relation  GAN  Language_Model  PDF
• 2021-09-21 Multi-Task Learning with Sentiment, Emotion, and Target Detection to Recognize Hate Speech and Offensive Language    Flor Miriam Plaza-del-Arco, Sercan Halat, Sebastian Padó, Roman Klinger arXiv_CL arXiv_CL  Recognition  Bert  Speech  Emotion  Classification  Detection  Relation  Sentiment  PDF
• 2021-09-21 BERTweetFR : Domain Adaptation of Pre-Trained Language Models for French Tweets    Yanzhu Guo, Virgile Rennard, Christos Xypolopoulos, Michalis Vazirgiannis arXiv_CL arXiv_CL  Transformer  Recognition  Bert  Detection  Language_Model  PDF
• 2021-09-21 A Comprehensive Review on Summarizing Financial News Using Deep Learning    Saurabh Kamal, Sahil Sharma arXiv_CL arXiv_CL  Embedding  Bert  RNN  Review  Pose  Quantitative  Deep_Learning  Sentiment  Language_Model  Prediction  PDF
• 2021-09-21 InvBERT: Text Reconstruction from Contextualized Embeddings used for Derived Text Formats of Literary Works    Johannes Höhmann, Achim Rettinger, Kai Kugler arXiv_CL arXiv_CL  Transformer  Reconstruction  Embedding  Bert  Pose  Quantitative  PDF
• 2021-09-21 Representation Learning for Short Text Clustering    Hui Yin, Xiangyu Song, Shuiqiao Yang, Guangyan Huang, Jianxin Li arXiv_CL arXiv_CL  Unsupervised  Bert  Sparse  Represenation_Learning  Pose  CNN  Language_Model  PDF
• 2021-09-20 BERT Has Uncommon Sense: Similarity Ranking for Word Sense BERTology    Luke Gessler, Nathan Schneider arXiv_CL arXiv_CL  Embedding  Bert  PDF
• 2021-09-20 Model Bias in NLP - Application to Hate Speech Classification    Jonas Bokstaller, Georgios Patoulidis, Aygul Zagidullina arXiv_AI arXiv_AI  Bert  Speech  Face  Classification  PDF
• 2021-09-20 BERT Cannot Align Characters    Antonis Maronikolakis, Philipp Dufter, Hinrich Schütze arXiv_AI arXiv_AI  Bert  Relation  PDF
• 2021-09-20 JobBERT: Understanding Job Titles through Skills    Jens-Joris Decorte, Jeroen Van Hautte, Thomas Demeester, Chris Develder arXiv_CL arXiv_CL  Bert  Pose  GAN  Language_Model  PDF
• 2021-09-19 MirrorWiC: On Eliciting Word-in-Context Representations from Pretrained Language Models    Qianchu Liu, Fangyu Liu, Nigel Collier, Anna Korhonen, Ivan Vulić arXiv_CL arXiv_CL  Unsupervised  Bert  Self-Supervised  Pose  Contrastive_Learning  Language_Model  PDF
• 2021-09-19 Wav-BERT: Cooperative Acoustic and Linguistic Representation Learning for Low-Resource Speech Recognition    Guolin Zheng, Yubei Xiao, Ke Gong, Pan Zhou, Xiaodan Liang, Liang Lin arXiv_CL arXiv_CL  Embedding  Recognition  Bert  Represenation_Learning  Knowledge  Speech  Attention  Speech_Recognition  Language_Model  PDF
• 2021-09-19 ComicGAN: Text-to-Comic Generative Adversarial Network    Ben Proven-Bessel, Zilong Zhao, Lydia Chen arXiv_CV arXiv_CV  Bert  Adversarial  Pose  GAN  CNN  PDF
• 2021-09-19 What BERT Based Language Models Learn in Spoken Transcripts: An Empirical Study    Ayush Kumar, Mukuntha Narayanan Sundararaman, Jithendra Vepa arXiv_AI arXiv_AI  Bert  Speech  Pose  Action  Detection  Language_Model  Prediction  PDF
• 2021-09-18 Complex Temporal Question Answering on Knowledge Graphs    Zhen Jia, Soumajit Pramanik, Rishiraj Saha Roy, Gerhard Weikum arXiv_CL arXiv_CL  Embedding  Bert  Knowledge  Knowledge_Graph  Pose  Relation  Attention  CNN  QA  PDF
• 2021-09-18 Text Detoxification using Large Pre-trained Neural Models    David Dale, Anton Voronov, Daryna Dementieva, Varvara Logacheva, Olga Kozlova, Nikita Semenov, Alexander Panchenko arXiv_CL arXiv_CL  Unsupervised  Style_Transfer  Bert  Language_Model  PDF
• 2021-09-18 DyLex: Incoporating Dynamic Lexicons into BERT for Sequence Labeling    Baojun Wang, Zhao Zhang, Kun Xu, Guang-Yuan Hao, Yuyang Zhang, Lifeng Shang, Linlin Li, Xiao Chen, Xin Jiang, Qun Liu arXiv_CL arXiv_CL  Embedding  Bert  Knowledge  Pose  Deep_Learning  Denoising  Attention  Matching  PDF
• 2021-09-18 BERT-Beta: A Proactive Probabilistic Approach to Text Moderation    Fei Tan, Yifan Hu, Kevin Yen, Changwei Hu arXiv_AI arXiv_AI  Bert  Review  Pose  Action  PDF
• 2021-09-18 Solar cell patent classification method based on keyword extraction and deep neural network    Yongmin Yoo, Dongjin Lim, Tak-Sung Heo arXiv_CL arXiv_CL  Bert  Pose  Action  Classification  Relation  Attention  PDF
• 2021-09-17 Grounding Natural Language Instructions: Can Large Language Models Capture Spatial Information?    Julia Rozanova, Deborah Ferreira, Krishna Dubba, Weiwei Cheng, Dell Zhang, Andre Freitas arXiv_AI arXiv_AI  Transformer  Bert  Pose  Face  Language_Model  PDF
• 2021-09-17 The futility of STILTs for the classification of lexical borrowings in Spanish    Javier de la Rosa arXiv_CL arXiv_CL  Transformer  Recognition  Bert  Speech  Classification  Detection  Language_Model  PDF
• 2021-09-17 New Students on Sesame Street: What Order-Aware Matrix Embeddings Can Learn from BERT    Lukas Galke, Isabelle Cuber, Christoph Meyer, Henrik Ferdinand Nölscher, Angelina Sonderecker, Ansgar Scherp arXiv_CL arXiv_CL  Embedding  Bert  Language_Model  PDF
• 2021-09-17 Fine-Tuned Transformers Show Clusters of Similar Representations Across Layers    Jason Phang, Haokun Liu, Samuel R. Bowman arXiv_CL arXiv_CL  Transformer  Bert  PDF
• 2021-09-17 Distilling Linguistic Context for Language Model Compression    Geondo Park, Gyeongman Kim, Eunho Yang arXiv_AI arXiv_AI  Bert  Represenation_Learning  Knowledge  Pose  Relation  Language_Model  PDF
• 2021-09-16 Revisiting Tri-training of Dependency Parsers    Joachim Wagner, Jennifer Foster arXiv_CL arXiv_CL  Embedding  Bert  Zero-Shot  PDF
• 2021-09-16 Let the CAT out of the bag: Contrastive Attributed explanations for Text    Saneem Chemmengath, Amar Prakash Azad, Ronny Luss, Amit Dhurandhar arXiv_AI arXiv_AI  Bert  Pose  Quantitative  Attention  Language_Model  PDF
• 2021-09-16 RetrievalSum: A Retrieval Enhanced Framework for Abstractive Summarization    Chenxin An, Ming Zhong, Zhichao Geng, Jianqiang Yang, Xipeng Qiu arXiv_CL arXiv_CL  Bert  Pose  Summarization  PDF
• 2021-09-16 MOVER: Mask, Over-generate and Rank for Hyperbole Generation    Yunxiang Zhang, Xiaojun Wan arXiv_CL arXiv_CL  Unsupervised  Bert  Speech  Pose  Inference  PDF
• 2021-09-15 Comparing Feature-Engineering and Feature-Learning Approaches for Multilingual Translationese Classification    Daria Pylypenko, Kwabena Amponsah-Kaakyire, Koel Dutta Chowdhury, Josef van Genabith, Cristina España-Bonet arXiv_CL arXiv_CL  Embedding  Bert  Classification  Prediction  PDF
• 2021-09-15 Efficient Domain Adaptation of Language Models via Adaptive Tokenization    Vin Sachidananda, Jason S. Kessler, Yi-an Lai arXiv_CL arXiv_CL  Embedding  Bert  Pose  Inference  Language_Model  PDF
• 2021-09-15 Can Machines Read Coding Manuals Yet? -- A Benchmark for Building Better Language Models for Code Understanding    Ibrahim Abdelaziz, Julian Dolby, Jamie McCusker, Kavitha Srinivas arXiv_AI arXiv_AI  Bert  Language_Model  PDF
• 2021-09-15 SupCL-Seq: Supervised Contrastive Learning for Downstream Optimized Sequence Representations    Hooman Sedghamiz, Shivam Raval, Enrico Santus, Tuka Alhanai, Mohammad Ghassemi arXiv_CL arXiv_CL  Transformer  Bert  Optimization  Self-Supervised  Contrastive_Learning  Classification  Language_Model  PDF
• 2021-09-15 BERT is Robust! A Case Against Synonym-Based Adversarial Examples in Text Classification    Jens Hauser, Zhao Meng, Damián Pascual, Roger Wattenhofer arXiv_CL arXiv_CL  Bert  Text_Classification  Adversarial  Classification  PDF
• 2021-09-15 Topic Transferable Table Question Answering    Saneem Ahmed Chemmengath, Vishwajeet Kumar, Samarth Bharadwaj, Jaydeep Sen, Mustafa Canim, Soumen Chakrabarti, Alfio Gliozzo, Karthik Sankaranarayanan arXiv_AI arXiv_AI  Transformer  Bert  Pose  QA  PDF
• 2021-09-15 What Vision-Language Models `See' when they See Scenes    Michele Cafagna, Kees van Deemter, Albert Gatt arXiv_CL arXiv_CL  Bert  Language_Model  PDF
• 2021-09-15 Enhancing Clinical Information Extraction with Transferred Contextual Embeddings    Zimin Wan, Chenchen Xu, Hanna Suominen arXiv_CL arXiv_CL  Transformer  Embedding  Transfer_Learning  Bert  Action  Deep_Learning  Medical  PDF
• 2021-09-15 The Unreasonable Effectiveness of the Baseline: Discussing SVMs in Legal Text Classification    Benjamin Clavié, Marc Alphonsus arXiv_CL arXiv_CL  Bert  Text_Classification  Classification  Deep_Learning  PDF
• 2021-09-15 {E}fficient{BERT}: Progressively Searching Multilayer Perceptron via Warm-up Knowledge Distillation    Chenhe Dong, Guangrun Wang, Hang Xu, Jiefeng Peng, Xiaozhe Ren, Xiaodan Liang arXiv_AI arXiv_AI  Bert  Optimization  Knowledge  Pose  Attention  Inference  Language_Model  PDF
• 2021-09-15 Transformer-based Language Models for Factoid Question Answering at BioASQ9b    Urvashi Khanna, Diego Mollá arXiv_CL arXiv_CL  Transformer  Bert  Medical  Language_Model  PDF
• 2021-09-15 Learning to Match Job Candidates Using Multilingual Bi-Encoder BERT    Dor Lavi arXiv_CL arXiv_CL  Transformer  Bert  PDF
• 2021-09-15 On the Universality of Deep COntextual Language Models    Shaily Bhatt, Poonam Goyal, Sandipan Dandapat, Monojit Choudhury, Sunayana Sitaram arXiv_CL arXiv_CL  Bert  Zero-Shot  Survey  Language_Model  PDF
• 2021-09-15 Towards Document-Level Paraphrase Generation with Sentence Rewriting and Reordering    Zhe Lin, Yitao Cai, Xiaojun Wan arXiv_AI arXiv_AI  Bert  Pose  Relation  PDF
• 2021-09-14 Frequency Effects on Syntactic Rule Learning in Transformers    Jason Wei, Dan Garrette, Tal Linzen, Ellie Pavlick arXiv_CL arXiv_CL  Transformer  Bert  Inference  Language_Model  Prediction  PDF
• 2021-09-14 Koopman Linearization for Data-Driven Batch State Estimation of Control-Affine Systems    Zi Cong Guo, Vassili Korotkine, James R. Forbes, Timothy D. Barfoot arXiv_RO arXiv_RO  Embedding  Bert  Knowledge  Inference  PDF
• 2021-09-14 Explainable Identification of Dementia from Transcripts using Transformer Networks    Loukas Ilias, Dimitris Askounis arXiv_CL arXiv_CL  Transformer  Bert  Pose  Face  Classification  Detection  Relation  Prediction  PDF
• 2021-09-14 On the Language-specificity of Multilingual BERT and the Impact of Fine-tuning    Marc Tanti, Lonneke van der Plas, Claudia Borg, Albert Gatt arXiv_CL arXiv_CL  Bert  Knowledge  Adversarial  Relation  GAN  Inference  PDF
• 2021-09-14 Legal Transformer Models May Not Always Help    Sakbo Geng, Rémi Lebret, Karl Aberer arXiv_CL arXiv_CL  Transformer  Bert  Deep_Learning  Language_Model  PDF
• 2021-09-14 Broaden the Vision: Geo-Diverse Visual Commonsense Reasoning    Da Yin, Liunian Harold Li, Ziniu Hu, Nanyun Peng, Kai-Wei Chang arXiv_AI arXiv_AI  Recognition  Bert  Knowledge  Language_Model  QA  PDF
• 2021-09-14 Evaluating Biomedical BERT Models for Vocabulary Alignment at Scale in the UMLS Metathesaurus    Goonmeet Bajaj, Vinh Nguyen, Thilini Wijesiriwardene, Hong Yung Yip, Vishesh Javangula, Srinivasan Parthasarathy, Amit Sheth, Olivier Bodenreider arXiv_CL arXiv_CL  Transformer  Embedding  Bert  RNN  Action  Medical  Prediction  PDF
• 2021-09-14 What are the attackers doing now? Automating cyber threat intelligence extraction from text on pace with the changing threat landscape: A survey    Md Rayhanur Rahman, Rezvan Mahdavi-Hezaveh, Laurie Williams arXiv_CL arXiv_CL  Unsupervised  Recognition  Bert  Knowledge  Pose  Survey  Action  Classification  PDF
• 2021-09-14 Semantic Answer Type Prediction using BERT: IAI at the ISWC SMART Task 2020    Vinay Setty, Krisztian Balog arXiv_AI arXiv_AI  Transformer  Bert  Text_Classification  Classification  Detection  Prediction  PDF
• 2021-09-14 KFCNet: Knowledge Filtering and Contrastive Learning Network for Generative Commonsense Reasoning    Haonan Li, Yeyun Gong, Jian Jiao, Ruofei Zhang, Timothy Baldwin, Nan Duan arXiv_CL arXiv_CL  Bert  Knowledge  Pose  Contrastive_Learning  Language_Model  PDF
• 2021-09-14 Learning Bill Similarity with Annotated and Augmented Corpora of Bills    Jiseon Kim, Elden Griggs, In Song Kim, Alice Oh arXiv_CL arXiv_CL  OCR  Bert  Pose  Classification  Relation  PDF
• 2021-09-14 Tribrid: Stance Classification with Neural Inconsistency Detection    Song Yang, Jacopo Urbani arXiv_CL arXiv_CL  Bert  Weakly_Supervised  Pose  Classification  Detection  Prediction  PDF
• 2021-09-14 conSultantBERT: Fine-tuned Siamese Sentence-BERT for Matching Jobs and Job Seekers    Dor Lavi, Volodymyr Medentsiy, David Graus arXiv_CL arXiv_CL  Embedding  Unsupervised  Bert  Matching  PDF
• 2021-09-14 YES SIR!Optimizing Semantic Space of Negatives with Self-Involvement Ranker    Ruizhi Pu, Xinyu Zhang, Ruofei Lai, Zikai Guo, Yinxia Zhang, Hao Jiang, Yongkang Wu, Yantao Jia, Zhicheng Dou, Zhao Cao arXiv_CL arXiv_CL  Bert  Pose  PDF
• 2021-09-14 Exploring Personality and Online Social Engagement: An Investigation of MBTI Users on Twitter    Partha Kadambi arXiv_CL arXiv_CL  Bert  Survey  Deep_Learning  Prediction  PDF
• 2021-09-13 Old BERT, New Tricks: Artificial Language Learning for Pre-Trained Language Models    Lisa Bylinina, Alexey Tikhonov, Ekaterina Garmash arXiv_CL arXiv_CL  Bert  Relation  Language_Model  PDF
• 2021-09-13 Evaluating Transferability of BERT Models on Uralic Languages    Judit Ács, Dániel Lévai, András Kornai arXiv_CL arXiv_CL  Transformer  Bert  Optimization  Language_Model  PDF
• 2021-09-13 A Massively Multilingual Analysis of Cross-linguality in Shared Embedding Space    Alex Jones, William Yang Wang, Kyle Mahowald arXiv_AI arXiv_AI  Segmentation  Embedding  Bert  Zero-Shot  RNN  Language_Model  PDF
• 2021-09-13 Phrase-BERT: Improved Phrase Embeddings from BERT with an Application to Corpus Exploration    Shufan Wang, Laure Thompson, Mohit Iyyer arXiv_CL arXiv_CL  Embedding  Bert  Pose  PDF
• 2021-09-13 KroneckerBERT: Learning Kronecker Decomposition for Pre-trained Language Models via Knowledge Distillation    Marzieh S. Tahaei, Ella Charlaix, Vahid Partovi Nia, Ali Ghodsi, Mehdi Rezagholizadeh arXiv_AI arXiv_AI  Transformer  Embedding  Bert  Knowledge  Pose  Attention  Language_Model  PDF
• 2021-09-13 Traffic Event Detection as a Slot Filling Problem    Xiangyu Yang, Giannis Bekoulis, Nikos Deligiannis arXiv_CL arXiv_CL  Transfer_Learning  Bert  Text_Classification  Pose  Classification  Detection  PDF
• 2021-09-13 Keyword Extraction for Improved Document Retrieval in Conversational Search    Oleg Borisov, Mohammad Aliannejadi, Fabio Crestani arXiv_CL arXiv_CL  Bert  Pose  Action  PDF
• 2021-09-13 Not All Models Localize Linguistic Knowledge in the Same Place: A Layer-wise Probing on BERToids' Representations    Mohsen Fayyaz, Ehsan Aghazadeh, Ali Modarressi, Hosein Mohebbi, Mohammad Taher Pilehvar arXiv_AI arXiv_AI  Bert  Knowledge  PDF
• 2021-09-13 Question Answering over Electronic Devices: A New Benchmark Dataset and a Multi-Task Learning based QA Framework    Abhilash Nandy, Soumya Sharma, Shubham Maddhashiya, Kapil Sachdeva, Pawan Goyal, Niloy Ganguly arXiv_CL arXiv_CL  Bert  QA  PDF
• 2021-09-13 Exploring a Unified Sequence-To-Sequence Transformer for Medical Product Safety Monitoring in Social Media    Shivam Raval, Hooman Sedghamiz, Enrico Santus, Tuka Alhanai, Mohammad Ghassemi, Emmanuele Chersoni arXiv_CL arXiv_CL  Transformer  Bert  Zero-Shot  Pose  Action  Detection  Medical  PDF
• 2021-09-13 Effectiveness of Pre-training for Few-shot Intent Classification    Haode Zhang, Yuwei Zhang, Li-Ming Zhan, Jiaxin Chen, Guangyuan Shi, Xiao-Ming Wu, Albert Y.S. Lam arXiv_CL arXiv_CL  Bert  Classification  Detection  Few-Shot  Language_Model  PDF
• 2021-09-13 GradTS: A Gradient-Based Automatic Auxiliary Task Selection Method Based on Transformer Networks    Weicheng Ma, Renze Lou, Kai Zhang, Lili Wang, Soroush Vosoughi arXiv_CL arXiv_CL  Transformer  Bert  Classification  PDF
• 2021-09-13 Mitigating Language-Dependent Ethnic Bias in BERT    Jaimeen Ahn, Alice Oh arXiv_AI arXiv_AI  Bert  Pose  Language_Model  PDF
• 2021-09-12 RockNER: A Simple Method to Create Adversarial Examples for Evaluating the Robustness of Named Entity Recognition Models    Bill Yuchen Lin, Wenyang Gao, Jun Yan, Ryan Moreno, Xiang Ren arXiv_CL arXiv_CL  Recognition  Bert  Adversarial  Pose  Language_Model  PDF
• 2021-09-11 The Impact of Positional Encodings on Multilingual Compression    Vinit Ravishankar, Anders Søgaard arXiv_CL arXiv_CL  Transformer  Embedding  Bert  Knowledge  Pose  Attention  Language_Model  PDF
• 2021-09-11 COSMic: A Coherence-Aware Generation Metric for Image Descriptions    Mert İnan, Piyush Sharma, Baber Khalid, Radu Soricut, Matthew Stone, Malihe Alikhani arXiv_AI arXiv_AI  Image_Caption  Bert  Pose  Relation  Text_Generation  Caption  PDF
• 2021-09-11 Multilingual Translation via Grafting Pre-trained Language Models    Zewei Sun, Mingxuan Wang, Lei Li arXiv_CL arXiv_CL  Transformer  Bert  Self-Supervised  Pose  Attention  Language_Model  PDF
• 2021-09-11 TopicRefine: Joint Topic Prediction and Dialogue Response Generation for Multi-turn End-to-End Dialogue System    Hongru Wang, Mingyu Cui, Zimo Zhou, Gabriel Pui Cheong Fung, Kam-Fai Wong arXiv_AI arXiv_AI  Bert  Pose  Attention  Prediction  PDF
• 2021-09-11 College Student Retention Risk Analysis From Educational Database using Multi-Task Multi-Modal Neural Fusion    Mohammad Arif Ul Alam arXiv_CL arXiv_CL  Transformer  Embedding  Bert  RNN  Pose  PDF
• 2021-09-10 D-REX: Dialogue Relation Extraction with Explanations    Alon Albalak, Varun Embar, Yi-Lin Tuan, Lise Getoor, William Yang Wang arXiv_CL arXiv_CL  Bert  Pose  Action  Relation  Relation_Extraction  Inference  PDF
• 2021-09-10 FBERT: A Neural Transformer for Identifying Offensive Content    Diptanu Sarkar, Marcos Zampieri, Tharindu Ranasinghe, Alexander Ororbia arXiv_AI arXiv_AI  Transformer  Bert  Speech  PDF
• 2021-09-10 Trajectory Optimization with Optimization-Based Dynamics    Taylor A. Howell, Simon Le Cleac'h, Sumeet Singh, Pete Florence, Zachary Manchester, Vikas Sindhwani arXiv_RO arXiv_RO  Bert  Optimization  PDF
• 2021-09-10 Examining Cross-lingual Contextual Embeddings with Orthogonal Structural Probes    Tomasz Limisiewicz, David Mareček arXiv_AI arXiv_AI  Embedding  Bert  Zero-Shot  Few-Shot  Language_Model  PDF
• 2021-09-10 ReasonBERT: Pre-trained to Reason with Distant Supervision    Xiang Deng, Yu Su, Alyssa Lees, You Wu, Cong Yu, Huan Sun arXiv_AI arXiv_AI  Bert  Pose  Relation  Few-Shot  Language_Model  PDF
• 2021-09-10 Active learning for reducing labeling effort in text classification tasks    Pieter Floris Jacobs, Gideon Maillette de Buy Wenniger, Marco Wiering, Lambert Schomaker arXiv_CL arXiv_CL  Bert  Text_Classification  Pose  Classification  Deep_Learning  Sentiment  PDF
• 2021-09-10 Block Pruning For Faster Transformers    François Lagunas, Ella Charlaix, Victor Sanh, Alexander M. Rush arXiv_CL arXiv_CL  Transformer  Bert  Classification  Attention  Inference  PDF
• 2021-09-10 Artificial Text Detection via Examining the Topology of Attention Maps    Laida Kushnareva, Daniil Cherniavskii, Vladislav Mikhailov, Ekaterina Artemova, Serguei Barannikov, Alexander Bernstein, Irina Piontkovskaya, Dmitri Piontkovski, Evgeny Burnaev arXiv_CL arXiv_CL  Bert  Review  Pose  Face  Detection  Attention  PDF
• 2021-09-10 Does It Capture STEL? A Modular, Similarity-based Linguistic Style Evaluation Framework    Anna Wegmann, Dong Nguyen arXiv_CL arXiv_CL  Bert  Pose  PDF
• 2021-09-10 Mixture-of-Partitions: Infusing Large Biomedical Knowledge Graphs into BERT    Zaiqiao Meng, Fangyu Liu, Thomas Hikaru Clark, Ehsan Shareghi, Nigel Collier arXiv_CL arXiv_CL  Bert  Knowledge  Knowledge_Graph  Pose  Classification  Medical  QA  PDF
• 2021-09-10 RoR: Read-over-Read for Long Document Machine Reading Comprehension    Jing Zhao, Junwei Bao, Yifan Wang, Yongwei Zhou, Youzheng Wu, Xiaodong He, Bowen Zhou arXiv_CL arXiv_CL  Transformer  Bert  Pose  Prediction  QA  PDF
• 2021-09-10 Automated Machine Learning, Bounded Rationality, and Rational Metareasoning    Eyke Hüllermeier, Felix Mohr, Alexander Tornede, Marcel Wever arXiv_AI arXiv_AI  Bert  Action  PDF
• 2021-09-10 AutoTriggER: Named Entity Recognition with Auxiliary Trigger Extraction    Dong-Ho Lee, Ravi Kiran Selvam, Sheikh Muhammad Sarwar, Bill Yuchen Lin, Mahak Agarwal, Fred Morstatter, Jay Pujara, Elizabeth Boschee, James Allan, Xiang Ren arXiv_CL arXiv_CL  Recognition  Bert  Action  PDF
• 2021-09-10 Euphemistic Phrase Detection by Masked Language Model    Wanzheng Zhu, Suma Bhat arXiv_CL arXiv_CL  Embedding  Bert  Detection  GAN  Language_Model  PDF
• 2021-09-10 Query-driven Segment Selection for Ranking Long Documents    Youngwoo Kim, Razieh Rahimi, Hamed Bonab, James Allan arXiv_CL arXiv_CL  Transformer  Bert  Pose  Attention  PDF
• 2021-09-10 IndoBERTweet: A Pretrained Language Model for Indonesian Twitter with Effective Domain-Specific Vocabulary Initialization    Fajri Koto, Jey Han Lau, Timothy Baldwin arXiv_CL arXiv_CL  Embedding  Bert  Pose  Language_Model  PDF
• 2021-09-10 How May I Help You? Using Neural Text Simplification to Improve Downstream NLP Tasks    Hoang Van, Zheng Tang, Mihai Surdeanu arXiv_CL arXiv_CL  Bert  RNN  Action  Relation  Relation_Extraction  Inference  Prediction  PDF
• 2021-09-10 Augmenting BERT-style Models with Predictive Coding to Improve Discourse-level Representations    Vladimir Araujo, Andrés Villa, Marcelo Mendoza, Marie-Francine Moens, Alvaro Soto arXiv_CL arXiv_CL  Bert  Knowledge  Self-Supervised  Pose  Detection  Relation  Language_Model  PDF
• 2021-09-09 BERT, mBERT, or BiBERT? A Study on Contextualized Embeddings for Neural Machine Translation    Haoran Xu, Benjamin Van Durme, Kenton Murray arXiv_CL arXiv_CL  Embedding  Bert  Pose  NMT  Language_Model  PDF
• 2021-09-09 Vision-and-Language or Vision-for-Language? On Cross-Modal Influence in Multimodal Transformers    Stella Frank, Emanuele Bugliarello, Desmond Elliott arXiv_CV arXiv_CV  Transformer  Bert  Pose  Language_Model  Prediction  PDF
• 2021-09-09 All Bark and No Bite: Rogue Dimensions in Transformer Language Models Obscure Representational Quality    William Timkey, Marten van Schijndel arXiv_CL arXiv_CL  Transformer  Embedding  Bert  Language_Model  PDF
• 2021-09-09 ESimCSE: Enhanced Sample Building Method for Contrastive Learning of Unsupervised Sentence Embedding    Xing Wu, Chaochen Gao, Liangjun Zang, Jizhong Han, Zhongyuan Wang, Songlin Hu arXiv_AI arXiv_AI  Transformer  Embedding  Unsupervised  Bert  Pose  Contrastive_Learning  Relation  Attention  PDF
• 2021-09-09 Multi-granularity Textual Adversarial Attack with Behavior Cloning    Yangyi Chen, Jin Su, Wei Wei arXiv_CL arXiv_CL  Bert  RNN  Knowledge  Adversarial  Pose  PDF
• 2021-09-09 Smoothed Contrastive Learning for Unsupervised Sentence Embedding    Xing Wu, Chaochen Gao, Liangjun Zang, Jizhong Han, Zhongyuan Wang, Songlin Hu arXiv_AI arXiv_AI  Embedding  Unsupervised  Bert  Pose  Contrastive_Learning  Relation  PDF
• 2021-09-09 Generalised Unsupervised Domain Adaptation of Neural Machine Translation with Cross-Lingual Data Selection    Thuy-Trang Vu, Xuanli He, Dinh Phung, Gholamreza Haffari arXiv_CL arXiv_CL  Unsupervised  Bert  Zero-Shot  Pose  Contrastive_Learning  NMT  PDF
• 2021-09-09 KELM: Knowledge Enhanced Pre-Trained Language Representations with Message Passing on Hierarchical Relational Graphs    Yinquan Lu, Haonan Lu, Guirong Fu, Qun Liu arXiv_AI arXiv_AI  Bert  Knowledge  Knowledge_Graph  Pose  Relation  Language_Model  PDF
• 2021-09-09 Word-Level Coreference Resolution    Vladimir Dobrovolskii arXiv_CL arXiv_CL  Bert  Pose  PDF
• 2021-09-09 ARMAN: Pre-training with Semantically Selecting and Reordering of Sentences for Persian Abstractive Summarization    Alireza Salemi, Emad Kebriaei, Ghazal Neisi Minaei, Azadeh Shakery arXiv_CL arXiv_CL  Transformer  Bert  Salient  Pose  Attention  Summarization  Language_Model  PDF
• 2021-09-08 Unsupervised Pre-training with Structured Knowledge for Improving Natural Language Inference    Xiaoyu Yang, Xiaodan Zhu, Zhan Shi, Tianda Li arXiv_AI arXiv_AI  Unsupervised  Bert  Knowledge  Pose  Classification  Inference  PDF
• 2021-09-08 Transformers in the loop: Polarity in neural models of language    Lisa Bylinina, Alexey Tikhonov arXiv_CL arXiv_CL  Transformer  Bert  Pose  Language_Model  Prediction  PDF
• 2021-09-08 Ensemble Fine-tuned mBERT for Translation Quality Estimation    Shaika Chowdhury, Naouel Baili, Brian Vannah arXiv_CL arXiv_CL  Bert  Zero-Shot  Pose  Relation  PDF
• 2021-09-08 Forget me not: A Gentle Reminder to Mind the Simple Multi-Layer Perceptron Baseline for Text Classification    Lukas Galke, Ansgar Scherp arXiv_CL arXiv_CL  Bert  Text_Classification  Classification  Recommendation  PDF
• 2021-09-08 Sustainable Modular Debiasing of Language Models    Anne Lauscher, Tobias Lüken, Goran Glavaš arXiv_CL arXiv_CL  Bert  Knowledge  Pose  Language_Model  PDF
• 2021-09-08 Biomedical and Clinical Language Models for Spanish: On the Benefits of Domain-Specific Pretraining in a Mid-Resource Scenario    Casimiro Pio Carrino, Jordi Armengol-Estapé, Asier Gutiérrez-Fandiño, Joan Llop-Palao, Marc Pàmies, Aitor Gonzalez-Agirre, Marta Villegas arXiv_CL arXiv_CL  Transformer  Recognition  Bert  Knowledge  Medical  Language_Model  PDF
• 2021-09-08 NSP-BERT: A Prompt-based Zero-Shot Learner Through an Original Pre-training Task--Next Sentence Prediction    Yi Sun, Yu Zheng, Chao Hao, Hangping Qiu arXiv_AI arXiv_AI  Bert  Zero-Shot  Few-Shot  Language_Model  Prediction  PDF
• 2021-09-07 Beyond Preserved Accuracy: Evaluating Loyalty and Robustness of BERT Compression    Canwen Xu, Wangchunshu Zhou, Tao Ge, Ke Xu, Julian McAuley, Furu Wei arXiv_AI arXiv_AI  Quantization  Bert  Knowledge  Adversarial  Pose  Language_Model  PDF
• 2021-09-07 ExCode-Mixed: Explainable Approaches towards Sentiment Analysis on Code-Mixed Data using BERT models    Aman Priyanshu, Aleti Vardhan, Sudarshan Sivakumar, Supriti Vijay, Nipuna Chhabra arXiv_AI arXiv_AI  Bert  Pose  Sentiment  Prediction  PDF
• 2021-09-07 How much pretraining data do language models need to learn syntax?    Laura Pérez-Mayos, Miguel Ballesteros, Leo Wanner arXiv_CL arXiv_CL  Transformer  Bert  Knowledge  Speech  Language_Model  PDF
• 2021-09-07 FHAC at GermEval 2021: Identifying German toxic, engaging, and fact-claiming comments with ensemble learning    Tobias Bornheim, Niklas Grieger, Stephan Bialonski arXiv_CL arXiv_CL  Bert  Face  Classification  PDF
• 2021-09-07 Empathetic Dialogue Generation with Pre-trained RoBERTa-GPT2 and External Knowledge    Ye Liu, Wolfgang Maier, Wolfgang Minker, Stefan Ultes arXiv_AI arXiv_AI  Bert  Knowledge  Pose  Emotion  PDF
• 2021-09-07 Don't Go Far Off: An Empirical Study on Neural Poetry Translation    Tuhin Chakrabarty, Arkadiy Saakyan, Smaranda Muresan arXiv_CL arXiv_CL  Bert  Zero-Shot  PDF
• 2021-09-07 Naturalness Evaluation of Natural Language Generation in Task-oriented Dialogues using BERT    Ye Liu, Wolfgang Maier, Wolfgang Minker, Stefan Ultes arXiv_CL arXiv_CL  Transfer_Learning  Bert  RNN  Knowledge  Pose  PDF
• 2021-09-07 Data Driven Content Creation using Statistical and Natural Language Processing Techniques for Financial Domain    Ankush Chopra, Prateek Nagwanshi, Sohom Ghosh arXiv_CL arXiv_CL  Bert  RNN  Pose  Action  GAN  PDF
• 2021-09-07 Few-shot Learning via Dependency Maximization and Instance Discriminant Analysis    Zejiang Hou, Sun-Yuan Kung arXiv_AI arXiv_AI  Bert  Pose  Few-Shot  Prediction  PDF
• 2021-09-06 Does BERT Learn as Humans Perceive? Understanding Linguistic Styles through Lexica    Shirley Anugrah Hayati, Dongyeop Kang, Lyle Ungar arXiv_CL arXiv_CL  Bert  Emotion  Sentiment  Prediction  PDF
• 2021-09-06 SS-BERT: Mitigating Identity Terms Bias in Toxic Comment Classification by Utilising the Notion of 'Subjectivity' and 'Identity Terms'    Zhixue Zhao, Ziqi Zhang, Frank Hopfgartner arXiv_CL arXiv_CL  Bert  Pose  Classification  Prediction  PDF
• 2021-09-06 Enhancing Language Models with Plug-and-Play Large-Scale Commonsense    Wanyun Cui, Xingran Chen arXiv_CL arXiv_CL  Transformer  Embedding  Bert  Represenation_Learning  Knowledge  Knowledge_Graph  Pose  Language_Model  PDF
• 2021-09-06 GPT-3 Models are Poor Few-Shot Learners in the Biomedical Domain    Milad Moradi, Kathrin Blagec, Florian Haberl, Matthias Samwald arXiv_AI arXiv_AI  Transformer  Transfer_Learning  Bert  Knowledge  Few-Shot  Medical  Language_Model  PDF
• 2021-09-06 BERT might be Overkill: A Tiny but Effective Biomedical Entity Linker based on Residual Convolutional Neural Networks    Tuan Lai, Heng Ji, ChengXiang Zhai arXiv_AI arXiv_AI  Bert  Sparse  Knowledge  Pose  Attention  Medical  CNN  PDF
• 2021-09-06 Nearest Neighbour Few-Shot Learning for Cross-lingual Classification    M Saiful Bari, Batool Haider, Saab Mansour arXiv_CL arXiv_CL  Bert  Classification  Few-Shot  Inference  PDF
• 2021-09-04 FewshotQA: A simple framework for few-shot learning of question answering tasks using pre-trained text-to-text models    Rakesh Chada, Pradeep Natarajan arXiv_AI arXiv_AI  Bert  Pose  Few-Shot  QA  PDF
• 2021-09-04 Self-Supervised Detection of Contextual Synonyms in a Multi-Class Setting: Phenotype Annotation Use Case    Jingqing Zhang, Luis Bolanos, Tong Li, Ashwani Tanwar, Guilherme Freire, Xian Yang, Julia Ive, Vibhor Gupta, Yike Guo arXiv_CL arXiv_CL  Embedding  Unsupervised  Bert  Sparse  Self-Supervised  Pose  Action  Deep_Learning  Detection  Matching  PDF
• 2021-09-04 Uncovering the Limits of Text-based Emotion Detection    Nurudin Alvarez-Gonzalez, Andreas Kaltenbrunner, Vicenç Gómez arXiv_CL arXiv_CL  Bert  Emotion  Face  Classification  Detection  PDF
• 2021-09-04 Supervised Contrastive Learning for Multimodal Unreliable News Detection in COVID-19 Pandemic    Wenjia Zhang, Lin Gui, Yulan He arXiv_CL arXiv_CL  Embedding  Bert  Pose  Contrastive_Learning  Detection  PDF
• 2021-09-04 Frustratingly Simple Pretraining Alternatives to Masked Language Modeling    Atsuki Yamaguchi, George Chrysostomou, Katerina Margatina, Nikolaos Aletras arXiv_AI arXiv_AI  Bert  Self-Supervised  Pose  Classification  Language_Model  Prediction  PDF
• 2021-09-04 Error Detection in Large-Scale Natural Language Understanding Systems Using Transformer Models    Rakesh Chada, Pradeep Natarajan, Darshan Fofadiya, Prathap Ramachandra arXiv_AI arXiv_AI  Transformer  Recognition  Bert  RNN  Classification  Detection  PDF
• 2021-09-03 Cross-Lingual Training with Dense Retrieval for Document Retrieval    Peng Shi, Rui Zhang, He Bai, Jimmy Lin arXiv_CL arXiv_CL  Bert  Zero-Shot  PDF
• 2021-09-03 An Exploratory Study on Utilising the Web of Linked Data for Product Data Mining    Ziqi Zhang, Xingyi Song arXiv_AI arXiv_AI  Embedding  Bert  Classification  Language_Model  PDF
• 2021-09-03 A Context-Aware Hierarchical BERT Fusion Network for Multi-turn Dialog Act Detection    Ting-Wei Wu, Ruolin Su, Biing-Hwang Juang arXiv_CL arXiv_CL  Bert  Pose  Detection  PDF
• 2021-09-02 So Cloze yet so Far: N400 Amplitude is Better Predicted by Distributional Information than Human Predictability Judgements    James A. Michaelov, Seana Coulson, Benjamin K. Bergen arXiv_AI arXiv_AI  Bert  Face  Language_Model  Prediction  PDF
• 2021-09-02 Establishing Interlingua in Multilingual Language Models    Maksym Del, Mark Fishel arXiv_CL arXiv_CL  Bert  Zero-Shot  Relation  Language_Model  PDF
• 2021-09-02 A New Semi-Automated Algorithm for Volumetric Segmentation of the Left Ventricle in Temporal 3D Echocardiography Sequences    Deepa Krishnaswamy (1 and 2), Abhilash R. Hareendranathan (1 and 2), Tan Suwatanaviroj (4), Pierre Boulanger (1 and 2 and 3), Harald Becher (4), Michelle Noga (1 and 2), Kumaradevan Punithakumar (1 and 2 and 3) ((1) Department of Radiology and Diagnostic Imaging, University of Alberta, Edmonton, AB, Canada, (2) Servier Virtual Cardiac Centre, Mazankowski Alberta Heart Institute, Edmonton, AB, Canada, (3) Department of Computing Science, University of Alberta, Edmonton, AB, Canada, (4) ABACUS, Mazankowski Alberta Heart Institute, Edmonton, AB, Canada) arXiv_CV arXiv_CV  Segmentation  3D  Bert  Pose  Action  PDF
• 2021-09-02 TravelBERT: Pre-training Language Model Incorporating Domain-specific Heterogeneous Knowledge into A Unified Representation    Hongyin Zhu, Hao Peng, Zhiheng Lv, Lei Hou, Juanzi Li, Jinghui Xiao arXiv_CL arXiv_CL  Bert  Knowledge  Knowledge_Graph  Pose  Classification  Relation  Language_Model  Matching  PDF
• 2021-09-02 LegaLMFiT: Efficient Short Legal Text Classification with LSTM Language Model Pre-Training    Benjamin Clavié, Akshita Gheewala, Paul Briton, Marc Alphonsus, Rym Labiyaad, Francesco Piccoli arXiv_CL arXiv_CL  Transformer  Bert  Text_Classification  RNN  Classification  Language_Model  PDF
• 2021-09-02 MultiEURLEX - A multi-lingual and multi-label legal document classification dataset for zero-shot cross-lingual transfer    Ilias Chalkidis, Manos Fergadiotis, Ion Androutsopoulos arXiv_CL arXiv_CL  Bert  Zero-Shot  Knowledge  Pose  Classification  PDF
• 2021-09-02 CodeT5: Identifier-aware Unified Pre-trained Encoder-Decoder Models for Code Understanding and Generation    Yue Wang, Weishi Wang, Shafiq Joty, Steven C.H. Hoi arXiv_CL arXiv_CL  Transformer  Bert  Pose  Detection  PDF
• 2021-09-02 Imposing Relation Structure in Language-Model EmbeddingsUsing Contrastive Learning    Christos Theodoropoulos, James Henderson, Andrei C. Coman, Marie-Francine Moens arXiv_AI arXiv_AI  Embedding  Recognition  Bert  Pose  Contrastive_Learning  Action  Relation  Relation_Extraction  Language_Model  PDF
• 2021-09-02 MemBERT: Injecting Unstructured Knowledge into BERT    Federico Ruggeri, Marco Lippi, Paolo Torroni arXiv_AI arXiv_AI  Transformer  Enhancement  Bert  Knowledge  Pose  PDF
• 2021-09-02 Multi-Modal Zero-Shot Sign Language Recognition    Razieh Rastgoo, Kourosh Kiani, Sergio Escalera, Mohammad Sabokrou arXiv_CV arXiv_CV  Transformer  Embedding  Recognition  3D  Bert  Zero-Shot  RNN  Pose  Action  Detection  PDF
• 2021-09-02 ConQX: Semantic Expansion of Spoken Queries for Intent Detection based on Conditioned Text Generation    Eyup Halit Yilmaz, Cagri Toraman arXiv_AI arXiv_AI  Bert  Zero-Shot  Pose  Detection  Few-Shot  Text_Generation  Language_Model  PDF
• 2021-09-01 Fight Fire with Fire: Fine-tuning Hate Detectors using Large Samples of Generated Hate Speech    Tomer Wullach, Amir Adler, Einat Minkov arXiv_AI arXiv_AI  Bert  Speech  Detection  Object_Detection  Language_Model  PDF
• 2021-09-01 DILBERT: Customized Pre-Training for Domain Adaptation withCategory Shift, with an Application to Aspect Extraction    Entony Lekhtman, Yftah Ziser, Roi Reichart arXiv_CL arXiv_CL  Unsupervised  Bert  Review  Action  Language_Model  PDF
• 2021-09-01 Towards Improving Adversarial Training of NLP Models    Jin Yong Yoo, Yanjun Qi arXiv_AI arXiv_AI  Bert  Adversarial  Pose  PDF
• 2021-09-01 M^2-MedDialog: A Dataset and Benchmarks for Multi-domain Multi-service Medical Dialogues    Guojun Yan, Jiahuan Pei, Pengjie Ren, Zhumin Chen, Zhaochun Ren, Huasheng Liang arXiv_AI arXiv_AI  Bert  Knowledge  Pose  Medical  Language_Model  PDF
• 2021-09-01 Exploring deep learning methods for recognizing rare diseases and their clinical manifestations from texts    Isabel Segura-Bedmar, David Camino-Perdonas, Sara Guerrero-Aspizua arXiv_CL arXiv_CL  Transformer  Bert  RNN  Knowledge  Deep_Learning  Medical  PDF
• 2021-09-01 OptAGAN: Entropy-based finetuning on text VAE-GAN    Paolo Tirotta, Stefano Lodi arXiv_CL arXiv_CL  Transfer_Learning  Reinforcement_Learning  Bert  GAN  Text_Generation  PDF
• 2021-08-31 MergeBERT: Program Merge Conflict Resolution via Neural Transformers    Alexey Svyatkovskiy, Todd Mytcowicz, Negar Ghorbani, Sarah Fakhoury, Elizabeth Dinella, Christian Bird, Neel Sundaresan, Shuvendu Lahiri arXiv_CL arXiv_CL  Transformer  Bert  Zero-Shot  Classification  PDF
• 2021-08-31 Effectiveness of Deep Networks in NLP using BiDAF as an example architecture    Soumyendu Sarkar arXiv_CL arXiv_CL  Embedding  Bert  Language_Model  PDF
• 2021-08-31 Sense representations for Portuguese: experiments with sense embeddings and deep neural language models    Jessica Rodrigues da Silva, Helena de Medeiros Caseli arXiv_CL arXiv_CL  Embedding  Unsupervised  Transfer_Learning  Bert  Language_Model  PDF
• 2021-08-31 TREND: Trigger-Enhanced Relation-Extraction Network for Dialogues    Po-Wei Lin, Shang-Yu Su, Yun-Nung Chen arXiv_CL arXiv_CL  Bert  Pose  Action  Relation  Relation_Extraction  PDF
• 2021-08-31 Enjoy the Salience: Towards Better Transformer-based Faithful Explanations with Word Salience    George Chrysostomou, Nikolaos Aletras arXiv_CL arXiv_CL  Transformer  Bert  Salient  Attention  Prediction  PDF
• 2021-08-31 Monolingual versus Multilingual BERTology for Vietnamese Extractive Multi-Document Summarization    Huy To Quoc, Kiet Van Nguyen, Ngan Luu-Thuy Nguyen, Anh Gia-Tuan Nguyen arXiv_AI arXiv_AI  Bert  Summarization  PDF
• 2021-08-31 Automated Mining of Leaderboards for Empirical AI Research    Salomon Kabongo, Jennifer D'Souza, Sören Auer arXiv_AI arXiv_AI  Transformer  Bert  Knowledge  Knowledge_Graph  Face  Action  GAN  PDF
• 2021-08-31 Cross-Lingual Text Classification of Transliterated Hindi and Malayalam    Jitin Krishnan, Antonios Anastasopoulos, Hemant Purohit, Huzefa Rangwala arXiv_CL arXiv_CL  Bert  Sentiment_Classification  Text_Classification  Classification  Sentiment  Language_Model  PDF
• 2021-08-31 How Does Adversarial Fine-Tuning Benefit BERT?    Javid Ebrahimi, Hao Yang, Wei Zhang arXiv_AI arXiv_AI  Transfer_Learning  Bert  Regularization  Adversarial  Language_Model  PDF
• 2021-08-31 AraT5: Text-to-Text Transformers for Arabic Language Understanding and Generation    El Moatez Billah Nagoudi, Muhammad Abdul-Mageed, AbdelRahim Elmadany arXiv_CL arXiv_CL  Transformer  Transfer_Learning  Bert  Pose  PDF
• 2021-08-30 Improving Query Representations for Dense Retrieval with Pseudo Relevance Feedback    HongChien Yu, Chenyan Xiong, Jamie Callan arXiv_AI arXiv_AI  Embedding  Bert  Pose  Attention  PDF
• 2021-08-30 Knowledge Base Completion Meets Transfer Learning    Vid Kocijan, Thomas Lukasiewicz arXiv_CL arXiv_CL  Transfer_Learning  Bert  Knowledge  Action  Relation  Prediction  Matching  PDF
• 2021-08-30 Shatter: An Efficient Transformer Encoder with Single-Headed Self-Attention and Relative Sequence Partitioning    Ran Tian, Joshua Maynez, Ankur P. Parikh arXiv_CL arXiv_CL  Transformer  Bert  Attention  PDF
• 2021-08-29 Analyzing and Mitigating Interference in Neural Architecture Search    Jin Xu, Xu Tan, Kaitao Song, Renqian Luo, Yichong Leng, Tao Qin, Tie-Yan Liu, Jian Li arXiv_CL arXiv_CL  NAS  Bert  Optimization  Pose  Relation  PDF
• 2021-08-29 NoiER: An Approach for Training more Reliable Fine-TunedDownstream Task Models    Myeongjun Jang, Thomas Lukasiewicz arXiv_CL arXiv_CL  Bert  Self-Supervised  Pose  Detection  Language_Model  PDF
• 2021-08-28 DKM: Differentiable K-Means Clustering Layer for Neural Network Compression    Minsik Cho, Keivan A. Vahid, Saurabh Adya, Mohammad Rastegari arXiv_AI arXiv_AI  Bert  Optimization  Pose  Attention  Inference  PDF
• 2021-08-28 HeadlineCause: A Dataset of News Headlines for Detecting Casualties    Ilya Gusev, Alexey Tikhonov arXiv_CL arXiv_CL  Bert  Knowledge  Detection  Relation  Prediction  PDF
• 2021-08-28 Self-training Improves Pre-training for Few-shot Learning in Task-oriented Dialog Systems    Fei Mi, Wanhao Zhou, Fengyu Cai, Lingjing Kong, Minlie Huang, Boi Faltings arXiv_CL arXiv_CL  Tracking  Bert  Pose  Classification  Few-Shot  Language_Model  Prediction  PDF
• 2021-08-27 TweetBLM: A Hate Speech Dataset and Analysis of Black Lives Matter-related Microblogs on Twitter    Sumit Kumar, Raj Ratn Pranesh arXiv_CL arXiv_CL  Bert  RNN  Speech  Pose  Classification  PDF
• 2021-08-27 Automatic Text Evaluation through the Lens of Wasserstein Barycenters    Pierre Colombo, Guillaume Staerman, Chloe Clavel, Pablo Piantanida arXiv_AI arXiv_AI  Image_Caption  Embedding  Bert  Summarization  Text_Generation  Caption  PDF
• 2021-08-27 Lower-limb kinematics and kinetics during continuously varying human locomotion    Emma Reznick, Kyle R. Embry, Ross Neuman, Edgar Bolívar-Nieto, Nicholas P. Fey, Robert D. Gregg arXiv_RO arXiv_RO  Bert  PDF
• 2021-08-27 Evaluating the Robustness of Neural Language Models to Input Perturbations    Milad Moradi, Matthias Samwald arXiv_AI arXiv_AI  Bert  Language_Model  PDF
• 2021-08-27 Exploring the Capacity of a Large-scale Masked Language Model to Recognize Grammatical Errors    Ryo Nagata, Manabu Kimura, Kazuaki Hanawa arXiv_CL arXiv_CL  Bert  Knowledge  Detection  Language_Model  PDF
• 2021-08-27 Query-Focused Extractive Summarisation for Finding Ideal Answers to Biomedical and COVID-19 Questions    Diego Mollá (1 and 2), Urvashi Khanna (1), Dima Galat (1), Vincent Nguyen (2 and 3) Maciej Rybinski (3) ( (1) Macquarie University, (2) CSIRO Data61, (3) Australian National University) arXiv_CL arXiv_CL  Bert  Classification  Medical  PDF
• 2021-08-27 Harms of Gender Exclusivity and Challenges in Non-Binary Representation in Language Technologies    Sunipa Dev, Masoud Monajatipoor, Anaelia Ovalle, Arjun Subramonian, Jeff M Phillips, Kai-Wei Chang arXiv_AI arXiv_AI  Recognition  Bert  Knowledge  Survey  Language_Model  PDF
• 2021-08-26 Semantic-based Self-Critical Training For Question Generation    Loïc, Kwate Dassi arXiv_AI arXiv_AI  Transformer  Reinforcement_Learning  Bert  Relation  Text_Generation  Language_Model  PDF
• 2021-08-26 EmoBERTa: Speaker-Aware Emotion Recognition in Conversation with RoBERTa    Taewoon Kim, Piek Vossen arXiv_CL arXiv_CL  Recognition  Bert  Emotion  PDF
• 2021-08-26 A New Sentence Ordering Method Using BERT Pretrained Model    Melika Golestani, Seyedeh Zahra Razavi, Heshaam Faili arXiv_AI arXiv_AI  Embedding  Bert  Knowledge  Pose  PDF
• 2021-08-26 A Computational Approach to Measure Empathy and Theory-of-Mind from Written Texts    Yoon Kyung Lee, Inju Lee, Jae Eun Park, Yoonwon Jung, Jiwon Kim, Sowon Hahn arXiv_CL arXiv_CL  Transformer  Bert  Review  Pose  PDF
• 2021-08-26 SLIM: Explicit Slot-Intent Mapping with BERT for Joint Multi-Intent Detection and Slot Filling    Fengyu Cai, Wanhao Zhou, Fei Mi, Boi Faltings arXiv_AI arXiv_AI  Bert  Pose  Action  Detection  PDF
• 2021-08-26 Rethinking Why Intermediate-Task Fine-Tuning Works    Ting-Yun Chang, Chi-Jen Lu arXiv_CL arXiv_CL  Bert  Inference  Language_Model  PDF
• 2021-08-26 Scalable End-to-End Training of Knowledge Graph-Enhanced Aspect Embedding for Aspect Level Sentiment Analysis    Sk Mainul Islam, Sourangshu Bhattacharya arXiv_CL arXiv_CL  Embedding  Bert  Sentiment_Classification  Knowledge  Knowledge_Graph  Pose  Classification  Detection  Relation  Sentiment  PDF
• 2021-08-26 Understanding Attention in Machine Reading Comprehension    Yiming Cui, Wei-Nan Zhang, Wanxiang Che, Ting Liu, Zhigang Chen arXiv_AI arXiv_AI  Bert  Action  Quantitative  Relation  Attention  Language_Model  PDF
• 2021-08-25 Ontology-Enhanced Slot Filling    Yuhao Ding, Yik-Cheung Tam arXiv_CL arXiv_CL  Tracking  Bert  Ontology  Matching  PDF
• 2021-08-25 Exploring the Promises of Transformer-Based LMs for the Representation of Normative Claims in the Legal Domain    Reto Gubelmann (1), Peter Hongler (1), Siegfried Handschuh (1) ((1) University of St.Gallen (HSG)) arXiv_CL arXiv_CL  Transformer  Embedding  Bert  Language_Model  PDF
• 2021-08-25 Models In a Spelling Bee: Language Models Implicitly Learn the Character Composition of Tokens    Itay Itzhak, Omer Levy arXiv_AI arXiv_AI  Embedding  Bert  Pose  Language_Model  PDF
• 2021-08-24 Using BERT Encoding and Sentence-Level Language Model for Sentence Ordering    Melika Golestani, Seyedeh Zahra Razavi, Zeinab Borhanifard, Farnaz Tahmasebian, Hesham Faili arXiv_CL arXiv_CL  Transformer  Embedding  Bert  RNN  Pose  Attention  Summarization  Text_Generation  Language_Model  PDF
• 2021-08-24 SN Computer Science: Towards Offensive Language Identification for Tamil Code-Mixed YouTube Comments and Posts    Charangan Vasantharajan, Uthayasanker Thayasivam arXiv_CL arXiv_CL  Transformer  Transfer_Learning  Bert  RNN  Speech  Pose  Deep_Learning  Detection  PDF
• 2021-08-24 Greenformers: Improving Computation and Memory Efficiency in Transformer Models via Low-Rank Approximation    Samuel Cahyawijaya arXiv_AI arXiv_AI  Transformer  Bert  Pose  Deep_Learning  Prediction  PDF
• 2021-08-24 Weakly Supervised Cross-platform Teenager Detection with Adversarial BERT    Peiling Yi, Arkaitz Zubiaga arXiv_CL arXiv_CL  Bert  Weakly_Supervised  Knowledge  Adversarial  Pose  Detection  PDF
• 2021-08-23 Learning Sparse Analytic Filters for Piano Transcription    Frank Cwitkowitz, Mojtaba Heydari, Zhiyao Duan arXiv_SD arXiv_SD  Bert  Sparse  Action  Deep_Learning  CNN  PDF
• 2021-08-23 Deploying a BERT-based Query-Title Relevance Classifier in a Production System: a View from the Trenches    Leonard Dahlmann, Tomer Lancewicki arXiv_CL arXiv_CL  Transformer  Recognition  Bert  Text_Classification  RNN  Knowledge  Pose  Classification  PDF
• 2021-08-23 ZS-SLR: Zero-Shot Sign Language Recognition from RGB-D Videos    Razieh Rastgoo, Kourosh Kiani, Sergio Escalera arXiv_CV arXiv_CV  Transformer  Embedding  Recognition  3D  Bert  Zero-Shot  RNN  Pose  Detection  Activity  PDF
• 2021-08-23 Regularizing Transformers With Deep Probabilistic Layers    Aurora Cobo Aguilera, Pablo Martínez Olmos, Antonio Artés-Rodríguez, Fernando Pérez-Cruz arXiv_CL arXiv_CL  Transformer  Bert  Attention  Language_Model  PDF
• 2021-08-23 Sarcasm Detection in Twitter -- Performance Impact when using Data Augmentation: Word Embeddings    Alif Tri Handoyo, Hidayaturrahman, Derwin Suhartono arXiv_CL arXiv_CL  Embedding  Bert  Pose  Classification  Detection  Sentiment  PDF
• 2021-08-22 UzBERT: pretraining a BERT model for Uzbek    B. Mansurov, A. Mansurov arXiv_CL arXiv_CL  Transformer  Recognition  Bert  Speech  Language_Model  PDF
• 2021-08-22 Using Large Pre-Trained Models with Cross-Modal Attention for Multi-Modal Emotion Recognition    Krishna D N arXiv_SD arXiv_SD  Recognition  Bert  Speech  Self-Supervised  Pose  Emotion  Action  Attention  PDF
• 2021-08-21 Yseop at FinSim-3 Shared Task 2021: Specializing Financial Domain Learning with Phrase Representations    Hanna Abi Akl, Dominique Mariko, Hugues de Mazancourt arXiv_CL arXiv_CL  Embedding  Bert  Pose  Ontology  Classification  PDF
• 2021-08-20 Extracting Radiological Findings With Normalized Anatomical Information Using a Span-Based BERT Relation Extraction Model    Kevin Lybarger, Aashka Damani, Martin Gunn, Ozlem Uzuner, Meliha Yetisgen arXiv_CL arXiv_CL  Bert  Action  Relation  Relation_Extraction  GAN  Medical  PDF
• 2021-08-20 Airbert: In-domain Pretraining for Vision-and-Language Navigation    Pierre-Louis Guhur, Makarand Tapaswi, Shizhe Chen, Ivan Laptev, Cordelia Schmid arXiv_AI arXiv_AI  Image_Caption  Bert  Pose  Few-Shot  Caption  PDF
• 2021-08-20 SMedBERT: A Knowledge-Enhanced Pre-trained Language Model with Structured Semantics for Medical Text Mining    Taolin Zhang, Zerui Cai, Chengyu Wang, Minghui Qiu, Bite Yang, Xiaofeng He arXiv_CL arXiv_CL  Bert  Knowledge  Knowledge_Graph  Pose  Relation  Attention  Medical  Inference  Language_Model  Matching  PDF
• 2021-08-19 A Framework for Neural Topic Modeling of Text Corpora    Shayan Fazeli, Majid Sarrafzadeh arXiv_CL arXiv_CL  Transformer  Embedding  Bert  Language_Model  PDF
• 2021-08-19 Detection of Illicit Drug Trafficking Events on Instagram: A Deep Multimodal Multilabel Learning Approach    Chuanbo Hu, Minglei Yin, Bin Liu, Xin Li, Yanfang Ye arXiv_AI arXiv_AI  Transformer  Bert  Self-Supervised  Pose  Detection  PDF
• 2021-08-19 Sentence-T5: Scalable Sentence Encoders from Pre-trained Text-to-Text Models    Jianmo Ni, Gustavo Hernández {Á}brego, Noah Constant, Ji Ma, Keith B. Hall, Daniel Cer, Yinfei Yang arXiv_CL arXiv_CL  Transformer  Embedding  Bert  Contrastive_Learning  PDF
• 2021-08-19 How Hateful are Movies? A Study and Prediction on Movie Subtitles    Niklas von Boguszewski, Sana Moin, Anirban Bhowmick, Seid Muhie Yimam, Chris Biemann arXiv_CL arXiv_CL  Transformer  Transfer_Learning  Bert  RNN  Speech  Prediction  PDF
• 2021-08-19 Fine-Grained Element Identification in Complaint Text of Internet Fraud    Tong Liu, Siyuan Wang, Jingchao Fu, Lei Chen, Zhongyu Wei, Yaqi Liu, Heng Ye, Liaosa Xu, Weiqiang Wan, Xuanjing Huang arXiv_CL arXiv_CL  Bert  Pose  Classification  PDF
• 2021-08-19 An Information Theory-inspired Strategy for Automatic Network Pruning    Xiawu Zheng, Yuexiao Ma, Teng Xi, Gang Zhang, Errui Ding, Yuchao Li, Jie Chen, Yonghong Tian, Rongrong Ji arXiv_CV arXiv_CV  NAS  Bert  Optimization  Pose  CNN  PDF
• 2021-08-19 Language Model Augmented Relevance Score    Ruibo Liu, Jason Wei, Soroush Vosoughi arXiv_CL arXiv_CL  Reinforcement_Learning  Bert  Adversarial  Pose  Relation  Language_Model  Matching  PDF
• 2021-08-18 Integrating Dialog History into End-to-End Spoken Language Understanding Systems    Jatin Ganhotra, Samuel Thomas, Hong-Kwang J. Kuo, Sachindra Joshi, George Saon, Zoltán Tüske, Brian Kingsbury arXiv_CL arXiv_CL  Embedding  Recognition  Bert  RNN  Speech  Pose  Action  PDF
• 2021-08-18 Contributions of Transformer Attention Heads in Multi- and Cross-lingual Tasks    Weicheng Ma, Kai Zhang, Renze Lou, Lili Wang, Soroush Vosoughi arXiv_CL arXiv_CL  Transformer  Bert  Attention  PDF
• 2021-08-18 TSI: an Ad Text Strength Indicator using Text-to-CTR and Semantic-Ad-Similarity    Shaunak Mishra, Changwei Hu, Manisha Verma, Kevin Yen, Yifan Hu, Maxim Sviridenko arXiv_CL arXiv_CL  Unsupervised  Bert  Pose  Language_Model  Prediction  PDF
• 2021-08-18 MeDiaQA: A Question Answering Dataset on Medical Dialogues    Huqun Suri, Qi Zhang, Wenhua Huo, Yan Liu, Chunsheng Guan arXiv_AI arXiv_AI  Bert  Quantitative  Medical  QA  PDF
• 2021-08-18 SIFN: A Sentiment-aware Interactive Fusion Network for Review-based Item Recommendation    Kai Zhang, Hao Qian, Qi Liu, Zhiqiang Zhang, Jun Zhou, Jianhui Ma, Enhong Chen arXiv_AI arXiv_AI  Bert  Review  Pose  Action  Sentiment  Prediction  Recommendation  PDF
• 2021-08-17 A Weak Supervised Dataset of Fine-Grained Emotions in Portuguese    Diogo Cortiz, Jefferson O. Silva, Newton Calegari, Ana Luísa Freitas, Ana Angélica Soares, Carolina Botelho, Gabriel Gaudencio Rêgo, Waldir Sampaio, Paulo Sergio Boggio arXiv_CL arXiv_CL  Transformer  Recognition  Bert  Emotion  Classification  Sentiment  Language_Model  PDF
• 2021-08-17 MigrationsKB: A Knowledge Base of Public Attitudes towards Migrations and their Driving Factors    Yiyi Chen, Harald Sack, Mehwish Alam arXiv_AI arXiv_AI  Bert  Knowledge  Speech  Detection  Sentiment  Attention  PDF
• 2021-08-16 Deep Natural Language Processing for LinkedIn Search    Weiwei Guo, Xiaowei Liu, Sida Wang, Michaeel Kazi, Zhiwei Wang, Zhoutong Fu, Jun Jia, Liang Zhang, Huiji Gao, Bo Long arXiv_CL arXiv_CL  Bert  Classification  Deep_Learning  Language_Model  Prediction  PDF
• 2021-08-16 On the Opportunities and Risks of Foundation Models    Rishi Bommasani, Drew A. Hudson, Ehsan Adeli, Russ Altman, Simran Arora, Sydney von Arx, Michael S. Bernstein, Jeannette Bohg, Antoine Bosselut, Emma Brunskill, Erik Brynjolfsson, Shyamal Buch, Dallas Card, Rodrigo Castellon, Niladri Chatterji, Annie Chen, Kathleen Creel, Jared Quincy Davis, Dora Demszky, Chris Donahue, Moussa Doumbouya, Esin Durmus, Stefano Ermon, John Etchemendy, Kawin Ethayarajh, Li Fei-Fei, Chelsea Finn, Trevor Gale, Lauren Gillespie, Karan Goel, Noah Goodman, Shelby Grossman, Neel Guha, Tatsunori Hashimoto, Peter Henderson, John Hewitt, Daniel E. Ho, Jenny Hong, Kyle Hsu, Jing Huang, Thomas Icard, Saahil Jain, Dan Jurafsky, Pratyusha Kalluri, Siddharth Karamcheti, Geoff Keeling, Fereshte Khani, Omar Khattab, Pang Wei Koh, Mark Krass, Ranjay Krishna, Rohith Kuditipudi, et al. (62 additional authors not shown) arXiv_AI arXiv_AI  Transfer_Learning  Bert  Action  Deep_Learning  PDF
• 2021-08-15 Maps Search Misspelling Detection Leveraging Domain-Augmented Contextual Representations    Yutong Li arXiv_CL arXiv_CL  Bert  Represenation_Learning  RNN  Deep_Learning  Detection  Object_Detection  PDF
• 2021-08-13 On Single and Multiple Representations in Dense Passage Retrieval    Craig Macdonald, Nicola Tonellotto, Iadh Ounis arXiv_CL arXiv_CL  Embedding  Bert  Language_Model  PDF
• 2021-08-13 Towards Structured Dynamic Sparse Pre-Training of BERT    Anastasia Dietrich, Frithjof Gressmann, Douglas Orr, Ivan Chelombiev, Daniel Justus, Carlo Luschi arXiv_CL arXiv_CL  Unsupervised  Bert  Sparse  Language_Model  PDF
• 2021-08-12 Overview of the HASOC track at FIRE 2020: Hate Speech and Offensive Content Identification in Indo-European Languages    Thomas Mandla, Sandip Modha, Gautam Kishore Shahi, Amit Kumar Jaiswal, Durgesh Nandini, Daksh Patel, Prasenjit Majumder, Johannes Schäfer arXiv_CL arXiv_CL  Transformer  Bert  Speech  Classification  Detection  PDF
• 2021-08-12 Modeling Relevance Ranking under the Pre-training and Fine-tuning Paradigm    Lin Bo, Liang Pang, Gang Wang, Jun Xu, XiuQiang He, Ji-Rong Wen arXiv_CL arXiv_CL  Bert  Knowledge  Pose  Language_Model  PDF
• 2021-08-12 AMMUS : A Survey of Transformer-based Pretrained Models in Natural Language Processing    Katikapalli Subramanyam Kalyan, Ajit Rajasekharan, Sivanesan Sangeetha arXiv_CL arXiv_CL  Transformer  Embedding  Transfer_Learning  Bert  Knowledge  Self-Supervised  Survey  Language_Model  PDF
• 2021-08-12 Dereverberation of Autoregressive Envelopes for Far-field Speech Recognition    Anurenjan Purushothaman, Anirudh Sreeram, Rohit Kumar, Sriram Ganapathy arXiv_SD arXiv_SD  Recognition  Bert  Speech  Action  Speech_Recognition  Prediction  PDF
• 2021-08-11 NoFake at CheckThat! 2021: Fake News Detection Using BERT    Sushma Kumari arXiv_CL arXiv_CL  Bert  Classification  Detection  PDF
• 2021-08-11 User-friendly Comparison of Similarity Algorithms on Wikidata    Filip Ilievski, Pedro Szekely, Gleb Satyukov, Amandeep Singh arXiv_AI arXiv_AI  Embedding  Bert  Knowledge  Knowledge_Graph  Face  Attention  Recommendation  PDF
• 2021-08-11 Medical-VLBERT: Medical Visual Language BERT for COVID-19 CT Report Generation With Alternate Learning    Guangyi Liu, Yinghong Liao, Fuyu Wang, Bin Zhang, Lu Zhang, Xiaodan Liang, Xiang Wan, Shaolin Li, Zhen Li, Shuixing Zhang, Shuguang Cui arXiv_CV arXiv_CV  Bert  Knowledge  Pose  Medical  Prediction  PDF
• 2021-08-10 A Study of Social and Behavioral Determinants of Health in Lung Cancer Patients Using Transformers-based Natural Language Processing Models    Zehao Yu, Xi Yang, Chong Dang, Songzi Wu, Prakash Adekkanattu, Jyotishman Pathak, Thomas J. George, William R. Hogan, Yi Guo, Jiang Bian, Yonghui Wu arXiv_CL arXiv_CL  Transformer  Bert  Classification  PDF
• 2021-08-10 BERTHop: An Effective Vision-and-Language Model for Chest X-ray Disease Diagnosis    Masoud Monajatipoor, Mozhdeh Rouhsedaghat, Liunian Harold Li, Aichi Chien, C.-C. Jay Kuo, Fabien Scalzo, Kai-Wei Chang arXiv_AI arXiv_AI  Transformer  Bert  Pose  VQA  Medical  Language_Model  QA  PDF
• 2021-08-10 Embodied BERT: A Transformer Model for Embodied, Language-guided Visual Task Completion    Alessandro Suglia, Qiaozi Gao, Jesse Thomason, Govind Thattai, Gaurav Sukhatme arXiv_AI arXiv_AI  Transformer  Bert  Action  PDF
• 2021-08-10 Hope Speech detection in under-resourced Kannada language    Adeep Hande, Ruba Priyadharshini, Anbukkarasi Sampath, Kingston Pal Thamburaj, Prabakaran Chandran, Bharathi Raja Chakravarthi arXiv_CL arXiv_CL  Bert  Speech  Pose  Detection  PDF
• 2021-08-10 CLSEBERT: Contrastive Learning for Syntax Enhanced Code Pre-Trained Model    Xin Wang, Yasheng Wang, Pingyi Zhou, Meng Xiao, Yadao Wang, Li Li, Xiao Liu, Hao Wu, Jin Liu, Xin Jiang arXiv_AI arXiv_AI  Bert  Pose  Contrastive_Learning  Detection  Language_Model  Matching  PDF
• 2021-08-10 TrUMAn: Trope Understanding in Movies and Animations    Hung-Ting Su, Po-Wei Shen, Bing-Chen Tsai, Wen-Feng Cheng, Ke-Jyun Wang, Winston H. Hsu arXiv_AI arXiv_AI  Embedding  Bert  Pose  Action  Deep_Learning  Relation  Recommendation  PDF
• 2021-08-10 BROS: A Layout-Aware Pre-trained Language Model for Understanding Documents    Teakgyu Hong, Donghyun Kim, Mingi Ji, Wonseok Hwang, Daehyun Nam, Sungrae Park arXiv_CL arXiv_CL  Recognition  OCR  Bert  Pose  Language_Model  PDF
• 2021-08-09 BERT-based distractor generation for Swedish reading comprehension questions using a small-scale dataset    Dmytro Kalpakchi, Johan Boye arXiv_CL arXiv_CL  Bert  Pose  PDF
• 2021-08-09 FiLMing Multimodal Sarcasm Detection with Attention    Sundesh Gupta, Aditya Shah, Miten Shah, Laribok Syiemlieh, Chandresh Maurya arXiv_CL arXiv_CL  Bert  Pose  Face  Detection  Sentiment  Attention  Prediction  PDF
• 2021-08-09 P-WAE: Generalized Patch-Wasserstein Autoencoder for Anomaly Screening    Yurong Chen arXiv_AI arXiv_AI  Reconstruction  Bert  Regularization  Pose  Detection  Inference  PDF
• 2021-08-08 Leveraging Commonsense Knowledge on Classifying False News and Determining Checkworthiness of Claims    Ipek Baris Schlicht, Erhan Sezerer, Selma Tekir, Oul Han, Zeyd Boukhers arXiv_AI arXiv_AI  Bert  Knowledge  Pose  Classification  Detection  Language_Model  PDF
• 2021-08-08 Efficacy of BERT embeddings on predicting disaster from Twitter data    Ashis Kumar Chanda arXiv_CL arXiv_CL  Embedding  Bert  Pose  Quantitative  Deep_Learning  Sentiment  Prediction  PDF
• 2021-08-07 W2v-BERT: Combining Contrastive Learning and Masked Language Modeling for Self-Supervised Speech Pre-Training    Yu-An Chung, Yu Zhang, Wei Han, Chung-Cheng Chiu, James Qin, Ruoming Pang, Yonghui Wu arXiv_SD arXiv_SD  Unsupervised  Bert  Represenation_Learning  Speech  Self-Supervised  Pose  Contrastive_Learning  Language_Model  Prediction  PDF
• 2021-08-07 Tiny Neural Models for Seq2Seq    Arun Kandoor arXiv_CL arXiv_CL  Embedding  Bert  RNN  Pose  PDF
• 2021-08-06 Offensive Language and Hate Speech Detection with Deep Learning and Transfer Learning    Bencheng Wei, Jason Li, Ajay Gupta, Hafiza Umair, Atsu Vovor, Natalie Durzynski arXiv_AI arXiv_AI  Transformer  Embedding  Transfer_Learning  Bert  Text_Classification  RNN  Speech  Pose  Classification  Deep_Learning  Detection  Sentiment  Language_Model  PDF
• 2021-08-06 Deriving Disinformation Insights from Geolocalized Twitter Callouts    David Tuxworth, Dimosthenis Antypas, Luis Espinosa-Anke, Jose Camacho-Collados, Alun Preece, David Rogers arXiv_CL arXiv_CL  Transformer  Embedding  Bert  Classification  Language_Model  PDF
• 2021-08-06 Sentence Semantic Regression for Text Generation    Wei Wang, Piji Li, Hai-Tao Zheng arXiv_CL arXiv_CL  Bert  Pose  Face  Text_Generation  Language_Model  Prediction  PDF
• 2021-08-05 Decoupled Transformer for Scalable Inference in Open-domain Question Answering    Haytham ElFadeel, Stan Peshterliev arXiv_CL arXiv_CL  Transformer  Bert  Knowledge  Pose  Inference  QA  PDF
• 2021-08-05 VisualTextRank: Unsupervised Graph-based Content Extraction for Automating Ad Text to Image Search    Shaunak Mishra, Mikhail Kuznetsov, Gaurav Srivastava, Maxim Sviridenko arXiv_CV arXiv_CV  Embedding  Unsupervised  Bert  Pose  Action  PDF
• 2021-08-05 Knowledge Distillation from BERT Transformer to Speech Transformer for Intent Classification    Yidi Jiang, Bidisha Sharma, Maulik Madhavi, Haizhou Li arXiv_CL arXiv_CL  Transformer  Recognition  Bert  Knowledge  Speech  Pose  Classification  Attention  Speech_Recognition  Language_Model  PDF
• 2021-08-05 Performer Identification From Symbolic Representation of Music Using Statistical Models    Syed Rifat Mahmud Rafee, Gyorgy Fazekas, Geraint A.~Wiggins arXiv_SD arXiv_SD  Bert  Pose  PDF
• 2021-08-05 Adaptive Residue-wise Profile Fusion for Low Homologous Protein SecondaryStructure Prediction Using External Knowledge    Qin Wang, Jun Wei, Boyuan Wang, Zhen Li1, Sheng Wang, Shuguang Cu arXiv_AI arXiv_AI  Bert  Knowledge  Self-Supervised  Pose  Attention  Prediction  PDF
• 2021-08-05 Robust Transfer Learning with Pretrained Language Models through Adapters    Wenjuan Han, Bo Pang, Yingnian Wu arXiv_CL arXiv_CL  Transformer  Unsupervised  Transfer_Learning  Bert  Adversarial  Pose  Classification  Language_Model  PDF
• 2021-08-04 Curriculum learning for language modeling    Daniel Campos arXiv_AI arXiv_AI  Bert  Language_Model  PDF
• 2021-08-04 How to Query Language Models?    Leonard Adolphs, Shehzaad Dhuliawala, Thomas Hofmann arXiv_CL arXiv_CL  Bert  Knowledge  Pose  Relation  Language_Model  PDF
• 2021-08-03 Exploiting BERT For Multimodal Target SentimentClassification Through Input Space Translation    Zaid Khan, Yun Fu arXiv_CV arXiv_CV  Transformer  Bert  Sentiment_Classification  Emotion  Classification  Sentiment  Text_Generation  Language_Model  PDF
• 2021-08-03 Large-Scale Differentially Private BERT    Rohan Anil, Badih Ghazi, Vineet Gupta, Ravi Kumar, Pasin Manurangsi arXiv_CL arXiv_CL  Bert  Language_Model  PDF
• 2021-08-03 ExBERT: An External Knowledge Enhanced BERT for Natural Language Inference    Amit Gajbhiye, Noura Al Moubayed, Steven Bradley arXiv_CL arXiv_CL  Bert  Knowledge  Knowledge_Graph  Inference  PDF
• 2021-08-02 Changes in European Solidarity Before and During COVID-19: Evidence from a Large Crowd- and Expert-Annotated Twitter Dataset    Alexandra Ils, Dan Liu, Daniela Grunow, Steffen Eger arXiv_CL arXiv_CL  Bert  Salient  Relation  PDF
• 2021-08-02 LICHEE: Improving Language Model Pre-training with Multi-grained Tokenization    Weidong Guo, Mingjun Zhao, Lusheng Zhang, Di Niu, Jinwen Luo, Zhenhua Liu, Zhenyang Li, Jianbo Tang arXiv_AI arXiv_AI  Bert  Pose  Inference  Language_Model  PDF
• 2021-08-02 Transfer Learning for Mining Feature Requests and Bug Reports from Tweets and App Store Reviews    Pablo Restrepo Henao, Jannik Fischbach, Dominik Spies, Julian Frattini, Andreas Vogelsang arXiv_CL arXiv_CL  Transfer_Learning  Bert  Review  Classification  Deep_Learning  PDF
• 2021-08-02 Is My Model Using The Right Evidence? Systematic Probes for Examining Evidence-Based Tabular Reasoning    Vivek Gupta, Riyaz A. Bhat, Atreya Ghosal, Manish Srivastava, Maneesh Singh, Vivek Srikumar arXiv_AI arXiv_AI  Bert  Knowledge  Language_Model  Prediction  PDF
• 2021-07-31 Opinion Prediction with User Fingerprinting    Kishore Tumarada, Yifan Zhang, Dr. Fan Yang, Dr. Eduard Dragut, Dr. Omprakash Gnawali, Dr. Arjun Mukherjee arXiv_AI arXiv_AI  Embedding  Bert  Pose  Action  Sentiment  Prediction  PDF
• 2021-07-31 Using Knowledge-Embedded Attention to Augment Pre-trained Language Models for Fine-Grained Emotion Recognition    Varsha Suresh, Desmond C. Ong arXiv_AI arXiv_AI  Recognition  Bert  Knowledge  Pose  Emotion  Action  Attention  Language_Model  PDF
• 2021-07-30 Perceiver IO: A General Architecture for Structured Inputs & Outputs    Andrew Jaegle, Sebastian Borgeaud, Jean-Baptiste Alayrac, Carl Doersch, Catalin Ionescu, David Ding, Skanda Koppula, Andrew Brock, Evan Shelhamer, Olivier Hénaff, Matthew M. Botvinick, Andrew Zisserman, Oriol Vinyals, João Carreira arXiv_CV arXiv_CV  Transformer  Point_Cloud  Bert  Pose  Optical_Flow  PDF
• 2021-07-30 EmailSum: Abstractive Email Thread Summarization    Shiyue Zhang, Asli Celikyilmaz, Jianfeng Gao, Mohit Bansal arXiv_AI arXiv_AI  Bert  Summarization  PDF
• 2021-07-29 IIITG-ADBU@HASOC-Dravidian-CodeMix-FIRE2020: Offensive Content Detection in Code-Mixed Dravidian Text    Arup Baruah, Kaushik Amar Das, Ferdous Ahmed Barbhuiya, Kuntal Dey arXiv_CL arXiv_CL  Bert  Detection  PDF
• 2021-07-29 Adapting GPT, GPT-2 and BERT Language Models for Speech Recognition    Xianrui Zheng, Chao Zhang, Philip C. Woodland arXiv_CL arXiv_CL  Transformer  Recognition  Bert  Speech  Pose  Speech_Recognition  Language_Model  PDF
• 2021-07-29 Term Expansion and FinBERT fine-tuning for Hypernym and Synonym Ranking of Financial Terms    Ankush Chopra, Sohom Ghosh arXiv_CL arXiv_CL  Transformer  Embedding  Bert  Ontology  Classification  GAN  Matching  PDF
• 2021-07-29 UIBert: Learning Generic Multimodal Representations for UI Understanding    Chongyang Bai, Xiaoxue Zang, Ying Xu, Srinivas Sunkara, Abhinav Rastogi, Jindong Chen, Blaise Aguera y Arcas arXiv_AI arXiv_AI  Transformer  Bert  Pose  Face  PDF
• 2021-07-29 AutoTinyBERT: Automatic Hyper-parameter Optimization for Efficient Pre-trained Language Models    Yichun Yin, Cheng Chen, Lifeng Shang, Xin Jiang, Xiao Chen, Qun Liu arXiv_CL arXiv_CL  NAS  Bert  Optimization  Pose  Language_Model  PDF
• 2021-07-28 Sentiment Analysis of the COVID-related r/Depression Posts    Zihan Chen, Marina Sokolova arXiv_CL arXiv_CL  Bert  Sentiment_Classification  Pose  Classification  Sentiment  PDF
• 2021-07-28 MWP-BERT: A Strong Baseline for Math Word Problems    Zhenwen Liang, Jipeng Zhang, Jie Shao, Xiangliang Zhang arXiv_AI arXiv_AI  Bert  Knowledge  Language_Model  Matching  PDF
• 2021-07-28 Arabic aspect based sentiment analysis using BERT    Mohammed M.Abdelgwad arXiv_CL arXiv_CL  Embedding  Bert  Review  Classification  Deep_Learning  Sentiment  Language_Model  PDF
• 2021-07-27 A Physiologically-adapted Gold Standard for Arousal During a Stress Induced Scenario    Alice Baird, Lukas Stappen, Lukas Christ, Lea Schumann, Eva-Maria Meßner, Björn W. Schuller arXiv_CV arXiv_CV  Bert  Emotion  Relation  Activity  PDF
• 2021-07-27 gaBERT -- an Irish Language Model    James Barry, Joachim Wagner, Lauren Cassidy, Alan Cowap, Teresa Lynn, Abigail Walsh, Mícheál J. Ó Meachair, Jennifer Foster arXiv_CL arXiv_CL  Bert  Language_Model  PDF
• 2021-07-27 Emotion Stimulus Detection in German News Headlines    {Bao Minh} {Doan Dang}, Laura Oberländer, Roman Klinger arXiv_CL arXiv_CL  Bert  Emotion  Action  Detection  PDF
• 2021-07-27 Unsupervised Domain Adaptation for Hate Speech Detection Using a Data Augmentation Approach    Sheikh Muhammad Sarwar, Vanessa Murdock arXiv_CL arXiv_CL  Unsupervised  Bert  RNN  Speech  Pose  Detection  PDF
• 2021-07-26 ContextNet: A Click-Through Rate Prediction Framework Using Contextual information to Refine Feature Embedding    Zhiqiang Wang, Qingyun She, PengTao Zhang, Junlin Zhang arXiv_AI arXiv_AI  Embedding  Bert  Pose  Action  Prediction  Recommendation  PDF
• 2021-07-24 Context-aware Adversarial Training for Name Regularity Bias in Named Entity Recognition    Abbas Ghaddar, Philippe Langlais, Ahmad Rashid, Mehdi Rezagholizadeh arXiv_CL arXiv_CL  Recognition  Bert  RNN  Adversarial  Pose  PDF
• 2021-07-24 MDQE: A More Accurate Direct Pretraining for Machine Translation Quality Estimation    Lei Lin arXiv_CL arXiv_CL  Bert  Pose  Language_Model  PDF
• 2021-07-23 Improving Early Sepsis Prediction with Multi Modal Learning    Fred Qin, Vivek Madan, Ujjwal Ratan, Zohar Karnin, Vishaal Kapoor, Parminder Bhatia, Taha Kass-Hout arXiv_CL arXiv_CL  Multi_Modal  Bert  Pose  Detection  Medical  Prediction  PDF
• 2021-07-22 Semantic Text-to-Face GAN -ST^2FG    Manan Oza, Sukalpa Chanda, David Doermann arXiv_CV arXiv_CV  Embedding  Image_Generation  Bert  Sketch  Adversarial  Pose  Face  Attention  GAN  PDF
• 2021-07-22 Evaluation of contextual embeddings on less-resourced languages    Matej Ulčar, Aleš Žagar, Carlos S. Armendariz, Andraž Repar, Senja Pollak, Matthew Purver, Marko Robnik-Šikonja arXiv_CL arXiv_CL  Embedding  Bert  PDF
• 2021-07-22 Fristograms: Revealing and Exploiting Light Field Internals    Thorsten Herfet, Kelvin Chelli, Tobias Lange, Robin Kremer arXiv_CV arXiv_CV  Reconstruction  Segmentation  Recognition  3D  Bert  Salient  Pose  Detection  Relation  Object_Detection  PDF
• 2021-07-21 Improved Text Classification via Contrastive Adversarial Training    Lin Pan, Chung-Wei Hang, Avirup Sil, Saloni Potdar, Mo Yu arXiv_CL arXiv_CL  Transformer  Embedding  Bert  Text_Classification  Adversarial  Pose  Contrastive_Learning  Classification  PDF
• 2021-07-21 Digital Einstein Experience: Fast Text-to-Speech for Conversational AI    Joanna Rownicka, Kilian Sprenkamp, Antonio Tripiana, Volodymyr Gromoglasov, Timo P Kunz arXiv_AI arXiv_AI  Bert  Speech  Pose  Action  GAN  Prediction  PDF
• 2021-07-21 MarsExplorer: Exploration of Unknown Terrains via Deep Reinforcement Learning and Procedurally Generated Environments    Dimitrios I. Koutras, Athanasios Ch. Kapoutsis, Angelos A. Amanatiadis, Elias B. Kosmatopoulos arXiv_AI arXiv_AI  Reinforcement_Learning  Bert  PDF
• 2021-07-21 DRDF: Determining the Importance of Different Multimodal Information with Dual-Router Dynamic Framework    Haiwen Hong, Xuan Jin, Yin Zhang, Yunqing Hu, Jingfeng Zhang, Yuan He, Hui Xue arXiv_CV arXiv_CV  Bert  Pose  PDF
• 2021-07-21 CausalBERT: Injecting Causal Knowledge Into Pre-trained Models with Minimal Supervision    Zhongyang Li, Xiao Ding, Kuo Liao, Ting Liu, Bing Qin arXiv_CL arXiv_CL  Embedding  Bert  Regularization  Knowledge  Pose  Classification  Inference  QA  PDF
• 2021-07-20 Sequence Model with Self-Adaptive Sliding Window for Efficient Spoken Document Segmentation    Qinglin Zhang, Qian Chen, Yali Li, Jiaqing Liu, Wen Wang arXiv_CL arXiv_CL  Segmentation  Recognition  Bert  Speech  Pose  Summarization  Speech_Recognition  Inference  PDF
• 2021-07-19 Cross-Lingual BERT Contextual Embedding Space Mapping with Isotropic and Isometric Conditions    Haoran Xu, Philipp Koehn arXiv_CL arXiv_CL  Embedding  Bert  Relation  PDF
• 2021-07-19 Unsupervised Identification of Relevant Prior Cases    Shivangi Bithel, Sumitra S Malagi arXiv_CL arXiv_CL  Embedding  Unsupervised  Bert  Knowledge  Pose  Language_Model  PDF
• 2021-07-19 Clinical Relation Extraction Using Transformer-based Models    Xi Yang, Zehao Yu, Yi Guo, Jiang Bian, Yonghui Wu arXiv_CL arXiv_CL  Transformer  Bert  Action  Classification  Relation  Relation_Extraction  Medical  PDF
• 2021-07-19 Stock Movement Prediction with Financial News using Contextualized Embedding from BERT    Qinkai Chen arXiv_CL arXiv_CL  Transformer  Embedding  Bert  RNN  Prediction  PDF
• 2021-07-18 Stock price prediction using BERT and GAN    Priyank Sonkiya, Vikas Bajpai, Anukriti Bansal arXiv_CL arXiv_CL  Transformer  Bert  RNN  Adversarial  Pose  Emotion  Deep_Learning  Sentiment  GAN  Prediction  PDF
• 2021-07-16 The Law of Large Documents: Understanding the Structure of Legal Contracts Using Visual Cues    Allison Hegel, Marina Shah, Genevieve Peaslee, Brendan Roof, Emad Elwany arXiv_CL arXiv_CL  Transformer  Segmentation  Bert  Action  Classification  PDF
• 2021-07-16 Are Multilingual Models the Best Choice for Moderately Under-resourced Languages? A Comprehensive Assessment for Catalan    Jordi Armengol-Estapé, Casimiro Pio Carrino, Carlos Rodriguez-Penagos, Ona de Gibert Bonet, Carme Armentano-Oller, Aitor Gonzalez-Agirre, Maite Melero, Marta Villegas arXiv_CL arXiv_CL  Transformer  Recognition  Bert  Text_Classification  Speech  Action  Classification  Language_Model  PDF
• 2021-07-15 Self-Supervised Contrastive Learning with Adversarial Perturbations for Robust Pretrained Language Models    Zhao Meng, Yihan Dong, Mrinmaya Sachan, Roger Wattenhofer arXiv_CL arXiv_CL  Bert  Adversarial  Self-Supervised  Contrastive_Learning  Language_Model  PDF
• 2021-07-15 AutoBERT-Zero: Evolving BERT Backbone from Scratch    Jiahui Gao, Hang Xu, Han shi, Xiaozhe Ren, Philip L.H. Yu, Xiaodan Liang, Xin Jiang, Zhenguo Li arXiv_CL arXiv_CL  Transformer  NAS  Bert  Pose  Attention  Language_Model  PDF
• 2021-07-15 Single-image Full-body Human Relighting    Manuel Lagunas, Xin Sun, Jimei Yang, Ruben Villegas, Jianming Zhang, Zhixin Shu, Belen Masia, Diego Gutierrez arXiv_CV arXiv_CV  Reconstruction  Bert  Pose  Deep_Learning  PDF
• 2021-07-15 Spanish Language Models    Asier Gutiérrez-Fandiño, Jordi Armengol-Estapé, Marc Pàmies, Joan Llop-Palao, Joaquín Silveira-Ocampo, Casimiro Pio Carrino, Aitor Gonzalez-Agirre, Carme Armentano-Oller, Carlos Rodriguez-Penagos, Marta Villegas arXiv_AI arXiv_AI  Bert  Language_Model  PDF
• 2021-07-15 Trusting RoBERTa over BERT: Insights from CheckListing the Natural Language Inference Task    Ishan Tarunesh, Somak Aditya, Monojit Choudhury arXiv_AI arXiv_AI  Bert  Inference  PDF
• 2021-07-15 Incorporating Lambertian Priors into Surface Normals Measurement    Yakun Ju, Muwei Jian, Shaoxiang Guo, Yingyu Wang, Huiyu Zhou, Junyu Dong arXiv_CV arXiv_CV  Reconstruction  3D  Bert  Pose  Face  PDF
• 2021-07-14 From Show to Tell: A Survey on Image Captioning    Matteo Stefanini, Marcella Cornia, Lorenzo Baraldi, Silvia Cascianelli, Giuseppe Fiameni, Rita Cucchiara arXiv_CV arXiv_CV  Image_Caption  Bert  Pose  Survey  Quantitative  Relation  Text_Generation  Caption  Language_Model  PDF
• 2021-07-14 BERT Fine-Tuning for Sentiment Analysis on Indonesian Mobile Apps Reviews    Kuncahyo Setyo Nugroho, Anantha Yullian Sukmadewa, Haftittah Wuswilahaken DW, Fitra Abdurrachman Bachtiar, Novanto Yudistira arXiv_CL arXiv_CL  Transfer_Learning  Bert  Review  Sentiment  PDF
• 2021-07-14 Indonesia's Fake News Detection using Transformer Network    Aisyah Awalina, Jibran Fawaid, Rifky Yunus Krisnabayu, Novanto Yudistira arXiv_CL arXiv_CL  Transformer  Bert  RNN  Face  Detection  PDF
• 2021-07-14 Large-Scale News Classification using BERT Language Model: Spark NLP Approach    Kuncahyo Setyo Nugroho, Kuncahyo Setyo Nugroho, Novanto Yudistira arXiv_CL arXiv_CL  Bert  Face  Classification  Deep_Learning  Language_Model  PDF
• 2021-07-13 TSCAN : Dialog Structure discovery using SCAN    Apurba Nath, Aayush Kubba arXiv_AI arXiv_AI  Unsupervised  Bert  Ontology  Classification  PDF
• 2021-07-13 Using BERT Encoding to Tackle the Mad-lib Attack in SMS Spam Detection    Sergio Rojas-Galeano arXiv_CL arXiv_CL  Bert  Adversarial  Classification  Detection  Relation  Language_Model  PDF
• 2021-07-13 What do writing features tell us about AI papers?    Zining Zhu, Bai Li, Yang Xu, Frank Rudzicz arXiv_CL arXiv_CL  Bert  Attention  Prediction  PDF
• 2021-07-13 Rating Facts under Coarse-to-fine Regimes    Guojun Wu arXiv_CL arXiv_CL  Bert  Pose  Classification  PDF
• 2021-07-13 Exploiting Network Structures to Improve Semantic Representation for the Financial Domain    Chao Feng, Shi-jie We arXiv_CL arXiv_CL  Transformer  Embedding  Bert  Knowledge  Knowledge_Graph  Pose  Inference  Language_Model  PDF
• 2021-07-12 Quantifying Explainability in NLP and Analyzing Algorithms for Performance-Explainability Tradeoff    Mitchell Naylor, Christi French, Samantha Terker, Uday Kamath arXiv_CL arXiv_CL  Bert  Text_Classification  Classification  Prediction  PDF
• 2021-07-12 CoBERL: Contrastive BERT for Reinforcement Learning    Andrea Banino, Adrià Puidomenech Badia, Jacob Walker, Tim Scholtes, Jovana Mitrovic, Charles Blundell arXiv_AI arXiv_AI  Transformer  Reinforcement_Learning  3D  Bert  RNN  Pose  Prediction  PDF
• 2021-07-12 A Flexible Multi-Task Model for BERT Serving    Tianwen Wei, Jianwei Qi, Shenghuan He arXiv_CL arXiv_CL  Bert  Knowledge  Pose  PDF
• 2021-07-12 MidiBERT-Piano: Large-scale Pre-training for Symbolic Music Understanding    Yi-Hui Chou, I-Chun Chen, Chin-Jui Chang, Joann Ching, Yi-Hsuan Yang arXiv_SD arXiv_SD  Transformer  Bert  Pose  Emotion  Action  Classification  Attention  Language_Model  Prediction  PDF
• 2021-07-12 Split, embed and merge: An accurate table structure recognizer    Zhenrong Zhang, Jianshu Zhang, Jun Du arXiv_CV arXiv_CV  Recognition  Bert  Pose  Attention  PDF
• 2021-07-12 Delta Sampling R-BERT for limited data and low-light action recognition    Sanchit Hira, Ritwik Das, Abhinav Modi, Daniil Pakhomov arXiv_CV arXiv_CV  Recognition  Bert  Pose  Action_Recognition  Action  Inference  PDF
• 2021-07-10 Noise Stability Regularization for Improving BERT Fine-tuning    Hang Hua, Xingjian Li, Dejing Dou, Cheng-Zhong Xu, Jiebo Luo arXiv_CL arXiv_CL  Bert  Regularization  Pose  Language_Model  PDF
• 2021-07-09 Benchmarking for Biomedical Natural Language Processing Tasks with a Domain Specific ALBERT    Usman Naseem, Adam G. Dunn, Matloob Khushi, Jinman Kim arXiv_CL arXiv_CL  Transformer  Recognition  Bert  Action  Classification  Relation  Relation_Extraction  Medical  Language_Model  PDF
• 2021-07-09 Learning Syntactic Dense Embedding with Correlation Graph for Automatic Readability Assessment    Xinying Qiu, Yuan Chen, Hanwu Chen, Jian-Yun Nie, Yuming Shen, Dawei Lu arXiv_CL arXiv_CL  Embedding  Bert  Pose  Deep_Learning  Relation  PDF
• 2021-07-07 Identifying Hijacked Reviews    Monika Daryani, James Caverlee arXiv_AI arXiv_AI  Bert  RNN  Review  Pose  PDF
• 2021-07-07 Can Transformer Models Measure Coherence In Text? Re-Thinking the Shuffle Test    Philippe Laban, Luke Dai, Lucas Bandarkar, Marti A. Hearst arXiv_CL arXiv_CL  Transformer  Bert  Zero-Shot  PDF
• 2021-07-07 LanguageRefer: Spatial-Language Model for 3D Visual Grounding    Junha Roh, Karthik Desingh, Ali Farhadi, Dieter Fox arXiv_CV arXiv_CV  Transformer  Embedding  Point_Cloud  3D  Bert  Pose  Language_Model  PDF
• 2021-07-06 Transfer Learning for Improving Results on Russian Sentiment Datasets    Anton Golubev, Natalia Loukachevitch arXiv_CL arXiv_CL  Transfer_Learning  Bert  Sentiment_Classification  Classification  Sentiment  Inference  PDF
• 2021-07-06 A Short Note on the Relationship of Information Gain and Eluder Dimension    Kaixuan Huang, Sham M. Kakade, Jason D. Lee, Qi Lei arXiv_AI arXiv_AI  Reinforcement_Learning  Bert  Pose  Relation  PDF
• 2021-07-06 Weighted Gaussian Process Bandits for Non-stationary Environments    Yuntian Deng, Xingyu Zhou, Baekjin Kim, Ambuj Tewari, Abhishek Gupta, Ness Shroff arXiv_AI arXiv_AI  Bert  Optimization  Pose  PDF
• 2021-07-05 Experiments with adversarial attacks on text genres    Mikhail Lepekhin, Serge Sharoff arXiv_CL arXiv_CL  Transformer  Embedding  Bert  Adversarial  Classification  Prediction  PDF
• 2021-07-05 A Knowledge-based Approach for Answering Complex Questions in Persian    Romina Etezadi, Mehrnoush Shamsfard arXiv_AI arXiv_AI  Bert  Knowledge  Knowledge_Graph  Pose  Inference  QA  PDF
• 2021-07-05 Contradiction Detection in Persian Text    Zeinab Rahimi, Mehrnoush ShamsFard arXiv_CL arXiv_CL  Transfer_Learning  Recognition  Bert  Deep_Learning  Detection  PDF
• 2021-07-05 The DCU-EPFL Enhanced Dependency Parser at the IWPT 2021 Shared Task    James Barry, Alireza Mohammadshahi, Joachim Wagner, Jennifer Foster, James Henderson arXiv_CL arXiv_CL  Bert  PDF
• 2021-07-02 Language Identification of Hindi-English tweets using code-mixed BERT    Mohd Zeeshan Ansari, M M Sufyan Beg, Tanvir Ahmad, Mohd Jazib Khan, Ghazali Wasim arXiv_CL arXiv_CL  Embedding  Transfer_Learning  Bert  Knowledge  Classification  Language_Model  PDF
• 2021-07-02 Ultrasound Video Transformers for Cardiac Ejection Fraction Estimation    Hadrien Reynaud, Athanasios Vlontzos, Benjamin Hou, Arian Beqiri, Paul Leeson, Bernhard Kainz arXiv_CV arXiv_CV  Transformer  Segmentation  Bert  Pose  Action  Classification  Detection  PDF
• 2021-07-02 A Novel Deep Reinforcement Learning Based Stock Direction Prediction using Knowledge Graph and Community Aware Sentiments    Anil Berk Altuner, Zeynep Hilal Kilimci arXiv_AI arXiv_AI  Transformer  Reinforcement_Learning  Bert  Knowledge  Knowledge_Graph  Pose  Relation  Sentiment  Prediction  PDF
• 2021-07-02 He Thinks He Knows Better than the Doctors: BERT for Event Factuality Fails on Pragmatics    Nanjiang Jiang, Marie-Catherine de Marneffe arXiv_CL arXiv_CL  Bert  Face  Prediction  PDF
• 2021-07-01 A Primer on Pretrained Multilingual Language Models    Sumanth Doddapaneni, Gowtham Ramesh, Anoop Kunchukuttan, Pratyush Kumar, Mitesh M. Khapra arXiv_CL arXiv_CL  Transfer_Learning  Bert  Review  Survey  Language_Model  PDF
• 2021-07-01 Multimodal Graph-based Transformer Framework for Biomedical Relation Extraction    Sriram Pingali, Shweta Yadav, Pratik Dutta, Sriparna Saha arXiv_CL arXiv_CL  Transformer  Bert  Knowledge  Pose  Action  Relation  Relation_Extraction  Medical  PDF
• 2021-07-01 GlyphCRM: Bidirectional Encoder Representation for Chinese Character with its Glyph    Yunxin Li, Yu Zhao, Baotian Hu, Qingcai Chen, Yang Xiang, Xiaolong Wang, Yuxin Ding, Lin Ma arXiv_AI arXiv_AI  Transformer  Embedding  Bert  Pose  CNN  PDF
• 2021-07-01 Leveraging Domain Agnostic and Specific Knowledge for Acronym Disambiguation    Qiwei Zhong, Guanxiong Zeng, Danqing Zhu, Yang Zhang, Wangli Lin, Ben Chen, Jiayu Tang arXiv_AI arXiv_AI  Embedding  Bert  Knowledge  Pose  Deep_Learning  Language_Model  Prediction  PDF
• 2021-07-01 Sonority Measurement Using System, Source, and Suprasegmental Information    Bidisha Sharma, S. R. Mahadeva Prasanna arXiv_SD arXiv_SD  Recognition  Bert  Speech  Pose  Classification  Relation  Prediction  PDF
• 2021-07-01 Elbert: Fast Albert with Confidence-Window Based Early Exit    Keli Xie, Siyuan Lu, Meiqi Wang, Zhongfeng Wang arXiv_CL arXiv_CL  Bert  Pose  Inference  Language_Model  PDF
• 2021-06-30 Early Risk Detection of Pathological Gambling, Self-Harm and Depression Using BERT    Ana-Maria Bucur, Adrian Cosma, Liviu P. Dinu arXiv_CL arXiv_CL  Transformer  Bert  Detection  PDF
• 2021-06-30 Revisiting the Primacy of English in Zero-shot Cross-lingual Transfer    Iulia Turc, Kenton Lee, Jacob Eisenstein, Ming-Wei Chang, Kristina Toutanova arXiv_CL arXiv_CL  Bert  Zero-Shot  Classification  PDF
• 2021-06-30 The MultiBERTs: BERT Reproductions for Robustness Analysis    Thibault Sellam, Steve Yadlowsky, Jason Wei, Naomi Saphra, Alexander D'Amour, Tal Linzen, Jasmijn Bastings, Iulia Turc, Jacob Eisenstein, Dipanjan Das, Ian Tenney, Ellie Pavlick arXiv_CL arXiv_CL  Bert  PDF
• 2021-06-30 ChineseBERT: Chinese Pretraining Enhanced by Glyph and Pinyin Information    Zijun Sun, Xiaoya Li, Xiaofei Sun, Yuxian Meng, Xiang Ao, Qing He, Fei Wu, Jiwei Li arXiv_CL arXiv_CL  Embedding  Recognition  Bert  Text_Classification  Pose  Classification  Inference  Language_Model  Matching  PDF
• 2021-06-30 AutoLAW: Augmented Legal Reasoning through Legal Precedent Prediction    Robert Zev Mahari arXiv_CL arXiv_CL  Bert  GAN  Prediction  PDF
• 2021-06-29 Hate speech detection using static BERT embeddings    Gaurav Rajput, Narinder Singh punn, Sanjay Kumar Sonbhadra, Sonali Agarwal arXiv_CV arXiv_CV  Embedding  Bert  Speech  Detection  PDF
• 2021-06-29 New Arabic Medical Dataset for Diseases Classification    Jaafar Hammoud, Aleksandra Vatian, Natalia Dobrenko, Nikolai Vedernikov, Anatoly Shalyto, Natalia Gusarova arXiv_CL arXiv_CL  OCR  Bert  Classification  Deep_Learning  Medical  PDF
• 2021-06-29 Packing: Towards 2x NLP BERT Acceleration    Matej Kosec, Sheng Fu, Mario Michael Krell arXiv_CL arXiv_CL  Transformer  Bert  Attention  PDF
• 2021-06-28 Enhancing the Generalization for Intent Classification and Out-of-Domain Detection in SLU    Yilin Shen, Yen-Chang Hsu, Avik Ray, Hongxia Jin arXiv_AI arXiv_AI  Bert  Pose  Classification  Detection  PDF
• 2021-06-28 Traditional Machine Learning and Deep Learning Models for Argumentation Mining in Russian Texts    Irina Fishcheva, Valeriya Goloviznina, Evgeny Kotelnikov arXiv_CL arXiv_CL  Bert  Pose  Classification  Deep_Learning  Relation  PDF
• 2021-06-28 Current Landscape of the Russian Sentiment Corpora    Evgeny Kotelnikov arXiv_CL arXiv_CL  Bert  Review  Pose  Quantitative  Sentiment  PDF
• 2021-06-28 A 3D CNN Network with BERT For Automatic COVID-19 Diagnosis From CT-Scan Images    Weijun Tan, Jingfeng Liu arXiv_CV arXiv_CV  Segmentation  Embedding  3D  Bert  PDF
• 2021-06-27 A Closer Look at How Fine-tuning Changes BERT    Yichu Zhou, Vivek Srikumar arXiv_CL arXiv_CL  Bert  PDF
• 2021-06-27 AI based Presentation Creator With Customized Audio Content Delivery    Muvazima Mansoor, Srikanth Chandar, Ramamoorthy Srinath arXiv_AI arXiv_AI  Bert  Adversarial  Pose  GAN  Summarization  PDF
• 2021-06-26 Answering Chinese Elementary School Social Study Multiple Choice Questions    Daniel Lee, Chao-Chun Liang, Keh-Yih Su arXiv_CL arXiv_CL  Bert  Pose  PDF
• 2021-06-26 UMIC: An Unreferenced Metric for Image Captioning via Contrastive Learning    Hwanhee Lee, Seunghyun Yoon, Franck Dernoncourt, Trung Bui, Kyomin Jung arXiv_CV arXiv_CV  Image_Caption  Bert  Contrastive_Learning  Relation  Text_Generation  Caption  PDF
• 2021-06-26 Benchmarking Differential Privacy and Federated Learning for BERT Models    Priyam Basu, Tiasa Singha Roy, Rakshit Naidu, Zumrut Muftuoglu, Sahib Singh, Fatemehsadat Mireshghallah arXiv_CL arXiv_CL  Bert  Emotion  Medical  Language_Model  PDF
• 2021-06-25 Adapt-and-Distill: Developing Small, Fast and Effective Pretrained Language Models for Domains    Yunzhi Yao, Shaohan Huang, Wenhui Wang, Li Dong, Furu Wei arXiv_CL arXiv_CL  Bert  Knowledge  Pose  Medical  Language_Model  PDF
• 2021-06-25 iReason: Multimodal Commonsense Reasoning using Videos and Natural Language with Interpretability    Aman Chadha, Vinija Jain arXiv_AI arXiv_AI  Embedding  Video_Caption  Bert  Represenation_Learning  Knowledge  Pose  Deep_Learning  Detection  Relation  Caption  PDF
• 2021-06-24 Unsupervised Topic Segmentation of Meetings with BERT Embeddings    Alessandro Solbiati, Kevin Heffernan, Georgios Damaskinos, Shivani Poddar, Shubham Modi, Jacques Cali arXiv_CL arXiv_CL  Segmentation  Embedding  Unsupervised  Bert  PDF
• 2021-06-24 AIT-QA: Question Answering Dataset over Complex Tables in the Airline Industry    Yannis Katsis, Saneem Chemmengath, Vishwajeet Kumar, Samarth Bharadwaj, Mustafa Canim, Michael Glass, Alfio Gliozzo, Feifei Pan, Jaydeep Sen, Karthik Sankaranarayanan, Soumen Chakrabarti arXiv_AI arXiv_AI  Transformer  Bert  Zero-Shot  Pose  Relation  QA  PDF
• 2021-06-24 An Automated Knowledge Mining and Document Classification System with Multi-model Transfer Learning    Jia Wei Chong, Zhiyuan Chen, Mei Shin Oh arXiv_CL arXiv_CL  Transfer_Learning  Bert  Knowledge  Pose  Classification  PDF
• 2021-06-24 Discovering novel drug-supplement interactions using a dietary supplements knowledge graph generated from the biomedical literature    Dalton Schutte, Jake Vasilakes, Anu Bompelli, Yuqi Zhou, Marcelo Fiszman, Hua Xu, Halil Kilicoglu, Jeffrey R. Bishop, Terrence Adam, Rui Zhang arXiv_CL arXiv_CL  Bert  Knowledge  Review  Knowledge_Graph  Pose  Action  Relation  Medical  PDF
• 2021-06-23 BERT-based Multi-Task Model for Country and Province Level Modern Standard Arabic and Dialectal Arabic Identification    Abdellah El Mekki, Abdelkader El Mahdaouy, Kabil Essefar, Nabil El Mamoun, Ismail Berrada, Ahmed Khoumsi arXiv_CL arXiv_CL  Transformer  Bert  Deep_Learning  Attention  PDF
• 2021-06-23 Deep Multi-Task Model for Sarcasm Detection and Sentiment Analysis in Arabic Language    Abdelkader El Mahdaouy, Abdellah El Mekki, Kabil Essefar, Nabil El Mamoun, Ismail Berrada, Ahmed Khoumsi arXiv_CL arXiv_CL  Transformer  Bert  Knowledge  Pose  Action  Detection  Sentiment  Attention  PDF
• 2021-06-23 Classifying Textual Data with Pre-trained Vision Models through Transfer Learning and Data Transformations    Charaf Eddine Benarab arXiv_AI arXiv_AI  Embedding  Transfer_Learning  Bert  Knowledge  Pose  Sentiment  Language_Model  PDF
• 2021-06-22 LV-BERT: Exploiting Layer Variety for BERT    Weihao Yu, Zihang Jiang, Fei Chen, Qibin Hou, Jiashi Feng arXiv_AI arXiv_AI  Bert  Attention  Language_Model  PDF
• 2021-06-22 A Comprehensive Exploration of Pre-training Language Models    Tong Guo arXiv_CL arXiv_CL  Transformer  Bert  RNN  Language_Model  PDF
• 2021-06-21 Deep Learning Models in Detection of Dietary Supplement Adverse Event Signals from Twitter    Yefeng Wang, Yunpeng Zhao, Jiang Bian, Rui Zhang arXiv_CL arXiv_CL  Embedding  Bert  RNN  Knowledge  Pose  Action  Deep_Learning  Detection  Relation  Relation_Extraction  GAN  Medical  PDF
• 2021-06-21 Iterative Network Pruning with Uncertainty Regularization for Lifelong Sentiment Classification    Binzong Geng, Min Yang, Fajie Yuan, Shupeng Wang, Xiang Ao, Ruifeng Xu arXiv_AI arXiv_AI  Bert  Sentiment_Classification  Regularization  Knowledge  Review  Pose  Classification  Sentiment  PDF
• 2021-06-21 Ad Text Classification with Transformer-Based Natural Language Processing Methods    Umut Özdil, Büşra Arslan, D. Emre Taşar, Gökçe Polat, Şükrü Ozan arXiv_CL arXiv_CL  Transformer  Bert  Text_Classification  Pose  Classification  Language_Model  PDF
• 2021-06-21 Out of Context: A New Clue for Context Modeling of Aspect-based Sentiment Analysis    Bowen Xing, Ivor W. Tsang arXiv_CL arXiv_CL  Bert  RNN  Review  Pose  Action  Relation  Sentiment  Attention  PDF
• 2021-06-20 Context-Aware Legal Citation Recommendation using Deep Learning    Zihan Huang, Charles Low, Mengqiu Teng, Hongyi Zhang, Daniel E. Ho, Mark S. Krass, Matthias Grabmair arXiv_CL arXiv_CL  Bert  RNN  Deep_Learning  Recommendation  PDF
• 2021-06-19 Hybrid approach to detecting symptoms of depression in social media entries    Agnieszka Wołk, Karol Chlasta, Paweł Holas arXiv_CL arXiv_CL  Bert  Emotion  Sentiment  PDF
• 2021-06-18 BitFit: Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-models    Elad Ben Zaken, Shauli Ravfogel, Yoav Goldberg arXiv_CL arXiv_CL  Transformer  Bert  Sparse  Knowledge  PDF
• 2021-06-18 All You Can Embed: Natural Language based Vehicle Retrieval with Spatio-Temporal Transformers    Carmelo Scribano, Davide Sapienza, Giorgia Franchini, Micaela Verucchi, Marko Bertogna arXiv_CV arXiv_CV  Transformer  Embedding  Tracking  Bert  Pose  CNN  PDF
• 2021-06-18 SPBERT: Pre-training BERT on SPARQL Queries for End-to-end Question Answering over Knowledge Graphs    Hieu Tran, Long Phan, Truong-Son Nguyen arXiv_CL arXiv_CL  Transformer  Bert