Bert

Bert

• 2023-01-31 The Touch'e23-ValueEval Dataset for Identifying Human Values behind Arguments    Nailia Mirzakhmedova, Johannes Kiesel, Milad Alshomary, Maximilian Heinrich, Nicolas Handke, Xiaoni Cai, Barriere Valentin, Doratossadat Dastgheib, Omid Ghahroodi, Mohammad Ali Sadraei, Ehsaneddin Asgari, Lea Kawaletz, Henning Wachsmuth, Benno Stein arXiv_CL arXiv_CL  OCR  Bert  Classification  Detection  PDF
• 2023-01-31 TopoBERT: Plug and Play Toponym Recognition Module Harnessing Fine-tuned BERT    Bing Zhou, Lei Zou, Yingjie Hu, Yi Qiang arXiv_AI arXiv_AI  Transformer  Recognition  Bert  Pose  Action  Deep_Learning  CNN  Language_Model  PDF
• 2023-01-30 Representation biases in sentence transformers    Dmitry Nikolaev, Sebastian Padó arXiv_CL arXiv_CL  Transformer  Embedding  Bert  PDF
• 2023-01-30 Response-act Guided Reinforced Dialogue Generation for Mental Health Counseling    Aseem Srivastava, Ishan Pandey, Md. Shad Akhtar, Tanmoy Chakraborty arXiv_CL arXiv_CL  Transformer  Bert  Optimization  Pose  Quantitative  PDF
• 2023-01-30 KG-BERTScore: Incorporating Knowledge Graph into BERTScore for Reference-Free Machine Translation Evaluation    Zhanglin Wu, Min Zhang, Ming Zhu, Yinglu Li, Ting Zhu, Hao Yang, Song Peng, Ying Qin arXiv_AI arXiv_AI  Bert  Knowledge  Knowledge_Graph  Pose  Relation  Matching  PDF
• 2023-01-29 BERT-based Authorship Attribution on the Romanian Dataset called ROST    Sanda-Maria Avram arXiv_AI arXiv_AI  Bert  Sketch  Language_Model  PDF
• 2023-01-28 Semantic Tagging with LSTM-CRF    Farshad Noravesh arXiv_CL arXiv_CL  Embedding  Bert  RNN  PDF
• 2023-01-28 Multilingual Sentence Transformer as A Multilingual Word Aligner    Weikang Wang, Guanhua Chen, Hanqing Wang, Yue Han, Yun Chen arXiv_CL arXiv_CL  Transformer  Embedding  Bert  Zero-Shot  Pose  Action  Language_Model  PDF
• 2023-01-27 Context Matters: A Strategy to Pre-train Language Model for Science Education    Zhengliang Liu, Xinyu He, Lei Liu, Tianming Liu, Xiaoming Zhai arXiv_AI arXiv_AI  Transformer  Bert  Language_Model  PDF
• 2023-01-27 Understanding INT4 Quantization for Transformer Models: Latency Speedup, Composability, and Failure Cases    Xiaoxia Wu, Cheng Li, Reza Yazdani Aminabadi, Zhewei Yao, Yuxiong He arXiv_CL arXiv_CL  Transformer  Quantization  Bert  Inference  Language_Model  PDF
• 2023-01-27 Factual or Biased? Predicting Sentence-Level Factuality and Bias of News    Francielle Vargas, Fabiana Góes, Thiago A. S. Pardo, Fabrício Benevenuto arXiv_CL arXiv_CL  Bert  Pose  Face  Prediction  PDF
• 2023-01-27 A Comparative Study of Pretrained Language Models for Long Clinical Text    Yikuan Li, Ramsey M. Wehbe, Faraz S. Ahmad, Hanyin Wang, Yuan Luo arXiv_AI arXiv_AI  Transformer  Recognition  Bert  Knowledge  Pose  Classification  Attention  Inference  Language_Model  PDF
• 2023-01-27 Reading and Reasoning over Chart Images for Evidence-based Automated Fact-Checking    Mubashara Akhtar, Oana Cocarascu, Elena Simperl arXiv_CV arXiv_CV  Transformer  Bert  Pose  PDF
• 2023-01-27 Can We Use Probing to Better Understand Fine-tuning and Knowledge Distillation of the BERT NLU?    Jakub Hościłowicz, Marcin Sowański, Piotr Czubowski, Artur Janicki arXiv_CL arXiv_CL  Transformer  Bert  Knowledge  Pose  PDF
• 2023-01-27 A Multi-View Joint Learning Framework for Embedding Clinical Codes and Text Using Graph Neural Networks    Lecheng Kong, Christopher King, Bradley Fritz, Yixin Chen arXiv_AI arXiv_AI  Embedding  Bert  RNN  Pose  Action  Classification  Relation  Inference  Language_Model  PDF
• 2023-01-26 A benchmark for toxic comment classification on Civil Comments dataset    Corentin Duchene, Henri Jamet, Pierre Guillaume, Reda Dehak arXiv_CL arXiv_CL  Transformer  Bert  Optimization  RNN  Speech  Classification  Detection  CNN  Inference  PDF
• 2023-01-25 Qualitative Analysis of a Graph Transformer Approach to Addressing Hate Speech: Adapting to Dynamically Changing Content    Liam Hebert, Hong Yi Chen, Robin Cohen, Lukasz Golab arXiv_CL arXiv_CL  Transformer  Bert  Speech  Detection  Attention  PDF
• 2023-01-25 A Study on FGSM Adversarial Training for Neural Retrieval    Simon Lupart, Stéphane Clinchant arXiv_CL arXiv_CL  Bert  Sparse  Adversarial  Face  PDF
• 2023-01-25 ViDeBERTa: A powerful pre-trained language model for Vietnamese    Cong Dao Tran, Nhut Huy Pham, Anh Nguyen, Truong Son Hy, Tu Vu arXiv_CL arXiv_CL  Transformer  Recognition  Bert  Speech  Pose  Language_Model  PDF
• 2023-01-24 Semi-Automated Construction of Food Composition Knowledge Base    Jason Youn, Fangzhou Li, Ilias Tagkopoulos arXiv_AI arXiv_AI  Bert  Knowledge  Pose  Language_Model  PDF
• 2023-01-24 ViHOS: Hate Speech Spans Detection for Vietnamese    Phu Gia Hoang, Canh Duc Luu, Khanh Quoc Tran, Kiet Van Nguyen, Ngan Luu-Thuy Nguyen arXiv_CL arXiv_CL  Bert  Review  Speech  Classification  Detection  PDF
• 2023-01-24 Multitask Instruction-based Prompting for Fallacy Recognition    Tariq Alhindi, Tuhin Chakrabarty, Elena Musi, Smaranda Muresan arXiv_CL arXiv_CL  Recognition  Bert  Knowledge  PDF
• 2023-01-24 A Stability Analysis of Fine-Tuning a Pre-Trained Model    Zihao Fu, Anthony Man-Cho So, Nigel Collier arXiv_AI arXiv_AI  Unsupervised  Bert  Pose  Classification  PDF
• 2023-01-24 Truveta Mapper: A Zero-shot Ontology Alignment Framework    Mariyam Amir, Murchana Baruah, Mahsa Eslamialishah, Sina Ehsani, Alireza Bahramali, Sadra Naddaf-Sh, Saman Zarandioon arXiv_AI arXiv_AI  Transformer  Unsupervised  Bert  Zero-Shot  Pose  Ontology  Relation  Matching  PDF
• 2023-01-23 StockEmotions: Discover Investor Emotions for Financial Sentiment Analysis and Multivariate Time Series    Jean Lee, Hoyoul Luis Youn, Josiah Poon, Soyeon Caren Han arXiv_AI arXiv_AI  Bert  RNN  Pose  Emotion  Classification  Sentiment  Attention  PDF
• 2023-01-21 Nichtverbales Verhalten sozialer Roboter: Bewegungen, deren Bedeutung und die Technik dahinter    Kathrin Janowski, Elisabeth André arXiv_RO arXiv_RO  Bert  PDF
• 2023-01-20 Phoneme-Level BERT for Enhanced Prosody of Text-to-Speech with Grapheme Predictions    Yinghao Aaron Li, Cong Han, Xilin Jiang, Nima Mesgarani arXiv_CL arXiv_CL  Bert  Speech  Pose  Language_Model  Prediction  PDF
• 2023-01-20 Which Features are Learned by CodeBert: An Empirical Study of the BERT-based Source Code Representation Learning    Lan Zhang, Chen Cao, Zhilong Wang, Peng Liu arXiv_CL arXiv_CL  Transformer  Bert  Represenation_Learning  Pose  PDF
• 2023-01-19 Booster: a Benchmark for Depth from Images of Specular and Transparent Surfaces    Pierluigi Zama Ramirez, Alex Costanzino, Fabio Tosi, Matteo Poggi, Samuele Salti, Stefano Mattoccia, Luigi Di Stefano arXiv_CV arXiv_CV  Segmentation  Bert  Pose  Face  PDF
• 2023-01-19 From English to More Languages: Parameter-Efficient Model Reprogramming for Cross-Lingual Speech Recognition    Chao-Han Huck Yang, Bo Li, Yu Zhang, Nanxin Chen, Rohit Prabhavalkar, Tara N. Sainath, Trevor Strohman arXiv_AI arXiv_AI  Enhancement  Recognition  Bert  RNN  Speech  Self-Supervised  Pose  Speech_Recognition  PDF
• 2023-01-17 BERT-ERC: Fine-tuning BERT is Enough for Emotion Recognition in Conversation    Xiangyu Qin, Zhiyu Wu, Jinshi Cui, Tingting Zhang, Yanran Li, Jian Luan, Bin Wang, Li Wang arXiv_AI arXiv_AI  Recognition  Bert  Pose  Emotion  Classification  Language_Model  Prediction  PDF
• 2023-01-17 VaxxHesitancy: A Dataset for Studying Hesitancy Towards COVID-19 Vaccination on Twitter    Yida Mu, Mali Jin, Charlie Grimshaw, Carolina Scarton, Kalina Bontcheva, Xingyi Song arXiv_CL arXiv_CL  Bert  Knowledge  Action  Language_Model  PDF
• 2023-01-16 ClassBases at CASE-2022 Multilingual Protest Event Detection Tasks: Multilingual Protest News Detection and Automatically Replicating Manually Created Event Datasets    Peratham Wiriyathammabhum arXiv_CL arXiv_CL  Bert  Knowledge  Classification  Detection  PDF
• 2023-01-16 TEDB System Description to a Shared Task on Euphemism Detection 2022    Peratham Wiriyathammabhum arXiv_CL arXiv_CL  Transformer  Bert  Text_Classification  Classification  Detection  Sentiment  PDF
• 2023-01-16 Wobble control of a pendulum actuated spherical robot    Animesh Singhal, Sahil Modi, Abhishek Gupta, Leena Vachhani arXiv_RO arXiv_RO  Surveillance  Bert  Pose  PDF
• 2023-01-16 An Error-Guided Correction Model for Chinese Spelling Error Correction    Rui Sun, Xiuyu Wu, Yunfang Wu arXiv_AI arXiv_AI  Bert  Zero-Shot  Pose  Detection  PDF
• 2023-01-13 It's Just a Matter of Time: Detecting Depression with Time-Enriched Multimodal Transformers    Ana-Maria Bucur, Adrian Cosma, Paolo Rosso, Liviu P. Dinu arXiv_CL arXiv_CL  Transformer  Embedding  Bert  Pose  Action  Detection  PDF
• 2023-01-12 Improving Inference Performance of Machine Learning with the Divide-and-Conquer Principle    Alex Kogan arXiv_AI arXiv_AI  Recognition  OCR  Bert  Optical_Character  Pose  Inference  PDF
• 2023-01-11 NarrowBERT: Accelerating Masked Language Model Pretraining and Inference    Haoxin Li, Phillip Keung, Daniel Cheng, Jungo Kasai, Noah A. Smith arXiv_CL arXiv_CL  Transformer  Bert  Review  Self-Supervised  Pose  Classification  Attention  Inference  Language_Model  PDF
• 2023-01-11 Topics in Contextualised Attention Embeddings    Mozhgan Talebpour, Alba Garcia Seco de Herrera, Shoaib Jameel arXiv_CL arXiv_CL  Embedding  Bert  Knowledge  Relation  Attention  Language_Model  PDF
• 2023-01-10 Language Models sounds the Death Knell of Knowledge Graphs    Kunal Suri, Atul Singh, Prakhar Mishra, Swapna Sourav Rout, Rajesh Sabapathy arXiv_AI arXiv_AI  Recognition  Bert  Knowledge  Knowledge_Graph  Self-Supervised  Ontology  Action  Deep_Learning  Relation  Medical  Language_Model  PDF
• 2023-01-10 Scaling Laws for Generative Mixed-Modal Language Models    Armen Aghajanyan, Lili Yu, Alexis Conneau, Wei-Ning Hsu, Karen Hambardzumyan, Susan Zhang, Stephen Roller, Naman Goyal, Omer Levy, Luke Zettlemoyer arXiv_AI arXiv_AI  Bert  Speech  Action  Language_Model  PDF
• 2023-01-09 Designing BERT for Convolutional Networks: Sparse and Hierarchical Masked Modeling    Keyu Tian, Yi Jiang, Qishuai Diao, Chen Lin, Liwei Wang, Zehuan Yuan arXiv_AI arXiv_AI  Transformer  Segmentation  Point_Cloud  3D  Bert  Sparse  Contrastive_Learning  Detection  Object_Detection  CNN  PDF
• 2023-01-09 ERNIE 3.0 Tiny: Frustratingly Simple Method to Improve Task-Agnostic Distillation Generalization    Weixin Liu, Xuyi Chen, Jiaxiang Liu, Shikun Feng, Yu Sun, Hao Tian, Hua Wu arXiv_CL arXiv_CL  Bert  Knowledge  Pose  Language_Model  PDF
• 2023-01-09 FullStop:Punctuation and Segmentation Prediction for Dutch with Transformers    Vincent Vandeghinste, Oliver Guhr arXiv_AI arXiv_AI  Transformer  Segmentation  Recognition  Bert  Speech  Classification  Speech_Recognition  Language_Model  Prediction  PDF
• 2023-01-09 Online Fake Review Detection Using Supervised Machine Learning And BERT Model    Abrar Qadir Mir, Furqan Yaqub Khan, Mohammad Ahsan Chishti arXiv_AI arXiv_AI  Transformer  Embedding  Bert  Review  Pose  Classification  Detection  Attention  PDF
• 2023-01-08 InPars-Light: Cost-Effective Unsupervised Training of Efficient Rankers    Leonid Boytsov, Preksha Patel, Vivek Sourabh, Riddhi Nisar, Sayani Kundu, Ramya Ramanathan, Eric Nyberg arXiv_AI arXiv_AI  Unsupervised  Bert  Language_Model  PDF
• 2023-01-07 App Review Driven Collaborative Bug Finding    Xunzhu Tang, Haoye Tian, Pingfan Kong, Kui Liu, Jacques Klein, Tegawendé F. Bissyande arXiv_AI arXiv_AI  Embedding  Bert  Review  Pose  Matching  PDF
• 2023-01-07 RLAS-BIABC: A Reinforcement Learning-Based Answer Selection Using the BERT Model Boosted by an Improved ABC Algorithm    Hamid Gharagozlou, Javad Mohammadzadeh, Azam Bastanfard, Saeed Shiry Ghidary arXiv_AI arXiv_AI  Transformer  Embedding  Reinforcement_Learning  Bert  RNN  Pose  Classification  Attention  QA  PDF
• 2023-01-06 SAIDS: A Novel Approach for Sentiment Analysis Informed of Dialect and Sarcasm    Abdelrahman Kaseb, Mona Farouk arXiv_AI arXiv_AI  Embedding  Bert  Detection  Sentiment  Language_Model  Prediction  PDF
• 2023-01-05 Emotion-Cause Pair Extraction as Question Answering    Huu-Hiep Nguyen, Minh-Tien Nguyen arXiv_CL arXiv_CL  Bert  Pose  Emotion  Action  QA  PDF
• 2023-01-05 Adaptively Clustering Neighbor Elements for Image Captioning    Zihua Wang, Xu Yang, Haiyang Xu, Hanwang Zhang, Chenliang Li, Songfang Huang, Fei Huang, Yu Zhang arXiv_CV arXiv_CV  Image_Caption  Transformer  Bert  Attention  Caption  PDF
• 2023-01-05 Learning Trajectory-Word Alignments for Video-Language Tasks    Xu Yang, Zhangzikang Li, Haiyang Xu, Hanwang Zhang, Qinghao Ye, Chenliang Li, Ming Yan, Yu Zhang, Fei Huang, Songfang Huang arXiv_CV arXiv_CV  Transformer  Embedding  Bert  Pose  Attention  Video_Retrieval  PDF
• 2023-01-05 EPR-Net: Constructing non-equilibrium potential landscape via a variational force projection formulation    Yue Zhao, Wei Zhang, Tiejun Li arXiv_AI arXiv_AI  Bert  Pose  Deep_Learning  PDF
• 2023-01-05 The political ideology of conversational AI: Converging evidence on ChatGPT's pro-environmental, left-libertarian orientation    Jochen Hartmann, Jasper Schwenzow, Maximilian Witte arXiv_CL arXiv_CL  OCR  Bert  Pose  Attention  PDF
• 2023-01-03 PIE-QG: Paraphrased Information Extraction for Unsupervised Question Generation from Small Corpora    Dinesh Nagumothu, Bahadorreza Ofoghi, Guangyan Huang, Peter W. Eklund arXiv_AI arXiv_AI  Unsupervised  Bert  Knowledge  Action  Language_Model  QA  PDF
• 2023-01-02 What is Cognitive Computing? An Architecture and State of The Art    Samaa Elnagar, Manoj A. Thomas, Kweku-Muata Osei-Bryson arXiv_AI arXiv_AI  Bert  Pose  Survey  PDF
• 2023-01-02 Russia-Ukraine war: Modeling and Clustering the Sentiments Trends of Various Countries    Hamed Vahdat-Nejad, Mohammad Ghasem Akbari, Fatemeh Salmani, Faezeh Azizi, Hamid-Reza Nili-Sani arXiv_CL arXiv_CL  Bert  Pose  Sentiment  PDF
• 2023-01-01 Integrating Semantic Information into Sketchy Reading Module of Retro-Reader for Vietnamese Machine Reading Comprehension    Hang Thi-Thu Le, Viet-Duc Ho, Duc-Vu Nguyen, Ngan Luu-Thuy Nguyen arXiv_CL arXiv_CL  Bert  Sketch  Classification  Language_Model  PDF
• 2023-01-01 Leveraging Semantic Representations Combined with Contextual Word Representations for Recognizing Textual Entailment in Vietnamese    Quoc-Loc Duong, Duc-Vu Nguyen, Ngan Luu-Thuy Nguyen arXiv_CL arXiv_CL  Bert  Represenation_Learning  Pose  PDF
• 2023-01-01 Floods Relevancy and Identification of Location from Twitter Posts using NLP Techniques    Muhammad Suleman, Muhammad Asif, Tayyab Zamir, Ayaz Mehmood, Jebran Khan, Nasir Ahmad, Kashif Ahmad arXiv_CL arXiv_CL  Recognition  Bert  Pose  Action  Classification  PDF
• 2022-12-31 Towards Proactively Forecasting Sentence-Specific Information Popularity within Online News Documents    Sayar Ghosh Roy, Anshul Padhi, Risubh Jain, Manish Gupta, Vasudeva Varma arXiv_AI arXiv_AI  Transfer_Learning  Bert  Knowledge  Pose  Attention  Prediction  PDF
• 2022-12-30 On the Inconsistencies of Conditionals Learned by Masked Language Models    Tom Young, Yang You arXiv_AI arXiv_AI  Bert  Language_Model  PDF
• 2022-12-30 Distant Reading of the German Coalition Deal: Recognizing Policy Positions with BERT-based Text Classification    Michael Zylla, Thomas Haider arXiv_CL arXiv_CL  Bert  Text_Classification  Classification  PDF
• 2022-12-29 Examining Political Rhetoric with Epistemic Stance Detection    Ankita Gupta, Su Lin Blodgett, Justin H Gross, Brendan O'Connor arXiv_CL arXiv_CL  Bert  Pose  Detection  Prediction  PDF
• 2022-12-28 Cramming: Training a Language Model on a Single GPU in One Day    Jonas Geiping, Tom Goldstein arXiv_CL arXiv_CL  Transformer  Bert  Language_Model  PDF
• 2022-12-28 Data Augmentation using Transformers and Similarity Measures for Improving Arabic Text Classification    Dania Refai, Saleh Abo-Soud, Mohammad Abdel-Rahman arXiv_CL arXiv_CL  Transformer  Bert  Sentiment_Classification  Text_Classification  Pose  Classification  Sentiment  Prediction  PDF
• 2022-12-28 Automatic Recognition and Classification of Future Work Sentences from Academic Articles in a Specific Domain    Chengzhi Zhang, Yi Xiang, Wenke Hao, Zhicheng Li, Yuchen Qian, Yuzhuo Wang arXiv_CL arXiv_CL  Recognition  Bert  Pose  Classification  PDF
• 2022-12-27 A Survey on Knowledge-Enhanced Pre-trained Language Models    Chaoqi Zhen, Yanlei Shang, Xiangyu Liu, Yifei Li, Yong Chen, Dell Zhang arXiv_CL arXiv_CL  Bert  Knowledge  Face  Survey  Language_Model  PDF
• 2022-12-27 DeepCuts: Single-Shot Interpretability based Pruning for BERT    Jasdeep Singh Grover, Bhavesh Gawri, Ruskin Raj Manku arXiv_CL arXiv_CL  Transformer  Bert  Pose  Language_Model  PDF
• 2022-12-23 MicroBERT: Effective Training of Low-resource Monolingual BERTs through Parameter Reduction and Multitask Learning    Luke Gessler, Amir Zeldes arXiv_CL arXiv_CL  Transformer  Bert  Speech  Language_Model  PDF
• 2022-12-23 Benchmark for Uncertainty & Robustness in Self-Supervised Learning    Ha Manh Bui, Iliana Maifeld-Carucci arXiv_CV arXiv_CV  Transformer  Bert  Self-Supervised  Classification  Language_Model  Prediction  PDF
• 2022-12-23 Finetuning for Sarcasm Detection with a Pruned Dataset    Ishita Goyal, Priyank Bhandia, Sanjana Dulam arXiv_AI arXiv_AI  Bert  Detection  PDF
• 2022-12-22 Enhancing the prediction of disease outcomes using electronic health records and pretrained deep learning models    Zhichao Yang, Weisong Liu, Dan Berlowitz, Hong Yu arXiv_AI arXiv_AI  Bert  Deep_Learning  Denoising  Prediction  PDF
• 2022-12-22 CAMeMBERT: Cascading Assistant-Mediated Multilingual BERT    Dan DeGenaro, Jugal Kalita arXiv_CL arXiv_CL  Bert  Knowledge  Pose  Language_Model  PDF
• 2022-12-21 Cross-Linguistic Syntactic Difference in Multilingual BERT: How Good is It and How Does It Affect Transfer?    Ningyu Xu, Tao Gui, Ruotian Ma, Qi Zhang, Jingting Ye, Menghan Zhang, Xuanjing Huang arXiv_CL arXiv_CL  Bert  Zero-Shot  Knowledge  Relation  PDF
• 2022-12-21 KL Regularized Normalization Framework for Low Resource Tasks    Neeraj Kumar, Ankur Narang, Brejesh Lall arXiv_AI arXiv_AI  Bert  Regularization  Speech  Pose  PDF
• 2022-12-21 Towards Efficient Visual Simplification of Computational Graphs in Deep Neural Networks    Rusheng Pan, Zhiyong Wang, Yating Wei, Han Gao, Gongchang Ou, Caleb Chen Cao, Jingli Xu, Tong Xu, Wei Chen arXiv_AI arXiv_AI  Bert  Pose  PDF
• 2022-12-21 Spoken Language Understanding for Conversational AI: Recent Advances and Future Direction    Soyeon Caren Han, Siqu Long, Henry Weld, Josiah Poon arXiv_AI arXiv_AI  Transformer  Bert  Pose  Action  Classification  Deep_Learning  Detection  Attention  PDF
• 2022-12-21 Analyzing Semantic Faithfulness of Language Models via Input Intervention on Conversational Question Answering    Akshay Chaturvedi, Swarnadeep Bhar, Soumadeep Saha, Utpal Garain, Nicholas Asher arXiv_CL arXiv_CL  Transformer  Bert  Pose  Inference  Language_Model  PDF
• 2022-12-20 Pretraining Without Attention    Junxiong Wang, Jing Nathan Yan, Albert Gu, Alexander M. Rush arXiv_CL arXiv_CL  Transformer  Bert  Pose  Attention  PDF
• 2022-12-20 Parameter-efficient Zero-shot Transfer for Cross-Language Dense Retrieval with Adapters    Eugene Yang, Suraj Nair, Dawn Lawrie, James Mayfield, Douglas W. Oard arXiv_CL arXiv_CL  Transformer  Bert  Zero-Shot  Pose  Inference  Language_Model  PDF
• 2022-12-20 AnnoBERT: Effectively Representing Multiple Annotators' Label Choices to Improve Hate Speech Detection    Wenjie Yin, Vibhor Agarwal, Aiqi Jiang, Arkaitz Zubiaga, Nishanth Sastry arXiv_CL arXiv_CL  Transformer  Embedding  Bert  Speech  Pose  Detection  PDF
• 2022-12-20 Extrinsic Evaluation of Machine Translation Metrics    Nikita Moghe, Tom Sherborne, Mark Steedman, Alexandra Birch arXiv_AI arXiv_AI  Tracking  Bert  Relation  PDF
• 2022-12-20 Identifying and Manipulating the Personality Traits of Language Models    Graham Caron, Shashank Srivastava arXiv_AI arXiv_AI  Bert  Emotion  Language_Model  PDF
• 2022-12-20 In and Out-of-Domain Text Adversarial Robustness via Label Smoothing    Yahan Yang, Soham Dan, Dan Roth, Insup Lee arXiv_CL arXiv_CL  Bert  Regularization  Adversarial  Pose  Relation  Language_Model  Prediction  PDF
• 2022-12-20 Pre-trained Language Models for Keyphrase Generation: A Thorough Empirical Study    Di Wu, Wasi Uddin Ahmad, Kai-Wei Chang arXiv_CL arXiv_CL  Transformer  Bert  Knowledge  Action  Language_Model  PDF
• 2022-12-20 Naamapadam: A Large-Scale Named Entity Annotated Data for Indic Languages    Arnav Mhaske, Harshit Kedia, Sumanth Doddapaneni, Mitesh M. Khapra, Pratyush Kumar, Rudra Murthy V, Anoop Kunchukuttan arXiv_CL arXiv_CL  Recognition  Bert  GAN  PDF
• 2022-12-20 Quirk or Palmer: A Comparative Study of Modal Verb Frameworks with Annotated Datasets    Risako Owan, Maria Gini, Dongyeop Kang arXiv_CL arXiv_CL  Bert  PDF
• 2022-12-20 Exploring Effective Fusion Algorithms for Speech Based Self-Supervised Learning Models    Changli Tang, Yujin Wang, Xie Chen, Wei-Qiang Zhang arXiv_SD arXiv_SD  Recognition  Bert  Speech  Self-Supervised  Pose  Speech_Recognition  PDF
• 2022-12-20 Hybrid Rule-Neural Coreference Resolution System based on Actor-Critic Learning    Yu Wang, Hongxia Jin arXiv_CL arXiv_CL  Bert  Pose  Detection  PDF
• 2022-12-20 Rumour detection using graph neural network and oversampling in benchmark Twitter dataset    Shaswat Patel, Prince Bansal, Preeti Kaur arXiv_CL arXiv_CL  Bert  Pose  Detection  PDF
• 2022-12-20 A Twitter BERT Approach for Offensive Language Detection in Marathi    Tanmay Chavan, Shantanu Patankar, Aditya Kane, Omkar Gokhale, Raviraj Joshi arXiv_CL arXiv_CL  Bert  Text_Classification  Speech  Classification  Detection  PDF
• 2022-12-20 On the Blind Spots of Model-Based Evaluation Metrics for Text Generation    Tianxing He, Jingyu Zhang, Tianle Wang, Sachin Kumar, Kyunghyun Cho, James Glass, Yulia Tsvetkov arXiv_CL arXiv_CL  Bert  Pose  Summarization  Text_Generation  Language_Model  PDF
• 2022-12-20 Is Self-Attention Powerful to Learn Code Syntax and Semantics?    Wei Ma, Mengjie Zhao, Xiaofei Xie, Qiang Hu, Shangqing Liu, Jie Zhang, Wenhan Wang, Yang Liu, arXiv_AI arXiv_AI  Transformer  Bert  Knowledge  Pose  Relation  Attention  Inference  Language_Model  PDF
• 2022-12-19 MANTIS at TSAR-2022 Shared Task: Improved Unsupervised Lexical Simplification with Pretrained Encoders    Xiaofei Li, Daniel Wiechmann, Yu Qiao, Elma Kerz arXiv_CL arXiv_CL  Transformer  Unsupervised  Bert  Language_Model  PDF
• 2022-12-19 Exploring Hybrid and Ensemble Models for Multiclass Prediction of Mental Health Status on Social Media    Sourabh Zanwar, Daniel Wiechmann, Yu Qiao, Elma Kerz arXiv_CL arXiv_CL  Transformer  Bert  RNN  Emotion  Classification  Detection  Sentiment  Attention  Activity  Prediction  PDF
• 2022-12-19 Do CoNLL-2003 Named Entity Taggers Still Work Well in 2023?    Shuheng Liu, Alan Ritter arXiv_CL arXiv_CL  Transformer  Embedding  Recognition  Bert  PDF
• 2022-12-19 Don't Generate, Discriminate: A Proposal for Grounding Language Models to Real-World Environments    Yu Gu, Xiang Deng, Yu Su arXiv_AI arXiv_AI  Bert  Knowledge  Pose  Few-Shot  Language_Model  QA  PDF
• 2022-12-19 Words as Gatekeepers: Measuring Discipline-specific Terms and Meanings in Scholarly Publications    Li Lucy, Jesse Dodge, David Bamman, Katherine A. Keith arXiv_CL arXiv_CL  Bert  Pose  Relation  PDF
• 2022-12-19 Improving the Generalizability of Text-Based Emotion Detection by Leveraging Transformers with Psycholinguistic Features    Sourabh Zanwar, Daniel Wiechmann, Yu Qiao, Elma Kerz arXiv_CL arXiv_CL  Transformer  Transfer_Learning  Recognition  Bert  RNN  Pose  Emotion  Face  Detection  Sentiment  PDF
• 2022-12-19 Less is More: Parameter-Free Text Classification with Gzip    Zhiying Jiang, Matthew Y.R. Yang, Mikhail Tsirlin, Raphael Tang, Jimmy Lin arXiv_CL arXiv_CL  Transformer  Bert  Text_Classification  Pose  Classification  Deep_Learning  Few-Shot  PDF
• 2022-12-19 Enriching Relation Extraction with OpenIE    Alessandro Temperoni, Maria Biryukov, Martin Theobald arXiv_CL arXiv_CL  Recognition  Bert  Knowledge  Action  Relation  Relation_Extraction  Language_Model  Prediction  PDF
• 2022-12-18 Neural Coreference Resolution based on Reinforcement Learning    Yu Wang, Hongxia Jin arXiv_CL arXiv_CL  Reinforcement_Learning  Bert  Pose  Detection  PDF
• 2022-12-18 Neural Rankers for Effective Screening Prioritisation in Medical Systematic Review Literature Search    Shuai Wang, Harrisen Scells, Bevan Koopman, Guido Zuccon arXiv_AI arXiv_AI  Bert  Review  Medical  Language_Model  PDF
• 2022-12-17 Exploiting Rich Textual User-Product Context for Improving Sentiment Analysis    Chenyang Lyu, Linyi Yang, Yue Zhang, Yvette Graham, Jennifer Foster arXiv_CL arXiv_CL  Bert  Review  Sentiment  Prediction  PDF
• 2022-12-16 Plansformer: Generating Symbolic Plans using Transformers    Vishal Pallagani, Bharath Muppasani, Keerthiram Murugesan, Francesca Rossi, Lior Horesh, Biplav Srivastava, Francesco Fabiano, Andrea Loreggia arXiv_AI arXiv_AI  Transformer  Transfer_Learning  Bert  Knowledge  Action  Summarization  Text_Generation  Autonomous  Language_Model  PDF
• 2022-12-16 Estimating truncation effects of quantum bosonic systems using sampling algorithms    Masanori Hanada, Junyu Liu, Enrico Rinaldi, Masaki Tezuka arXiv_AI arXiv_AI  Bert  PDF
• 2022-12-16 Experiments on Generalizability of BERTopic on Multi-Domain Short Text    Muriël de Groot, Mohammad Aliannejadi, Marcel R. Haas arXiv_CL arXiv_CL  Bert  PDF
• 2022-12-16 POIBERT: A Transformer-based Model for the Tour Recommendation Problem    Ngai Lam Ho, Kwan Hui Lim arXiv_AI arXiv_AI  Transformer  Bert  Pose  Language_Model  Prediction  Recommendation  PDF
• 2022-12-16 Deep Learning Methods for Calibrated Photometric Stereo and Beyond: A Survey    Yakun Ju, Kin-Man Lam, Wuyuan Xie, Huiyu Zhou, Junyu Dong, Boxin Shi arXiv_AI arXiv_AI  Reconstruction  Bert  Review  Pose  Face  Survey  Deep_Learning  Relation  PDF
• 2022-12-16 Utilizing distilBert transformer model for sentiment classification of COVID-19's Persian open-text responses    Fatemeh Sadat Masoumi, Mohammad Bahrani arXiv_CL arXiv_CL  Transformer  Bert  Sentiment_Classification  Pose  Survey  Classification  Sentiment  PDF
• 2022-12-16 Lessons learned from the evaluation of Spanish Language Models    Rodrigo Agerri, Eneko Agirre arXiv_AI arXiv_AI  Transformer  Bert  Pose  Face  Activity  Language_Model  PDF
• 2022-12-16 ReCo: Reliable Causal Chain Reasoning via Structural Causal Recurrent Neural Networks    Kai Xiong, Xiao Ding, Zhongyang Li, Li Du, Bing Qin, Yi Zheng, Baoxing Huai arXiv_AI arXiv_AI  Bert  RNN  Knowledge  Pose  PDF
• 2022-12-16 Investigation of Japanese PnG BERT language model in text-to-speech synthesis for pitch accent language    Yusuke Yasuda, Tomoki Toda arXiv_CL arXiv_CL  Bert  Speech  Self-Supervised  Language_Model  Prediction  PDF
• 2022-12-16 LegalRelectra: Mixed-domain Language Modeling for Long-range Legal Text Comprehension    Wenyue Hua, Yuchen Zhang, Zhe Chen, Josie Li, Melanie Weber arXiv_CL arXiv_CL  Bert  Pose  Medical  Language_Model  PDF
• 2022-12-15 Saved You A Click: Automatically Answering Clickbait Titles    Oliver Johnson, Beicheng Lou, Janet Zhong, Andrey Kurenkov arXiv_CL arXiv_CL  Bert  Face  PDF
• 2022-12-15 DAMP: Doubly Aligned Multilingual Parser for Task-Oriented Dialogue    William Held, Christopher Hidey, Fei Liu, Eric Zhu, Rahul Goel, Diyi Yang, Rushin Shah arXiv_CL arXiv_CL  Bert  Zero-Shot  Optimization  Adversarial  Action  PDF
• 2022-12-15 Visually-augmented pretrained language models for NLP tasks without images    Hangyu Guo, Kun Zhou, Wayne Xin Zhao, Qinyu Zhang, Ji-Rong Wen arXiv_CL arXiv_CL  Transformer  Bert  Knowledge  Self-Supervised  Pose  Attention  Language_Model  QA  PDF
• 2022-12-15 The Effects of In-domain Corpus Size on pre-training BERT    Chris Sanchez, Zheyuan Zhang arXiv_CL arXiv_CL  Transformer  Bert  Medical  Language_Model  PDF
• 2022-12-15 MASTER: Multi-task Pre-trained Bottlenecked Masked Autoencoders are Better Dense Retrievers    Kun Zhou, Xiao Liu, Yeyun Gong, Wayne Xin Zhao, Daxin Jiang, Nan Duan, Ji-Rong Wen arXiv_CL arXiv_CL  Transformer  Bert  Knowledge  Pose  Relation  PDF
• 2022-12-15 FreCDo: A Large Corpus for French Cross-Domain Dialect Identification    Mihaela Gaman, Adrian-Gabriel Chifu, William Domingues, Radu Tudor Ionescu arXiv_CL arXiv_CL  Bert  Quantitative  PDF
• 2022-12-15 Using Two Losses and Two Datasets Simultaneously to Improve TempoWiC Accuracy    Mohammad Javad Pirhadi, Motahhare Mirzaei, Sauleh Eetemadi arXiv_AI arXiv_AI  Bert  Classification  Language_Model  PDF
• 2022-12-15 Efficient Pre-training of Masked Language Model via Concept-based Curriculum Masking    Mingyu Lee, Jun-Hyung Park, Junho Kim, Kang-Min Kim, SangKeun Lee arXiv_CL arXiv_CL  Transformer  Bert  Knowledge  Knowledge_Graph  Pose  Language_Model  PDF
• 2022-12-14 Efficient Self-supervised Learning with Contextualized Target Representations for Vision, Speech and Language    Alexei Baevski, Arun Babu, Wei-Ning Hsu, Michael Auli arXiv_CL arXiv_CL  Transformer  Recognition  Bert  Speech  Self-Supervised  Classification  Speech_Recognition  CNN  Image_Classification  PDF
• 2022-12-14 VTCC-NLP at NL4Opt competition subtask 1: An Ensemble Pre-trained language models for Named Entity Recognition    Xuan-Dung Doan arXiv_CL arXiv_CL  Embedding  Recognition  Bert  Pose  Language_Model  PDF
• 2022-12-14 Multi-task Learning for Cross-Lingual Sentiment Analysis    Gaurish Thakkar, Nives Mikelic Preradovic, Marko Tadic arXiv_CL arXiv_CL  Bert  Sentiment_Classification  Zero-Shot  Pose  Classification  Sentiment  Few-Shot  PDF
• 2022-12-14 Explainability of Text Processing and Retrieval Methods: A Critical Survey    Sourav Saha, Debapriyo Majumdar, Mandar Mitra arXiv_AI arXiv_AI  Transformer  Embedding  Bert  Survey  Deep_Learning  Attention  PDF
• 2022-12-14 Efficient Speech Representation Learning with Low-Bit Quantization    Ching-Feng Yeh, Wei-Ning Hsu, Paden Tomasello, Abdelrahman Mohamed arXiv_CL arXiv_CL  Quantization  Bert  Represenation_Learning  Speech  PDF
• 2022-12-14 Disentangling Prosody Representations with Unsupervised Speech Reconstruction    Leyuan Qu, Taihao Li, Cornelius Weber, Theresa Pekarek-Rosin, Fuji Ren, Stefan Wermter arXiv_SD arXiv_SD  Reconstruction  Embedding  Unsupervised  Recognition  Bert  Speech  Pose  Emotion  Speech_Recognition  PDF
• 2022-12-13 Collision probability reduction method for tracking control in automatic docking / berthing using reinforcement learning    Kouki Wakita, Youhei Akimoto, Dimas M. Rachman, Yoshiki Miyauchi, Umeda Naoya, Atsuo Maki arXiv_RO arXiv_RO  Tracking  Reinforcement_Learning  Bert  Pose  PDF
• 2022-12-12 A Pre-Trained BERT Model for Android Applications    Tiezhu Sun (1), Kevin Allix (1), Kisub Kim (2), Xin Zhou (2), Dongsun Kim (3), David Lo (2), Tegawendé F. Bissyandé (1), Jacques Klein (1) ((1) University of Luxembourg, (2) Singapore Management University, (3) Kyungpook National University) arXiv_AI arXiv_AI  Bert  Represenation_Learning  Pose  Language_Model  Prediction  PDF
• 2022-12-12 MaNLP@SMM4H22: BERT for Classification of Twitter Posts    Keshav Kapur, Rajitha Harikrishnan arXiv_CL arXiv_CL  Bert  Classification  GAN  PDF
• 2022-12-12 Page Layout Analysis of Text-heavy Historical Documents: a Comparison of Textual and Visual Approaches    Najem-Meyer Sven, Romanello Matteo arXiv_CL arXiv_CL  Transformer  Bert  Detection  PDF
• 2022-12-11 IndicXTREME: A Multi-Task Benchmark For Evaluating Indic Languages    Sumanth Doddapaneni, Rahul Aralikatte, Gowtham Ramesh, Shreya Goyal, Mitesh M. Khapra, Anoop Kunchukuttan, Pratyush Kumar arXiv_CL arXiv_CL  Bert  Zero-Shot  Knowledge  Language_Model  PDF
• 2022-12-10 Punctuation Restoration for Singaporean Spoken Languages: English, Malay, and Mandarin    Abhinav Rao, Ho Thi-Nga, Chng Eng-Siong arXiv_CL arXiv_CL  Transformer  Bert  Restoration  Knowledge  Pose  Language_Model  PDF
• 2022-12-10 Artificial Text Detection with Multiple Training Strategies    Bin Li, Yixuan Weng, Qiya Song, Hanjun Deng arXiv_AI arXiv_AI  Bert  Review  Pose  Deep_Learning  Detection  Language_Model  PDF
• 2022-12-09 Incorporating Emotions into Health Mention Classification Task on Social Media    Olanrewaju Tahir Aduragba, Jialin Yu, Alexandra I. Cristea arXiv_CL arXiv_CL  Tracking  Bert  Knowledge  Emotion  Classification  PDF
• 2022-12-09 CKG: Dynamic Representation Based on Context and Knowledge Graph    Xunzhu Tang, Tiezhu Sun, Rujie Zhu, Shi Wang arXiv_CL arXiv_CL  Bert  Knowledge  Knowledge_Graph  Pose  PDF
• 2022-12-08 Explain to me like I am five -- Sentence Simplification Using Transformers    Aman Agarwal arXiv_CL arXiv_CL  Transformer  Bert  PDF
• 2022-12-08 Fresnel Microfacet BRDF: Unification of Polari-Radiometric Surface-Body Reflection    Tomoki Ichikawa, Yoshiki Fukao, Shohei Nobuhara, Ko Nishino arXiv_CV arXiv_CV  Bert  Face  PDF
• 2022-12-08 BEVBert: Topo-Metric Map Pre-training for Language-guided Navigation    Dong An, Yuankai Qi, Yangguang Li, Yan Huang, Liang Wang, Tieniu Tan, Jing Shao arXiv_AI arXiv_AI  Transformer  Bert  Pose  PDF
• 2022-12-07 TweetDrought: A Deep-Learning Drought Impacts Recognizer based on Twitter Data    Beichen Zhang, Frank Schilder, Kelly Helm Smith, Michael J. Hayes, Sherri Harms, Tsegaye Tadesse arXiv_CL arXiv_CL  Transformer  Transfer_Learning  Bert  Prediction  PDF
• 2022-12-07 A Study on Extracting Named Entities from Fine-tuned vs. Differentially Private Fine-tuned BERT Models    Andor Diera, Nicolas Lell, Aygul Garifullina, Ansgar Scherp arXiv_CL arXiv_CL  Bert  Text_Classification  Action  Classification  Deep_Learning  Text_Generation  Language_Model  PDF
• 2022-12-07 DeepSpeed Data Efficiency: Improving Deep Learning Model Quality and Training Efficiency via Efficient Data Sampling and Routing    Conglong Li, Zhewei Yao, Xiaoxia Wu, Minjia Zhang, Yuxiong He arXiv_AI arXiv_AI  Bert  Pose  Deep_Learning  Language_Model  PDF
• 2022-12-07 SimVTP: Simple Video Text Pre-training with Masked Autoencoders    Yue Ma, Tianyu Yang, Yin Shan, Xiu Li arXiv_CV arXiv_CV  Transformer  Reconstruction  Bert  Contrastive_Learning  Matching  PDF
• 2022-12-07 Improved Speech Pre-Training with Supervision-Enhanced Acoustic Unit    Pengcheng Li, Genshun Wan, Fenglin Ding, Hang Chen, Jianqing Gao, Jia Pan, Cong Liu arXiv_SD arXiv_SD  Transformer  Recognition  Bert  Speech  Self-Supervised  Pose  Speech_Recognition  PDF
• 2022-12-07 Progressive Multi-Scale Self-Supervised Learning for Speech Recognition    Genshun Wan, Tan Liu, Hang Chen, Jia Pan, Cong Liu, Zhongfu Ye arXiv_SD arXiv_SD  Recognition  Bert  Speech  Self-Supervised  Pose  Attention  Speech_Recognition  PDF
• 2022-12-06 Style transfer and classification in hebrew news items    Nir Weingarten arXiv_CL arXiv_CL  Transformer  Style_Transfer  Bert  Classification  Text_Generation  PDF
• 2022-12-06 SODA: A Natural Language Processing Package to Extract Social Determinants of Health for Cancer Studies    Zehao Yu, Xi Yang, Chong Dang, Prakash Adekkanattu, Braja Gopal Patra, Yifan Peng, Jyotishman Pathak, Debbie L. Wilson, Ching-Yuan Chang, Wei-Hsuan Lo-Ciganic, Thomas J. George, William R. Hogan, Yi Guo, Jiang Bian, Yonghui Wu arXiv_AI arXiv_AI  Transformer  Bert  Action  PDF
• 2022-12-06 Proximal methods for point source localisation    Tuomo Valkonen arXiv_CV arXiv_CV  Bert  PDF
• 2022-12-06 CySecBERT: A Domain-Adapted Language Model for the Cybersecurity Domain    Markus Bayer, Philipp Kuehn, Ramin Shanehsaz, Christian Reuter arXiv_CL arXiv_CL  Bert  Knowledge  Classification  Language_Model  PDF
• 2022-12-06 Modern French Poetry Generation with RoBERTa and GPT-2    Mika Hämäläinen, Khalid Alnajjar, Thierry Poibeau arXiv_CL arXiv_CL  Bert  Emotion  PDF
• 2022-12-06 Self-Supervised Audio-Visual Speech Representations Learning By Multimodal Self-Distillation    Jing-Xuan Zhang, Genshun Wan, Zhen-Hua Ling, Jia Pan, Jianqing Gao, Cong Liu arXiv_SD arXiv_SD  Bert  Speech  Self-Supervised  Pose  Language_Model  PDF
• 2022-12-06 Automated Identification of Eviction Status from Electronic Health Record Notes    Zonghai Yao, Jack Tsai, Weisong Liu, David A. Levy, Emily Druhl, Joel I Reisman, Hong Yu arXiv_CL arXiv_CL  Bert  Knowledge  Classification  Language_Model  Prediction  PDF
• 2022-12-06 LUNA: Language Understanding with Number Augmentations on Transformers via Number Plugins and Pre-training    Hongwei Han, Jialiang Xu, Mengyu Zhou, Yijia Shao, Shi Han, Dongmei Zhang arXiv_CL arXiv_CL  Transformer  Embedding  Bert  Knowledge  Pose  Language_Model  QA  PDF
• 2022-12-06 Enabling and Accelerating Dynamic Vision Transformer Inference for Real-Time Applications    Kavya Sreedhar, Jason Clemons, Rangharajan Venkatesan, Stephen W. Keckler, Mark Horowitz arXiv_CV arXiv_CV  Transformer  Segmentation  Semantic_Segmentation  Bert  Deep_Learning  Attention  Inference  PDF
• 2022-12-05 Inverting Cryptographic Hash Functions via Cube-and-Conquer    Oleg Zaikin arXiv_AI arXiv_AI  Bert  Pose  PDF
• 2022-12-05 Construction of Object Boundaries for the Autopilotof a Surface Robot from Satellite Imagesusing Computer Vision Methods    Aleksandr N. Grekov (1) (2), Yurii E. Shishkin (1), Sergei S. Peliushenko (1), Aleksandr S. Mavrin (1) (2), ((1) Institute of Natural and Technical Systems, (2) Sevastopol State University) arXiv_CV arXiv_CV  Bert  Pose  Face  Contour  PDF
• 2022-12-05 Video Games as a Corpus: Sentiment Analysis using Fallout New Vegas Dialog    Mika Hämäläinen, Khalid Alnajjar, Thierry Poibeau arXiv_CL arXiv_CL  Bert  Sentiment  PDF
• 2022-12-05 Human-in-the-Loop Hate Speech Classification in a Multilingual Context    Ana Kotarcic, Dominik Hangartner, Fabrizio Gilardi, Selina Kurer, Karsten Donnay arXiv_CL arXiv_CL  Bert  Speech  Pose  Classification  PDF
• 2022-12-05 Inspired by Norbert Wiener: FeedBack Loop Network Learning Incremental Knowledge for Driver Attention Prediction and Beyond    Yilong Chen, Zhixiong Nan arXiv_CV arXiv_CV  Transformer  Bert  Salient  Knowledge  Pose  Attention  Autonomous  Prediction  PDF
• 2022-12-05 QBERT: Generalist Model for Processing Questions    Zhaozhen Xu, Nello Cristianini arXiv_AI arXiv_AI  Embedding  Recognition  Bert  Classification  PDF
• 2022-12-04 Applying Multilingual Models to Question Answering    Ayrton San Joaquin, Filip Skubacz arXiv_CL arXiv_CL  Bert  Zero-Shot  Language_Model  QA  PDF
• 2022-12-04 Cross-lingual Similarity of Multilingual Representations Revisited    Maksym Del, Mark Fishel arXiv_AI arXiv_AI  Bert  Zero-Shot  Relation  Language_Model  PDF
• 2022-12-04 Languages You Know Influence Those You Learn: Impact of Language Characteristics on Multi-Lingual Text-to-Text Transfer    Benjamin Muller, Deepanshu Gupta, Siddharth Patwardhan, Jean-Philippe Fauconnier, David Vandyke, Sachin Agarwal arXiv_AI arXiv_AI  Transformer  Bert  Zero-Shot  Knowledge  Few-Shot  Language_Model  PDF
• 2022-12-03 Unsupervised Fine-Tuning Data Selection for ASR Using Self-Supervised Speech Models    Reem Gody, David Harwath arXiv_CL arXiv_CL  Transformer  Unsupervised  Recognition  Bert  Speech  Self-Supervised  Relation  Speech_Recognition  PDF
• 2022-12-02 Twitter Data Analysis: Izmir Earthquake Case    Özgür Agrali, Hakan Sökün, Enis Karaarslan arXiv_AI arXiv_AI  Transformer  Bert  Pose  Relation  Sentiment  GAN  Inference  PDF
• 2022-12-02 ColD Fusion: Collaborative Descent for Distributed Multitask Finetuning    Shachar Don-Yehiya, Elad Venezian, Colin Raffel, Noam Slonim, Yoav Katz, Leshem Choshen arXiv_CL arXiv_CL  Bert  Self-Supervised  Pose  PDF
• 2022-12-01 Analogical Math Word Problems Solving with Enhanced Problem-Solution Association    Zhenwen Liang, Jipeng Zhang, Xiangliang Zhang arXiv_AI arXiv_AI  Bert  Pose  Relation  PDF
• 2022-12-01 CliMedBERT: A Pre-trained Language Model for Climate and Health-related Text    B. Jalalzadeh Fard, S. A. Hasan, J. E. Bell arXiv_CL arXiv_CL  Bert  Knowledge  Pose  Action  Relation  Relation_Extraction  Text_Generation  Language_Model  PDF
• 2022-12-01 Adapted Multimodal BERT with Layer-wise Fusion for Sentiment Analysis    Odysseas S. Chlapanis, Georgios Paraskevopoulos, Alexandros Potamianos arXiv_CV arXiv_CV  Bert  Pose  Classification  Sentiment  Language_Model  PDF
• 2022-12-01 CultureBERT: Fine-Tuning Transformer-Based Language Models for Corporate Culture    Sebastian Koch, Stefan Pasch arXiv_CL arXiv_CL  Transformer  Bert  Text_Classification  Review  Classification  Language_Model  Prediction  PDF
• 2022-12-01 CHAPTER: Exploiting Convolutional Neural Network Adapters for Self-supervised Speech Models    Zih-Ching Chen, Yu-Shun Sung, Hung-yi Lee arXiv_CL arXiv_CL  Transformer  Bert  Speech  Self-Supervised  Pose  Emotion  CNN  PDF
• 2022-11-30 Task-Specific Embeddings for Ante-Hoc Explainable Text Classification    Kishaloy Halder, Josip Krapac, Alan Akbik, Anthony Brew, Matti Lyra arXiv_CL arXiv_CL  Transformer  Embedding  Bert  Text_Classification  Pose  Classification  PDF
• 2022-11-30 Topological Data Analysis for Speech Processing    Eduard Tulchinskii, Kristian Kuznetsov, Laida Kushnareva, Daniil Cherniavskii, Serguei Barannikov, Irina Piontkovskaya, Sergey Nikolenko, Evgeny Burnaev arXiv_CL arXiv_CL  Transformer  Embedding  Bert  Speech  Pose  Classification  Attention  Prediction  PDF
• 2022-11-30 ExtremeBERT: A Toolkit for Accelerating Pretraining of Customized BERT    Rui Pan, Shizhe Diao, Jianlin Chen, Tong Zhang arXiv_CL arXiv_CL  Bert  Language_Model  PDF
• 2022-11-30 RAFT: Rationale adaptor for few-shot abusive language detection    Punyajoy Saha, Divyanshu Sheth, Kushal Kedia, Binny Mathew, Animesh Mukherjee arXiv_CL arXiv_CL  Bert  Pose  Classification  Detection  Few-Shot  PDF
• 2022-11-30 X-PuDu at SemEval-2022 Task 6: Multilingual Learning for English and Arabic Sarcasm Detection    Yaqian Han, Yekun Chai, Shuohuan Wang, Yu Sun, Hongyi Huang, Guanghao Chen, Yitong Xu, Yang Yang arXiv_CL arXiv_CL  Bert  Classification  Detection  Sentiment  Language_Model  PDF
• 2022-11-30 HEAT: Hardware-Efficient Automatic Tensor Decomposition for Transformer Compression    Jiaqi Gu, Ben Keller, Jean Kossaifi, Anima Anandkumar, Brucek Khailany, David Z. Pan arXiv_AI arXiv_AI  Transformer  Bert  Optimization  Knowledge  Pose  Action  Attention  Inference  PDF
• 2022-11-29 Improving astroBERT using Semantic Textual Similarity    Felix Grezes, Thomas Allen, Sergi Blanco-Cuaresma, Alberto Accomazzi, Michael J. Kurtz, Golnaz Shapurian, Edwin Henneken, Carolyn S. Grant, Donna M. Thompson, Timothy W. Hostetler, Matthew R. Templeton, Kelly E. Lockhart, Shinyi Chen, Jennifer Koch, Taylor Jacovich, Pavlos Protopapas arXiv_CL arXiv_CL  Bert  Language_Model  PDF
• 2022-11-29 Evaluating Unsupervised Text Classification: Zero-shot and Similarity-based Approaches    Tim Schopf, Daniel Braun, Florian Matthes arXiv_AI arXiv_AI  Transformer  Embedding  Unsupervised  Bert  Zero-Shot  Text_Classification  Knowledge  Pose  Classification  Medical  PDF
• 2022-11-29 Diverse Multi-Answer Retrieval with Determinantal Point Processes    Poojitha Nandigam, Nikhil Rayaprolu, Manish Shrivastava arXiv_CL arXiv_CL  Bert  Pose  Relation  QA  PDF
• 2022-11-29 Compressing Cross-Lingual Multi-Task Models at Qualtrics    Daniel Campos, Daniel Perry, Samir Joshi, Yashmeet Gambhir, Wei Du, Zhengzheng Xing, Aaron Colak arXiv_CL arXiv_CL  Bert  Text_Classification  Action  Classification  GAN  Inference  Prediction  PDF
• 2022-11-28 Automatically Extracting Information in Medical Dialogue: Expert System And Attention for Labelling    Xinshi Wang, Daniel Tang arXiv_CL arXiv_CL  Bert  Pose  Action  Classification  Attention  Medical  PDF
• 2022-11-28 NeuralMPS: Non-Lambertian Multispectral Photometric Stereo via Spectral Reflectance Decomposition    Jipeng Lv, Heng Guo, Guanying Chen, Jinxiu Liang, Boxin Shi arXiv_CV arXiv_CV  Bert  Pose  Face  PDF
• 2022-11-28 Scientific and Creative Analogies in Pretrained Language Models    Tamara Czinczoll, Helen Yannakoudakis, Pushkar Mishra, Ekaterina Shutova arXiv_CL arXiv_CL  Bert  Pose  Relation  Language_Model  PDF
• 2022-11-28 Is it Required? Ranking the Skills Required for a Job-Title    Sarthak Anand, Jens-Joris Decorte, Niels Lowie arXiv_CL arXiv_CL  Bert  PDF
• 2022-11-28 Revisiting Distance Metric Learning for Few-Shot Natural Language Classification    Witold Sosnowski, Anna Wróblewska, Karolina Seweryn, Piotr Gawrysiak arXiv_AI arXiv_AI  Bert  Classification  Few-Shot  Attention  Inference  Language_Model  PDF
• 2022-11-28 Large Pre-Trained Models with Extra-Large Vocabularies: A Contrastive Analysis of Hebrew BERT Models and a New One to Outperform Them All    Eylon Guetta, Avi Shmidman, Shaltiel Shmidman, Cheyn Shmuel Shmidman, Joshua Guedalia, Moshe Koppel, Dan Bareket, Amit Seker, Reut Tsarfaty arXiv_CL arXiv_CL  Segmentation  Bert  Sentiment  Language_Model  PDF
• 2022-11-28 Distance Metric Learning Loss Functions in Few-Shot Scenarios of Supervised Language Models Fine-Tuning    Witold Sosnowski, Karolina Seweryn, Anna Wróblewska, Piotr Gawrysiak arXiv_AI arXiv_AI  Bert  Classification  Few-Shot  Language_Model  PDF
• 2022-11-28 Handling and extracting key entities from customer conversations using Speech recognition and Named Entity recognition    Sharvi Endait, Ruturaj Ghatage, Prof. DD Kadam arXiv_CL arXiv_CL  Transformer  Recognition  Bert  Speech  Face  Action  Speech_Recognition  PDF
• 2022-11-28 DiffusionBERT: Improving Generative Masked Language Models with Diffusion Models    Zhengfu He, Tianxiang Sun, Kuanning Wang, Xuanjing Huang, Xipeng Qiu arXiv_CL arXiv_CL  Bert  Pose  Denoising  Text_Generation  Language_Model  PDF
• 2022-11-27 AWTE-BERT:Attending to Wordpiece Tokenization Explicitly on BERT for Joint Intent Classification and SlotFilling    Yu Guo, Zhilong Xie, Xingyan Chen, Leilei Wang, Gang Wu arXiv_AI arXiv_AI  Transformer  Bert  Optimization  Pose  Action  Classification  Attention  PDF
• 2022-11-26 SKDBERT: Compressing BERT via Stochastic Knowledge Distillation    Zixiang Ding, Guoqing Jiang, Shuai Zhang, Lin Guo, Wei Lin arXiv_CL arXiv_CL  Bert  Knowledge  Pose  Language_Model  PDF
• 2022-11-25 An Analysis of Social Biases Present in BERT Variants Across Multiple Languages    Aristides Milios (1 and 2), Parishad BehnamGhader (1 and 2) ((1) McGill University, (2) Mila) arXiv_CL arXiv_CL  Transformer  Bert  Pose  Language_Model  PDF
• 2022-11-25 Finetuning BERT on Partially Annotated NER Corpora    Viktor Scherbakov, Vladimir Mayorov arXiv_CL arXiv_CL  Recognition  Bert  RNN  PDF
• 2022-11-25 Competency-Aware Neural Machine Translation: Can Machine Translation Know its Own Translation Quality?    Pei Zhang, Baosong Yang, Haoran Wei, Dayiheng Liu, Kai Fan, Luo Si, Jun Xie arXiv_AI arXiv_AI  Bert  Pose  Quantitative  NMT  Relation  Prediction  PDF
• 2022-11-24 Using Selective Masking as a Bridge between Pre-training and Fine-tuning    Tanish Lad, Himanshu Maheshwari, Shreyas Kottukkal, Radhika Mamidi arXiv_CL arXiv_CL  Transformer  Bert  Sentiment_Classification  Pose  Classification  Sentiment  Language_Model  PDF
• 2022-11-24 Question-type Identification for Academic Questions in Online Learning Platform    Azam Rabiee, Alok Goel, Johnson D'Souza, Saurabh Khanwalkar arXiv_AI arXiv_AI  Bert  Classification  PDF
• 2022-11-24 TESSP: Text-Enhanced Self-Supervised Speech Pre-training    Zhuoyuan Yao, Shuo Ren, Sanyuan Chen, Ziyang Ma, Pengcheng Guo, Lei Xie arXiv_SD arXiv_SD  Transformer  Unsupervised  Recognition  Bert  Speech  Self-Supervised  Pose  Speech_Recognition  Matching  PDF
• 2022-11-24 InDEX: Indonesian Idiom and Expression Dataset for Cloze Test    Xinying Qiu, Guofeng Shi arXiv_CL arXiv_CL  Embedding  Bert  Pose  PDF
• 2022-11-24 Tapping the Potential of Coherence and Syntactic Features in Neural Models for Automatic Essay Scoring    Xinying Qiu, Shuxuan Liao, Jiajun Xie, Jian-Yun Nie arXiv_CL arXiv_CL  Embedding  Bert  Pose  Prediction  PDF
• 2022-11-23 SEAT: Stable and Explainable Attention    Lijie Hu, Yixin Liu, Ninghao Liu, Mengdi Huai, Lichao Sun, Di Wang arXiv_AI arXiv_AI  Embedding  Bert  RNN  Attention  Prediction  PDF
• 2022-11-23 SeedBERT: Recovering Annotator Rating Distributions from an Aggregated Label    Aneesha Sampath, Victoria Lin, Louis-Philippe Morency arXiv_CL arXiv_CL  Bert  Pose  Deep_Learning  Attention  Language_Model  PDF
• 2022-11-23 Improving Visual-textual Sentiment Analysis by Fusing Expert Features    Junyu Chen, Jie An, Hanjia Lyu, Jiebo Luo arXiv_CV arXiv_CV  Bert  Pose  Sentiment  Prediction  PDF
• 2022-11-23 Unified Multimodal Model with Unlikelihood Training for Visual Dialog    Zihao Wang, Junli Wang, Changjun Jiang arXiv_AI arXiv_AI  Bert  Knowledge  Pose  Attention  Language_Model  QA  PDF
• 2022-11-23 Word-Level Representation From Bytes For Language Modeling    Chu-Tak Lee, Qipeng Guo, Xipeng Qiu arXiv_CL arXiv_CL  Embedding  Bert  Text_Classification  Classification  Attention  Image_Classification  Language_Model  Prediction  PDF
• 2022-11-22 OLGA : An Ontology and LSTM-based approach for generating Arithmetic Word Problems of transfer type    Suresh Kumar, P Sreenivasa Kumar arXiv_AI arXiv_AI  Bert  RNN  Knowledge  Pose  Ontology  Relation  PDF
• 2022-11-21 L3Cube-HindBERT and DevBERT: Pre-Trained BERT Transformer models for Devanagari based Hindi and Marathi Languages    Raviraj Joshi arXiv_CL arXiv_CL  Transformer  Recognition  Bert  Text_Classification  Classification  PDF
• 2022-11-21 CBEAF-Adapting: Enhanced Continual Pretraining for Building Chinese Biomedical Language Model    Yongyu Yan, Kui Xue, Qi Ye, Tong Ruan arXiv_CL arXiv_CL  Bert  Pose  Attention  Medical  Language_Model  PDF
• 2022-11-21 TCBERT: A Technical Report for Chinese Topic Classification BERT    Ting Han, Kunhao Pan, Xinyu Chen, Dingjie Song, Yuchen Fan, Xinyu Gao, Ruyi Gan, Jiaxing Zhang arXiv_CL arXiv_CL  Transformer  Bert  Pose  Contrastive_Learning  Classification  GAN  PDF
• 2022-11-21 VATLM: Visual-Audio-Text Pre-Training with Unified Masked Prediction for Speech Representation Learning    Qiushi Zhu, Long Zhou, Ziqiang Zhang, Shujie Liu, Binxing Jiao, Jie Zhang, Lirong Dai, Daxin Jiang, Jinyu Li, Furu Wei arXiv_AI arXiv_AI  Transformer  Recognition  Bert  Represenation_Learning  Speech  Pose  Action  Speech_Recognition  Language_Model  Prediction  PDF
• 2022-11-21 Exploring the Efficacy of Pre-trained Checkpoints in Text-to-Music Generation Task    Shangda Wu, Maosong Sun arXiv_CL arXiv_CL  Bert  PDF
• 2022-11-21 L3Cube-MahaSBERT and HindSBERT: Sentence BERT Models and Benchmarking BERT Sentence Representations for Hindi and Marathi    Ananya Joshi, Aditi Kajale, Janhavi Gadre, Samruddhi Deode, Raviraj Joshi arXiv_CL arXiv_CL  Transformer  Embedding  Bert  Text_Classification  Classification  PDF
• 2022-11-20 Conceptor-Aided Debiasing of Contextualized Embeddings    Yifei Li, Lyle Ungar, João Sedoc arXiv_AI arXiv_AI  Embedding  Bert  Pose  Language_Model  PDF
• 2022-11-20 Understanding and Improving Knowledge Distillation for Quantization-Aware Training of Large Transformer Encoders    Minsoo Kim, Sihwa Lee, Sukjin Hong, Du-Seong Chang, Jungwook Choi arXiv_AI arXiv_AI  Transformer  Quantization  Bert  Knowledge  Pose  Attention  QA  PDF
• 2022-11-20 Feature Weaken: Vicinal Data Augmentation for Classification    Songhao Jiang, Yan Chu, Tianxing Ma, Tianning Zang arXiv_AI arXiv_AI  Bert  Text_Classification  Optimization  Adversarial  Pose  Classification  Deep_Learning  Image_Classification  PDF
• 2022-11-20 Detecting Conspiracy Theory Against COVID-19 Vaccines    Md Hasibul Amin (1), Harika Madanu (1), Sahithi Lavu (1), Hadi Mansourifar (1), Dana Alsagheer (1), Weidong Shi (1) ((1) University Of Houston) arXiv_CL arXiv_CL  Bert  Sentiment  PDF
• 2022-11-19 Entity-Assisted Language Models for Identifying Check-worthy Sentences    Ting Su, Craig Macdonald, Iadh Ounis arXiv_CL arXiv_CL  Embedding  Bert  Text_Classification  RNN  Knowledge  Knowledge_Graph  Speech  Pose  Classification  Language_Model  PDF
• 2022-11-18 Knowledge Graph Refinement based on Triplet BERT-Networks    Armita Khajeh Nassiri (1), Nathalie Pernelle (2), Fatiha Sais (1), Gianluca Quercini (1) ((1) LISN, CNRS UMR 9015, University of Paris Saclay (2) LIPN, CNRS UMR 7030, University of Sorbonne Paris Nord) arXiv_AI arXiv_AI  Transformer  Embedding  Bert  Knowledge  Knowledge_Graph  Pose  Classification  Relation  Few-Shot  Language_Model  Prediction  PDF
• 2022-11-18 CITADEL: Conditional Token Interaction via Dynamic Lexical Routing for Efficient and Effective Multi-Vector Retrieval    Minghan Li, Sheng-Chieh Lin, Barlas Oguz, Asish Ghoshal, Jimmy Lin, Yashar Mehdad, Wen-tau Yih, Xilun Chen arXiv_CL arXiv_CL  Bert  Sparse  Pose  Action  PDF
• 2022-11-18 Metadata Might Make Language Models Better    Kaspar Beelen, Daniel van Strien arXiv_CL arXiv_CL  Bert  Pose  Classification  Language_Model  PDF
• 2022-11-18 Where did you tweet from? Inferring the origin locations of tweets based on contextual information    Rabindra Lamsal, Aaron Harwood, Maria Rodriguez Read arXiv_CL arXiv_CL  Bert  Pose  Action  GAN  PDF
• 2022-11-17 MelHuBERT: A simplified HuBERT on Mel spectrogram    Tzu-Quan Lin, Hung-yi Lee, Hao Tang arXiv_SD arXiv_SD  Bert  Speech  Self-Supervised  Pose  PDF
• 2022-11-17 Random-LTD: Random and Layerwise Token Dropping Brings Efficient Training for Large-scale Transformers    Zhewei Yao, Xiaoxia Wu, Conglong Li, Connor Holmes, Minjia Zhang, Cheng Li, Yuxiong He arXiv_CL arXiv_CL  Transformer  Bert  Zero-Shot  Pose  PDF
• 2022-11-17 ProtSi: Prototypical Siamese Network with Data Augmentation for Few-Shot Subjective Answer Evaluation    Yining Lu, Jingxi Qiu, Gaurav Gupta arXiv_CL arXiv_CL  Unsupervised  Bert  Text_Classification  Pose  Contrastive_Learning  Classification  Few-Shot  PDF
• 2022-11-17 Zero-Shot Dynamic Quantization for Transformer Inference    Yousef El-Kurdi, Jerry Quinn, Avirup Sil arXiv_CL arXiv_CL  Transformer  Quantization  Bert  Zero-Shot  Inference  PDF
• 2022-11-17 Consultation Checklists: Standardising the Human Evaluation of Medical Note Generation    Aleksandar Savkov, Francesco Moramarco, Alex Papadopoulos Korfiatis, Mark Perera, Anya Belz, Ehud Reiter arXiv_CL arXiv_CL  Bert  Pose  Relation  Medical  PDF
• 2022-11-17 LongFNT: Long-form Speech Recognition with Factorized Neural Transducer    Xun Gong, Yu Wu, Jinyu Li, Shujie Liu, Rui Zhao, Xie Chen, Yanmin Qian arXiv_SD arXiv_SD  Recognition  Bert  Speech  Pose  Speech_Recognition  Language_Model  Prediction  PDF
• 2022-11-16 A Graph-Based Context-Aware Model to Understand Online Conversations    Vibhor Agarwal, Anthony P. Young, Sagar Joglekar, Nishanth Sastry arXiv_AI arXiv_AI  Embedding  Bert  Speech  Pose  Classification  Deep_Learning  Detection  Inference  Prediction  PDF
• 2022-11-16 Ischemic Stroke Lesion Prediction using imbalanced Temporal Deep Gaussian Process    Mohsen Soltanpour, Muhammad Yousefnezhad, Russ Greiner, Pierre Boulanger, Brian Buck arXiv_CV arXiv_CV  3D  Bert  Pose  Prediction  PDF
• 2022-11-16 L2 proficiency assessment using self-supervised speech representations    Stefano Bannò, Kate M. Knill, Marco Matassoni, Vyas Raina, Mark J. F. Gales arXiv_CL arXiv_CL  Recognition  Bert  Speech  Self-Supervised  Pose  Speech_Recognition  PDF
• 2022-11-16 Fast and Accurate FSA System Using ELBERT: An Efficient and Lightweight BERT    Siyuan Lu, Chenchen Zhou, Keli Xie, Shiyi Liu, Jun Lin, Zhongfeng Wang arXiv_CL arXiv_CL  Transformer  Bert  Pose  Deep_Learning  Sentiment  PDF
• 2022-11-16 Streaming Joint Speech Recognition and Disfluency Detection    Hayato Futami, Emiru Tsunoo, Kentaro Shibata, Yosuke Kashiwagi, Takao Okuda, Siddhant Arora, Shinji Watanabe arXiv_SD arXiv_SD  Transformer  Recognition  Bert  Speech  Pose  Detection  Speech_Recognition  Inference  Language_Model  PDF
• 2022-11-15 Empowering Language Models with Knowledge Graph Reasoning for Question Answering    Ziniu Hu, Yichong Xu, Wenhao Yu, Shuohang Wang, Ziyi Yang, Chenguang Zhu, Kai-Wei Chang, Yizhou Sun arXiv_CL arXiv_CL  Transformer  Enhancement  Bert  Knowledge  Knowledge_Graph  Pose  Action  Relation  Language_Model  PDF
• 2022-11-15 An FNet based Auto Encoder for Long Sequence News Story Generation    Paul K. Mandal, Rakeshkumar Mahto arXiv_CL arXiv_CL  Bert  Pose  PDF
• 2022-11-15 Multiagent Rollout with Reshuffling for Warehouse Robots Path Planning    William Emanuelsson, Alejandro Penacho Riveiros, Yuchao Li, Karl H. Johansson, Jonas Mårtensson arXiv_RO arXiv_RO  Bert  Pose  PDF
• 2022-11-15 RobBERT-2022: Updating a Dutch Language Model to Account for Evolving Language Use    Pieter Delobelle, Thomas Winters, Bettina Berendt arXiv_CL arXiv_CL  Transformer  Bert  GAN  Language_Model  PDF
• 2022-11-15 Persian Emotion Detection using ParsBERT and Imbalanced Data Handling Approaches    Amirhossein Abaskohi, Nazanin Sabri, Behnam Bahrak arXiv_CL arXiv_CL  Transformer  Recognition  Bert  Speech  Emotion  Detection  Language_Model  PDF
• 2022-11-15 Relationship of the language distance to English ability of a country    Cao Xinxin, Lei Xiaolan, Murtadha Ahmed arXiv_CL arXiv_CL  Embedding  Bert  Pose  Relation  Language_Model  Recommendation  PDF
• 2022-11-14 AdaptKeyBERT: An Attention-Based approach towards Few-Shot & Zero-Shot Domain Adaptation of KeyBERT    Aman Priyanshu, Supriti Vijay arXiv_CL arXiv_CL  Transformer  Bert  Zero-Shot  Pose  Ontology  Action  Few-Shot  Attention  Recommendation  PDF
• 2022-11-14 Semantic Decomposition Improves Learning of Large Language Models on EHR Data    David A. Bloore, Romane Gauriau, Anna L. Decker, Jacob Oppenheim arXiv_CL arXiv_CL  Transformer  Bert  Pose  Action  Attention  Medical  Language_Model  Prediction  PDF
• 2022-11-14 MT4SSL: Boosting Self-Supervised Speech Representation Learning by Integrating Multiple Targets    Ziyang Ma, Zhisheng Zhen, Changli Tang, Yujin Wang, Xie Chen arXiv_SD arXiv_SD  Transformer  Bert  Represenation_Learning  Speech  Self-Supervised  Pose  PDF
• 2022-11-14 Hope Speech Detection on Social Media Platforms    Pranjal Aggarwal, Pasupuleti Chandana, Jagrut Nemade, Shubham Sharma, Sunil Saumya, Shankar Biradar arXiv_CL arXiv_CL  Bert  Speech  Detection  PDF
• 2022-11-14 ALBERT with Knowledge Graph Encoder Utilizing Semantic Similarity for Commonsense Question Answering    Byeongmin Choi, YongHyun Lee, Yeunwoong Kyung, Eunchan Kim arXiv_AI arXiv_AI  Transformer  Bert  Knowledge  Knowledge_Graph  Pose  Action  Relation  Language_Model  QA  PDF
• 2022-11-13 Xu at SemEval-2022 Task 4: Pre-BERT Neural Network Methods vs Post-BERT RoBERTa Approach for Patronizing and Condescending Language Detection    Jinghua Xu arXiv_CL arXiv_CL  Bert  Detection  Language_Model  PDF
• 2022-11-12 Improving the Robustness of DistilHuBERT to Unseen Noisy Conditions via Data Augmentation, Curriculum Learning, and Multi-Task Enhancement    Heitor R. Guimarães, Arthur Pimentel, Anderson R. Avila, Mehdi Rezagholizadeh, Tiago H. Falk arXiv_SD arXiv_SD  Enhancement  Recognition  Bert  Represenation_Learning  Speech  Self-Supervised  Pose  Emotion  Action  PDF
• 2022-11-11 The Architectural Bottleneck Principle    Tiago Pimentel, Josef Valvoda, Niklas Stoehr, Ryan Cotterell arXiv_CL arXiv_CL  Transformer  Bert  Pose  Attention  PDF
• 2022-11-11 Improving word mover's distance by leveraging self-attention matrix    Hiroaki Yamagiwa, Sho Yokoi, Hidetoshi Shimodaira arXiv_CL arXiv_CL  Embedding  Bert  Pose  Attention  PDF
• 2022-11-11 Towards automating Numerical Consistency Checks in Financial Reports    Lars Hillebrand, Tobias Deußer, Tim Dilmaghani, Bernd Kliem, Rüdiger Loitz, Christian Bauckhage, Rafet Sifa arXiv_CL arXiv_CL  Bert  Action  Classification  Relation  Relation_Extraction  Matching  PDF
• 2022-11-11 Misinformation Detection using Persuasive Writing Strategies    Joseph Romain, Huiyi Liu, Wei Peng, Jingbo Meng, Parisa Kordjamshidi arXiv_CL arXiv_CL  Bert  Text_Classification  Classification  Detection  Language_Model  Prediction  PDF
• 2022-11-10 BERT in Plutarch's Shadows    Ivan P. Yamshchikov, Alexey Tikhonov, Yorgos Pantis, Charlotte Schubert, Jürgen Jost arXiv_CL arXiv_CL  Bert  Relation  Language_Model  PDF
• 2022-11-10 BERT on a Data Diet: Finding Important Examples by Gradient-Based Pruning    Mohsen Fayyaz, Ehsan Aghazadeh, Ali Modarressi, Mohammad Taher Pilehvar, Yadollah Yaghoobzadeh, Samira Ebrahimi Kahou arXiv_CL arXiv_CL  Bert  Action  Language_Model  PDF
• 2022-11-10 Impact of Adversarial Training on Robustness and Generalizability of Language Models    Enes Altinisik, Hassan Sajjad, Husrev Taha Sencar, Safa Messaoud, Sanjay Chawla arXiv_AI arXiv_AI  Transformer  Embedding  Bert  Knowledge  Adversarial  Relation  Language_Model  PDF
• 2022-11-10 Syntax-Guided Domain Adaptation for Aspect-based Sentiment Analysis    Anguo Dong, Cuiyun Gao, Yan Jia, Qing Liao, Xuan Wang, Lei Wang, Jing Xiao arXiv_AI arXiv_AI  Bert  Knowledge  Review  Pose  Classification  Sentiment  Language_Model  PDF
• 2022-11-10 Biomedical Multi-hop Question Answering Using Knowledge Graph Embeddings and Language Models    Dattaraj J. Rao, Shraddha S. Mane, Mukta A. Paliwal arXiv_AI arXiv_AI  Embedding  Bert  Knowledge  Knowledge_Graph  Face  Relation  Medical  Language_Model  QA  PDF
• 2022-11-10 BERT-Based Combination of Convolutional and Recurrent Neural Network for Indonesian Sentiment Analysis    Hendri Murfi, Syamsyuriani, Theresia Gowandi, Gianinna Ardaneswari, Siti Nurrohmah arXiv_CL arXiv_CL  Transformer  Embedding  Bert  RNN  Emotion  Deep_Learning  Sentiment  Attention  CNN  PDF
• 2022-11-09 Collateral facilitation in humans and language models    James A. Michaelov, Benjamin K. Bergen arXiv_CL arXiv_CL  Transformer  Bert  Language_Model  Prediction  PDF
• 2022-11-09 Cross-lingual Transfer Learning for Check-worthy Claim Identification over Twitter    Maram Hasanain, Tamer Elsayed arXiv_CL arXiv_CL  Transfer_Learning  Bert  Zero-Shot  GAN  PDF
• 2022-11-09 Mask More and Mask Later: Efficient Pre-training of Masked Language Models by Disentangling the MASK Token    Baohao Liao, David Thulke, Sanjika Hewavitharana, Hermann Ney, Christof Monz arXiv_CL arXiv_CL  Transformer  Embedding  Bert  Language_Model  PDF
• 2022-11-09 Sentiment Analysis of Persian Language: Review of Algorithms, Approaches and Datasets    Ali Nazarizadeh, Touraj Banirostam, Minoo Sayyadpour arXiv_CL arXiv_CL  Transformer  Bert  RNN  Review  Pose  Emotion  Deep_Learning  Sentiment  PDF
• 2022-11-08 Discover, Explanation, Improvement: Automatic Slice Detection Framework for Natural Language Processing    Wenyue Hua, Lifeng Jin, Linfeng Song, Haitao Mi, Yongfeng Zhang, Dong Yu arXiv_CL arXiv_CL  Bert  Quantitative  Detection  Attention  PDF
• 2022-11-08 A Multimodal Approach for Dementia Detection from Spontaneous Speech with Tensor Fusion Layer    Loukas Ilias, Dimitris Askounis, John Psarras arXiv_CL arXiv_CL  Transformer  Bert  Speech  Pose  Action  Detection  Attention  PDF
• 2022-11-08 An Ensemble-based approach for assigning text to correct Harmonized system code    Shubham, Avinash Arya, Subarna Roy, Sridhar Jonnala arXiv_AI arXiv_AI  Transformer  Bert  Knowledge  Classification  PDF
• 2022-11-08 Hilbert Distillation for Cross-Dimensionality Networks    Dian Qin, Haishuai Wang, Zhe Liu, Hongjia Xu, Sheng Zhou, Jiajun Bu arXiv_AI arXiv_AI  3D  Bert  Knowledge  Pose  Classification  Attention  Medical  CNN  PDF
• 2022-11-08 Parameter and Data Efficient Continual Pre-training for Robustness to Dialectal Variance in Arabic    Soumajyoti Sarkar, Kaixiang Lin, Sailik Sengupta, Leonard Lausen, Sheng Zha, Saab Mansour arXiv_CL arXiv_CL  Transformer  Bert  Classification  Deep_Learning  Attention  Language_Model  PDF
• 2022-11-07 End-to-End Evaluation of a Spoken Dialogue System for Learning Basic Mathematics    Eda Okur, Saurav Sahay, Roddy Fuentes Alba, Lama Nachman arXiv_CL arXiv_CL  Enhancement  Recognition  Bert  Speech  Action  Speech_Recognition  PDF
• 2022-11-07 AD-BERT: Using Pre-trained contextualized embeddings to Predict the Progression from Mild Cognitive Impairment to Alzheimer's Disease    Chengsheng Mao, Jie Xu, Luke Rasmussen, Yikuan Li, Prakash Adekkanattu, Jennifer Pacheco, Borna Bonakdarpour, Robert Vassar, Guoqian Jiang, Fei Wang, Jyotishman Pathak, Yuan Luo arXiv_CL arXiv_CL  Transformer  Embedding  Bert  Deep_Learning  Prediction  PDF
• 2022-11-07 AfroLM: A Self-Active Learning-based Multilingual Pretrained Language Model for 23 African Languages    Bonaventure F. P. Dossou, Atnafu Lambebo Tonja, Oreen Yousuf, Salomey Osei, Abigail Oppong, Iyanuoluwa Shode, Oluwabusayo Olufunke Awoyomi, Chris Chinenye Emezue arXiv_AI arXiv_AI  Transformer  Bert  Text_Classification  Optimization  Classification  Sentiment  Language_Model  PDF
• 2022-11-06 Improved Target-specific Stance Detection on Social Media Platforms by Delving into Conversation Threads    Yupeng Li, Haorui He, Shaonan Wang, Francis C.M. Lau, Yunya Song arXiv_CL arXiv_CL  Bert  Pose  Detection  PDF
• 2022-11-06 Suffix Retrieval-Augmented Language Modeling    Zecheng Wang, Yik-Cheung Tam arXiv_CL arXiv_CL  Embedding  Bert  Pose  Language_Model  PDF
• 2022-11-05 BEKG: A Built Environment Knowledge Graph    Xiaojun Yang, Haoyu Zhong, Penglin Du, Keyi Zhou, Xingjin Lai, Zhengdong Wang, Yik Lun Lau, Yangqiu Song, Liyaning Tang arXiv_CL arXiv_CL  Recognition  Bert  Knowledge  Knowledge_Graph  Pose  Action  Relation  Relation_Extraction  PDF
• 2022-11-05 PASTA: Table-Operations Aware Fact Verification via Sentence-Table Cloze Pre-training    Zihui Gu, Ju Fan, Nan Tang, Preslav Nakov, Xiaoman Zhao, Xiaoyong Du arXiv_AI arXiv_AI  Transformer  Bert  Action  Attention  Language_Model  PDF
• 2022-11-04 Intriguing Properties of Compression on Multilingual Models    Kelechi Ogueji, Orevaoghene Ahia, Gbemileke Onilude, Sebastian Gehrmann, Sara Hooker, Julia Kreutzer arXiv_CL arXiv_CL  Recognition  Bert  Pose  Language_Model  PDF
• 2022-11-04 Evaluating and Improving Factuality in Multimodal Abstractive Summarization    David Wan, Mohit Bansal arXiv_CV arXiv_CV  Reinforcement_Learning  Bert  Zero-Shot  Pose  Detection  Relation  Summarization  PDF
• 2022-11-04 BERT for Long Documents: A Case Study of Automated ICD Coding    Arash Afkanpour, Shabir Adeel, Hansenclever Bassani, Arkady Epshteyn, Hongbo Fan, Isaac Jones, Mahan Malihi, Adrian Nauth, Raj Sinha, Sanjana Woonna, Shiva Zamani, Elli Kanal, Mikhail Fomitchev, Donny Cheung arXiv_CL arXiv_CL  Transformer  Bert  PDF
• 2022-11-04 BERT-Deep CNN: State-of-the-Art for Sentiment Analysis of COVID-19 Tweets    Javad Hassannataj Joloudari, Sadiq Hussain, Mohammad Ali Nematollahi, Rouhollah Bagheri, Fatemeh Fazl, Roohallah Alizadehsani, Reza Lashgari arXiv_CL arXiv_CL  Bert  Review  Emotion  Survey  Sentiment  PDF
• 2022-11-04 Continuous Prompt Tuning Based Textual Entailment Model for E-commerce Entity Typing    Yibo Wang, Congying Xia, Guan Wang, Philip Yu arXiv_CL arXiv_CL  Embedding  Bert  Pose  Activity  PDF
• 2022-11-04 Miko Team: Deep Learning Approach for Legal Question Answering in ALQAC 2022    Hieu Nguyen Van, Dat Nguyen, Phuong Minh Nguyen, Minh Le Nguyen arXiv_CL arXiv_CL  Bert  Deep_Learning  QA  PDF
• 2022-11-03 Quantifying Model Uncertainty for Semantic Segmentation using Operators in the RKHS    Rishabh Singh, Jose C. Principe arXiv_CV arXiv_CV  Segmentation  Semantic_Segmentation  Bert  Action  Deep_Learning  PDF
• 2022-11-03 Exploring the State-of-the-Art Language Modeling Methods and Data Augmentation Techniques for Multilingual Clause-Level Morphology    Emre Can Acikgoz, Tilek Chubakov, Müge Kural, Gözde Gül Şahin, Deniz Yuret arXiv_CL arXiv_CL  Transformer  Bert  Language_Model  PDF
• 2022-11-03 Hybrid-SD : A new hybrid evaluation metric for automatic speech recognition tasks    Zitha Sasindran, Harsha Yelchuri, Supreeth Rao, T. V. Prabhakar arXiv_CL arXiv_CL  Recognition  Bert  Speech  Pose  Speech_Recognition  PDF
• 2022-11-03 Channel-Aware Pretraining of Joint Encoder-Decoder Self-Supervised Model for Telephonic-Speech ASR    Vrunda N. Sukhadia, A. Arunkumar, S. Umesh arXiv_SD arXiv_SD  Transformer  Bert  Speech  Self-Supervised  Pose  PDF
• 2022-11-03 Revisiting Grammatical Error Correction Evaluation and Beyond    Peiyuan Gong, Xuebo Liu, Heyan Huang, Min Zhang arXiv_CL arXiv_CL  Bert  Knowledge  Pose  Relation  Attention  Summarization  PDF
• 2022-11-03 Fine-Tuning Language Models via Epistemic Neural Networks    Ian Osband, Seyed Mohammad Asghari, Benjamin Van Roy, Nat McAleese, John Aslanides, Geoffrey Irving arXiv_CL arXiv_CL  Unsupervised  Bert  Language_Model  PDF
• 2022-11-02 RQUGE: Reference-Free Metric for Evaluating Question Generation by Answering the Question    Alireza Mohammadshahi, Thomas Scialom, Majid Yazdani, Pouya Yanki, Angela Fan, James Henderson, Marzieh Saeidi arXiv_CL arXiv_CL  Bert  Adversarial  Pose  Relation  QA  PDF
• 2022-11-02 Multi-level Distillation of Semantic Knowledge for Pre-training Multilingual Language Model    Mingqi Li, Fei Ding, Dan Zhang, Long Cheng, Hongxin Hu, Feng Luo arXiv_CL arXiv_CL  Transformer  Bert  Knowledge  Pose  Relation  Language_Model  PDF
• 2022-11-02 M-SpeechCLIP: Leveraging Large-Scale, Pre-Trained Models for Multilingual Speech to Image Retrieval    Layne Berry, Yi-Jen Shih, Hsuan-Fu Wang, Heng-Jui Chang, Hung-yi Lee, David Harwath arXiv_CL arXiv_CL  Transformer  Bert  Image_Retrieval  Speech  PDF
• 2022-11-02 Transformer-based encoder-encoder architecture for Spoken Term Detection    Jan Švec, Luboš Šmídl, Jan Lehečka arXiv_CL arXiv_CL  Transformer  Embedding  Bert  RNN  Speech  Pose  Detection  Attention  CNN  PDF
• 2022-11-02 Processing Long Legal Documents with Pre-trained Transformers: Modding LegalBERT and Longformer    Dimitris Mamakas, Petros Tsotsi, Ion Androutsopoulos, Ilias Chalkidis arXiv_CL arXiv_CL  Transformer  Bert  Sparse  Pose  Classification  Attention  PDF
• 2022-11-02 BECTRA: Transducer-based End-to-End ASR with BERT-Enhanced Encoder    Yosuke Higuchi, Tetsuji Ogawa, Tetsunori Kobayashi, Shinji Watanabe arXiv_CL arXiv_CL  Recognition  Bert  Knowledge  Speech  Pose  Speech_Recognition  Inference  Language_Model  PDF
• 2022-11-01 Reduce, Reuse, Recycle: Improving Training Efficiency with Distillation    Cody Blakeney, Jessica Zosa Forde, Jonathan Frankle, Ziliang Zong, Matthew L. Leavitt arXiv_AI arXiv_AI  Bert  Optimization  Classification  Deep_Learning  Image_Classification  Language_Model  PDF
• 2022-11-01 T5lephone: Bridging Speech and Text Self-supervised Models for Spoken Language Understanding via Phoneme level T5    Chan-Jan Hsu, Ho-Lam Chung, Hung-yi Lee, Yu Tsao arXiv_CL arXiv_CL  Bert  Speech  Self-Supervised  Language_Model  QA  PDF
• 2022-11-01 Investigating Content-Aware Neural Text-To-Speech MOS Prediction Using Prosodic and Linguistic Features    Alexandra Vioni, Georgia Maniati, Nikolaos Ellinas, June Sig Sung, Inchul Hwang, Aimilios Chalamandaris, Pirros Tsiakoulis arXiv_CL arXiv_CL  Embedding  Bert  Speech  Self-Supervised  Pose  Relation  Prediction  PDF
• 2022-11-01 CCS Explorer: Relevance Prediction, Extractive Summarization, and Named Entity Recognition from Clinical Cohort Studies    Irfan Al-Hussaini, Davi Nakajima An, Albert J. Lee, Sarah Bi, Cassie S. Mitchell arXiv_AI arXiv_AI  Transformer  Recognition  Bert  Pose  Face  Detection  Summarization  Language_Model  Prediction  PDF
• 2022-10-31 Leveraging Pre-trained Models for Failure Analysis Triplets Generation    Kenneth Ezukwoke, Anis Hoayek, Mireille Batton-Hubert, Xavier Boucher, Pascal Gounet, Jerome Adrian arXiv_CL arXiv_CL  Transformer  Bert  RNN  Action  Attention  Summarization  Language_Model  PDF
• 2022-10-31 Audio-Visual Speech Enhancement and Separation by Leveraging Multi-Modal Self-Supervised Embeddings    I-Chun Chern, Kuo-Hsuan Hung, Yi-Ting Chen, Tassadaq Hussain, Mandar Gogate, Amir Hussain, Yu Tsao, Jen-Cheng Hou arXiv_SD arXiv_SD  Embedding  Enhancement  Recognition  Bert  Speech  Self-Supervised  Pose  Speech_Recognition  PDF
• 2022-10-31 Emergent Linguistic Structures in Neural Networks are Fragile    Emanuele La Malfa, Matthew Wicker, Marta Kiatkowska arXiv_CL arXiv_CL  Bert  Pose  Attention  Language_Model  PDF
• 2022-10-31 IITD at the WANLP 2022 Shared Task: Multilingual Multi-Granularity Network for Propaganda Detection    Shubham Mittal, Preslav Nakov arXiv_CL arXiv_CL  Bert  Classification  Detection  GAN  PDF
• 2022-10-31 SDCL: Self-Distillation Contrastive Learning for Chinese Spell Checking    Xiaotian Zhang, Hang Yan, Sun Yu, Xipeng Qiu arXiv_CL arXiv_CL  Bert  Pose  Contrastive_Learning  PDF
• 2022-10-31 Improving Cause-of-Death Classification from Verbal Autopsy Reports    Thokozile Manaka, Terence van Zyl, Deepak Kar arXiv_CL arXiv_CL  Transformer  Embedding  Transfer_Learning  Bert  Classification  Language_Model  PDF
• 2022-10-31 QuaLA-MiniLM: a Quantized Length Adaptive MiniLM    Shira Guskin, Moshe Wasserblat, Chang Wang, Haihao Shen arXiv_CL arXiv_CL  Transformer  Embedding  Quantization  Bert  Knowledge  Inference  PDF
• 2022-10-30 Improving Bilingual Lexicon Induction with Cross-Encoder Reranking    Yaoyiran Li, Fangyu Liu, Ivan Vulić, Anna Korhonen arXiv_CL arXiv_CL  Embedding  Bert  Knowledge  Pose  Inference  Language_Model  PDF
• 2022-10-30 Parameter-Efficient Tuning Makes a Good Classification Head    Zhuoyi Yang, Ming Ding, Yanhui Guo, Qingsong Lv, Jie Tang arXiv_CL arXiv_CL  Bert  Classification  PDF
• 2022-10-29 BERT Meets CTC: New Formulation of End-to-End Speech Recognition with Pre-trained Masked Language Model    Yosuke Higuchi, Brian Yan, Siddhant Arora, Tetsuji Ogawa, Tetsunori Kobayashi, Shinji Watanabe arXiv_CL arXiv_CL  Embedding  Recognition  Bert  Knowledge  Speech  Classification  Attention  Speech_Recognition  Inference  Language_Model  PDF
• 2022-10-29 Empirical Evaluation of Post-Training Quantization Methods for Language Tasks    Ting Hu, Christoph Meinel, Haojin Yang arXiv_CL arXiv_CL  Transformer  Quantization  Bert  PDF
• 2022-10-29 Application of Knowledge Distillation to Multi-task Speech Representation Learning    Mine Kerpicci, Van Nguyen, Shuhua Zhang, Erik Visser arXiv_CL arXiv_CL  Recognition  Bert  Represenation_Learning  Knowledge  Speech  Self-Supervised  Pose  Speech_Recognition  PDF
• 2022-10-29 Exploiting prompt learning with pre-trained language models for Alzheimer's Disease detection    Yi Wang, Jiajun Deng, Tianzi Wang, Bo Zheng, Shoukang Hu, Xunying Liu, Helen Meng arXiv_CL arXiv_CL  Embedding  Bert  Speech  Classification  Detection  Language_Model  Prediction  PDF
• 2022-10-29 Two is Better than Many? Binary Classification as an Effective Approach to Multi-Choice Question Answering    Deepanway Ghosal, Navonil Majumder, Rada Mihalcea, Soujanya Poria arXiv_CL arXiv_CL  Bert  Pose  Classification  QA  PDF
• 2022-10-28 DiMBERT: Learning Vision-Language Grounded Representations with Disentangled Multimodal-Attention    Fenglin Liu, Xian Wu, Shen Ge, Xuancheng Ren, Wei Fan, Xu Sun, Yuexian Zou arXiv_CL arXiv_CL  Image_Caption  Transformer  Bert  Pose  Classification  Relation  Attention  Caption  Language_Model  PDF
• 2022-10-28 Probing for targeted syntactic knowledge through grammatical error detection    Christopher Davis, Christopher Bryant, Andrew Caines, Marek Rei, Paula Buttery arXiv_CL arXiv_CL  Bert  Knowledge  Pose  Detection  Language_Model  PDF
• 2022-10-28 Feature Engineering vs BERT on Twitter Data    Ryiaadh Gani, Lisa Chalaguine arXiv_CL arXiv_CL  Embedding  Bert  Language_Model  PDF
• 2022-10-28 Zero-Shot Text Matching for Automated Auditing using Sentence Transformers    David Biesner, Maren Pielka, Rajkumar Ramamurthy, Tim Dilmaghani, Bernd Kliem, Rüdiger Loitz, Rafet Sifa arXiv_CL arXiv_CL  Transformer  Unsupervised  Bert  Zero-Shot  Classification  Matching  PDF
• 2022-10-28 Analyzing Acoustic Word Embeddings from Pre-trained Self-supervised Speech Models    Ramon Sanabria, Hao Tang, Sharon Goldwater arXiv_CL arXiv_CL  Embedding  Bert  Speech  Self-Supervised  PDF
• 2022-10-28 BEBERT: Efficient and robust binary ensemble BERT    Jiayi Tian, Chao Fang, Haonan Wang, Zhongfeng Wang arXiv_CL arXiv_CL  Bert  Knowledge  Pose  PDF
• 2022-10-28 RoChBert: Towards Robust BERT Fine-tuning for Chinese    Zihan Zhang, Jinfeng Li, Ning Shi, Bo Yuan, Xiangyu Liu, Rong Zhang, Hui Xue, Donghong Sun, Chao Zhang arXiv_CL arXiv_CL  Transformer  Bert  Adversarial  Pose  Language_Model  PDF
• 2022-10-28 On the Use of Modality-Specific Large-Scale Pre-Trained Encoders for Multimodal Sentiment Analysis    Atsushi Ando, Ryo Masumura, Akihiko Takashima, Satoshi Suzuki, Naoki Makishima, Keita Suzuki, Takafumi Moriya, Takanori Ashihara, Hiroshi Sato arXiv_CL arXiv_CL  Bert  Sentiment  PDF
• 2022-10-28 Leveraging Label Correlations in a Multi-label Setting: A Case Study in Emotion    Georgios Chochlakis (1 and 2), Gireesh Mahajan (3), Sabyasachee Baruah (1 and 2), Keith Burghardt (2), Kristina Lerman (2), Shrikanth Narayanan (1 and 2) ((1) Signal Analysis and Interpretation Lab, University of Southern California, (2) Information Science Institute, University of Southern California, (3) Microsoft Cognitive Services) arXiv_AI arXiv_AI  Recognition  Bert  Regularization  Emotion  Classification  Detection  Relation  Language_Model  PDF
• 2022-10-27 Exploring Effective Distillation of Self-Supervised Speech Models for Automatic Speech Recognition    Yujin Wang, Changli Tang, Ziyang Ma, Zhisheng Zheng, Xie Chen, Wei-Qiang Zhang arXiv_CL arXiv_CL  Recognition  Bert  Speech  Self-Supervised  Speech_Recognition  Inference  PDF
• 2022-10-27 COST-EFF: Collaborative Optimization of Spatial and Temporal Efficiency with Slenderized Multi-exit Language Models    Bowen Shen, Zheng Lin, Yuanxin Liu, Zhengxiao Liu, Lei Wang, Weiping Wang arXiv_CL arXiv_CL  Transformer  Bert  Optimization  Pose  Inference  Language_Model  Prediction  PDF
• 2022-10-27 Self-consistent Reasoning For Solving Math Word Problems    Jing Xiong, Zhongwei Wan, Xiping Hu, Min Yang, Chengming Li arXiv_CL arXiv_CL  Bert  Pose  Relation  PDF
• 2022-10-27 FCTalker: Fine and Coarse Grained Context Modeling for Expressive Conversational Speech Synthesis    Yifan Hu, Rui Liu, Guanglai Gao, Haizhou Li arXiv_CL arXiv_CL  Bert  Speech  Pose  Relation  PDF
• 2022-10-27 Seq2Seq-SC: End-to-End Semantic Communication Systems with Pre-trained Language Model    Ju-Hyung Lee, Dong-Ho Lee, Eunsoo Sheen, Thomas Choi, Jay Pujara, Joongheon Kim arXiv_CL arXiv_CL  Bert  Language_Model  PDF
• 2022-10-27 Unsupervised Boundary-Aware Language Model Pretraining for Chinese Sequence Labeling    Peijie Jiang, Dingkun Long, Yanzhao Zhang, Pengjun Xie, Meishan Zhang, Min Zhang arXiv_AI arXiv_AI  Segmentation  Unsupervised  Recognition  Bert  Speech  Pose  Language_Model  PDF
• 2022-10-27 Fast DistilBERT on CPUs    Haihao Shen, Ofir Zafrir, Bo Dong, Hengyu Meng, Xinyu Ye, Zhe Wang, Yi Ding, Hanwen Chang, Guy Boudoukh, Moshe Wasserblat arXiv_CL arXiv_CL  Transformer  Quantization  Bert  Sparse  Knowledge  Pose  Inference  Language_Model  PDF
• 2022-10-27 BERT-Flow-VAE: A Weakly-supervised Model for Multi-Label Text Classification    Ziwen Liu, Josep Grau-Bove, Scott Allan Orr arXiv_CL arXiv_CL  Embedding  Bert  Text_Classification  Sparse  Pose  Face  Classification  Prediction  PDF
• 2022-10-27 COCO-DR: Combating Distribution Shifts in Zero-Shot Dense Retrieval with Contrastive and Distributionally Robust Learning    Yue Yu, Chenyan Xiong, Si Sun, Chao Zhang, Arnold Overwijk arXiv_CL arXiv_CL  Embedding  Bert  Zero-Shot  Optimization  Relation  Language_Model  PDF
• 2022-10-27 Open-vocabulary Semantic Segmentation with Frozen Vision-Language Models    Chaofan Ma, Yuhuan Yang, Yanfeng Wang, Ya Zhang, Weidi Xie arXiv_CV arXiv_CV  Transformer  Segmentation  Semantic_Segmentation  Bert  Zero-Shot  Self-Supervised  Pose  Language_Model  PDF
• 2022-10-27 Masked Vision-Language Transformer in Fashion    Ge-Peng Ji, Mingcheng Zhuge, Dehong Gao, Deng-Ping Fan, Christos Sakaridis, Luc Van Gool arXiv_CV arXiv_CV  Transformer  Reconstruction  Recognition  Bert  Matching  PDF
• 2022-10-26 Causality Detection using Multiple Annotation Decision    Quynh Anh Nguyen, Arka Mitra arXiv_CL arXiv_CL  Bert  Action  Detection  Language_Model  PDF
• 2022-10-26 Don't Prompt, Search! Mining-based Zero-Shot Learning with Language Models    Mozes van de Kar, Mengzhou Xia, Danqi Chen, Mikel Artetxe arXiv_AI arXiv_AI  Bert  Zero-Shot  Text_Classification  Pose  Classification  Language_Model  PDF
• 2022-10-26 Multilevel Transformer For Multimodal Emotion Recognition    Junyi He, Meimei Wu, Meng Li, Xiaobo Zhu, Feng Ye arXiv_CL arXiv_CL  Transformer  Embedding  Recognition  Bert  Speech  Pose  Emotion  Attention  PDF
• 2022-10-26 Leveraging Affirmative Interpretations from Negation Improves Natural Language Understanding    Md Mosharaf Hossain, Eduardo Blanco arXiv_CL arXiv_CL  Bert  Pose  Sentiment  Inference  PDF
• 2022-10-26 Bi-Link: Bridging Inductive Link Predictions from Text via Contrastive Learning of Transformers and Prompts    Bohua Peng, Shihao Liang, Mobarakol Islam arXiv_CL arXiv_CL  Transformer  Bert  Knowledge  Knowledge_Graph  Pose  Contrastive_Learning  Relation  Language_Model  Prediction  PDF
• 2022-10-26 Exploring Robustness of Prefix Tuning in Noisy Data: A Case Study in Financial Sentiment Analysis    Sudhandar Balakrishnan, Yihao Fang, Xioadan Zhu arXiv_CL arXiv_CL  Transformer  Bert  Face  Sentiment  PDF
• 2022-10-25 Causal Analysis of Syntactic Agreement Neurons in Multilingual Language Models    Aaron Mueller, Yu Xia, Tal Linzen arXiv_CL arXiv_CL  Bert  Relation  Language_Model  PDF
• 2022-10-25 Universal Evasion Attacks on Summarization Scoring    Wenchuan Mu, Kwan Hui Lim arXiv_CL arXiv_CL  Bert  Pose  Summarization  PDF
• 2022-10-25 IELM: An Open Information Extraction Benchmark for Pre-Trained Language Models    Chenguang Wang, Xiao Liu, Dawn Song arXiv_AI arXiv_AI  Bert  Zero-Shot  Knowledge  Action  Relation  Language_Model  PDF
• 2022-10-25 DEMETR: Diagnosing Evaluation Metrics for Translation    Marzena Karpinska, Nishant Raj, Katherine Thai, Yixiao Song, Ankita Gupta, Mohit Iyyer arXiv_CL arXiv_CL  Bert  Relation  Language_Model  PDF
• 2022-10-25 Parameter-Efficient Legal Domain Adaptation    Jonathan Li, Rohan Bhambhoria, Xiaodan Zhu arXiv_CL arXiv_CL  Transformer  Unsupervised  Bert  Knowledge  Pose  Language_Model  PDF
• 2022-10-24 VLC-BERT: Visual Question Answering with Contextualized Commonsense Knowledge    Sahithya Ravi, Aditya Chinchure, Leonid Sigal, Renjie Liao, Vered Shwartz arXiv_CV arXiv_CV  Transformer  Bert  Knowledge  Pose  VQA  QA  PDF
• 2022-10-24 Learning by Hallucinating: Vision-Language Pre-training with Weak Supervision    Tzu-Jui Julius Wang, Jorma Laaksonen, Tomas Langer, Heikki Arponen, Tom E. Bishop arXiv_CV arXiv_CV  Image_Caption  Transformer  Bert  Image_Retrieval  Pose  Action  VQA  Caption  PDF
• 2022-10-24 Effective Pre-Training Objectives for Transformer-based Autoencoders    Luca Di Liello, Matteo Gabburo, Alessandro Moschitti arXiv_CL arXiv_CL  Transformer  Bert  Pose  PDF
• 2022-10-24 Classification of Misinformation in New Articles using Natural Language Processing and a Recurrent Neural Network    Brendan Cunha, Lydia Manikonda arXiv_CL arXiv_CL  Bert  Classification  PDF
• 2022-10-24 Entity-level Sentiment Analysis in Contact Center Telephone Conversations    Xue-Yong Fu, Cheng Chen, Md Tahmid Rahman Laskar, Shayna Gardiner, Pooja Hiranandani, Shashi Bhushan TN arXiv_CL arXiv_CL  Transformer  Bert  Emotion  Sentiment  CNN  PDF
• 2022-10-24 Explaining Translationese: why are Neural Classifiers Better and what do they Learn?    Kwabena Amponsah-Kaakyire, Daria Pylypenko, Josef van Genabith, Cristina España-Bonet arXiv_CL arXiv_CL  Bert  Classification  Relation  PDF
• 2022-10-24 Universal and Independent: Multilingual Probing Framework for Exhaustive Model Interpretation and Evaluation    Oleg Serikov, Vitaly Protasov, Ekaterina Voloshina, Viktoria Knyazkova, Tatiana Shavrina arXiv_AI arXiv_AI  Bert  Knowledge  Pose  Language_Model  PDF
• 2022-10-24 Mutual Information Alleviates Hallucinations in Abstractive Summarization    Liam van der Poel, Ryan Cotterell, Clara Meister arXiv_CL arXiv_CL  Bert  Pose  Summarization  PDF
• 2022-10-24 The Better Your Syntax, the Better Your Semantics? Probing Pretrained Language Models for the English Comparative Correlative    Leonie Weissweiler, Valentin Hofmann, Abdullatif Köksal, Hinrich Schütze arXiv_CL arXiv_CL  Bert  Knowledge  Classification  Language_Model  PDF
• 2022-10-24 Proficiency assessment of L2 spoken English using wav2vec 2.0    Stefano Bannò, Marco Matassoni arXiv_CL arXiv_CL  Bert  Salient  Speech  PDF
• 2022-10-24 Exploring Euphemism Detection in Few-Shot and Zero-Shot Settings    Sedrick Scott Keh arXiv_CL arXiv_CL  Bert  Zero-Shot  Pose  Detection  Few-Shot  Language_Model  PDF
• 2022-10-23 Bootstrapping meaning through listening: Unsupervised learning of spoken sentence embeddings    Jian Zhu, Zuoyu Tian, Yadong Liu, Cong Zhang, Chia-wen Lo arXiv_CL arXiv_CL  Embedding  Unsupervised  Bert  Knowledge  Speech  Pose  Contrastive_Learning  Relation  PDF
• 2022-10-23 Automated Essay Scoring using Transformers    Kshitij Gupta arXiv_AI arXiv_AI  Transformer  Bert  RNN  Attention  PDF
• 2022-10-23 On Cross-Domain Pre-Trained Language Models for Clinical Text Mining: How Do They Perform on Data-Constrained Fine-Tuning?    Yuping Wu, Lifeng Han, Valerio Antonini, Goran Nenadic arXiv_AI arXiv_AI  Transformer  Recognition  Bert  Medical  Language_Model  PDF
• 2022-10-23 A BERT-based Deep Learning Approach for Reputation Analysis in Social Media    Mohammad Wali Ur Rahman, Sicong Shao, Pratik Satam, Salim Hariri, Chris Padilla, Zoe Taylor, Carlos Nevarez arXiv_CL arXiv_CL  Transformer  Bert  Pose  Face  Action  Deep_Learning  Language_Model  PDF
• 2022-10-22 Meta-learning Pathologies from Radiology Reports using Variance Aware Prototypical Networks    Arijit Sehanobish, Kawshik Kannan, Nabila Abraham, Anasuya Das, Benjamin Odry arXiv_CL arXiv_CL  Transformer  Bert  Text_Classification  Regularization  Pose  Classification  Few-Shot  Language_Model  PDF
• 2022-10-21 SpaBERT: A Pretrained Language Model from Geographic Data for Geo-Entity Representation    Zekun Li, Jina Kim, Yao-Yi Chiang, Muhao Chen arXiv_AI arXiv_AI  Embedding  Bert  Pose  Relation  Language_Model  Prediction  PDF
• 2022-10-21 Probing with Noise: Unpicking the Warp and Weft of Embeddings    Filip Klubička, John D. Kelleher arXiv_AI arXiv_AI  Embedding  Bert  Relation  PDF
• 2022-10-21 Discovering Differences in the Representation of People using Contextualized Semantic Axes    Li Lucy, Divya Tadimeti, David Bamman arXiv_CL arXiv_CL  Embedding  Bert  PDF
• 2022-10-21 Multimodal Model with Text and Drug Embeddings for Adverse Drug Reaction Classification    Andrey Sakhovskiy, Elena Tutubalina arXiv_CL arXiv_CL  Embedding  Bert  Action  Classification  Prediction  PDF
• 2022-10-21 LittleBird: Efficient Faster & Longer Transformer for Question Answering    Minchul Lee (1), Kijong Han (1), Myeong Cheol Shin (1) ((1) Kakao Enterprise Corp.) arXiv_AI arXiv_AI  Transformer  Bert  Pose  Attention  Language_Model  PDF
• 2022-10-21 A Textless Metric for Speech-to-Speech Comparison    Laurent Besacier, Swen Ribeiro, Olivier Galibert, Ioan Calapodescu arXiv_CL arXiv_CL  Bert  Speech  Pose  PDF
• 2022-10-21 Evidence of Vocal Tract Articulation in Self-Supervised Learning of Speech    Cheol Jun Cho, Peter Wu, Abdelrahman Mohamed, Gopala K. Anumanchipalli arXiv_AI arXiv_AI  Transformer  Bert  Speech  Self-Supervised  Pose  Relation  Attention  PDF
• 2022-10-21 SLING: Sino Linguistic Evaluation of Large Language Models    Yixiao Song, Kalpesh Krishna, Rajesh Bhatt, Mohit Iyyer arXiv_CL arXiv_CL  Bert  Knowledge  Language_Model  PDF
• 2022-10-20 Tele-Knowledge Pre-training for Fault Analysis    Zhuo Chen, Wen Zhang, Yufeng Huang, Mingyang Chen, Yuxia Geng, Hongtao Yu, Zhen Bi, Yichi Zhang, Zhen Yao, Wenting Song, Xinliang Wu, Yi Yang, Song Jiang, Zhaoyang Lian, Yingying Li, Huajun Chen arXiv_AI arXiv_AI  Transformer  Bert  Knowledge  Pose  GAN  Prediction  PDF
• 2022-10-20 Automatic Document Selection for Efficient Encoder Pretraining    Yukun Feng, Patrick Xia, Benjamin Van Durme, João Sedoc arXiv_CL arXiv_CL  Bert  Pose  Language_Model  PDF
• 2022-10-19 BioGPT: Generative Pre-trained Transformer for Biomedical Text Generation and Mining    Renqian Luo, Liai Sun, Yingce Xia, Tao Qin, Sheng Zhang, Hoifung Poon, Tie-Yan Liu arXiv_AI arXiv_AI  Transformer  Bert  Pose  Action  Relation  Relation_Extraction  Attention  Text_Generation  Medical  Language_Model  QA  PDF
• 2022-10-19 A Unified Neural Network Model for Readability Assessment with Feature Projection and Length-Balanced Loss    Wenbiao Li, Ziyang Wang, Yunfang Wu arXiv_CL arXiv_CL  Bert  Knowledge  Pose  Deep_Learning  PDF
• 2022-10-19 Forging Multiple Training Objectives for Pre-trained Language Models via Meta-Learning    Hongqiu Wu, Ruixue Ding, Hai Zhao, Boli Chen, Pengjun Xie, Fei Huang, Min Zhang arXiv_CL arXiv_CL  Transformer  Bert  Pose  Language_Model  PDF
• 2022-10-19 Language Model Decomposition: Quantifying the Dependency and Correlation of Language Models    Hao Zhang arXiv_AI arXiv_AI  Bert  Pose  Relation  Language_Model  PDF
• 2022-10-18 ELASTIC: Numerical Reasoning with Adaptive Symbolic Compiler    Jiaxin Zhang, Yashar Moshfeghi arXiv_AI arXiv_AI  Bert  QA  PDF
• 2022-10-18 A Simple and Effective Method to Improve Zero-Shot Cross-Lingual Transfer Learning    Kunbo Ding, Weijie Liu, Yuejian Fang, Weiquan Mao, Zhe Zhao, Tao Zhu, Haoyan Liu, Rong Tian, Yiren Chen arXiv_CL arXiv_CL  Embedding  Transfer_Learning  Bert  Zero-Shot  Text_Classification  Pose  Classification  Attention  PDF
• 2022-10-18 Probing Cross-modal Semantics Alignment Capability from the Textual Perspective    Zheng Ma, Shi Zong, Mianzhi Pan, Jianbing Zhang, Shujian Huang, Xinyu Dai, Jiajun Chen arXiv_CL arXiv_CL  Image_Caption  Transformer  Bert  Pose  Attention  Caption  PDF
• 2022-10-17 Using Bottleneck Adapters to Identify Cancer in Clinical Notes under Low-Resource Constraints    Omid Rohanian, Hannah Jauncey, Mohammadmahdi Nouriborji, Bronner P. Gonçalves, Christiana Kartsonaki, ISARIC Clinical Characterisation Group, Laura Merson, David Clifton arXiv_AI arXiv_AI  Transformer  Bert  RNN  Medical  PDF
• 2022-10-17 Fine-tuned Sentiment Analysis of COVID-19 Vaccine-Related Social Media Data: Comparative Study    Chad A Melton, Brianna M White, Robert L Davis, Robert A Bednarczyk, Arash Shaban-Nejad arXiv_CL arXiv_CL  Bert  Pose  Face  Sentiment  PDF
• 2022-10-17 Zero-Shot Ranking Socio-Political Texts with Transformer Language Models to Reduce Close Reading Time    Kiymet Akdemir, Ali Hürriyetoğlu arXiv_CL arXiv_CL  Transformer  Bert  Zero-Shot  Action  Classification  Language_Model  PDF
• 2022-10-16 Acoustic-aware Non-autoregressive Spell Correction with Mask Sample Decoding    Ruchao Fan, Guoli Ye, Yashesh Gaur, Jinyu Li arXiv_SD arXiv_SD  Transformer  Recognition  Bert  Speech  Pose  Speech_Recognition  Language_Model  PDF
• 2022-10-16 CTCBERT: Advancing Hidden-unit BERT with CTC Objectives    Ruchao Fan, Yiming Wang, Yashesh Gaur, Jinyu Li arXiv_SD arXiv_SD  Bert  Speech  Classification  PDF
• 2022-10-16 Improving Semantic Matching through Dependency-Enhanced Pre-trained Model with Adaptive Fusion    Jian Song, Di Liang, Rumei Li, Yuntao Li, Sirui Wang, Minlong Peng, Wei Wu, Yongxin Yu arXiv_AI arXiv_AI  Transformer  Bert  Knowledge  Pose  Relation  Attention  Matching  PDF
• 2022-10-15 A Simple and Strong Baseline for End-to-End Neural RST-style Discourse Parsing    Naoki Kobayashi, Tsutomu Hirao, Hidetaka Kamigaito, Manabu Okumura, Masaaki Nagata arXiv_CL arXiv_CL  Transformer  Bert  Language_Model  Prediction  PDF
• 2022-10-15 AraLegal-BERT: A pretrained language model for Arabic Legal text    Muhammad AL-Qurishi, Sarah AlQaseemi, Riad Soussi arXiv_CL arXiv_CL  Transformer  Bert  Language_Model  PDF
• 2022-10-14 PseudoReasoner: Leveraging Pseudo Labels for Commonsense Knowledge Base Population    Tianqing Fang, Quyet V. Do, Hongming Zhang, Yangqiu Song, Ginny Y. Wong, Simon See arXiv_AI arXiv_AI  Bert  Knowledge  Pose  Prediction  PDF
• 2022-10-14 BERTScore is Unfair: On Social Bias in Language Model-Based Metrics for Text Generation    Tianxiang Sun, Junliang He, Xipeng Qiu, Xuanjing Huang arXiv_AI arXiv_AI  Bert  Text_Generation  Language_Model  Matching  PDF
• 2022-10-14 TSP-Bot: Robotic TSP Pen Art using High-DoF Manipulators    Daeun Song, Eunjung Lim, Jiyoon Park, Minjung Jung, Young J. Kim arXiv_RO arXiv_RO  Bert  Optimization  PDF
• 2022-10-14 DyLoRA: Parameter Efficient Tuning of Pre-trained Models using Dynamic Search-Free Low-Rank Adaptation    Mojtaba Valipour, Mehdi Rezagholizadeh, Ivan Kobyzev, Ali Ghodsi arXiv_CL arXiv_CL  Bert  PDF
• 2022-10-14 Kernel-Whitening: Overcome Dataset Bias with Isotropic Sentence Embedding    Songyang Gao, Shihan Dou, Qi Zhang, Xuanjing Huang arXiv_CL arXiv_CL  Embedding  Bert  Pose  Relation  Attention  PDF
• 2022-10-14 Self-Adaptive Named Entity Recognition by Retrieving Unstructured Knowledge    Kosuke Nishida, Naoki Yoshinaga, Kyosuke Nishida arXiv_CL arXiv_CL  Recognition  Bert  Knowledge  Pose  Prediction  PDF
• 2022-10-13 HuBERT-TR: Reviving Turkish Automatic Speech Recognition with Self-supervised Speech Representation Learning    Ali Safaya, Engin Erzin arXiv_CL arXiv_CL  Transformer  Recognition  Bert  Represenation_Learning  Speech  Self-Supervised  Speech_Recognition  PDF
• 2022-10-13 SQuAT: Sharpness- and Quantization-Aware Training for BERT    Zheng Wang, Juncheng B Li, Shuhui Qu, Florian Metze, Emma Strubell arXiv_CL arXiv_CL  Transformer  Quantization  Bert  Pose  Deep_Learning  Inference  PDF
• 2022-10-13 Tone prediction and orthographic conversion for Basaa    Ilya Nikitin, Brian O'Connor, Anastasia Safonova arXiv_CL arXiv_CL  Bert  Prediction  PDF
• 2022-10-13 Multilingual Zero Resource Speech Recognition Base on Self-Supervise Pre-Trained Acoustic Models    Haoyu Wang, Wei-Qiang Zhang, Hongbin Suo, Yulong Wan arXiv_CL arXiv_CL  Recognition  Bert  Speech  Speech_Recognition  Language_Model  PDF
• 2022-10-13 Overlooked Video Classification in Weakly Supervised Video Anomaly Detection    Weijun Tan, Qi Yao, Jingfeng Liu arXiv_CV arXiv_CV  Bert  Weakly_Supervised  RNN  Classification  Detection  Video_Classification  PDF
• 2022-10-12 RankT5: Fine-Tuning T5 for Text Ranking with Ranking Losses    Honglei Zhuang, Zhen Qin, Rolf Jagerman, Kai Hui, Ji Ma, Jing Lu, Jianmo Ni, Xuanhui Wang, Michael Bendersky arXiv_CL arXiv_CL  Bert  Zero-Shot  Pose  Classification  Language_Model  PDF
• 2022-10-12 Developing a general-purpose clinical language inference model from a large corpus of clinical notes    Madhumita Sushil, Dana Ludwig, Atul J. Butte, Vivek A. Rudrapatna arXiv_CL arXiv_CL  Transformer  Recognition  Bert  Pose  Action  Relation  Relation_Extraction  Medical  Inference  Language_Model  PDF
• 2022-10-12 MotionBERT: Unified Pretraining for Human Motion Analysis    Wentao Zhu, Xiaoxuan Ma, Zhaoyang Liu, Libin Liu, Wayne Wu, Yizhou Wang arXiv_CV arXiv_CV  Transformer  Recognition  3D  Bert  Pose_Estimation  Knowledge  Pose  Action_Recognition  Action  Relation  PDF
• 2022-10-12 MiniALBERT: Model Distillation via Parameter-Efficient Recursive Transformers    Mohammadmahdi Nouriborji, Omid Rohanian, Samaneh Kouchaki, David A. Clifton arXiv_CL arXiv_CL  Transformer  Bert  Knowledge  Pose  Medical  Language_Model  PDF
• 2022-10-12 Foundation Transformers    Hongyu Wang, Shuming Ma, Shaohan Huang, Li Dong, Wenhui Wang, Zhiliang Peng, Yu Wu, Payal Bajaj, Saksham Singhal, Alon Benhaim, Barun Patra, Zhun Liu, Vishrav Chaudhary, Xia Song, Furu Wei arXiv_CV arXiv_CV  Transformer  Recognition  Bert  Speech  Pose  Speech_Recognition  Language_Model  PDF
• 2022-10-12 On Text Style Transfer via Style Masked Language Models    Sharan Narasimhan, Pooja Shekar, Suvodip Dey, Maunendra Sankar Desarkar arXiv_CL arXiv_CL  Reconstruction  Style_Transfer  Bert  Pose  Attention  Language_Model  PDF
• 2022-10-12 GMP*: Well-Tuned Global Magnitude Pruning Can Outperform Most BERT-Pruning Methods    Eldar Kurtic, Dan Alistarh arXiv_CL arXiv_CL  Bert  Language_Model  PDF
• 2022-10-12 Probing Commonsense Knowledge in Pre-trained Language Models with Sense-level Precision and Expanded Vocabulary    Daniel Loureiro, Alípio Mário Jorge arXiv_AI arXiv_AI  Transformer  Bert  Knowledge  Pose  Ontology  Relation  Language_Model  Prediction  PDF
• 2022-10-12 SQuId: Measuring Speech Naturalness in Many Languages    Thibault Sellam, Ankur Bapna, Joshua Camp, Diana Mackinnon, Ankur P. Parikh, Jason Riesa arXiv_CL arXiv_CL  Transformer  Bert  Zero-Shot  Speech  Prediction  PDF
• 2022-10-11 CLIP also Understands Text: Prompting CLIP for Phrase Understanding    An Yan, Jiacheng Li, Wanrong Zhu, Yujie Lu, William Yang Wang, Julian McAuley arXiv_CL arXiv_CL  Transformer  Transfer_Learning  Bert  Zero-Shot  Language_Model  PDF
• 2022-10-11 Transfer Learning with Joint Fine-Tuning for Multimodal Sentiment Analysis    Guilherme Lourenço de Toledo, Ricardo Marcondes Marcacini arXiv_CV arXiv_CV  Transformer  Transfer_Learning  Bert  Sentiment_Classification  Classification  Sentiment  PDF
• 2022-10-11 CLIP-Fields: Weakly Supervised Semantic Fields for Robotic Memory    Nur Muhammad Mahi Shafiullah, Chris Paxton, Lerrel Pinto, Soumith Chintala, Arthur Szlam arXiv_CV arXiv_CV  Segmentation  Embedding  Semantic_Segmentation  3D  Bert  Weakly_Supervised  Pose  Action  Few-Shot  PDF
• 2022-10-11 Multilingual BERT has an accent: Evaluating English influences on fluency in multilingual models    Isabel Papadimitriou, Kezia Lopez, Dan Jurafsky arXiv_CL arXiv_CL  Bert  Language_Model  PDF
• 2022-10-11 Better Than Whitespace: Information Retrieval for Languages without Custom Tokenizers    Odunayo Ogundepo, Xinyu Zhang, Jimmy Lin arXiv_CL arXiv_CL  Unsupervised  Bert  Knowledge  Pose  Matching  PDF
• 2022-10-11 Are Pretrained Multilingual Models Equally Fair Across Languages?    Laura Cabello Piqueras, Anders Søgaard arXiv_CL arXiv_CL  Bert  Language_Model  PDF
• 2022-10-11 COVID-19-related Nepali Tweets Classification in a Low Resource Setting    Rabin Adhikari, Safal Thapaliya, Nirajan Basnet, Samip Poudel, Aman Shakya, Bishesh Khanal arXiv_CL arXiv_CL  Bert  Classification  GAN  Language_Model  PDF
• 2022-10-11 Code Librarian: A Software Package Recommendation System    Lili Tao, Alexandru-Petre Cazan, Senad Ibraimoski, Sean Moran arXiv_AI arXiv_AI  Bert  Recommendation  PDF
• 2022-10-11 On the Use of Semantically-Aligned Speech Representations for Spoken Language Understanding    Gaëlle Laperrière, Valentin Pelloin, Mickaël Rouvier, Themos Stafylakis, Yannick Estève arXiv_CL arXiv_CL  Embedding  Bert  Represenation_Learning  Speech  PDF
• 2022-10-11 Revisiting and Advancing Chinese Natural Language Understanding with Accelerated Heterogeneous Knowledge Pre-training    Taolin Zhang, Junwei DOng, Jianing Wang, Chengyu Wang, Ang Wang, Yinghui Liu, Jun Huang, Yong Li, Xiaofeng He arXiv_CL arXiv_CL  Transformer  Bert  Knowledge  Knowledge_Graph  Relation  Language_Model  PDF
• 2022-10-11 A Win-win Deal: Towards Sparse and Robust Pre-trained Language Models    Yuanxin Liu, Fandong Meng, Zheng Lin, Jiangnan Li, Peng Fu, Yanan Cao, Weiping Wang, Jie Zhou arXiv_CL arXiv_CL  Bert  Sparse  Face  Language_Model  PDF
• 2022-10-11 HUE: Pretrained Model and Dataset for Understanding Hanja Documents of Ancient Korea    Haneul Yoo, Jiho Jin, Juhee Son, JinYeong Bak, Kyunghyun Cho, Alice Oh arXiv_CL arXiv_CL  Recognition  Bert  Zero-Shot  Classification  Language_Model  PDF
• 2022-10-10 Multi-CLS BERT: An Efficient Alternative to Traditional Ensembling    Haw-Shiuan Chang, Ruei-Yao Sun, Kathryn Ricci, Andrew McCallum arXiv_CL arXiv_CL  Embedding  Bert  Pose  Prediction  PDF
• 2022-10-10 Transformer-based Localization from Embodied Dialog with Large-scale Pre-training    Meera Hahn, James M. Rehg arXiv_AI arXiv_AI  Transformer  Bert  PDF
• 2022-10-10 Empowering the Fact-checkers! Automatic Identification of Claim Spans on Twitter    Megha Sundriyal, Atharva Kulkarni, Vaibhav Pulastya, Md Shad Akhtar, Tanmoy Chakraborty arXiv_CL arXiv_CL  Bert  Pose  Classification  Medical  PDF
• 2022-10-10 Do Children Texts Hold The Key To Commonsense Knowledge?    Julien Romero, Simon Razniewski arXiv_AI arXiv_AI  Bert  Knowledge  Action  PDF
• 2022-10-10 Multi-Modal Fusion Transformer for Visual Question Answering in Remote Sensing    Tim Siebert, Kai Norman Clasen, Mahdyar Ravanbakhsh, Begüm Demir arXiv_AI arXiv_AI  Transformer  Bert  Represenation_Learning  Pose  Action  Classification  Relation  VQA  QA  PDF
• 2022-10-10 DEPTWEET: A Typology for Social Media Texts to Detect Depression Severities    Mohsinul Kabir, Tasnim Ahmed, Md. Bakhtiar Hasan, Md Tahmid Rahman Laskar, Tarun Kumar Joarder, Hasan Mahmud, Kamrul Hasan arXiv_CL arXiv_CL  Bert  Attention  PDF
• 2022-10-10 Parameter-Efficient Tuning with Special Token Adaptation    Xiaoocong Yang, James Y. Huang, Wenxuan Zhou, Muhao Chen arXiv_AI arXiv_AI  Transformer  Bert  Text_Classification  Classification  Attention  Language_Model  PDF
• 2022-10-09 FairGer: Using NLP to Measure Support for Women and Migrants in 155 Years of German Parliamentary Debates    Dominik Beese, Ole Pütz, Steffen Eger arXiv_CL arXiv_CL  Bert  PDF
• 2022-10-09 QAScore -- An Unsupervised Unreferenced Metric for the Question Generation Evaluation    Tianbo Ji, Chenyang Lyu, Gareth Jones, Liting Zhou, Yvette Graham arXiv_CL arXiv_CL  Unsupervised  Bert  Pose  Relation  Language_Model  QA  PDF
• 2022-10-09 Pruning Adversarially Robust Neural Networks without Adversarial Examples    Tong Jian, Zifeng Wang, Yanzhi Wang, Jennifer Dy, Stratis Ioannidis arXiv_AI arXiv_AI  Bert  Knowledge  Adversarial  Pose  PDF
• 2022-10-09 Spread Love Not Hate: Undermining the Importance of Hateful Pre-training for Hate Speech Detection    Shantanu Patankar, Omkar Gokhale, Aditya Kane, Tanmay Chavan, Raviraj Joshi arXiv_AI arXiv_AI  Transformer  Bert  Speech  Classification  Detection  Language_Model  PDF
• 2022-10-09 Improve Transformer Pre-Training with Decoupled Directional Relative Position Encoding and Representation Differentiations    Haojie Zhang, Mingfei Liang, Ruobing Xie, Zhenlong Sun, Bo Zhang, Leyu Lin arXiv_CL arXiv_CL  Transformer  Bert  Optimization  Represenation_Learning  Pose  Attention  Language_Model  PDF
• 2022-10-08 On Task-Adaptive Pretraining for Dialogue Response Selection    Tzu-Hsiang Lin, Ta-Chung Chi, Anna Rumshisky arXiv_CL arXiv_CL  Transformer  Bert  Pose  PDF
• 2022-10-08 CoBERT: Self-Supervised Speech Representation Learning Through Code Representation Learning    Chutong Meng, Junyi Ao, Tom Ko, Mingxuan Wang, Haizhou Li arXiv_SD arXiv_SD  Bert  Represenation_Learning  Speech  Self-Supervised  Pose  Face  PDF
• 2022-10-08 InfoCSE: Information-aggregated Contrastive Learning of Sentence Embeddings    Xing Wu, Chaochen Gao, Zijia Lin, Jizhong Han, Zhongyuan Wang, Songlin Hu arXiv_CL arXiv_CL  Embedding  Unsupervised  Bert  Represenation_Learning  Pose  Contrastive_Learning  Relation  Language_Model  PDF
• 2022-10-08 KG-MTT-BERT: Knowledge Graph Enhanced BERT for Multi-Type Medical Text Classification    Yong He, Cheng Wang, Shun Zhang, Nan Li, Zhaorong Li, Zhenyu Zeng arXiv_AI arXiv_AI  Bert  Text_Classification  Knowledge  Knowledge_Graph  Pose  Classification  Deep_Learning  Medical  PDF
• 2022-10-07 Breaking BERT: Evaluating and Optimizing Sparsified Attention    Siddhartha Brahma, Polina Zablotskaia, David Mimno arXiv_CL arXiv_CL  Transformer  Bert  Sparse  Attention  PDF
• 2022-10-07 Hate Speech and Offensive Language Detection in Bengali    Mithun Das, Somnath Banerjee, Punyajoy Saha, Animesh Mukherjee arXiv_CL arXiv_CL  Bert  Speech  Action  Classification  Detection  Few-Shot  PDF
• 2022-10-07 DABERT: Dual Attention Enhanced BERT for Semantic Matching    Sirui Wang, Di Liang, Jian Song, Yuntao Li, Wei Wu arXiv_CL arXiv_CL  Transformer  Bert  Pose  Attention  Language_Model  Prediction  Matching  PDF
• 2022-10-07 Generating Quizzes to Support Training on Quality Management and Assurance in Space Science and Engineering    Andrés García-Silva, Cristian Berrío, José Manuel Gómez-Pérez arXiv_AI arXiv_AI  Bert  PDF
• 2022-10-06 HealthE: Classifying Entities in Online Textual Health Advice    Joseph Gatto, Parker Seegmiller, Garrett Johnston, Sarah M. Preum arXiv_CL arXiv_CL  Bert  Classification  Medical  PDF
• 2022-10-06 Explainable Verbal Deception Detection using Transformers    Loukas Ilias, Felix Soldner, Bennett Kleinberg arXiv_CL arXiv_CL  Transformer  Bert  Review  Pose  Deep_Learning  Detection  Relation  Attention  Prediction  PDF
• 2022-10-06 Conversational Semantic Role Labeling with Predicate-Oriented Latent Graph    Hao Fei, Shengqiong Wu, Meishan Zhang, Yafeng Ren, Donghong Ji arXiv_AI arXiv_AI  Bert  Pose  Detection  Attention  Language_Model  PDF
• 2022-10-06 Matching Text and Audio Embeddings: Exploring Transfer-learning Strategies for Language-based Audio Retrieval    Benno Weck, Miguel Pérez Fernández, Holger Kirchhoff, Xavier Serra arXiv_CL arXiv_CL  Embedding  Bert  Deep_Learning  Matching  PDF
• 2022-10-06 Join-Chain Network: A Logical Reasoning View of the Multi-head Attention in Transformer    Jianyi Zhang, Yiran Chen, Jianshu Chen arXiv_CL arXiv_CL  Transformer  Bert  Pose  Attention  PDF
• 2022-10-05 Privacy-Preserving Text Classification on BERT Embeddings with Homomorphic Encryption    Garam Lee, Minsoo Kim, Jai Hyun Park, Seung-won Hwang, Jung Hee Cheon arXiv_CL arXiv_CL  Embedding  Bert  Text_Classification  Pose  Classification  PDF
• 2022-10-05 Revisiting Structured Dropout    Yiren Zhao, Oluwatomisin Dada, Xitong Gao, Robert D Mullins arXiv_AI arXiv_AI  Bert  Regularization  Pose  Inference  PDF
• 2022-10-05 Token Classification for Disambiguating Medical Abbreviations    Mucahit Cevik, Sanaz Mohammad Jafari, Mitchell Myers, Savas Yildirim arXiv_AI arXiv_AI  Transformer  Bert  Text_Classification  Pose  Classification  Medical  Prediction  PDF
• 2022-10-03 Characterization of effects of transfer learning across domains and languages    Sovesh Mohapatra arXiv_CL arXiv_CL  Transfer_Learning  Bert  Language_Model  PDF
• 2022-10-03 Hypothesis Engineering for Zero-Shot Hate Speech Detection    Janis Goldzycher, Gerold Schneider arXiv_CL arXiv_CL  Bert  Zero-Shot  Text_Classification  Speech  Pose  Classification  Detection  Inference  Prediction  PDF
• 2022-10-03 SpeechCLIP: Integrating Speech with Pre-Trained Vision and Language Model    Yi-Jen Shih, Hsuan-Fu Wang, Heng-Jui Chang, Layne Berry, Hung-yi Lee, David Harwath arXiv_CL arXiv_CL  Bert  Zero-Shot  Speech  Pose  Caption  Language_Model  PDF
• 2022-10-03 Probing of Quantitative Values in Abstractive Summarization Models    Nathan M. White arXiv_CL arXiv_CL  Embedding  Bert  Pose  Quantitative  Summarization  PDF
• 2022-10-01 Construction and Evaluation of a Self-Attention Model for Semantic Understanding of Sentence-Final Particles    Shuhei Mandokoro, Natsuki Oka, Akane Matsushima, Chie Fukada, Yuko Yoshimura, Koji Kawahara, Kazuaki Tanaka arXiv_CL arXiv_CL  Bert  Pose  Relation  Attention  PDF
• 2022-09-29 Stop Wasting My Time! Saving Days of ImageNet and BERT Training with Latest Weight Averaging    Jean Kaddour arXiv_AI arXiv_AI  Bert  Language_Model  PDF
• 2022-09-29 polyBERT: A chemical language model to enable fully machine-driven ultrafast polymer informatics    Christopher Kuenneth, Rampi Ramprasad arXiv_AI arXiv_AI  Bert  Language_Model  Prediction  PDF
• 2022-09-29 Prompt-guided Scene Generation for 3D Zero-Shot Learning    Majid Nasiri, Ali Cheraghian, Townim Faisal Chowdhury, Sahar Ahmadi, Morteza Saberi, Shafin Rahman arXiv_CV arXiv_CV  Point_Cloud  3D  Bert  Zero-Shot  Scene_Generation  Pose  Contrastive_Learning  Action  Caption  Language_Model  PDF
• 2022-09-29 Neural Media Bias Detection Using Distant Supervision With BABE -- Bias Annotations By Experts    Timo Spinde, Manuel Plank, Jan-David Krieger, Terry Ruas, Bela Gipp, Akiko Aizawa arXiv_CL arXiv_CL  Bert  Pose  Detection  PDF
• 2022-09-28 Downstream Datasets Make Surprisingly Good Pretraining Corpora    Kundan Krishna, Saurabh Garg, Jeffrey P. Bigham, Zachary C. Lipton arXiv_CL arXiv_CL  Transformer  Bert  PDF
• 2022-09-28 Supervised Contrastive Learning as Multi-Objective Optimization for Fine-Tuning Large Pre-trained Language Models    Youness Moukafih, Mounir Ghogho, Kamel Smaili arXiv_CL arXiv_CL  Embedding  Bert  Optimization  Adversarial  Pose  Contrastive_Learning  Classification  Language_Model  PDF
• 2022-09-28 Human-in-the-loop Robotic Grasping using BERT Scene Representation    Yaoxian Song, Penglei Sun, Pengfei Fang, Linyi Yang, Yanghua Xiao, Yue Zhang arXiv_RO arXiv_RO  Bert  Pose  Face  PDF
• 2022-09-28 Keyword Extraction from Short Texts with~a~Text-To-Text Transfer Transformer    Piotr Pęzik, Agnieszka Mikołajczyk-Bareła, Adam Wawrzyński, Bartłomiej Nitoń, Maciej Ogrodniczuk arXiv_CL arXiv_CL  Transformer  Bert  Sparse  Action  Language_Model  PDF
• 2022-09-28 CEFER: A Four Facets Framework based on Context and Emotion embedded features for Implicit and Explicit Emotion Recognition    Fereshteh Khoshnam, Ahmad Baraani-Dastjerdi, M.J. Liaghatdar arXiv_CL arXiv_CL  Recognition  Bert  Knowledge  Pose  Emotion  Face  Action  Attention  PDF
• 2022-09-28 An Efficient Multitask Learning Architecture for Affective Vocal Burst Analysis    Tobias Hallmen, Silvan Mertes, Dominik Schiller, Elisabeth André arXiv_SD arXiv_SD  Bert  Speech  PDF
• 2022-09-28 YATO: Yet Another deep learning based Text analysis Open toolkit    Zeqiang Wang, Yile Wang, Jiageng Wu, Zhiyang Teng, Jie Yang arXiv_CL arXiv_CL  Bert  RNN  Classification  Deep_Learning  Language_Model  PDF
• 2022-09-28 Deep Learning based Automatic Quantification of Urethral Plate Quality using the Plate Objective Scoring Tool    Tariq O. Abbas, Mohamed AbdelMoniem, Ibrahim Khalil, Md Sakib Abrar Hossain, Muhammad E. H. Chowdhury arXiv_AI arXiv_AI  Bert  Pose  Deep_Learning  Detection  CNN  Prediction  PDF
• 2022-09-27 An Effective, Performant Named Entity Recognition System for Noisy Business Telephone Conversation Transcripts    Xue-Yong Fu, Cheng Chen, Md Tahmid Rahman Laskar, Shashi Bhushan TN, Simon Corston-Oliver arXiv_CL arXiv_CL  Recognition  Bert  Speech  Speech_Recognition  PDF
• 2022-09-27 Embarrassingly Easy Document-Level MT Metrics: How to Convert Any Pretrained Metric Into a Document-Level Metric    Giorgos Vernikos, Brian Thompson, Prashant Mathur, Marcello Federico arXiv_CL arXiv_CL  Bert  PDF
• 2022-09-27 A general-purpose material property data extraction pipeline from large polymer corpora using Natural Language Processing    Pranav Shetty, Arunkumar Chitteth Rajan, Christopher Kuenneth, Sonkakshi Gupta, Lakshmi Prerana Panchumarti, Lauren Holm, Chao Zhang, Rampi Ramprasad arXiv_CL arXiv_CL  Recognition  Bert  Pose  Action  Relation  Language_Model  PDF
• 2022-09-27 Improving Radiology Report Generation Systems by Removing Hallucinated References to Non-existent Priors    Vignav Ramesh, Nathan Andrew Chi, Pranav Rajpurkar arXiv_AI arXiv_AI  Bert  Pose  Action  Classification  Deep_Learning  Few-Shot  Medical  PDF
• 2022-09-27 Extractive Question Answering on Queries in Hindi and Tamil    Adhitya Thirumala, Elisa Ferracane arXiv_CL arXiv_CL  Bert  Pose  Classification  QA  PDF
• 2022-09-26 Towards Simple and Efficient Task-Adaptive Pre-training for Text Classification    Arnav Ladkat, Aamir Miyajiwala, Samiksha Jagadale, Rekha Kulkarni, Raviraj Joshi arXiv_CL arXiv_CL  Transformer  Embedding  Bert  Text_Classification  Pose  Classification  Language_Model  PDF
• 2022-09-26 Out-of-Distribution Detection with Hilbert-Schmidt Independence Optimization    Jingyang Lin, Yu Wang, Qi Cai, Yingwei Pan, Ting Yao, Hongyang Chao, Tao Mei arXiv_CV arXiv_CV  Bert  Optimization  Pose  Detection  Inference  PDF
• 2022-09-26 Do ever larger octopi still amplify reporting biases? Evidence from judgments of typical colour    Fangyu Liu, Julian Martin Eisenschlos, Jeremy R. Cole, Nigel Collier arXiv_AI arXiv_AI  Bert  Face  Language_Model  PDF
• 2022-09-26 The Ability of Self-Supervised Speech Models for Audio Representations    Tung-Yu Wu, Chen-An Li, Tzu-Han Lin, Tsu-Yuan Hsu, Hung-Yi Lee arXiv_AI arXiv_AI  Embedding  Bert  Represenation_Learning  Speech  Self-Supervised  Pose  PDF
• 2022-09-26 Taking a Respite from Representation Learning for Molecular Property Prediction    Jianyuan Deng, Zhibo Yang, Hehe Wang, Iwao Ojima, Dimitris Samaras, Fusheng Wang arXiv_AI arXiv_AI  Bert  Represenation_Learning  Self-Supervised  Activity  Prediction  PDF
• 2022-09-24 Can Transformer Models Effectively Detect Software Aspects in StackOverflow Discussion?    Nibir Chandra Mandal, Tashreef Muhammad, G. M. Shahariar arXiv_CL arXiv_CL  Transformer  Bert  Sentiment  PDF
• 2022-09-24 Dead or Murdered? Predicting Responsibility Perception in Femicide News Reports    Gosse Minnema, Sara Gemelli, Chiara Zanchi, Tommaso Caselli, Malvina Nissim arXiv_CL arXiv_CL  Bert  Salient  Survey  PDF
• 2022-09-24 Learning Chess With Language Models and Transformers    Michael DeLeo, Erhan Guven arXiv_AI arXiv_AI  Transformer  Unsupervised  Bert  Few-Shot  Language_Model  PDF
• 2022-09-23 Promptagator: Few-shot Dense Retrieval From 8 Examples    Zhuyun Dai, Vincent Y. Zhao, Ji Ma, Yi Luan, Jianmo Ni, Jing Lu, Anton Bakalov, Kelvin Guu, Keith B. Hall, Ming-Wei Chang arXiv_CL arXiv_CL  Bert  Knowledge  Pose  Few-Shot  Language_Model  PDF
• 2022-09-23 Variational Open-Domain Question Answering    Valentin Liévin, Andreas Geert Motzfeldt, Ida Riis Jensen, Ole Winther arXiv_CL arXiv_CL  Bert  Optimization  Knowledge  Medical  Language_Model  QA  PDF
• 2022-09-23 IDEA: Interactive DoublE Attentions from Label Embedding for Text Classification    Ziyuan Wang, Hailiang Huang, Songqiao Han arXiv_AI arXiv_AI  Embedding  Bert  Text_Classification  Pose  Classification  Attention  Matching  PDF
• 2022-09-23 Extending Word-Level Quality Estimation for Post-Editing Assistance    Yizhen Wei, Takehito Utsuro, Masaaki Nagata arXiv_CL arXiv_CL  Bert  Pose  PDF
• 2022-09-22 Scope of Pre-trained Language Models for Detecting Conflicting Health Information    Joseph Gatto, Madhusudan Basak, Sarah M. Preum arXiv_CL arXiv_CL  Bert  Pose  Detection  Language_Model  PDF
• 2022-09-22 MonoByte: A Pool of Monolingual Byte-level Language Models    Hugo Abonizio, Leandro Rodrigues de Souza, Roberto Lotufo, Rodrigo Nogueira arXiv_CL arXiv_CL  Embedding  Bert  Zero-Shot  Language_Model  QA  PDF
• 2022-09-22 Adaptation of domain-specific transformer models with text oversampling for sentiment analysis of social media posts on Covid-19 vaccines    Anmol Bansal, Arjun Choudhry, Anubhav Sharma, Seba Susan arXiv_CL arXiv_CL  Transformer  Bert  Classification  Sentiment  Language_Model  PDF
• 2022-09-22 AIR-JPMC@SMM4H'22: Classifying Self-Reported Intimate Partner Violence in Tweets with Multiple BERT-based Models    Alec Candidato, Akshat Gupta, Xiaomo Liu, Sameena Shah arXiv_CL arXiv_CL  Bert  Classification  PDF
• 2022-09-21 Assessing ASR Model Quality on Disordered Speech using BERTScore    Jimmy Tobin, Qisheng Li, Subhashini Venugopalan, Katie Seaver, Richard Cave, Katrin Tomanek arXiv_CL arXiv_CL  Recognition  Bert  Speech  Action  Speech_Recognition  Text_Generation  Prediction  PDF
• 2022-09-21 Representing Affect Information in Word Embeddings    Yuhan Zhang, Wenqi Chen, Ruihan Zhang, Xiajie Zhang arXiv_CL arXiv_CL  Transformer  Embedding  Bert  Salient  Knowledge  Emotion  Classification  Relation  Language_Model  PDF
• 2022-09-21 Subject Verb Agreement Error Patterns in Meaningless Sentences: Humans vs. BERT    Karim Lasri, Olga Seminck, Alessandro Lenci, Thierry Poibeau arXiv_CL arXiv_CL  Bert  Knowledge  Language_Model  PDF
• 2022-09-21 SMTCE: A Social Media Text Classification Evaluation Benchmark and BERTology Models for Vietnamese    Luan Thanh Nguyen, Kiet Van Nguyen, Ngan Luu-Thuy Nguyen arXiv_CL arXiv_CL  Bert  Text_Classification  Pose  Classification  PDF
• 2022-09-21 Bias at a Second Glance: A Deep Dive into Bias for German Educational Peer-Review Data Modeling    Thiemo Wambsganss, Vinitra Swamy, Roman Rietsche, Tanja Käser arXiv_CL arXiv_CL  Embedding  Bert  Review  Language_Model  PDF
• 2022-09-21 Extreme Multi-Domain, Multi-Task Learning With Unified Text-to-Text Transfer Transformers    Adebayo Oshingbesan, Courage Ekoh, Germann Atakpa, Yonah Byaruagaba arXiv_CL arXiv_CL  Transformer  Transfer_Learning  Bert  Knowledge  Relation  Summarization  PDF
• 2022-09-20 Can we do that simpler? Simple, Efficient, High-Quality Evaluation Metrics for NLG    Jens Grünwald, Christoph Leiter, Steffen Eger arXiv_CL arXiv_CL  Transformer  Bert  Inference  PDF
• 2022-09-20 Unsupervised Early Exit in DNNs with Multiple Exits    Hari Narayan N U, Manjesh K. Hanawal, Avinash Bhardwaj arXiv_AI arXiv_AI  Unsupervised  Bert  Face  Inference  Prediction  PDF
• 2022-09-20 One-to-Many Semantic Communication Systems: Design, Implementation, Performance Evaluation    Han Hu, Xingwu Zhu, Fuhui Zhou, Wei Wu, Rose Qingyang Hu, Hongbo Zhu arXiv_CL arXiv_CL  Transfer_Learning  Bert  Pose  PDF
• 2022-09-19 TimberTrek: Exploring and Curating Sparse Decision Trees with Interactive Visualization    Zijie J. Wang, Chudi Zhong, Rui Xin, Takuya Takagi, Zhi Chen, Duen Horng Chau, Cynthia Rudin, Margo Seltzer arXiv_AI arXiv_AI  Bert  Sparse  Knowledge  PDF
• 2022-09-19 ALEXSIS-PT: A New Resource for Portuguese Lexical Simplification    Kai North, Marcos Zampieri, Tharindu Ranasinghe arXiv_AI arXiv_AI  Bert  PDF
• 2022-09-19 Tree-based Text-Vision BERT for Video Search in Baidu Video Advertising    Tan Yu, Jie Liu, Yi Yang, Yi Li, Hongliang Fei, Ping Li arXiv_CV arXiv_CV  Transformer  Bert  Attention  Video_Retrieval  PDF
• 2022-09-17 From Disfluency Detection to Intent Detection and Slot Filling    Mai Hoang Dao, Thinh Hung Truong, Dat Quoc Nguyen arXiv_CL arXiv_CL  Bert  Detection  Language_Model  PDF
• 2022-09-17 Watch What You Pretrain For: Targeted, Transferable Adversarial Examples on Self-Supervised Speech Recognition models    Raphael Olivier, Bhiksha Raj arXiv_CL arXiv_CL  Transformer  Recognition  Bert  Knowledge  Adversarial  Speech  Self-Supervised  Pose  Speech_Recognition  PDF
• 2022-09-17 Detecting Generated Scientific Papers using an Ensemble of Transformer Models    Anna Glazkova, Maksim Glazkov arXiv_AI arXiv_AI  Transformer  Bert  Detection  PDF
• 2022-09-16 Changing the Representation: Examining Language Representation for Neural Sign Language Production    Harry Walsh, Ben Saunders, Richard Bowden arXiv_AI arXiv_AI  Embedding  Bert  Language_Model  PDF
• 2022-09-15 TwHIN-BERT: A Socially-Enriched Pre-trained Language Model for Multilingual Tweet Representations    Xinyang Zhang, Yury Malkov, Omar Florez, Serim Park, Brian McWilliams, Jiawei Han, Ahmed El-Kishky arXiv_CL arXiv_CL  Bert  Language_Model  Prediction  Recommendation  PDF
• 2022-09-15 Machine Reading, Fast and Slow: When Do Models 'Understand' Language?    Sagnik Ray Choudhury, Anna Rogers, Isabelle Augenstein arXiv_CL arXiv_CL  Bert  Salient  Pose  Deep_Learning  PDF
• 2022-09-15 Rethinking Round-trip Translation for Automatic Machine Translation Evaluation    Terry Yue Zhuo, Qiongkai Xu, Xuanli He, Trevor Cohn arXiv_CL arXiv_CL  Bert  Pose  PDF
• 2022-09-15 Linear Transformations for Cross-lingual Sentiment Analysis    Pavel Přibáň, Jakub Šmíd, Adam Mištera, Pavel Král arXiv_CL arXiv_CL  Embedding  Bert  Zero-Shot  RNN  Classification  Sentiment  PDF
• 2022-09-15 Learning to Exploit Elastic Actuators for Quadruped Locomotion    Antonin Raffin, Daniel Seidel, Jens Kober, Alin Albu-Schäffer, João Silvério, Freek Stulp arXiv_RO arXiv_RO  Reinforcement_Learning  Bert  Pose  Action  PDF
• 2022-09-15 Knowledge Graph Completion with Pre-trained Multimodal Transformer and Twins Negative Sampling    Yichi Zhang, Wen Zhang arXiv_CL arXiv_CL  Transformer  Embedding  Bert  Knowledge  Knowledge_Graph  Pose  Prediction  PDF
• 2022-09-15 uChecker: Masked Pretrained Language Models as Unsupervised Chinese Spelling Checkers    Piji Li arXiv_CL arXiv_CL  Unsupervised  Bert  Pose  Detection  Language_Model  PDF
• 2022-09-15 VIPHY: Probing 'Visible' Physical Commonsense Knowledge    Shikhar Singh, Ehsan Qasemi, Muhao Chen arXiv_CL arXiv_CL  Transformer  Bert  Knowledge  Caption  Language_Model  PDF
• 2022-09-14 On the State of the Art in Authorship Attribution and Authorship Verification    Jacob Tyo, Bhuwan Dhingra, Zachary C. Lipton arXiv_AI arXiv_AI  Bert  Survey  PDF
• 2022-09-14 LibertyMFD: A Lexicon to Assess the Moral Foundation of Liberty    Oscar Araque, Lorenzo Gatti, Kyriaki Kalimeri arXiv_CL arXiv_CL  Bert  Pose  PDF
• 2022-09-14 Automated Fidelity Assessment for Strategy Training in Inpatient Rehabilitation using Natural Language Processing    Hunter Osterhoudt, Courtney E. Schneider, Haneef A Mohammad, Minmei Shih, Alexandra E. Harper, Leming Zhou, Elizabeth R Skidmore, Yanshan Wang arXiv_CL arXiv_CL  Transformer  Bert  RNN  PDF
• 2022-09-14 Toward Improving Health Literacy in Patient Education Materials with Neural Machine Translation Models    David Oniani, Sreekanth Sreekumar, Renuk DeAlmeida, Dinuk DeAlmeida, Vivian Hui, Young Ji Lee, Yiye Zhang, Leming Zhou, Yanshan Wang arXiv_CL arXiv_CL  Transformer  Bert  RNN  Pose  NMT  Medical  PDF
• 2022-09-14 Pre-training for Information Retrieval: Are Hyperlinks Fully Explored?    Jiawen Wu, Xinyu Zhang, Yutao Zhu, Zheng Liu, Zikai Guo, Zhaoye Fei, Ruofei Lai, Yongkang Wu, Zhao Cao, Zhicheng Dou arXiv_AI arXiv_AI  Transformer  Bert  Pose  Relation  Language_Model