Bert
Bert
2023-01-31
The Touch'e23-ValueEval Dataset for Identifying Human Values behind Arguments
Nailia Mirzakhmedova, Johannes Kiesel, Milad Alshomary, Maximilian Heinrich, Nicolas Handke, Xiaoni Cai, Barriere Valentin, Doratossadat Dastgheib, Omid Ghahroodi, Mohammad Ali Sadraei, Ehsaneddin Asgari, Lea Kawaletz, Henning Wachsmuth, Benno Stein
arXiv_CL
arXiv_CL
OCR
Bert
Classification
Detection
PDF
2023-01-31
TopoBERT: Plug and Play Toponym Recognition Module Harnessing Fine-tuned BERT
Bing Zhou, Lei Zou, Yingjie Hu, Yi Qiang
arXiv_AI
arXiv_AI
Transformer
Recognition
Bert
Pose
Action
Deep_Learning
CNN
Language_Model
PDF
2023-01-30
Representation biases in sentence transformers
Dmitry Nikolaev, Sebastian Padó
arXiv_CL
arXiv_CL
Transformer
Embedding
Bert
PDF
2023-01-30
Response-act Guided Reinforced Dialogue Generation for Mental Health Counseling
Aseem Srivastava, Ishan Pandey, Md. Shad Akhtar, Tanmoy Chakraborty
arXiv_CL
arXiv_CL
Transformer
Bert
Optimization
Pose
Quantitative
PDF
2023-01-30
KG-BERTScore: Incorporating Knowledge Graph into BERTScore for Reference-Free Machine Translation Evaluation
Zhanglin Wu, Min Zhang, Ming Zhu, Yinglu Li, Ting Zhu, Hao Yang, Song Peng, Ying Qin
arXiv_AI
arXiv_AI
Bert
Knowledge
Knowledge_Graph
Pose
Relation
Matching
PDF
2023-01-29
BERT-based Authorship Attribution on the Romanian Dataset called ROST
Sanda-Maria Avram
arXiv_AI
arXiv_AI
Bert
Sketch
Language_Model
PDF
2023-01-28
Semantic Tagging with LSTM-CRF
Farshad Noravesh
arXiv_CL
arXiv_CL
Embedding
Bert
RNN
PDF
2023-01-28
Multilingual Sentence Transformer as A Multilingual Word Aligner
Weikang Wang, Guanhua Chen, Hanqing Wang, Yue Han, Yun Chen
arXiv_CL
arXiv_CL
Transformer
Embedding
Bert
Zero-Shot
Pose
Action
Language_Model
PDF
2023-01-27
Context Matters: A Strategy to Pre-train Language Model for Science Education
Zhengliang Liu, Xinyu He, Lei Liu, Tianming Liu, Xiaoming Zhai
arXiv_AI
arXiv_AI
Transformer
Bert
Language_Model
PDF
2023-01-27
Understanding INT4 Quantization for Transformer Models: Latency Speedup, Composability, and Failure Cases
Xiaoxia Wu, Cheng Li, Reza Yazdani Aminabadi, Zhewei Yao, Yuxiong He
arXiv_CL
arXiv_CL
Transformer
Quantization
Bert
Inference
Language_Model
PDF
2023-01-27
Factual or Biased? Predicting Sentence-Level Factuality and Bias of News
Francielle Vargas, Fabiana Góes, Thiago A. S. Pardo, Fabrício Benevenuto
arXiv_CL
arXiv_CL
Bert
Pose
Face
Prediction
PDF
2023-01-27
A Comparative Study of Pretrained Language Models for Long Clinical Text
Yikuan Li, Ramsey M. Wehbe, Faraz S. Ahmad, Hanyin Wang, Yuan Luo
arXiv_AI
arXiv_AI
Transformer
Recognition
Bert
Knowledge
Pose
Classification
Attention
Inference
Language_Model
PDF
2023-01-27
Reading and Reasoning over Chart Images for Evidence-based Automated Fact-Checking
Mubashara Akhtar, Oana Cocarascu, Elena Simperl
arXiv_CV
arXiv_CV
Transformer
Bert
Pose
PDF
2023-01-27
Can We Use Probing to Better Understand Fine-tuning and Knowledge Distillation of the BERT NLU?
Jakub Hościłowicz, Marcin Sowański, Piotr Czubowski, Artur Janicki
arXiv_CL
arXiv_CL
Transformer
Bert
Knowledge
Pose
PDF
2023-01-27
A Multi-View Joint Learning Framework for Embedding Clinical Codes and Text Using Graph Neural Networks
Lecheng Kong, Christopher King, Bradley Fritz, Yixin Chen
arXiv_AI
arXiv_AI
Embedding
Bert
RNN
Pose
Action
Classification
Relation
Inference
Language_Model
PDF
2023-01-26
A benchmark for toxic comment classification on Civil Comments dataset
Corentin Duchene, Henri Jamet, Pierre Guillaume, Reda Dehak
arXiv_CL
arXiv_CL
Transformer
Bert
Optimization
RNN
Speech
Classification
Detection
CNN
Inference
PDF
2023-01-25
Qualitative Analysis of a Graph Transformer Approach to Addressing Hate Speech: Adapting to Dynamically Changing Content
Liam Hebert, Hong Yi Chen, Robin Cohen, Lukasz Golab
arXiv_CL
arXiv_CL
Transformer
Bert
Speech
Detection
Attention
PDF
2023-01-25
A Study on FGSM Adversarial Training for Neural Retrieval
Simon Lupart, Stéphane Clinchant
arXiv_CL
arXiv_CL
Bert
Sparse
Adversarial
Face
PDF
2023-01-25
ViDeBERTa: A powerful pre-trained language model for Vietnamese
Cong Dao Tran, Nhut Huy Pham, Anh Nguyen, Truong Son Hy, Tu Vu
arXiv_CL
arXiv_CL
Transformer
Recognition
Bert
Speech
Pose
Language_Model
PDF
2023-01-24
Semi-Automated Construction of Food Composition Knowledge Base
Jason Youn, Fangzhou Li, Ilias Tagkopoulos
arXiv_AI
arXiv_AI
Bert
Knowledge
Pose
Language_Model
PDF
2023-01-24
ViHOS: Hate Speech Spans Detection for Vietnamese
Phu Gia Hoang, Canh Duc Luu, Khanh Quoc Tran, Kiet Van Nguyen, Ngan Luu-Thuy Nguyen
arXiv_CL
arXiv_CL
Bert
Review
Speech
Classification
Detection
PDF
2023-01-24
Multitask Instruction-based Prompting for Fallacy Recognition
Tariq Alhindi, Tuhin Chakrabarty, Elena Musi, Smaranda Muresan
arXiv_CL
arXiv_CL
Recognition
Bert
Knowledge
PDF
2023-01-24
A Stability Analysis of Fine-Tuning a Pre-Trained Model
Zihao Fu, Anthony Man-Cho So, Nigel Collier
arXiv_AI
arXiv_AI
Unsupervised
Bert
Pose
Classification
PDF
2023-01-24
Truveta Mapper: A Zero-shot Ontology Alignment Framework
Mariyam Amir, Murchana Baruah, Mahsa Eslamialishah, Sina Ehsani, Alireza Bahramali, Sadra Naddaf-Sh, Saman Zarandioon
arXiv_AI
arXiv_AI
Transformer
Unsupervised
Bert
Zero-Shot
Pose
Ontology
Relation
Matching
PDF
2023-01-23
StockEmotions: Discover Investor Emotions for Financial Sentiment Analysis and Multivariate Time Series
Jean Lee, Hoyoul Luis Youn, Josiah Poon, Soyeon Caren Han
arXiv_AI
arXiv_AI
Bert
RNN
Pose
Emotion
Classification
Sentiment
Attention
PDF
2023-01-21
Nichtverbales Verhalten sozialer Roboter: Bewegungen, deren Bedeutung und die Technik dahinter
Kathrin Janowski, Elisabeth André
arXiv_RO
arXiv_RO
Bert
PDF
2023-01-20
Phoneme-Level BERT for Enhanced Prosody of Text-to-Speech with Grapheme Predictions
Yinghao Aaron Li, Cong Han, Xilin Jiang, Nima Mesgarani
arXiv_CL
arXiv_CL
Bert
Speech
Pose
Language_Model
Prediction
PDF
2023-01-20
Which Features are Learned by CodeBert: An Empirical Study of the BERT-based Source Code Representation Learning
Lan Zhang, Chen Cao, Zhilong Wang, Peng Liu
arXiv_CL
arXiv_CL
Transformer
Bert
Represenation_Learning
Pose
PDF
2023-01-19
Booster: a Benchmark for Depth from Images of Specular and Transparent Surfaces
Pierluigi Zama Ramirez, Alex Costanzino, Fabio Tosi, Matteo Poggi, Samuele Salti, Stefano Mattoccia, Luigi Di Stefano
arXiv_CV
arXiv_CV
Segmentation
Bert
Pose
Face
PDF
2023-01-19
From English to More Languages: Parameter-Efficient Model Reprogramming for Cross-Lingual Speech Recognition
Chao-Han Huck Yang, Bo Li, Yu Zhang, Nanxin Chen, Rohit Prabhavalkar, Tara N. Sainath, Trevor Strohman
arXiv_AI
arXiv_AI
Enhancement
Recognition
Bert
RNN
Speech
Self-Supervised
Pose
Speech_Recognition
PDF
2023-01-17
BERT-ERC: Fine-tuning BERT is Enough for Emotion Recognition in Conversation
Xiangyu Qin, Zhiyu Wu, Jinshi Cui, Tingting Zhang, Yanran Li, Jian Luan, Bin Wang, Li Wang
arXiv_AI
arXiv_AI
Recognition
Bert
Pose
Emotion
Classification
Language_Model
Prediction
PDF
2023-01-17
VaxxHesitancy: A Dataset for Studying Hesitancy Towards COVID-19 Vaccination on Twitter
Yida Mu, Mali Jin, Charlie Grimshaw, Carolina Scarton, Kalina Bontcheva, Xingyi Song
arXiv_CL
arXiv_CL
Bert
Knowledge
Action
Language_Model
PDF
2023-01-16
ClassBases at CASE-2022 Multilingual Protest Event Detection Tasks: Multilingual Protest News Detection and Automatically Replicating Manually Created Event Datasets
Peratham Wiriyathammabhum
arXiv_CL
arXiv_CL
Bert
Knowledge
Classification
Detection
PDF
2023-01-16
TEDB System Description to a Shared Task on Euphemism Detection 2022
Peratham Wiriyathammabhum
arXiv_CL
arXiv_CL
Transformer
Bert
Text_Classification
Classification
Detection
Sentiment
PDF
2023-01-16
Wobble control of a pendulum actuated spherical robot
Animesh Singhal, Sahil Modi, Abhishek Gupta, Leena Vachhani
arXiv_RO
arXiv_RO
Surveillance
Bert
Pose
PDF
2023-01-16
An Error-Guided Correction Model for Chinese Spelling Error Correction
Rui Sun, Xiuyu Wu, Yunfang Wu
arXiv_AI
arXiv_AI
Bert
Zero-Shot
Pose
Detection
PDF
2023-01-13
It's Just a Matter of Time: Detecting Depression with Time-Enriched Multimodal Transformers
Ana-Maria Bucur, Adrian Cosma, Paolo Rosso, Liviu P. Dinu
arXiv_CL
arXiv_CL
Transformer
Embedding
Bert
Pose
Action
Detection
PDF
2023-01-12
Improving Inference Performance of Machine Learning with the Divide-and-Conquer Principle
Alex Kogan
arXiv_AI
arXiv_AI
Recognition
OCR
Bert
Optical_Character
Pose
Inference
PDF
2023-01-11
NarrowBERT: Accelerating Masked Language Model Pretraining and Inference
Haoxin Li, Phillip Keung, Daniel Cheng, Jungo Kasai, Noah A. Smith
arXiv_CL
arXiv_CL
Transformer
Bert
Review
Self-Supervised
Pose
Classification
Attention
Inference
Language_Model
PDF
2023-01-11
Topics in Contextualised Attention Embeddings
Mozhgan Talebpour, Alba Garcia Seco de Herrera, Shoaib Jameel
arXiv_CL
arXiv_CL
Embedding
Bert
Knowledge
Relation
Attention
Language_Model
PDF
2023-01-10
Language Models sounds the Death Knell of Knowledge Graphs
Kunal Suri, Atul Singh, Prakhar Mishra, Swapna Sourav Rout, Rajesh Sabapathy
arXiv_AI
arXiv_AI
Recognition
Bert
Knowledge
Knowledge_Graph
Self-Supervised
Ontology
Action
Deep_Learning
Relation
Medical
Language_Model
PDF
2023-01-10
Scaling Laws for Generative Mixed-Modal Language Models
Armen Aghajanyan, Lili Yu, Alexis Conneau, Wei-Ning Hsu, Karen Hambardzumyan, Susan Zhang, Stephen Roller, Naman Goyal, Omer Levy, Luke Zettlemoyer
arXiv_AI
arXiv_AI
Bert
Speech
Action
Language_Model
PDF
2023-01-09
Designing BERT for Convolutional Networks: Sparse and Hierarchical Masked Modeling
Keyu Tian, Yi Jiang, Qishuai Diao, Chen Lin, Liwei Wang, Zehuan Yuan
arXiv_AI
arXiv_AI
Transformer
Segmentation
Point_Cloud
3D
Bert
Sparse
Contrastive_Learning
Detection
Object_Detection
CNN
PDF
2023-01-09
ERNIE 3.0 Tiny: Frustratingly Simple Method to Improve Task-Agnostic Distillation Generalization
Weixin Liu, Xuyi Chen, Jiaxiang Liu, Shikun Feng, Yu Sun, Hao Tian, Hua Wu
arXiv_CL
arXiv_CL
Bert
Knowledge
Pose
Language_Model
PDF
2023-01-09
FullStop:Punctuation and Segmentation Prediction for Dutch with Transformers
Vincent Vandeghinste, Oliver Guhr
arXiv_AI
arXiv_AI
Transformer
Segmentation
Recognition
Bert
Speech
Classification
Speech_Recognition
Language_Model
Prediction
PDF
2023-01-09
Online Fake Review Detection Using Supervised Machine Learning And BERT Model
Abrar Qadir Mir, Furqan Yaqub Khan, Mohammad Ahsan Chishti
arXiv_AI
arXiv_AI
Transformer
Embedding
Bert
Review
Pose
Classification
Detection
Attention
PDF
2023-01-08
InPars-Light: Cost-Effective Unsupervised Training of Efficient Rankers
Leonid Boytsov, Preksha Patel, Vivek Sourabh, Riddhi Nisar, Sayani Kundu, Ramya Ramanathan, Eric Nyberg
arXiv_AI
arXiv_AI
Unsupervised
Bert
Language_Model
PDF
2023-01-07
App Review Driven Collaborative Bug Finding
Xunzhu Tang, Haoye Tian, Pingfan Kong, Kui Liu, Jacques Klein, Tegawendé F. Bissyande
arXiv_AI
arXiv_AI
Embedding
Bert
Review
Pose
Matching
PDF
2023-01-07
RLAS-BIABC: A Reinforcement Learning-Based Answer Selection Using the BERT Model Boosted by an Improved ABC Algorithm
Hamid Gharagozlou, Javad Mohammadzadeh, Azam Bastanfard, Saeed Shiry Ghidary
arXiv_AI
arXiv_AI
Transformer
Embedding
Reinforcement_Learning
Bert
RNN
Pose
Classification
Attention
QA
PDF
2023-01-06
SAIDS: A Novel Approach for Sentiment Analysis Informed of Dialect and Sarcasm
Abdelrahman Kaseb, Mona Farouk
arXiv_AI
arXiv_AI
Embedding
Bert
Detection
Sentiment
Language_Model
Prediction
PDF
2023-01-05
Emotion-Cause Pair Extraction as Question Answering
Huu-Hiep Nguyen, Minh-Tien Nguyen
arXiv_CL
arXiv_CL
Bert
Pose
Emotion
Action
QA
PDF
2023-01-05
Adaptively Clustering Neighbor Elements for Image Captioning
Zihua Wang, Xu Yang, Haiyang Xu, Hanwang Zhang, Chenliang Li, Songfang Huang, Fei Huang, Yu Zhang
arXiv_CV
arXiv_CV
Image_Caption
Transformer
Bert
Attention
Caption
PDF
2023-01-05
Learning Trajectory-Word Alignments for Video-Language Tasks
Xu Yang, Zhangzikang Li, Haiyang Xu, Hanwang Zhang, Qinghao Ye, Chenliang Li, Ming Yan, Yu Zhang, Fei Huang, Songfang Huang
arXiv_CV
arXiv_CV
Transformer
Embedding
Bert
Pose
Attention
Video_Retrieval
PDF
2023-01-05
EPR-Net: Constructing non-equilibrium potential landscape via a variational force projection formulation
Yue Zhao, Wei Zhang, Tiejun Li
arXiv_AI
arXiv_AI
Bert
Pose
Deep_Learning
PDF
2023-01-05
The political ideology of conversational AI: Converging evidence on ChatGPT's pro-environmental, left-libertarian orientation
Jochen Hartmann, Jasper Schwenzow, Maximilian Witte
arXiv_CL
arXiv_CL
OCR
Bert
Pose
Attention
PDF
2023-01-03
PIE-QG: Paraphrased Information Extraction for Unsupervised Question Generation from Small Corpora
Dinesh Nagumothu, Bahadorreza Ofoghi, Guangyan Huang, Peter W. Eklund
arXiv_AI
arXiv_AI
Unsupervised
Bert
Knowledge
Action
Language_Model
QA
PDF
2023-01-02
What is Cognitive Computing? An Architecture and State of The Art
Samaa Elnagar, Manoj A. Thomas, Kweku-Muata Osei-Bryson
arXiv_AI
arXiv_AI
Bert
Pose
Survey
PDF
2023-01-02
Russia-Ukraine war: Modeling and Clustering the Sentiments Trends of Various Countries
Hamed Vahdat-Nejad, Mohammad Ghasem Akbari, Fatemeh Salmani, Faezeh Azizi, Hamid-Reza Nili-Sani
arXiv_CL
arXiv_CL
Bert
Pose
Sentiment
PDF
2023-01-01
Integrating Semantic Information into Sketchy Reading Module of Retro-Reader for Vietnamese Machine Reading Comprehension
Hang Thi-Thu Le, Viet-Duc Ho, Duc-Vu Nguyen, Ngan Luu-Thuy Nguyen
arXiv_CL
arXiv_CL
Bert
Sketch
Classification
Language_Model
PDF
2023-01-01
Leveraging Semantic Representations Combined with Contextual Word Representations for Recognizing Textual Entailment in Vietnamese
Quoc-Loc Duong, Duc-Vu Nguyen, Ngan Luu-Thuy Nguyen
arXiv_CL
arXiv_CL
Bert
Represenation_Learning
Pose
PDF
2023-01-01
Floods Relevancy and Identification of Location from Twitter Posts using NLP Techniques
Muhammad Suleman, Muhammad Asif, Tayyab Zamir, Ayaz Mehmood, Jebran Khan, Nasir Ahmad, Kashif Ahmad
arXiv_CL
arXiv_CL
Recognition
Bert
Pose
Action
Classification
PDF
2022-12-31
Towards Proactively Forecasting Sentence-Specific Information Popularity within Online News Documents
Sayar Ghosh Roy, Anshul Padhi, Risubh Jain, Manish Gupta, Vasudeva Varma
arXiv_AI
arXiv_AI
Transfer_Learning
Bert
Knowledge
Pose
Attention
Prediction
PDF
2022-12-30
On the Inconsistencies of Conditionals Learned by Masked Language Models
Tom Young, Yang You
arXiv_AI
arXiv_AI
Bert
Language_Model
PDF
2022-12-30
Distant Reading of the German Coalition Deal: Recognizing Policy Positions with BERT-based Text Classification
Michael Zylla, Thomas Haider
arXiv_CL
arXiv_CL
Bert
Text_Classification
Classification
PDF
2022-12-29
Examining Political Rhetoric with Epistemic Stance Detection
Ankita Gupta, Su Lin Blodgett, Justin H Gross, Brendan O'Connor
arXiv_CL
arXiv_CL
Bert
Pose
Detection
Prediction
PDF
2022-12-28
Cramming: Training a Language Model on a Single GPU in One Day
Jonas Geiping, Tom Goldstein
arXiv_CL
arXiv_CL
Transformer
Bert
Language_Model
PDF
2022-12-28
Data Augmentation using Transformers and Similarity Measures for Improving Arabic Text Classification
Dania Refai, Saleh Abo-Soud, Mohammad Abdel-Rahman
arXiv_CL
arXiv_CL
Transformer
Bert
Sentiment_Classification
Text_Classification
Pose
Classification
Sentiment
Prediction
PDF
2022-12-28
Automatic Recognition and Classification of Future Work Sentences from Academic Articles in a Specific Domain
Chengzhi Zhang, Yi Xiang, Wenke Hao, Zhicheng Li, Yuchen Qian, Yuzhuo Wang
arXiv_CL
arXiv_CL
Recognition
Bert
Pose
Classification
PDF
2022-12-27
A Survey on Knowledge-Enhanced Pre-trained Language Models
Chaoqi Zhen, Yanlei Shang, Xiangyu Liu, Yifei Li, Yong Chen, Dell Zhang
arXiv_CL
arXiv_CL
Bert
Knowledge
Face
Survey
Language_Model
PDF
2022-12-27
DeepCuts: Single-Shot Interpretability based Pruning for BERT
Jasdeep Singh Grover, Bhavesh Gawri, Ruskin Raj Manku
arXiv_CL
arXiv_CL
Transformer
Bert
Pose
Language_Model
PDF
2022-12-23
MicroBERT: Effective Training of Low-resource Monolingual BERTs through Parameter Reduction and Multitask Learning
Luke Gessler, Amir Zeldes
arXiv_CL
arXiv_CL
Transformer
Bert
Speech
Language_Model
PDF
2022-12-23
Benchmark for Uncertainty & Robustness in Self-Supervised Learning
Ha Manh Bui, Iliana Maifeld-Carucci
arXiv_CV
arXiv_CV
Transformer
Bert
Self-Supervised
Classification
Language_Model
Prediction
PDF
2022-12-23
Finetuning for Sarcasm Detection with a Pruned Dataset
Ishita Goyal, Priyank Bhandia, Sanjana Dulam
arXiv_AI
arXiv_AI
Bert
Detection
PDF
2022-12-22
Enhancing the prediction of disease outcomes using electronic health records and pretrained deep learning models
Zhichao Yang, Weisong Liu, Dan Berlowitz, Hong Yu
arXiv_AI
arXiv_AI
Bert
Deep_Learning
Denoising
Prediction
PDF
2022-12-22
CAMeMBERT: Cascading Assistant-Mediated Multilingual BERT
Dan DeGenaro, Jugal Kalita
arXiv_CL
arXiv_CL
Bert
Knowledge
Pose
Language_Model
PDF
2022-12-21
Cross-Linguistic Syntactic Difference in Multilingual BERT: How Good is It and How Does It Affect Transfer?
Ningyu Xu, Tao Gui, Ruotian Ma, Qi Zhang, Jingting Ye, Menghan Zhang, Xuanjing Huang
arXiv_CL
arXiv_CL
Bert
Zero-Shot
Knowledge
Relation
PDF
2022-12-21
KL Regularized Normalization Framework for Low Resource Tasks
Neeraj Kumar, Ankur Narang, Brejesh Lall
arXiv_AI
arXiv_AI
Bert
Regularization
Speech
Pose
PDF
2022-12-21
Towards Efficient Visual Simplification of Computational Graphs in Deep Neural Networks
Rusheng Pan, Zhiyong Wang, Yating Wei, Han Gao, Gongchang Ou, Caleb Chen Cao, Jingli Xu, Tong Xu, Wei Chen
arXiv_AI
arXiv_AI
Bert
Pose
PDF
2022-12-21
Spoken Language Understanding for Conversational AI: Recent Advances and Future Direction
Soyeon Caren Han, Siqu Long, Henry Weld, Josiah Poon
arXiv_AI
arXiv_AI
Transformer
Bert
Pose
Action
Classification
Deep_Learning
Detection
Attention
PDF
2022-12-21
Analyzing Semantic Faithfulness of Language Models via Input Intervention on Conversational Question Answering
Akshay Chaturvedi, Swarnadeep Bhar, Soumadeep Saha, Utpal Garain, Nicholas Asher
arXiv_CL
arXiv_CL
Transformer
Bert
Pose
Inference
Language_Model
PDF
2022-12-20
Pretraining Without Attention
Junxiong Wang, Jing Nathan Yan, Albert Gu, Alexander M. Rush
arXiv_CL
arXiv_CL
Transformer
Bert
Pose
Attention
PDF
2022-12-20
Parameter-efficient Zero-shot Transfer for Cross-Language Dense Retrieval with Adapters
Eugene Yang, Suraj Nair, Dawn Lawrie, James Mayfield, Douglas W. Oard
arXiv_CL
arXiv_CL
Transformer
Bert
Zero-Shot
Pose
Inference
Language_Model
PDF
2022-12-20
AnnoBERT: Effectively Representing Multiple Annotators' Label Choices to Improve Hate Speech Detection
Wenjie Yin, Vibhor Agarwal, Aiqi Jiang, Arkaitz Zubiaga, Nishanth Sastry
arXiv_CL
arXiv_CL
Transformer
Embedding
Bert
Speech
Pose
Detection
PDF
2022-12-20
Extrinsic Evaluation of Machine Translation Metrics
Nikita Moghe, Tom Sherborne, Mark Steedman, Alexandra Birch
arXiv_AI
arXiv_AI
Tracking
Bert
Relation
PDF
2022-12-20
Identifying and Manipulating the Personality Traits of Language Models
Graham Caron, Shashank Srivastava
arXiv_AI
arXiv_AI
Bert
Emotion
Language_Model
PDF
2022-12-20
In and Out-of-Domain Text Adversarial Robustness via Label Smoothing
Yahan Yang, Soham Dan, Dan Roth, Insup Lee
arXiv_CL
arXiv_CL
Bert
Regularization
Adversarial
Pose
Relation
Language_Model
Prediction
PDF
2022-12-20
Pre-trained Language Models for Keyphrase Generation: A Thorough Empirical Study
Di Wu, Wasi Uddin Ahmad, Kai-Wei Chang
arXiv_CL
arXiv_CL
Transformer
Bert
Knowledge
Action
Language_Model
PDF
2022-12-20
Naamapadam: A Large-Scale Named Entity Annotated Data for Indic Languages
Arnav Mhaske, Harshit Kedia, Sumanth Doddapaneni, Mitesh M. Khapra, Pratyush Kumar, Rudra Murthy V, Anoop Kunchukuttan
arXiv_CL
arXiv_CL
Recognition
Bert
GAN
PDF
2022-12-20
Quirk or Palmer: A Comparative Study of Modal Verb Frameworks with Annotated Datasets
Risako Owan, Maria Gini, Dongyeop Kang
arXiv_CL
arXiv_CL
Bert
PDF
2022-12-20
Exploring Effective Fusion Algorithms for Speech Based Self-Supervised Learning Models
Changli Tang, Yujin Wang, Xie Chen, Wei-Qiang Zhang
arXiv_SD
arXiv_SD
Recognition
Bert
Speech
Self-Supervised
Pose
Speech_Recognition
PDF
2022-12-20
Hybrid Rule-Neural Coreference Resolution System based on Actor-Critic Learning
Yu Wang, Hongxia Jin
arXiv_CL
arXiv_CL
Bert
Pose
Detection
PDF
2022-12-20
Rumour detection using graph neural network and oversampling in benchmark Twitter dataset
Shaswat Patel, Prince Bansal, Preeti Kaur
arXiv_CL
arXiv_CL
Bert
Pose
Detection
PDF
2022-12-20
A Twitter BERT Approach for Offensive Language Detection in Marathi
Tanmay Chavan, Shantanu Patankar, Aditya Kane, Omkar Gokhale, Raviraj Joshi
arXiv_CL
arXiv_CL
Bert
Text_Classification
Speech
Classification
Detection
PDF
2022-12-20
On the Blind Spots of Model-Based Evaluation Metrics for Text Generation
Tianxing He, Jingyu Zhang, Tianle Wang, Sachin Kumar, Kyunghyun Cho, James Glass, Yulia Tsvetkov
arXiv_CL
arXiv_CL
Bert
Pose
Summarization
Text_Generation
Language_Model
PDF
2022-12-20
Is Self-Attention Powerful to Learn Code Syntax and Semantics?
Wei Ma, Mengjie Zhao, Xiaofei Xie, Qiang Hu, Shangqing Liu, Jie Zhang, Wenhan Wang, Yang Liu,
arXiv_AI
arXiv_AI
Transformer
Bert
Knowledge
Pose
Relation
Attention
Inference
Language_Model
PDF
2022-12-19
MANTIS at TSAR-2022 Shared Task: Improved Unsupervised Lexical Simplification with Pretrained Encoders
Xiaofei Li, Daniel Wiechmann, Yu Qiao, Elma Kerz
arXiv_CL
arXiv_CL
Transformer
Unsupervised
Bert
Language_Model
PDF
2022-12-19
Exploring Hybrid and Ensemble Models for Multiclass Prediction of Mental Health Status on Social Media
Sourabh Zanwar, Daniel Wiechmann, Yu Qiao, Elma Kerz
arXiv_CL
arXiv_CL
Transformer
Bert
RNN
Emotion
Classification
Detection
Sentiment
Attention
Activity
Prediction
PDF
2022-12-19
Do CoNLL-2003 Named Entity Taggers Still Work Well in 2023?
Shuheng Liu, Alan Ritter
arXiv_CL
arXiv_CL
Transformer
Embedding
Recognition
Bert
PDF
2022-12-19
Don't Generate, Discriminate: A Proposal for Grounding Language Models to Real-World Environments
Yu Gu, Xiang Deng, Yu Su
arXiv_AI
arXiv_AI
Bert
Knowledge
Pose
Few-Shot
Language_Model
QA
PDF
2022-12-19
Words as Gatekeepers: Measuring Discipline-specific Terms and Meanings in Scholarly Publications
Li Lucy, Jesse Dodge, David Bamman, Katherine A. Keith
arXiv_CL
arXiv_CL
Bert
Pose
Relation
PDF
2022-12-19
Improving the Generalizability of Text-Based Emotion Detection by Leveraging Transformers with Psycholinguistic Features
Sourabh Zanwar, Daniel Wiechmann, Yu Qiao, Elma Kerz
arXiv_CL
arXiv_CL
Transformer
Transfer_Learning
Recognition
Bert
RNN
Pose
Emotion
Face
Detection
Sentiment
PDF
2022-12-19
Less is More: Parameter-Free Text Classification with Gzip
Zhiying Jiang, Matthew Y.R. Yang, Mikhail Tsirlin, Raphael Tang, Jimmy Lin
arXiv_CL
arXiv_CL
Transformer
Bert
Text_Classification
Pose
Classification
Deep_Learning
Few-Shot
PDF
2022-12-19
Enriching Relation Extraction with OpenIE
Alessandro Temperoni, Maria Biryukov, Martin Theobald
arXiv_CL
arXiv_CL
Recognition
Bert
Knowledge
Action
Relation
Relation_Extraction
Language_Model
Prediction
PDF
2022-12-18
Neural Coreference Resolution based on Reinforcement Learning
Yu Wang, Hongxia Jin
arXiv_CL
arXiv_CL
Reinforcement_Learning
Bert
Pose
Detection
PDF
2022-12-18
Neural Rankers for Effective Screening Prioritisation in Medical Systematic Review Literature Search
Shuai Wang, Harrisen Scells, Bevan Koopman, Guido Zuccon
arXiv_AI
arXiv_AI
Bert
Review
Medical
Language_Model
PDF
2022-12-17
Exploiting Rich Textual User-Product Context for Improving Sentiment Analysis
Chenyang Lyu, Linyi Yang, Yue Zhang, Yvette Graham, Jennifer Foster
arXiv_CL
arXiv_CL
Bert
Review
Sentiment
Prediction
PDF
2022-12-16
Plansformer: Generating Symbolic Plans using Transformers
Vishal Pallagani, Bharath Muppasani, Keerthiram Murugesan, Francesca Rossi, Lior Horesh, Biplav Srivastava, Francesco Fabiano, Andrea Loreggia
arXiv_AI
arXiv_AI
Transformer
Transfer_Learning
Bert
Knowledge
Action
Summarization
Text_Generation
Autonomous
Language_Model
PDF
2022-12-16
Estimating truncation effects of quantum bosonic systems using sampling algorithms
Masanori Hanada, Junyu Liu, Enrico Rinaldi, Masaki Tezuka
arXiv_AI
arXiv_AI
Bert
PDF
2022-12-16
Experiments on Generalizability of BERTopic on Multi-Domain Short Text
Muriël de Groot, Mohammad Aliannejadi, Marcel R. Haas
arXiv_CL
arXiv_CL
Bert
PDF
2022-12-16
POIBERT: A Transformer-based Model for the Tour Recommendation Problem
Ngai Lam Ho, Kwan Hui Lim
arXiv_AI
arXiv_AI
Transformer
Bert
Pose
Language_Model
Prediction
Recommendation
PDF
2022-12-16
Deep Learning Methods for Calibrated Photometric Stereo and Beyond: A Survey
Yakun Ju, Kin-Man Lam, Wuyuan Xie, Huiyu Zhou, Junyu Dong, Boxin Shi
arXiv_AI
arXiv_AI
Reconstruction
Bert
Review
Pose
Face
Survey
Deep_Learning
Relation
PDF
2022-12-16
Utilizing distilBert transformer model for sentiment classification of COVID-19's Persian open-text responses
Fatemeh Sadat Masoumi, Mohammad Bahrani
arXiv_CL
arXiv_CL
Transformer
Bert
Sentiment_Classification
Pose
Survey
Classification
Sentiment
PDF
2022-12-16
Lessons learned from the evaluation of Spanish Language Models
Rodrigo Agerri, Eneko Agirre
arXiv_AI
arXiv_AI
Transformer
Bert
Pose
Face
Activity
Language_Model
PDF
2022-12-16
ReCo: Reliable Causal Chain Reasoning via Structural Causal Recurrent Neural Networks
Kai Xiong, Xiao Ding, Zhongyang Li, Li Du, Bing Qin, Yi Zheng, Baoxing Huai
arXiv_AI
arXiv_AI
Bert
RNN
Knowledge
Pose
PDF
2022-12-16
Investigation of Japanese PnG BERT language model in text-to-speech synthesis for pitch accent language
Yusuke Yasuda, Tomoki Toda
arXiv_CL
arXiv_CL
Bert
Speech
Self-Supervised
Language_Model
Prediction
PDF
2022-12-16
LegalRelectra: Mixed-domain Language Modeling for Long-range Legal Text Comprehension
Wenyue Hua, Yuchen Zhang, Zhe Chen, Josie Li, Melanie Weber
arXiv_CL
arXiv_CL
Bert
Pose
Medical
Language_Model
PDF
2022-12-15
Saved You A Click: Automatically Answering Clickbait Titles
Oliver Johnson, Beicheng Lou, Janet Zhong, Andrey Kurenkov
arXiv_CL
arXiv_CL
Bert
Face
PDF
2022-12-15
DAMP: Doubly Aligned Multilingual Parser for Task-Oriented Dialogue
William Held, Christopher Hidey, Fei Liu, Eric Zhu, Rahul Goel, Diyi Yang, Rushin Shah
arXiv_CL
arXiv_CL
Bert
Zero-Shot
Optimization
Adversarial
Action
PDF
2022-12-15
Visually-augmented pretrained language models for NLP tasks without images
Hangyu Guo, Kun Zhou, Wayne Xin Zhao, Qinyu Zhang, Ji-Rong Wen
arXiv_CL
arXiv_CL
Transformer
Bert
Knowledge
Self-Supervised
Pose
Attention
Language_Model
QA
PDF
2022-12-15
The Effects of In-domain Corpus Size on pre-training BERT
Chris Sanchez, Zheyuan Zhang
arXiv_CL
arXiv_CL
Transformer
Bert
Medical
Language_Model
PDF
2022-12-15
MASTER: Multi-task Pre-trained Bottlenecked Masked Autoencoders are Better Dense Retrievers
Kun Zhou, Xiao Liu, Yeyun Gong, Wayne Xin Zhao, Daxin Jiang, Nan Duan, Ji-Rong Wen
arXiv_CL
arXiv_CL
Transformer
Bert
Knowledge
Pose
Relation
PDF
2022-12-15
FreCDo: A Large Corpus for French Cross-Domain Dialect Identification
Mihaela Gaman, Adrian-Gabriel Chifu, William Domingues, Radu Tudor Ionescu
arXiv_CL
arXiv_CL
Bert
Quantitative
PDF
2022-12-15
Using Two Losses and Two Datasets Simultaneously to Improve TempoWiC Accuracy
Mohammad Javad Pirhadi, Motahhare Mirzaei, Sauleh Eetemadi
arXiv_AI
arXiv_AI
Bert
Classification
Language_Model
PDF
2022-12-15
Efficient Pre-training of Masked Language Model via Concept-based Curriculum Masking
Mingyu Lee, Jun-Hyung Park, Junho Kim, Kang-Min Kim, SangKeun Lee
arXiv_CL
arXiv_CL
Transformer
Bert
Knowledge
Knowledge_Graph
Pose
Language_Model
PDF
2022-12-14
Efficient Self-supervised Learning with Contextualized Target Representations for Vision, Speech and Language
Alexei Baevski, Arun Babu, Wei-Ning Hsu, Michael Auli
arXiv_CL
arXiv_CL
Transformer
Recognition
Bert
Speech
Self-Supervised
Classification
Speech_Recognition
CNN
Image_Classification
PDF
2022-12-14
VTCC-NLP at NL4Opt competition subtask 1: An Ensemble Pre-trained language models for Named Entity Recognition
Xuan-Dung Doan
arXiv_CL
arXiv_CL
Embedding
Recognition
Bert
Pose
Language_Model
PDF
2022-12-14
Multi-task Learning for Cross-Lingual Sentiment Analysis
Gaurish Thakkar, Nives Mikelic Preradovic, Marko Tadic
arXiv_CL
arXiv_CL
Bert
Sentiment_Classification
Zero-Shot
Pose
Classification
Sentiment
Few-Shot
PDF
2022-12-14
Explainability of Text Processing and Retrieval Methods: A Critical Survey
Sourav Saha, Debapriyo Majumdar, Mandar Mitra
arXiv_AI
arXiv_AI
Transformer
Embedding
Bert
Survey
Deep_Learning
Attention
PDF
2022-12-14
Efficient Speech Representation Learning with Low-Bit Quantization
Ching-Feng Yeh, Wei-Ning Hsu, Paden Tomasello, Abdelrahman Mohamed
arXiv_CL
arXiv_CL
Quantization
Bert
Represenation_Learning
Speech
PDF
2022-12-14
Disentangling Prosody Representations with Unsupervised Speech Reconstruction
Leyuan Qu, Taihao Li, Cornelius Weber, Theresa Pekarek-Rosin, Fuji Ren, Stefan Wermter
arXiv_SD
arXiv_SD
Reconstruction
Embedding
Unsupervised
Recognition
Bert
Speech
Pose
Emotion
Speech_Recognition
PDF
2022-12-13
Collision probability reduction method for tracking control in automatic docking / berthing using reinforcement learning
Kouki Wakita, Youhei Akimoto, Dimas M. Rachman, Yoshiki Miyauchi, Umeda Naoya, Atsuo Maki
arXiv_RO
arXiv_RO
Tracking
Reinforcement_Learning
Bert
Pose
PDF
2022-12-12
A Pre-Trained BERT Model for Android Applications
Tiezhu Sun (1), Kevin Allix (1), Kisub Kim (2), Xin Zhou (2), Dongsun Kim (3), David Lo (2), Tegawendé F. Bissyandé (1), Jacques Klein (1) ((1) University of Luxembourg, (2) Singapore Management University, (3) Kyungpook National University)
arXiv_AI
arXiv_AI
Bert
Represenation_Learning
Pose
Language_Model
Prediction
PDF
2022-12-12
MaNLP@SMM4H22: BERT for Classification of Twitter Posts
Keshav Kapur, Rajitha Harikrishnan
arXiv_CL
arXiv_CL
Bert
Classification
GAN
PDF
2022-12-12
Page Layout Analysis of Text-heavy Historical Documents: a Comparison of Textual and Visual Approaches
Najem-Meyer Sven, Romanello Matteo
arXiv_CL
arXiv_CL
Transformer
Bert
Detection
PDF
2022-12-11
IndicXTREME: A Multi-Task Benchmark For Evaluating Indic Languages
Sumanth Doddapaneni, Rahul Aralikatte, Gowtham Ramesh, Shreya Goyal, Mitesh M. Khapra, Anoop Kunchukuttan, Pratyush Kumar
arXiv_CL
arXiv_CL
Bert
Zero-Shot
Knowledge
Language_Model
PDF
2022-12-10
Punctuation Restoration for Singaporean Spoken Languages: English, Malay, and Mandarin
Abhinav Rao, Ho Thi-Nga, Chng Eng-Siong
arXiv_CL
arXiv_CL
Transformer
Bert
Restoration
Knowledge
Pose
Language_Model
PDF
2022-12-10
Artificial Text Detection with Multiple Training Strategies
Bin Li, Yixuan Weng, Qiya Song, Hanjun Deng
arXiv_AI
arXiv_AI
Bert
Review
Pose
Deep_Learning
Detection
Language_Model
PDF
2022-12-09
Incorporating Emotions into Health Mention Classification Task on Social Media
Olanrewaju Tahir Aduragba, Jialin Yu, Alexandra I. Cristea
arXiv_CL
arXiv_CL
Tracking
Bert
Knowledge
Emotion
Classification
PDF
2022-12-09
CKG: Dynamic Representation Based on Context and Knowledge Graph
Xunzhu Tang, Tiezhu Sun, Rujie Zhu, Shi Wang
arXiv_CL
arXiv_CL
Bert
Knowledge
Knowledge_Graph
Pose
PDF
2022-12-08
Explain to me like I am five -- Sentence Simplification Using Transformers
Aman Agarwal
arXiv_CL
arXiv_CL
Transformer
Bert
PDF
2022-12-08
Fresnel Microfacet BRDF: Unification of Polari-Radiometric Surface-Body Reflection
Tomoki Ichikawa, Yoshiki Fukao, Shohei Nobuhara, Ko Nishino
arXiv_CV
arXiv_CV
Bert
Face
PDF
2022-12-08
BEVBert: Topo-Metric Map Pre-training for Language-guided Navigation
Dong An, Yuankai Qi, Yangguang Li, Yan Huang, Liang Wang, Tieniu Tan, Jing Shao
arXiv_AI
arXiv_AI
Transformer
Bert
Pose
PDF
2022-12-07
TweetDrought: A Deep-Learning Drought Impacts Recognizer based on Twitter Data
Beichen Zhang, Frank Schilder, Kelly Helm Smith, Michael J. Hayes, Sherri Harms, Tsegaye Tadesse
arXiv_CL
arXiv_CL
Transformer
Transfer_Learning
Bert
Prediction
PDF
2022-12-07
A Study on Extracting Named Entities from Fine-tuned vs. Differentially Private Fine-tuned BERT Models
Andor Diera, Nicolas Lell, Aygul Garifullina, Ansgar Scherp
arXiv_CL
arXiv_CL
Bert
Text_Classification
Action
Classification
Deep_Learning
Text_Generation
Language_Model
PDF
2022-12-07
DeepSpeed Data Efficiency: Improving Deep Learning Model Quality and Training Efficiency via Efficient Data Sampling and Routing
Conglong Li, Zhewei Yao, Xiaoxia Wu, Minjia Zhang, Yuxiong He
arXiv_AI
arXiv_AI
Bert
Pose
Deep_Learning
Language_Model
PDF
2022-12-07
SimVTP: Simple Video Text Pre-training with Masked Autoencoders
Yue Ma, Tianyu Yang, Yin Shan, Xiu Li
arXiv_CV
arXiv_CV
Transformer
Reconstruction
Bert
Contrastive_Learning
Matching
PDF
2022-12-07
Improved Speech Pre-Training with Supervision-Enhanced Acoustic Unit
Pengcheng Li, Genshun Wan, Fenglin Ding, Hang Chen, Jianqing Gao, Jia Pan, Cong Liu
arXiv_SD
arXiv_SD
Transformer
Recognition
Bert
Speech
Self-Supervised
Pose
Speech_Recognition
PDF
2022-12-07
Progressive Multi-Scale Self-Supervised Learning for Speech Recognition
Genshun Wan, Tan Liu, Hang Chen, Jia Pan, Cong Liu, Zhongfu Ye
arXiv_SD
arXiv_SD
Recognition
Bert
Speech
Self-Supervised
Pose
Attention
Speech_Recognition
PDF
2022-12-06
Style transfer and classification in hebrew news items
Nir Weingarten
arXiv_CL
arXiv_CL
Transformer
Style_Transfer
Bert
Classification
Text_Generation
PDF
2022-12-06
SODA: A Natural Language Processing Package to Extract Social Determinants of Health for Cancer Studies
Zehao Yu, Xi Yang, Chong Dang, Prakash Adekkanattu, Braja Gopal Patra, Yifan Peng, Jyotishman Pathak, Debbie L. Wilson, Ching-Yuan Chang, Wei-Hsuan Lo-Ciganic, Thomas J. George, William R. Hogan, Yi Guo, Jiang Bian, Yonghui Wu
arXiv_AI
arXiv_AI
Transformer
Bert
Action
PDF
2022-12-06
Proximal methods for point source localisation
Tuomo Valkonen
arXiv_CV
arXiv_CV
Bert
PDF
2022-12-06
CySecBERT: A Domain-Adapted Language Model for the Cybersecurity Domain
Markus Bayer, Philipp Kuehn, Ramin Shanehsaz, Christian Reuter
arXiv_CL
arXiv_CL
Bert
Knowledge
Classification
Language_Model
PDF
2022-12-06
Modern French Poetry Generation with RoBERTa and GPT-2
Mika Hämäläinen, Khalid Alnajjar, Thierry Poibeau
arXiv_CL
arXiv_CL
Bert
Emotion
PDF
2022-12-06
Self-Supervised Audio-Visual Speech Representations Learning By Multimodal Self-Distillation
Jing-Xuan Zhang, Genshun Wan, Zhen-Hua Ling, Jia Pan, Jianqing Gao, Cong Liu
arXiv_SD
arXiv_SD
Bert
Speech
Self-Supervised
Pose
Language_Model
PDF
2022-12-06
Automated Identification of Eviction Status from Electronic Health Record Notes
Zonghai Yao, Jack Tsai, Weisong Liu, David A. Levy, Emily Druhl, Joel I Reisman, Hong Yu
arXiv_CL
arXiv_CL
Bert
Knowledge
Classification
Language_Model
Prediction
PDF
2022-12-06
LUNA: Language Understanding with Number Augmentations on Transformers via Number Plugins and Pre-training
Hongwei Han, Jialiang Xu, Mengyu Zhou, Yijia Shao, Shi Han, Dongmei Zhang
arXiv_CL
arXiv_CL
Transformer
Embedding
Bert
Knowledge
Pose
Language_Model
QA
PDF
2022-12-06
Enabling and Accelerating Dynamic Vision Transformer Inference for Real-Time Applications
Kavya Sreedhar, Jason Clemons, Rangharajan Venkatesan, Stephen W. Keckler, Mark Horowitz
arXiv_CV
arXiv_CV
Transformer
Segmentation
Semantic_Segmentation
Bert
Deep_Learning
Attention
Inference
PDF
2022-12-05
Inverting Cryptographic Hash Functions via Cube-and-Conquer
Oleg Zaikin
arXiv_AI
arXiv_AI
Bert
Pose
PDF
2022-12-05
Construction of Object Boundaries for the Autopilotof a Surface Robot from Satellite Imagesusing Computer Vision Methods
Aleksandr N. Grekov (1) (2), Yurii E. Shishkin (1), Sergei S. Peliushenko (1), Aleksandr S. Mavrin (1) (2), ((1) Institute of Natural and Technical Systems, (2) Sevastopol State University)
arXiv_CV
arXiv_CV
Bert
Pose
Face
Contour
PDF
2022-12-05
Video Games as a Corpus: Sentiment Analysis using Fallout New Vegas Dialog
Mika Hämäläinen, Khalid Alnajjar, Thierry Poibeau
arXiv_CL
arXiv_CL
Bert
Sentiment
PDF
2022-12-05
Human-in-the-Loop Hate Speech Classification in a Multilingual Context
Ana Kotarcic, Dominik Hangartner, Fabrizio Gilardi, Selina Kurer, Karsten Donnay
arXiv_CL
arXiv_CL
Bert
Speech
Pose
Classification
PDF
2022-12-05
Inspired by Norbert Wiener: FeedBack Loop Network Learning Incremental Knowledge for Driver Attention Prediction and Beyond
Yilong Chen, Zhixiong Nan
arXiv_CV
arXiv_CV
Transformer
Bert
Salient
Knowledge
Pose
Attention
Autonomous
Prediction
PDF
2022-12-05
QBERT: Generalist Model for Processing Questions
Zhaozhen Xu, Nello Cristianini
arXiv_AI
arXiv_AI
Embedding
Recognition
Bert
Classification
PDF
2022-12-04
Applying Multilingual Models to Question Answering
Ayrton San Joaquin, Filip Skubacz
arXiv_CL
arXiv_CL
Bert
Zero-Shot
Language_Model
QA
PDF
2022-12-04
Cross-lingual Similarity of Multilingual Representations Revisited
Maksym Del, Mark Fishel
arXiv_AI
arXiv_AI
Bert
Zero-Shot
Relation
Language_Model
PDF
2022-12-04
Languages You Know Influence Those You Learn: Impact of Language Characteristics on Multi-Lingual Text-to-Text Transfer
Benjamin Muller, Deepanshu Gupta, Siddharth Patwardhan, Jean-Philippe Fauconnier, David Vandyke, Sachin Agarwal
arXiv_AI
arXiv_AI
Transformer
Bert
Zero-Shot
Knowledge
Few-Shot
Language_Model
PDF
2022-12-03
Unsupervised Fine-Tuning Data Selection for ASR Using Self-Supervised Speech Models
Reem Gody, David Harwath
arXiv_CL
arXiv_CL
Transformer
Unsupervised
Recognition
Bert
Speech
Self-Supervised
Relation
Speech_Recognition
PDF
2022-12-02
Twitter Data Analysis: Izmir Earthquake Case
Özgür Agrali, Hakan Sökün, Enis Karaarslan
arXiv_AI
arXiv_AI
Transformer
Bert
Pose
Relation
Sentiment
GAN
Inference
PDF
2022-12-02
ColD Fusion: Collaborative Descent for Distributed Multitask Finetuning
Shachar Don-Yehiya, Elad Venezian, Colin Raffel, Noam Slonim, Yoav Katz, Leshem Choshen
arXiv_CL
arXiv_CL
Bert
Self-Supervised
Pose
PDF
2022-12-01
Analogical Math Word Problems Solving with Enhanced Problem-Solution Association
Zhenwen Liang, Jipeng Zhang, Xiangliang Zhang
arXiv_AI
arXiv_AI
Bert
Pose
Relation
PDF
2022-12-01
CliMedBERT: A Pre-trained Language Model for Climate and Health-related Text
B. Jalalzadeh Fard, S. A. Hasan, J. E. Bell
arXiv_CL
arXiv_CL
Bert
Knowledge
Pose
Action
Relation
Relation_Extraction
Text_Generation
Language_Model
PDF
2022-12-01
Adapted Multimodal BERT with Layer-wise Fusion for Sentiment Analysis
Odysseas S. Chlapanis, Georgios Paraskevopoulos, Alexandros Potamianos
arXiv_CV
arXiv_CV
Bert
Pose
Classification
Sentiment
Language_Model
PDF
2022-12-01
CultureBERT: Fine-Tuning Transformer-Based Language Models for Corporate Culture
Sebastian Koch, Stefan Pasch
arXiv_CL
arXiv_CL
Transformer
Bert
Text_Classification
Review
Classification
Language_Model
Prediction
PDF
2022-12-01
CHAPTER: Exploiting Convolutional Neural Network Adapters for Self-supervised Speech Models
Zih-Ching Chen, Yu-Shun Sung, Hung-yi Lee
arXiv_CL
arXiv_CL
Transformer
Bert
Speech
Self-Supervised
Pose
Emotion
CNN
PDF
2022-11-30
Task-Specific Embeddings for Ante-Hoc Explainable Text Classification
Kishaloy Halder, Josip Krapac, Alan Akbik, Anthony Brew, Matti Lyra
arXiv_CL
arXiv_CL
Transformer
Embedding
Bert
Text_Classification
Pose
Classification
PDF
2022-11-30
Topological Data Analysis for Speech Processing
Eduard Tulchinskii, Kristian Kuznetsov, Laida Kushnareva, Daniil Cherniavskii, Serguei Barannikov, Irina Piontkovskaya, Sergey Nikolenko, Evgeny Burnaev
arXiv_CL
arXiv_CL
Transformer
Embedding
Bert
Speech
Pose
Classification
Attention
Prediction
PDF
2022-11-30
ExtremeBERT: A Toolkit for Accelerating Pretraining of Customized BERT
Rui Pan, Shizhe Diao, Jianlin Chen, Tong Zhang
arXiv_CL
arXiv_CL
Bert
Language_Model
PDF
2022-11-30
RAFT: Rationale adaptor for few-shot abusive language detection
Punyajoy Saha, Divyanshu Sheth, Kushal Kedia, Binny Mathew, Animesh Mukherjee
arXiv_CL
arXiv_CL
Bert
Pose
Classification
Detection
Few-Shot
PDF
2022-11-30
X-PuDu at SemEval-2022 Task 6: Multilingual Learning for English and Arabic Sarcasm Detection
Yaqian Han, Yekun Chai, Shuohuan Wang, Yu Sun, Hongyi Huang, Guanghao Chen, Yitong Xu, Yang Yang
arXiv_CL
arXiv_CL
Bert
Classification
Detection
Sentiment
Language_Model
PDF
2022-11-30
HEAT: Hardware-Efficient Automatic Tensor Decomposition for Transformer Compression
Jiaqi Gu, Ben Keller, Jean Kossaifi, Anima Anandkumar, Brucek Khailany, David Z. Pan
arXiv_AI
arXiv_AI
Transformer
Bert
Optimization
Knowledge
Pose
Action
Attention
Inference
PDF
2022-11-29
Improving astroBERT using Semantic Textual Similarity
Felix Grezes, Thomas Allen, Sergi Blanco-Cuaresma, Alberto Accomazzi, Michael J. Kurtz, Golnaz Shapurian, Edwin Henneken, Carolyn S. Grant, Donna M. Thompson, Timothy W. Hostetler, Matthew R. Templeton, Kelly E. Lockhart, Shinyi Chen, Jennifer Koch, Taylor Jacovich, Pavlos Protopapas
arXiv_CL
arXiv_CL
Bert
Language_Model
PDF
2022-11-29
Evaluating Unsupervised Text Classification: Zero-shot and Similarity-based Approaches
Tim Schopf, Daniel Braun, Florian Matthes
arXiv_AI
arXiv_AI
Transformer
Embedding
Unsupervised
Bert
Zero-Shot
Text_Classification
Knowledge
Pose
Classification
Medical
PDF
2022-11-29
Diverse Multi-Answer Retrieval with Determinantal Point Processes
Poojitha Nandigam, Nikhil Rayaprolu, Manish Shrivastava
arXiv_CL
arXiv_CL
Bert
Pose
Relation
QA
PDF
2022-11-29
Compressing Cross-Lingual Multi-Task Models at Qualtrics
Daniel Campos, Daniel Perry, Samir Joshi, Yashmeet Gambhir, Wei Du, Zhengzheng Xing, Aaron Colak
arXiv_CL
arXiv_CL
Bert
Text_Classification
Action
Classification
GAN
Inference
Prediction
PDF
2022-11-28
Automatically Extracting Information in Medical Dialogue: Expert System And Attention for Labelling
Xinshi Wang, Daniel Tang
arXiv_CL
arXiv_CL
Bert
Pose
Action
Classification
Attention
Medical
PDF
2022-11-28
NeuralMPS: Non-Lambertian Multispectral Photometric Stereo via Spectral Reflectance Decomposition
Jipeng Lv, Heng Guo, Guanying Chen, Jinxiu Liang, Boxin Shi
arXiv_CV
arXiv_CV
Bert
Pose
Face
PDF
2022-11-28
Scientific and Creative Analogies in Pretrained Language Models
Tamara Czinczoll, Helen Yannakoudakis, Pushkar Mishra, Ekaterina Shutova
arXiv_CL
arXiv_CL
Bert
Pose
Relation
Language_Model
PDF
2022-11-28
Is it Required? Ranking the Skills Required for a Job-Title
Sarthak Anand, Jens-Joris Decorte, Niels Lowie
arXiv_CL
arXiv_CL
Bert
PDF
2022-11-28
Revisiting Distance Metric Learning for Few-Shot Natural Language Classification
Witold Sosnowski, Anna Wróblewska, Karolina Seweryn, Piotr Gawrysiak
arXiv_AI
arXiv_AI
Bert
Classification
Few-Shot
Attention
Inference
Language_Model
PDF
2022-11-28
Large Pre-Trained Models with Extra-Large Vocabularies: A Contrastive Analysis of Hebrew BERT Models and a New One to Outperform Them All
Eylon Guetta, Avi Shmidman, Shaltiel Shmidman, Cheyn Shmuel Shmidman, Joshua Guedalia, Moshe Koppel, Dan Bareket, Amit Seker, Reut Tsarfaty
arXiv_CL
arXiv_CL
Segmentation
Bert
Sentiment
Language_Model
PDF
2022-11-28
Distance Metric Learning Loss Functions in Few-Shot Scenarios of Supervised Language Models Fine-Tuning
Witold Sosnowski, Karolina Seweryn, Anna Wróblewska, Piotr Gawrysiak
arXiv_AI
arXiv_AI
Bert
Classification
Few-Shot
Language_Model
PDF
2022-11-28
Handling and extracting key entities from customer conversations using Speech recognition and Named Entity recognition
Sharvi Endait, Ruturaj Ghatage, Prof. DD Kadam
arXiv_CL
arXiv_CL
Transformer
Recognition
Bert
Speech
Face
Action
Speech_Recognition
PDF
2022-11-28
DiffusionBERT: Improving Generative Masked Language Models with Diffusion Models
Zhengfu He, Tianxiang Sun, Kuanning Wang, Xuanjing Huang, Xipeng Qiu
arXiv_CL
arXiv_CL
Bert
Pose
Denoising
Text_Generation
Language_Model
PDF
2022-11-27
AWTE-BERT:Attending to Wordpiece Tokenization Explicitly on BERT for Joint Intent Classification and SlotFilling
Yu Guo, Zhilong Xie, Xingyan Chen, Leilei Wang, Gang Wu
arXiv_AI
arXiv_AI
Transformer
Bert
Optimization
Pose
Action
Classification
Attention
PDF
2022-11-26
SKDBERT: Compressing BERT via Stochastic Knowledge Distillation
Zixiang Ding, Guoqing Jiang, Shuai Zhang, Lin Guo, Wei Lin
arXiv_CL
arXiv_CL
Bert
Knowledge
Pose
Language_Model
PDF
2022-11-25
An Analysis of Social Biases Present in BERT Variants Across Multiple Languages
Aristides Milios (1 and 2), Parishad BehnamGhader (1 and 2) ((1) McGill University, (2) Mila)
arXiv_CL
arXiv_CL
Transformer
Bert
Pose
Language_Model
PDF
2022-11-25
Finetuning BERT on Partially Annotated NER Corpora
Viktor Scherbakov, Vladimir Mayorov
arXiv_CL
arXiv_CL
Recognition
Bert
RNN
PDF
2022-11-25
Competency-Aware Neural Machine Translation: Can Machine Translation Know its Own Translation Quality?
Pei Zhang, Baosong Yang, Haoran Wei, Dayiheng Liu, Kai Fan, Luo Si, Jun Xie
arXiv_AI
arXiv_AI
Bert
Pose
Quantitative
NMT
Relation
Prediction
PDF
2022-11-24
Using Selective Masking as a Bridge between Pre-training and Fine-tuning
Tanish Lad, Himanshu Maheshwari, Shreyas Kottukkal, Radhika Mamidi
arXiv_CL
arXiv_CL
Transformer
Bert
Sentiment_Classification
Pose
Classification
Sentiment
Language_Model
PDF
2022-11-24
Question-type Identification for Academic Questions in Online Learning Platform
Azam Rabiee, Alok Goel, Johnson D'Souza, Saurabh Khanwalkar
arXiv_AI
arXiv_AI
Bert
Classification
PDF
2022-11-24
TESSP: Text-Enhanced Self-Supervised Speech Pre-training
Zhuoyuan Yao, Shuo Ren, Sanyuan Chen, Ziyang Ma, Pengcheng Guo, Lei Xie
arXiv_SD
arXiv_SD
Transformer
Unsupervised
Recognition
Bert
Speech
Self-Supervised
Pose
Speech_Recognition
Matching
PDF
2022-11-24
InDEX: Indonesian Idiom and Expression Dataset for Cloze Test
Xinying Qiu, Guofeng Shi
arXiv_CL
arXiv_CL
Embedding
Bert
Pose
PDF
2022-11-24
Tapping the Potential of Coherence and Syntactic Features in Neural Models for Automatic Essay Scoring
Xinying Qiu, Shuxuan Liao, Jiajun Xie, Jian-Yun Nie
arXiv_CL
arXiv_CL
Embedding
Bert
Pose
Prediction
PDF
2022-11-23
SEAT: Stable and Explainable Attention
Lijie Hu, Yixin Liu, Ninghao Liu, Mengdi Huai, Lichao Sun, Di Wang
arXiv_AI
arXiv_AI
Embedding
Bert
RNN
Attention
Prediction
PDF
2022-11-23
SeedBERT: Recovering Annotator Rating Distributions from an Aggregated Label
Aneesha Sampath, Victoria Lin, Louis-Philippe Morency
arXiv_CL
arXiv_CL
Bert
Pose
Deep_Learning
Attention
Language_Model
PDF
2022-11-23
Improving Visual-textual Sentiment Analysis by Fusing Expert Features
Junyu Chen, Jie An, Hanjia Lyu, Jiebo Luo
arXiv_CV
arXiv_CV
Bert
Pose
Sentiment
Prediction
PDF
2022-11-23
Unified Multimodal Model with Unlikelihood Training for Visual Dialog
Zihao Wang, Junli Wang, Changjun Jiang
arXiv_AI
arXiv_AI
Bert
Knowledge
Pose
Attention
Language_Model
QA
PDF
2022-11-23
Word-Level Representation From Bytes For Language Modeling
Chu-Tak Lee, Qipeng Guo, Xipeng Qiu
arXiv_CL
arXiv_CL
Embedding
Bert
Text_Classification
Classification
Attention
Image_Classification
Language_Model
Prediction
PDF
2022-11-22
OLGA : An Ontology and LSTM-based approach for generating Arithmetic Word Problems of transfer type
Suresh Kumar, P Sreenivasa Kumar
arXiv_AI
arXiv_AI
Bert
RNN
Knowledge
Pose
Ontology
Relation
PDF
2022-11-21
L3Cube-HindBERT and DevBERT: Pre-Trained BERT Transformer models for Devanagari based Hindi and Marathi Languages
Raviraj Joshi
arXiv_CL
arXiv_CL
Transformer
Recognition
Bert
Text_Classification
Classification
PDF
2022-11-21
CBEAF-Adapting: Enhanced Continual Pretraining for Building Chinese Biomedical Language Model
Yongyu Yan, Kui Xue, Qi Ye, Tong Ruan
arXiv_CL
arXiv_CL
Bert
Pose
Attention
Medical
Language_Model
PDF
2022-11-21
TCBERT: A Technical Report for Chinese Topic Classification BERT
Ting Han, Kunhao Pan, Xinyu Chen, Dingjie Song, Yuchen Fan, Xinyu Gao, Ruyi Gan, Jiaxing Zhang
arXiv_CL
arXiv_CL
Transformer
Bert
Pose
Contrastive_Learning
Classification
GAN
PDF
2022-11-21
VATLM: Visual-Audio-Text Pre-Training with Unified Masked Prediction for Speech Representation Learning
Qiushi Zhu, Long Zhou, Ziqiang Zhang, Shujie Liu, Binxing Jiao, Jie Zhang, Lirong Dai, Daxin Jiang, Jinyu Li, Furu Wei
arXiv_AI
arXiv_AI
Transformer
Recognition
Bert
Represenation_Learning
Speech
Pose
Action
Speech_Recognition
Language_Model
Prediction
PDF
2022-11-21
Exploring the Efficacy of Pre-trained Checkpoints in Text-to-Music Generation Task
Shangda Wu, Maosong Sun
arXiv_CL
arXiv_CL
Bert
PDF
2022-11-21
L3Cube-MahaSBERT and HindSBERT: Sentence BERT Models and Benchmarking BERT Sentence Representations for Hindi and Marathi
Ananya Joshi, Aditi Kajale, Janhavi Gadre, Samruddhi Deode, Raviraj Joshi
arXiv_CL
arXiv_CL
Transformer
Embedding
Bert
Text_Classification
Classification
PDF
2022-11-20
Conceptor-Aided Debiasing of Contextualized Embeddings
Yifei Li, Lyle Ungar, João Sedoc
arXiv_AI
arXiv_AI
Embedding
Bert
Pose
Language_Model
PDF
2022-11-20
Understanding and Improving Knowledge Distillation for Quantization-Aware Training of Large Transformer Encoders
Minsoo Kim, Sihwa Lee, Sukjin Hong, Du-Seong Chang, Jungwook Choi
arXiv_AI
arXiv_AI
Transformer
Quantization
Bert
Knowledge
Pose
Attention
QA
PDF
2022-11-20
Feature Weaken: Vicinal Data Augmentation for Classification
Songhao Jiang, Yan Chu, Tianxing Ma, Tianning Zang
arXiv_AI
arXiv_AI
Bert
Text_Classification
Optimization
Adversarial
Pose
Classification
Deep_Learning
Image_Classification
PDF
2022-11-20
Detecting Conspiracy Theory Against COVID-19 Vaccines
Md Hasibul Amin (1), Harika Madanu (1), Sahithi Lavu (1), Hadi Mansourifar (1), Dana Alsagheer (1), Weidong Shi (1) ((1) University Of Houston)
arXiv_CL
arXiv_CL
Bert
Sentiment
PDF
2022-11-19
Entity-Assisted Language Models for Identifying Check-worthy Sentences
Ting Su, Craig Macdonald, Iadh Ounis
arXiv_CL
arXiv_CL
Embedding
Bert
Text_Classification
RNN
Knowledge
Knowledge_Graph
Speech
Pose
Classification
Language_Model
PDF
2022-11-18
Knowledge Graph Refinement based on Triplet BERT-Networks
Armita Khajeh Nassiri (1), Nathalie Pernelle (2), Fatiha Sais (1), Gianluca Quercini (1) ((1) LISN, CNRS UMR 9015, University of Paris Saclay (2) LIPN, CNRS UMR 7030, University of Sorbonne Paris Nord)
arXiv_AI
arXiv_AI
Transformer
Embedding
Bert
Knowledge
Knowledge_Graph
Pose
Classification
Relation
Few-Shot
Language_Model
Prediction
PDF
2022-11-18
CITADEL: Conditional Token Interaction via Dynamic Lexical Routing for Efficient and Effective Multi-Vector Retrieval
Minghan Li, Sheng-Chieh Lin, Barlas Oguz, Asish Ghoshal, Jimmy Lin, Yashar Mehdad, Wen-tau Yih, Xilun Chen
arXiv_CL
arXiv_CL
Bert
Sparse
Pose
Action
PDF
2022-11-18
Metadata Might Make Language Models Better
Kaspar Beelen, Daniel van Strien
arXiv_CL
arXiv_CL
Bert
Pose
Classification
Language_Model
PDF
2022-11-18
Where did you tweet from? Inferring the origin locations of tweets based on contextual information
Rabindra Lamsal, Aaron Harwood, Maria Rodriguez Read
arXiv_CL
arXiv_CL
Bert
Pose
Action
GAN
PDF
2022-11-17
MelHuBERT: A simplified HuBERT on Mel spectrogram
Tzu-Quan Lin, Hung-yi Lee, Hao Tang
arXiv_SD
arXiv_SD
Bert
Speech
Self-Supervised
Pose
PDF
2022-11-17
Random-LTD: Random and Layerwise Token Dropping Brings Efficient Training for Large-scale Transformers
Zhewei Yao, Xiaoxia Wu, Conglong Li, Connor Holmes, Minjia Zhang, Cheng Li, Yuxiong He
arXiv_CL
arXiv_CL
Transformer
Bert
Zero-Shot
Pose
PDF
2022-11-17
ProtSi: Prototypical Siamese Network with Data Augmentation for Few-Shot Subjective Answer Evaluation
Yining Lu, Jingxi Qiu, Gaurav Gupta
arXiv_CL
arXiv_CL
Unsupervised
Bert
Text_Classification
Pose
Contrastive_Learning
Classification
Few-Shot
PDF
2022-11-17
Zero-Shot Dynamic Quantization for Transformer Inference
Yousef El-Kurdi, Jerry Quinn, Avirup Sil
arXiv_CL
arXiv_CL
Transformer
Quantization
Bert
Zero-Shot
Inference
PDF
2022-11-17
Consultation Checklists: Standardising the Human Evaluation of Medical Note Generation
Aleksandar Savkov, Francesco Moramarco, Alex Papadopoulos Korfiatis, Mark Perera, Anya Belz, Ehud Reiter
arXiv_CL
arXiv_CL
Bert
Pose
Relation
Medical
PDF
2022-11-17
LongFNT: Long-form Speech Recognition with Factorized Neural Transducer
Xun Gong, Yu Wu, Jinyu Li, Shujie Liu, Rui Zhao, Xie Chen, Yanmin Qian
arXiv_SD
arXiv_SD
Recognition
Bert
Speech
Pose
Speech_Recognition
Language_Model
Prediction
PDF
2022-11-16
A Graph-Based Context-Aware Model to Understand Online Conversations
Vibhor Agarwal, Anthony P. Young, Sagar Joglekar, Nishanth Sastry
arXiv_AI
arXiv_AI
Embedding
Bert
Speech
Pose
Classification
Deep_Learning
Detection
Inference
Prediction
PDF
2022-11-16
Ischemic Stroke Lesion Prediction using imbalanced Temporal Deep Gaussian Process
Mohsen Soltanpour, Muhammad Yousefnezhad, Russ Greiner, Pierre Boulanger, Brian Buck
arXiv_CV
arXiv_CV
3D
Bert
Pose
Prediction
PDF
2022-11-16
L2 proficiency assessment using self-supervised speech representations
Stefano Bannò, Kate M. Knill, Marco Matassoni, Vyas Raina, Mark J. F. Gales
arXiv_CL
arXiv_CL
Recognition
Bert
Speech
Self-Supervised
Pose
Speech_Recognition
PDF
2022-11-16
Fast and Accurate FSA System Using ELBERT: An Efficient and Lightweight BERT
Siyuan Lu, Chenchen Zhou, Keli Xie, Shiyi Liu, Jun Lin, Zhongfeng Wang
arXiv_CL
arXiv_CL
Transformer
Bert
Pose
Deep_Learning
Sentiment
PDF
2022-11-16
Streaming Joint Speech Recognition and Disfluency Detection
Hayato Futami, Emiru Tsunoo, Kentaro Shibata, Yosuke Kashiwagi, Takao Okuda, Siddhant Arora, Shinji Watanabe
arXiv_SD
arXiv_SD
Transformer
Recognition
Bert
Speech
Pose
Detection
Speech_Recognition
Inference
Language_Model
PDF
2022-11-15
Empowering Language Models with Knowledge Graph Reasoning for Question Answering
Ziniu Hu, Yichong Xu, Wenhao Yu, Shuohang Wang, Ziyi Yang, Chenguang Zhu, Kai-Wei Chang, Yizhou Sun
arXiv_CL
arXiv_CL
Transformer
Enhancement
Bert
Knowledge
Knowledge_Graph
Pose
Action
Relation
Language_Model
PDF
2022-11-15
An FNet based Auto Encoder for Long Sequence News Story Generation
Paul K. Mandal, Rakeshkumar Mahto
arXiv_CL
arXiv_CL
Bert
Pose
PDF
2022-11-15
Multiagent Rollout with Reshuffling for Warehouse Robots Path Planning
William Emanuelsson, Alejandro Penacho Riveiros, Yuchao Li, Karl H. Johansson, Jonas Mårtensson
arXiv_RO
arXiv_RO
Bert
Pose
PDF
2022-11-15
RobBERT-2022: Updating a Dutch Language Model to Account for Evolving Language Use
Pieter Delobelle, Thomas Winters, Bettina Berendt
arXiv_CL
arXiv_CL
Transformer
Bert
GAN
Language_Model
PDF
2022-11-15
Persian Emotion Detection using ParsBERT and Imbalanced Data Handling Approaches
Amirhossein Abaskohi, Nazanin Sabri, Behnam Bahrak
arXiv_CL
arXiv_CL
Transformer
Recognition
Bert
Speech
Emotion
Detection
Language_Model
PDF
2022-11-15
Relationship of the language distance to English ability of a country
Cao Xinxin, Lei Xiaolan, Murtadha Ahmed
arXiv_CL
arXiv_CL
Embedding
Bert
Pose
Relation
Language_Model
Recommendation
PDF
2022-11-14
AdaptKeyBERT: An Attention-Based approach towards Few-Shot & Zero-Shot Domain Adaptation of KeyBERT
Aman Priyanshu, Supriti Vijay
arXiv_CL
arXiv_CL
Transformer
Bert
Zero-Shot
Pose
Ontology
Action
Few-Shot
Attention
Recommendation
PDF
2022-11-14
Semantic Decomposition Improves Learning of Large Language Models on EHR Data
David A. Bloore, Romane Gauriau, Anna L. Decker, Jacob Oppenheim
arXiv_CL
arXiv_CL
Transformer
Bert
Pose
Action
Attention
Medical
Language_Model
Prediction
PDF
2022-11-14
MT4SSL: Boosting Self-Supervised Speech Representation Learning by Integrating Multiple Targets
Ziyang Ma, Zhisheng Zhen, Changli Tang, Yujin Wang, Xie Chen
arXiv_SD
arXiv_SD
Transformer
Bert
Represenation_Learning
Speech
Self-Supervised
Pose
PDF
2022-11-14
Hope Speech Detection on Social Media Platforms
Pranjal Aggarwal, Pasupuleti Chandana, Jagrut Nemade, Shubham Sharma, Sunil Saumya, Shankar Biradar
arXiv_CL
arXiv_CL
Bert
Speech
Detection
PDF
2022-11-14
ALBERT with Knowledge Graph Encoder Utilizing Semantic Similarity for Commonsense Question Answering
Byeongmin Choi, YongHyun Lee, Yeunwoong Kyung, Eunchan Kim
arXiv_AI
arXiv_AI
Transformer
Bert
Knowledge
Knowledge_Graph
Pose
Action
Relation
Language_Model
QA
PDF
2022-11-13
Xu at SemEval-2022 Task 4: Pre-BERT Neural Network Methods vs Post-BERT RoBERTa Approach for Patronizing and Condescending Language Detection
Jinghua Xu
arXiv_CL
arXiv_CL
Bert
Detection
Language_Model
PDF
2022-11-12
Improving the Robustness of DistilHuBERT to Unseen Noisy Conditions via Data Augmentation, Curriculum Learning, and Multi-Task Enhancement
Heitor R. Guimarães, Arthur Pimentel, Anderson R. Avila, Mehdi Rezagholizadeh, Tiago H. Falk
arXiv_SD
arXiv_SD
Enhancement
Recognition
Bert
Represenation_Learning
Speech
Self-Supervised
Pose
Emotion
Action
PDF
2022-11-11
The Architectural Bottleneck Principle
Tiago Pimentel, Josef Valvoda, Niklas Stoehr, Ryan Cotterell
arXiv_CL
arXiv_CL
Transformer
Bert
Pose
Attention
PDF
2022-11-11
Improving word mover's distance by leveraging self-attention matrix
Hiroaki Yamagiwa, Sho Yokoi, Hidetoshi Shimodaira
arXiv_CL
arXiv_CL
Embedding
Bert
Pose
Attention
PDF
2022-11-11
Towards automating Numerical Consistency Checks in Financial Reports
Lars Hillebrand, Tobias Deußer, Tim Dilmaghani, Bernd Kliem, Rüdiger Loitz, Christian Bauckhage, Rafet Sifa
arXiv_CL
arXiv_CL
Bert
Action
Classification
Relation
Relation_Extraction
Matching
PDF
2022-11-11
Misinformation Detection using Persuasive Writing Strategies
Joseph Romain, Huiyi Liu, Wei Peng, Jingbo Meng, Parisa Kordjamshidi
arXiv_CL
arXiv_CL
Bert
Text_Classification
Classification
Detection
Language_Model
Prediction
PDF
2022-11-10
BERT in Plutarch's Shadows
Ivan P. Yamshchikov, Alexey Tikhonov, Yorgos Pantis, Charlotte Schubert, Jürgen Jost
arXiv_CL
arXiv_CL
Bert
Relation
Language_Model
PDF
2022-11-10
BERT on a Data Diet: Finding Important Examples by Gradient-Based Pruning
Mohsen Fayyaz, Ehsan Aghazadeh, Ali Modarressi, Mohammad Taher Pilehvar, Yadollah Yaghoobzadeh, Samira Ebrahimi Kahou
arXiv_CL
arXiv_CL
Bert
Action
Language_Model
PDF
2022-11-10
Impact of Adversarial Training on Robustness and Generalizability of Language Models
Enes Altinisik, Hassan Sajjad, Husrev Taha Sencar, Safa Messaoud, Sanjay Chawla
arXiv_AI
arXiv_AI
Transformer
Embedding
Bert
Knowledge
Adversarial
Relation
Language_Model
PDF
2022-11-10
Syntax-Guided Domain Adaptation for Aspect-based Sentiment Analysis
Anguo Dong, Cuiyun Gao, Yan Jia, Qing Liao, Xuan Wang, Lei Wang, Jing Xiao
arXiv_AI
arXiv_AI
Bert
Knowledge
Review
Pose
Classification
Sentiment
Language_Model
PDF
2022-11-10
Biomedical Multi-hop Question Answering Using Knowledge Graph Embeddings and Language Models
Dattaraj J. Rao, Shraddha S. Mane, Mukta A. Paliwal
arXiv_AI
arXiv_AI
Embedding
Bert
Knowledge
Knowledge_Graph
Face
Relation
Medical
Language_Model
QA
PDF
2022-11-10
BERT-Based Combination of Convolutional and Recurrent Neural Network for Indonesian Sentiment Analysis
Hendri Murfi, Syamsyuriani, Theresia Gowandi, Gianinna Ardaneswari, Siti Nurrohmah
arXiv_CL
arXiv_CL
Transformer
Embedding
Bert
RNN
Emotion
Deep_Learning
Sentiment
Attention
CNN
PDF
2022-11-09
Collateral facilitation in humans and language models
James A. Michaelov, Benjamin K. Bergen
arXiv_CL
arXiv_CL
Transformer
Bert
Language_Model
Prediction
PDF
2022-11-09
Cross-lingual Transfer Learning for Check-worthy Claim Identification over Twitter
Maram Hasanain, Tamer Elsayed
arXiv_CL
arXiv_CL
Transfer_Learning
Bert
Zero-Shot
GAN
PDF
2022-11-09
Mask More and Mask Later: Efficient Pre-training of Masked Language Models by Disentangling the MASK Token
Baohao Liao, David Thulke, Sanjika Hewavitharana, Hermann Ney, Christof Monz
arXiv_CL
arXiv_CL
Transformer
Embedding
Bert
Language_Model
PDF
2022-11-09
Sentiment Analysis of Persian Language: Review of Algorithms, Approaches and Datasets
Ali Nazarizadeh, Touraj Banirostam, Minoo Sayyadpour
arXiv_CL
arXiv_CL
Transformer
Bert
RNN
Review
Pose
Emotion
Deep_Learning
Sentiment
PDF
2022-11-08
Discover, Explanation, Improvement: Automatic Slice Detection Framework for Natural Language Processing
Wenyue Hua, Lifeng Jin, Linfeng Song, Haitao Mi, Yongfeng Zhang, Dong Yu
arXiv_CL
arXiv_CL
Bert
Quantitative
Detection
Attention
PDF
2022-11-08
A Multimodal Approach for Dementia Detection from Spontaneous Speech with Tensor Fusion Layer
Loukas Ilias, Dimitris Askounis, John Psarras
arXiv_CL
arXiv_CL
Transformer
Bert
Speech
Pose
Action
Detection
Attention
PDF
2022-11-08
An Ensemble-based approach for assigning text to correct Harmonized system code
Shubham, Avinash Arya, Subarna Roy, Sridhar Jonnala
arXiv_AI
arXiv_AI
Transformer
Bert
Knowledge
Classification
PDF
2022-11-08
Hilbert Distillation for Cross-Dimensionality Networks
Dian Qin, Haishuai Wang, Zhe Liu, Hongjia Xu, Sheng Zhou, Jiajun Bu
arXiv_AI
arXiv_AI
3D
Bert
Knowledge
Pose
Classification
Attention
Medical
CNN
PDF
2022-11-08
Parameter and Data Efficient Continual Pre-training for Robustness to Dialectal Variance in Arabic
Soumajyoti Sarkar, Kaixiang Lin, Sailik Sengupta, Leonard Lausen, Sheng Zha, Saab Mansour
arXiv_CL
arXiv_CL
Transformer
Bert
Classification
Deep_Learning
Attention
Language_Model
PDF
2022-11-07
End-to-End Evaluation of a Spoken Dialogue System for Learning Basic Mathematics
Eda Okur, Saurav Sahay, Roddy Fuentes Alba, Lama Nachman
arXiv_CL
arXiv_CL
Enhancement
Recognition
Bert
Speech
Action
Speech_Recognition
PDF
2022-11-07
AD-BERT: Using Pre-trained contextualized embeddings to Predict the Progression from Mild Cognitive Impairment to Alzheimer's Disease
Chengsheng Mao, Jie Xu, Luke Rasmussen, Yikuan Li, Prakash Adekkanattu, Jennifer Pacheco, Borna Bonakdarpour, Robert Vassar, Guoqian Jiang, Fei Wang, Jyotishman Pathak, Yuan Luo
arXiv_CL
arXiv_CL
Transformer
Embedding
Bert
Deep_Learning
Prediction
PDF
2022-11-07
AfroLM: A Self-Active Learning-based Multilingual Pretrained Language Model for 23 African Languages
Bonaventure F. P. Dossou, Atnafu Lambebo Tonja, Oreen Yousuf, Salomey Osei, Abigail Oppong, Iyanuoluwa Shode, Oluwabusayo Olufunke Awoyomi, Chris Chinenye Emezue
arXiv_AI
arXiv_AI
Transformer
Bert
Text_Classification
Optimization
Classification
Sentiment
Language_Model
PDF
2022-11-06
Improved Target-specific Stance Detection on Social Media Platforms by Delving into Conversation Threads
Yupeng Li, Haorui He, Shaonan Wang, Francis C.M. Lau, Yunya Song
arXiv_CL
arXiv_CL
Bert
Pose
Detection
PDF
2022-11-06
Suffix Retrieval-Augmented Language Modeling
Zecheng Wang, Yik-Cheung Tam
arXiv_CL
arXiv_CL
Embedding
Bert
Pose
Language_Model
PDF
2022-11-05
BEKG: A Built Environment Knowledge Graph
Xiaojun Yang, Haoyu Zhong, Penglin Du, Keyi Zhou, Xingjin Lai, Zhengdong Wang, Yik Lun Lau, Yangqiu Song, Liyaning Tang
arXiv_CL
arXiv_CL
Recognition
Bert
Knowledge
Knowledge_Graph
Pose
Action
Relation
Relation_Extraction
PDF
2022-11-05
PASTA: Table-Operations Aware Fact Verification via Sentence-Table Cloze Pre-training
Zihui Gu, Ju Fan, Nan Tang, Preslav Nakov, Xiaoman Zhao, Xiaoyong Du
arXiv_AI
arXiv_AI
Transformer
Bert
Action
Attention
Language_Model
PDF
2022-11-04
Intriguing Properties of Compression on Multilingual Models
Kelechi Ogueji, Orevaoghene Ahia, Gbemileke Onilude, Sebastian Gehrmann, Sara Hooker, Julia Kreutzer
arXiv_CL
arXiv_CL
Recognition
Bert
Pose
Language_Model
PDF
2022-11-04
Evaluating and Improving Factuality in Multimodal Abstractive Summarization
David Wan, Mohit Bansal
arXiv_CV
arXiv_CV
Reinforcement_Learning
Bert
Zero-Shot
Pose
Detection
Relation
Summarization
PDF
2022-11-04
BERT for Long Documents: A Case Study of Automated ICD Coding
Arash Afkanpour, Shabir Adeel, Hansenclever Bassani, Arkady Epshteyn, Hongbo Fan, Isaac Jones, Mahan Malihi, Adrian Nauth, Raj Sinha, Sanjana Woonna, Shiva Zamani, Elli Kanal, Mikhail Fomitchev, Donny Cheung
arXiv_CL
arXiv_CL
Transformer
Bert
PDF
2022-11-04
BERT-Deep CNN: State-of-the-Art for Sentiment Analysis of COVID-19 Tweets
Javad Hassannataj Joloudari, Sadiq Hussain, Mohammad Ali Nematollahi, Rouhollah Bagheri, Fatemeh Fazl, Roohallah Alizadehsani, Reza Lashgari
arXiv_CL
arXiv_CL
Bert
Review
Emotion
Survey
Sentiment
PDF
2022-11-04
Continuous Prompt Tuning Based Textual Entailment Model for E-commerce Entity Typing
Yibo Wang, Congying Xia, Guan Wang, Philip Yu
arXiv_CL
arXiv_CL
Embedding
Bert
Pose
Activity
PDF
2022-11-04
Miko Team: Deep Learning Approach for Legal Question Answering in ALQAC 2022
Hieu Nguyen Van, Dat Nguyen, Phuong Minh Nguyen, Minh Le Nguyen
arXiv_CL
arXiv_CL
Bert
Deep_Learning
QA
PDF
2022-11-03
Quantifying Model Uncertainty for Semantic Segmentation using Operators in the RKHS
Rishabh Singh, Jose C. Principe
arXiv_CV
arXiv_CV
Segmentation
Semantic_Segmentation
Bert
Action
Deep_Learning
PDF
2022-11-03
Exploring the State-of-the-Art Language Modeling Methods and Data Augmentation Techniques for Multilingual Clause-Level Morphology
Emre Can Acikgoz, Tilek Chubakov, Müge Kural, Gözde Gül Şahin, Deniz Yuret
arXiv_CL
arXiv_CL
Transformer
Bert
Language_Model
PDF
2022-11-03
Hybrid-SD : A new hybrid evaluation metric for automatic speech recognition tasks
Zitha Sasindran, Harsha Yelchuri, Supreeth Rao, T. V. Prabhakar
arXiv_CL
arXiv_CL
Recognition
Bert
Speech
Pose
Speech_Recognition
PDF
2022-11-03
Channel-Aware Pretraining of Joint Encoder-Decoder Self-Supervised Model for Telephonic-Speech ASR
Vrunda N. Sukhadia, A. Arunkumar, S. Umesh
arXiv_SD
arXiv_SD
Transformer
Bert
Speech
Self-Supervised
Pose
PDF
2022-11-03
Revisiting Grammatical Error Correction Evaluation and Beyond
Peiyuan Gong, Xuebo Liu, Heyan Huang, Min Zhang
arXiv_CL
arXiv_CL
Bert
Knowledge
Pose
Relation
Attention
Summarization
PDF
2022-11-03
Fine-Tuning Language Models via Epistemic Neural Networks
Ian Osband, Seyed Mohammad Asghari, Benjamin Van Roy, Nat McAleese, John Aslanides, Geoffrey Irving
arXiv_CL
arXiv_CL
Unsupervised
Bert
Language_Model
PDF
2022-11-02
RQUGE: Reference-Free Metric for Evaluating Question Generation by Answering the Question
Alireza Mohammadshahi, Thomas Scialom, Majid Yazdani, Pouya Yanki, Angela Fan, James Henderson, Marzieh Saeidi
arXiv_CL
arXiv_CL
Bert
Adversarial
Pose
Relation
QA
PDF
2022-11-02
Multi-level Distillation of Semantic Knowledge for Pre-training Multilingual Language Model
Mingqi Li, Fei Ding, Dan Zhang, Long Cheng, Hongxin Hu, Feng Luo
arXiv_CL
arXiv_CL
Transformer
Bert
Knowledge
Pose
Relation
Language_Model
PDF
2022-11-02
M-SpeechCLIP: Leveraging Large-Scale, Pre-Trained Models for Multilingual Speech to Image Retrieval
Layne Berry, Yi-Jen Shih, Hsuan-Fu Wang, Heng-Jui Chang, Hung-yi Lee, David Harwath
arXiv_CL
arXiv_CL
Transformer
Bert
Image_Retrieval
Speech
PDF
2022-11-02
Transformer-based encoder-encoder architecture for Spoken Term Detection
Jan Švec, Luboš Šmídl, Jan Lehečka
arXiv_CL
arXiv_CL
Transformer
Embedding
Bert
RNN
Speech
Pose
Detection
Attention
CNN
PDF
2022-11-02
Processing Long Legal Documents with Pre-trained Transformers: Modding LegalBERT and Longformer
Dimitris Mamakas, Petros Tsotsi, Ion Androutsopoulos, Ilias Chalkidis
arXiv_CL
arXiv_CL
Transformer
Bert
Sparse
Pose
Classification
Attention
PDF
2022-11-02
BECTRA: Transducer-based End-to-End ASR with BERT-Enhanced Encoder
Yosuke Higuchi, Tetsuji Ogawa, Tetsunori Kobayashi, Shinji Watanabe
arXiv_CL
arXiv_CL
Recognition
Bert
Knowledge
Speech
Pose
Speech_Recognition
Inference
Language_Model
PDF
2022-11-01
Reduce, Reuse, Recycle: Improving Training Efficiency with Distillation
Cody Blakeney, Jessica Zosa Forde, Jonathan Frankle, Ziliang Zong, Matthew L. Leavitt
arXiv_AI
arXiv_AI
Bert
Optimization
Classification
Deep_Learning
Image_Classification
Language_Model
PDF
2022-11-01
T5lephone: Bridging Speech and Text Self-supervised Models for Spoken Language Understanding via Phoneme level T5
Chan-Jan Hsu, Ho-Lam Chung, Hung-yi Lee, Yu Tsao
arXiv_CL
arXiv_CL
Bert
Speech
Self-Supervised
Language_Model
QA
PDF
2022-11-01
Investigating Content-Aware Neural Text-To-Speech MOS Prediction Using Prosodic and Linguistic Features
Alexandra Vioni, Georgia Maniati, Nikolaos Ellinas, June Sig Sung, Inchul Hwang, Aimilios Chalamandaris, Pirros Tsiakoulis
arXiv_CL
arXiv_CL
Embedding
Bert
Speech
Self-Supervised
Pose
Relation
Prediction
PDF
2022-11-01
CCS Explorer: Relevance Prediction, Extractive Summarization, and Named Entity Recognition from Clinical Cohort Studies
Irfan Al-Hussaini, Davi Nakajima An, Albert J. Lee, Sarah Bi, Cassie S. Mitchell
arXiv_AI
arXiv_AI
Transformer
Recognition
Bert
Pose
Face
Detection
Summarization
Language_Model
Prediction
PDF
2022-10-31
Leveraging Pre-trained Models for Failure Analysis Triplets Generation
Kenneth Ezukwoke, Anis Hoayek, Mireille Batton-Hubert, Xavier Boucher, Pascal Gounet, Jerome Adrian
arXiv_CL
arXiv_CL
Transformer
Bert
RNN
Action
Attention
Summarization
Language_Model
PDF
2022-10-31
Audio-Visual Speech Enhancement and Separation by Leveraging Multi-Modal Self-Supervised Embeddings
I-Chun Chern, Kuo-Hsuan Hung, Yi-Ting Chen, Tassadaq Hussain, Mandar Gogate, Amir Hussain, Yu Tsao, Jen-Cheng Hou
arXiv_SD
arXiv_SD
Embedding
Enhancement
Recognition
Bert
Speech
Self-Supervised
Pose
Speech_Recognition
PDF
2022-10-31
Emergent Linguistic Structures in Neural Networks are Fragile
Emanuele La Malfa, Matthew Wicker, Marta Kiatkowska
arXiv_CL
arXiv_CL
Bert
Pose
Attention
Language_Model
PDF
2022-10-31
IITD at the WANLP 2022 Shared Task: Multilingual Multi-Granularity Network for Propaganda Detection
Shubham Mittal, Preslav Nakov
arXiv_CL
arXiv_CL
Bert
Classification
Detection
GAN
PDF
2022-10-31
SDCL: Self-Distillation Contrastive Learning for Chinese Spell Checking
Xiaotian Zhang, Hang Yan, Sun Yu, Xipeng Qiu
arXiv_CL
arXiv_CL
Bert
Pose
Contrastive_Learning
PDF
2022-10-31
Improving Cause-of-Death Classification from Verbal Autopsy Reports
Thokozile Manaka, Terence van Zyl, Deepak Kar
arXiv_CL
arXiv_CL
Transformer
Embedding
Transfer_Learning
Bert
Classification
Language_Model
PDF
2022-10-31
QuaLA-MiniLM: a Quantized Length Adaptive MiniLM
Shira Guskin, Moshe Wasserblat, Chang Wang, Haihao Shen
arXiv_CL
arXiv_CL
Transformer
Embedding
Quantization
Bert
Knowledge
Inference
PDF
2022-10-30
Improving Bilingual Lexicon Induction with Cross-Encoder Reranking
Yaoyiran Li, Fangyu Liu, Ivan Vulić, Anna Korhonen
arXiv_CL
arXiv_CL
Embedding
Bert
Knowledge
Pose
Inference
Language_Model
PDF
2022-10-30
Parameter-Efficient Tuning Makes a Good Classification Head
Zhuoyi Yang, Ming Ding, Yanhui Guo, Qingsong Lv, Jie Tang
arXiv_CL
arXiv_CL
Bert
Classification
PDF
2022-10-29
BERT Meets CTC: New Formulation of End-to-End Speech Recognition with Pre-trained Masked Language Model
Yosuke Higuchi, Brian Yan, Siddhant Arora, Tetsuji Ogawa, Tetsunori Kobayashi, Shinji Watanabe
arXiv_CL
arXiv_CL
Embedding
Recognition
Bert
Knowledge
Speech
Classification
Attention
Speech_Recognition
Inference
Language_Model
PDF
2022-10-29
Empirical Evaluation of Post-Training Quantization Methods for Language Tasks
Ting Hu, Christoph Meinel, Haojin Yang
arXiv_CL
arXiv_CL
Transformer
Quantization
Bert
PDF
2022-10-29
Application of Knowledge Distillation to Multi-task Speech Representation Learning
Mine Kerpicci, Van Nguyen, Shuhua Zhang, Erik Visser
arXiv_CL
arXiv_CL
Recognition
Bert
Represenation_Learning
Knowledge
Speech
Self-Supervised
Pose
Speech_Recognition
PDF
2022-10-29
Exploiting prompt learning with pre-trained language models for Alzheimer's Disease detection
Yi Wang, Jiajun Deng, Tianzi Wang, Bo Zheng, Shoukang Hu, Xunying Liu, Helen Meng
arXiv_CL
arXiv_CL
Embedding
Bert
Speech
Classification
Detection
Language_Model
Prediction
PDF
2022-10-29
Two is Better than Many? Binary Classification as an Effective Approach to Multi-Choice Question Answering
Deepanway Ghosal, Navonil Majumder, Rada Mihalcea, Soujanya Poria
arXiv_CL
arXiv_CL
Bert
Pose
Classification
QA
PDF
2022-10-28
DiMBERT: Learning Vision-Language Grounded Representations with Disentangled Multimodal-Attention
Fenglin Liu, Xian Wu, Shen Ge, Xuancheng Ren, Wei Fan, Xu Sun, Yuexian Zou
arXiv_CL
arXiv_CL
Image_Caption
Transformer
Bert
Pose
Classification
Relation
Attention
Caption
Language_Model
PDF
2022-10-28
Probing for targeted syntactic knowledge through grammatical error detection
Christopher Davis, Christopher Bryant, Andrew Caines, Marek Rei, Paula Buttery
arXiv_CL
arXiv_CL
Bert
Knowledge
Pose
Detection
Language_Model
PDF
2022-10-28
Feature Engineering vs BERT on Twitter Data
Ryiaadh Gani, Lisa Chalaguine
arXiv_CL
arXiv_CL
Embedding
Bert
Language_Model
PDF
2022-10-28
Zero-Shot Text Matching for Automated Auditing using Sentence Transformers
David Biesner, Maren Pielka, Rajkumar Ramamurthy, Tim Dilmaghani, Bernd Kliem, Rüdiger Loitz, Rafet Sifa
arXiv_CL
arXiv_CL
Transformer
Unsupervised
Bert
Zero-Shot
Classification
Matching
PDF
2022-10-28
Analyzing Acoustic Word Embeddings from Pre-trained Self-supervised Speech Models
Ramon Sanabria, Hao Tang, Sharon Goldwater
arXiv_CL
arXiv_CL
Embedding
Bert
Speech
Self-Supervised
PDF
2022-10-28
BEBERT: Efficient and robust binary ensemble BERT
Jiayi Tian, Chao Fang, Haonan Wang, Zhongfeng Wang
arXiv_CL
arXiv_CL
Bert
Knowledge
Pose
PDF
2022-10-28
RoChBert: Towards Robust BERT Fine-tuning for Chinese
Zihan Zhang, Jinfeng Li, Ning Shi, Bo Yuan, Xiangyu Liu, Rong Zhang, Hui Xue, Donghong Sun, Chao Zhang
arXiv_CL
arXiv_CL
Transformer
Bert
Adversarial
Pose
Language_Model
PDF
2022-10-28
On the Use of Modality-Specific Large-Scale Pre-Trained Encoders for Multimodal Sentiment Analysis
Atsushi Ando, Ryo Masumura, Akihiko Takashima, Satoshi Suzuki, Naoki Makishima, Keita Suzuki, Takafumi Moriya, Takanori Ashihara, Hiroshi Sato
arXiv_CL
arXiv_CL
Bert
Sentiment
PDF
2022-10-28
Leveraging Label Correlations in a Multi-label Setting: A Case Study in Emotion
Georgios Chochlakis (1 and 2), Gireesh Mahajan (3), Sabyasachee Baruah (1 and 2), Keith Burghardt (2), Kristina Lerman (2), Shrikanth Narayanan (1 and 2) ((1) Signal Analysis and Interpretation Lab, University of Southern California, (2) Information Science Institute, University of Southern California, (3) Microsoft Cognitive Services)
arXiv_AI
arXiv_AI
Recognition
Bert
Regularization
Emotion
Classification
Detection
Relation
Language_Model
PDF
2022-10-27
Exploring Effective Distillation of Self-Supervised Speech Models for Automatic Speech Recognition
Yujin Wang, Changli Tang, Ziyang Ma, Zhisheng Zheng, Xie Chen, Wei-Qiang Zhang
arXiv_CL
arXiv_CL
Recognition
Bert
Speech
Self-Supervised
Speech_Recognition
Inference
PDF
2022-10-27
COST-EFF: Collaborative Optimization of Spatial and Temporal Efficiency with Slenderized Multi-exit Language Models
Bowen Shen, Zheng Lin, Yuanxin Liu, Zhengxiao Liu, Lei Wang, Weiping Wang
arXiv_CL
arXiv_CL
Transformer
Bert
Optimization
Pose
Inference
Language_Model
Prediction
PDF
2022-10-27
Self-consistent Reasoning For Solving Math Word Problems
Jing Xiong, Zhongwei Wan, Xiping Hu, Min Yang, Chengming Li
arXiv_CL
arXiv_CL
Bert
Pose
Relation
PDF
2022-10-27
FCTalker: Fine and Coarse Grained Context Modeling for Expressive Conversational Speech Synthesis
Yifan Hu, Rui Liu, Guanglai Gao, Haizhou Li
arXiv_CL
arXiv_CL
Bert
Speech
Pose
Relation
PDF
2022-10-27
Seq2Seq-SC: End-to-End Semantic Communication Systems with Pre-trained Language Model
Ju-Hyung Lee, Dong-Ho Lee, Eunsoo Sheen, Thomas Choi, Jay Pujara, Joongheon Kim
arXiv_CL
arXiv_CL
Bert
Language_Model
PDF
2022-10-27
Unsupervised Boundary-Aware Language Model Pretraining for Chinese Sequence Labeling
Peijie Jiang, Dingkun Long, Yanzhao Zhang, Pengjun Xie, Meishan Zhang, Min Zhang
arXiv_AI
arXiv_AI
Segmentation
Unsupervised
Recognition
Bert
Speech
Pose
Language_Model
PDF
2022-10-27
Fast DistilBERT on CPUs
Haihao Shen, Ofir Zafrir, Bo Dong, Hengyu Meng, Xinyu Ye, Zhe Wang, Yi Ding, Hanwen Chang, Guy Boudoukh, Moshe Wasserblat
arXiv_CL
arXiv_CL
Transformer
Quantization
Bert
Sparse
Knowledge
Pose
Inference
Language_Model
PDF
2022-10-27
BERT-Flow-VAE: A Weakly-supervised Model for Multi-Label Text Classification
Ziwen Liu, Josep Grau-Bove, Scott Allan Orr
arXiv_CL
arXiv_CL
Embedding
Bert
Text_Classification
Sparse
Pose
Face
Classification
Prediction
PDF
2022-10-27
COCO-DR: Combating Distribution Shifts in Zero-Shot Dense Retrieval with Contrastive and Distributionally Robust Learning
Yue Yu, Chenyan Xiong, Si Sun, Chao Zhang, Arnold Overwijk
arXiv_CL
arXiv_CL
Embedding
Bert
Zero-Shot
Optimization
Relation
Language_Model
PDF
2022-10-27
Open-vocabulary Semantic Segmentation with Frozen Vision-Language Models
Chaofan Ma, Yuhuan Yang, Yanfeng Wang, Ya Zhang, Weidi Xie
arXiv_CV
arXiv_CV
Transformer
Segmentation
Semantic_Segmentation
Bert
Zero-Shot
Self-Supervised
Pose
Language_Model
PDF
2022-10-27
Masked Vision-Language Transformer in Fashion
Ge-Peng Ji, Mingcheng Zhuge, Dehong Gao, Deng-Ping Fan, Christos Sakaridis, Luc Van Gool
arXiv_CV
arXiv_CV
Transformer
Reconstruction
Recognition
Bert
Matching
PDF
2022-10-26
Causality Detection using Multiple Annotation Decision
Quynh Anh Nguyen, Arka Mitra
arXiv_CL
arXiv_CL
Bert
Action
Detection
Language_Model
PDF
2022-10-26
Don't Prompt, Search! Mining-based Zero-Shot Learning with Language Models
Mozes van de Kar, Mengzhou Xia, Danqi Chen, Mikel Artetxe
arXiv_AI
arXiv_AI
Bert
Zero-Shot
Text_Classification
Pose
Classification
Language_Model
PDF
2022-10-26
Multilevel Transformer For Multimodal Emotion Recognition
Junyi He, Meimei Wu, Meng Li, Xiaobo Zhu, Feng Ye
arXiv_CL
arXiv_CL
Transformer
Embedding
Recognition
Bert
Speech
Pose
Emotion
Attention
PDF
2022-10-26
Leveraging Affirmative Interpretations from Negation Improves Natural Language Understanding
Md Mosharaf Hossain, Eduardo Blanco
arXiv_CL
arXiv_CL
Bert
Pose
Sentiment
Inference
PDF
2022-10-26
Bi-Link: Bridging Inductive Link Predictions from Text via Contrastive Learning of Transformers and Prompts
Bohua Peng, Shihao Liang, Mobarakol Islam
arXiv_CL
arXiv_CL
Transformer
Bert
Knowledge
Knowledge_Graph
Pose
Contrastive_Learning
Relation
Language_Model
Prediction
PDF
2022-10-26
Exploring Robustness of Prefix Tuning in Noisy Data: A Case Study in Financial Sentiment Analysis
Sudhandar Balakrishnan, Yihao Fang, Xioadan Zhu
arXiv_CL
arXiv_CL
Transformer
Bert
Face
Sentiment
PDF
2022-10-25
Causal Analysis of Syntactic Agreement Neurons in Multilingual Language Models
Aaron Mueller, Yu Xia, Tal Linzen
arXiv_CL
arXiv_CL
Bert
Relation
Language_Model
PDF
2022-10-25
Universal Evasion Attacks on Summarization Scoring
Wenchuan Mu, Kwan Hui Lim
arXiv_CL
arXiv_CL
Bert
Pose
Summarization
PDF
2022-10-25
IELM: An Open Information Extraction Benchmark for Pre-Trained Language Models
Chenguang Wang, Xiao Liu, Dawn Song
arXiv_AI
arXiv_AI
Bert
Zero-Shot
Knowledge
Action
Relation
Language_Model
PDF
2022-10-25
DEMETR: Diagnosing Evaluation Metrics for Translation
Marzena Karpinska, Nishant Raj, Katherine Thai, Yixiao Song, Ankita Gupta, Mohit Iyyer
arXiv_CL
arXiv_CL
Bert
Relation
Language_Model
PDF
2022-10-25
Parameter-Efficient Legal Domain Adaptation
Jonathan Li, Rohan Bhambhoria, Xiaodan Zhu
arXiv_CL
arXiv_CL
Transformer
Unsupervised
Bert
Knowledge
Pose
Language_Model
PDF
2022-10-24
VLC-BERT: Visual Question Answering with Contextualized Commonsense Knowledge
Sahithya Ravi, Aditya Chinchure, Leonid Sigal, Renjie Liao, Vered Shwartz
arXiv_CV
arXiv_CV
Transformer
Bert
Knowledge
Pose
VQA
QA
PDF
2022-10-24
Learning by Hallucinating: Vision-Language Pre-training with Weak Supervision
Tzu-Jui Julius Wang, Jorma Laaksonen, Tomas Langer, Heikki Arponen, Tom E. Bishop
arXiv_CV
arXiv_CV
Image_Caption
Transformer
Bert
Image_Retrieval
Pose
Action
VQA
Caption
PDF
2022-10-24
Effective Pre-Training Objectives for Transformer-based Autoencoders
Luca Di Liello, Matteo Gabburo, Alessandro Moschitti
arXiv_CL
arXiv_CL
Transformer
Bert
Pose
PDF
2022-10-24
Classification of Misinformation in New Articles using Natural Language Processing and a Recurrent Neural Network
Brendan Cunha, Lydia Manikonda
arXiv_CL
arXiv_CL
Bert
Classification
PDF
2022-10-24
Entity-level Sentiment Analysis in Contact Center Telephone Conversations
Xue-Yong Fu, Cheng Chen, Md Tahmid Rahman Laskar, Shayna Gardiner, Pooja Hiranandani, Shashi Bhushan TN
arXiv_CL
arXiv_CL
Transformer
Bert
Emotion
Sentiment
CNN
PDF
2022-10-24
Explaining Translationese: why are Neural Classifiers Better and what do they Learn?
Kwabena Amponsah-Kaakyire, Daria Pylypenko, Josef van Genabith, Cristina España-Bonet
arXiv_CL
arXiv_CL
Bert
Classification
Relation
PDF
2022-10-24
Universal and Independent: Multilingual Probing Framework for Exhaustive Model Interpretation and Evaluation
Oleg Serikov, Vitaly Protasov, Ekaterina Voloshina, Viktoria Knyazkova, Tatiana Shavrina
arXiv_AI
arXiv_AI
Bert
Knowledge
Pose
Language_Model
PDF
2022-10-24
Mutual Information Alleviates Hallucinations in Abstractive Summarization
Liam van der Poel, Ryan Cotterell, Clara Meister
arXiv_CL
arXiv_CL
Bert
Pose
Summarization
PDF
2022-10-24
The Better Your Syntax, the Better Your Semantics? Probing Pretrained Language Models for the English Comparative Correlative
Leonie Weissweiler, Valentin Hofmann, Abdullatif Köksal, Hinrich Schütze
arXiv_CL
arXiv_CL
Bert
Knowledge
Classification
Language_Model
PDF
2022-10-24
Proficiency assessment of L2 spoken English using wav2vec 2.0
Stefano Bannò, Marco Matassoni
arXiv_CL
arXiv_CL
Bert
Salient
Speech
PDF
2022-10-24
Exploring Euphemism Detection in Few-Shot and Zero-Shot Settings
Sedrick Scott Keh
arXiv_CL
arXiv_CL
Bert
Zero-Shot
Pose
Detection
Few-Shot
Language_Model
PDF
2022-10-23
Bootstrapping meaning through listening: Unsupervised learning of spoken sentence embeddings
Jian Zhu, Zuoyu Tian, Yadong Liu, Cong Zhang, Chia-wen Lo
arXiv_CL
arXiv_CL
Embedding
Unsupervised
Bert
Knowledge
Speech
Pose
Contrastive_Learning
Relation
PDF
2022-10-23
Automated Essay Scoring using Transformers
Kshitij Gupta
arXiv_AI
arXiv_AI
Transformer
Bert
RNN
Attention
PDF
2022-10-23
On Cross-Domain Pre-Trained Language Models for Clinical Text Mining: How Do They Perform on Data-Constrained Fine-Tuning?
Yuping Wu, Lifeng Han, Valerio Antonini, Goran Nenadic
arXiv_AI
arXiv_AI
Transformer
Recognition
Bert
Medical
Language_Model
PDF
2022-10-23
A BERT-based Deep Learning Approach for Reputation Analysis in Social Media
Mohammad Wali Ur Rahman, Sicong Shao, Pratik Satam, Salim Hariri, Chris Padilla, Zoe Taylor, Carlos Nevarez
arXiv_CL
arXiv_CL
Transformer
Bert
Pose
Face
Action
Deep_Learning
Language_Model
PDF
2022-10-22
Meta-learning Pathologies from Radiology Reports using Variance Aware Prototypical Networks
Arijit Sehanobish, Kawshik Kannan, Nabila Abraham, Anasuya Das, Benjamin Odry
arXiv_CL
arXiv_CL
Transformer
Bert
Text_Classification
Regularization
Pose
Classification
Few-Shot
Language_Model
PDF
2022-10-21
SpaBERT: A Pretrained Language Model from Geographic Data for Geo-Entity Representation
Zekun Li, Jina Kim, Yao-Yi Chiang, Muhao Chen
arXiv_AI
arXiv_AI
Embedding
Bert
Pose
Relation
Language_Model
Prediction
PDF
2022-10-21
Probing with Noise: Unpicking the Warp and Weft of Embeddings
Filip Klubička, John D. Kelleher
arXiv_AI
arXiv_AI
Embedding
Bert
Relation
PDF
2022-10-21
Discovering Differences in the Representation of People using Contextualized Semantic Axes
Li Lucy, Divya Tadimeti, David Bamman
arXiv_CL
arXiv_CL
Embedding
Bert
PDF
2022-10-21
Multimodal Model with Text and Drug Embeddings for Adverse Drug Reaction Classification
Andrey Sakhovskiy, Elena Tutubalina
arXiv_CL
arXiv_CL
Embedding
Bert
Action
Classification
Prediction
PDF
2022-10-21
LittleBird: Efficient Faster & Longer Transformer for Question Answering
Minchul Lee (1), Kijong Han (1), Myeong Cheol Shin (1) ((1) Kakao Enterprise Corp.)
arXiv_AI
arXiv_AI
Transformer
Bert
Pose
Attention
Language_Model
PDF
2022-10-21
A Textless Metric for Speech-to-Speech Comparison
Laurent Besacier, Swen Ribeiro, Olivier Galibert, Ioan Calapodescu
arXiv_CL
arXiv_CL
Bert
Speech
Pose
PDF
2022-10-21
Evidence of Vocal Tract Articulation in Self-Supervised Learning of Speech
Cheol Jun Cho, Peter Wu, Abdelrahman Mohamed, Gopala K. Anumanchipalli
arXiv_AI
arXiv_AI
Transformer
Bert
Speech
Self-Supervised
Pose
Relation
Attention
PDF
2022-10-21
SLING: Sino Linguistic Evaluation of Large Language Models
Yixiao Song, Kalpesh Krishna, Rajesh Bhatt, Mohit Iyyer
arXiv_CL
arXiv_CL
Bert
Knowledge
Language_Model
PDF
2022-10-20
Tele-Knowledge Pre-training for Fault Analysis
Zhuo Chen, Wen Zhang, Yufeng Huang, Mingyang Chen, Yuxia Geng, Hongtao Yu, Zhen Bi, Yichi Zhang, Zhen Yao, Wenting Song, Xinliang Wu, Yi Yang, Song Jiang, Zhaoyang Lian, Yingying Li, Huajun Chen
arXiv_AI
arXiv_AI
Transformer
Bert
Knowledge
Pose
GAN
Prediction
PDF
2022-10-20
Automatic Document Selection for Efficient Encoder Pretraining
Yukun Feng, Patrick Xia, Benjamin Van Durme, João Sedoc
arXiv_CL
arXiv_CL
Bert
Pose
Language_Model
PDF
2022-10-19
BioGPT: Generative Pre-trained Transformer for Biomedical Text Generation and Mining
Renqian Luo, Liai Sun, Yingce Xia, Tao Qin, Sheng Zhang, Hoifung Poon, Tie-Yan Liu
arXiv_AI
arXiv_AI
Transformer
Bert
Pose
Action
Relation
Relation_Extraction
Attention
Text_Generation
Medical
Language_Model
QA
PDF
2022-10-19
A Unified Neural Network Model for Readability Assessment with Feature Projection and Length-Balanced Loss
Wenbiao Li, Ziyang Wang, Yunfang Wu
arXiv_CL
arXiv_CL
Bert
Knowledge
Pose
Deep_Learning
PDF
2022-10-19
Forging Multiple Training Objectives for Pre-trained Language Models via Meta-Learning
Hongqiu Wu, Ruixue Ding, Hai Zhao, Boli Chen, Pengjun Xie, Fei Huang, Min Zhang
arXiv_CL
arXiv_CL
Transformer
Bert
Pose
Language_Model
PDF
2022-10-19
Language Model Decomposition: Quantifying the Dependency and Correlation of Language Models
Hao Zhang
arXiv_AI
arXiv_AI
Bert
Pose
Relation
Language_Model
PDF
2022-10-18
ELASTIC: Numerical Reasoning with Adaptive Symbolic Compiler
Jiaxin Zhang, Yashar Moshfeghi
arXiv_AI
arXiv_AI
Bert
QA
PDF
2022-10-18
A Simple and Effective Method to Improve Zero-Shot Cross-Lingual Transfer Learning
Kunbo Ding, Weijie Liu, Yuejian Fang, Weiquan Mao, Zhe Zhao, Tao Zhu, Haoyan Liu, Rong Tian, Yiren Chen
arXiv_CL
arXiv_CL
Embedding
Transfer_Learning
Bert
Zero-Shot
Text_Classification
Pose
Classification
Attention
PDF
2022-10-18
Probing Cross-modal Semantics Alignment Capability from the Textual Perspective
Zheng Ma, Shi Zong, Mianzhi Pan, Jianbing Zhang, Shujian Huang, Xinyu Dai, Jiajun Chen
arXiv_CL
arXiv_CL
Image_Caption
Transformer
Bert
Pose
Attention
Caption
PDF
2022-10-17
Using Bottleneck Adapters to Identify Cancer in Clinical Notes under Low-Resource Constraints
Omid Rohanian, Hannah Jauncey, Mohammadmahdi Nouriborji, Bronner P. Gonçalves, Christiana Kartsonaki, ISARIC Clinical Characterisation Group, Laura Merson, David Clifton
arXiv_AI
arXiv_AI
Transformer
Bert
RNN
Medical
PDF
2022-10-17
Fine-tuned Sentiment Analysis of COVID-19 Vaccine-Related Social Media Data: Comparative Study
Chad A Melton, Brianna M White, Robert L Davis, Robert A Bednarczyk, Arash Shaban-Nejad
arXiv_CL
arXiv_CL
Bert
Pose
Face
Sentiment
PDF
2022-10-17
Zero-Shot Ranking Socio-Political Texts with Transformer Language Models to Reduce Close Reading Time
Kiymet Akdemir, Ali Hürriyetoğlu
arXiv_CL
arXiv_CL
Transformer
Bert
Zero-Shot
Action
Classification
Language_Model
PDF
2022-10-16
Acoustic-aware Non-autoregressive Spell Correction with Mask Sample Decoding
Ruchao Fan, Guoli Ye, Yashesh Gaur, Jinyu Li
arXiv_SD
arXiv_SD
Transformer
Recognition
Bert
Speech
Pose
Speech_Recognition
Language_Model
PDF
2022-10-16
CTCBERT: Advancing Hidden-unit BERT with CTC Objectives
Ruchao Fan, Yiming Wang, Yashesh Gaur, Jinyu Li
arXiv_SD
arXiv_SD
Bert
Speech
Classification
PDF
2022-10-16
Improving Semantic Matching through Dependency-Enhanced Pre-trained Model with Adaptive Fusion
Jian Song, Di Liang, Rumei Li, Yuntao Li, Sirui Wang, Minlong Peng, Wei Wu, Yongxin Yu
arXiv_AI
arXiv_AI
Transformer
Bert
Knowledge
Pose
Relation
Attention
Matching
PDF
2022-10-15
A Simple and Strong Baseline for End-to-End Neural RST-style Discourse Parsing
Naoki Kobayashi, Tsutomu Hirao, Hidetaka Kamigaito, Manabu Okumura, Masaaki Nagata
arXiv_CL
arXiv_CL
Transformer
Bert
Language_Model
Prediction
PDF
2022-10-15
AraLegal-BERT: A pretrained language model for Arabic Legal text
Muhammad AL-Qurishi, Sarah AlQaseemi, Riad Soussi
arXiv_CL
arXiv_CL
Transformer
Bert
Language_Model
PDF
2022-10-14
PseudoReasoner: Leveraging Pseudo Labels for Commonsense Knowledge Base Population
Tianqing Fang, Quyet V. Do, Hongming Zhang, Yangqiu Song, Ginny Y. Wong, Simon See
arXiv_AI
arXiv_AI
Bert
Knowledge
Pose
Prediction
PDF
2022-10-14
BERTScore is Unfair: On Social Bias in Language Model-Based Metrics for Text Generation
Tianxiang Sun, Junliang He, Xipeng Qiu, Xuanjing Huang
arXiv_AI
arXiv_AI
Bert
Text_Generation
Language_Model
Matching
PDF
2022-10-14
TSP-Bot: Robotic TSP Pen Art using High-DoF Manipulators
Daeun Song, Eunjung Lim, Jiyoon Park, Minjung Jung, Young J. Kim
arXiv_RO
arXiv_RO
Bert
Optimization
PDF
2022-10-14
DyLoRA: Parameter Efficient Tuning of Pre-trained Models using Dynamic Search-Free Low-Rank Adaptation
Mojtaba Valipour, Mehdi Rezagholizadeh, Ivan Kobyzev, Ali Ghodsi
arXiv_CL
arXiv_CL
Bert
PDF
2022-10-14
Kernel-Whitening: Overcome Dataset Bias with Isotropic Sentence Embedding
Songyang Gao, Shihan Dou, Qi Zhang, Xuanjing Huang
arXiv_CL
arXiv_CL
Embedding
Bert
Pose
Relation
Attention
PDF
2022-10-14
Self-Adaptive Named Entity Recognition by Retrieving Unstructured Knowledge
Kosuke Nishida, Naoki Yoshinaga, Kyosuke Nishida
arXiv_CL
arXiv_CL
Recognition
Bert
Knowledge
Pose
Prediction
PDF
2022-10-13
HuBERT-TR: Reviving Turkish Automatic Speech Recognition with Self-supervised Speech Representation Learning
Ali Safaya, Engin Erzin
arXiv_CL
arXiv_CL
Transformer
Recognition
Bert
Represenation_Learning
Speech
Self-Supervised
Speech_Recognition
PDF
2022-10-13
SQuAT: Sharpness- and Quantization-Aware Training for BERT
Zheng Wang, Juncheng B Li, Shuhui Qu, Florian Metze, Emma Strubell
arXiv_CL
arXiv_CL
Transformer
Quantization
Bert
Pose
Deep_Learning
Inference
PDF
2022-10-13
Tone prediction and orthographic conversion for Basaa
Ilya Nikitin, Brian O'Connor, Anastasia Safonova
arXiv_CL
arXiv_CL
Bert
Prediction
PDF
2022-10-13
Multilingual Zero Resource Speech Recognition Base on Self-Supervise Pre-Trained Acoustic Models
Haoyu Wang, Wei-Qiang Zhang, Hongbin Suo, Yulong Wan
arXiv_CL
arXiv_CL
Recognition
Bert
Speech
Speech_Recognition
Language_Model
PDF
2022-10-13
Overlooked Video Classification in Weakly Supervised Video Anomaly Detection
Weijun Tan, Qi Yao, Jingfeng Liu
arXiv_CV
arXiv_CV
Bert
Weakly_Supervised
RNN
Classification
Detection
Video_Classification
PDF
2022-10-12
RankT5: Fine-Tuning T5 for Text Ranking with Ranking Losses
Honglei Zhuang, Zhen Qin, Rolf Jagerman, Kai Hui, Ji Ma, Jing Lu, Jianmo Ni, Xuanhui Wang, Michael Bendersky
arXiv_CL
arXiv_CL
Bert
Zero-Shot
Pose
Classification
Language_Model
PDF
2022-10-12
Developing a general-purpose clinical language inference model from a large corpus of clinical notes
Madhumita Sushil, Dana Ludwig, Atul J. Butte, Vivek A. Rudrapatna
arXiv_CL
arXiv_CL
Transformer
Recognition
Bert
Pose
Action
Relation
Relation_Extraction
Medical
Inference
Language_Model
PDF
2022-10-12
MotionBERT: Unified Pretraining for Human Motion Analysis
Wentao Zhu, Xiaoxuan Ma, Zhaoyang Liu, Libin Liu, Wayne Wu, Yizhou Wang
arXiv_CV
arXiv_CV
Transformer
Recognition
3D
Bert
Pose_Estimation
Knowledge
Pose
Action_Recognition
Action
Relation
PDF
2022-10-12
MiniALBERT: Model Distillation via Parameter-Efficient Recursive Transformers
Mohammadmahdi Nouriborji, Omid Rohanian, Samaneh Kouchaki, David A. Clifton
arXiv_CL
arXiv_CL
Transformer
Bert
Knowledge
Pose
Medical
Language_Model
PDF
2022-10-12
Foundation Transformers
Hongyu Wang, Shuming Ma, Shaohan Huang, Li Dong, Wenhui Wang, Zhiliang Peng, Yu Wu, Payal Bajaj, Saksham Singhal, Alon Benhaim, Barun Patra, Zhun Liu, Vishrav Chaudhary, Xia Song, Furu Wei
arXiv_CV
arXiv_CV
Transformer
Recognition
Bert
Speech
Pose
Speech_Recognition
Language_Model
PDF
2022-10-12
On Text Style Transfer via Style Masked Language Models
Sharan Narasimhan, Pooja Shekar, Suvodip Dey, Maunendra Sankar Desarkar
arXiv_CL
arXiv_CL
Reconstruction
Style_Transfer
Bert
Pose
Attention
Language_Model
PDF
2022-10-12
GMP*: Well-Tuned Global Magnitude Pruning Can Outperform Most BERT-Pruning Methods
Eldar Kurtic, Dan Alistarh
arXiv_CL
arXiv_CL
Bert
Language_Model
PDF
2022-10-12
Probing Commonsense Knowledge in Pre-trained Language Models with Sense-level Precision and Expanded Vocabulary
Daniel Loureiro, Alípio Mário Jorge
arXiv_AI
arXiv_AI
Transformer
Bert
Knowledge
Pose
Ontology
Relation
Language_Model
Prediction
PDF
2022-10-12
SQuId: Measuring Speech Naturalness in Many Languages
Thibault Sellam, Ankur Bapna, Joshua Camp, Diana Mackinnon, Ankur P. Parikh, Jason Riesa
arXiv_CL
arXiv_CL
Transformer
Bert
Zero-Shot
Speech
Prediction
PDF
2022-10-11
CLIP also Understands Text: Prompting CLIP for Phrase Understanding
An Yan, Jiacheng Li, Wanrong Zhu, Yujie Lu, William Yang Wang, Julian McAuley
arXiv_CL
arXiv_CL
Transformer
Transfer_Learning
Bert
Zero-Shot
Language_Model
PDF
2022-10-11
Transfer Learning with Joint Fine-Tuning for Multimodal Sentiment Analysis
Guilherme Lourenço de Toledo, Ricardo Marcondes Marcacini
arXiv_CV
arXiv_CV
Transformer
Transfer_Learning
Bert
Sentiment_Classification
Classification
Sentiment
PDF
2022-10-11
CLIP-Fields: Weakly Supervised Semantic Fields for Robotic Memory
Nur Muhammad Mahi Shafiullah, Chris Paxton, Lerrel Pinto, Soumith Chintala, Arthur Szlam
arXiv_CV
arXiv_CV
Segmentation
Embedding
Semantic_Segmentation
3D
Bert
Weakly_Supervised
Pose
Action
Few-Shot
PDF
2022-10-11
Multilingual BERT has an accent: Evaluating English influences on fluency in multilingual models
Isabel Papadimitriou, Kezia Lopez, Dan Jurafsky
arXiv_CL
arXiv_CL
Bert
Language_Model
PDF
2022-10-11
Better Than Whitespace: Information Retrieval for Languages without Custom Tokenizers
Odunayo Ogundepo, Xinyu Zhang, Jimmy Lin
arXiv_CL
arXiv_CL
Unsupervised
Bert
Knowledge
Pose
Matching
PDF
2022-10-11
Are Pretrained Multilingual Models Equally Fair Across Languages?
Laura Cabello Piqueras, Anders Søgaard
arXiv_CL
arXiv_CL
Bert
Language_Model
PDF
2022-10-11
COVID-19-related Nepali Tweets Classification in a Low Resource Setting
Rabin Adhikari, Safal Thapaliya, Nirajan Basnet, Samip Poudel, Aman Shakya, Bishesh Khanal
arXiv_CL
arXiv_CL
Bert
Classification
GAN
Language_Model
PDF
2022-10-11
Code Librarian: A Software Package Recommendation System
Lili Tao, Alexandru-Petre Cazan, Senad Ibraimoski, Sean Moran
arXiv_AI
arXiv_AI
Bert
Recommendation
PDF
2022-10-11
On the Use of Semantically-Aligned Speech Representations for Spoken Language Understanding
Gaëlle Laperrière, Valentin Pelloin, Mickaël Rouvier, Themos Stafylakis, Yannick Estève
arXiv_CL
arXiv_CL
Embedding
Bert
Represenation_Learning
Speech
PDF
2022-10-11
Revisiting and Advancing Chinese Natural Language Understanding with Accelerated Heterogeneous Knowledge Pre-training
Taolin Zhang, Junwei DOng, Jianing Wang, Chengyu Wang, Ang Wang, Yinghui Liu, Jun Huang, Yong Li, Xiaofeng He
arXiv_CL
arXiv_CL
Transformer
Bert
Knowledge
Knowledge_Graph
Relation
Language_Model
PDF
2022-10-11
A Win-win Deal: Towards Sparse and Robust Pre-trained Language Models
Yuanxin Liu, Fandong Meng, Zheng Lin, Jiangnan Li, Peng Fu, Yanan Cao, Weiping Wang, Jie Zhou
arXiv_CL
arXiv_CL
Bert
Sparse
Face
Language_Model
PDF
2022-10-11
HUE: Pretrained Model and Dataset for Understanding Hanja Documents of Ancient Korea
Haneul Yoo, Jiho Jin, Juhee Son, JinYeong Bak, Kyunghyun Cho, Alice Oh
arXiv_CL
arXiv_CL
Recognition
Bert
Zero-Shot
Classification
Language_Model
PDF
2022-10-10
Multi-CLS BERT: An Efficient Alternative to Traditional Ensembling
Haw-Shiuan Chang, Ruei-Yao Sun, Kathryn Ricci, Andrew McCallum
arXiv_CL
arXiv_CL
Embedding
Bert
Pose
Prediction
PDF
2022-10-10
Transformer-based Localization from Embodied Dialog with Large-scale Pre-training
Meera Hahn, James M. Rehg
arXiv_AI
arXiv_AI
Transformer
Bert
PDF
2022-10-10
Empowering the Fact-checkers! Automatic Identification of Claim Spans on Twitter
Megha Sundriyal, Atharva Kulkarni, Vaibhav Pulastya, Md Shad Akhtar, Tanmoy Chakraborty
arXiv_CL
arXiv_CL
Bert
Pose
Classification
Medical
PDF
2022-10-10
Do Children Texts Hold The Key To Commonsense Knowledge?
Julien Romero, Simon Razniewski
arXiv_AI
arXiv_AI
Bert
Knowledge
Action
PDF
2022-10-10
Multi-Modal Fusion Transformer for Visual Question Answering in Remote Sensing
Tim Siebert, Kai Norman Clasen, Mahdyar Ravanbakhsh, Begüm Demir
arXiv_AI
arXiv_AI
Transformer
Bert
Represenation_Learning
Pose
Action
Classification
Relation
VQA
QA
PDF
2022-10-10
DEPTWEET: A Typology for Social Media Texts to Detect Depression Severities
Mohsinul Kabir, Tasnim Ahmed, Md. Bakhtiar Hasan, Md Tahmid Rahman Laskar, Tarun Kumar Joarder, Hasan Mahmud, Kamrul Hasan
arXiv_CL
arXiv_CL
Bert
Attention
PDF
2022-10-10
Parameter-Efficient Tuning with Special Token Adaptation
Xiaoocong Yang, James Y. Huang, Wenxuan Zhou, Muhao Chen
arXiv_AI
arXiv_AI
Transformer
Bert
Text_Classification
Classification
Attention
Language_Model
PDF
2022-10-09
FairGer: Using NLP to Measure Support for Women and Migrants in 155 Years of German Parliamentary Debates
Dominik Beese, Ole Pütz, Steffen Eger
arXiv_CL
arXiv_CL
Bert
PDF
2022-10-09
QAScore -- An Unsupervised Unreferenced Metric for the Question Generation Evaluation
Tianbo Ji, Chenyang Lyu, Gareth Jones, Liting Zhou, Yvette Graham
arXiv_CL
arXiv_CL
Unsupervised
Bert
Pose
Relation
Language_Model
QA
PDF
2022-10-09
Pruning Adversarially Robust Neural Networks without Adversarial Examples
Tong Jian, Zifeng Wang, Yanzhi Wang, Jennifer Dy, Stratis Ioannidis
arXiv_AI
arXiv_AI
Bert
Knowledge
Adversarial
Pose
PDF
2022-10-09
Spread Love Not Hate: Undermining the Importance of Hateful Pre-training for Hate Speech Detection
Shantanu Patankar, Omkar Gokhale, Aditya Kane, Tanmay Chavan, Raviraj Joshi
arXiv_AI
arXiv_AI
Transformer
Bert
Speech
Classification
Detection
Language_Model
PDF
2022-10-09
Improve Transformer Pre-Training with Decoupled Directional Relative Position Encoding and Representation Differentiations
Haojie Zhang, Mingfei Liang, Ruobing Xie, Zhenlong Sun, Bo Zhang, Leyu Lin
arXiv_CL
arXiv_CL
Transformer
Bert
Optimization
Represenation_Learning
Pose
Attention
Language_Model
PDF
2022-10-08
On Task-Adaptive Pretraining for Dialogue Response Selection
Tzu-Hsiang Lin, Ta-Chung Chi, Anna Rumshisky
arXiv_CL
arXiv_CL
Transformer
Bert
Pose
PDF
2022-10-08
CoBERT: Self-Supervised Speech Representation Learning Through Code Representation Learning
Chutong Meng, Junyi Ao, Tom Ko, Mingxuan Wang, Haizhou Li
arXiv_SD
arXiv_SD
Bert
Represenation_Learning
Speech
Self-Supervised
Pose
Face
PDF
2022-10-08
InfoCSE: Information-aggregated Contrastive Learning of Sentence Embeddings
Xing Wu, Chaochen Gao, Zijia Lin, Jizhong Han, Zhongyuan Wang, Songlin Hu
arXiv_CL
arXiv_CL
Embedding
Unsupervised
Bert
Represenation_Learning
Pose
Contrastive_Learning
Relation
Language_Model
PDF
2022-10-08
KG-MTT-BERT: Knowledge Graph Enhanced BERT for Multi-Type Medical Text Classification
Yong He, Cheng Wang, Shun Zhang, Nan Li, Zhaorong Li, Zhenyu Zeng
arXiv_AI
arXiv_AI
Bert
Text_Classification
Knowledge
Knowledge_Graph
Pose
Classification
Deep_Learning
Medical
PDF
2022-10-07
Breaking BERT: Evaluating and Optimizing Sparsified Attention
Siddhartha Brahma, Polina Zablotskaia, David Mimno
arXiv_CL
arXiv_CL
Transformer
Bert
Sparse
Attention
PDF
2022-10-07
Hate Speech and Offensive Language Detection in Bengali
Mithun Das, Somnath Banerjee, Punyajoy Saha, Animesh Mukherjee
arXiv_CL
arXiv_CL
Bert
Speech
Action
Classification
Detection
Few-Shot
PDF
2022-10-07
DABERT: Dual Attention Enhanced BERT for Semantic Matching
Sirui Wang, Di Liang, Jian Song, Yuntao Li, Wei Wu
arXiv_CL
arXiv_CL
Transformer
Bert
Pose
Attention
Language_Model
Prediction
Matching
PDF
2022-10-07
Generating Quizzes to Support Training on Quality Management and Assurance in Space Science and Engineering
Andrés García-Silva, Cristian Berrío, José Manuel Gómez-Pérez
arXiv_AI
arXiv_AI
Bert
PDF
2022-10-06
HealthE: Classifying Entities in Online Textual Health Advice
Joseph Gatto, Parker Seegmiller, Garrett Johnston, Sarah M. Preum
arXiv_CL
arXiv_CL
Bert
Classification
Medical
PDF
2022-10-06
Explainable Verbal Deception Detection using Transformers
Loukas Ilias, Felix Soldner, Bennett Kleinberg
arXiv_CL
arXiv_CL
Transformer
Bert
Review
Pose
Deep_Learning
Detection
Relation
Attention
Prediction
PDF
2022-10-06
Conversational Semantic Role Labeling with Predicate-Oriented Latent Graph
Hao Fei, Shengqiong Wu, Meishan Zhang, Yafeng Ren, Donghong Ji
arXiv_AI
arXiv_AI
Bert
Pose
Detection
Attention
Language_Model
PDF
2022-10-06
Matching Text and Audio Embeddings: Exploring Transfer-learning Strategies for Language-based Audio Retrieval
Benno Weck, Miguel Pérez Fernández, Holger Kirchhoff, Xavier Serra
arXiv_CL
arXiv_CL
Embedding
Bert
Deep_Learning
Matching
PDF
2022-10-06
Join-Chain Network: A Logical Reasoning View of the Multi-head Attention in Transformer
Jianyi Zhang, Yiran Chen, Jianshu Chen
arXiv_CL
arXiv_CL
Transformer
Bert
Pose
Attention
PDF
2022-10-05
Privacy-Preserving Text Classification on BERT Embeddings with Homomorphic Encryption
Garam Lee, Minsoo Kim, Jai Hyun Park, Seung-won Hwang, Jung Hee Cheon
arXiv_CL
arXiv_CL
Embedding
Bert
Text_Classification
Pose
Classification
PDF
2022-10-05
Revisiting Structured Dropout
Yiren Zhao, Oluwatomisin Dada, Xitong Gao, Robert D Mullins
arXiv_AI
arXiv_AI
Bert
Regularization
Pose
Inference
PDF
2022-10-05
Token Classification for Disambiguating Medical Abbreviations
Mucahit Cevik, Sanaz Mohammad Jafari, Mitchell Myers, Savas Yildirim
arXiv_AI
arXiv_AI
Transformer
Bert
Text_Classification
Pose
Classification
Medical
Prediction
PDF
2022-10-03
Characterization of effects of transfer learning across domains and languages
Sovesh Mohapatra
arXiv_CL
arXiv_CL
Transfer_Learning
Bert
Language_Model
PDF
2022-10-03
Hypothesis Engineering for Zero-Shot Hate Speech Detection
Janis Goldzycher, Gerold Schneider
arXiv_CL
arXiv_CL
Bert
Zero-Shot
Text_Classification
Speech
Pose
Classification
Detection
Inference
Prediction
PDF
2022-10-03
SpeechCLIP: Integrating Speech with Pre-Trained Vision and Language Model
Yi-Jen Shih, Hsuan-Fu Wang, Heng-Jui Chang, Layne Berry, Hung-yi Lee, David Harwath
arXiv_CL
arXiv_CL
Bert
Zero-Shot
Speech
Pose
Caption
Language_Model
PDF
2022-10-03
Probing of Quantitative Values in Abstractive Summarization Models
Nathan M. White
arXiv_CL
arXiv_CL
Embedding
Bert
Pose
Quantitative
Summarization
PDF
2022-10-01
Construction and Evaluation of a Self-Attention Model for Semantic Understanding of Sentence-Final Particles
Shuhei Mandokoro, Natsuki Oka, Akane Matsushima, Chie Fukada, Yuko Yoshimura, Koji Kawahara, Kazuaki Tanaka
arXiv_CL
arXiv_CL
Bert
Pose
Relation
Attention
PDF
2022-09-29
Stop Wasting My Time! Saving Days of ImageNet and BERT Training with Latest Weight Averaging
Jean Kaddour
arXiv_AI
arXiv_AI
Bert
Language_Model
PDF
2022-09-29
polyBERT: A chemical language model to enable fully machine-driven ultrafast polymer informatics
Christopher Kuenneth, Rampi Ramprasad
arXiv_AI
arXiv_AI
Bert
Language_Model
Prediction
PDF
2022-09-29
Prompt-guided Scene Generation for 3D Zero-Shot Learning
Majid Nasiri, Ali Cheraghian, Townim Faisal Chowdhury, Sahar Ahmadi, Morteza Saberi, Shafin Rahman
arXiv_CV
arXiv_CV
Point_Cloud
3D
Bert
Zero-Shot
Scene_Generation
Pose
Contrastive_Learning
Action
Caption
Language_Model
PDF
2022-09-29
Neural Media Bias Detection Using Distant Supervision With BABE -- Bias Annotations By Experts
Timo Spinde, Manuel Plank, Jan-David Krieger, Terry Ruas, Bela Gipp, Akiko Aizawa
arXiv_CL
arXiv_CL
Bert
Pose
Detection
PDF
2022-09-28
Downstream Datasets Make Surprisingly Good Pretraining Corpora
Kundan Krishna, Saurabh Garg, Jeffrey P. Bigham, Zachary C. Lipton
arXiv_CL
arXiv_CL
Transformer
Bert
PDF
2022-09-28
Supervised Contrastive Learning as Multi-Objective Optimization for Fine-Tuning Large Pre-trained Language Models
Youness Moukafih, Mounir Ghogho, Kamel Smaili
arXiv_CL
arXiv_CL
Embedding
Bert
Optimization
Adversarial
Pose
Contrastive_Learning
Classification
Language_Model
PDF
2022-09-28
Human-in-the-loop Robotic Grasping using BERT Scene Representation
Yaoxian Song, Penglei Sun, Pengfei Fang, Linyi Yang, Yanghua Xiao, Yue Zhang
arXiv_RO
arXiv_RO
Bert
Pose
Face
PDF
2022-09-28
Keyword Extraction from Short Texts with~a~Text-To-Text Transfer Transformer
Piotr Pęzik, Agnieszka Mikołajczyk-Bareła, Adam Wawrzyński, Bartłomiej Nitoń, Maciej Ogrodniczuk
arXiv_CL
arXiv_CL
Transformer
Bert
Sparse
Action
Language_Model
PDF
2022-09-28
CEFER: A Four Facets Framework based on Context and Emotion embedded features for Implicit and Explicit Emotion Recognition
Fereshteh Khoshnam, Ahmad Baraani-Dastjerdi, M.J. Liaghatdar
arXiv_CL
arXiv_CL
Recognition
Bert
Knowledge
Pose
Emotion
Face
Action
Attention
PDF
2022-09-28
An Efficient Multitask Learning Architecture for Affective Vocal Burst Analysis
Tobias Hallmen, Silvan Mertes, Dominik Schiller, Elisabeth André
arXiv_SD
arXiv_SD
Bert
Speech
PDF
2022-09-28
YATO: Yet Another deep learning based Text analysis Open toolkit
Zeqiang Wang, Yile Wang, Jiageng Wu, Zhiyang Teng, Jie Yang
arXiv_CL
arXiv_CL
Bert
RNN
Classification
Deep_Learning
Language_Model
PDF
2022-09-28
Deep Learning based Automatic Quantification of Urethral Plate Quality using the Plate Objective Scoring Tool
Tariq O. Abbas, Mohamed AbdelMoniem, Ibrahim Khalil, Md Sakib Abrar Hossain, Muhammad E. H. Chowdhury
arXiv_AI
arXiv_AI
Bert
Pose
Deep_Learning
Detection
CNN
Prediction
PDF
2022-09-27
An Effective, Performant Named Entity Recognition System for Noisy Business Telephone Conversation Transcripts
Xue-Yong Fu, Cheng Chen, Md Tahmid Rahman Laskar, Shashi Bhushan TN, Simon Corston-Oliver
arXiv_CL
arXiv_CL
Recognition
Bert
Speech
Speech_Recognition
PDF
2022-09-27
Embarrassingly Easy Document-Level MT Metrics: How to Convert Any Pretrained Metric Into a Document-Level Metric
Giorgos Vernikos, Brian Thompson, Prashant Mathur, Marcello Federico
arXiv_CL
arXiv_CL
Bert
PDF
2022-09-27
A general-purpose material property data extraction pipeline from large polymer corpora using Natural Language Processing
Pranav Shetty, Arunkumar Chitteth Rajan, Christopher Kuenneth, Sonkakshi Gupta, Lakshmi Prerana Panchumarti, Lauren Holm, Chao Zhang, Rampi Ramprasad
arXiv_CL
arXiv_CL
Recognition
Bert
Pose
Action
Relation
Language_Model
PDF
2022-09-27
Improving Radiology Report Generation Systems by Removing Hallucinated References to Non-existent Priors
Vignav Ramesh, Nathan Andrew Chi, Pranav Rajpurkar
arXiv_AI
arXiv_AI
Bert
Pose
Action
Classification
Deep_Learning
Few-Shot
Medical
PDF
2022-09-27
Extractive Question Answering on Queries in Hindi and Tamil
Adhitya Thirumala, Elisa Ferracane
arXiv_CL
arXiv_CL
Bert
Pose
Classification
QA
PDF
2022-09-26
Towards Simple and Efficient Task-Adaptive Pre-training for Text Classification
Arnav Ladkat, Aamir Miyajiwala, Samiksha Jagadale, Rekha Kulkarni, Raviraj Joshi
arXiv_CL
arXiv_CL
Transformer
Embedding
Bert
Text_Classification
Pose
Classification
Language_Model
PDF
2022-09-26
Out-of-Distribution Detection with Hilbert-Schmidt Independence Optimization
Jingyang Lin, Yu Wang, Qi Cai, Yingwei Pan, Ting Yao, Hongyang Chao, Tao Mei
arXiv_CV
arXiv_CV
Bert
Optimization
Pose
Detection
Inference
PDF
2022-09-26
Do ever larger octopi still amplify reporting biases? Evidence from judgments of typical colour
Fangyu Liu, Julian Martin Eisenschlos, Jeremy R. Cole, Nigel Collier
arXiv_AI
arXiv_AI
Bert
Face
Language_Model
PDF
2022-09-26
The Ability of Self-Supervised Speech Models for Audio Representations
Tung-Yu Wu, Chen-An Li, Tzu-Han Lin, Tsu-Yuan Hsu, Hung-Yi Lee
arXiv_AI
arXiv_AI
Embedding
Bert
Represenation_Learning
Speech
Self-Supervised
Pose
PDF
2022-09-26
Taking a Respite from Representation Learning for Molecular Property Prediction
Jianyuan Deng, Zhibo Yang, Hehe Wang, Iwao Ojima, Dimitris Samaras, Fusheng Wang
arXiv_AI
arXiv_AI
Bert
Represenation_Learning
Self-Supervised
Activity
Prediction
PDF
2022-09-24
Can Transformer Models Effectively Detect Software Aspects in StackOverflow Discussion?
Nibir Chandra Mandal, Tashreef Muhammad, G. M. Shahariar
arXiv_CL
arXiv_CL
Transformer
Bert
Sentiment
PDF
2022-09-24
Dead or Murdered? Predicting Responsibility Perception in Femicide News Reports
Gosse Minnema, Sara Gemelli, Chiara Zanchi, Tommaso Caselli, Malvina Nissim
arXiv_CL
arXiv_CL
Bert
Salient
Survey
PDF
2022-09-24
Learning Chess With Language Models and Transformers
Michael DeLeo, Erhan Guven
arXiv_AI
arXiv_AI
Transformer
Unsupervised
Bert
Few-Shot
Language_Model
PDF
2022-09-23
Promptagator: Few-shot Dense Retrieval From 8 Examples
Zhuyun Dai, Vincent Y. Zhao, Ji Ma, Yi Luan, Jianmo Ni, Jing Lu, Anton Bakalov, Kelvin Guu, Keith B. Hall, Ming-Wei Chang
arXiv_CL
arXiv_CL
Bert
Knowledge
Pose
Few-Shot
Language_Model
PDF
2022-09-23
Variational Open-Domain Question Answering
Valentin Liévin, Andreas Geert Motzfeldt, Ida Riis Jensen, Ole Winther
arXiv_CL
arXiv_CL
Bert
Optimization
Knowledge
Medical
Language_Model
QA
PDF
2022-09-23
IDEA: Interactive DoublE Attentions from Label Embedding for Text Classification
Ziyuan Wang, Hailiang Huang, Songqiao Han
arXiv_AI
arXiv_AI
Embedding
Bert
Text_Classification
Pose
Classification
Attention
Matching
PDF
2022-09-23
Extending Word-Level Quality Estimation for Post-Editing Assistance
Yizhen Wei, Takehito Utsuro, Masaaki Nagata
arXiv_CL
arXiv_CL
Bert
Pose
PDF
2022-09-22
Scope of Pre-trained Language Models for Detecting Conflicting Health Information
Joseph Gatto, Madhusudan Basak, Sarah M. Preum
arXiv_CL
arXiv_CL
Bert
Pose
Detection
Language_Model
PDF
2022-09-22
MonoByte: A Pool of Monolingual Byte-level Language Models
Hugo Abonizio, Leandro Rodrigues de Souza, Roberto Lotufo, Rodrigo Nogueira
arXiv_CL
arXiv_CL
Embedding
Bert
Zero-Shot
Language_Model
QA
PDF
2022-09-22
Adaptation of domain-specific transformer models with text oversampling for sentiment analysis of social media posts on Covid-19 vaccines
Anmol Bansal, Arjun Choudhry, Anubhav Sharma, Seba Susan
arXiv_CL
arXiv_CL
Transformer
Bert
Classification
Sentiment
Language_Model
PDF
2022-09-22
AIR-JPMC@SMM4H'22: Classifying Self-Reported Intimate Partner Violence in Tweets with Multiple BERT-based Models
Alec Candidato, Akshat Gupta, Xiaomo Liu, Sameena Shah
arXiv_CL
arXiv_CL
Bert
Classification
PDF
2022-09-21
Assessing ASR Model Quality on Disordered Speech using BERTScore
Jimmy Tobin, Qisheng Li, Subhashini Venugopalan, Katie Seaver, Richard Cave, Katrin Tomanek
arXiv_CL
arXiv_CL
Recognition
Bert
Speech
Action
Speech_Recognition
Text_Generation
Prediction
PDF
2022-09-21
Representing Affect Information in Word Embeddings
Yuhan Zhang, Wenqi Chen, Ruihan Zhang, Xiajie Zhang
arXiv_CL
arXiv_CL
Transformer
Embedding
Bert
Salient
Knowledge
Emotion
Classification
Relation
Language_Model
PDF
2022-09-21
Subject Verb Agreement Error Patterns in Meaningless Sentences: Humans vs. BERT
Karim Lasri, Olga Seminck, Alessandro Lenci, Thierry Poibeau
arXiv_CL
arXiv_CL
Bert
Knowledge
Language_Model
PDF
2022-09-21
SMTCE: A Social Media Text Classification Evaluation Benchmark and BERTology Models for Vietnamese
Luan Thanh Nguyen, Kiet Van Nguyen, Ngan Luu-Thuy Nguyen
arXiv_CL
arXiv_CL
Bert
Text_Classification
Pose
Classification
PDF
2022-09-21
Bias at a Second Glance: A Deep Dive into Bias for German Educational Peer-Review Data Modeling
Thiemo Wambsganss, Vinitra Swamy, Roman Rietsche, Tanja Käser
arXiv_CL
arXiv_CL
Embedding
Bert
Review
Language_Model
PDF
2022-09-21
Extreme Multi-Domain, Multi-Task Learning With Unified Text-to-Text Transfer Transformers
Adebayo Oshingbesan, Courage Ekoh, Germann Atakpa, Yonah Byaruagaba
arXiv_CL
arXiv_CL
Transformer
Transfer_Learning
Bert
Knowledge
Relation
Summarization
PDF
2022-09-20
Can we do that simpler? Simple, Efficient, High-Quality Evaluation Metrics for NLG
Jens Grünwald, Christoph Leiter, Steffen Eger
arXiv_CL
arXiv_CL
Transformer
Bert
Inference
PDF
2022-09-20
Unsupervised Early Exit in DNNs with Multiple Exits
Hari Narayan N U, Manjesh K. Hanawal, Avinash Bhardwaj
arXiv_AI
arXiv_AI
Unsupervised
Bert
Face
Inference
Prediction
PDF
2022-09-20
One-to-Many Semantic Communication Systems: Design, Implementation, Performance Evaluation
Han Hu, Xingwu Zhu, Fuhui Zhou, Wei Wu, Rose Qingyang Hu, Hongbo Zhu
arXiv_CL
arXiv_CL
Transfer_Learning
Bert
Pose
PDF
2022-09-19
TimberTrek: Exploring and Curating Sparse Decision Trees with Interactive Visualization
Zijie J. Wang, Chudi Zhong, Rui Xin, Takuya Takagi, Zhi Chen, Duen Horng Chau, Cynthia Rudin, Margo Seltzer
arXiv_AI
arXiv_AI
Bert
Sparse
Knowledge
PDF
2022-09-19
ALEXSIS-PT: A New Resource for Portuguese Lexical Simplification
Kai North, Marcos Zampieri, Tharindu Ranasinghe
arXiv_AI
arXiv_AI
Bert
PDF
2022-09-19
Tree-based Text-Vision BERT for Video Search in Baidu Video Advertising
Tan Yu, Jie Liu, Yi Yang, Yi Li, Hongliang Fei, Ping Li
arXiv_CV
arXiv_CV
Transformer
Bert
Attention
Video_Retrieval
PDF
2022-09-17
From Disfluency Detection to Intent Detection and Slot Filling
Mai Hoang Dao, Thinh Hung Truong, Dat Quoc Nguyen
arXiv_CL
arXiv_CL
Bert
Detection
Language_Model
PDF
2022-09-17
Watch What You Pretrain For: Targeted, Transferable Adversarial Examples on Self-Supervised Speech Recognition models
Raphael Olivier, Bhiksha Raj
arXiv_CL
arXiv_CL
Transformer
Recognition
Bert
Knowledge
Adversarial
Speech
Self-Supervised
Pose
Speech_Recognition
PDF
2022-09-17
Detecting Generated Scientific Papers using an Ensemble of Transformer Models
Anna Glazkova, Maksim Glazkov
arXiv_AI
arXiv_AI
Transformer
Bert
Detection
PDF
2022-09-16
Changing the Representation: Examining Language Representation for Neural Sign Language Production
Harry Walsh, Ben Saunders, Richard Bowden
arXiv_AI
arXiv_AI
Embedding
Bert
Language_Model
PDF
2022-09-15
TwHIN-BERT: A Socially-Enriched Pre-trained Language Model for Multilingual Tweet Representations
Xinyang Zhang, Yury Malkov, Omar Florez, Serim Park, Brian McWilliams, Jiawei Han, Ahmed El-Kishky
arXiv_CL
arXiv_CL
Bert
Language_Model
Prediction
Recommendation
PDF
2022-09-15
Machine Reading, Fast and Slow: When Do Models 'Understand' Language?
Sagnik Ray Choudhury, Anna Rogers, Isabelle Augenstein
arXiv_CL
arXiv_CL
Bert
Salient
Pose
Deep_Learning
PDF
2022-09-15
Rethinking Round-trip Translation for Automatic Machine Translation Evaluation
Terry Yue Zhuo, Qiongkai Xu, Xuanli He, Trevor Cohn
arXiv_CL
arXiv_CL
Bert
Pose
PDF
2022-09-15
Linear Transformations for Cross-lingual Sentiment Analysis
Pavel Přibáň, Jakub Šmíd, Adam Mištera, Pavel Král
arXiv_CL
arXiv_CL
Embedding
Bert
Zero-Shot
RNN
Classification
Sentiment
PDF
2022-09-15
Learning to Exploit Elastic Actuators for Quadruped Locomotion
Antonin Raffin, Daniel Seidel, Jens Kober, Alin Albu-Schäffer, João Silvério, Freek Stulp
arXiv_RO
arXiv_RO
Reinforcement_Learning
Bert
Pose
Action
PDF
2022-09-15
Knowledge Graph Completion with Pre-trained Multimodal Transformer and Twins Negative Sampling
Yichi Zhang, Wen Zhang
arXiv_CL
arXiv_CL
Transformer
Embedding
Bert
Knowledge
Knowledge_Graph
Pose
Prediction
PDF
2022-09-15
uChecker: Masked Pretrained Language Models as Unsupervised Chinese Spelling Checkers
Piji Li
arXiv_CL
arXiv_CL
Unsupervised
Bert
Pose
Detection
Language_Model
PDF
2022-09-15
VIPHY: Probing 'Visible' Physical Commonsense Knowledge
Shikhar Singh, Ehsan Qasemi, Muhao Chen
arXiv_CL
arXiv_CL
Transformer
Bert
Knowledge
Caption
Language_Model
PDF
2022-09-14
On the State of the Art in Authorship Attribution and Authorship Verification
Jacob Tyo, Bhuwan Dhingra, Zachary C. Lipton
arXiv_AI
arXiv_AI
Bert
Survey
PDF
2022-09-14
LibertyMFD: A Lexicon to Assess the Moral Foundation of Liberty
Oscar Araque, Lorenzo Gatti, Kyriaki Kalimeri
arXiv_CL
arXiv_CL
Bert
Pose
PDF
2022-09-14
Automated Fidelity Assessment for Strategy Training in Inpatient Rehabilitation using Natural Language Processing
Hunter Osterhoudt, Courtney E. Schneider, Haneef A Mohammad, Minmei Shih, Alexandra E. Harper, Leming Zhou, Elizabeth R Skidmore, Yanshan Wang
arXiv_CL
arXiv_CL
Transformer
Bert
RNN
PDF
2022-09-14
Toward Improving Health Literacy in Patient Education Materials with Neural Machine Translation Models
David Oniani, Sreekanth Sreekumar, Renuk DeAlmeida, Dinuk DeAlmeida, Vivian Hui, Young Ji Lee, Yiye Zhang, Leming Zhou, Yanshan Wang
arXiv_CL
arXiv_CL
Transformer
Bert
RNN
Pose
NMT
Medical
PDF
2022-09-14
Pre-training for Information Retrieval: Are Hyperlinks Fully Explored?
Jiawen Wu, Xinyu Zhang, Yutao Zhu, Zheng Liu, Zikai Guo, Zhaoye Fei, Ruofei Lai, Yongkang Wu, Zhao Cao, Zhicheng Dou
arXiv_AI
arXiv_AI
Transformer
Bert
Pose
Relation
Language_Model