Transformer

2020-11-25 Neural Representations for Modeling Variation in English Speech Martijn Bartelds, Wietse de Vries, Faraz Sanal, Caitlin Richter, Mark Liberman, Martijn Wieling arXiv_CL arXiv_CL Transformer Embedding Speech Self-Supervised Action PDF
2020-11-25 Combining Semantic Guidance and Deep Reinforcement Learning For Generating Human Level Paintings Jaskirat Singh, Liang Zheng arXiv_CV arXiv_CV Transformer Reinforcement_Learning Salient Pose PDF
2020-11-24 Enhancing deep neural networks with morphological information Matej Klemen, Luka Krsnik, Marko Robnik-Šikonja arXiv_CL arXiv_CL Transformer Recognition Bert RNN Speech Deep_Learning Language_Model PDF
2020-11-24 SpinNet: Learning a General Surface Descriptor for 3D Point Cloud Registration Sheng Ao, Qingyong Hu, Bo Yang, Andrew Markham, Yulan Guo arXiv_AI arXiv_AI Transformer Reconstruction Point_Cloud 3D Optimization Face CNN Matching PDF
2020-11-24 Tackling Domain-Specific Winograd Schemas with Knowledge-Based Reasoning and Machine Learning Suk Joon Hong, Brandon Bennett arXiv_AI arXiv_AI Transformer Bert Knowledge Pose PDF
2020-11-23 Large Scale Multimodal Classification Using an Ensemble of Transformer Models and Co-Attention Varnith Chordia, Vijay Kumar BG arXiv_AI arXiv_AI Transformer Embedding Classification Relation VQA Attention QA Recommendation PDF
2020-11-21 Rethinking Transformer-based Set Prediction for Object Detection Zhiqing Sun, Shengcao Cao, Yiming Yang, Kris Kitani arXiv_CV arXiv_CV Transformer Optimization Pose Detection Object_Detection Attention Prediction PDF
2020-11-20 Self-Supervised learning with cross-modal transformers for emotion recognition Aparna Khare, Srinivas Parthasarathy, Shiva Sundaram arXiv_CL arXiv_CL Transformer Embedding Recognition Bert Speech Self-Supervised Emotion Language_Model PDF
2020-11-20 Fine-Tuning BERT for Sentiment Analysis of Vietnamese Reviews Quoc Thai Nguyen, Thoai Linh Nguyen, Ngoc Hoang Luong, Quoc Hung Ngo arXiv_CL arXiv_CL Transformer Bert Review Pose Classification Deep_Learning Sentiment PDF
2020-11-20 SophiaPop: Experiments in Human-AI Collaboration on Popular Music David Hanson, Frankie Storm, Wenwei Huang, Vytas Krisciunas, Tiger Darrow, Audrey Brown, Mengna Lei, Matthew Aylett, Adam Pickrell, Sophia the Robot arXiv_AI arXiv_AI Transformer Pose Relation PDF
2020-11-20 ConvTransformer: A Convolutional Transformer Network for Video Frame Synthesis Zhouyong Liu, Shun Luo, Wubin Li, Jingben Lu, Yufan Wu, Chunguo Li, Luxi Yang arXiv_CV arXiv_CV Transformer RNN Knowledge Pose Attention CNN PDF
2020-11-19 Sentiment Classification in Bangla Textual Content: A Comparative Study Md. Arid Hasan, Jannatul Tajrin, Shammur Absar Chowdhury, Firoj Alam arXiv_CL arXiv_CL Transformer Sentiment_Classification Classification Deep_Learning Sentiment PDF
2020-11-19 Persuasive Dialogue Understanding: the Baselines and Negative Results Hui Chen, Deepanway Ghosal, Navonil Majumder, Amir Hussain, Soujanya Poria arXiv_CL arXiv_CL Transformer Recognition Optimization RNN Speech Action Relation Attention CNN PDF
2020-11-19 Everybody Sign Now: Translating Spoken Language to Photo Realistic Sign Language Video Ben Saunders, Necati Cihan Camgoz, Richard Bowden arXiv_CV arXiv_CV Transformer Pose Quantitative GAN Inference PDF
2020-11-19 Attention-Based Transformers for Instance Segmentation of Cells in Microstructures Tim Prangemeier, Christoph Reich, Heinz Koeppl arXiv_CV arXiv_CV Transformer Segmentation Semantic_Segmentation Pose Quantitative Deep_Learning Detection Attention Medical PDF
2020-11-19 Universal MelGAN: A Robust Neural Vocoder for High-Fidelity Waveform Generation in Multiple Domains Won Jang, Dan Lim, Jaesam Yoon arXiv_CL arXiv_CL Transformer Speech Pose Emotion GAN Inference PDF
2020-11-18 Palomino-Ochoa at SemEval-2020 Task 9: Robust System based on Transformer for Code-Mixed Sentiment Classification Daniel Palomino, Jose Ochoa-Luna arXiv_CL arXiv_CL Transformer Transfer_Learning Bert Sentiment_Classification Classification Detection Sentiment Language_Model PDF
2020-11-18 EWareNet: Emotion Aware Human Intent Prediction and Adaptive Spatial Profile Fusion for Social Robot Navigation Venkatraman Narayanan, Bala Murali Manoghar, Rama Prashanth RV, Aniket Bera arXiv_RO arXiv_RO Transformer Reinforcement_Learning 3D Pose Emotion Prediction PDF
2020-11-18 End-to-End Object Detection with Adaptive Clustering Transformer Minghang Zheng, Peng Gao, Xiaogang Wang, Hongsheng Li, Hao Dong arXiv_CV arXiv_CV Transformer Pose Action Detection Object_Detection Attention Inference PDF
2020-11-18 The Ubiqus English-Inuktitut System for WMT20 François Hernandez, Vincent Nguyen arXiv_CL arXiv_CL Transformer PDF
2020-11-18 Do Fine-tuned Commonsense Language Models Really Generalize? Mayank Kejriwal, Ke Shen arXiv_AI arXiv_AI Transformer Bert Language_Model PDF
2020-11-18 UP-DETR: Unsupervised Pre-training for Object Detection with Transformers Zhigang Dai, Bolun Cai, Yugeng Lin, Junying Chen arXiv_CV arXiv_CV Transformer Reconstruction Unsupervised Pose Classification Detection Object_Detection Attention PDF
2020-11-18 Sequence-Level Mixed Sample Data Augmentation Demi Guo, Yoon Kim, Alexander M. Rush arXiv_CL arXiv_CL Transformer Pose PDF
2020-11-17 s-Transformer: Segment-Transformer for Robust Neural Speech Synthesis Xi Wang, Huaiping Ming, Lei He, Frank K. Soong arXiv_SD arXiv_SD Transformer Speech Pose Attention PDF
2020-11-16 End-to-end spoken language understanding using transformer networks and self-supervised pre-trained features Edmilson Morais, Hong-Kwang J. Kuo, Samuel Thomas, Zoltan Tuske, Brian Kingsbury arXiv_CL arXiv_CL Transformer Self-Supervised Action PDF
2020-11-16 On the Effectiveness of Vision Transformers for Zero-shot Face Anti-Spoofing Anjith George, Sebastien Marcel arXiv_CV arXiv_CV Transformer Transfer_Learning Recognition Zero-Shot Pose Face Face_Recognition PDF
2020-11-14 Conditioned Natural Language Generation using only Unconditioned Language Model: An Exploration Fan-Keng Sun, Cheng-I Lai arXiv_CL arXiv_CL Transformer Text_Generation Language_Model PDF
2020-11-14 DebateSum: A large-scale argument mining and summarization dataset Allen Roush, Arvind Balaji arXiv_CL arXiv_CL Transformer Speech Summarization PDF
2020-11-14 ActBERT: Learning Global-Local Video-Text Representations Linchao Zhu, Yi Yang arXiv_CV arXiv_CV Transformer Segmentation Video_Caption Bert Represenation_Learning Self-Supervised Action Relation Caption PDF
2020-11-14 Utilizing Bidirectional Encoder Representations from Transformers for Answer Selection Md Tahmid Rahman Laskar, Enamul Hoque, Jimmy Xiangji Huang arXiv_CL arXiv_CL Transformer Bert Language_Model QA PDF
2020-11-13 FLERT: Document-Level Features for Named Entity Recognition Stefan Schweter, Alan Akbik arXiv_CL arXiv_CL Transformer Recognition Bert RNN Prediction Recommendation PDF
2020-11-13 Transformer-Encoder Detector Module: Using Context to Improve Robustness to Adversarial Attacks on Object Detection Faisal Alamri, Sinan Kalkan, Nicolas Pugeault arXiv_CV arXiv_CV Transformer Recognition Adversarial Pose Detection Object_Detection PDF
2020-11-13 EDITOR: an Edit-Based Transformer with Repositioning for Neural Machine Translation with Soft Lexical Constraints Weijia Xu, Marine Carpuat arXiv_CL arXiv_CL Transformer PDF
2020-11-12 Augmenting BERT Carefully with Underrepresented Linguistic Features Aparna Balagopalan, Jekaterina Novikova arXiv_CL arXiv_CL Transformer Bert Speech Classification Detection PDF
2020-11-11 Hurricane Forecasting: A Novel Multimodal Machine Learning Framework Léonard Boussioux, Cynthia Zeng, Théo Guénais, Dimitris Bertsimas arXiv_AI arXiv_AI Transformer Pose PDF
2020-11-11 Transformers for One-Shot Visual Imitation Sudeep Dasari, Abhinav Gupta arXiv_CV arXiv_CV Transformer Knowledge Self-Supervised Action Attention PDF
2020-11-11 TRAILER: Transformer-based Time-wise Long Term Relation Modeling for Citywide Traffic Flow Prediction Hao Xue, Flora D Salim arXiv_AI arXiv_AI Transformer Pose Deep_Learning Relation Prediction PDF
2020-11-10 E.T.: Entity-Transformers. Coreference augmented Neural Language Model for richer mention representations via Entity-Transformer blocks Nikolaos Stylianou, Ioannis Vlahavas arXiv_CL arXiv_CL Transformer Recognition Language_Model PDF
2020-11-10 Human-centric Spatio-Temporal Video Grounding With Visual Transformers Zongheng Tang, Yue Liao, Si Liu, Guanbin Li, Xiaojie Jin, Hongxu Jiang, Qian Yu, Dong Xu arXiv_AI arXiv_AI Transformer Surveillance Pose Matching PDF
2020-11-10 Translating Similar Languages: Role of Mutual Intelligibility in Multilingual Transformers Ife Adebara, El Moatez Billah Nagoudi, Muhammad Abdul Mageed arXiv_CL arXiv_CL Transformer Relation PDF
2020-11-10 When Do You Need Billions of Words of Pretraining Data? Yian Zhang, Alex Warstadt, Haau-Sing Li, Samuel R. Bowman arXiv_CL arXiv_CL Transformer Unsupervised Bert Knowledge Pose Language_Model PDF
2020-11-10 A Transfer Learning Approach for Dialogue Act Classification of GitHub Issue Comments Ayesha Enayet, Gita Sukthankar arXiv_CL arXiv_CL Transformer Transfer_Learning Bert Classification PDF
2020-11-09 EstBERT: A Pretrained Language-Specific BERT for Estonian Hasan Tanvir, Claudia Kittask, Kairit Sirts arXiv_CL arXiv_CL Transformer Recognition Bert Text_Classification Classification PDF
2020-11-09 VisBERT: Hidden-State Visualizations for Transformers Betty van Aken, Benjamin Winter, Alexander Löser, Felix A. Gers arXiv_CL arXiv_CL Transformer Bert Attention Inference Prediction PDF
2020-11-09 Bangla Text Classification using Transformers Tanvirul Alam, Akib Khan, Firoj Alam arXiv_CL arXiv_CL Transformer Text_Classification Emotion Classification Deep_Learning Detection Sentiment PDF
2020-11-09 BERT-JAM: Boosting BERT-Enhanced Neural Machine Translation with Joint Attention Zhebin Zhang, Sai Wu, Dawei Jiang, Gang Chen arXiv_CL arXiv_CL Transformer Bert Optimization Pose NMT Attention PDF
2020-11-09 Gated Recurrent Fusion with Joint Training Framework for Robust End-to-End Speech Recognition Cunhang Fan, Jiangyan Yi, Jianhua Tao, Zhengkun Tian, Bin Liu, Zhengqi Wen arXiv_CL arXiv_CL Transformer Enhancement Recognition Speech Pose Speech_Recognition PDF
2020-11-09 End-to-end Lane Shape Prediction with Transformers Ruijin Liu, Zejian Yuan, Tie Liu, Zhiliang Xiong arXiv_AI arXiv_AI Transformer Pose Action Detection Attention Autonomous Prediction PDF
2020-11-09 Efficient End-to-End Speech Recognition Using Performers in Conformers Peidong Wang, DeLiang Wang arXiv_CL arXiv_CL Transformer Recognition Speech Pose Attention Speech_Recognition PDF
2020-11-08 On the Usefulness of Self-Attention for Automatic Speech Recognition with Transformers Shucong Zhang, Erfan Loweimi, Peter Bell, Steve Renals arXiv_CL arXiv_CL Transformer Recognition Speech Relation Attention Speech_Recognition PDF
2020-11-08 Long Range Arena: A Benchmark for Efficient Transformers Yi Tay, Mostafa Dehghani, Samira Abnar, Yikang Shen, Dara Bahri, Philip Pham, Jinfeng Rao, Liu Yang, Sebastian Ruder, Donald Metzler arXiv_AI arXiv_AI Transformer Sparse Pose Attention PDF
2020-11-08 Stochastic Attention Head Removal: A Simple and Effective Method for Improving Automatic Speech Recognition with Transformers Shucong Zhang, Erfan Loweimi, Peter Bell, Steve Renals arXiv_CL arXiv_CL Transformer Recognition Speech Pose Attention Speech_Recognition PDF
2020-11-08 On the Practical Ability of Recurrent Neural Networks to Recognize Hierarchical Languages Satwik Bhattamishra, Kabir Ahuja, Navin Goyal arXiv_CL arXiv_CL Transformer RNN PDF
2020-11-08 PointTransformer for Shape Classification and Retrieval of 3D and ALS Roof PointClouds Dimple A Shajahan, Mukund Varma T, Ramanathan Muthuganapathy arXiv_CV arXiv_CV Transformer Point_Cloud 3D Pose Classification Deep_Learning Attention PDF
2020-11-07 Rethinking the Value of Transformer Components Wenxuan Wang, Zhaopeng Tu arXiv_CL arXiv_CL Transformer Pose PDF
2020-11-07 Know What You Don't Need: Single-Shot Meta-Pruning for Attention Heads Zhengyan Zhang, Fanchao Qi, Zhiyuan Liu, Qun Liu, Maosong Sun arXiv_CL arXiv_CL Transformer Knowledge Pose Attention Inference PDF
2020-11-06 Semi-Supervised Low-Resource Style Transfer of Indonesian Informal to Formal Language with Iterative Forward-Translation Haryo Akbarianto Wibowo, Tatag Aziz Prawiro, Muhammad Ihsan, Alham Fikri Aji, Radityo Eko Prasojo, Rahmad Mahendra arXiv_CL arXiv_CL Transformer Style_Transfer PDF
2020-11-06 From Dataset Recycling to Multi-Property Extraction and Beyond Tomasz Dwojak, Michał Pietruszka, Łukasz Borchmann, Jakub Chłędowski, Filip Graliński arXiv_CL arXiv_CL Transformer Pose Action PDF
2020-11-05 Improving RNN Transducer Based ASR with Auxiliary Tasks Chunxi Liu, Frank Zhang, Duc Le, Suyoun Kim, Yatharth Saraf, Geoffrey Zweig arXiv_CL arXiv_CL Transformer Recognition RNN Speech Pose Speech_Recognition Prediction PDF
2020-11-05 Competence-Level Prediction and Resume & Job Description Matching Using Context-Aware Transformer Models Changmao Li, Elaine Fisher, Rebecca Thomas, Steve Pittard, Vicki Hertzberg, Jinho D. Choi arXiv_CL arXiv_CL Transformer Classification Attention Prediction Matching PDF
2020-11-05 Revisiting Stereo Depth Estimation From a Sequence-to-Sequence Perspective with Transformers Zhaoshuo Li, Xingtong Liu, Francis X. Creighton, Russell H. Taylor, Mathias Unberath arXiv_CV arXiv_CV Transformer Pose Attention Matching PDF
2020-11-05 BW-EDA-EEND: Streaming End-to-End Neural Speaker Diarization for a Variable Number of Speakers Eunjung Han, Chul Lee, Andreas Stolcke arXiv_CL arXiv_CL Transformer Pose PDF
2020-11-05 Lets Play Music: Audio-driven Performance Video Generation Hao Zhu, Yi Li, Feixia Zhu, Aihua Zheng, Ran He arXiv_CV arXiv_CV Transformer Pose PDF
2020-11-04 Indic-Transformers: An Analysis of Transformer Language Models for Indian Languages Kushal Jain, Adwait Deshpande, Kumar Shridhar, Felix Laumann, Ayushman Dash arXiv_CL arXiv_CL Transformer Text_Classification Classification Language_Model PDF
2020-11-04 Optimizing Transformer for Low-Resource Neural Machine Translation Ali Araabi, Christof Monz arXiv_CL arXiv_CL Transformer PDF
2020-11-03 Sound Natural: Content Rephrasing in Dialog Systems Arash Einolghozati, Anchit Gupta, Keith Diedrick, Sonal Gupta arXiv_CL arXiv_CL Transformer RNN Pose Language_Model PDF
2020-11-03 Tabular Transformers for Modeling Multivariate Time Series Inkit Padhi, Yair Schiff, Igor Melnyk, Mattia Rigotti, Youssef Mroueh, Pierre Dognin, Jerret Ross, Ravi Nair, Erik Altman arXiv_AI arXiv_AI Transformer Bert Pose Action Deep_Learning Detection PDF
2020-11-03 Learning Representations from Audio-Visual Spatial Alignment Pedro Morgado, Yi Li, Nuno Vasconcelos arXiv_CV arXiv_CV Transformer Segmentation Semantic_Segmentation Recognition Represenation_Learning Self-Supervised Pose Action_Recognition Action PDF
2020-11-03 Rotational Rectification Network: Enabling Pedestrian Detection for Mobile Vision Xinshuo Weng, Shangxuan Wu, Fares Beainy, Kris Kitani arXiv_CV arXiv_CV Transformer Pose Detection Object_Detection CNN PDF
2020-11-03 Joint Entity and Relation Extraction with Set Prediction Networks Dianbo Sui, Yubo Chen, Kang Liu, Jun Zhao, Xiangrong Zeng, Shengping Liu arXiv_CL arXiv_CL Transformer Pose Action Relation Relation_Extraction Prediction Matching PDF
2020-11-03 Improving RNN transducer with normalized jointer network Mingkun Huang, Jun Zhang, Meng Cai, Yang Zhang, Jiali Yao, Yongbin You, Yi He, Zejun Ma arXiv_SD arXiv_SD Transformer Recognition RNN Speech Pose Speech_Recognition Language_Model PDF
2020-11-03 BioNerFlair: biomedical named entity recognition using flair embedding and sequence tagger Harsh Patel arXiv_CL arXiv_CL Transformer Embedding Recognition OCR Bert RNN Action Medical PDF
2020-11-02 The Devil is in the Details: Evaluating Limitations of Transformer-based Methods for Granular Tasks Brihi Joshi, Neil Shah, Francesco Barbieri, Leonardo Neves arXiv_CL arXiv_CL Transformer Embedding Pose Sentiment Language_Model Matching PDF
2020-11-02 A Closer Look at Linguistic Knowledge in Masked Language Models: The Case of Relative Clauses in American English Marius Mosbach, Stefania Degaetano-Ortlieb, Marie-Pauline Krielke, Badr M. Abdullah, Dietrich Klakow arXiv_CL arXiv_CL Transformer Bert Knowledge Language_Model Prediction PDF
2020-11-02 How Far Does BERT Look At:Distance-based Clustering and Analysis of BERTś Attention Yue Guan, Jingwen Leng, Chao Li, Quan Chen, Minyi Guo arXiv_CL arXiv_CL Transformer Unsupervised Bert Pose Attention PDF
2020-11-02 Point Transformer Nico Engel, Vasileios Belagiannis, Klaus Dietmayer arXiv_CV arXiv_CV Transformer Segmentation Pose Classification Relation Attention PDF
2020-11-02 Adapting Pretrained Transformer to Lattices for Spoken Language Understanding Chao-Wei Huang, Yun-Nung Chen arXiv_AI arXiv_AI Transformer Segmentation Recognition Speech Pose Speech_Recognition Language_Model PDF
2020-11-02 Multitask Learning and Joint Optimization for Transformer-RNN-Transducer Speech Recognition Jae-Jin Jeon, Eesung Kim arXiv_SD arXiv_SD Transformer Recognition Optimization RNN Speech Pose Speech_Recognition Prediction PDF
2020-11-02 Dual-decoder Transformer for Joint Automatic Speech Recognition and Multilingual Speech Translation Hang Le, Juan Pino, Changhan Wang, Jiatao Gu, Didier Schwab, Laurent Besacier arXiv_CL arXiv_CL Transformer Recognition Speech Pose Attention Speech_Recognition PDF
2020-11-01 Social Chemistry 101: Learning to Reason about Social and Moral Norms Maxwell Forbes, Jena D. Hwang, Vered Shwartz, Maarten Sap, Yejin Choi arXiv_AI arXiv_AI Transformer Action PDF
2020-11-01 COOT: Cooperative Hierarchical Transformer for Video-Text Representation Learning Simon Ging (1), Mohammadreza Zolfaghari (1), Hamed Pirsiavash (2), Thomas Brox (1) ((1) University of Freiburg, (2) University of Maryland Baltimore County) arXiv_AI arXiv_AI Transformer Represenation_Learning Pose Action Attention PDF
2020-11-01 TransQuest: Translation Quality Estimation with Cross-lingual Transformers Tharindu Ranasinghe, Constantin Orasan, Ruslan Mitkov arXiv_AI arXiv_AI Transformer Transfer_Learning Pose PDF
2020-11-01 SMRT Chatbots: Improving Non-Task-Oriented Dialog with Simulated Multiple Reference Training Huda Khayrallah, João Sedoc arXiv_CL arXiv_CL Transformer QA PDF
2020-11-01 Transformer-based Multi-Aspect Modeling for Multi-Aspect Multi-Sentiment Analysis Zhen Wu, Chengcan Ying, Xinyu Dai, Shujian Huang, Jiajun Chen arXiv_CL arXiv_CL Transformer Bert Pose Relation Sentiment PDF
2020-11-01 Investigation of BERT Model on Biomedical Relation Extraction Based on Revised Fine-tuning Mechanism Peng Su, K. Vijay-Shanker arXiv_CL arXiv_CL Transformer Bert Knowledge Action Classification Relation Relation_Extraction Medical PDF
2020-10-30 Streaming Simultaneous Speech Translation with Augmented Memory Transformer Xutai Ma, Yongqiang Wang, Mohammad Javad Dousti, Philipp Koehn, Juan Pino arXiv_CL arXiv_CL Transformer Recognition Speech Pose Attention Speech_Recognition PDF
2020-10-30 SLM: Learning a Discourse Language Representation with Sentence Unshuffling Haejun Lee, Drew A. Hudson, Kangwook Lee, Christopher D. Manning arXiv_CL arXiv_CL Transformer Bert Self-Supervised Pose Classification Relation Language_Model PDF
2020-10-30 Generating Radiology Reports via Memory-driven Transformer Zhihong Chen, Yan Song, Tsung-Hui Chang, Xiang Wan arXiv_CL arXiv_CL Transformer Knowledge Pose Relation Attention Medical PDF
2020-10-30 VECO: Variable Encoder-decoder Pre-training for Cross-lingual Understanding and Generation Fuli Luo, Wei Wang, Jiahao Liu, Yijia Liu, Bin Bi, Songfang Huang, Fei Huang, Luo Si arXiv_CL arXiv_CL Transformer Text_Classification Classification Relation GAN Inference Language_Model PDF
2020-10-29 RuREBus: a Case Study of Joint Named Entity Recognition and Relation Extraction from e-Government Domain Vitaly Ivanin, Ekaterina Artemova, Tatiana Batura, Vladimir Ivanov, Veronika Sarkisyan, Elena Tutubalina, Ivan Smurov arXiv_CL arXiv_CL Transformer Recognition Action Relation Relation_Extraction PDF
2020-10-29 RussianSuperGLUE: A Russian Language Understanding Evaluation Benchmark Tatiana Shavrina, Alena Fenogenova, Anton Emelyanov, Denis Shevelev, Ekaterina Artemova, Valentin Malykh, Vladislav Mikhailov, Maria Tikhonova, Andrey Chertok, Andrey Evlampiev arXiv_AI arXiv_AI Transformer Detection GAN Inference Language_Model PDF
2020-10-29 Reducing Non-Normative Text Generation from Language Models Xiangyu Peng, Siyan Li, Spencer Frazier, Mark Riedl arXiv_CL arXiv_CL Transformer Reinforcement_Learning Text_Generation Language_Model PDF
2020-10-29 RelationNet++: Bridging Visual Representations for Object Detection via Transformer Decoder Cheng Chi, Fangyun Wei, Han Hu arXiv_CV arXiv_CV Transformer Embedding Pose Action Classification Detection Relation Object_Detection Attention PDF
2020-10-29 T-vectors: Weakly Supervised Speaker Identification Using Hierarchical Transformer Model Yanpei Shi, Mingjie Chen, Qiang Huang, Thomas Hain arXiv_CL arXiv_CL Transformer Weakly_Supervised Pose Attention PDF
2020-10-29 Memory Attentive Fusion: External Language Model Integration for Transformer-based Sequence-to-Sequence Model Mana Ihori, Ryo Masumura, Naoki Makishima, Tomohiro Tanaka, Akihiko Takashima, Shota Orihashi arXiv_CL arXiv_CL Transformer Knowledge Pose Attention Language_Model PDF
2020-10-29 Tilde at WMT 2020: News Task Systems Rihards Krišlauks, Mārcis Pinnis arXiv_CL arXiv_CL Transformer PDF
2020-10-29 Multiple Sclerosis Severity Classification From Clinical Text Alister D Costa, Stefan Denkovski, Michal Malyska, Sae Young Moon, Brandon Rufino, Zhen Yang, Taylor Killian, Marzyeh Ghassemi arXiv_CL arXiv_CL Transformer Embedding Bert Knowledge Classification Language_Model Prediction PDF
2020-10-28 Graph-based Topic Extraction from Vector Embeddings of Text Documents: Application to a Corpus of News Articles M. Tarik Altuncu, Sophia N. Yaliraki, Mauricio Barahona arXiv_AI arXiv_AI Transformer Embedding Unsupervised Bert Action PDF
2020-10-28 Non-Autoregressive Transformer ASR with CTC-Enhanced Decoder Input Xingchen Song, Zhiyong Wu, Yiheng Huang, Chao Weng, Dan Su, Helen Meng arXiv_CL arXiv_CL Transformer Recognition Speech Pose Speech_Recognition Inference Prediction PDF
2020-10-28 The Volctrans Machine Translation System for WMT20 Liwei Wu, Xiao Pan, Zehui Lin, Yaoming Zhu, Mingxuan Wang, Lei Li arXiv_CL arXiv_CL Transformer PDF
2020-10-28 Decoupling Pronunciation and Language for End-to-end Code-switching Automatic Speech Recognition Shuai Zhang, Jiangyan Yi, Zhengkun Tian, Ye Bai, Jianhua Tao, Zhengqi wen arXiv_CL arXiv_CL Transformer Recognition Speech Pose Attention Speech_Recognition PDF
2020-10-28 CASS-NAT: CTC Alignment-based Single Step Non-autoregressive Transformer for Speech Recognition Ruchao Fan, Wei Chu, Peng Chang, Jing Xiao arXiv_CL arXiv_CL Transformer Embedding Recognition Speech Pose Speech_Recognition Inference PDF
2020-10-28 Scaling Laws for Autoregressive Generative Modeling Tom Henighan, Jared Kaplan, Mor Katz, Mark Chen, Christopher Hesse, Jacob Jackson, Heewoo Jun, Tom B. Brown, Prafulla Dhariwal, Scott Gray, Chris Hallacy, Benjamin Mann, Alec Radford, Aditya Ramesh, Nick Ryder, Daniel M. Ziegler, John Schulman, Dario Amodei, Sam McCandlish arXiv_CV arXiv_CV Transformer Classification Relation Caption Prediction PDF
2020-10-27 Transformer in action: a comparative study of transformer-based acoustic models for large scale speech recognition applications Yongqiang Wang, Yangyang Shi, Frank Zhang, Chunyang Wu, Julian Chan, Ching-Feng Yeh, Alex Xiao arXiv_CL arXiv_CL Transformer Recognition Video_Caption RNN Speech Action Speech_Recognition Caption Inference PDF
2020-10-27 Language ID in the Wild: Unexpected Challenges on the Path to a Thousand-Language Web Text Corpus Isaac Caswell, Theresa Breiner, Daan van Esch, Ankur Bapna arXiv_CL arXiv_CL Transformer Pose PDF
2020-10-27 Fast Interleaved Bidirectional Sequence Generation Biao Zhang, Ivan Titov, Rico Sennrich arXiv_CL arXiv_CL Transformer Attention Summarization Inference PDF
2020-10-27 Co-attentional Transformers for Story-Based Video Understanding Björn Bebensee, Byoung-Tak Zhang arXiv_AI arXiv_AI Transformer Video_Caption Pose Action Attention QA PDF
2020-10-27 MMFT-BERT: Multimodal Fusion Transformer with BERT Encodings for Visual Question Answering Aisha Urooj Khan, Amir Mazaheri, Niels da Vitoria Lobo, Mubarak Shah arXiv_CV arXiv_CV Transformer Bert Knowledge Pose VQA QA PDF
2020-10-27 To BERT or Not to BERT: Comparing Task-specific and Task-agnostic Semi-Supervised Approaches for Sequence Tagging Kasturi Bhattacharjee, Miguel Ballesteros, Rishita Anubhai, Smaranda Muresan, Jie Ma, Faisal Ladhak, Yaser Al-Onaizan arXiv_CL arXiv_CL Transformer Bert PDF
2020-10-26 Recent Developments on ESPnet Toolkit Boosted by Conformer Pengcheng Guo, Florian Boyer, Xuankai Chang, Tomoki Hayashi, Yosuke Higuchi, Hirofumi Inaguma, Naoyuki Kamo, Chenda Li, Daniel Garcia-Romero, Jiatong Shi, Jing Shi, Shinji Watanabe, Kun Wei, Wangyou Zhang, Yuekai Zhang arXiv_SD arXiv_SD Transformer Recognition Speech Pose Speech_Recognition PDF
2020-10-26 Controlled Molecule Generator for Optimizing Multiple Chemical Properties Bonggun Shin, Sungsoo Park, JinYeong Bak, Joyce C. Ho arXiv_AI arXiv_AI Transformer Optimization Pose Prediction PDF
2020-10-26 Peak Detection On Data Independent Acquisition Mass Spectrometry Data With Semisupervised Convolutional Transformers Leon L. Xu, Hannes L. Röst arXiv_CV arXiv_CV Transformer Segmentation Pose Quantitative Classification Detection Attention CNN Image_Classification PDF
2020-10-26 PowerTransformer: Unsupervised Controllable Revision for Biased Language Correction Xinyao Ma, Maarten Sap, Hannah Rashkin, Yejin Choi arXiv_AI arXiv_AI Transformer Reconstruction Unsupervised Knowledge Language_Model PDF
2020-10-26 Dutch Humor Detection by Generating Negative Examples Thomas Winters, Pieter Delobelle arXiv_AI arXiv_AI Transformer Recognition Bert Pose Classification Detection Text_Generation Language_Model PDF
2020-10-26 UPB at SemEval-2020 Task 12: Multilingual Offensive Language Detection on Social Media by Fine-tuning a Variety of BERT-based Models Mircea-Adrian Tanase, Dumitru-Clementin Cercel, Costing-Gabriel Chiru arXiv_CL arXiv_CL Transformer Bert Pose Detection PDF
2020-10-26 Graph Transformer Networks with Syntactic and Semantic Structures for Event Argument Extraction Amir Pouran Ben Veyseh, Tuan Ngo Nguyen, Thien Huu Nguyen arXiv_CL arXiv_CL Transformer Pose Action Deep_Learning PDF
2020-10-26 FastFormers: Highly Efficient Transformer Models for Natural Language Understanding Young Jin Kim, Hany Hassan Awadalla arXiv_CL arXiv_CL Transformer Optimization Knowledge Pose Inference PDF
2020-10-25 Attention is All You Need in Speech Separation Cem Subakan, Mirco Ravanelli, Samuele Cornell, Mirko Bronzi, Jianyuan Zhong arXiv_SD arXiv_SD Transformer RNN Speech Pose Attention Matching PDF
2020-10-25 ExplanationLP: Abductive Reasoning for Explainable Science Question Answering Mokanarangan Thayaparan, Marco Valentino, André Freitas arXiv_AI arXiv_AI Transformer Pose Inference PDF
2020-10-24 Pre-trained Summarization Distillation Sam Shleifer, Alexander M. Rush arXiv_AI arXiv_AI Transformer Bert Knowledge Face Classification Summarization PDF
2020-10-24 Large Scale Legal Text Classification Using Transformer Models Zein Shaheen, Gerhard Wohlgenannt, Erwin Filtz arXiv_AI arXiv_AI Transformer Text_Classification Classification Language_Model PDF
2020-10-24 Hierarchical Transformer for Task Oriented Dialog Systems Bishal Santra, Potnuru Anusha, Pawan Goyal arXiv_CL arXiv_CL Transformer Embedding RNN Pose Attention Summarization PDF
2020-10-24 ReadOnce Transformers: Reusable Representations of Text for Transformers Shih-Ting Lin, Ashish Sabharwal, Tushar Khot arXiv_AI arXiv_AI Transformer Summarization Language_Model QA PDF
2020-10-24 Align-Refine: Non-Autoregressive Speech Recognition via Iterative Realignment Ethan A. Chi, Julian Salazar, Katrin Kirchhoff arXiv_CL arXiv_CL Transformer Recognition Speech Pose Classification Speech_Recognition Matching PDF
2020-10-24 Text Editing by Command Felix Faltings, Michel Galley, Gerold Hintz, Chris Brockett, Chris Quirk, Jianfeng Gao, Bill Dolan arXiv_CL arXiv_CL Transformer Pose Text_Generation PDF
2020-10-24 Rethinking embedding coupling in pre-trained language models Hyung Won Chung, Thibault Févry, Henry Tsai, Melvin Johnson, Sebastian Ruder arXiv_CL arXiv_CL Transformer Embedding Language_Model PDF
2020-10-24 Inducing Taxonomic Knowledge from Pretrained Transformers Catherine Chen, Kevin Lin, Dan Klein arXiv_CL arXiv_CL Transformer Optimization Knowledge Relation PDF
2020-10-24 Pre-training Text-to-Text Transformers for Concept-centric Common Sense Wangchunshu Zhou, Dong-Ho Lee, Ravi Kiran Selvam, Seyeon Lee, Bill Yuchen Lin, Xiang Ren arXiv_AI arXiv_AI Transformer Bert Knowledge Knowledge_Graph Self-Supervised Pose Relation Language_Model Prediction PDF
2020-10-24 CaM-Gen:Causally-aware Metric-guided Text Generation Navita Goyal, Roodram Paneri, Ayush Agarwal, Udit Kalani, Abhilasha Sancheti, Niyati Chhaya arXiv_CL arXiv_CL Transformer Knowledge Pose Relation Text_Generation Inference Language_Model PDF
2020-10-24 Multi-Domain Dialogue State Tracking -- A Purely Transformer-Based Generative Approach Yan Zeng, Jian-Yun Nie arXiv_AI arXiv_AI Transformer Tracking Bert RNN Pose Ontology Attention Prediction PDF
2020-10-24 Open-Domain Dialogue Generation Based on Pre-trained Language Models Yan Zeng, Jian-Yun Nie arXiv_AI arXiv_AI Transformer Pose Attention Language_Model PDF
2020-10-24 Effective Distant Supervision for Temporal Relation Extraction Xinyu Zhao, Shih-ting Lin, Greg Durrett arXiv_CL arXiv_CL Transformer Zero-Shot Action Relation Few-Shot Relation_Extraction PDF
2020-10-24 Char2Subword: Extending the Subword Embedding Space from Pre-trained Models Using Robust Character Compositionality Gustavo Aguilar, Bryan McCann, Tong Niu, Nazneen Rajani, Nitish Keskar, Thamar Solorio arXiv_CL arXiv_CL Transformer Embedding Bert Adversarial Pose Language_Model PDF
2020-10-23 Learning to Recognize Dialect Features Dorottya Demszky, Devyani Sharma, Jonathan H. Clark, Vinodkumar Prabhakaran, Jacob Eisenstein arXiv_CL arXiv_CL Transformer Detection PDF
2020-10-23 Graph-Based Universal Dependency Parsing in the Age of the Transformer: What Works, and What Doesn't Stefan Grünewald, Annemarie Friedrich, Jonas Kuhn arXiv_CL arXiv_CL Transformer Embedding Speech Language_Model PDF
2020-10-23 Long Document Ranking with Query-Directed Sparse Transformer Jyun-Yu Jiang, Chenyan Xiong, Chia-Jung Lee, Wei Wang arXiv_AI arXiv_AI Transformer Bert Sparse Few-Shot Attention Prediction Matching PDF
2020-10-23 On the Transformer Growth for Progressive BERT Training Xiaotao Gu, Liyuan Liu, Hongkun Yu, Jing Li, Chen Chen, Jiawei Han arXiv_CL arXiv_CL Transformer Bert Pose PDF
2020-10-23 Generating Plausible Counterfactual Explanations for Deep Transformers in Financial Text Classification Linyi Yang, Eoin M. Kenny, Tin Lok James Ng, Yi Yang, Barry Smyth, Ruihai Dong arXiv_AI arXiv_AI Transformer Text_Classification Regularization Adversarial Pose Quantitative Classification Attention Language_Model PDF
2020-10-23 Improving Robustness by Augmenting Training Sentences with Predicate-Argument Structures Nafise Sadat Moosavi, Marcel de Boer, Prasetya Ajie Utama, Iryna Gurevych arXiv_CL arXiv_CL Transformer Adversarial Pose Action PDF
2020-10-23 GraphSpeech: Syntax-Aware Graph Attention Network For Neural Speech Synthesis Rui Liu, Berrak Sisman, Haizhou Li arXiv_SD arXiv_SD Transformer Embedding Speech Pose Relation Attention PDF
2020-10-23 Deep Learning Framework for Measuring the Digital Strategy of Companies from Earnings Calls Ahmed Ghanim Al-Ali, Robert Phaal, Donald Sull arXiv_CL arXiv_CL Transformer Text_Classification Classification Deep_Learning PDF
2020-10-23 SmBoP: Semi-autoregressive Bottom-up Semantic Parsing Ohad Rubin, Jonathan Berant arXiv_CL arXiv_CL Transformer Zero-Shot Pose PDF
2020-10-23 Don't shoot butterfly with rifles: Multi-channel Continuous Speech Separation with Early Exit Transformer Sanyuan Chen, Yu Wu, Zhuo Chen, Takuya Yoshioka, Shujie Liu, Jinyu Li arXiv_CL arXiv_CL Transformer Enhancement Speech Pose Inference PDF
2020-10-23 A Cross-Verification Approach for Protecting World Leaders from Fake and Tampered Audio Mengyi Shan, TJ Tsai arXiv_SD arXiv_SD Transformer RNN Speech Pose Classification Matching PDF
2020-10-23 Transformer-based End-to-End Speech Recognition with Local Dense Synthesizer Attention Menglong Xu, Shengqiang Li, Xiao-Lei Zhang arXiv_CL arXiv_CL Transformer Recognition Speech Pose Action Attention Speech_Recognition PDF
2020-10-22 How Phonotactics Affect Multilingual and Zero-shot ASR Performance Siyuan Feng, Piotr Żelasko, Laureano Moro-Velázquez, Ali Abavisani, Mark Hasegawa-Johnson, Odette Scharenborg, Najim Dehak arXiv_CL arXiv_CL Transformer Recognition Zero-Shot Speech Speech_Recognition Language_Model PDF
2020-10-22 Sequence-to-sequence Singing Voice Synthesis with Perceptual Entropy Loss Jiatong Shi, Shuai Guo, Nan Huo, Yuekai Zhang, Qin Jin arXiv_SD arXiv_SD Transformer RNN Pose Contour Prediction PDF
2020-10-22 mT5: A massively multilingual pre-trained text-to-text transformer Linting Xue, Noah Constant, Adam Roberts, Mihir Kale, Rami Al-Rfou, Aditya Siddhant, Aditya Barua, Colin Raffel arXiv_CL arXiv_CL Transformer PDF
2020-10-22 An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale Alexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, Dirk Weissenborn, Xiaohua Zhai, Thomas Unterthiner, Mostafa Dehghani, Matthias Minderer, Georg Heigold, Sylvain Gelly, Jakob Uszkoreit, Neil Houlsby arXiv_AI arXiv_AI Transformer Recognition Classification Attention CNN Image_Classification PDF
2020-10-22 AdapterDrop: On the Efficiency of Adapters in Transformers Andreas Rücklé, Gregor Geigle, Max Glockner, Tilman Beck, Jonas Pfeiffer, Nils Reimers, Iryna Gurevych arXiv_CL arXiv_CL Transformer Pose Inference PDF
2020-10-22 Perceptual Loss based Speech Denoising with an ensemble of Audio Pattern Recognition and Self-Supervised Models Saurabh Kataria, Jesús Villalba, Najim Dehak arXiv_SD arXiv_SD Transformer Embedding Enhancement Recognition Regularization Speech Self-Supervised Emotion Classification Deep_Learning Denoising PDF
2020-10-22 Not all parameters are born equal: Attention is mostly what you need Nikolay Bogoychev arXiv_CL arXiv_CL Transformer Embedding Attention Language_Model PDF
2020-10-22 An Analysis of Simple Data Augmentation for Named Entity Recognition Xiang Dai, Heike Adel arXiv_CL arXiv_CL Transformer Recognition Pose Medical PDF
2020-10-22 A Technical Report: BUT Speech Translation Systems Hari Krishna Vydana, Lukas Burget, Jan Cernocky arXiv_AI arXiv_AI Transformer Optimization Speech Inference PDF
2020-10-22 Multi-dimensional Style Transfer for Partially Annotated Data using Language Models as Discriminators Navita Goyal, Balaji Vasan Srinivasan, Anandhavelu N, Abhilasha Sancheti arXiv_CL arXiv_CL Transformer Style_Transfer Quantitative Language_Model PDF
2020-10-22 Investigating the True Performance of Transformers in Low-Resource Languages: A Case Study in Automatic Corpus Creation Jan Christian Blaise Cruz, Jose Kristian Resabal, James Lin, Dan John Velasco, Charibeth Cheng arXiv_CL arXiv_CL Transformer Transfer_Learning Pose Inference PDF
2020-10-22 Incorporating Stylistic Lexical Preferences in Generative Language Models Hrituraj Singh, Gaurav Verma, Balaji Vasan Srinivasan arXiv_CL arXiv_CL Transformer Reinforcement_Learning Pose Quantitative Language_Model PDF
2020-10-22 Cross Copy Network for Dialogue Generation Changzhen Ji, Xin Zhou, Yating Zhang, Xiaozhong Liu, Changlong Sun, Conghui Zhu, Tiejun Zhao arXiv_CL arXiv_CL Transformer RNN Pose Attention PDF
2020-10-22 WHALETRANS: E2E WHisper to nAturaL spEech conversion using modified TRANSformer network Abhishek Niranjan, Mukesh Sharma, Sai Bharath Chandra Gutha, M Ali Basha Shaik arXiv_CL arXiv_CL Transformer Knowledge Speech Pose PDF
2020-10-22 Similarity Analysis of Self-Supervised Speech Representations Yu-An Chung, Yonatan Belinkov, James Glass arXiv_CL arXiv_CL Transformer Represenation_Learning RNN Speech Self-Supervised Pose Relation PDF
2020-10-22 A Framework for Contrastive and Generative Learning of Audio Representations Prateek Verma, Julius Smith arXiv_AI arXiv_AI Transformer Salient Contrastive_Learning PDF
2020-10-22 Task-Adaptive Feature Transformer for Few-Shot Segmentation Jun Seo, Young-Hyun Park, Sung-Whan Yoon, Jaekyun Moon arXiv_AI arXiv_AI Transformer Segmentation Semantic_Segmentation Pose Few-Shot PDF
2020-10-22 Developing Real-time Streaming Transformer Transducer for Speech Recognition on Large-scale Dataset Xie Chen, Yu Wu, Zhenghao Wang, Shujie Liu, Jinyu Li arXiv_CL arXiv_CL Transformer Recognition RNN Speech Attention Speech_Recognition Inference PDF
2020-10-22 Stronger Transformers for Neural Multi-Hop Question Generation Devendra Singh Sachan, Lingfei Wu, Mrinmaya Sachan, William Hamilton arXiv_CL arXiv_CL Transformer Relation PDF
2020-10-22 N-ODE Transformer: A Depth-Adaptive Variant of the Transformer Using Neural Ordinary Differential Equations Aaron Baier-Reinio, Hans De Sterck arXiv_CL arXiv_CL Transformer Regularization Attention PDF
2020-10-21 Learning to Summarize Long Texts with Memory Compression and Transfer Jaehong Park, Jonathan Pilault, Christopher Pal arXiv_CL arXiv_CL Transformer Regularization Salient Action Summarization PDF
2020-10-21 FastEmit: Low-latency Streaming ASR with Sequence-level Emission Regularization Jiahui Yu, Chung-Cheng Chiu, Bo Li, Shuo-yiin Chang, Tara N. Sainath, Yanzhang He, Arun Narayanan, Wei Han, Anmol Gulati, Yonghui Wu, Ruoming Pang arXiv_AI arXiv_AI Transformer Recognition Optimization RNN Regularization Speech Pose Speech_Recognition Prediction PDF
2020-10-21 Multi-Domain Dialogue State Tracking based on State Graph Yan Zeng, Jian-Yun Nie arXiv_AI arXiv_AI Transformer Embedding Tracking Pose Relation Attention Inference PDF
2020-10-21 DuoRAT: Towards Simpler Text-to-SQL Models Torsten Scholak, Raymond Li, Dzmitry Bahdanau, Harm de Vries, Chris Pal arXiv_CL arXiv_CL Transformer Relation PDF
2020-10-21 WaveTransformer: A Novel Architecture for Audio Captioning Based on Learning Temporal and Time-Frequency Information An Tran, Konstantinos Drossos, Tuomas Virtanen arXiv_SD arXiv_SD Image_Caption Transformer Caption PDF
2020-10-21 Token Drop mechanism for Neural Machine Translation Huaao Zhang, Shigui Qiu, Xiangyu Duan, Min Zhang arXiv_CL arXiv_CL Transformer Self-Supervised Pose NMT Detection Prediction PDF
2020-10-21 Open-Domain Frame Semantic Parsing Using Transformers Aditya Kalyanpur, Or Biran, Tom Breloff, Jennifer Chu-Carroll, Ariel Diertani, Owen Rambow, Mark Sammons arXiv_AI arXiv_AI Transformer Detection PDF
2020-10-21 Structure-aware Pre-training for Table Understanding with Tree-based Transformers Zhiruo Wang, Haoyu Dong, Ran Jia, Jia Li, Zhiyi Fu, Shi Han, Dongmei Zhang arXiv_AI arXiv_AI Transformer Embedding Pose Classification Relation Attention GAN PDF
2020-10-21 Complaint Identification in Social Media with Transformer Networks Mali Jin, Nikolaos Aletras arXiv_CL arXiv_CL Transformer Speech Sentiment Language_Model Prediction PDF
2020-10-21 Analyzing the Source and Target Contributions to Predictions in Neural Machine Translation Elena Voita, Rico Sennrich, Ivan Titov arXiv_CL arXiv_CL Transformer NMT Language_Model Prediction PDF
2020-10-21 BERT for Joint Multichannel Speech Dereverberation with Spatial-aware Tasks Yang Jiao arXiv_CL arXiv_CL Transformer Bert Speech Self-Supervised Pose PDF
2020-10-21 TurnGPT: a Transformer-based Language Model for Predicting Turn-taking in Spoken Dialog Erik Ekstedt, Gabriel Skantze arXiv_AI arXiv_AI Transformer Attention Language_Model Prediction PDF
2020-10-21 TMT: A Transformer-based Modal Translator for Improving Multimodal Sequence Representations in Audio Visual Scene-aware Dialog Wubo Li, Dongwei Jiang, Wei Zou, Xiangang Li arXiv_CL arXiv_CL Transformer Pose NMT PDF
2020-10-21 SeqTrans: Automatic Vulnerability Fix via Sequence to Sequence Learning Jianlei Chi, Yu Qu, Ting Liu, Qinghua Zheng, Heng Yin arXiv_CL arXiv_CL Transformer Pose NMT Attention PDF
2020-10-21 Emformer: Efficient Memory Transformer Based Acoustic Model For Low Latency Streaming Speech Recognition Yangyang Shi, Yongqiang Wang, Chunyang Wu, Ching-Feng Yeh, Julian Chan, Frank Zhang, Duc Le, Mike Seltzer arXiv_CL arXiv_CL Transformer Recognition RNN Speech Pose Attention Speech_Recognition PDF
2020-10-21 Multi-Unit Transformer for Neural Machine Translation Jianhao Yan, Fandong Meng, Jie Zhou arXiv_CL arXiv_CL Transformer Pose Attention Inference PDF
2020-10-20 Transition-based Parsing with Stack-Transformers Ramon Fernandez Astudillo, Miguel Ballesteros, Tahira Naseem, Austin Blodgett, Radu Florian arXiv_CL arXiv_CL Transformer RNN Attention PDF
2020-10-20 An Empirical Investigation of Contextualized Number Prediction Daniel Spokoyny, Taylor Berg-Kirkpatrick arXiv_CL arXiv_CL Transformer Unsupervised Pose Detection Prediction PDF
2020-10-20 Towards Scalable Distributed Training of Deep Learning on Public Cloud Clusters Shaohuai Shi, Xianhao Zhou, Shutao Song, Xingyao Wang, Zilin Zhu, Xue Huang, Xinan Jiang, Feihu Zhou, Zhenyu Guo, Liqiang Xie, Rui Lan, Xianbin Ouyang, Yan Zhang, Jieqian Wei, Jing Gong, Weiliang Lin, Ping Gao, Peng Meng, Xiaomin Xu, Chenyang Guo, Bo Yang, Zhibo Chen, Yongjian Wu, Xiaowen Chu arXiv_AI arXiv_AI Transformer Pose Deep_Learning PDF
2020-10-20 BERT2DNN: BERT Distillation with Massive Unlabeled Data for Online E-Commerce Search Yunjiang Jiang, Yue Shang, Ziyang Liu, Hongwei Shen, Yun Xiao, Wei Xiong, Sulong Xu, Weipeng Yan, Di Jin arXiv_AI arXiv_AI Transformer Embedding Bert Knowledge Pose Sentiment GAN Prediction PDF
2020-10-20 CharacterBERT: Reconciling ELMo and BERT for Word-Level Open-Vocabulary Representations From Characters Hicham El Boukkouri, Olivier Ferret, Thomas Lavergne, Hiroshi Noji, Pierre Zweigenbaum, Junichi Tsujii arXiv_CL arXiv_CL Transformer Bert Pose Medical PDF
2020-10-20 Bootleg: Chasing the Tail with Self-Supervised Named Entity Disambiguation Laurel Orr, Megan Leszczynski, Simran Arora, Sen Wu, Neel Guha, Xiao Ling, Christopher Re arXiv_AI arXiv_AI Transformer Knowledge Self-Supervised Action Relation Relation_Extraction PDF
2020-10-20 Topic-Aware Abstractive Text Summarization Chujie Zheng, Kunpeng Zhang, Harry Jiannan Wang, Ling Fan arXiv_CL arXiv_CL Transformer Self-Supervised Pose Attention Summarization PDF
2020-10-20 Text Classification of COVID-19 Press Briefings using BERT and Convolutional Neural Networks Kakia Chatsiou arXiv_CL arXiv_CL Transformer Embedding Bert Text_Classification Classification CNN Language_Model PDF
2020-10-20 CoRT: Complementary Rankings from Transformers Marco Wrzalik, Dirk Krechel arXiv_CL arXiv_CL Transformer Pose Language_Model PDF
2020-10-20 Local Knowledge Powered Conversational Agents Sashank Santhanam, Wei Ping, Raul Puri, Mohammad Shoeybi, Mostofa Patwary, Bryan Catanzaro arXiv_AI arXiv_AI Transformer Knowledge Pose Language_Model PDF
2020-10-19 SmartTriage: A system for personalized patient data capture, documentation generation, and decision support Ilya Valmianski, Ian M. Finn, Nave Frost, Yang Wang, Baodong Liu, James J. Zhu, Sunil Karumuri, Daniel S. Zisook arXiv_CL arXiv_CL Transformer RNN Action Medical Prediction PDF
2020-10-19 ChemBERTa: Large-Scale Self-Supervised Pretraining for Molecular Property Prediction Seyone Chithrananda, Gabe Grand, Bharath Ramsundar arXiv_CL arXiv_CL Transformer Bert Represenation_Learning Self-Supervised Face Attention Prediction PDF
2020-10-19 Parameter Norm Growth During Training of Transformers William Merrill, Vivek Ramanujan, Yoav Goldberg, Roy Schwartz, Noah Smith arXiv_CL arXiv_CL Transformer Gradient_Descent PDF
2020-10-19 End-to-End Text-to-Speech using Latent Duration based on VQ-VAE Yusuke Yasuda, Xin Wang, Junichi Yamagishi arXiv_CL arXiv_CL Transformer Optimization Speech Pose Classification Attention PDF
2020-10-19 Better Distractions: Transformer-based Distractor Generation and Multiple Choice Question Filtering Jeroen Offerijns, Suzan Verberne, Tessa Verhoef arXiv_CL arXiv_CL Transformer Bert Action Attention Text_Generation Language_Model QA PDF
2020-10-19 Heads-up! Unsupervised Constituency Parsing via Self-Attention Heads Bowen Li, Taeuk Kim, Reinald Kim Amplayo, Frank Keller arXiv_CL arXiv_CL Transformer Unsupervised Knowledge Pose Attention Language_Model PDF
2020-10-19 Query-aware Tip Generation for Vertical Search Yang Yang, Junmei Hao, Canjia Li, Zili Wang, Jingang Wang, Fuzheng Zhang, Rao Fu, Peixu Hou, Gong Zhang, Zhongyuan Wang arXiv_AI arXiv_AI Transformer RNN Review Pose Attention PDF
2020-10-19 Infusing Sequential Information into Conditional Masked Translation Model with Self-Review Mechanism Pan Xie, Zhi Cui, Xiuyin Chen, Xiaohui Hu, Jianwei Cui, Bin Wang arXiv_CL arXiv_CL Transformer Knowledge Review Pose PDF
2020-10-19 SciSummPip: An Unsupervised Scientific Paper Summarization Pipeline Jiaxin Ju, Ming Liu, Longxiang Gao, Shirui Pan arXiv_CL arXiv_CL Transformer Unsupervised Bert Summarization Language_Model PDF
2020-10-19 SAINT+: Integrating Temporal Features for EdNet Correctness Prediction Dongmin Shin, Yugeun Shim, Hangyeol Yu, Seewoo Lee, Byungsoo Kim, Youngduck Choi arXiv_AI arXiv_AI Transformer Embedding Knowledge Pose Attention Prediction PDF
2020-10-18 Chart-to-Text: Generating Natural Language Descriptions for Charts by Adapting the Transformer Model Jason Obeid, Enamul Hoque arXiv_AI arXiv_AI Transformer Text_Generation PDF
2020-10-18 Capturing Longer Context for Document-level Neural Machine Translation: A Multi-resolutional Approach Zewei Sun, Mingxuan Wang, Hao Zhou, Chengqi Zhao, Shujian Huang, Jiajun Chen, Lei Li arXiv_CL arXiv_CL Transformer Pose PDF
2020-10-18 TED: A Pretrained Unsupervised Summarization Model with Theme Modeling and Denoising Ziyi Yang, Chenguang Zhu, Robert Gmyr, Michael Zeng, Xuedong Huang, Eric Darve arXiv_CL arXiv_CL Transformer Unsupervised RNN Pose Denoising Summarization PDF
2020-10-16 CoDA: Contrast-enhanced and Diversity-promoting Data Augmentation for Natural Language Understanding Yanru Qu, Dinghan Shen, Yelong Shen, Sandra Sajeev, Jiawei Han, Weizhu Chen arXiv_CL arXiv_CL Transformer Bert Regularization Adversarial Pose Relation GAN PDF
2020-10-16 Cross-Lingual Relation Extraction with Transformers Jian Ni, Taesun Moon, Parul Awasthy, Radu Florian arXiv_AI arXiv_AI Transformer Unsupervised Zero-Shot Represenation_Learning Pose Action Relation Relation_Extraction PDF
2020-10-16 Mischief: A Simple Black-Box Attack Against Transformer Architectures Adrian de Wynter arXiv_CL arXiv_CL Transformer Adversarial Language_Model PDF
2020-10-16 Delaying Interaction Layers in Transformer-based Encoders for Efficient Open Domain Question Answering Wissam Siblini, Mohamed Challal, Charlotte Pasqual arXiv_CL arXiv_CL Transformer Bert Pose Face Action Attention Language_Model QA PDF
2020-10-16 Effective Distributed Representations for Academic Expert Search Mark Berger, Jakub Zavrel, Paul Groth arXiv_AI arXiv_AI Transformer Embedding Knowledge PDF
2020-10-16 Unsupervised Extractive Summarization by Pre-training Hierarchical Transformers Shusheng Xu, Xingxing Zhang, Yi Wu, Furu Wei, Ming Zhou arXiv_CL arXiv_CL Transformer Unsupervised Pose Attention Summarization PDF
2020-10-16 Lexicon-constrained Copying Network for Chinese Abstractive Summarization Boyan Wan, Zhuo Tang, Li Yang arXiv_CL arXiv_CL Transformer Pose Summarization PDF
2020-10-16 DiDi's Machine Translation System for WMT2020 Tanfang Chen, Weiwei Wang, Wenyang Wei, Xing Shi, Xiangang Li, Jieping Ye, Kevin Knight arXiv_AI arXiv_AI Transformer Enhancement PDF
2020-10-16 Towards Natural Bilingual and Code-Switched Speech Synthesis Based on Mix of Monolingual Recordings and Cross-Lingual Voice Conversion Shengkui Zhao, Trung Hieu Nguyen, Hao Wang, Bin Ma arXiv_SD arXiv_SD Transformer Speech PDF
2020-10-16 Modeling Token-level Uncertainty to Learn Unknown Concepts in SLU via Calibrated Dirichlet Prior RNN Yilin Shen, Wenhu Chen, Hongxia Jin arXiv_AI arXiv_AI Transformer RNN Pose PDF
2020-10-15 Revisiting Optical Flow Estimation in 360 Videos Keshav Bhandari, Ziliang Zong, Yan Yan arXiv_CV arXiv_CV Transformer Regularization Self-Supervised Pose Optical_Flow Inference PDF
2020-10-15 CXP949 at WNUT-2020 Task 2: Extracting Informative COVID-19 Tweets -- RoBERTa Ensembles and The Continued Relevance of Handcrafted Features Calum Perrio, Harish Tayyar Madabushi arXiv_CL arXiv_CL Transformer Bert Text_Classification Classification Language_Model PDF
2020-10-15 Empirical Study of Transformers for Source Code Nadezhda Chirkova, Sergey Troshin arXiv_CL arXiv_CL Transformer Prediction PDF
2020-10-15 Compressive Summarization with Plausibility and Salience Modeling Shrey Desai, Jiacheng Xu, Greg Durrett arXiv_CL arXiv_CL Transformer Salient Pose Action Summarization PDF
2020-10-15 Fixed-Length Protein Embeddings using Contextual Lenses Amir Shanehsazzadeh, David Belanger, David Dohan arXiv_CL arXiv_CL Transformer Embedding Bert Pose Classification Deep_Learning Language_Model PDF
2020-10-15 A Transformer Based Pitch Sequence Autoencoder with MIDI Augmentation Mingshuo Ding, Yinghao Ma arXiv_SD arXiv_SD Transformer Bert Pose Classification Deep_Learning Attention Language_Model PDF
2020-10-15 DialogueTRM: Exploring the Intra- and Inter-Modal Emotional Behaviors in the Conversation Yuzhao Mao, Qi Sun, Guang Liu, Xiaojie Wang, Weiguo Gao, Xuan Li, Jianping Shen arXiv_CL arXiv_CL Transformer Recognition Pose Emotion Action Prediction PDF
2020-10-15 Improving Constituency Parsing with Span Attention Yuanhe Tian, Yan Song, Fei Xia, Tong Zhang arXiv_CL arXiv_CL Transformer Pose Action Attention PDF
2020-10-15 Natural Language Rationales with Full-Stack Visual Reasoning: From Pixels to Semantic Frames to Commonsense Graphs Ana Marasović, Chandra Bhagavatula, Jae Sung Park, Ronan Le Bras, Noah A. Smith, Yejin Choi arXiv_CV arXiv_CV Image_Caption Transformer Recognition VQA Attention Language_Model PDF
2020-10-15 Context-Guided BERT for Targeted Aspect-Based Sentiment Analysis Zhengxuan Wu, Desmond C. Ong arXiv_AI arXiv_AI Transformer Bert Pose Sentiment Attention Inference Language_Model QA PDF
2020-10-15 Multi-Task Learning for Cross-Lingual Abstractive Summarization Sho Takase, Naoaki Okazaki arXiv_CL arXiv_CL Transformer Pose Summarization PDF
2020-10-14 From Language to Language-ish: How Brain-Like is an LSTM's Representation of Nonsensical Language Stimuli? Maryam Hashemzadeh, Greta Kaufeld, Martha White, Andrea E. Martin, Alona Fyshe arXiv_CL arXiv_CL Transformer Embedding RNN Action Relation Activity Language_Model PDF
2020-10-14 Length-Adaptive Transformer: Train Once with Length Drop, Use Anytime with Search Gyuwan Kim, Kyunghyun Cho arXiv_CL arXiv_CL Transformer Bert Pose Classification Inference PDF
2020-10-14 Neural Databases James Thorne, Majid Yazdani, Marzieh Saeidi, Fabrizio Silvestri, Sebastian Riedel, Alon Halevy arXiv_CL arXiv_CL Transformer Language_Model PDF
2020-10-14 DA-Transformer: Distance-aware Transformer Chuhan Wu, Fangzhao Wu, Yongfeng Huang arXiv_CL arXiv_CL Transformer Embedding Bert Pose Relation Attention PDF
2020-10-14 Memformer: The Memory-Augmented Transformer Qingyang Wu, Zhenzhong Lan, Jing Gu, Zhou Yu arXiv_CL arXiv_CL Transformer Optimization Self-Supervised Attention Inference Language_Model PDF
2020-10-13 Probing for Multilingual Numerical Understanding in Transformer-Based Language Models Devin Johnson, Denise Mak, Drew Barker, Lexi Loessberg-Zahl arXiv_CL arXiv_CL Transformer Embedding Bert Pose Classification Language_Model PDF
2020-10-13 Pretrained Transformers for Text Ranking: BERT and Beyond Jimmy Lin, Rodrigo Nogueira, Andrew Yates arXiv_CL arXiv_CL Transformer Bert Self-Supervised Survey PDF
2020-10-13 Pagsusuri ng RNN-based Transfer Learning Technique sa Low-Resource Language Dan John Velasco arXiv_CL arXiv_CL Transformer Transfer_Learning RNN Speech Face Classification GAN Language_Model PDF
2020-10-13 Interpreting Attention Models with Human Visual Attention in Machine Reading Comprehension Ekta Sood, Simon Tannert, Diego Frassinelli, Andreas Bulling, Ngoc Thang Vu arXiv_CL arXiv_CL Transformer Tracking RNN Pose Relation Attention CNN QA PDF
2020-10-13 Aspect-based Document Similarity for Research Papers Malte Ostendorff, Terry Ruas, Till Blume, Bela Gipp, Georg Rehm arXiv_CL arXiv_CL Transformer Bert RNN Quantitative Classification Recommendation PDF
2020-10-13 BRUMS at SemEval-2020 Task 12 : Transformer based Multilingual Offensive Language Identification in Social Media Tharindu Ranasinghe, Hansi Hettiarachchi arXiv_AI arXiv_AI Transformer Deep_Learning GAN PDF
2020-10-13 Context-Aware Drive-thru Recommendation Service at Fast Food Restaurants Luyang Wang, Kai Huang, Jiao Wang, Shengsheng Huang, Jason Dai, Yue Zhuang arXiv_AI arXiv_AI Transformer Pose Action Deep_Learning Recommendation PDF
2020-10-13 Model Selection for Cross-Lingual Transfer using a Learned Scoring Function Yang Chen, Alan Ritter arXiv_CL arXiv_CL Transformer Transfer_Learning Bert Zero-Shot Pose PDF
2020-10-12 Universal ASR: Unify and Improve Streaming ASR with Full-context Modeling Jiahui Yu, Wei Han, Anmol Gulati, Chung-Cheng Chiu, Bo Li, Tara N. Sainath, Yonghui Wu, Ruoming Pang arXiv_AI arXiv_AI Transformer Recognition Knowledge Speech Pose Speech_Recognition PDF
2020-10-12 End-to-End Synthetic Data Generation for Domain Adaptation of Question Answering Systems Siamak Shakeri, Cicero Nogueira dos Santos, Henry Zhu, Patrick Ng, Feng Nan, Zhiguo Wang, Ramesh Nallapati, Bing Xiang arXiv_CL arXiv_CL Transformer Pose QA PDF
2020-10-12 Chatbot Interaction with Artificial Intelligence: Human Data Augmentation with T5 and Language Transformer Ensemble for Text Classification Jordan J. Bird, Anikó Ekárt, Diego R. Faria arXiv_AI arXiv_AI Transformer Bert Text_Classification Face Action Classification Deep_Learning Attention Prediction QA PDF
2020-10-12 Extracting Angina Symptoms from Clinical Notes Using Pre-Trained Transformer Architectures Aaron S. Eisman, Nishant R. Shah, Carsten Eickhoff, George Zerveas, Elizabeth S. Chen, Wen-Chih Wu, Indra Neil Sarkar arXiv_AI arXiv_AI Transformer Action Detection Language_Model PDF
2020-10-12 Dynamic Memory Enhanced Transformer for End-to-end Task-Oriented Dialogue System Yanjie Gou, Yinjie Lei, Lingqiao Liu arXiv_CL arXiv_CL Transformer Dynamic_Memory_Network Memory_Networks Knowledge Pose PDF
2020-10-12 Probing Pretrained Language Models for Lexical Semantics Ivan Vulić, Edoardo Maria Ponti, Robert Litschko, Goran Glavaš, Anna Korhonen arXiv_CL arXiv_CL Transformer Bert Knowledge Action Language_Model PDF
2020-10-12 Load What You Need: Smaller Versions of Multilingual BERT Amine Abdaoui, Camille Pradel, Grégoire Sigel arXiv_AI arXiv_AI Transformer Embedding Bert Pose PDF
2020-10-12 Social Commonsense Reasoning with Multi-Head Knowledge Attention Debjit Paul, Anette Frank arXiv_CL arXiv_CL Transformer Bert Knowledge Pose Attention Inference Prediction PDF
2020-10-12 Meta-Context Transformers for Domain-Specific Response Generation Debanjana Kar, Suranjana Samanta, Amar Prakash Azad arXiv_CL arXiv_CL Transformer Bert Pose Attention Language_Model PDF
2020-10-12 COGS: A Compositional Generalization Challenge Based on Semantic Interpretation Najoung Kim, Tal Linzen arXiv_CL arXiv_CL Transformer RNN PDF
2020-10-12 A Progressive Conditional Generative Adversarial Network for Generating Dense and Colored 3D Point Clouds Mohammad Samiul Arshad, William J. Beksi arXiv_AI arXiv_AI Transformer Unsupervised Point_Cloud 3D Adversarial Pose PDF
2020-10-11 We Can Detect Your Bias: Predicting the Political Ideology of News Articles Ramy Baly, Giovanni Da San Martino, James Glass, Preslav Nakov arXiv_CL arXiv_CL Transformer Adversarial Pose Prediction PDF
2020-10-11 Incremental Processing in the Age of Non-Incremental Encoders: An Empirical Assessment of Bidirectional Models for Incremental NLU Brielen Madureira, David Schlangen arXiv_CL arXiv_CL Transformer Bert RNN Face Language_Model PDF
2020-10-11 InfoMiner at WNUT-2020 Task 2: Transformer-based Covid-19 Informative Tweet Extraction Hansi Hettiarachchi, Tharindu Ranasinghe arXiv_CL arXiv_CL Transformer Action GAN PDF
2020-10-11 TransQuest at WMT2020: Sentence-Level Direct Assessment Tharindu Ranasinghe, Constantin Orasan, Ruslan Mitkov arXiv_CL arXiv_CL Transformer Pose PDF
2020-10-11 Weakly Supervised Medication Regimen Extraction from Medical Conversations Dhruvesh Patel, Sandeep Konam, Sai P. Selvaraj arXiv_CL arXiv_CL Transformer Weakly_Supervised Pose Action Classification Attention Medical PDF
2020-10-11 Machine Translation of Mathematical Text Aditya Ohri, Tanya Schmah arXiv_CL arXiv_CL Transformer NMT PDF
2020-10-11 End to End Binarized Neural Networks for Text Classification Harshil Jain, Akshat Agarwal, Kumar Shridhar, Denis Kleyko arXiv_CL arXiv_CL Transformer Embedding Text_Classification Pose Classification Inference PDF
2020-10-11 fairseq S2T: Fast Speech-to-Text Modeling with fairseq Changhan Wang, Yun Tang, Xutai Ma, Anne Wu, Dmytro Okhonko, Juan Pino arXiv_CL arXiv_CL Transformer Transfer_Learning Recognition RNN Speech Speech_Recognition Inference Language_Model PDF
2020-10-11 Document-Level Definition Detection in Scholarly Documents: Existing Models, Error Analyses, and Future Directions Dongyeop Kang, Andrew Head, Risham Sidhu, Kyle Lo, Daniel S. Weld, Marti A. Hearst arXiv_CL arXiv_CL Transformer Pose Detection PDF
2020-10-10 Compressing Transformer-Based Semantic Parsing Models using Compositional Code Embeddings Prafull Prakash, Saurabh Kumar Shashidhar, Wenlong Zhao, Subendhu Rongali, Haidar Khan, Michael Kayser arXiv_CL arXiv_CL Transformer Embedding Bert Pose PDF
2020-10-10 Structured Self-Attention Weights Encode Semantics in Sentiment Analysis Zhengxuan Wu, Thanh-Son Nguyen, Desmond C. Ong arXiv_AI arXiv_AI Transformer Review Pose Emotion Face Quantitative Sentiment Attention Prediction PDF
2020-10-10 What Do Position Embeddings Learn? An Empirical Study of Pre-Trained Language Model Positional Encoding Yu-An Wang, Yun-Nung Chen arXiv_AI arXiv_AI Transformer Embedding Attention Language_Model PDF
2020-10-10 Information Extraction from Swedish Medical Prescriptions with Sig-Transformer Encoder John Pougue Biyong, Bo Wang, Terry Lyons, Alejo J Nevado-Holgado arXiv_CL arXiv_CL Transformer Embedding Bert Pose Action Attention Medical Language_Model Prediction PDF
2020-10-10 Discourse structure interacts with reference but not syntax in neural language models Forrest Davis, Marten van Schijndel arXiv_CL arXiv_CL Transformer Action Language_Model PDF
2020-10-10 Adversarial Self-Supervised Data-Free Distillation for Text Classification Xinyin Ma, Yongliang Shen, Gongfan Fang, Chen Chen, Chenghao Jia, Weiming Lu arXiv_AI arXiv_AI Transformer Embedding Bert Text_Classification Knowledge Adversarial Self-Supervised Pose Classification Text_Generation Language_Model PDF
2020-10-09 On Task-Level Dialogue Composition of Generative Transformer Model Prasanna Parthasarathi, Arvind Neelakantan, Sharan Narang arXiv_AI arXiv_AI Transformer Pose PDF
2020-10-09 ChrEn: Cherokee-English Machine Translation for Endangered Language Revitalization Shiyue Zhang, Benjamin Frey, Mohit Bansal arXiv_AI arXiv_AI Transformer Transfer_Learning Bert RNN Pose NMT Language_Model PDF
2020-10-09 Online Back-Parsing for AMR-to-Text Generation Xuefeng Bai, Linfeng Song, Yue Zhang arXiv_CL arXiv_CL Transformer Pose Text_Generation Language_Model PDF
2020-10-09 Contralaterally Enhanced Networks for Thoracic Disease Detection Gangming Zhao, Chaowei Fang, Guanbin Li, Licheng Jiao, Yizhou Yu arXiv_AI arXiv_AI Transformer Weakly_Supervised Pose Detection PDF
2020-10-09 The NU Voice Conversion System for the Voice Conversion Challenge 2020: On the Effectiveness of Sequence-to-sequence Models and Autoregressive Neural Vocoders Wen-Chin Huang, Patrick Lumban Tobing, Yi-Chiao Wu, Kazuhiro Kobayashi, Tomoki Toda arXiv_CL arXiv_CL Transformer Speech PDF
2020-10-09 TurboTransformers: An Efficient GPU Serving System For Transformer Models Jiarui Fang, Yang Yu, Chengduo Zhao, Jie Zhou arXiv_AI arXiv_AI Transformer Optimization RNN Pose PDF
2020-10-08 Masked ELMo: An evolution of ELMo towards fully contextual RNN language models Gregory Senay, Emmanuelle Salin arXiv_CL arXiv_CL Transformer Bert Optimization RNN Language_Model PDF
2020-10-08 Query-Key Normalization for Transformers Alex Henry, Prudhvi Raj Dachapally, Shubham Pawar, Yuxuan Chen arXiv_AI arXiv_AI Transformer Embedding Pose Attention PDF
2020-10-08 Gender domain adaptation for automatic speech recognition task Sokolov Artem, Andrey V. Savchenko arXiv_SD arXiv_SD Transformer Embedding Recognition Speech Speech_Recognition PDF
2020-10-08 PoinT-5: Pointer Network and T-5 based Financial NarrativeSummarisation Abhishek Singh arXiv_CL arXiv_CL Transformer Pose PDF
2020-10-08 Deformable DETR: Deformable Transformers for End-to-End Object Detection Xizhou Zhu, Weijie Su, Lewei Lu, Bin Li, Xiaogang Wang, Jifeng Dai arXiv_CV arXiv_CV Transformer Pose Detection Object_Detection Attention PDF
2020-10-08 Interlocking Backpropagation: Improving depthwise model-parallelism Aidan N. Gomez, Oscar Key, Stephen Gou, Nick Frosst, Jeff Dean, Yarin Gal arXiv_AI arXiv_AI Transformer Classification Image_Classification Language_Model PDF
2020-10-08 A Co-Interactive Transformer for Joint Slot Filling and Intent Detection Libo Qin, Tailu Liu, Wanxiang Che, Bingbing Kang, Sendong Zhao, Ting Liu arXiv_CL arXiv_CL Transformer Knowledge Pose Action Detection Attention PDF
2020-10-08 Improving Attention Mechanism with Query-Value Interaction Chuhan Wu, Fangzhao Wu, Tao Qi, Yongfeng Huang arXiv_CL arXiv_CL Transformer Bert Pose Action Attention PDF
2020-10-08 Assessing Phrasal Representation and Composition in Transformers Lang Yu, Allyson Ettinger arXiv_CL arXiv_CL Transformer Recommendation PDF
2020-10-08 Shallow-to-Deep Training for Neural Machine Translation Bei Li, Ziyang Wang, Hui Liu, Yufan Jiang, Quan Du, Tong Xiao, Huizhen Wang, Jingbo Zhu arXiv_CL arXiv_CL Transformer NMT PDF
2020-10-08 Learning to Fuse Sentences with Transformers for Summarization Logan Lebanoff, Franck Dernoncourt, Doo Soon Kim, Lidan Wang, Walter Chang, Fei Liu arXiv_CL arXiv_CL Transformer Knowledge Pose Summarization PDF
2020-10-08 Don't Parse, Insert: Multilingual Semantic Parsing with Insertion Based Decoding Qile Zhu, Haidar Khan, Saleh Soltan, Stephen Rawls, Wael Hamza arXiv_AI arXiv_AI Transformer Transfer_Learning Zero-Shot Pose Action Inference PDF
2020-10-07 Optimizing Transformers with Approximate Computing for Faster, Smaller and more Accurate NLP Models Amrit Nagarajan, Sanchari Sen, Jacob R. Stevens, Anand Raghunathan arXiv_AI arXiv_AI Transformer Quantization Transfer_Learning Bert Pose Attention Matching PDF
2020-10-07 Cross-Thought for Sentence Encoder Pre-training Shuohang Wang, Yuwei Fang, Siqi Sun, Zhe Gan, Yu Cheng, Jing Jiang, Jingjing Liu arXiv_CL arXiv_CL Transformer Embedding Pose Language_Model QA PDF
2020-10-07 A Self-supervised Approach for Semantic Indexing in the Context of COVID-19 Pandemic Nima Ebadi, Peyman Najafirad arXiv_CL arXiv_CL Transformer Represenation_Learning Self-Supervised Pose Medical PDF
2020-10-07 Inductive Entity Representations from Text via Link Prediction Daniel Daza, Michael Cochez, Paul Groth arXiv_AI arXiv_AI Transformer Knowledge Knowledge_Graph Classification Prediction PDF
2020-10-07 Improving Sentiment Analysis over non-English Tweets using Multilingual Transformers and Automatic Translation for Data-Augmentation Valentin Barriere, Alexandra Balahur arXiv_CL arXiv_CL Transformer Pose Sentiment PDF
2020-10-07 Super-Human Performance in Online Low-latency Recognition of Conversational Speech Thai-Son Nguyen, Sebastian Stueker, Alex Waibel arXiv_CV arXiv_CV Transformer Recognition Speech Attention PDF
2020-10-07 Transformer-GCRF: Recovering Chinese Dropped Pronouns with General Conditional Random Fields Jingxuan Yang, Kerui Xu, Jun Xu, Si Li, Sheng Gao, Jun Guo, Ji-Rong Wen, Nianwen Xue arXiv_CL arXiv_CL Transformer PDF
2020-10-07 Unsupervised Evaluation for Question Answering with Transformers Lukas Muttenthaler, Isabelle Augenstein, Johannes Bjerva arXiv_AI arXiv_AI Transformer Unsupervised Inference QA PDF
2020-10-07 Transformer Transducer: One Model Unifying Streaming and Non-streaming Speech Recognition Anshuman Tripathi, Jaeyoung Kim, Qian Zhang, Han Lu, Hasim Sak arXiv_SD arXiv_SD Transformer Recognition Optimization Speech Pose Speech_Recognition Inference PDF
2020-10-07 Transfer Learning and Distant Supervision for Multilingual Transformer Models: A Study on African Languages Michael A. Hedderich, David Adelani, Dawei Zhu, Jesujoba Alabi, Udia Markus, Dietrich Klakow arXiv_CL arXiv_CL Transformer Transfer_Learning Bert Classification PDF
2020-10-07 Knowledge-aware Method for Confusing Charge Prediction Xiya Cheng, Sheng Bi, Guilin Qi, Yongzhen Wang arXiv_AI arXiv_AI Transformer Knowledge Pose CNN Prediction Matching PDF
2020-10-06 Resource-Enhanced Neural Model for Event Argument Extraction Jie Ma, Shuai Wang, Rishita Anubhai, Miguel Ballesteros, Yaser Al-Onaizan arXiv_CL arXiv_CL Transformer Pose Action Attention PDF
2020-10-06 GATE: Graph Attention Transformer Encoder for Cross-lingual Relation and Event Extraction Wasi Uddin Ahmad, Nanyun Peng, Kai-Wei Chang arXiv_CL arXiv_CL Transformer Pose Action Relation Attention CNN PDF
2020-10-06 Learning to Represent Image and Text with Denotation Graph Bowen Zhang, Hexiang Hu, Vihan Jain, Eugene Ie, Fei Sha arXiv_CV arXiv_CV Image_Caption Transformer Recognition Image_Retrieval Pose Relation Attention Language_Model PDF
2020-10-06 Vector-Vector-Matrix Architecture: A Novel Hardware-Aware Framework for Low-Latency Inference in NLP Applications Matthew Khoury, Rumen Dangovski, Longwu Ou, Preslav Nakov, Yichen Shen, Li Jing arXiv_CL arXiv_CL Transformer Pose NMT Inference PDF
2020-10-06 PRover: Proof Generation for Interpretable Reasoning over Rules Swarnadeep Saha, Sayan Ghosh, Shashank Srivastava, Mohit Bansal arXiv_AI arXiv_AI Transformer Zero-Shot Knowledge Inference QA PDF
2020-10-06 A Transformer-based Framework for Multivariate Time Series Representation Learning George Zerveas, Srideepika Jayaraman, Dhaval Patel, Anuradha Bhamidipaty, Carsten Eickhoff arXiv_AI arXiv_AI Transformer Unsupervised Represenation_Learning Pose Classification PDF
2020-10-06 Stepwise Extractive Summarization and Planning with Structured Transformers Shashi Narayan, Joshua Maynez, Jakub Adamek, Daniele Pighin, Blaž Bratanič, Ryan McDonald arXiv_CL arXiv_CL Transformer Bert Pose Summarization Text_Generation PDF
2020-10-06 Neural Mask Generator: Learning to Generate Adaptive Word Maskings for Language Model Adaptation Minki Kang, Moonsu Han, Sung Ju Hwang arXiv_AI arXiv_AI Transformer Reinforcement_Learning Bert Text_Classification Regularization Self-Supervised Pose Classification Language_Model PDF
2020-10-06 Incorporating Behavioral Hypotheses for Query Generation Ruey-Cheng Chen, Chia-Jung Lee arXiv_CL arXiv_CL Transformer Bert Pose PDF
2020-10-06 On the Sub-Layer Functionalities of Transformer Decoder Yilin Yang, Longyue Wang, Shuming Shi, Prasad Tadepalli, Stefan Lee, Zhaopeng Tu arXiv_AI arXiv_AI Transformer NMT Inference PDF
2020-10-06 On the Interplay Between Fine-tuning and Sentence-level Probing for Linguistic Knowledge in Pre-trained Transformers Marius Mosbach, Anna Khokhlova, Michael A. Hedderich, Dietrich Klakow arXiv_CL arXiv_CL Transformer Embedding Bert Knowledge PDF
2020-10-06 Converting the Point of View of Messages Spoken to Virtual Assistants Isabelle G. Lee, Vera Zu, Sai Srujana Buddi, Dennis Liang, Jack G.M. Fitzgerald arXiv_AI arXiv_AI Transformer Text_Classification RNN Speech Pose NMT Classification Language_Model PDF
2020-10-06 Scene Graph Modification Based on Natural Language Commands Xuanli He, Quan Hung Tran, Gholamreza Haffari, Walter Chang, Trung Bui, Zhe Lin, Franck Dernoncourt, Nhan Dam arXiv_CL arXiv_CL Transformer Sparse Face Attention PDF
2020-10-06 Unsupervised Hierarchical Concept Learning Sumegh Roychowdhury, Sumedh A. Sontakke, Nikaash Puri, Mausoom Sarkar, Milan Aggarwal, Pinkesh Badjatiya, Balaji Krishnamurthy, Laurent Itti arXiv_AI arXiv_AI Transformer Unsupervised Action Relation GAN PDF
2020-10-06 Investigating African-American Vernacular English in Transformer-Based Text Generation Sophie Groenwold, Lily Ou, Aesha Parekh, Samhita Honnavalli, Sharon Levy, Diba Mirza, William Yang Wang arXiv_AI arXiv_AI Transformer Classification Sentiment Text_Generation PDF
2020-10-06 UNQOVERing Stereotyping Biases via Underspecified Questions Tao Li, Daniel Khashabi, Tushar Khot, Ashish Sabharwal, Vivek Srikumar arXiv_CL arXiv_CL Transformer Embedding Language_Model QA PDF
2020-10-06 Efficient Inference For Neural Machine Translation Yi-Te Hsu, Sarthak Garg, Yi-Hsiu Liao, Ilya Chatsviorkin arXiv_CL arXiv_CL Transformer Attention Inference PDF
2020-10-06 Adversarial Grammatical Error Correction Vipul Raheja, Dimitrios Alikaniotis arXiv_AI arXiv_AI Transformer Adversarial NMT Classification GAN PDF
2020-10-06 Guiding Attention for Self-Supervised Learning with Transformers Ameet Deshpande, Karthik Narasimhan arXiv_CL arXiv_CL Transformer Self-Supervised Pose Attention Language_Model PDF
2020-10-05 Mixup-Transfomer: Dynamic Data Augmentation for NLP Tasks Lichao Sun, Congying Xia, Wenpeng Yin, Tingting Liang, Philip S. Yu, Lifang He arXiv_CL arXiv_CL Transformer Bert Pose Classification Image_Classification Language_Model PDF
2020-10-05 Improving Neural Topic Models using Knowledge Distillation Alexander Hoyle, Pranav Goel, Philip Resnik arXiv_CL arXiv_CL Transformer Knowledge PDF
2020-10-05 Investigating representations of verb bias in neural language models Robert D. Hawkins, Takateru Yamakoshi, Thomas L. Griffiths, Adele E. Goldberg arXiv_CL arXiv_CL Transformer RNN Language_Model PDF
2020-10-05 Adaptive Automotive Radar data Acquisition Madhumitha Sakthi, Ahmed Tewfik arXiv_CV arXiv_CV Transformer Detection Object_Detection Autonomous PDF
2020-10-05 PAIR: Planning and Iterative Refinement in Pre-trained Transformers for Long Text Generation Xinyu Hua, Lu Wang arXiv_CL arXiv_CL Transformer Bert Pose Text_Generation PDF
2020-10-05 Learned Hardware/Software Co-Design of Neural Accelerators Zhan Shi, Chirag Sakhuja, Milad Hashemi, Kevin Swersky, Calvin Lin arXiv_AI arXiv_AI Transformer Optimization Deep_Learning PDF
2020-10-05 Modulated Fusion using Transformer for Linguistic-Acoustic Emotion Recognition Jean-Benoit Delbrouck, Noé Tits, Stéphane Dupont arXiv_CL arXiv_CL Transformer Recognition Pose Emotion Sentiment PDF
2020-10-05 PUM at SemEval-2020 Task 12: Aggregation of Transformer-based models' features for offensive language recognition Piotr Janiszewski, Mateusz Skiba, Urszula Walińska arXiv_CL arXiv_CL Transformer Recognition Bert PDF
2020-10-05 Pruning Redundant Mappings in Transformer Models via Spectral-Normalized Identity Prior Zi Lin, Jeremiah Zhe Liu, Zi Yang, Nan Hua, Dan Roth arXiv_CL arXiv_CL Transformer Bert Pose Attention PDF
2020-10-05 How Effective is Task-Agnostic Data Augmentation for Pretrained Transformers? Shayne Longpre, Yu Wang, Christopher DuBois arXiv_AI arXiv_AI Transformer Bert Classification PDF
2020-10-05 Transformer-Based Neural Text Generation with Syntactic Guidance Yinghao Li (Georgia Institute of Technology), Rui Feng (Georgia Institute of Technology), Isaac Rehg (Georgia Institute of Technology), Chao Zhang (Georgia Institute of Technology) arXiv_CL arXiv_CL Transformer Pose Attention Text_Generation PDF
2020-10-04 DLGNet-Task: An End-to-end Neural Network Framework for Modeling Multi-turn Multi-domain Task-Oriented Dialogue Oluwatobi O. Olabiyi, Prarthana Bhattarai, C. Bayan Bruss, Zachary Kulis arXiv_AI arXiv_AI Transformer Tracking Action PDF
2020-10-04 An Empirical Study on Large-Scale Multi-Label Text Classification Including Few and Zero-Shot Labels Ilias Chalkidis, Manos Fergadiotis, Sotiris Kotitsas, Prodromos Malakasiotis, Nikolaos Aletras, Ion Androutsopoulos arXiv_CL arXiv_CL Transformer Transfer_Learning Bert Zero-Shot Text_Classification Pose Classification Attention PDF
2020-10-04 When in Doubt, Ask: Generating Answerable and Unanswerable Questions, Unsupervised Liubov Nikolenko, Pouya Rezazadeh Kalehbasti arXiv_CL arXiv_CL Transformer Unsupervised Language_Model QA PDF
2020-10-04 Holistic static and animated 3D scene generation from diverse text descriptions Faria Huq, Anindya Iqbal, Nafees Ahmed arXiv_CV arXiv_CV Transformer 3D Scene_Generation Pose Action Inference PDF
2020-10-04 Multi-turn Response Selection using Dialogue Dependency Relations Qi Jia, Yizhu Liu, Siyu Ren, Kenny Q. Zhu, Haifeng Tang arXiv_CL arXiv_CL Transformer Pose Action Relation Attention Language_Model Matching PDF
2020-10-04 Paragraph-Level Commonsense Transformers with Recurrent Memory Saadia Gabriel, Chandra Bhagavatula, Vered Shwartz, Ronan Le Bras, Maxwell Forbes, Yejin Choi arXiv_CL arXiv_CL Transformer Knowledge Inference PDF
2020-10-04 Tell Me How to Ask Again: Question Data Augmentation with Controllable Rewriting in Continuous Space Dayiheng Liu, Yeyun Gong, Jie Fu, Yu Yan, Jiusheng Chen, Jiancheng Lv, Nan Duan, Ming Zhou arXiv_CL arXiv_CL Transformer Embedding Optimization Pose Inference PDF
2020-10-03 Multilevel Text Alignment with Cross-Document Attention Xuhui Zhou, Nikolaos Pappas, Noah A. Smith arXiv_CL arXiv_CL Transformer Weakly_Supervised Pose Detection Relation Attention Recommendation PDF
2020-10-02 Cross-Lingual Transfer Learning for Complex Word Identification George-Eduard Zaharia, Dumitru-Clementin Cercel, Mihai Dascalu arXiv_CL arXiv_CL Transformer Transfer_Learning Zero-Shot Pose Few-Shot PDF
2020-10-02 LUKE: Deep Contextualized Entity Representations with Entity-aware Self-attention Ikuya Yamada, Akari Asai, Hiroyuki Shindo, Hideaki Takeda, Yuji Matsumoto arXiv_CL arXiv_CL Transformer Recognition Bert Pose Classification Relation Attention Language_Model PDF
2020-10-02 Training Strategies to Handle Missing Modalities for Audio-Visual Expression Recognition Srinivas Parthasarathy, Shiva Sundaram arXiv_SD arXiv_SD Transformer Recognition Pose Action PDF
2020-10-01 ISAAQ -- Mastering Textbook Questions with Pre-trained Transformers and Bottom-Up and Top-Down Attention Jose Manuel Gomez-Perez, Raul Ortega arXiv_AI arXiv_AI Transformer Relation VQA Attention Language_Model QA PDF
2020-10-01 CoLAKE: Contextualized Language and Knowledge Embedding Tianxiang Sun, Yunfan Shao, Xipeng Qiu, Qipeng Guo, Yaru Hu, Xuanjing Huang, Zheng Zhang arXiv_AI arXiv_AI Transformer Embedding Bert Knowledge Knowledge_Graph Pose Language_Model PDF
2020-10-01 Phonemer at WNUT-2020 Task 2: Sequence Classification Using COVID Twitter BERT and Bagging Ensemble Technique based on Plurality Voting Anshul Wadhawan arXiv_CL arXiv_CL Transformer Bert RNN Pose Classification Deep_Learning PDF
2020-10-01 WeChat Neural Machine Translation Systems for WMT20 Fandong Meng, Jianhao Yan, Yijin Liu, Yuan Gao, Xianfeng Zeng, Qinsong Zeng, Peng Li, Ming Chen, Jie Zhou, Sifan Liu, Hao Zhou arXiv_AI arXiv_AI Transformer Knowledge PDF
2020-10-01 A Compare Aggregate Transformer for Understanding Document-grounded Dialogue Longxuan Ma, Weinan Zhang, Runxin Sun, Ting Liu arXiv_CL arXiv_CL Transformer Knowledge Pose PDF
2020-10-01 Examining the rhetorical capacities of neural language models Zining Zhu, Chuer Pan, Mohamed Abdalla, Frank Rudzicz arXiv_CL arXiv_CL Transformer Bert Knowledge Pose Quantitative Language_Model PDF
2020-09-30 Rethinking Attention with Performers Krzysztof Choromanski, Valerii Likhosherstov, David Dohan, Xingyou Song, Andreea Gane, Tamas Sarlos, Peter Hawkins, Jared Davis, Afroz Mohiuddin, Lukasz Kaiser, David Belanger, Lucy Colwell, Adrian Weller arXiv_CL arXiv_CL Transformer Sparse Pose Attention Prediction PDF
2020-09-30 Measuring Systematic Generalization in Neural Proof Generation with Transformers Nicolas Gontier, Koustuv Sinha, Siva Reddy, Christopher Pal arXiv_AI arXiv_AI Transformer Knowledge Pose Relation Inference Language_Model PDF
2020-09-30 Learning Hard Retrieval Cross Attention for Transformer Hongfei Xu, Qiuhui Liu arXiv_CL arXiv_CL Transformer Pose Attention Inference PDF
2020-09-30 Explainable Natural Language Reasoning via Conceptual Unification Marco Valentino, Mokanarangan Thayaparan, André Freitas arXiv_AI arXiv_AI Transformer Unsupervised Pose Action Inference Prediction PDF
2020-09-30 TaxiNLI: Taking a Ride up the NLU Hill Pratik Joshi, Somak Aditya, Aalok Sathe, Monojit Choudhury arXiv_AI arXiv_AI Transformer Pose Inference PDF
2020-09-29 Gender prediction using limited Twitter Data Maaike Burghoorn, Maaike H.T. de Boer, Stephan Raaijmakers arXiv_AI arXiv_AI Transformer Embedding Bert Classification Detection Prediction PDF
2020-09-29 Sequence-to-Sequence Learning for Indonesian Automatic Question Generator Ferdiant Joshua Muis (1), Ayu Purwarianti (1 and 2) ((1) Institut Teknologi Bandung, (2) U-CoE AI-VLB) arXiv_CL arXiv_CL Transformer RNN QA PDF
2020-09-29 A Simple but Tough-to-Beat Data Augmentation Approach for Natural Language Understanding and Generation Dinghan Shen, Mingzhi Zheng, Yelong Shen, Yanru Qu, Weizhu Chen arXiv_AI arXiv_AI Transformer Adversarial Pose PDF
2020-09-29 Knowledge Fusion Transformers for Video Action Recognition Ganesh Samarth, Sheetal Ojha, Nikhil Pareek arXiv_CV arXiv_CV Transformer Recognition 3D Knowledge Action_Recognition Action Classification Attention PDF
2020-09-28 VIVO: Surpassing Human Performance in Novel Object Captioning with Visual Vocabulary Pre-Training Xiaowei Hu, Xi Yin, Kevin Lin, Lijuan Wang, Lei Zhang, Jianfeng Gao, Zicheng Liu arXiv_CV arXiv_CV Image_Caption Transformer Caption Prediction Matching PDF
2020-09-28 Improve Transformer Models with Better Relative Position Embeddings Zhiheng Huang, Davis Liang, Peng Xu, Bing Xiang arXiv_CL arXiv_CL Transformer Embedding Review Pose Action Attention PDF
2020-09-28 Transformers Are Better Than Humans at Identifying Generated Text Antonis Maronikolakis, Mark Stevenson, Hinrich Schutze arXiv_CL arXiv_CL Transformer Deep_Learning Activity Language_Model PDF
2020-09-28 Deep Transformers with Latent Depth Xian Li, Asa Cooper Stickland, Yuqing Tang, Xiang Kong arXiv_CL arXiv_CL Transformer Pose Language_Model PDF
2020-09-28 SPARTA: Efficient Open-Domain Question Answering via Sparse Transformer Matching Retrieval Tiancheng Zhao, Xiaopeng Lu, Kyusong Lee arXiv_CL arXiv_CL Transformer Sparse Pose QA Matching PDF
2020-09-28 Fancy Man Lauches Zippo at WNUT 2020 Shared Task-1: A Bert Case Model for Wet Lab Entity Extraction Haoding Meng, Qingcheng Zeng, Xiaoyang Fang, Zhexin Liang arXiv_CL arXiv_CL Transformer Bert RNN Action Deep_Learning Attention PDF
2020-09-27 TernaryBERT: Distillation-aware Ultra-low Bit BERT Wei Zhang, Lu Hou, Yichun Yin, Lifeng Shang, Xiao Chen, Xin Jiang, Qun Liu arXiv_CL arXiv_CL Transformer Quantization Bert Knowledge Pose PDF
2020-09-26 Techniques to Improve Q&A Accuracy with Transformer-based models on Large Complex Documents Chejui Liao, Tabish Maniar, Sravanajyothi N, Anantha Sharma arXiv_CL arXiv_CL Transformer Bert PDF
2020-09-25 BET: A Backtranslation Approach for Easy Data Augmentation in Transformer-based Paraphrase Identification Context Jean-Philippe Corbeil, Hadi Abdi Ghadivel arXiv_CL arXiv_CL Transformer Bert Deep_Learning PDF
2020-09-25 A little goes a long way: Improving toxic language classification despite data scarcity Mika Juuti, Tommi Gröndahl, Adrian Flanagan, N. Asokan arXiv_CL arXiv_CL Transformer Bert Classification Detection PDF
2020-09-23 Multi-Pass Transformer for Machine Translation Peng Gao, Chiori Hori, Shijie Geng, Takaaki Hori, Jonathan Le Roux arXiv_CL arXiv_CL Transformer NAS Pose PDF
2020-09-23 X-LXMERT: Paint, Caption and Answer Questions with Multi-Modal Transformers Jaemin Cho, Jiasen Lu, Dustin Schwenk, Hannaneh Hajishirzi, Aniruddha Kembhavi arXiv_AI arXiv_AI Image_Caption Transformer Bert VQA Caption Language_Model PDF
2020-09-23 On the Ability of Self-Attention Networks to Recognize Counter Languages Satwik Bhattamishra, Kabir Ahuja, Navin Goyal arXiv_CL arXiv_CL Transformer RNN Attention PDF
2020-09-23 A Token-wise CNN-based Method for Sentence Compression Weiwei Hou, Hanna Suominen, Piotr Koniusz, Sabrina Caldwell, Tom Gedeon arXiv_CL arXiv_CL Transformer Bert RNN Pose CNN PDF
2020-09-23 A Comparative Study on Structural and Semantic Properties of Sentence Embeddings Alexander Kalinowski, Yuan An arXiv_CL arXiv_CL Transformer Embedding Bert Knowledge Knowledge_Graph Pose Action Relation Relation_Extraction PDF
2020-09-23 Hierarchical Pre-training for Sequence Labelling in Spoken Dialog Emile Chapuis, Pierre Colombo, Matteo Manica, Matthieu Labeau, Chloe Clavel arXiv_AI arXiv_AI Transformer Pose Emotion Sentiment PDF
2020-09-23 Hamming OCR: A Locality Sensitive Hashing Neural Network for Scene Text Recognition Bingcong Li, Xin Tang, Xianbiao Qi, Yihao Chen, Rong Xiao arXiv_AI arXiv_AI Transformer Embedding Recognition OCR Pose Scene_Text Classification Attention PDF
2020-09-21 Composed Variational Natural Language Generation for Few-shot Intents Congying Xia, Caiming Xiong, Philip Yu, Richard Socher arXiv_CL arXiv_CL Transformer Regularization Pose Action Detection Few-Shot PDF
2020-09-21 UCD-CS at W-NUT 2020 Shared Task-3: A Text to Text Approach for COVID-19 Event Extraction on Social Media Congcong Wang, David Lillis arXiv_CL arXiv_CL Transformer Action Prediction PDF
2020-09-21 WESSA at SemEval-2020 Task 9: Code-Mixed Sentiment Analysis using Transformers Ahmed Sultan (WideBot), Mahmoud Salim (WideBot), Amina Gaber (WideBot), Islam El Hosary (WideBot) arXiv_AI arXiv_AI Transformer Transfer_Learning Bert Sentiment Language_Model PDF
2020-09-21 Empathetic Dialogue Generation via Knowledge Enhancing and Emotion Dependency Modeling Qintong Li, Piji Li, Zhumin Chen, Zhaochun Ren arXiv_CL arXiv_CL Transformer Knowledge Pose Emotion Action Attention PDF
2020-09-21 Alleviating the Inequality of Attention Heads for Neural Machine Translation Zewei Sun, Shujian Huang, Xinyu Dai, Jiajun Chen arXiv_CL arXiv_CL Transformer Pose Attention PDF
2020-09-20 Persian Ezafe Recognition Using Transformers and Its Role in Part-Of-Speech Tagging Ehsan Doostmohammadi, Minoo Nassajian, Adel Rahimi arXiv_CL arXiv_CL Transformer Recognition Bert Speech PDF
2020-09-20 Energy-Based Reranking: Improving Neural Machine Translation Using Energy-Based Models Subhajit Naskar, Amirmohammad Rooshenas, Simeng Sun, Mohit Iyyer, Andrew McCallum arXiv_CL arXiv_CL Transformer NMT PDF
2020-09-19 Towards Computational Linguistics in Minangkabau Language: Studies on Sentiment Analysis and Machine Translation Fajri Koto, Ikhwan Koto arXiv_CL arXiv_CL Transformer RNN Classification Sentiment PDF
2020-09-19 BioALBERT: A Simple and Effective Pre-trained Language Model for Biomedical Named Entity Recognition Usman Naseem, Matloob Khushi, Vinay Reddy, Sakthivel Rajendran, Imran Razzak, Jinman Kim arXiv_CL arXiv_CL Transformer Recognition Bert Self-Supervised Pose Medical Language_Model PDF
2020-09-19 Long-Short Term Masking Transformer: A Simple but Effective Baseline for Document-level Neural Machine Translation Pei Zhang, Boxing Chen, Niyu Ge, Kai Fan arXiv_AI arXiv_AI Transformer Pose NMT Attention PDF
2020-09-18 The birth of Romanian BERT Stefan Daniel Dumitrescu, Andrei-Marius Avram, Sampo Pyysalo arXiv_CL arXiv_CL Transformer Bert Language_Model PDF
2020-09-18 Hierarchical GPT with Congruent Transformers for Multi-Sentence Language Models Jihyeon Roh, Huiseong Gim, Soo-Young Lee arXiv_CL arXiv_CL Transformer Embedding Pose Attention Language_Model PDF
2020-09-17 Self-Supervised Meta-Learning for Few-Shot Natural Language Classification Tasks Trapit Bansal, Rishikesh Jha, Tsendsuren Munkhdalai, Andrew McCallum arXiv_CL arXiv_CL Transformer Self-Supervised Pose Classification Few-Shot Language_Model PDF
2020-09-17 GraphCodeBERT: Pre-training Code Representations with Data Flow Daya Guo, Shuo Ren, Shuai Lu, Zhangyin Feng, Duyu Tang, Shujie Liu, Long Zhou, Nan Duan, Jian Yin, Daxin Jiang, Ming Zhou arXiv_CL arXiv_CL Transformer Bert Detection Relation Attention Summarization Language_Model PDF
2020-09-17 Learning to Identify Physical Parameters from Video Using Differentiable Physics Rama Krishna Kandukuri, Jan Achterhold, Michael Möller, Jörg Stückler arXiv_CV arXiv_CV Transformer Represenation_Learning Video_Prediction Self-Supervised Pose Action Deep_Learning Attention Activity Prediction PDF
2020-09-17 DSC IIT-ISM at SemEval-2020 Task 6: Boosting BERT with Dependencies for Definition Extraction Aadarsh Singh, Priyanshu Kumar, Aman Sinha arXiv_CL arXiv_CL Transformer Bert Pose Action CNN Language_Model PDF
2020-09-17 ISCAS at SemEval-2020 Task 5: Pre-trained Transformers for Counterfactual Statement Modeling Yaojie Lu, Annan Li, Hongyu Lin, Xianpei Han, Le Sun arXiv_CL arXiv_CL Transformer Action PDF
2020-09-17 Multi^2OIE: Multilingual Open Information Extraction based on Multi-Head Attention with BERT Youngbin Ro, Yukyung Lee, Pilsung Kang arXiv_CL arXiv_CL Transformer Bert Pose Action Attention PDF
2020-09-17 Efficient Transformer-based Large Scale Language Representations using Hardware-friendly Block Structured Pruning Bingbing Li, Zhenglun Kong, Tianyun Zhang, Ji Li, Zhengang Li, Hang Liu, Caiwen Ding arXiv_AI arXiv_AI Transformer Bert Optimization Knowledge Pose Language_Model PDF
2020-09-17 Towards Fully 8-bit Integer Inference for the Transformer Model Ye Lin, Yanyang Li, Tengbo Liu, Tong Xiao, Tongran Liu, Jingbo Zhu arXiv_CL arXiv_CL Transformer Quantization Inference Language_Model PDF
2020-09-17 Cross-Modal Alignment with Mixture Experts Neural Network for Intral-City Retail Recommendation Po Li, Lei Li, Yan Fu, Jun Rong, Yu Zhang arXiv_CV arXiv_CV Image_Caption Transformer Embedding Bert Pose Action Prediction Recommendation PDF
2020-09-17 Dissecting Lottery Ticket Transformers: Structural and Behavioral Study of Sparse Neural Machine Translation Rajiv Movva, Jason Y. Zhao arXiv_CL arXiv_CL Transformer Sparse NMT Attention PDF
2020-09-16 Document-level Neural Machine Translation with Document Embeddings Shu Jiang, Hai Zhao, Zuchao Li, Bao-Liang Lu arXiv_CL arXiv_CL Transformer Embedding Pose NMT PDF
2020-09-16 Transformer Based Multi-Source Domain Adaptation Dustin Wright, Isabelle Augenstein arXiv_CL arXiv_CL Transformer Unsupervised RNN Adversarial Attention Prediction PDF
2020-09-16 Deep Learning Approaches for Extracting Adverse Events and Indications of Dietary Supplements from Clinical Text Yadan Fan, Sicheng Zhou, Yifan Li, Rui Zhang arXiv_CL arXiv_CL Transformer Recognition Bert RNN Knowledge Action Deep_Learning Relation Relation_Extraction Attention CNN PDF
2020-09-16 Automated Source Code Generation and Auto-completion Using Deep Learning: Comparing and Discussing Current Language-Model-Related Approaches Juan Cruz-Benito (1), Sanjay Vishwakarma (2), Francisco Martin-Fernandez (1), Ismael Faro (1) ((1) IBM Quantum, (2) Electrical and Computer Engineering. Carnegie Mellon University) arXiv_CL arXiv_CL Transformer Transfer_Learning RNN Deep_Learning Attention Text_Generation Language_Model PDF
2020-09-16 NABU -- Multilingual Graph-based Neural RDF Verbalizer Diego Moussallem, Dwaraknath Gnaneshwar, Thiago Castro Ferreira, Axel-Cyrille Ngonga Ngomo arXiv_CL arXiv_CL Transformer Knowledge Knowledge_Graph Attention PDF
2020-09-16 Reasoning about Goals, Steps, and Temporal Ordering with WikiHow Qing Lyu, Li Zhang, Chris Callison-Burch arXiv_CL arXiv_CL Transformer Knowledge Pose Relation Few-Shot Inference PDF
2020-09-16 Graph-to-Sequence Neural Machine Translation Sufeng Duan, Hai Zhao, Rui Wang arXiv_CL arXiv_CL Transformer Pose NMT Relation PDF
2020-09-16 Solomon at SemEval-2020 Task 11: Ensemble Architecture for Fine-Tuned Propaganda Detection in News Articles Mayank Raj, Ajay Jaiswal, Rohit R.R, Ankita Gupta, Sudeep Kumar Sahoo, Vertika Srivastava, Yeon Hyang Kim arXiv_AI arXiv_AI Transformer Bert Classification Detection GAN Prediction PDF
2020-09-16 Extremely Low Bit Transformer Quantization for On-Device Neural Machine Translation Insoo Chung, Byeongwook Kim, Yoonjung Choi, Se Jung Kwon, Yongkweon Jeon, Baeseong Park, Sangha Kim, Dongsoo Lee arXiv_CL arXiv_CL Transformer Embedding Quantization Pose NMT Inference PDF
2020-09-16 Retrofitting Structure-aware Transformer Language Model for End Tasks Hao Fei, Yafeng Ren, Donghong Ji arXiv_CL arXiv_CL Transformer Language_Model PDF
2020-09-15 Cascaded Models for Better Fine-Grained Named Entity Recognition Parul Awasthy, Taesun Moon, Jian Ni, Radu Florian arXiv_CL arXiv_CL Transformer Recognition Action Relation Relation_Extraction PDF
2020-09-15 Event Presence Prediction Helps Trigger Detection Across Languages Parul Awasthy, Tahira Naseem, Jian Ni, Taesun Moon, Radu Florian arXiv_CL arXiv_CL Transformer Bert Pose Action Classification Detection Prediction PDF
2020-09-15 Cascaded Semantic and Positional Self-Attention Network for Document Classification Juyong Jiang, Jie Zhang, Kai Zhang arXiv_CL arXiv_CL Transformer Embedding RNN Pose Action Classification Attention Language_Model PDF
2020-09-15 Attention-Aware Inference for Neural Abstractive Summarization Ye Ma, Lu Zong arXiv_CL arXiv_CL Transformer Pose NMT Attention Summarization Inference Prediction PDF
2020-09-15 Achieving Real-Time Execution of Transformer-based Large-scale Models on Mobile with Compiler-aware Neural Architecture Optimization Wei Niu, Zhenglun Kong, Geng Yuan, Weiwen Jiang, Jiexiong Guan, Caiwen Ding, Pu Zhao, Sijia Liu, Bin Ren, Yanzhi Wang arXiv_AI arXiv_AI Transformer NAS Bert Optimization Pose Language_Model PDF
2020-09-14 Efficient Transformers: A Survey Yi Tay, Mostafa Dehghani, Dara Bahri, Donald Metzler arXiv_AI arXiv_AI Transformer Reinforcement_Learning Pose Survey Deep_Learning GAN PDF
2020-09-14 Filling the Gap of Utterance-aware and Speaker-aware Representation for Multi-turn Dialogue Longxiang Liu, Zhuosheng Zhang, Hai Zhao, Xi Zhou, Xiang Zhou arXiv_AI arXiv_AI Transformer Pose Relation Language_Model PDF
2020-09-14 Contrastive Triple Extraction with Generative Transformer Hongbin Ye, Ningyu Zhang, Shumin Deng, Mosha Chen, Chuanqi Tan, Fei Huang, Huajun Chen arXiv_CL arXiv_CL Transformer Knowledge Knowledge_Graph Pose Action Attention PDF
2020-09-13 Cluster-Former: Clustering-based Sparse Transformer for Long-Range Dependency Encoding Shuohang Wang, Luowei Zhou, Zhe Gan, Yen-Chun Chen, Yuwei Fang, Siqi Sun, Yu Cheng, Jingjing Liu arXiv_CL arXiv_CL Transformer Sparse Pose Deep_Learning Attention Language_Model QA PDF
2020-09-13 BoostingBERT:Integrating Multi-Class Boosting into BERT for NLP Tasks Tongwen Huang, Qingyun She, Junlin Zhang arXiv_AI arXiv_AI Transformer Bert Knowledge Pose PDF
2020-09-11 Unit Test Case Generation with Transformers Michele Tufano, Dawn Drain, Alexey Svyatkovskiy, Shao Kun Deng, Neel Sundaresan arXiv_CL arXiv_CL Transformer Pose Survey PDF
2020-09-11 A Comparison of LSTM and BERT for Small Corpus Aysu Ezen-Can arXiv_CL arXiv_CL Transformer Transfer_Learning Bert Text_Classification RNN Face Classification Text_Generation QA PDF
2020-09-10 Sparsifying Transformer Models with Differentiable Representation Pooling Michał Pietruszka, Łukasz Borchmann, Filip Graliński arXiv_CL arXiv_CL Transformer Pose Attention Summarization PDF
2020-09-10 Rank over Class: The Untapped Potential of Ranking in Natural Language Processing Amir Atapour-Abarghouei, Stephen Bonner, Andrew Stephen McGough arXiv_CL arXiv_CL Transformer Text_Classification Pose Classification Detection Sentiment Recommendation PDF
2020-09-10 Patient Cohort Retrieval using Transformer Language Models Sarvesh Soni, Kirk Roberts arXiv_CL arXiv_CL Transformer Pose Action Deep_Learning Language_Model PDF
2020-09-10 Multi-modal embeddings using multi-task learning for emotion recognition Aparna Khare, Srinivas Parthasarathy, Shiva Sundaram arXiv_CL arXiv_CL Transformer Embedding Recognition Speech Emotion Speech_Recognition Language_Model PDF
2020-09-10 Modern Methods for Text Generation Dimas Munoz Montesinos arXiv_CL arXiv_CL Transformer Bert Text_Classification Classification Summarization Text_Generation PDF
2020-09-10 RVL-BERT: Visual Relationship Detection with Visual-Linguistic Knowledge from Pre-trained Representations Meng-Jiun Chiou, Roger Zimmermann, Jiashi Feng arXiv_CV arXiv_CV Transformer Recognition Bert Salient Knowledge Self-Supervised Pose Quantitative Detection Relation Object_Detection Attention Visual_Relation PDF
2020-09-10 Learning Universal Representations from Word to Sentence Yian Li, Hai Zhao arXiv_CL arXiv_CL Transformer Embedding Bert Represenation_Learning PDF
2020-09-09 Pay Attention when Required Swetha Mandava, Szymon Migacz, Alex Fit Florea arXiv_CL arXiv_CL Transformer Bert Pose Attention Language_Model PDF
2020-09-09 Comparative Study of Language Models on Cross-Domain Data with Model Agnostic Explainability Mayank Chhipa, Hrushikesh Mahesh Vazurkar, Abhijeet Kumar, Mridul Mishra arXiv_CL arXiv_CL Transformer Bert Classification Detection Sentiment Language_Model PDF
2020-09-08 Brown University at TREC Deep Learning 2019 George Zerveas, Ruochen Zhang, Leila Kim, Carsten Eickhoff arXiv_CL arXiv_CL Transformer Bert Face Deep_Learning Language_Model Prediction PDF
2020-09-08 Probabilistic Predictions of People Perusing: Evaluating Metrics of Language Model Performance for Psycholinguistic Modeling Yiding Hao, Simon Mendelsohn, Rachel Sterneck, Randi Martinez, Robert Frank arXiv_CL arXiv_CL Transformer Memory_Networks Pose Face Relation Language_Model Prediction PDF
2020-09-08 Covid-Transformer: Detecting Trending Topics on Twitter Using Universal Sentence Encoder Meysam Asgari-Chenaghlu, Narjes Nikzad-Khasmakhi, Shervin Minaee arXiv_CL arXiv_CL Transformer Embedding Pose Deep_Learning Summarization PDF
2020-09-07 Robust Conversational AI with Grounded Text Generation Jianfeng Gao, Baolin Peng, Chunyuan Li, Jinchao Li, Shahin Shayandeh, Lars Liden, Heung-Yeung Shum arXiv_AI arXiv_AI Transformer Knowledge Text_Generation Inference PDF
2020-09-07 Generative Language Modeling for Automated Theorem Proving Stanislas Polu, Ilya Sutskever arXiv_AI arXiv_AI Transformer Knowledge Language_Model PDF
2020-09-07 Adversarial Watermarking Transformer: Towards Tracing Text Provenance with Data Hiding Sahar Abdelnabi, Mario Fritz arXiv_CL arXiv_CL Transformer Adversarial Pose Denoising Inference Language_Model PDF
2020-09-07 UIT-HSE at WNUT-2020 Task 2: Exploiting CT-BERT for Identifying COVID-19 Information on the Twitter Social Network Khiem Vinh Tran, Hao Phu Phan, Kiet Van Nguyen, Ngan Luu-Thuy Nguyen arXiv_CL arXiv_CL Transformer Bert Pose PDF
2020-09-07 Team Alex at CLEF CheckThat! 2020: Identifying Check-Worthy Tweets With Transformer Models Alex Nikolov, Giovanni Da San Martino, Ivan Koychev, Preslav Nakov arXiv_CL arXiv_CL Transformer Pose PDF
2020-09-07 TransModality: An End2End Fusion Method with Transformer for Multimodal Sentiment Analysis Zilong Wang, Zhaohong Wan, Xiaojun Wan arXiv_CL arXiv_CL Transformer Pose Relation Sentiment PDF
2020-09-06 Duluth at SemEval-2020 Task 7: Using Surprise as a Key to Unlock Humorous Headlines Shuning Jin, Yue Yin, XianE Tang, Ted Pedersen arXiv_CL arXiv_CL Transformer Language_Model PDF
2020-09-06 UPB at SemEval-2020 Task 9: Identifying Sentiment in Code-Mixed Social Media Texts using Transformers and Multi-Task Learning George-Eduard Zaharia, George-Alexandru Vlad, Dumitru-Clementin Cercel, Traian Rebedea, Costin-Gabriel Chiru arXiv_CL arXiv_CL Transformer Embedding Bert Action Sentiment PDF
2020-09-06 EdinburghNLP at WNUT-2020 Task 2: Leveraging Transformers with Generalized Augmentation for Identifying Informativeness in COVID-19 Tweets Nickil Maveli arXiv_CL arXiv_CL Transformer Embedding Bert Pose GAN PDF
2020-09-06 SemEval-2020 Task 11: Detection of Propaganda Techniques in News Articles G. Da San Martino, A. Barrón-Cedeño, H. Wachsmuth, R. Petrov, P. Nakov arXiv_CL arXiv_CL Transformer Classification Detection GAN PDF
2020-09-06 BANANA at WNUT-2020 Task 2: Identifying COVID-19 Information on Twitter by Combining Deep Learning and Transfer Learning Models Tin Van Huynh, Luan Thanh Nguyen, Son T. Luu arXiv_CL arXiv_CL Transformer Transfer_Learning Deep_Learning Prediction PDF
2020-09-05 Accenture at CheckThat! 2020: If you say so: Post-hoc fact-checking of claims using transformer-based models Evan Williams, Paul Rodrigues, Valerie Novak arXiv_CL arXiv_CL Transformer Bert Review PDF
2020-09-04 Going Beyond T-SNE: Exposing texttt{whatlies} in Text Embeddings Vincent D. Warmerdam, Thomas Kober, Rachael Tatman arXiv_CL arXiv_CL Transformer Embedding Face PDF
2020-09-04 AutoTrans: Automating Transformer Design via Reinforced Architecture Search Wei Zhu, Xiaoling Wang, Xipeng Qiu, Yuan Ni, Guotong Xie arXiv_CL arXiv_CL Transformer NAS Attention PDF
2020-09-03 Attention Flows: Analyzing and Comparing Attention Mechanisms in Language Models Joseph F DeRose, Jiayao Wang, Matthew Berger arXiv_CL arXiv_CL Transformer Pose Classification Attention Language_Model PDF
2020-09-03 Voice Conversion by Cascading Automatic Speech Recognition and Text-to-Speech Synthesis with Prosody Transfer Jing-Xuan Zhang, Li-Juan Liu, Yan-Nian Chen, Ya-Jun Hu, Yuan Jiang, Zhen-Hua Ling, Li-Rong Dai arXiv_SD arXiv_SD Transformer Recognition Speech Pose Speech_Recognition PDF
2020-09-03 Spatial Transformer Point Convolution Yuan Fang, Chunyan Xu, Zhen Cui, Yuan Zong, Jian Yang arXiv_CV arXiv_CV Transformer Segmentation Semantic_Segmentation Point_Cloud 3D Sparse Pose PDF
2020-09-01 What Does My QA Model Know? Devising Controlled Probes using Expert Knowledge Kyle Richardson, Ashish Sabharwal arXiv_CL arXiv_CL Transformer Knowledge Knowledge_Graph Pose QA PDF
2020-09-01 LiftFormer: 3D Human Pose Estimation using attention models Adrian Llopart arXiv_CV arXiv_CV Transformer 3D Pose_Estimation Pose Attention Prediction PDF
2020-09-01 Multi-channel Transformers for Multi-articulatory Sign Language Translation Necati Cihan Camgoz, Oscar Koller, Simon Hadfield, Richard Bowden arXiv_CV arXiv_CV Transformer Pose Face Relation PDF
2020-08-30 Parallel Rescoring with Transformer for Streaming On-Device Speech Recognition Wei Li, James Qin, Chung-Cheng Chiu, Ruoming Pang, Yanzhang He arXiv_CL arXiv_CL Transformer Recognition RNN Speech Pose Speech_Recognition Inference PDF
2020-08-28 TATL at W-NUT 2020 Task 2: A Transformer-based Baseline System for Identification of Informative COVID-19 English Tweets Anh Tuan Nguyen arXiv_CL arXiv_CL Transformer Pose Language_Model PDF
2020-08-28 HittER: Hierarchical Transformers for Knowledge Graph Embeddings Sanxing Chen, Xiaodong Liu, Jianfeng Gao, Jian Jiao, Ruofei Zhang, Yangfeng Ji arXiv_CL arXiv_CL Transformer Embedding Knowledge Knowledge_Graph Pose Relation Prediction PDF
2020-08-27 Adversarial Training for Multi-Channel Sign Language Production Ben Saunders, Necati Cihan Camgoz, Richard Bowden arXiv_CV arXiv_CV Transformer Adversarial Pose Face PDF
2020-08-27 GREEK-BERT: The Greeks visiting Sesame Street John Koutsikakis, Ilias Chalkidis, Prodromos Malakasiotis, Ion Androutsopoulos arXiv_CL arXiv_CL Transformer Embedding Recognition Bert Speech Inference Language_Model PDF
2020-08-27 A Survey of Evaluation Metrics Used for NLG Systems Ananya B. Sai, Akash Kumar Mohankumar, Mitesh M. Khapra arXiv_CL arXiv_CL Image_Caption Transformer Pose Survey Classification Deep_Learning GAN Caption Recommendation PDF
2020-08-27 Improvement of a dedicated model for open domain persona-aware dialogue generation Qiang Han arXiv_CL arXiv_CL Transformer Attention PDF
2020-08-26 Language Models and Word Sense Disambiguation: An Overview and Analysis Daniel Loureiro, Kiamehr Rezaee, Mohammad Taher Pilehvar, Jose Camacho-Collados arXiv_CL arXiv_CL Transformer Bert Knowledge Action Quantitative Language_Model PDF
2020-08-26 Inno at SemEval-2020 Task 11: Leveraging Pure Transfomer for Multi-Class Propaganda Detection Dmitry Grigorev, Vladimir Ivanov arXiv_CL arXiv_CL Transformer Detection GAN PDF
2020-08-26 Synthetic Sample Selection via Reinforcement Learning Jiarong Ye, Yuan Xue, L. Rodney Long, Sameer Antani, Zhiyun Xue, Keith Cheng, Xiaolei Huang arXiv_CV arXiv_CV Transformer Recognition Reinforcement_Learning Optimization Pose Classification Deep_Learning Medical Image_Classification PDF
2020-08-24 How To Evaluate Your Dialogue System: Probe Tasks as an Alternative for Token-level Evaluation Metrics Prasanna Parthasarathi, Joelle Pineau, Sarath Chandar arXiv_AI arXiv_AI Transformer RNN Pose Action Quantitative Language_Model PDF
2020-08-24 End to End Dialogue Transformer Ondřej Měkota, Memduh Gökırmak, Petr Laitoch arXiv_CL arXiv_CL Transformer RNN Pose PDF
2020-08-22 HinglishNLP: Fine-tuned Language Models for Hinglish Sentiment Detection Meghana Bhange, Nirant Kasliwal arXiv_CL arXiv_CL Transformer Bert Pose Detection Sentiment Language_Model PDF
2020-08-22 Identity-Aware Multi-Sentence Video Description Jae Sung Park, Trevor Darrell, Anna Rohrbach arXiv_CV arXiv_CV Transformer Video_Caption Pose Prediction PDF
2020-08-22 FAT ALBERT: Finding Answers in Large Texts using Semantic Similarity Attention Layer based on BERT Omar Mossad, Amgad Ahmed, Anandharaju Raju, Hari Karthikeyan, Zayed Ahmed arXiv_CL arXiv_CL Transformer Bert Pose Classification Deep_Learning Attention Summarization QA PDF
2020-08-21 Document-level Event-based Extraction Using Generative Template-filling Transformers Xinya Du, Alexander Rush, Claire Cardie arXiv_CL arXiv_CL Transformer Knowledge Pose Action PDF
2020-08-20 Do Syntax Trees Help Pre-trained Transformers Extract Information? Devendra Singh Sachan, Yuhao Zhang, Peng Qi, William Hamilton arXiv_CL arXiv_CL Transformer Recognition Bert Pose Action Relation Relation_Extraction Attention PDF
2020-08-20 Discovering Useful Sentence Representations from Large Pretrained Language Models Nishant Subramani, Nivedita Suresh arXiv_CL arXiv_CL Transformer Optimization Language_Model PDF
2020-08-19 Transformer based Multilingual document Embedding model Wei Li, Brian Mak arXiv_CL arXiv_CL Transformer Embedding RNN NMT Attention PDF
2020-08-18 Learning to Generate Diverse Dance Motions with Transformer Jiaman Li, Yihang Yin, Hang Chu, Yi Zhou, Tingwu Wang, Sanja Fidler, Hao Li arXiv_CV arXiv_CV Transformer Action PDF
2020-08-18 Glancing Transformer for Non-Autoregressive Neural Machine Translation Lihua Qian, Hao Zhou, Yu Bao, Mingxuan Wang, Lin Qiu, Weinan Zhang, Yong Yu, Lei Li arXiv_CL arXiv_CL Transformer Pose Inference Language_Model Prediction PDF
2020-08-18 Very Deep Transformers for Neural Machine Translation Xiaodong Liu, Kevin Duh, Liyuan Liu, Jianfeng Gao arXiv_CL arXiv_CL Transformer NMT PDF
2020-08-18 Are Neural Open-Domain Dialog Systems Robust to Speech Recognition Errors in the Dialog History? An Empirical Study Karthik Gopalakrishnan, Behnam Hedayatnia, Longshaokan Wang, Yang Liu, Dilek Hakkani-Tur arXiv_AI arXiv_AI Transformer Recognition Knowledge Speech Attention Speech_Recognition Inference QA PDF
2020-08-17 Spatial Temporal Transformer Network for Skeleton-based Action Recognition Chiara Plizzari, Marco Cannici, Matteo Matteucci arXiv_CV arXiv_CV Transformer Recognition 3D Pose Action_Recognition Action Relation Attention Activity CNN PDF
2020-08-16 Adding Recurrence to Pretrained Transformers for Improved Efficiency and Context Size Davis Yoshida, Allyson Ettinger, Kevin Gimpel arXiv_CL arXiv_CL Transformer Inference Language_Model PDF
2020-08-16 DCR-Net: A Deep Co-Interactive Relation Network for Joint Dialog Act Recognition and Sentiment Classification Libo Qin, Wanxiang Che, Yangming Li, Minheng Ni, Ting Liu arXiv_CL arXiv_CL Transformer Recognition Bert Sentiment_Classification Knowledge Pose Action Classification Relation Sentiment PDF
2020-08-16 TopicBERT: A Transformer transfer learning based memory-graph approach for multimodal streaming social media topic detection Meysam Asgari-Chenaghlu, Mohammad-Reza Feizi-Derakhshi, Leili farzinvash, Mohammad-Ali Balafar, Cina Motamed arXiv_AI arXiv_AI Transformer Tracking Unsupervised Transfer_Learning Recognition Bert Pose Detection Relation PDF
2020-08-15 Is Supervised Syntactic Parsing Beneficial for Language Understanding? An Empirical Investigation Goran Glavaš, Ivan Vulić arXiv_CL arXiv_CL Transformer Zero-Shot Knowledge Self-Supervised Language_Model PDF
2020-08-14 Adaptable Multi-Domain Language Model for Transformer ASR Taewoo Lee, Min-Joong Lee, Tae Gyoon Kang, Seokyeoung Jung, Minseok Kwon, Yeona Hong, Jungin Lee, Kyoung-Gu Woo, Ho-Gyeong Kim, Jiseung Jeong, Jihyun Lee, Hosik Lee, Young Sang Choi arXiv_CL arXiv_CL Transformer Pose Language_Model PDF
2020-08-14 A Hybrid BERT and LightGBM based Model for Predicting Emotion GIF Categories on Twitter Ye Bi, Shuo Wang, Zhongrui Fan arXiv_CL arXiv_CL Transformer Bert Pose Emotion Matching PDF
2020-08-13 End-to-end Contextual Perception and Prediction with Interaction Transformer Lingyun Luke Li, Bin Yang, Ming Liang, Wenyuan Zeng, Mengye Ren, Sean Segal, Raquel Urtasun arXiv_CV arXiv_CV Transformer 3D Pose Action Prediction PDF
2020-08-13 On the Importance of Local Information in Transformer Based Models Madhura Pande, Aakriti Budhraja, Preksha Nema, Pratyush Kumar, Mitesh M. Khapra arXiv_CL arXiv_CL Transformer Action Attention PDF
2020-08-13 Continuous Speech Separation with Conformer Sanyuan Chen, Yu Wu, Zhuo Chen, Jinyu Li, Chengyi Wang, Shujie Liu, Ming Zhou arXiv_CL arXiv_CL Transformer RNN Speech Attention PDF
2020-08-13 Conv-Transformer Transducer: Low Latency, Low Frame Rate, Streamable End-to-End Speech Recognition Wenyong Huang, Wenchao Hu, Yu Ting Yeung, Xiao Chen arXiv_CL arXiv_CL Transformer Recognition RNN Speech Attention Speech_Recognition Language_Model PDF
2020-08-13 An Ensemble of Knowledge Sharing Models for Dynamic Hand Gesture Recognition Kenneth Lai, Svetlana Yanushkevich arXiv_CV arXiv_CV Transformer Recognition Gesture RNN Knowledge Pose Action Prediction PDF
2020-08-13 Large-scale Transfer Learning for Low-resource Spoken Language Understanding Xueli Jia, Jianzong Wang, Zhiyong Zhang, Ning Cheng, Jing Xiao arXiv_CL arXiv_CL Transformer Transfer_Learning Enhancement Recognition Bert Speech Pose Action Attention Speech_Recognition PDF
2020-08-13 ISIA Food-500: A Dataset for Large-Scale Food Recognition via Stacked Global-Local Attention Network Weiqing Min, Linhu Liu, Zhiling Wang, Zhengdong Luo, Xiaoming Wei, Xiaolin Wei, Shuqiang Jiang arXiv_CV arXiv_CV Transformer Recognition Pose Ontology Attention PDF
2020-08-13 MMM : Exploring Conditional Multi-Track Music Generation with the Transformer Jeff Ens, Philippe Pasquier arXiv_SD arXiv_SD Transformer Inpainting Pose Attention PDF
2020-08-12 End-to-End Neural Transformer Based Spoken Language Understanding Martin Radfar, Athanasios Mouchtaris, Siegfried Kunzmann arXiv_CL arXiv_CL Transformer Speech Attention CNN Prediction PDF
2020-08-12 Semantics-preserving adversarial attacks in NLP Rahul Singh, Tarun Joshi, Vijayan N. Nair, Agus Sudjianto arXiv_CL arXiv_CL Transformer Text_Classification Adversarial Pose Classification PDF
2020-08-12 Towards Unsupervised Crowd Counting via Regression-Detection Bi-knowledge Transfer Yuting Liu, Zheng Wang, Miaojing Shi, Shin'ichi Satoh, Qijun Zhao, Hongyu Yang arXiv_CV arXiv_CV Transformer Unsupervised Transfer_Learning Knowledge Self-Supervised Detection PDF
2020-08-12 Fine-grained Visual Textual Alignment for Cross-Modal Retrieval using Transformer Encoders Nicola Messina, Giuseppe Amato, Andrea Esuli, Fabrizio Falchi, Claudio Gennaro, Stéphane Marchand-Maillet arXiv_CV arXiv_CV Transformer Image_Retrieval Pose Attention Matching PDF
2020-08-12 Compression of Deep Learning Models for Text: A Survey Manish Gupta, Puneet Agrawal arXiv_AI arXiv_AI Transformer Quantization Bert RNN Knowledge Survey Deep_Learning GAN PDF
2020-08-12 Evaluating the Impact of Knowledge Graph Contexton Entity Disambiguation Models Isaiah Onando Mulang', Kuldeep Singh, Chaitali Prabhu, Abhishek Nadgeri, Johannes Hoffart, Jens Lehmann arXiv_AI arXiv_AI Transformer Knowledge Knowledge_Graph Pose PDF
2020-08-11 S-vectors: Speaker Embeddings based on Transformer's Encoder for Text-Independent Speaker Verification Metilda Sagaya Mary N J, Sandesh V Katta, S Umesh arXiv_SD arXiv_SD Transformer Embedding Pose Classification Attention PDF
2020-08-11 Transformer with Bidirectional Decoder for Speech Recognition Xi Chen, Songyang Zhang, Dandan Song, Peng Ouyang, Shouyi Yin arXiv_CL arXiv_CL Transformer Recognition Speech Pose Attention Speech_Recognition Inference Language_Model PDF
2020-08-10 GANBERT: Generative Adversarial Networks with Bidirectional Encoder Representations from Transformers for MRI to PET synthesis Hoo-Chang Shin, Alvin Ihsani, Swetha Mandava, Sharath Turuvekere Sreenivas, Christopher Forster, Jiook Cha, Alzheimer's Disease Neuroimaging Initiative arXiv_CV arXiv_CV Transformer Bert Adversarial Pose GAN Medical Prediction PDF
2020-08-10 FDFtNet: Facing Off Fake Images using Fake Detection Fine-tuning Network Hyeonseong Jeon, Youngoh Bang, Simon S. Woo arXiv_CV arXiv_CV Transformer Adversarial Pose Face Classification Detection Few-Shot Attention GAN Image_Classification PDF
2020-08-09 Distilling the Knowledge of BERT for Sequence-to-Sequence ASR Hayato Futami, Hirofumi Inaguma, Sei Ueno, Masato Mimura, Shinsuke Sakai, Tatsuya Kawahara arXiv_CL arXiv_CL Transformer Recognition Bert Knowledge Speech Pose Attention Speech_Recognition Inference Language_Model PDF
2020-08-08 VPC-Net: Completion of 3D Vehicles from MLS Point Clouds Yan Xia, Yusheng Xu, Cheng Wang, Uwe Stilla arXiv_CV arXiv_CV Transformer Enhancement Point_Cloud 3D Sparse Pose Quantitative Autonomous PDF
2020-08-07 Investigation of Speaker-adaptation methods in Transformer based ASR Vishwas M. Shetty, Metilda Sagaya Mary N J, S. Umesh arXiv_CV arXiv_CV Transformer Embedding Recognition Speech Attention Speech_Recognition PDF
2020-08-07 Pretraining Techniques for Sequence-to-Sequence Voice Conversion Wen-Chin Huang, Tomoki Hayashi, Yi-Chiao Wu, Hirokazu Kameoka, Tomoki Toda arXiv_CL arXiv_CL Transformer Recognition RNN Knowledge Speech Pose Speech_Recognition PDF
2020-08-06 Attentive Fusion Enhanced Audio-Visual Encoding for Transformer Based Robust Speech Recognition Liangfa Wei, Jie Zhang, Junfeng Hou, Lirong Dai arXiv_SD arXiv_SD Transformer Recognition Speech Pose Action Attention Speech_Recognition PDF
2020-08-05 Global Voxel Transformer Networks for Augmented Microscopy Zhengyang Wang, Yaochen Xie, Shuiwang Ji arXiv_CV arXiv_CV Transformer Pose Deep_Learning PDF
2020-08-05 Hybrid Transformer/CTC Networks for Hardware Efficient Voice Triggering Saurabh Adya, Vineet Garg, Siddharth Sigtia, Pramod Simha, Chandra Dhir arXiv_SD arXiv_SD Transformer RNN Pose Detection Attention Inference PDF
2020-08-05 6VecLM: Language Modeling in Vector Space for IPv6 Target Generation Tianyu Cui, Gang Xiong, Gaopeng Gou, Junzheng Shi, Wei Xia arXiv_AI arXiv_AI Transformer Pose Classification Relation Language_Model PDF
2020-08-05 Multimodality Biomedical Image Registration using Free Point Transformer Networks Zachary M. C. Baum, Yipeng Hu, Dean C. Barratt arXiv_CV arXiv_CV Transformer Unsupervised Sparse Medical PDF
2020-08-04 I-AID: Identifying Actionable Information from Disaster-related Tweets Hamada M. Zahera, Rricha Jalota, Mohamed A. Sherif, Axel N. Ngomo arXiv_AI arXiv_AI Transformer Bert Pose Action Relation GAN PDF
2020-08-04 Select, Extract and Generate: Neural Keyphrase Generation with Syntactic Guidance Wasi Uddin Ahmad, Xiao Bai, Soomin Lee, Kai-Wei Chang arXiv_CL arXiv_CL Transformer Salient Speech Pose Action Attention Prediction PDF
2020-08-04 Automatic Composition of Guitar Tabs by Transformers and Groove Modeling Yu-Hua Chen, Yu-Hsiang Huang, Wen-Yi Hsiao, Yi-Hsuan Yang arXiv_SD arXiv_SD Transformer Pose Deep_Learning PDF
2020-08-04 The Jazz Transformer on the Front Line: Exploring the Shortcomings of AI-composed Music through Quantitative Measures Shih-Lun Wu, Yi-Hsuan Yang arXiv_AI arXiv_AI Transformer Pose Quantitative Prediction PDF
2020-08-03 Late Temporal Modeling in 3D CNN Architectures with BERT for Action Recognition M. Esat Kalfaoglu, Sinan Kalkan, A. Aydin Alatan arXiv_CV arXiv_CV Transformer Recognition 3D Bert Action_Recognition Action Attention CNN PDF
2020-08-03 LT@Helsinki at SemEval-2020 Task 12: Multilingual or language-specific BERT? Marc Pàmies, Emily Öhman, Kaisla Kajava, Jörg Tiedemann arXiv_CL arXiv_CL Transformer Bert Classification PDF
2020-08-03 Self-attention encoding and pooling for speaker recognition Pooyan Safari, Miquel India, Javier Hernando arXiv_SD arXiv_SD Transformer Embedding Recognition Speech Pose Attention PDF
2020-08-03 Deep Photo Cropper and Enhancer Aaron Ott, Amir Mazaheri, Niels D. Lobo, Mubarak Shah arXiv_CV arXiv_CV Transformer Enhancement Super_Resolution Pose Image_Enhancement Quantitative PDF
2020-08-03 DeLighT: Very Deep and Light-weight Transformer Sachin Mehta, Marjan Ghazvininejad, Srinivasan Iyer, Luke Zettlemoyer, Hannaneh Hajishirzi arXiv_CL arXiv_CL Transformer Language_Model PDF
2020-08-02