Transformer

2021-02-24 When Attention Meets Fast Recurrence: Training Language Models with Reduced Compute Tao Lei arXiv_CL arXiv_CL Transformer Attention Language_Model PDF
2021-02-24 Re-Evaluating GermEval17 Using German Pre-Trained Language Models M. Aßenmacher, A. Corvonato, C. Heumann arXiv_CL arXiv_CL Transformer Bert Face Relation Language_Model PDF
2021-02-24 GEM: Glare or Gloom, I Can Still See You -- End-to-End Multimodal Object Detector Osama Mazhar, Jens Kober, Robert Babuska arXiv_CV arXiv_CV Transformer Knowledge Pose Detection Object_Detection PDF
2021-02-24 LRG at SemEval-2021 Task 4: Improving Reading Comprehension with Abstract Words using Augmentation, Linguistic Features and Voting Abheesht Sharma, Harshit Pandey, Gunjan Chhablani, Yash Bhartia, Tirtharaj Dash arXiv_CL arXiv_CL Transformer Bert Pose Language_Model Prediction PDF
2021-02-24 From Universal Language Model to Downstream Task: Improving RoBERTa-Based Vietnamese Hate Speech Detection Quang Huu Pham, Viet Anh Nguyen, Linh Bao Doan, Ngoc N. Tran, Ta Minh Thanh arXiv_CL arXiv_CL Transformer Bert Text_Classification Speech Pose Classification Detection Language_Model PDF
2021-02-24 Pyramid Vision Transformer: A Versatile Backbone for Dense Prediction without Convolutions Wenhai Wang, Enze Xie, Xiang Li, Deng-Ping Fan, Kaitao Song, Ding Liang, Tong Lu, Ping Luo, Ling Shao arXiv_CV arXiv_CV Transformer Segmentation Pose Classification Detection Object_Detection CNN Image_Classification Prediction PDF
2021-02-24 Zero-Shot Text-to-Image Generation Aditya Ramesh, Mikhail Pavlov, Gabriel Goh, Scott Gray, Chelsea Voss, Alec Radford, Mark Chen, Ilya Sutskever arXiv_CV arXiv_CV Transformer Segmentation Zero-Shot PDF
2021-02-24 Hopeful_Men@LT-EDI-EACL2021: Hope Speech Detection Using Indic Transliteration and Transformers Ishan Sanjeev Upadhyay, Nikhil E, Anshul Wadhawan, Radhika Mamidi arXiv_CL arXiv_CL Transformer Embedding Bert RNN Speech Detection PDF
2021-02-23 Do Transformer Modifications Transfer Across Implementations and Applications? Sharan Narang, Hyung Won Chung, Yi Tay, William Fedus, Thibault Fevry, Michael Matena, Karishma Malkan, Noah Fiedel, Noam Shazeer, Zhenzhong Lan, Yanqi Zhou, Wei Li, Nan Ding, Jake Marcus, Adam Roberts, Colin Raffel arXiv_CL arXiv_CL Transformer Pose Recommendation PDF
2021-02-23 Unsupervised Brain Anomaly Detection and Segmentation with Transformers Walter Hugo Lopez Pinaya, Petru-Daniel Tudosiu, Robert Gray, Geraint Rees, Parashkev Nachev, Sebastien Ourselin, M. Jorge Cardoso arXiv_CV arXiv_CV Transformer Segmentation Unsupervised Action Detection Attention GAN Medical PDF
2021-02-23 Dual-Path Modeling for Long Recording Speech Separation in Meetings Chenda Li, Zhuo Chen, Yi Luo, Cong Han, Tianyan Zhou, Keisuke Kinoshita, Marc Delcroix, Shinji Watanabe, Yanmin Qian arXiv_SD arXiv_SD Transformer Speech Pose CNN PDF
2021-02-23 Deep Deformation Detail Synthesis for Thin Shell Models Lan Chen, Lin Gao, Jie Yang, Shibiao Xu, Juntao Ye, Xiaopeng Zhang, Yu-Kun Lai arXiv_CV arXiv_CV Transformer Pose Attention Prediction PDF
2021-02-22 Parallelizing Legendre Memory Unit Training Narsimha Chilkuri, Chris Eliasmith arXiv_AI arXiv_AI Transformer Bert RNN Pose Sentiment Inference PDF
2021-02-22 MixUp Training Leads to Reduced Overfitting and Improved Calibration for the Transformer Architecture Wancong Zhang, Ieshan Vaidya arXiv_CL arXiv_CL Transformer Embedding Bert Pose PDF
2021-02-22 Deepfake Video Detection Using Convolutional Vision Transformer Deressa Wodajo, Solomon Atnafu arXiv_CV arXiv_CV Transformer Pose Face Deep_Learning Detection Attention CNN PDF
2021-02-22 Position Information in Transformers: An Overview Philipp Dufter, Martin Schmitt, Hinrich Schütze arXiv_AI arXiv_AI Transformer Survey PDF
2021-02-22 Better Call the Plumber: Orchestrating Dynamic Information Extraction Pipelines Mohamad Yaser Jaradeh, Kuldeep Singh, Markus Stocker, Andreas Both, Sören Auer arXiv_CL arXiv_CL Transformer Embedding Optimization Knowledge Knowledge_Graph Pose Action Classification Relation Relation_Extraction PDF
2021-02-22 Using Prior Knowledge to Guide BERT's Attention in Semantic Textual Matching Tasks Tingyu Xia, Yue Wang, Yuan Tian, Yi Chang arXiv_AI arXiv_AI Transformer Bert Salient Knowledge Pose Attention Matching PDF
2021-02-22 Do We Really Need Explicit Position Encodings for Vision Transformers? Xiangxiang Chu, Bo Zhang, Zhi Tian, Xiaolin Wei, Huaxia Xia arXiv_AI arXiv_AI Transformer Pose Classification Attention PDF
2021-02-22 Transformer is All You Need: Multimodal Multitask Learning with a Unified Transformer Ronghang Hu, Amanpreet Singh arXiv_CV arXiv_CV Transformer Pose Detection Object_Detection Prediction PDF
2021-02-21 Pre-Training BERT on Arabic Tweets: Practical Considerations Ahmed Abdelali, Sabit Hassan, Hamdy Mubarak, Kareem Darwish, Younes Samih arXiv_AI arXiv_AI Transformer Segmentation Bert QA PDF
2021-02-21 Medical Transformer: Gated Axial-Attention for Medical Image Segmentation Jeya Maria Jose Valanarasu, Poojan Oza, Ilker Hacihaliloglu, Vishal M. Patel arXiv_CV arXiv_CV Transformer Segmentation Pose Attention Medical CNN PDF
2021-02-20 Towards Accurate and Compact Architectures via Neural Architecture Transformer Yong Guo, Yin Zheng, Mingkui Tan, Qi Chen, Zhipeng Li, Jian Chen, Peilin Zhao, Junzhou Huang arXiv_CV arXiv_CV Transformer NAS Optimization Pose PDF
2021-02-20 Multilingual Answer Sentence Reranking via Automatically Translated Data Thuy Vu, Alessandro Moschitti arXiv_CL arXiv_CL Transformer QA PDF
2021-02-19 Hate-Alert@DravidianLangTech-EACL2021: Ensembling strategies for Transformer-based Offensive language Detection Debjoy Saha, Naman Paharia, Debajit Chakraborty, Punyajoy Saha, Animesh Mukherjee arXiv_AI arXiv_AI Transformer Detection PDF
2021-02-19 Using Transformer based Ensemble Learning to classify Scientific Articles Sohom Ghosh, Ankush Chopra arXiv_CL arXiv_CL Transformer Bert Review Prediction PDF
2021-02-19 TransMask: A Compact and Fast Speech Separation Model Based on Transformer Zining Zhang, Bingsheng He, Zhenjie Zhang arXiv_SD arXiv_SD Transformer Speech Pose Deep_Learning Attention Inference PDF
2021-02-19 Towards Emotion Recognition in Hindi-English Code-Mixed Data: A Transformer Based Approach Anshul Wadhawan, Akshita Aggarwal arXiv_CL arXiv_CL Transformer Embedding Recognition Bert RNN Emotion Action Deep_Learning Detection Sentiment Attention Language_Model PDF
2021-02-19 Progressive Transformer-Based Generation of Radiology Reports Farhad Nooralahzadeh, Nicolas Perez Gonzalez, Thomas Frauenfelder, Koji Fujimoto, Michael Krauthammer arXiv_CL arXiv_CL Image_Caption Transformer Pose PDF
2021-02-19 Dialect Identification in Nuanced Arabic Tweets Using Farasa Segmentation and AraBERT Anshul Wadhawan arXiv_CL arXiv_CL Transformer Segmentation Bert PDF
2021-02-19 Multilingual Augmenter: The Model Chooses Matthew Ciolino, David Noever, Josh Kalin arXiv_CL arXiv_CL Transformer Embedding PDF
2021-02-18 Going Full-TILT Boogie on Document Understanding with Text-Image-Layout Transformer Rafał Powalski, Łukasz Borchmann, Dawid Jurkiewicz, Tomasz Dwojak, Michał Pietruszka, Gabriela Pałka arXiv_CL arXiv_CL Transformer VQA Attention QA PDF
2021-02-18 UnibucKernel: Geolocating Swiss-German Jodels Using Ensemble Learning Mihaela Gaman, Sebastian Cojocariu, Radu Tudor Ionescu arXiv_CL arXiv_CL Transformer Embedding Bert Prediction PDF
2021-02-18 Quiz-Style Question Generation for News Stories Adam D. Lelkes, Vinh Q. Tran, Cong Yu arXiv_CL arXiv_CL Transformer Knowledge Pose Survey QA PDF
2021-02-17 Beyond Fully-Connected Layers with Quaternions: Parameterization of Hypercomplex Multiplications with $1/n$ Parameters Aston Zhang, Yi Tay, Shuai Zhang, Alvin Chan, Anh Tuan Luu, Siu Cheung Hui, Jie Fu arXiv_AI arXiv_AI Transformer Style_Transfer Represenation_Learning RNN Pose Inference PDF
2021-02-16 Revisiting Language Encoding in Learning Multilingual Representations Shengjie Luo, Kaiyuan Gao, Shuxin Zheng, Guolin Ke, Di He, Liwei Wang, Tie-Yan Liu arXiv_CL arXiv_CL Transformer Embedding Pose Action Relation Attention PDF
2021-02-16 End-to-End Automatic Speech Recognition with Deep Mutual Learning Ryo Masumura, Mana Ihori, Akihiko Takashima, Tomohiro Tanaka, Takanori Ashihara arXiv_CL arXiv_CL Transformer Recognition Knowledge Speech Pose Classification Speech_Recognition Prediction PDF
2021-02-16 IronMan: GNN-assisted Design Space Exploration in High-Level Synthesis via Reinforcement Learning Nan Wu, Yuan Xie, Cong Hao arXiv_CL arXiv_CL Transformer Reinforcement_Learning Optimization Pose Action Prediction Matching PDF
2021-02-16 GradInit: Learning to Initialize Neural Networks for Stable and Efficient Training Chen Zhu, Renkun Ni, Zheng Xu, Kezhi Kong, W. Ronny Huang, Tom Goldstein arXiv_CV arXiv_CV Transformer CNN Language_Model PDF
2021-02-16 Exploring Transformers in Natural Language Generation: GPT, BERT, and XLNet M. Onat Topal, Anil Bas, Imke van Heerden arXiv_CL arXiv_CL Transformer Bert RNN Attention Summarization Text_Generation Language_Model PDF
2021-02-16 TransFuse: Fusing Transformers and CNNs for Medical Image Segmentation Yundong Zhang, Huiye Liu, Qiang Hu arXiv_AI arXiv_AI Transformer Segmentation Pose Medical CNN Inference PDF
2021-02-16 TeraPipe: Token-Level Pipeline Parallelism for Training Large-Scale Language Models Zhuohan Li, Siyuan Zhuang, Shiyuan Guo, Danyang Zhuo, Hao Zhang, Dawn Song, Ion Stoica arXiv_CL arXiv_CL Transformer Language_Model PDF
2021-02-16 Hierarchical Transformer-based Large-Context End-to-end ASR with Large-Context Knowledge Distillation Ryo Masumura, Naoki Makishima, Mana Ihori, Akihiko Takashima, Tomohiro Tanaka, Shota Orihashi arXiv_CL arXiv_CL Transformer Recognition Knowledge Speech Pose Speech_Recognition Language_Model PDF
2021-02-16 User-Inspired Posterior Network for Recommendation Reason Generation Haolan Zhan, Hainan Zhang, Hongshen Chen, Lei Shen, Yanyan Lan, Zhuoye Ding, Dawei Yin arXiv_CL arXiv_CL Transformer Knowledge Pose Attention QA Recommendation PDF
2021-02-15 Translational Equivariance in Kernelizable Attention Max Horn, Kumar Shridhar, Elrich Groenewald, Philipp F. M. Baumann arXiv_CV arXiv_CV Transformer Recognition Action Attention CNN PDF
2021-02-15 BERT's output layer recognizes all hidden layers? Some Intriguing Phenomena and a simple way to boost BERT Wei-Tsung Kao, Tsung-Han Wu, Po-Han Chi, Chun-Cheng Hsieh, Hung-Yi Lee arXiv_CL arXiv_CL Transformer Bert Pose PDF
2021-02-14 Thank you for Attention: A survey on Attention-based Artificial Neural Networks for Automatic Speech Recognition Priyabrata Karmakar, Shyh Wei Teng, Guojun Lu arXiv_CL arXiv_CL Transformer Recognition Review Speech Survey Attention Speech_Recognition PDF
2021-02-14 indicnlp@kgp at DravidianLangTech-EACL2021: Offensive Language Identification in Dravidian Languages Kushal Kedia, Abhilash Nandy arXiv_CL arXiv_CL Transformer Transfer_Learning Bert Text_Classification RNN Classification PDF
2021-02-14 TransGAN: Two Transformers Can Make One Strong GAN Yifan Jiang, Shiyu Chang, Zhangyang Wang arXiv_CV arXiv_CV Transformer Segmentation Embedding Adversarial Classification Detection Attention GAN CNN PDF
2021-02-12 Multimodal Punctuation Prediction with Contextual Dropout Andrew Silva, Barry-John Theobald, Nicholas Apostoloff arXiv_AI arXiv_AI Transformer Recognition Speech Speech_Recognition Prediction PDF
2021-02-12 End-to-end Audio-visual Speech Recognition with Conformers Pingchuan Ma, Stavros Petridis, Maja Pantic arXiv_CV arXiv_CV Transformer Recognition Speech Pose Attention Speech_Recognition Language_Model PDF
2021-02-12 Optimizing Inference Performance of Transformers on CPUs Dave Dice, Alex Kogan arXiv_AI arXiv_AI Transformer Bert Optimization Pose Face Attention Inference PDF
2021-02-12 Improving Zero-shot Neural Machine Translation on Language-specific Encoders-Decoders Junwei Liao, Yu Shi, Ming Gong, Linjun Shou, Hong Qu, Michael Zeng arXiv_CL arXiv_CL Transformer Zero-Shot Pose NMT Denoising Attention PDF
2021-02-12 Transformer Language Models with LSTM-based Cross-utterance Information Representation G. Sun, C. Zhang, P. C. Woodland arXiv_AI arXiv_AI Transformer Recognition RNN Speech Pose Speech_Recognition Language_Model PDF
2021-02-12 On Efficient Training, Controllability and Compositional Generalization of Insertion-based Language Generators Sidi Lu, Nanyun Peng arXiv_CL arXiv_CL Transformer Pose Attention Text_Generation Caption Language_Model PDF
2021-02-12 Neural Inverse Text Normalization Monica Sunkara, Chaitanya Shivade, Sravan Bodapati, Katrin Kirchhoff arXiv_CL arXiv_CL Transformer Pose PDF
2021-02-11 Speech-language Pre-training for End-to-end Spoken Language Understanding Yao Qian, Ximo Bian, Yu Shi, Naoyuki Kanda, Leo Shen, Zhen Xiao, Michael Zeng arXiv_CL arXiv_CL Transformer Speech Pose Inference Language_Model PDF
2021-02-11 Proof Artifact Co-training for Theorem Proving with Language Models Jesse Michael Han, Jason Rute, Yuhuai Wu, Edward W. Ayers, Stanislas Polu arXiv_AI arXiv_AI Transformer Self-Supervised Pose Language_Model Prediction PDF
2021-02-11 Text Compression-aided Transformer Encoding Zuchao Li, Zhuosheng Zhang, Hai Zhao, Rui Wang, Kehai Chen, Masao Utiyama, Eiichiro Sumita arXiv_CL arXiv_CL Transformer Pose Attention PDF
2021-02-11 Generating Coherent and Diverse Slogans with Sequence-to-Sequence Transformer Yiping Jin, Akshay Bhatia, Dittaya Wanvarie, Phu T. V. Le arXiv_CL arXiv_CL Transformer Pose Quantitative GAN Inference PDF
2021-02-10 Training Vision Transformers for Image Retrieval Alaaeldin El-Nouby, Natalia Neverova, Ivan Laptev, Hervé Jégou arXiv_CV arXiv_CV Transformer Image_Retrieval Pose Classification Image_Classification PDF
2021-02-10 Multi-turn Dialogue Reading Comprehension with Pivot Turns and Knowledge Zhuosheng Zhang, Junlong Li, Hai Zhao arXiv_AI arXiv_AI Transformer Knowledge Knowledge_Graph Pose Language_Model Prediction Matching PDF
2021-02-10 Origami spring-inspired shape morphing for flexible robotics Qianying Chen, Fan Feng, Pengyu Lv, Huiling Duan arXiv_RO arXiv_RO Transformer Pose PDF
2021-02-09 Is Space-Time Attention All You Need for Video Understanding? Gedas Bertasius, Heng Wang, Lorenzo Torresani arXiv_CV arXiv_CV Transformer Recognition Video_Caption 3D Action_Recognition Action Classification Attention CNN Video_Classification PDF
2021-02-09 Improving Visual Reasoning by Exploiting The Knowledge in Texts Sahand Sharifzadeh, Sina Moayed Baharlou, Martin Schmitt, Hinrich Schütze, Volker Tresp arXiv_AI arXiv_AI Transformer Knowledge Self-Supervised Classification Relation PDF
2021-02-09 Bayesian Transformer Language Models for Speech Recognition Boyang Xue, Jianwei Yu, Junhao Xu, Shansong Liu, Shoukang Hu, Zi Ye, Mengzhe Geng, Xunying Liu, Helen Meng arXiv_CL arXiv_CL Transformer Embedding Recognition Speech Pose Attention Speech_Recognition Inference Language_Model PDF
2021-02-09 Conversational Query Rewriting with Self-supervised Learning Hang Liu, Meng Chen, Youzheng Wu, Xiaodong He, Bowen Zhou arXiv_CL arXiv_CL Transformer Self-Supervised Pose Detection PDF
2021-02-09 Transfer Learning Approach for Arabic Offensive Language Detection System -- BERT-Based Model Fatemah Husain, Ozlem Uzuner arXiv_CL arXiv_CL Transformer Transfer_Learning Bert Knowledge Detection PDF
2021-02-09 Joint Intent Detection and Slot Filling with Wheel-Graph Attention Networks Pengfei Wei, Bi Zeng, Wenxiong Liao arXiv_AI arXiv_AI Transformer Bert Pose Deep_Learning Detection Attention PDF
2021-02-08 Wake Word Detection with Streaming Transformers Yiming Wang, Hang Lv, Daniel Povey, Lei Xie, Sanjeev Khudanpur arXiv_CL arXiv_CL Transformer Embedding RNN Pose Detection CNN PDF
2021-02-08 Colorization Transformer Manoj Kumar, Dirk Weissenborn, Nal Kalchbrenner arXiv_AI arXiv_AI Transformer Attention PDF
2021-02-08 TransReID: Transformer-based Object Re-Identification Shuting He, Hao Luo, Pichao Wang, Fan Wang, Hao Li, Wei Jiang arXiv_CV arXiv_CV Transformer Embedding Knowledge Pose Re-identification CNN PDF
2021-02-08 Unlocking Pixels for Reinforcement Learning via Implicit Attention Krzysztof Choromanski, Deepali Jain, Jack Parker-Holder, Xingyou Song, Valerii Likhosherstov, Anirban Santara, Aldo Pacchiano, Yunhao Tang, Adrian Weller arXiv_AI arXiv_AI Transformer Reinforcement_Learning Pose Action Relation Attention PDF
2021-02-08 Generating Fake Cyber Threat Intelligence Using Transformer-Based Models Priyanka Ranade, Aritran Piplai, Sudip Mittal, Anupam Joshi, Tim Finin arXiv_AI arXiv_AI Transformer Knowledge Knowledge_Graph Language_Model PDF
2021-02-08 TransUNet: Transformers Make Strong Encoders for Medical Image Segmentation Jieneng Chen, Yongyi Lu, Qihang Yu, Xiangde Luo, Ehsan Adeli, Yan Wang, Le Lu, Alan L. Yuille, Yuyin Zhou arXiv_CV arXiv_CV Transformer Segmentation Pose Attention GAN Medical CNN Prediction PDF
2021-02-08 SLUA: A Super Lightweight Unsupervised Word Alignment Model via Cross-Lingual Contrastive Learning Di Wu, Liang Ding, Shuo Yang, Dacheng Tao arXiv_AI arXiv_AI Transformer Embedding Unsupervised Pose Contrastive_Learning Attention PDF
2021-02-08 End-to-End Multi-Channel Transformer for Speech Recognition Feng-Ju Chang, Martin Radfar, Athanasios Mouchtaris, Brian King, Siegfried Kunzmann arXiv_CL arXiv_CL Transformer Recognition Speech Relation Attention Speech_Recognition PDF
2021-02-07 Iconographic Image Captioning for Artworks Eva Cetinic arXiv_CV arXiv_CV Image_Caption Transformer Quantitative Classification Relation Caption PDF
2021-02-07 Nystr'omformer: A Nystr'om-Based Algorithm for Approximating Self-Attention Yunyang Xiong, Zhanpeng Zeng, Rudrasis Chakraborty, Mingxing Tan, Glenn Fung, Yin Li, Vikas Singh arXiv_CL arXiv_CL Transformer Review Pose Attention PDF
2021-02-07 Unsupervised Sentence-embeddings by Manifold Approximation and Projection Subhradeep Kayal arXiv_CL arXiv_CL Transformer Embedding Unsupervised Text_Classification Pose Action Classification PDF
2021-02-04 RoI Tanh-polar Transformer Network for Face Parsing in the Wild Yiming Lin, Jie Shen, Yujiang Wang, Maja Pantic arXiv_CV arXiv_CV Transformer Represenation_Learning Pose Face Action CNN PDF
2021-02-04 Adaptive Semiparametric Language Models Dani Yogatama, Cyprien de Masson d'Autume, Lingpeng Kong arXiv_CL arXiv_CL Transformer Pose Language_Model Prediction PDF
2021-02-03 MUFASA: Multimodal Fusion Architecture Search for Electronic Health Records Zhen Xu, David R. So, Andrew M. Dai arXiv_AI arXiv_AI Transformer NAS Sparse Pose Deep_Learning Prediction PDF
2021-02-03 DiSCoL: Toward Engaging Dialogue Systems through Conversational Line Guided Response Generation Sarik Ghazarian, Zixi Liu, Tuhin Chakrabarty, Xuezhe Ma, Aram Galstyan, Nanyun Peng arXiv_CL arXiv_CL Transformer Language_Model PDF
2021-02-03 Bootstrapping Multilingual AMR with Contextual Word Alignments Janaki Sheth, Young-Suk Lee, Ramon Fernandez Astudillo, Tahira Naseem, Radu Florian, Salim Roukos, Todd Ward arXiv_AI arXiv_AI Transformer Embedding Bert Weakly_Supervised PDF
2021-02-03 Neural Transfer Learning with Transformers for Social Science Text Analysis Sandra Wankmüller arXiv_CL arXiv_CL Transformer Transfer_Learning Bert Deep_Learning Prediction PDF
2021-02-03 Top-down Discourse Parsing via Sequence Labelling Fajri Koto, Jey Han Lau, Timothy Baldwin arXiv_CL arXiv_CL Transformer RNN Pose PDF
2021-02-03 Towards Natural and Controllable Cross-Lingual Voice Conversion Based on Neural TTS Model and Phonetic Posteriorgram Shengkui Zhao, Hao Wang, Trung Hieu Nguyen, Bin Ma arXiv_SD arXiv_SD Transformer Speech Pose Inference PDF
2021-02-03 Riiid! Answer Correctness Prediction Kaggle Challenge: 4th Place Solution Summary Duc Kinh Le Tran arXiv_AI arXiv_AI Transformer Embedding Attention Prediction PDF
2021-02-03 Pitfalls of Static Language Modelling Angeliki Lazaridou, Adhiguna Kuncoro, Elena Gribovskaya, Devang Agrawal, Adam Liska, Tayfun Terzi, Mai Gimenez, Cyprien de Masson d'Autume, Sebastian Ruder, Dani Yogatama, Kris Cao, Tomas Kocisky, Susannah Young, Phil Blunsom arXiv_AI arXiv_AI Transformer Knowledge Language_Model PDF
2021-02-03 Roughly Collected Dataset for Contact Force Sensing Catheter Seunghyuk Cho, Minsoo Koo, Dongwoo Kim, Juyong Lee, Yeonwoo Jung, Kibyung Nam, Changmo Hwang arXiv_RO arXiv_RO Transformer RNN CNN PDF
2021-02-03 HeBERT & HebEMO: a Hebrew BERT Model and a Tool for Polarity Analysis and Emotion Recognition Avihay Chriqui, Inbal Yahav arXiv_CL arXiv_CL Transformer Recognition Bert Pose Emotion Classification Detection Sentiment Language_Model PDF
2021-02-03 Relaxed Transformer Decoders for Direct Action Proposal Generation Jing Tan, Jiaqi Tang, Limin Wang, Gangshan Wu arXiv_CV arXiv_CV Transformer Video_Caption Sparse Action Detection Activity Matching PDF
2021-02-02 Clickbait Headline Detection in Indonesian News Sites using Multilingual Bidirectional Encoder Representations from Transformers Muhammad N. Fakhruzzaman, Saidah Z. Jannah, Ratih A. Ningrum, Indah Fahmiyah arXiv_CL arXiv_CL Transformer Embedding Bert Text_Classification Pose Classification Detection Language_Model PDF
2021-02-01 Improving Distantly-Supervised Relation Extraction through BERT-based Label & Instance Embeddings Despina Christou, Grigorios Tsoumakas arXiv_CL arXiv_CL Transformer Embedding Bert Pose Action Relation Relation_Extraction Attention PDF
2021-02-01 Civil Rephrases Of Toxic Texts With Self-Supervised Transformers Leo Laugier, John Pavlopoulos, Jeffrey Sorensen, Lucas Dixon arXiv_AI arXiv_AI Transformer Style_Transfer Self-Supervised Detection Denoising PDF
2021-02-01 Scaling Federated Learning for Fine-tuning of Large Language Models Agrin Hilmkil, Sebastian Callh, Matteo Barbieri, Leon René Sütfeld, Edvin Listo Zec, Olof Mogren arXiv_CL arXiv_CL Transformer Bert Text_Classification Review Classification Sentiment Language_Model PDF
2021-02-01 Automated Query Reformulation for Efficient Search based on Query Logs From Stack Overflow Kaibo Cao (1), Chunyang Chen (2), Sebastian Baltes (3), Christoph Treude (3), Xiang Chen (4) ((1) Software Institute, Nanjing University, China, (2) Faculty of Information Technology, Monash University, Australia, (3) School of Computer Science, University of Adelaide, Australia, (4) School of Information Science and Technology, Nantong University, China) arXiv_AI arXiv_AI Transformer Pose Deep_Learning PDF
2021-02-01 GTAE: Graph-Transformer based Auto-Encoders for Linguistic-Constrained Text Style Transfer Yukai Shi, Sen Zhang, Chenxing Zhou, Xiaodan Liang, Xiaojun Yang, Liang Lin arXiv_AI arXiv_AI Transformer Embedding Style_Transfer Pose Action Quantitative PDF
2021-02-01 Video Transformer Network Daniel Neimark, Omri Bar, Maya Zohar, Dotan Asselmann arXiv_CV arXiv_CV Transformer Recognition 3D Action_Recognition Action Inference PDF
2021-01-31 Short Text Clustering with Transformers Leonid Pugachev, Mikhail Burtsev arXiv_CL arXiv_CL Transformer Embedding Transfer_Learning Enhancement Classification Language_Model PDF
2021-01-31 Decoupling the Role of Data, Attention, and Losses in Multimodal Transformers Lisa Anne Hendricks, John Mellor, Rosalia Schneider, Jean-Baptiste Alayrac, Aida Nematzadeh arXiv_CV arXiv_CV Transformer Zero-Shot Image_Retrieval Self-Supervised Attention PDF
2021-01-31 Extending Neural Keyword Extraction with TF-IDF tagset matching Boshko Koloski, Senja Pollak, Blaž Škrlj, Matej Martinc arXiv_CL arXiv_CL Transformer Unsupervised Bert RNN Action Recommendation Matching PDF
2021-01-30 ShufText: A Simple Black Box Approach to Evaluate the Fragility of Text Classification Models Rutuja Taware, Shraddha Varat, Gaurav Salunke, Chaitanya Gawande, Geetanjali Kale, Rahul Khengare, Raviraj Joshi arXiv_CL arXiv_CL Transformer Bert Text_Classification RNN Pose Classification Deep_Learning Sentiment Language_Model PDF
2021-01-30 MUSE: Multi-Scale Temporal Features Evolution for Knowledge Tracing Chengwei Zhang, Yangzhou Jiang, Wei Zhang, Chengyu Gu arXiv_AI arXiv_AI Transformer Knowledge Pose Attention Prediction PDF
2021-01-29 NLPBK at VLSP-2020 shared task: Compose transformer pretrained models for Reliable Intelligence Identification on Social network Thanh Chinh Nguyen, Van Nha Nguyen arXiv_CL arXiv_CL Transformer Bert Pose PDF
2021-01-29 Transition based Graph Decoder for Neural Machine Translation Leshem Choshen, Omri Abend arXiv_CL arXiv_CL Transformer RNN Pose NMT PDF
2021-01-29 Fine-tuning BERT-based models for Plant Health Bulletin Classification Shufan Jiang (CRESTIC, ISEP), Rafael Angarita (ISEP), Stephane Cormier (CRESTIC), Francis Rousseaux (CRESTIC) arXiv_CL arXiv_CL Transformer Bert Represenation_Learning Knowledge Pose Classification Deep_Learning Language_Model PDF
2021-01-28 Combining pre-trained language models and structured knowledge Pedro Colon-Hernandez, Catherine Havasi, Jason Alonso, Matthew Huggins, Cynthia Breazeal arXiv_CL arXiv_CL Transformer Knowledge Knowledge_Graph Survey Language_Model PDF
2021-01-28 Modeling Context in Answer Sentence Selection Systems on a Latency Budget Rujun Han, Luca Soldaini, Alessandro Moschitti arXiv_CL arXiv_CL Transformer Unsupervised Attention QA PDF
2021-01-28 A Neural Few-Shot Text Classification Reality Check Thomas Dopierre, Christophe Gravier, Wilfried Logerais arXiv_CL arXiv_CL Transformer Embedding Text_Classification Pose Classification Detection Few-Shot PDF
2021-01-28 Vx2Text: End-to-End Learning of Video-Based Text Generation From Multimodal Inputs Xudong Lin, Gedas Bertasius, Jue Wang, Shih-Fu Chang, Devi Parikh, Lorenzo Torresani arXiv_CV arXiv_CV Transformer Embedding Speech Pose Text_Generation Caption PDF
2021-01-28 A transformer based approach for fighting COVID-19 fake news S.M. Sadiq-Ur-Rahman Shifath, Mohammad Faiyaz Khan, Md. Saiful Islam arXiv_CL arXiv_CL Transformer Pose Detection PDF
2021-01-28 Tokens-to-Token ViT: Training Vision Transformers from Scratch on ImageNet Li Yuan, Yunpeng Chen, Tao Wang, Weihao Yu, Yujun Shi, Francis EH Tay, Jiashi Feng, Shuicheng Yan arXiv_CV arXiv_CV Transformer Pose Classification Relation Attention Image_Classification Language_Model PDF
2021-01-28 LSTM-SAKT: LSTM-Encoded SAKT-like Transformer for Knowledge Tracing, 2nd place solution for Riiid! Answer Correctness Prediction Takashi Oya, Shigeo Morishima arXiv_CL arXiv_CL Transformer RNN Knowledge Pose Prediction PDF
2021-01-28 The Role of Syntactic Planning in Compositional Image Captioning Emanuele Bugliarello, Desmond Elliott arXiv_CV arXiv_CV Image_Caption Transformer RNN Caption PDF
2021-01-28 DRAG: Director-Generator Language Modelling Framework for Non-Parallel Author Stylized Rewriting Hrituraj Singh, Gaurav Verma, Aparna Garimella, Balaji Vasan Srinivasan arXiv_AI arXiv_AI Transformer Pose Quantitative Denoising Language_Model PDF
2021-01-27 Bottleneck Transformers for Visual Recognition Aravind Srinivas, Tsung-Yi Lin, Niki Parmar, Jonathon Shlens, Pieter Abbeel, Ashish Vaswani arXiv_AI arXiv_AI Transformer Segmentation Recognition Classification Detection Object_Detection Attention Image_Classification PDF
2021-01-27 Transformer Based Deliberation for Two-Pass Speech Recognition Ke Hu, Ruoming Pang, Tara N. Sainath, Trevor Strohman arXiv_CL arXiv_CL Transformer Recognition RNN Speech Attention Speech_Recognition PDF
2021-01-27 Spatial-Channel Transformer Network for Trajectory Prediction on the Traffic Scenes Jingwen Zhao, Xuanpeng Li, Qifan Xue, Weigong Zhang arXiv_CV arXiv_CV Transformer RNN Action Attention Autonomous Prediction PDF
2021-01-27 Adversarial Stylometry in the Wild: Transferable Lexical Substitution Attacks on Author Profiling Chris Emmery, Ákos Kádár, Grzegorz Chrupała arXiv_CL arXiv_CL Transformer Adversarial Pose PDF
2021-01-27 Exploring multi-task multi-lingual learning of transformer models for hate speech and offensive speech identification in social media Sudhanshu Mishra, Shivangi Prasad, Shubhanshu Mishra arXiv_AI arXiv_AI Transformer Speech Pose Inference PDF
2021-01-26 Event-Driven News Stream Clustering using Entity-Aware Contextual Embeddings Kailash Karthik Saravanakumar, Miguel Ballesteros, Muthu Kumar Chandrasekaran, Kathleen McKeown arXiv_AI arXiv_AI Transformer Embedding Sparse Knowledge Pose Classification PDF
2021-01-26 'Laughing at you or with you': The Role of Sarcasm in Shaping the Disagreement Space Debanjan Ghosh, Ritvik Shrivastava, Smaranda Muresan arXiv_CL arXiv_CL Transformer RNN Action Classification Deep_Learning Detection Relation Attention PDF
2021-01-26 Attention Can Reflect Syntactic Structure Vinit Ravishankar, Artur Kulmizev, Mostafa Abdou, Anders Søgaard, Joakim Nivre arXiv_CL arXiv_CL Transformer Bert Pose Relation Attention PDF
2021-01-26 CPTR: Full Transformer Network for Image Captioning Wei Liu, Sihan Chen, Longteng Guo, Xinxin Zhu, Jing Liu arXiv_CV arXiv_CV Image_Caption Transformer Pose Attention Caption Prediction PDF
2021-01-26 Analyzing Zero-shot Cross-lingual Transfer in Supervised NLP Tasks Hyunjin Choi, Judong Kim, Seongho Joe, Seungjai Min, Youngjune Gwon arXiv_AI arXiv_AI Transformer Embedding Bert Zero-Shot Sentiment Language_Model PDF
2021-01-26 Coloring the Black Box: What Synesthesia Tells Us about Character Embeddings Katharina Kann, Mauro M. Monsalve-Mercado arXiv_CL arXiv_CL Transformer Embedding RNN GAN PDF
2021-01-25 Randomized Deep Structured Prediction for Discourse-Level Processing Manuel Widmoser, Maria Leonor Pacheco, Jean Honorio, Dan Goldwasser arXiv_AI arXiv_AI Transformer RNN Inference Prediction PDF
2021-01-25 Learning From Revisions: Quality Assessment of Claims in Argumentation at Scale Gabriella Skitalinskaya, Jonas Klaff, Henning Wachsmuth arXiv_CL arXiv_CL Transformer Embedding Pose PDF
2021-01-25 CHOLAN: A Modular Approach for Neural Entity Linking on Wikipedia and Wikidata Manoj Prabhakar Kannan Ravi, Kuldeep Singh, Isaiah Onando Mulang', Saeedeh Shekarpour, Johannes Hoffart, Jens Lehmann arXiv_CL arXiv_CL Transformer Knowledge Pose Face PDF
2021-01-25 ECOL-R: Encouraging Copying in Novel Object Captioning with Reinforcement Learning Yufei Wang, Ian D. Wood, Stephen Wan, Mark Johnson arXiv_CV arXiv_CV Image_Caption Transformer Reinforcement_Learning Zero-Shot Salient Knowledge Pose Detection Object_Detection Caption PDF
2021-01-24 Does Dialog Length matter for Next Response Selection task? An Empirical Study Jatin Ganhotra, Sachindra Joshi arXiv_CL arXiv_CL Transformer Bert Attention PDF
2021-01-24 WangchanBERTa: Pretraining transformer-based Thai Language Models Lalita Lowphansirikul, Charin Polpanumas, Nawat Jantrakulchai, Sarana Nutanong arXiv_CL arXiv_CL Transformer Bert Classification Language_Model PDF
2021-01-22 BERT Transformer model for Detecting Arabic GPT2 Auto-Generated Tweets Fouzi Harrag, Maria Debbah, Kareem Darwish, Ahmed Abdelali arXiv_CL arXiv_CL Transformer Embedding Transfer_Learning Bert RNN Knowledge Pose Language_Model PDF
2021-01-22 Drug and Disease Interpretation Learning with Biomedical Entity Representation Transformer Zulfat Miftahutdinov, Artur Kadurin, Roman Kudrin, Elena Tutubalina arXiv_CL arXiv_CL Transformer Embedding Bert Zero-Shot Knowledge Pose Medical PDF
2021-01-22 Extracting Lifestyle Factors for Alzheimer's Disease from Clinical Notes Using Deep Learning with Weak Supervision Zitao Shen (1), Yoonkwon Yi (1), Anusha Bompelli (2), Fang Yu (3), Yanshan Wang (4), Rui Zhang (2 and 5) ((1) College of Science & Engineering, University of Minnesota, (2) Department of Pharmaceutical Care & Health Systems, University of Minnesota, (3) Edson College of Nursing and Health Innovation, Arizona State University, (4) Department of AI & Informatics, Mayo Clinic, (5) Institute for Health Informatics, University of Minnesota) arXiv_CL arXiv_CL Transformer Bert Pose Deep_Learning Medical Activity PDF
2021-01-22 The heads hypothesis: A unifying statistical approach towards understanding multi-headed attention in BERT Madhura Pande, Aakriti Budhraja, Preksha Nema, Pratyush Kumar, Mitesh M. Khapra arXiv_AI arXiv_AI Transformer Bert Pose Classification Relation Attention Inference PDF
2021-01-22 Multilingual Pre-Trained Transformers and Convolutional NN Classification Models for Technical Domain Identification Suman Dowlagar, Radhika Mamidi arXiv_CL arXiv_CL Transformer Transfer_Learning Bert Text_Classification Classification CNN PDF
2021-01-22 CMSAOne@Dravidian-CodeMix-FIRE2020: A Meta Embedding and Transformer model for Code-Mixed Sentiment Analysis on Social Media Text Suman Dowlagar, Radhika Mamidi arXiv_CL arXiv_CL Transformer Embedding Pose Sentiment PDF
2021-01-22 Enriching Non-Autoregressive Transformer with Syntactic and SemanticStructures for Neural Machine Translation Ye Liu, Yao Wan, Jian-Guo Zhang, Wenting Zhao, Philip S. Yu arXiv_AI arXiv_AI Transformer Pose PDF
2021-01-21 Distilling Large Language Models into Tiny and Effective Students using pQRNN Prabhu Kaliamoorthi, Aditya Siddhant, Edward Li, Melvin Johnson arXiv_AI arXiv_AI Transformer Embedding Bert RNN Pose Language_Model PDF
2021-01-21 SSTVOS: Sparse Spatiotemporal Transformers for Video Object Segmentation Brendan Duke, Abdalla Ahmed, Christian Wolf, Parham Aarabi, Graham W. Taylor arXiv_CV arXiv_CV Transformer Segmentation Sparse Pose Attention PDF
2021-01-21 Learn to Dance with AIST++: Music Conditioned 3D Dance Generation Ruilong Li, Shan Yang, David A. Ross, Angjoo Kanazawa arXiv_CV arXiv_CV Transformer 3D Knowledge Pose Quantitative Relation Attention PDF
2021-01-21 DAF:re: A Challenging, Crowd-Sourced, Large-Scale, Long-Tailed Dataset For Anime Character Recognition Edwin Arkel Rios, Wen-Huang Cheng, Bo-Cheng Lai arXiv_CV arXiv_CV Transformer Transfer_Learning Recognition Pose Face Classification Attention PDF
2021-01-21 Activity Graph Transformer for Temporal Action Localization Megha Nawhal, Greg Mori arXiv_AI arXiv_AI Transformer Action_Localization Pose Action Detection Activity PDF
2021-01-21 Adv-OLM: Generating Textual Adversaries via OLM Vijit Malik, Ashwani Bhat, Ashutosh Modi arXiv_AI arXiv_AI Transformer Text_Classification Adversarial Classification Deep_Learning Language_Model PDF
2021-01-21 Segmenting Transparent Object in the Wild with Transformer Enze Xie, Wenjia Wang, Wenhai Wang, Peize Sun, Hang Xu, Ding Liang, Ping Luo arXiv_CV arXiv_CV Transformer Segmentation Semantic_Segmentation Pose PDF
2021-01-21 Arabic Speech Recognition by End-to-End, Modular Systems and Human Amir Hussein, Shinji Watanabe, Ahmed Ali arXiv_CL arXiv_CL Transformer Recognition Speech Speech_Recognition PDF
2021-01-21 Evaluating Multilingual Text Encoders for Unsupervised Cross-Lingual Retrieval Robert Litschko, Ivan Vulić, Simone Paolo Ponzetto, Goran Glavaš arXiv_CL arXiv_CL Transformer Embedding Unsupervised Bert Represenation_Learning Pose PDF
2021-01-20 Aesthetics, Personalization and Recommendation: A survey on Deep Learning in Fashion Wei Gong, Laila Khalid arXiv_CV arXiv_CV Transformer Knowledge Survey Deep_Learning GAN Recommendation PDF
2021-01-20 Fast deep learning correspondence for neuron tracking and identification in C.elegans using synthetic training Xinwei Yu, Matthew S. Creamer, Francesco Randi, Anuj K. Sharma, Scott W. Linderman, Andrew M. Leifer arXiv_CV arXiv_CV Transformer Tracking Transfer_Learning Deep_Learning GAN PDF
2021-01-20 Open-Domain Conversational Search Assistant with Transformers Rafael Ferreira, Mariana Leite, David Semedo, Joao Magalhaes arXiv_CL arXiv_CL Transformer Pose PDF
2021-01-20 Active Learning for Sequence Tagging with Deep Pre-trained Models and Bayesian Uncertainty Estimates Artem Shelmanov, Dmitri Puzyrev, Lyubov Kupriyanova, Denis Belyakov, Daniil Larionov, Nikita Khromov, Olga Kozlova, Ekaterina Artemova, Dmitry V. Dylov, Alexander Panchenko arXiv_CL arXiv_CL Transformer Transfer_Learning Classification PDF
2021-01-20 Classifying Scientific Publications with BERT -- Is Self-Attention a Feature Selection Method? Andres Garcia-Silva, Jose Manuel Gomez-Perez arXiv_AI arXiv_AI Transformer Bert Text_Classification Classification Attention PDF
2021-01-20 UPDeT: Universal Multi-agent Reinforcement Learning via Policy Decoupling with Transformers Siyi Hu, Fengda Zhu, Xiaojun Chang, Xiaodan Liang arXiv_AI arXiv_AI Transformer Reinforcement_Learning RNN Pose Action Attention PDF
2021-01-20 PGT: Pseudo Relevance Feedback Using a Graph-Based Transformer HongChien Yu, Zhuyun Dai, Jamie Callan arXiv_AI arXiv_AI Transformer Attention PDF
2021-01-19 Towards Facilitating Empathic Conversations in Online Mental Health Support: A Reinforcement Learning Approach Ashish Sharma, Inna W. Lin, Adam S. Miner, David C. Atkins, Tim Althoff arXiv_CL arXiv_CL Transformer Style_Transfer Reinforcement_Learning Pose Emotion Language_Model PDF
2021-01-19 Fast Convergence of DETR with Spatially Modulated Co-Attention Peng Gao, Minghang Zheng, Xiaogang Wang, Jifeng Dai, Hongsheng Li arXiv_CV arXiv_CV Transformer Pose Detection Object_Detection Attention PDF
2021-01-18 Teach me how to Label: Labeling Functions from Natural Language with Text-to-text Transformers Yannis Papanikolaou arXiv_CL arXiv_CL Transformer Pose PDF
2021-01-18 Mitigating the Position Bias of Transformer Models in Passage Re-Ranking Sebastian Hofstätter, Aldo Lipani, Sophia Althammer, Markus Zlabinger, Allan Hanbury arXiv_CL arXiv_CL Transformer Pose PDF
2021-01-18 HinFlair: pre-trained contextual string embeddings for pos tagging and text classification in the Hindi language Harsh Patel arXiv_CL arXiv_CL Transformer Embedding Recognition Text_Classification RNN Classification Language_Model PDF
2021-01-16 Transformer-Based Models for Question Answering on COVID19 Hillary Ngai, Yoona Park, John Chen, Mahboobeh Parsapoor (Mah Parsa) arXiv_CL arXiv_CL Transformer Bert Pose QA PDF
2021-01-16 Dual-Level Collaborative Transformer for Image Captioning Yunpeng Luo, Jiayi Ji, Xiaoshuai Sun, Liujuan Cao, Yongjian Wu, Feiyue Huang, Chia-Wen Lin, Rongrong Ji arXiv_CV arXiv_CV Image_Caption Transformer Pose Detection Relation Object_Detection Attention Caption PDF
2021-01-16 Match-Ignition: Plugging PageRank into Transformer for Long-form Text Matching Liang Pang, Yanyan Lan, Xueqi Cheng arXiv_CL arXiv_CL Transformer Pose Attention Matching PDF
2021-01-16 To Understand Representation of Layer-aware Sequence Encoders as Multi-order-graph Sufeng Duan, Hai Zhao, Rui Wang arXiv_CL arXiv_CL Transformer Salient Pose Relation Attention PDF
2021-01-15 TextGNN: Improving Text Encoder via Graph Neural Network in Sponsored Search Jason Zhu, Yanling Cui, Yuming Liu, Hao Sun, Xue Li, Markus Pelger, Liangjie Zhang, Tianqi Yan, Ruofei Zhang, Huasha Zhao arXiv_CL arXiv_CL Transformer Bert Pose PDF
2021-01-15 LIME: Learning Inductive Bias for Primitives of Mathematical Reasoning Yuhuai Wu, Markus Rabe, Wenda Li, Jimmy Ba, Roger Grosse, Christian Szegedy arXiv_AI arXiv_AI Transformer Knowledge Action PDF
2021-01-15 Temporal-Relational CrossTransformers for Few-Shot Action Recognition Toby Perrett, Alessandro Masullo, Tilo Burghardt, Majid Mirmehdi, Dima Damen arXiv_CV arXiv_CV Transformer Recognition Pose Action_Recognition Action Relation Few-Shot Attention Matching PDF
2021-01-15 Reasoning over Vision and Language: Exploring the Benefits of Supplemental Knowledge Violetta Shevchenko, Damien Teney, Anthony Dick, Anton van den Hengel arXiv_CV arXiv_CV Transformer Embedding Knowledge Pose Relation VQA Language_Model QA Matching PDF
2021-01-15 KDLSQ-BERT: A Quantized Bert Combining Knowledge Distillation with Learned Step Size Quantization Jing Jin, Cai Liang, Tiancheng Wu, Liqin Zou, Zhiliang Gan arXiv_AI arXiv_AI Transformer Quantization Bert Knowledge Pose Inference Language_Model PDF
2021-01-14 Stacked DeBERT: All Attention in Incomplete Data for Text Classification Gwenaelle Cunha Sergio, Minho Lee arXiv_CL arXiv_CL Transformer Reconstruction Embedding Bert Text_Classification Speech Pose Classification Sentiment Denoising Attention QA PDF
2021-01-14 Transformer-based Language Model Fine-tuning Methods for COVID-19 Fake News Detection Ben Chen, Bin Chen, Dehong Gao, Qijin Chen, Chengfu Huo, Xiaonan Meng, Weijun Ren, Yang Zhou arXiv_AI arXiv_AI Transformer OCR Bert Knowledge Adversarial Pose Quantitative Detection Language_Model PDF
2021-01-14 Exploration of Visual Features and their weighted-additive fusion for Video Captioning Praveen S V, Akhilesh Bharadwaj, Harsh Raj, Janhavi Dadhania, Ganesh Samarth C.A, Nikhil Pareek, S R M Prasanna arXiv_CV arXiv_CV Transformer Video_Caption Caption Activity CNN PDF
2021-01-13 Coarse and Fine-Grained Hostility Detection in Hindi Posts using Fine Tuned Multilingual Embeddings Arkadipta De, Venkatesh E, Kaushal Kumar Maurya, Maunendra Sankar Desarkar arXiv_CL arXiv_CL Transformer Embedding Bert Pose Face Classification Detection PDF
2021-01-13 COVID-19 Deterioration Prediction via Self-Supervised Representation Learning and Multi-Image Prediction Anuroop Sriram, Matthew Muckley, Koustuv Sinha, Farah Shamout, Joelle Pineau, Krzysztof J. Geras, Lea Azour, Yindalon Aphinyanaphongs, Nafissa Yakubova, William Moore arXiv_CV arXiv_CV Image_Caption Transformer Represenation_Learning Self-Supervised Pose Prediction PDF
2021-01-12 Of Non-Linearity and Commutativity in BERT Sumu Zhao, Damian Pascual, Gino Brunner, Roger Wattenhofer arXiv_AI arXiv_AI Transformer Bert Pose Action Attention PDF
2021-01-12 Neural Contract Element Extraction Revisited Ilias Chalkidis, Manos Fergadiotis, Prodromos Malakasiotis, Ion Androutsopoulos arXiv_CL arXiv_CL Transformer Embedding Bert RNN Action Language_Model PDF
2021-01-11 BERT-GT: Cross-sentence n-ary relation extraction with BERT and Graph Transformer Po-Ting Lai, Zhiyong Lu arXiv_CL arXiv_CL Transformer Bert RNN Pose Action Relation Relation_Extraction Attention Medical PDF
2021-01-11 Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsity William Fedus, Barret Zoph, Noam Shazeer arXiv_AI arXiv_AI Transformer Sparse Pose Deep_Learning Language_Model PDF
2021-01-11 A More Efficient Chinese Named Entity Recognition base on BERT and Syntactic Analysis Xiao Fu, Guijun Zhang arXiv_CL arXiv_CL Transformer Segmentation Recognition Bert Speech Pose PDF
2021-01-11 Spherical Transformer: Adapting Spherical Signal to ConvolutionalNetworks Haikuan Du, Hui Cao, Shen Cai, Junchi Yan, Siyu Zhang arXiv_CV arXiv_CV Transformer Segmentation Semantic_Segmentation Recognition 3D Pose Classification CNN Image_Classification PDF
2021-01-11 Model Generalization on COVID-19 Fake News Detection Yejin Bang, Etsuko Ishii, Samuel Cahyawijaya, Ziwei Ji, Pascale Fung arXiv_AI arXiv_AI Transformer Pose Detection Language_Model PDF
2021-01-11 Revisiting Mahalanobis Distance for Transformer-Based Out-of-Domain Detection Alexander Podolskiy, Dmitry Lipin, Andrey Bout, Ekaterina Artemova, Irina Piontkovskaya arXiv_CL arXiv_CL Transformer Classification Detection Attention PDF
2021-01-11 Investigating the Vision Transformer Model for Image Retrieval Tasks Socratis Gkelios, Yiannis Boutalis, Savvas A. Chatzichristofis arXiv_CV arXiv_CV Transformer Image_Retrieval Pose CNN PDF
2021-01-10 Summaformers @ LaySumm 20, LongSumm 20 Sayar Ghosh Roy, Nikhil Pinnaparaju, Risubh Jain, Manish Gupta, Vasudeva Varma arXiv_AI arXiv_AI Transformer Pose Deep_Learning Summarization PDF
2021-01-10 Channel Boosting Feature Ensemble for Radar-based Object Detection Shoaib Azam, Farzeen Munir, Moongu Jeon arXiv_CV arXiv_CV Transformer Pose Detection Object_Detection Autonomous Prediction PDF
2021-01-10 Cisco at AAAI-CAD21 shared task: Predicting Emphasis in Presentation Slides using Contextualised Embeddings Sreyan Ghosh, Sonal Kumar, Harsh Jalan, Hemant Yadav, Rajiv Ratn Shah arXiv_CL arXiv_CL Transformer Embedding Bert RNN Pose PDF
2021-01-09 Task Adaptive Pretraining of Transformers for Hostility Detection Tathagata Raha, Sayar Ghosh Roy, Ujwal Narayan, Zubair Abid, Vasudeva Varma arXiv_CL arXiv_CL Transformer Classification Detection PDF
2021-01-09 Learning Better Sentence Representation with Syntax Information Chen Yang (University of Science and Technology of China) arXiv_CL arXiv_CL Transformer Bert Text_Classification RNN Knowledge Pose Action Classification Relation Sentiment Relation_Extraction Language_Model PDF
2021-01-09 LightXML: Transformer with Dynamic Negative Sampling for High-Performance Extreme Multi-label Text Classification Ting Jiang, Deqing Wang, Leilei Sun, Huayi Yang, Zhengyang Zhao, Fuzhen Zhuang arXiv_CL arXiv_CL Transformer Text_Classification Pose Classification Deep_Learning Attention PDF
2021-01-09 Trankit: A Light-Weight Transformer-based Toolkit for Multilingual Natural Language Processing Minh Nguyen, Viet Lai, Amir Pouran Ben Veyseh, Thien Huu Nguyen arXiv_CL arXiv_CL Transformer Segmentation Speech Language_Model PDF
2021-01-08 Leveraging Multilingual Transformers for Hate Speech Detection Sayar Ghosh Roy, Ujwal Narayan, Tathagata Raha, Zubair Abid, Vasudeva Varma arXiv_AI arXiv_AI Transformer Speech Classification Detection Language_Model PDF
2021-01-08 Multistage BiCross Encoder: Team GATE Entry for MLIA Multilingual Semantic Search Task 2 Iknoor Singh, Carolina Scarton, Kalina Bontcheva arXiv_AI arXiv_AI Transformer PDF
2021-01-07 TrackFormer: Multi-Object Tracking with Transformers Tim Meinhardt, Alexander Kirillov, Laura Leal-Taixe, Christoph Feichtenhofer arXiv_CV arXiv_CV Transformer Segmentation Embedding Tracking Video_Caption Object_Tracking Detection Object_Detection Attention PDF
2021-01-07 Ask2Transformers: Zero-Shot Domain labelling with Pre-trained Language Models Oscar Sainz, German Rigau arXiv_CL arXiv_CL Transformer Zero-Shot Knowledge Pose Language_Model PDF
2021-01-07 Compound Word Transformer: Learning to Compose Full-Song Music over Dynamic Directed Hypergraphs Wen-Yi Hsiao, Jen-Yu Liu, Yin-Cheng Yeh, Yi-Hsuan Yang arXiv_AI arXiv_AI Transformer Pose PDF
2021-01-07 Exploring Text-transformers in AAAI 2021 Shared Task: COVID-19 Fake News Detection in English Xiangyang Li, Yu Xia, Xiang Long, Zheng Li, Sujian Li arXiv_AI arXiv_AI Transformer Bert Pose Detection Language_Model PDF
2021-01-06 Line Segment Detection Using Transformers without Edges Yifan Xu, Weijian Xu, David Cheung, Zhuowen Tu arXiv_CV arXiv_CV Transformer Segmentation Detection Attention Inference PDF
2021-01-05 Trear: Transformer-based RGB-D Egocentric Action Recognition Xiangyu Li, Yonghong Hou, Pichao Wang, Zhimin Gao, Mingliang Xu, Wanqing Li arXiv_CV arXiv_CV Transformer Recognition Pose Action_Recognition Action Attention Optical_Flow PDF
2021-01-05 AutoDropout: Learning Dropout Patterns to Regularize Deep Networks Hieu Pham, Quoc V. Le arXiv_AI arXiv_AI Transformer Recognition Regularization Pose Language_Model PDF
2021-01-05 I-BERT: Integer-only BERT Quantization Sehoon Kim, Amir Gholami, Zhewei Yao, Michael W. Mahoney, Kurt Keutzer arXiv_CL arXiv_CL Transformer Quantization Bert Pose Inference PDF
2021-01-04 Transformers and Transfer Learning for Improving Portuguese Semantic Role Labeling Sofia Oliveira, Daniel Loureiro, Alípio Jorge arXiv_CL arXiv_CL Transformer Transfer_Learning Bert Pose PDF
2021-01-04 Transformers in Vision: A Survey Salman Khan, Muzammal Naseer, Munawar Hayat, Syed Waqas Zamir, Fahad Shahbaz Khan, Mubarak Shah arXiv_AI arXiv_AI Transformer Segmentation Recognition Point_Cloud Super_Resolution 3D Knowledge Survey Action_Recognition Action Classification Detection Object_Detection Attention Activity Image_Classification PDF
2021-01-04 Transformer-based Conditional Variational Autoencoder for Controllable Story Generation Le Fang, Tao Zeng, Chaochun Liu, Liefeng Bo, Wen Dong, Changyou Chen arXiv_AI arXiv_AI Transformer Represenation_Learning Language_Model PDF
2021-01-03 An Efficient Transformer Decoder with Compressed Sub-layers Yanyang Li, Ye Lin, Tong Xiao, Jingbo Zhu arXiv_CL arXiv_CL Transformer Pose Attention PDF
2021-01-02 VinVL: Making Visual Representations Matter in Vision-Language Models Pengchuan Zhang, Xiujun Li, Xiaowei Hu, Jianwei Yang, Lei Zhang, Lijuan Wang, Yejin Choi, Jianfeng Gao arXiv_AI arXiv_AI Transformer Detection Object_Detection Language_Model PDF
2021-01-02 Coreference Resolution without Span Representations Yuval Kirstain, Ori Ram, Omer Levy arXiv_CL arXiv_CL Transformer Language_Model PDF
2021-01-02 Zero-shot Learning by Generating Task-specific Adapters Qinyuan Ye, Xiang Ren arXiv_CL arXiv_CL Transformer Zero-Shot Text_Generation PDF
2021-01-02 KM-BART: Knowledge Enhanced Multimodal BART for Visual Commonsense Generation Yiran Xing, Zai Shi, Zhao Meng, Yunpu Ma, Roger Wattenhofer arXiv_CL arXiv_CL Transformer Knowledge Knowledge_Graph Pose Language_Model PDF
2021-01-02 Lex-BERT: Enhancing BERT based NER with lexicons Wei Zhu, Daniel Cheung arXiv_CL arXiv_CL Transformer Embedding Recognition Bert PDF
2021-01-02 What all do audio transformer models hear? Probing Acoustic Representations for Language Delivery and its Structure Jui Shah, Yaman Kumar Singla, Changyou Chen, Rajiv Ratn Shah arXiv_CL arXiv_CL Transformer Embedding Bert Speech Face PDF
2021-01-01 VisualSparta: Sparse Transformer Fragment-level Matching for Large-scale Text-to-Image Search Xiaopeng Lu, Tiancheng Zhao, Kyusong Lee arXiv_CV arXiv_CV Transformer Sparse Image_Retrieval Knowledge Pose Matching PDF
2021-01-01 Semantic Parsing with Less Prior and More Monolingual Data Sajad Norouzi, Yanshuai Cao arXiv_CL arXiv_CL Transformer Knowledge PDF
2021-01-01 Subformer: Exploring Weight Sharing for Parameter Efficiency in Generative Transformers Machel Reid, Edison Marrese-Taylor, Yutaka Matsuo arXiv_CL arXiv_CL Transformer Embedding Pose Summarization Language_Model PDF
2021-01-01 Transformer based Automatic COVID-19 Fake News Detection System Sunil Gundapu, Radhika Mamid arXiv_CL arXiv_CL Transformer Bert Detection PDF
2020-12-31 A Multi-modal Deep Learning Model for Video Thumbnail Selection Zhifeng Yu, Nanchun Shi arXiv_AI arXiv_AI Transformer Knowledge Pose Face Action Deep_Learning Attention CNN PDF
2020-12-31 Rethinking Semantic Segmentation from a Sequence-to-Sequence Perspective with Transformers Sixiao Zheng, Jiachen Lu, Hengshuang Zhao, Xiatian Zhu, Zekun Luo, Yabiao Wang, Yanwei Fu, Jianfeng Feng, Tao Xiang, Philip H.S. Torr, Li Zhang arXiv_CV arXiv_CV Transformer Segmentation Semantic_Segmentation Attention CNN Prediction PDF
2020-12-31 Shortformer: Better Language Modeling using Shorter Inputs Ofir Press, Noah A. Smith, Mike Lewis arXiv_CL arXiv_CL Transformer Embedding Language_Model PDF
2020-12-31 Fully Non-autoregressive Neural Machine Translation: Tricks of the Trade Jiatao Gu, Xiang Kong arXiv_CL arXiv_CL Transformer Pose Inference PDF
2020-12-31 MiniLMv2: Multi-Head Self-Attention Relation Distillation for Compressing Pretrained Transformers Wenhui Wang, Hangbo Bao, Shaohan Huang, Li Dong, Furu Wei arXiv_CL arXiv_CL Transformer Bert Knowledge Action Relation Attention PDF
2020-12-31 Promoting Graph Awareness in Linearized Graph-to-Text Generation Alexander Hoyle, Ana Marasović, Noah Smith arXiv_CL arXiv_CL Transformer Denoising Text_Generation PDF
2020-12-31 Revisiting Robust Neural Machine Translation: A Transformer Case Study Peyman Passban, Puneeth S.M. Saladi, Qun Liu arXiv_CL arXiv_CL Transformer Pose NMT PDF
2020-12-31 ERNIE-DOC: The Retrospective Long-Document Modeling Transformer Siyu Ding, Junyuan Shang, Shuohuan Wang, Yu Sun, Hao Tian, Hua Wu, Haifeng Wang arXiv_CL arXiv_CL Transformer Text_Classification Sparse Pose Classification Relation Attention Language_Model PDF
2020-12-31 HateCheck: Functional Tests for Hate Speech Detection Models Paul Röttger, Bertram Vidgen, Dong Nguyen, Zeerak Waseem, Helen Margetts, Janet Pierrehumbert arXiv_CL arXiv_CL Transformer Review Speech Detection PDF
2020-12-31 XLM-T: Scaling up Multilingual Machine Translation with Pretrained Cross-lingual Transformer Encoders Shuming Ma, Jian Yang, Haoyang Huang, Zewen Chi, Li Dong, Dongdong Zhang, Hany Hassan Awadalla, Alexandre Muzio, Akiko Eriguchi, Saksham Singhal, Xia Song, Arul Menezes, Furu Wei arXiv_CL arXiv_CL Transformer Unsupervised Classification Language_Model PDF
2020-12-31 AraGPT2: Pre-Trained Transformer for Arabic Language Generation Wissam Antoun, Fady Baly, Hazem Hajj arXiv_CL arXiv_CL Transformer Language_Model PDF
2020-12-31 TransTrack: Multiple-Object Tracking with Transformer Peize Sun, Yi Jiang, Rufeng Zhang, Enze Xie, Jinkun Cao, Xinting Hu, Tao Kong, Zehuan Yuan, Changhu Wang, Ping Luo arXiv_CV arXiv_CV Transformer Tracking Object_Tracking Pose Action Detection Object_Detection PDF
2020-12-31 Verb Knowledge Injection for Multilingual Event Processing Olga Majewska, Ivan Vulić, Goran Glavaš, Edoardo M. Ponti, Anna Korhonen arXiv_CL arXiv_CL Transformer Zero-Shot Knowledge Action Language_Model PDF
2020-12-31 An Experimental Evaluation of Transformer-based Language Models in the Biomedical Domain Paul Grouchy, Shobhit Jain, Michael Liu, Kuhan Wang, Max Tian, Nidhi Arora, Hillary Ngai, Faiza Khan Khattak, Elham Dolatabadi, Sedef Akinli Kocak arXiv_CL arXiv_CL Transformer Bert Medical Language_Model QA PDF
2020-12-31 Directed Beam Search: Plug-and-Play Lexically Constrained Language Generation Damian Pascual, Beni Egressy, Florian Bolli, Roger Wattenhofer arXiv_AI arXiv_AI Transformer Pose Language_Model PDF
2020-12-30 Optimizing Deeper Transformers on Small Datasets: An Application on Text-to-SQL Semantic Parsing Peng Xu, Wei Yang, Wenjie Zi, Keyi Tang, Chengyang Huang, Jackie Chi Kit Cheung, Yanshuai Cao arXiv_CL arXiv_CL Transformer Bert Relation Prediction PDF
2020-12-30 Deriving Contextualised Semantic Features from BERT Embeddings Jacob Turton, David Vinson, Robert Elliott Smith arXiv_CL arXiv_CL Transformer Embedding Bert Pose PDF
2020-12-30 Unnatural Language Inference Koustuv Sinha, Prasanna Parthasarathi, Joelle Pineau, Adina Williams arXiv_CL arXiv_CL Transformer Bert Pose Inference PDF
2020-12-30 Transformer for Image Quality Assessment Junyong You, Jari Korhonen arXiv_CV arXiv_CV Transformer Embedding Pose CNN PDF
2020-12-30 Improving BERT with Syntax-aware Local Attention Zhongli Li, Qingyu Zhou, Chao Li, Ke Xu, Yunbo Cao arXiv_CL arXiv_CL Transformer Bert Pose Classification Attention Language_Model PDF
2020-12-30 Reservoir Transformer Sheng Shen, Alexei Baevski, Ari S. Morcos, Kurt Keutzer, Michael Auli, Douwe Kiela arXiv_CL arXiv_CL Transformer Language_Model PDF
2020-12-29 Few-Shot Named Entity Recognition: A Comprehensive Study Jiaxin Huang, Chunyuan Li, Krishan Subudhi, Damien Jose, Shobana Balakrishnan, Weizhu Chen, Baolin Peng, Jianfeng Gao, Jiawei Han arXiv_CL arXiv_CL Transformer Recognition Self-Supervised Pose Few-Shot Language_Model PDF
2020-12-29 Transformer Feed-Forward Layers Are Key-Value Memories Mor Geva, Roei Schuster, Jonathan Berant, Omer Levy arXiv_CL arXiv_CL Transformer Language_Model PDF
2020-12-29 A Hierarchical Transformer with Speaker Modeling for Emotion Recognition in Conversation Jiangnan Li, Zheng Lin, Peng Fu, Qingyi Si, Weiping Wang arXiv_CL arXiv_CL Transformer Recognition Pose Emotion Action Relation Attention Prediction PDF
2020-12-29 LayoutLMv2: Multi-modal Pre-training for Visually-Rich Document Understanding Yang Xu, Yiheng Xu, Tengchao Lv, Lei Cui, Furu Wei, Guoxin Wang, Yijuan Lu, Dinei Florencio, Cha Zhang, Wanxiang Che, Min Zhang, Lidong Zhou arXiv_CL arXiv_CL Transformer Action Relation VQA Attention Language_Model QA Matching PDF
2020-12-29 SIT3: Code Summarization with Structure-Induced Transformer Hongqiu Wu, Hai Zhao, Min Zhang arXiv_CL arXiv_CL Transformer RNN Knowledge Pose Attention Summarization PDF
2020-12-28 DeepHateExplainer: Explainable Hate Speech Detection in Under-resourced Bengali Language Md. Rezaul Karim, Sumon Kanti Dey, Bharathi Raja Chakravarthi arXiv_CL arXiv_CL Transformer Embedding Bert RNN Speech Pose Detection PDF
2020-12-28 Context-Aware Personality Inference in Dyadic Scenarios: Introducing the UDIVA Dataset Cristina Palmero, Javier Selva, Sorina Smeureanu, Julio C. S. Jacques Junior, Albert Clapés, Alexa Moseguí, Zejian Zhang, David Gallardo, Georgina Guilera, David Leiva, Sergio Escalera arXiv_AI arXiv_AI Transformer Pose Face Action Relation Inference PDF
2020-12-28 Lattice-Free MMI Adaptation Of Self-Supervised Pretrained Acoustic Models Apoorv Vyas, Srikanth Madikeri, Hervé Bourlard arXiv_SD arXiv_SD Transformer Speech Self-Supervised Pose PDF
2020-12-28 TransPose: Towards Explainable Human Pose Estimation by Transformer Sen Yang, Zhibin Quan, Mu Nie, Wankou Yang arXiv_CV arXiv_CV Transformer Pose_Estimation Pose Relation Attention CNN PDF
2020-12-28 Red Dragon AI at TextGraphs 2020 Shared Task: LIT : LSTM-Interleaved Transformer for Multi-Hop Explanation Ranking Yew Ken Chia, Sam Witteveen, Martin Andrews arXiv_AI arXiv_AI Transformer RNN Pose Action Inference PDF
2020-12-28 Syntax-Enhanced Pre-trained Model Zenan Xu, Daya Guo, Duyu Tang, Qinliang Su, Linjun Shou, Ming Gong, Wanjun Zhong, Xiaojun Quan, Nan Duan, Daxin Jiang arXiv_CL arXiv_CL Transformer Bert Classification Relation Attention PDF
2020-12-27 Portfolio Optimization with 2D Relative-Attentional Gated Transformer Tae Wan Kim, Matloob Khushi arXiv_AI arXiv_AI Transformer Embedding Reinforcement_Learning Optimization Pose Action Attention PDF
2020-12-27 SG-Net: Syntax Guided Transformer for Language Representation Zhuosheng Zhang, Yuwei Wu, Junru Zhou, Sufeng Duan, Hai Zhao, Rui Wang arXiv_AI arXiv_AI Transformer Knowledge Pose Attention Inference PDF
2020-12-27 ARBERT & MARBERT: Deep Bidirectional Transformers for Arabic Muhammad Abdul-Mageed, AbdelRahim Elmadany, El Moatez Billah Nagoudi arXiv_CL arXiv_CL Transformer Bert Pose Classification Language_Model PDF
2020-12-27 Learning Light-Weight Translation Models from Deep Transformer Bei Li, Ziyang Wang, Hui Liu, Quan Du, Tong Xiao, Chunliang Zhang, Jingbo Zhu arXiv_CL arXiv_CL Transformer Knowledge Pose NMT PDF
2020-12-27 Inserting Information Bottlenecks for Attribution in Transformers Zhiying Jiang, Raphael Tang, Ji Xin, Jimmy Lin arXiv_CL arXiv_CL Transformer Bert Quantitative Prediction PDF
2020-12-24 I like fish, especially dolphins: Addressing Contradictions in Dialogue Modelling Yixin Nie, Mary Williamson, Mohit Bansal, Douwe Kiela, Jason Weston arXiv_AI arXiv_AI Transformer Detection QA PDF
2020-12-24 To what extent do human explanations of model behavior align with actual model behavior? Grusha Prasad, Yixin Nie, Mohit Bansal, Robin Jia, Douwe Kiela, Adina Williams arXiv_CL arXiv_CL Transformer Bert Survey Inference PDF
2020-12-24 Detecting Hateful Memes Using a Multimodal Deep Ensemble Vlad Sandulescu arXiv_CV arXiv_CV Transformer Speech Pose PDF
2020-12-24 ProofWriter: Generating Implications, Proofs, and Abductive Statements over Natural Language Oyvind Tafjord, Bhavana Dalvi Mishra, Peter Clark arXiv_AI arXiv_AI Transformer PDF
2020-12-24 Disentangling semantics in language throughs VAEs and a certain architectural choice Ghazi Felhi, Joseph Le Roux, Djamé Seddah arXiv_CL arXiv_CL Transformer Unsupervised Action PDF
2020-12-23 The 2020 ESPnet update: new features, broadened applications, performance improvements, and future plans Shinji Watanabe, Florian Boyer, Xuankai Chang, Pengcheng Guo, Tomoki Hayashi, Yosuke Higuchi, Takaaki Hori, Wen-Chin Huang, Hirofumi Inaguma, Naoyuki Kamo, Shigeki Karita, Chenda Li, Jing Shi, Aswin Shanmugam Subramanian, Wangyou Zhang arXiv_SD arXiv_SD Transformer Enhancement Recognition Speech Denoising Speech_Recognition PDF
2020-12-23 Training data-efficient image transformers & distillation through attention Hugo Touvron, Matthieu Cord, Matthijs Douze, Francisco Massa, Alexandre Sablayrolles, Hervé Jégou arXiv_CV arXiv_CV Image_Caption Transformer Classification Attention Image_Classification PDF
2020-12-23 A Survey on Visual Transformer Kai Han, Yunhe Wang, Hanting Chen, Xinghao Chen, Jianyuan Guo, Zhenhua Liu, Yehui Tang, An Xiao, Chunjing Xu, Yixing Xu, Zhaohui Yang, Yiman Zhang, Dacheng Tao arXiv_AI arXiv_AI Transformer Review Pose Survey Classification Attention CNN Image_Classification PDF
2020-12-23 Future-Guided Incremental Transformer for Simultaneous Translation Shaolei Zhang, Yang Feng, Liangyou Li arXiv_AI arXiv_AI Transformer Embedding Knowledge Pose Face PDF
2020-12-22 Multi-Head Self-Attention with Role-Guided Masks Dongsheng Wang, Casper Hansen, Lucas Chaves Lima, Christian Hansen, Maria Maistro, Jakob Grue Simonsen, Christina Lioma arXiv_CL arXiv_CL Transformer Text_Classification RNN Pose Classification Attention PDF
2020-12-22 Domain Adaptation of NMT models for English-Hindi Machine Translation Task at AdapMT ICON 2020 Ramchandra Joshi, Rushabh Karnavat, Kaustubh Jirapure, Raviraj Joshi arXiv_CL arXiv_CL Transformer RNN NMT PDF
2020-12-22 Pre-Training a Language Model Without Human Language Cheng-Han Chiang, Hung-yi Lee arXiv_CL arXiv_CL Transformer Language_Model PDF
2020-12-22 g2tmn at Constraint@AAAI2021: Exploiting CT-BERT and Ensembling Learning for COVID-19 Fake News Detection Anna Glazkova, Maksim Glazkov, Timofey Trifonov arXiv_CL arXiv_CL Transformer Bert Pose Detection PDF
2020-12-22 Recognizing Emotion Cause in Conversations Soujanya Poria, Navonil Majumder, Devamanyu Hazarika, Deepanway Ghosal, Rishabh Bhardwaj, Samson Yu Bai Jian, Romila Ghosh, Niyati Chhaya, Alexander Gelbukh, Rada Mihalcea arXiv_CL arXiv_CL Transformer Emotion Action PDF
2020-12-22 Improved Biomedical Word Embeddings in the Transformer Era jiho Noh, Ramakanth Kavuluru arXiv_CL arXiv_CL Transformer Embedding Bert Pose Classification Relation Medical PDF
2020-12-21 Encoding Syntactic Knowledge in Transformer Encoder for Intent Detection and Slot Filling Jixuan Wang, Kai Wei, Martin Radfar, Weiwei Zhang, Clement Chung arXiv_AI arXiv_AI Transformer Knowledge Speech Pose Detection Attention Inference PDF
2020-12-21 Semantic Audio-Visual Navigation Changan Chen, Ziad Al-Halah, Kristen Grauman arXiv_CV arXiv_CV Transformer 3D Pose PDF
2020-12-21 3D Object Detection with Pointformer Xuran Pan, Zhuofan Xia, Shiji Song, Li Erran Li, Gao Huang arXiv_CV arXiv_CV Transformer Point_Cloud 3D Pose Action Detection Object_Detection PDF
2020-12-21 Leveraging ParsBERT and Pretrained mT5 for Persian Abstractive Text Summarization Mehrdad Farahani, Mohammad Gharachorloo, Mohammad Manthouri arXiv_CL arXiv_CL Transformer Bert Pose Summarization PDF
2020-12-20 KRISP: Integrating Implicit and Symbolic Knowledge for Open-Domain Knowledge-Based VQA Kenneth Marino, Xinlei Chen, Devi Parikh, Abhinav Gupta, Marcus Rohrbach arXiv_CV arXiv_CV Transformer Embedding Unsupervised Knowledge Knowledge_Graph VQA Prediction QA PDF
2020-12-20 Adaptive Bi-directional Attention: Exploring Multi-Granularity Representations for Machine Reading Comprehension Nuo Chen, Fenglin Liu, Chenyu You, Peilin Zhou, Yuexian Zou arXiv_AI arXiv_AI Transformer Pose Attention PDF
2020-12-20 A hybrid deep-learning approach for complex biochemical named entity recognition Jian Liu, Lei Gao, Sujie Guo, Rui Ding, Xin Huang, Long Ye, Qinghua Meng, Asef Nazari, Dhananjay Thiruvady arXiv_CL arXiv_CL Transformer Recognition Bert RNN Pose Action Deep_Learning Relation Relation_Extraction Attention Medical PDF
2020-12-18 Atlas-ISTN: Joint Segmentation, Registration and Atlas Construction with Image-and-Spatial Transformer Networks Matthew Sinclair, Andreas Schuh, Karl Hahn, Kersten Petersen, Ying Bai, James Batten, Michiel Schaap, Ben Glocker arXiv_CV arXiv_CV Transformer Segmentation Semantic_Segmentation 3D Pose Quantitative Deep_Learning Prediction PDF
2020-12-18 Understood in Translation, Transformers for Domain Understanding Dimitrios Christofidellis, Matteo Manica, Leonidas Georgopoulos, Hans Vandierendonck arXiv_CL arXiv_CL Transformer Unsupervised OCR RNN Knowledge Knowledge_Graph Pose Action PDF
2020-12-18 Exploring Fluent Query Reformulations with Text-to-Text Transformers and Reinforcement Learning Jerry Zikun Chen, Shi Yu, Haoran Wang arXiv_AI arXiv_AI Transformer Transfer_Learning Reinforcement_Learning Knowledge Quantitative Classification PDF
2020-12-17 Toward Transformer-Based Object Detection Josh Beal, Eric Kim, Eric Tzeng, Dong Huk Park, Andrew Zhai, Dmitry Kislyuk arXiv_AI arXiv_AI Transformer Segmentation Pose Classification Detection Object_Detection Attention CNN PDF
2020-12-17 Can Transformers Reason About Effects of Actions? Pratyay Banerjee, Chitta Baral, Man Luo, Arindam Mitra, Kuntal Pal, Tran C. Son, Neeraj Varshney arXiv_AI arXiv_AI Transformer Knowledge Action QA PDF
2020-12-17 Human Mesh Recovery from Multiple Shots Georgios Pavlakos, Jitendra Malik, Angjoo Kanazawa arXiv_CV arXiv_CV Transformer Reconstruction 3D Optimization Pose Action PDF
2020-12-17 Taming Transformers for High-Resolution Image Synthesis Patrick Esser, Robin Rombach, Björn Ommer arXiv_CV arXiv_CV Transformer Segmentation Action PDF
2020-12-17 Transformer Interpretability Beyond Attention Visualization Hila Chefer, Shir Gur, Lior Wolf arXiv_CV arXiv_CV Transformer Text_Classification Pose Classification Attention PDF
2020-12-17 SceneFormer: Indoor Scene Generation with Transformers Xinpeng Wang, Chandan Yeshwanth, Matthias Nießner arXiv_CV arXiv_CV Transformer 3D Scene_Generation Relation Attention PDF
2020-12-17 End-to-end Deep Object Tracking with Circular Loss Function for Rotated Bounding Box Vladislav Belyaev, Aleksandra Malysheva, Aleksei Shpilman arXiv_CV arXiv_CV Transformer Surveillance Tracking Object_Tracking Deep_Learning Attention Autonomous PDF
2020-12-17 End-to-End Human Pose and Mesh Reconstruction with Transformers Kevin Lin, Lijuan Wang, Zicheng Liu arXiv_CV arXiv_CV Transformer Reconstruction 3D Pose Action Relation Attention PDF
2020-12-17 PCT: Point Cloud Transformer Meng-Hao Guo, Jun-Xiong Cai, Zheng-Ning Liu, Tai-Jiang Mu, Ralph R. Martin, Shi-Min Hu arXiv_CV arXiv_CV Transformer Segmentation Embedding Point_Cloud Classification PDF
2020-12-17 Autoregressive Reasoning over Chains of Facts with Transformers Ruben Cartuyvels, Graham Spinks, Marie-Francine Moens arXiv_CL arXiv_CL Transformer Pose Inference PDF
2020-12-17 COVID-19 Emotion Monitoring as a Tool to Increase Preparedness for Disease Outbreaks in Developing Regions Santiago Cortes, Juan Muñoz, David Betancur, Mauricio Toro arXiv_CL arXiv_CL Transformer Bert Emotion PDF
2020-12-16 Point Transformer Hengshuang Zhao, Li Jiang, Jiaya Jia, Philip Torr, Vladlen Koltun arXiv_CV arXiv_CV Transformer Segmentation Point_Cloud 3D Classification Detection Object_Detection Attention Image_Classification PDF
2020-12-16 No Budget? Don't Flex! Cost Consideration when Planning to Adopt NLP for Your Business Made Nindyatama Nityasya, Haryo Akbarianto Wibowo, Radityo Eko Prasojo, Alham Fikri Aji arXiv_CL arXiv_CL Transformer Face PDF
2020-12-16 Focusing More on Conflicts with Mis-Predictions Helps Language Pre-Training Chen Xing, Wencong Xiao, Yong Li, Wei Lin arXiv_CL arXiv_CL Transformer Unsupervised Bert Pose Detection Object_Detection Attention Prediction PDF
2020-12-15 A Closer Look at the Robustness of Vision-and-Language Pre-trained Models Linjie Li, Zhe Gan, Jingjing Liu arXiv_CV arXiv_CV Transformer Embedding Bert Adversarial Pose PDF
2020-12-15 Pre-Training Transformers as Energy-Based Cloze Models Kevin Clark, Minh-Thang Luong, Quoc V. Le, Christopher D. Manning arXiv_CL arXiv_CL Transformer Recognition Bert Represenation_Learning Speech Pose Speech_Recognition Language_Model PDF
2020-12-15 The Monte Carlo Transformer: a stochastic self-attention model for sequence prediction Alice Martin (CMAP, IP Paris, CITI, TIPIC-SAMOVAR), Charles Ollion (CMAP), Florian Strub, Sylvain Le Corff (IP Paris, CITI, TIPIC-SAMOVAR), Olivier Pietquin arXiv_AI arXiv_AI Transformer Pose Attention Prediction PDF
2020-12-15 Enhance Multimodal Transformer With External Label And In-Domain Pretrain: Hateful Meme Challenge Winning Solution Ron Zhu arXiv_CV arXiv_CV Transformer Knowledge Detection PDF
2020-12-15 *-CFQ: Analyzing the Scalability of Machine Learning on a Compositional Task Dmitry Tsarkov, Tibor Tihon, Nathan Scales, Nikola Momchev, Danila Sinopalnikov, Nathanael Schärli arXiv_CL arXiv_CL Transformer PDF
2020-12-15 MeisterMorxrc at SemEval-2020 Task 9: Fine-Tune Bert and Multitask Learning for Sentiment Analysis of Code-Mixed Tweets Qi Wu, Peng Wang, Chenghao Huang arXiv_CL arXiv_CL Transformer Bert Text_Classification Classification Sentiment PDF
2020-12-15 A Response Retrieval Approach for Dialogue Using a Multi-Attentive Transformer Matteo A. Senese, Alberto Benincasa, Barbara Caputo, Giuseppe Rizzo arXiv_AI arXiv_AI Transformer GAN PDF
2020-12-15 Writing Polishment with Simile: Task, Dataset and A Neural Approach Jiayi Zhang, Zhi Cui, Xiaoqiang Xia, Yalong Guo, Yanran Li, Chen Wei, Jianwei Cui arXiv_CL arXiv_CL Transformer Speech Pose PDF
2020-12-15 Traditional IR rivals neural models on the MS~MARCO Document Ranking Leaderboard Leonid Boytsov arXiv_CL arXiv_CL Transformer Bert PDF
2020-12-14 A review of on-device fully neural end-to-end automatic speech recognition algorithms Chanwoo Kim, Dhananjaya Gowda, Dongsoo Lee, Jiyeon Kim, Ankur Kumar, Sungsoo Kim, Abhinav Garg, Changwoo Han arXiv_CL arXiv_CL Transformer Recognition Optimization RNN Review Speech Pose Classification Attention Speech_Recognition Language_Model PDF
2020-12-14 Vartani Spellcheck -- Automatic Context-Sensitive Spelling Correction of OCR-generated Hindi Text Using BERT and Levenshtein Distance Aditya Pal, Abhijit Mustafi arXiv_AI arXiv_AI Transformer Recognition OCR Bert Optical_Character Pose Detection Language_Model PDF
2020-12-14 Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecasting Haoyi Zhou (1), Shanghang Zhang (2), Jieqi Peng (1), Shuai Zhang (1), Jianxin Li (1), Hui Xiong (3), Wancai Zhang (4) ((1) Beihang University, (2) UC Berkeley, (3) Rutgers University, (4) Beijing Guowang Fuda Science & Technology Development Company) arXiv_AI arXiv_AI Transformer Sparse Attention Inference Prediction PDF
2020-12-14 Reasoning in Dialog: Improving Response Generation by Context Reading Comprehension Xiuying Chen, Zhi Cui, Jiayi Zhang, Chen Wei, Jianwei Cui, Bin Wang, Dongyan Zhao, Rui Yan arXiv_CL arXiv_CL Transformer 3D Pose PDF
2020-12-14 Contrastive Learning with Adversarial Perturbations for Conditional Text Generation Seanie Lee, Dong Bok Lee, Sung Ju Hwang arXiv_CL arXiv_CL Transformer Adversarial Pose Contrastive_Learning Summarization Text_Generation PDF
2020-12-13 Improving Image Captioning by Leveraging Intra- and Inter-layer Global Representation in Transformer Network Jiayi Ji, Yunpeng Luo, Xiaoshuai Sun, Fuhai Chen, Gen Luo, Yongjian Wu, Yue Gao, Rongrong Ji arXiv_CV arXiv_CV Image_Caption Transformer Embedding Pose Action Attention Caption PDF
2020-12-13 KVL-BERT: Knowledge Enhanced Visual-and-Linguistic BERT for Visual Commonsense Reasoning Dandan Song, Siyi Ma, Zhanchen Sun, Sicheng Yang, Lejian Liao arXiv_AI arXiv_AI Transformer Embedding Bert Knowledge Pose Attention PDF
2020-12-13 Radial Deformation Emplacement in Power Transformers Using Long Short-Term Memory Networks Arash Moradzadeh, Kazem Pourhossein, Behnam Mohammadi-Ivatloo, Tohid Khalili, Ali Bidram arXiv_CV arXiv_CV Transformer RNN Memory_Networks Pose Action Deep_Learning PDF
2020-12-13 MiniVLM: A Smaller and Faster Vision-Language Model Jianfeng Wang, Xiaowei Hu, Pengchuan Zhang, Xiujun Li, Lijuan Wang, Lei Zhang, Jianfeng Gao, Zicheng Liu arXiv_CV arXiv_CV Transformer Bert Pose Action Caption Inference Language_Model PDF
2020-12-12 DETR for Pedestrian Detection Matthieu Lin, Chuming Li, Xingyuan Bu, Ming Sun, Chen Lin, Junjie Yan, Wanli Ouyang, Zhidong Deng arXiv_CV arXiv_CV Transformer Pose Action Detection Object_Detection Prediction PDF
2020-12-12 Yelp Review Rating Prediction: Machine Learning and Deep Learning Models Zefang Liu arXiv_CL arXiv_CL Transformer Bert Review Classification Deep_Learning Prediction PDF
2020-12-11 TabTransformer: Tabular Data Modeling Using Contextual Embeddings Xin Huang, Ashish Khetan, Milan Cvitkovic, Zohar Karnin arXiv_AI arXiv_AI Transformer Embedding Unsupervised Pose Deep_Learning Attention Prediction PDF
2020-12-11 DeCoAR 2.0: Deep Contextualized Acoustic Representations with Vector Quantization Shaoshi Ling, Yuzong Liu arXiv_CL arXiv_CL Transformer Reconstruction Quantization Recognition Sparse Represenation_Learning RNN Speech Self-Supervised Pose Speech_Recognition PDF
2020-12-11 Orthogonal Language and Task Adapters in Zero-Shot Cross-Lingual Transfer Marko Vidoni, Ivan Vulić, Goran Glavaš arXiv_CL arXiv_CL Transformer Zero-Shot Knowledge Pose PDF
2020-12-11 Spatial Temporal Transformer Network for Skeleton-based Action Recognition Chiara Plizzari, Marco Cannici, Matteo Matteucci arXiv_CV arXiv_CV Transformer Recognition 3D Pose Action_Recognition Action Relation Attention PDF
2020-12-10 Towards Neural Programming Interfaces Zachary C. Brown, Nathaniel Robinson, David Wingate, Nancy Fulda arXiv_AI arXiv_AI Transformer Speech Pose Face GAN Language_Model PDF
2020-12-10 Leveraging Transfer Learning for Reliable Intelligence Identification on Vietnamese SNSs Trung-Hieu Tran, Long Phan, Truong-Son Nguyen arXiv_AI arXiv_AI Transformer Transfer_Learning Pose PDF
2020-12-10 Look Before you Speak: Visually Contextualized Utterances Paul Hongsuck Seo, Arsha Nagrani, Cordelia Schmid arXiv_CV arXiv_CV Transformer Speech Attention Activity Prediction QA PDF
2020-12-10 As good as new. How to successfully recycle English GPT-2 to make models for other languages Wietse de Vries, Malvina Nissim arXiv_CL arXiv_CL Transformer Embedding Pose Language_Model PDF
2020-12-10 Unified Streaming and Non-streaming Two-pass End-to-end Model for Speech Recognition Binbin Zhang, Di Wu, Zhuoyuan Yao, Xiong Wang, Fan Yu, Chao Yang, Liyong Guo, Yaguang Hu, Lei Xie, Xin Lei arXiv_SD arXiv_SD Transformer Recognition Speech Pose Attention Speech_Recognition Inference PDF
2020-12-10 Rewriter-Evaluator Framework for Neural Machine Translation Yangming Li, Kaisheng Yao arXiv_CL arXiv_CL Transformer Gradient_Descent Pose NMT PDF
2020-12-09 Topological Planning with Transformers for Vision-and-Language Navigation Kevin Chen, Junshen K. Chen, Jo Chuang, Marynel Vázquez, Silvio Savarese arXiv_AI arXiv_AI Transformer Tracking Pose Action Attention PDF
2020-12-09 Simple is not Easy: A Simple Strong Baseline for TextVQA and TextCaps Qi Zhu, Chenyu Gao, Peng Wang, Qi Wu arXiv_CV arXiv_CV Image_Caption Transformer Recognition OCR Optical_Character VQA Attention Caption QA PDF
2020-12-09 Mapping the Space of Chemical Reactions Using Attention-Based Neural Networks Philippe Schwaller, Daniel Probst, Alain C. Vaucher, Vishnu H. Nair, David Kreutter, Teodoro Laino, Jean-Louis Reymond arXiv_CL arXiv_CL Transformer Action Classification Attention GAN PDF
2020-12-09 Proactive Interaction Framework for Intelligent Social Receptionist Robots Yang Xue, Fan Wang, Hao Tian, Min Zhao, Jiangyong Li, Haiqing Pan, Yueqiang Dong arXiv_RO arXiv_RO Transformer Pose Action PDF
2020-12-08 River: machine learning for streaming data in Python Jacob Montiel, Max Halford, Saulo Martiello Mastelini, Geoffrey Bolmier, Raphael Sourty, Robin Vaysse, Adil Zouitine, Heitor Murilo Gomes, Jesse Read, Talel Abdessalem, Albert Bifet arXiv_AI arXiv_AI Transformer PDF
2020-12-08 Transformer Guided Geometry Model for Flow-Based Unsupervised Visual Odometry Xiangyu Li, Yonghong Hou, Pichao Wang, Zhimin Gao, Mingliang Xu, Wanqing Li arXiv_CV arXiv_CV Transformer Unsupervised RNN Pose Relation PDF
2020-12-08 Extractive Opinion Summarization in Quantized Transformer Spaces Stefanos Angelidis, Reinald Kim Amplayo, Yoshihiko Suhara, Xiaolan Wang, Mirella Lapata arXiv_CL arXiv_CL Transformer Unsupervised Review Pose Action Summarization PDF
2020-12-08 Parameter Efficient Multimodal Transformers for Video Representation Learning Sangho Lee, Youngjae Yu, Gunhee Kim, Thomas Breuel, Jan Kautz, Yale Song arXiv_CV arXiv_CV Transformer Embedding Represenation_Learning Pose Classification Language_Model PDF
2020-12-07 Detecting Insincere Questions from Text: A Transfer Learning Approach Ashwin Rachha, Gaurav Vanmane arXiv_AI arXiv_AI Transformer Transfer_Learning Bert Knowledge Action Classification PDF
2020-12-07 Confidence-aware Non-repetitive Multimodal Transformers for TextCaps Zhaokai Wang, Renda Bao, Qi Wu, Si Liu arXiv_CV arXiv_CV Image_Caption Transformer Embedding Recognition OCR Optical_Character Pose NMT Caption PDF
2020-12-07 Topical Change Detection in Documents via Embeddings of Long Sequences Dennis Aumiller, Satya Almasian, Sebastian Lackner, Michael Gertz arXiv_CL arXiv_CL Transformer Segmentation Embedding Deep_Learning Detection Summarization Language_Model Prediction PDF
2020-12-07 Deep Policy Networks for NPC Behaviors that Adapt to Changing Design Parameters in Roguelike Games Alessandro Sestini, Alexander Kuhnle, Andrew D. Bagdanov arXiv_AI arXiv_AI Transformer Embedding Reinforcement_Learning Pose Face Relation Attention PDF
2020-12-07 Improvements and Extensions on Metaphor Detection Weicheng Ma, Ruibo Liu, Lili Wang, Soroush Vosoughi arXiv_CL arXiv_CL Transformer Classification Detection PDF
2020-12-07 Document Graph for Neural Machine Translation Mingzhou Xu, Liangyou Li, Derek. F. Wai, Qun Liu, Lidia S. Chao arXiv_CL arXiv_CL Transformer NMT Relation CNN PDF
2020-12-07 An Empirical Survey of Unsupervised Text Representation Methods on Twitter Data Lili Wang, Chongyang Gao, Jason Wei, Weicheng Ma, Ruibo Liu, Soroush Vosoughi arXiv_CL arXiv_CL Transformer Unsupervised Bert Survey Language_Model PDF
2020-12-05 Pre-training Protein Language Models with Label-Agnostic Binding Pairs Enhances Performance in Downstream Tasks Modestas Filipavicius, Matteo Manica, Joris Cadow, Maria Rodriguez Martinez arXiv_CL arXiv_CL Transformer Bert Self-Supervised Classification Attention Language_Model Prediction PDF
2020-12-05 Urban Crowdsensing using Social Media: An Empirical Study on Transformer and Recurrent Neural Networks Jerome Heng, Junhua Liu, Kwan Hui Lim arXiv_AI arXiv_AI Transformer RNN Detection Prediction PDF
2020-12-05 Enhanced Offensive Language Detection Through Data Augmentation Ruibo Liu, Guangxuan Xu, Soroush Vosoughi arXiv_CL arXiv_CL Transformer Bert RNN Classification Detection Attention PDF
2020-12-05 Data-Efficient Methods for Dialogue Systems Igor Shalyminov arXiv_CL arXiv_CL Transformer RNN Knowledge Pose Face Deep_Learning Detection Matching PDF
2020-12-04 Learning Equivariant Representations Carlos Esteves arXiv_CV arXiv_CV Transformer Segmentation Embedding Recognition 3D Pose_Estimation Pose Classification Deep_Learning CNN Image_Classification PDF
2020-12-04 Fine-tuning BERT for Low-Resource Natural Language Understanding via Active Learning Daniel Grießhaber, Johannes Maucher, Ngoc Thang Vu arXiv_CL arXiv_CL Transformer Bert Knowledge Language_Model PDF
2020-12-04 Understanding Guided Image Captioning Performance across Domains Edwin G. Ng, Bo Pang, Piyush Sharma, Radu Soricut arXiv_CV arXiv_CV Image_Caption Transformer VQA Caption QA PDF
2020-12-03 Do We Really Need That Many Parameters In Transformer For Extractive Summarization? Discourse Can Help ! Wen Xiao, Patrick Huber, Giuseppe Carenini arXiv_CL arXiv_CL Transformer Pose Attention Summarization PDF
2020-12-03 BERT-hLSTMs: BERT and Hierarchical LSTMs for Visual Storytelling Jing Su, Qingyun Dai, Frank Guerin, Mian Zhou arXiv_CV arXiv_CV Transformer Embedding Bert RNN Pose PDF
2020-12-03 GottBERT: a pure German Language Model Raphael Scheible, Fabian Thomczyk, Patric Tippmann, Victor Jaravine, Martin Boeker arXiv_CL arXiv_CL Transformer Recognition Bert Text_Classification Optimization Classification Language_Model PDF
2020-12-03 Saying No is An Art: Contextualized Fallback Responses for Unanswerable Dialogue Queries Ashish Shrivastava, Kaustubh Dhole, Abhinav Bhatt, Sharvani Raghunath arXiv_AI arXiv_AI Transformer Action PDF
2020-12-03 DialogBERT: Discourse-Aware Response Generation via Learning to Recover and Rank Utterances Xiaodong Gu, Kang Min Yoo, Jung-Woo Ha arXiv_AI arXiv_AI Transformer Bert Pose Quantitative Attention Language_Model PDF
2020-12-03 Pedestrian Trajectory Prediction using Context-Augmented Transformer Networks Khaled Saleh arXiv_CV arXiv_CV Transformer RNN Action Autonomous Prediction PDF
2020-12-03 Adapt-and-Adjust: Overcoming the Long-Tail Problem of Multilingual Speech Recognition Genta Indra Winata, Guangsen Wang, Caiming Xiong, Steven Hoi arXiv_AI arXiv_AI Transformer Recognition Bert Speech Pose Speech_Recognition Inference Language_Model PDF
2020-12-02 Contour Transformer Network for One-shot Segmentation of Anatomical Structures Yuhang Lu, Kang Zheng, Weijian Li, Yirui Wang, Adam P. Harrison, Chihung Lin, Song Wang, Jing Xiao, Le Lu, Chang-Fu Kuo, Shun Miao arXiv_CV arXiv_CV Transformer Segmentation Deep_Learning Contour Medical CNN PDF
2020-12-02 ArCorona: Analyzing Arabic Tweets in the Early Days of Coronavirus Pandemic Hamdy Mubarak, Sabit Hassan arXiv_CL arXiv_CL Transformer Classification PDF
2020-12-02 Cross-modal Retrieval and Synthesis : Closing the modality gap in shared subspace Ricardo Guerrero, Hai Xuan Pham, Vladimir Pavlovic arXiv_CV arXiv_CV Transformer Embedding Pose PDF
2020-12-02 Interactive Teaching for Conversational AI Qing Ping, Feiyang Niu, Govind Thattai, Joel Chengottusseriyil, Qiaozi Gao, Aishwarya Reganti, Prashanth Rajagopal, Gokhan Tur, Dilek Hakkani-Tur, Prem Nataraja arXiv_CL arXiv_CL Transformer Pose Action PDF
2020-12-01 StructFormer: Joint Unsupervised Induction of Dependency and Constituency Structure from Masked Language Modeling Yikang Shen, Yi Tay, Che Zheng, Dara Bahri, Donald Metzler, Aaron Courville arXiv_AI arXiv_AI Transformer Unsupervised Pose Relation Attention Language_Model PDF
2020-12-01 Pose-based Sign Language Recognition using GCN and BERT Anirudh Tunga, Sai Vidyaranya Nuthalapati, Juan Wachs arXiv_CV arXiv_CV Transformer Recognition Bert Pose Action CNN Prediction PDF
2020-12-01 MaX-DeepLab: End-to-End Panoptic Segmentation with Mask Transformers Huiyu Wang, Yukun Zhu, Hartwig Adam, Alan Yuille, Liang-Chieh Chen arXiv_CV arXiv_CV Transformer Segmentation Detection Matching PDF
2020-12-01 Denoising Pre-Training and Data Augmentation Strategies for Enhanced RDF Verbalization with Transformers Sebastien Montella, Betty Fabre, Tanguy Urvoy, Johannes Heinecke, Lina Rojas-Barahona arXiv_CL arXiv_CL Transformer Knowledge Pose Denoising Text_Generation PDF
2020-12-01 Just Ask: Learning to Answer Questions from Millions of Narrated Videos Antoine Yang, Antoine Miech, Josef Sivic, Ivan Laptev, Cordelia Schmid arXiv_CV arXiv_CV Transformer Embedding Zero-Shot Pose VQA Activity QA PDF
2020-12-01 Pre-Trained Image Processing Transformer Hanting Chen, Yunhe Wang, Tianyu Guo, Chang Xu, Yiping Deng, Zhenhua Liu, Siwei Ma, Chunjing Xu, Chao Xu, Wen Gao arXiv_CV arXiv_CV Transformer Super_Resolution Bert Contrastive_Learning Deep_Learning Denoising PDF
2020-12-01 Modifying Memories in Transformer Models Chen Zhu, Ankit Singh Rawat, Manzil Zaheer, Srinadh Bhojanapalli, Daliang Li, Felix Yu, Sanjiv Kumar arXiv_CL arXiv_CL Transformer Knowledge Pose Language_Model PDF
2020-11-30 Detecting expressions with multimodal transformers Srinivas Parthasarathy, Shiva Sundaram arXiv_SD arXiv_SD Transformer Tracking Pose Detection Activity PDF
2020-11-30 Transformer-Transducers for Code-Switched Speech Recognition Siddharth Dalmia, Yuzong Liu, Srikanth Ronanki, Katrin Kirchhoff arXiv_CL arXiv_CL Transformer Recognition Speech Pose Speech_Recognition PDF
2020-11-30 Machine Translation of Novels in the Age of Transformer Antonio Toral, Antoni Oliver, Pau Ribas Ballestín arXiv_CL arXiv_CL Transformer NMT PDF
2020-11-30 Flood Detection via Twitter Streams using Textual and Visual Features Firoj Alam, Zohaib Hassan, Kashif Ahmad, Asma Gul, Michael Reiglar, Nicola Conci, Ala AL-Fuqaha arXiv_CV arXiv_CV Transformer Bert Pose Detection PDF
2020-11-30 Dynamic Curriculum Learning for Low-Resource Neural Machine Translation Chen Xu, Bojie Hu, Yufan Jiang, Kai Feng, Zeyang Wang, Shen Huang, Qi Ju, Tong Xiao, Jingbo Zhu arXiv_CL arXiv_CL Transformer Pose NMT PDF
2020-11-30 End-to-End Video Instance Segmentation with Transformers Yuqing Wang, Zhaoliang Xu, Xinlong Wang, Chunhua Shen, Baoshan Cheng, Hao Shen, Huaxia Xia arXiv_CV arXiv_CV Transformer Segmentation Tracking Video_Caption Pose Prediction Matching PDF
2020-11-28 EdgeBERT: Optimizing On-Chip Inference for Multi-Task NLP Thierry Tambe, Coleman Hooper, Lillian Pentecost, En-Yu Yang, Marco Donato, Victor Sanh, Alexander M. Rush, David Brooks, Gu-Yeon Wei arXiv_CL arXiv_CL Transformer Embedding Quantization Bert Attention Inference Language_Model PDF
2020-11-28 AdaBins: Depth Estimation using Adaptive Bins Shariq Farooq Bhat, Ibraheem Alhashim, Peter Wonka arXiv_CV arXiv_CV Transformer Pose CNN PDF
2020-11-28 Disentangling Homophemes in Lip Reading using Perplexity Analysis Souheil Fenghour, Daqing Chen, Kun Guo, Perry Xiao arXiv_CL arXiv_CL Transformer Text_Classification Speech Pose Classification Language_Model Prediction PDF
2020-11-28 Transformer Query-Target Knowledge Discovery : Drug Discovery from CORD-19 Leo K. Tam, Xiaosong Wang, Daguang Xu arXiv_CL arXiv_CL Transformer Bert Knowledge Language_Model Prediction PDF
2020-11-28 Understanding How BERT Learns to Identify Edits Samuel Stevens, Yu Su arXiv_CL arXiv_CL Transformer Bert Pose Classification Attention Language_Model PDF
2020-11-27 General Multi-label Image Classification with Transformers Jack Lanchantin, Tianlu Wang, Vicente Ordonez, Yanjun Qi arXiv_AI arXiv_AI Transformer Pose Classification CNN Image_Classification Inference PDF
2020-11-27 Relation Clustering in Narrative Knowledge Graphs Simone Mellace, K Vani, Alessandro Antonucci arXiv_AI arXiv_AI Transformer Unsupervised Bert Knowledge Knowledge_Graph Action Relation PDF
2020-11-27 Temporal-Channel Transformer for 3D Lidar-Based Video Object Detection in Autonomous Driving Zhenxun Yuan, Xiao Song, Lei Bai, Wengang Zhou, Zhe Wang, Wanli Ouyang arXiv_CV arXiv_CV Transformer 3D Pose Detection Relation Object_Detection Autonomous PDF
2020-11-27 PCLs: Geometry-aware Neural Reconstruction of 3D Pose with Perspective Crop Layers Frank Yu, Mathieu Salzmann, Pascal Fua, Helge Rhodin arXiv_CV arXiv_CV Transformer Reconstruction 3D Pose PDF
2020-11-27 Robust Attacks on Deep Learning Face Recognition in the Physical World Meng Shen, Hao Yu, Liehuang Zhu, Ke Xu, Qi Li, Xiaojiang Du arXiv_CV arXiv_CV Transformer Recognition Adversarial Pose Face Deep_Learning Face_Recognition PDF
2020-11-26 Generative Layout Modeling using Constraint Graphs Wamiq Para, Paul Guerrero, Tom Kelly, Leonidas Guibas, Peter Wonka arXiv_CV arXiv_CV Transformer Optimization Pose PDF
2020-11-26 DyCo3D: Robust Instance Segmentation of 3D Point Clouds through Dynamic Convolution Tong He, Chunhua Shen, Anton van den Hengel arXiv_CV arXiv_CV Transformer Segmentation Point_Cloud 3D Sparse Pose Action CNN Inference PDF
2020-11-26 Two Stage Transformer Model for COVID-19 Fake News Detection and Fact Checking Rutvik Vijjali, Prathyush Potluri, Siddharth Kumar, Sundeep Teki arXiv_CL arXiv_CL Transformer Bert Knowledge Detection PDF
2020-11-26 Molecular representation learning with language models and domain-relevant auxiliary tasks Benedek Fabian, Thomas Edlich, Héléna Gaspar, Marwin Segler, Joshua Meyers, Marco Fiscato, Mohamed Ahmed arXiv_AI arXiv_AI Transformer Bert Represenation_Learning Self-Supervised Language_Model PDF
2020-11-26 Transformer-Based Models for Automatic Identification of Argument Relations: A Cross-Domain Evaluation Ramon Ruiz-Dolz, Stella Heras, Jose Alemany, Ana García-Fornes arXiv_CL arXiv_CL Transformer Bert Relation PDF
2020-11-26 Multi-view Depth Estimation using Epipolar Spatio-Temporal Network Xiaoxiao Long, Lingjie Liu, Wei Li, Christian Theobalt, Wenping Wang arXiv_CV arXiv_CV Transformer Reconstruction 3D Regularization Relation Matching PDF
2020-11-26 A Recurrent Vision-and-Language BERT for Navigation Yicong Hong, Qi Wu, Yuankai Qi, Cristian Rodriguez-Opazo, Stephen Gould arXiv_CV arXiv_CV Transformer Bert Pose Attention PDF
2020-11-25 Neural Representations for Modeling Variation in English Speech Martijn Bartelds, Wietse de Vries, Faraz Sanal, Caitlin Richter, Mark Liberman, Martijn Wieling arXiv_CL arXiv_CL Transformer Embedding Speech Self-Supervised Action PDF
2020-11-25 Combining Semantic Guidance and Deep Reinforcement Learning For Generating Human Level Paintings Jaskirat Singh, Liang Zheng arXiv_CV arXiv_CV Transformer Reinforcement_Learning Salient Pose PDF
2020-11-24 Enhancing deep neural networks with morphological information Matej Klemen, Luka Krsnik, Marko Robnik-Šikonja arXiv_CL arXiv_CL Transformer Recognition Bert RNN Speech Deep_Learning Language_Model PDF
2020-11-24 SpinNet: Learning a General Surface Descriptor for 3D Point Cloud Registration Sheng Ao, Qingyong Hu, Bo Yang, Andrew Markham, Yulan Guo arXiv_AI arXiv_AI Transformer Reconstruction Point_Cloud 3D Optimization Face CNN Matching PDF
2020-11-24 Tackling Domain-Specific Winograd Schemas with Knowledge-Based Reasoning and Machine Learning Suk Joon Hong, Brandon Bennett arXiv_AI arXiv_AI Transformer Bert Knowledge Pose PDF
2020-11-23 Large Scale Multimodal Classification Using an Ensemble of Transformer Models and Co-Attention Varnith Chordia, Vijay Kumar BG arXiv_AI arXiv_AI Transformer Embedding Classification Relation VQA Attention QA Recommendation PDF
2020-11-21 Rethinking Transformer-based Set Prediction for Object Detection Zhiqing Sun, Shengcao Cao, Yiming Yang, Kris Kitani arXiv_CV arXiv_CV Transformer Optimization Pose Detection Object_Detection Attention Prediction PDF
2020-11-20 Self-Supervised learning with cross-modal transformers for emotion recognition Aparna Khare, Srinivas Parthasarathy, Shiva Sundaram arXiv_CL arXiv_CL Transformer Embedding Recognition Bert Speech Self-Supervised Emotion Language_Model PDF
2020-11-20 Fine-Tuning BERT for Sentiment Analysis of Vietnamese Reviews Quoc Thai Nguyen, Thoai Linh Nguyen, Ngoc Hoang Luong, Quoc Hung Ngo arXiv_CL arXiv_CL Transformer Bert Review Pose Classification Deep_Learning Sentiment PDF
2020-11-20 SophiaPop: Experiments in Human-AI Collaboration on Popular Music David Hanson, Frankie Storm, Wenwei Huang, Vytas Krisciunas, Tiger Darrow, Audrey Brown, Mengna Lei, Matthew Aylett, Adam Pickrell, Sophia the Robot arXiv_AI arXiv_AI Transformer Pose Relation PDF
2020-11-20 ConvTransformer: A Convolutional Transformer Network for Video Frame Synthesis Zhouyong Liu, Shun Luo, Wubin Li, Jingben Lu, Yufan Wu, Chunguo Li, Luxi Yang arXiv_CV arXiv_CV Transformer RNN Knowledge Pose Attention CNN PDF
2020-11-19 Sentiment Classification in Bangla Textual Content: A Comparative Study Md. Arid Hasan, Jannatul Tajrin, Shammur Absar Chowdhury, Firoj Alam arXiv_CL arXiv_CL Transformer Sentiment_Classification Classification Deep_Learning Sentiment PDF
2020-11-19 Persuasive Dialogue Understanding: the Baselines and Negative Results Hui Chen, Deepanway Ghosal, Navonil Majumder, Amir Hussain, Soujanya Poria arXiv_CL arXiv_CL Transformer Recognition Optimization RNN Speech Action Relation Attention CNN PDF
2020-11-19 Everybody Sign Now: Translating Spoken Language to Photo Realistic Sign Language Video Ben Saunders, Necati Cihan Camgoz, Richard Bowden arXiv_CV arXiv_CV Transformer Pose Quantitative GAN Inference PDF
2020-11-19 Attention-Based Transformers for Instance Segmentation of Cells in Microstructures Tim Prangemeier, Christoph Reich, Heinz Koeppl arXiv_CV arXiv_CV Transformer Segmentation Semantic_Segmentation Pose Quantitative Deep_Learning Detection Attention Medical PDF
2020-11-19 Universal MelGAN: A Robust Neural Vocoder for High-Fidelity Waveform Generation in Multiple Domains Won Jang, Dan Lim, Jaesam Yoon arXiv_CL arXiv_CL Transformer Speech Pose Emotion GAN Inference PDF
2020-11-18 Palomino-Ochoa at SemEval-2020 Task 9: Robust System based on Transformer for Code-Mixed Sentiment Classification Daniel Palomino, Jose Ochoa-Luna arXiv_CL arXiv_CL Transformer Transfer_Learning Bert Sentiment_Classification Classification Detection Sentiment Language_Model PDF
2020-11-18 EWareNet: Emotion Aware Human Intent Prediction and Adaptive Spatial Profile Fusion for Social Robot Navigation Venkatraman Narayanan, Bala Murali Manoghar, Rama Prashanth RV, Aniket Bera arXiv_RO arXiv_RO Transformer Reinforcement_Learning 3D Pose Emotion Prediction PDF
2020-11-18 End-to-End Object Detection with Adaptive Clustering Transformer Minghang Zheng, Peng Gao, Xiaogang Wang, Hongsheng Li, Hao Dong arXiv_CV arXiv_CV Transformer Pose Action Detection Object_Detection Attention Inference PDF
2020-11-18 The Ubiqus English-Inuktitut System for WMT20 François Hernandez, Vincent Nguyen arXiv_CL arXiv_CL Transformer PDF
2020-11-18 Do Fine-tuned Commonsense Language Models Really Generalize? Mayank Kejriwal, Ke Shen arXiv_AI arXiv_AI Transformer Bert Language_Model PDF
2020-11-18 UP-DETR: Unsupervised Pre-training for Object Detection with Transformers Zhigang Dai, Bolun Cai, Yugeng Lin, Junying Chen arXiv_CV arXiv_CV Transformer Reconstruction Unsupervised Pose Classification Detection Object_Detection Attention PDF
2020-11-18 Sequence-Level Mixed Sample Data Augmentation Demi Guo, Yoon Kim, Alexander M. Rush arXiv_CL arXiv_CL Transformer Pose PDF
2020-11-17 s-Transformer: Segment-Transformer for Robust Neural Speech Synthesis Xi Wang, Huaiping Ming, Lei He, Frank K. Soong arXiv_SD arXiv_SD Transformer Speech Pose Attention PDF
2020-11-16 It's a Thin Line Between Love and Hate: Using the Echo in Modeling Dynamics of Racist Online Communities Eyal Arviv, Simo Hanouna, Oren Tsur arXiv_CL arXiv_CL Transformer Reconstruction Tracking Bert RNN Speech Pose Detection PDF
2020-11-16 End-to-end spoken language understanding using transformer networks and self-supervised pre-trained features Edmilson Morais, Hong-Kwang J. Kuo, Samuel Thomas, Zoltan Tuske, Brian Kingsbury arXiv_CL arXiv_CL Transformer Self-Supervised Action PDF
2020-11-16 On the Effectiveness of Vision Transformers for Zero-shot Face Anti-Spoofing Anjith George, Sebastien Marcel arXiv_CV arXiv_CV Transformer Transfer_Learning Recognition Zero-Shot Pose Face Face_Recognition PDF
2020-11-14 Conditioned Natural Language Generation using only Unconditioned Language Model: An Exploration Fan-Keng Sun, Cheng-I Lai arXiv_CL arXiv_CL Transformer Text_Generation Language_Model PDF
2020-11-14 DebateSum: A large-scale argument mining and summarization dataset Allen Roush, Arvind Balaji arXiv_CL arXiv_CL Transformer Speech Summarization PDF
2020-11-14 ActBERT: Learning Global-Local Video-Text Representations Linchao Zhu, Yi Yang arXiv_CV arXiv_CV Transformer Segmentation Video_Caption Bert Represenation_Learning Self-Supervised Action Relation Caption PDF
2020-11-14 Utilizing Bidirectional Encoder Representations from Transformers for Answer Selection Md Tahmid Rahman Laskar, Enamul Hoque, Jimmy Xiangji Huang arXiv_CL arXiv_CL Transformer Bert Language_Model QA PDF
2020-11-13 FLERT: Document-Level Features for Named Entity Recognition Stefan Schweter, Alan Akbik arXiv_CL arXiv_CL Transformer Recognition Bert RNN Prediction Recommendation PDF
2020-11-13 Transformer-Encoder Detector Module: Using Context to Improve Robustness to Adversarial Attacks on Object Detection Faisal Alamri, Sinan Kalkan, Nicolas Pugeault arXiv_CV arXiv_CV Transformer Recognition Adversarial Pose Detection Object_Detection PDF
2020-11-13 EDITOR: an Edit-Based Transformer with Repositioning for Neural Machine Translation with Soft Lexical Constraints Weijia Xu, Marine Carpuat arXiv_CL arXiv_CL Transformer PDF
2020-11-12 Augmenting BERT Carefully with Underrepresented Linguistic Features Aparna Balagopalan, Jekaterina Novikova arXiv_CL arXiv_CL Transformer Bert Speech Classification Detection PDF
2020-11-11 Hurricane Forecasting: A Novel Multimodal Machine Learning Framework Léonard Boussioux, Cynthia Zeng, Théo Guénais, Dimitris Bertsimas arXiv_AI arXiv_AI Transformer Pose PDF
2020-11-11 Transformers for One-Shot Visual Imitation Sudeep Dasari, Abhinav Gupta arXiv_CV arXiv_CV Transformer Knowledge Self-Supervised Action Attention PDF
2020-11-11 TRAILER: Transformer-based Time-wise Long Term Relation Modeling for Citywide Traffic Flow Prediction Hao Xue, Flora D Salim arXiv_AI arXiv_AI Transformer Pose Deep_Learning Relation Prediction PDF
2020-11-10 E.T.: Entity-Transformers. Coreference augmented Neural Language Model for richer mention representations via Entity-Transformer blocks Nikolaos Stylianou, Ioannis Vlahavas arXiv_CL arXiv_CL Transformer Recognition Language_Model PDF
2020-11-10 Human-centric Spatio-Temporal Video Grounding With Visual Transformers Zongheng Tang, Yue Liao, Si Liu, Guanbin Li, Xiaojie Jin, Hongxu Jiang, Qian Yu, Dong Xu arXiv_AI arXiv_AI Transformer Surveillance Pose Matching PDF
2020-11-10 Translating Similar Languages: Role of Mutual Intelligibility in Multilingual Transformers Ife Adebara, El Moatez Billah Nagoudi, Muhammad Abdul Mageed arXiv_CL arXiv_CL Transformer Relation PDF
2020-11-10 When Do You Need Billions of Words of Pretraining Data? Yian Zhang, Alex Warstadt, Haau-Sing Li, Samuel R. Bowman arXiv_CL arXiv_CL Transformer Unsupervised Bert Knowledge Pose Language_Model PDF
2020-11-10 A Transfer Learning Approach for Dialogue Act Classification of GitHub Issue Comments Ayesha Enayet, Gita Sukthankar arXiv_CL arXiv_CL Transformer Transfer_Learning Bert Classification PDF
2020-11-09 EstBERT: A Pretrained Language-Specific BERT for Estonian Hasan Tanvir, Claudia Kittask, Kairit Sirts arXiv_CL arXiv_CL Transformer Recognition Bert Text_Classification Classification PDF
2020-11-09 VisBERT: Hidden-State Visualizations for Transformers Betty van Aken, Benjamin Winter, Alexander Löser, Felix A. Gers arXiv_CL arXiv_CL Transformer Bert Attention Inference Prediction PDF
2020-11-09 Bangla Text Classification using Transformers Tanvirul Alam, Akib Khan, Firoj Alam arXiv_CL arXiv_CL Transformer Text_Classification Emotion Classification Deep_Learning Detection Sentiment PDF
2020-11-09 BERT-JAM: Boosting BERT-Enhanced Neural Machine Translation with Joint Attention Zhebin Zhang, Sai Wu, Dawei Jiang, Gang Chen arXiv_CL arXiv_CL Transformer Bert Optimization Pose NMT Attention PDF
2020-11-09 Gated Recurrent Fusion with Joint Training Framework for Robust End-to-End Speech Recognition Cunhang Fan, Jiangyan Yi, Jianhua Tao, Zhengkun Tian, Bin Liu, Zhengqi Wen arXiv_CL arXiv_CL Transformer Enhancement Recognition Speech Pose Speech_Recognition PDF
2020-11-09 End-to-end Lane Shape Prediction with Transformers Ruijin Liu, Zejian Yuan, Tie Liu, Zhiliang Xiong arXiv_AI arXiv_AI Transformer Pose Action Detection Attention Autonomous Prediction PDF
2020-11-09 Efficient End-to-End Speech Recognition Using Performers in Conformers Peidong Wang, DeLiang Wang arXiv_CL arXiv_CL Transformer Recognition Speech Pose Attention Speech_Recognition PDF
2020-11-08 On the Usefulness of Self-Attention for Automatic Speech Recognition with Transformers Shucong Zhang, Erfan Loweimi, Peter Bell, Steve Renals arXiv_CL arXiv_CL Transformer Recognition Speech Relation Attention Speech_Recognition PDF
2020-11-08 Long Range Arena: A Benchmark for Efficient Transformers Yi Tay, Mostafa Dehghani, Samira Abnar, Yikang Shen, Dara Bahri, Philip Pham, Jinfeng Rao, Liu Yang, Sebastian Ruder, Donald Metzler arXiv_AI arXiv_AI Transformer Sparse Pose Attention PDF
2020-11-08 Stochastic Attention Head Removal: A Simple and Effective Method for Improving Automatic Speech Recognition with Transformers Shucong Zhang, Erfan Loweimi, Peter Bell, Steve Renals arXiv_CL arXiv_CL Transformer Recognition Speech Pose Attention Speech_Recognition PDF
2020-11-08 On the Practical Ability of Recurrent Neural Networks to Recognize Hierarchical Languages Satwik Bhattamishra, Kabir Ahuja, Navin Goyal arXiv_CL arXiv_CL Transformer RNN PDF
2020-11-08 PointTransformer for Shape Classification and Retrieval of 3D and ALS Roof PointClouds Dimple A Shajahan, Mukund Varma T, Ramanathan Muthuganapathy arXiv_CV arXiv_CV Transformer Point_Cloud 3D Pose Classification Deep_Learning Attention PDF
2020-11-07 Rethinking the Value of Transformer Components Wenxuan Wang, Zhaopeng Tu arXiv_CL arXiv_CL Transformer Pose PDF
2020-11-07 Know What You Don't Need: Single-Shot Meta-Pruning for Attention Heads Zhengyan Zhang, Fanchao Qi, Zhiyuan Liu, Qun Liu, Maosong Sun arXiv_CL arXiv_CL Transformer Knowledge Pose Attention Inference PDF
2020-11-06 Semi-Supervised Low-Resource Style Transfer of Indonesian Informal to Formal Language with Iterative Forward-Translation Haryo Akbarianto Wibowo, Tatag Aziz Prawiro, Muhammad Ihsan, Alham Fikri Aji, Radityo Eko Prasojo, Rahmad Mahendra arXiv_CL arXiv_CL Transformer Style_Transfer PDF
2020-11-06 From Dataset Recycling to Multi-Property Extraction and Beyond Tomasz Dwojak, Michał Pietruszka, Łukasz Borchmann, Jakub Chłędowski, Filip Graliński arXiv_CL arXiv_CL Transformer Pose Action PDF
2020-11-05 Improving RNN Transducer Based ASR with Auxiliary Tasks Chunxi Liu, Frank Zhang, Duc Le, Suyoun Kim, Yatharth Saraf, Geoffrey Zweig arXiv_CL arXiv_CL Transformer Recognition RNN Speech Pose Speech_Recognition Prediction PDF
2020-11-05 Competence-Level Prediction and Resume & Job Description Matching Using Context-Aware Transformer Models Changmao Li, Elaine Fisher, Rebecca Thomas, Steve Pittard, Vicki Hertzberg, Jinho D. Choi arXiv_CL arXiv_CL Transformer Classification Attention Prediction Matching PDF
2020-11-05 Revisiting Stereo Depth Estimation From a Sequence-to-Sequence Perspective with Transformers Zhaoshuo Li, Xingtong Liu, Francis X. Creighton, Russell H. Taylor, Mathias Unberath arXiv_CV arXiv_CV Transformer Pose Attention Matching PDF
2020-11-05 BW-EDA-EEND: Streaming End-to-End Neural Speaker Diarization for a Variable Number of Speakers Eunjung Han, Chul Lee, Andreas Stolcke arXiv_CL arXiv_CL Transformer Pose PDF
2020-11-05 Lets Play Music: Audio-driven Performance Video Generation Hao Zhu, Yi Li, Feixia Zhu, Aihua Zheng, Ran He arXiv_CV arXiv_CV Transformer Pose PDF
2020-11-04 Indic-Transformers: An Analysis of Transformer Language Models for Indian Languages Kushal Jain, Adwait Deshpande, Kumar Shridhar, Felix Laumann, Ayushman Dash arXiv_CL arXiv_CL Transformer Text_Classification Classification Language_Model PDF
2020-11-04 Optimizing Transformer for Low-Resource Neural Machine Translation Ali Araabi, Christof Monz arXiv_CL arXiv_CL Transformer PDF
2020-11-03 Sound Natural: Content Rephrasing in Dialog Systems Arash Einolghozati, Anchit Gupta, Keith Diedrick, Sonal Gupta arXiv_CL arXiv_CL Transformer RNN Pose Language_Model PDF
2020-11-03 Tabular Transformers for Modeling Multivariate Time Series Inkit Padhi, Yair Schiff, Igor Melnyk, Mattia Rigotti, Youssef Mroueh, Pierre Dognin, Jerret Ross, Ravi Nair, Erik Altman arXiv_AI arXiv_AI Transformer Bert Pose Action Deep_Learning Detection PDF
2020-11-03 Learning Representations from Audio-Visual Spatial Alignment Pedro Morgado, Yi Li, Nuno Vasconcelos arXiv_CV arXiv_CV Transformer Segmentation Semantic_Segmentation Recognition Represenation_Learning Self-Supervised Pose Action_Recognition Action PDF
2020-11-03 Rotational Rectification Network: Enabling Pedestrian Detection for Mobile Vision Xinshuo Weng, Shangxuan Wu, Fares Beainy, Kris Kitani arXiv_CV arXiv_CV Transformer Pose Detection Object_Detection CNN PDF
2020-11-03 Joint Entity and Relation Extraction with Set Prediction Networks Dianbo Sui, Yubo Chen, Kang Liu, Jun Zhao, Xiangrong Zeng, Shengping Liu arXiv_CL arXiv_CL Transformer Pose Action Relation Relation_Extraction Prediction Matching PDF
2020-11-03 Improving RNN transducer with normalized jointer network Mingkun Huang, Jun Zhang, Meng Cai, Yang Zhang, Jiali Yao, Yongbin You, Yi He, Zejun Ma arXiv_SD arXiv_SD Transformer Recognition RNN Speech Pose Speech_Recognition Language_Model PDF
2020-11-03 BioNerFlair: biomedical named entity recognition using flair embedding and sequence tagger Harsh Patel arXiv_CL arXiv_CL Transformer Embedding Recognition OCR Bert RNN Action Medical PDF
2020-11-02 The Devil is in the Details: Evaluating Limitations of Transformer-based Methods for Granular Tasks Brihi Joshi, Neil Shah, Francesco Barbieri, Leonardo Neves arXiv_CL arXiv_CL Transformer Embedding Pose Sentiment Language_Model Matching PDF
2020-11-02 A Closer Look at Linguistic Knowledge in Masked Language Models: The Case of Relative Clauses in American English Marius Mosbach, Stefania Degaetano-Ortlieb, Marie-Pauline Krielke, Badr M. Abdullah, Dietrich Klakow arXiv_CL arXiv_CL Transformer Bert Knowledge Language_Model Prediction PDF
2020-11-02 How Far Does BERT Look At:Distance-based Clustering and Analysis of BERTś Attention Yue Guan, Jingwen Leng, Chao Li, Quan Chen, Minyi Guo arXiv_CL arXiv_CL Transformer Unsupervised Bert Pose Attention PDF
2020-11-02 Point Transformer Nico Engel, Vasileios Belagiannis, Klaus Dietmayer arXiv_CV arXiv_CV Transformer Segmentation Pose Classification Relation Attention PDF
2020-11-02 Adapting Pretrained Transformer to Lattices for Spoken Language Understanding Chao-Wei Huang, Yun-Nung Chen arXiv_AI arXiv_AI Transformer Segmentation Recognition Speech Pose Speech_Recognition Language_Model PDF
2020-11-02 Multitask Learning and Joint Optimization for Transformer-RNN-Transducer Speech Recognition Jae-Jin Jeon, Eesung Kim arXiv_SD arXiv_SD Transformer Recognition Optimization RNN Speech Pose Speech_Recognition Prediction PDF
2020-11-02 Dual-decoder Transformer for Joint Automatic Speech Recognition and Multilingual Speech Translation Hang Le, Juan Pino, Changhan Wang, Jiatao Gu, Didier Schwab, Laurent Besacier arXiv_CL arXiv_CL Transformer Recognition Speech Pose Attention Speech_Recognition PDF
2020-11-01 Social Chemistry 101: Learning to Reason about Social and Moral Norms Maxwell Forbes, Jena D. Hwang, Vered Shwartz, Maarten Sap, Yejin Choi arXiv_AI arXiv_AI Transformer Action PDF
2020-11-01 COOT: Cooperative Hierarchical Transformer for Video-Text Representation Learning Simon Ging (1), Mohammadreza Zolfaghari (1), Hamed Pirsiavash (2), Thomas Brox (1) ((1) University of Freiburg, (2) University of Maryland Baltimore County) arXiv_AI arXiv_AI Transformer Represenation_Learning Pose Action Attention PDF
2020-11-01 TransQuest: Translation Quality Estimation with Cross-lingual Transformers Tharindu Ranasinghe, Constantin Orasan, Ruslan Mitkov arXiv_AI arXiv_AI Transformer Transfer_Learning Pose PDF
2020-11-01 SMRT Chatbots: Improving Non-Task-Oriented Dialog with Simulated Multiple Reference Training Huda Khayrallah, João Sedoc arXiv_CL arXiv_CL Transformer QA PDF
2020-11-01 Transformer-based Multi-Aspect Modeling for Multi-Aspect Multi-Sentiment Analysis Zhen Wu, Chengcan Ying, Xinyu Dai, Shujian Huang, Jiajun Chen arXiv_CL arXiv_CL Transformer Bert Pose Relation Sentiment PDF
2020-11-01 Investigation of BERT Model on Biomedical Relation Extraction Based on Revised Fine-tuning Mechanism Peng Su, K. Vijay-Shanker arXiv_CL arXiv_CL Transformer Bert Knowledge Action Classification Relation Relation_Extraction Medical PDF
2020-10-30 Streaming Simultaneous Speech Translation with Augmented Memory Transformer Xutai Ma, Yongqiang Wang, Mohammad Javad Dousti, Philipp Koehn, Juan Pino arXiv_CL arXiv_CL Transformer Recognition Speech Pose Attention Speech_Recognition PDF
2020-10-30 SLM: Learning a Discourse Language Representation with Sentence Unshuffling Haejun Lee, Drew A. Hudson, Kangwook Lee, Christopher D. Manning arXiv_CL arXiv_CL Transformer Bert Self-Supervised Pose Classification Relation Language_Model PDF
2020-10-30 Generating Radiology Reports via Memory-driven Transformer Zhihong Chen, Yan Song, Tsung-Hui Chang, Xiang Wan arXiv_CL arXiv_CL Transformer Knowledge Pose Relation Attention Medical PDF
2020-10-30 VECO: Variable Encoder-decoder Pre-training for Cross-lingual Understanding and Generation Fuli Luo, Wei Wang, Jiahao Liu, Yijia Liu, Bin Bi, Songfang Huang, Fei Huang, Luo Si arXiv_CL arXiv_CL Transformer Text_Classification Classification Relation GAN Inference Language_Model PDF
2020-10-29 RuREBus: a Case Study of Joint Named Entity Recognition and Relation Extraction from e-Government Domain Vitaly Ivanin, Ekaterina Artemova, Tatiana Batura, Vladimir Ivanov, Veronika Sarkisyan, Elena Tutubalina, Ivan Smurov arXiv_CL arXiv_CL Transformer Recognition Action Relation Relation_Extraction PDF
2020-10-29 RussianSuperGLUE: A Russian Language Understanding Evaluation Benchmark Tatiana Shavrina, Alena Fenogenova, Anton Emelyanov, Denis Shevelev, Ekaterina Artemova, Valentin Malykh, Vladislav Mikhailov, Maria Tikhonova, Andrey Chertok, Andrey Evlampiev arXiv_AI arXiv_AI Transformer Detection GAN Inference Language_Model PDF
2020-10-29 Reducing Non-Normative Text Generation from Language Models Xiangyu Peng, Siyan Li, Spencer Frazier, Mark Riedl arXiv_CL arXiv_CL Transformer Reinforcement_Learning Text_Generation Language_Model PDF
2020-10-29 RelationNet++: Bridging Visual Representations for Object Detection via Transformer Decoder Cheng Chi, Fangyun Wei, Han Hu arXiv_CV arXiv_CV Transformer Embedding Pose Action Classification Detection Relation Object_Detection Attention PDF
2020-10-29 T-vectors: Weakly Supervised Speaker Identification Using Hierarchical Transformer Model Yanpei Shi, Mingjie Chen, Qiang Huang, Thomas Hain arXiv_CL arXiv_CL Transformer Weakly_Supervised Pose Attention PDF
2020-10-29 Memory Attentive Fusion: External Language Model Integration for Transformer-based Sequence-to-Sequence Model Mana Ihori, Ryo Masumura, Naoki Makishima, Tomohiro Tanaka, Akihiko Takashima, Shota Orihashi arXiv_CL arXiv_CL Transformer Knowledge Pose Attention Language_Model PDF
2020-10-29 Tilde at WMT 2020: News Task Systems Rihards Krišlauks, Mārcis Pinnis arXiv_CL arXiv_CL Transformer PDF
2020-10-29 Multiple Sclerosis Severity Classification From Clinical Text Alister D Costa, Stefan Denkovski, Michal Malyska, Sae Young Moon, Brandon Rufino, Zhen Yang, Taylor Killian, Marzyeh Ghassemi arXiv_CL arXiv_CL Transformer Embedding Bert Knowledge Classification Language_Model Prediction PDF
2020-10-28 Graph-based Topic Extraction from Vector Embeddings of Text Documents: Application to a Corpus of News Articles M. Tarik Altuncu, Sophia N. Yaliraki, Mauricio Barahona arXiv_AI arXiv_AI Transformer Embedding Unsupervised Bert Action PDF
2020-10-28 Non-Autoregressive Transformer ASR with CTC-Enhanced Decoder Input Xingchen Song, Zhiyong Wu, Yiheng Huang, Chao Weng, Dan Su, Helen Meng arXiv_CL arXiv_CL Transformer Recognition Speech Pose Speech_Recognition Inference Prediction PDF
2020-10-28 The Volctrans Machine Translation System for WMT20 Liwei Wu, Xiao Pan, Zehui Lin, Yaoming Zhu, Mingxuan Wang, Lei Li arXiv_CL arXiv_CL Transformer PDF
2020-10-28 Decoupling Pronunciation and Language for End-to-end Code-switching Automatic Speech Recognition Shuai Zhang, Jiangyan Yi, Zhengkun Tian, Ye Bai, Jianhua Tao, Zhengqi wen arXiv_CL arXiv_CL Transformer Recognition Speech Pose Attention Speech_Recognition PDF
2020-10-28 CASS-NAT: CTC Alignment-based Single Step Non-autoregressive Transformer for Speech Recognition Ruchao Fan, Wei Chu, Peng Chang, Jing Xiao arXiv_CL arXiv_CL Transformer Embedding Recognition Speech Pose Speech_Recognition Inference PDF
2020-10-28 Scaling Laws for Autoregressive Generative Modeling Tom Henighan, Jared Kaplan, Mor Katz, Mark Chen, Christopher Hesse, Jacob Jackson, Heewoo Jun, Tom B. Brown, Prafulla Dhariwal, Scott Gray, Chris Hallacy, Benjamin Mann, Alec Radford, Aditya Ramesh, Nick Ryder, Daniel M. Ziegler, John Schulman, Dario Amodei, Sam McCandlish arXiv_CV arXiv_CV Transformer Classification Relation Caption Prediction PDF
2020-10-27 Transformer in action: a comparative study of transformer-based acoustic models for large scale speech recognition applications Yongqiang Wang, Yangyang Shi, Frank Zhang, Chunyang Wu, Julian Chan, Ching-Feng Yeh, Alex Xiao arXiv_CL arXiv_CL Transformer Recognition Video_Caption RNN Speech Action Speech_Recognition Caption Inference PDF
2020-10-27 Language ID in the Wild: Unexpected Challenges on the Path to a Thousand-Language Web Text Corpus Isaac Caswell, Theresa Breiner, Daan van Esch, Ankur Bapna arXiv_CL arXiv_CL Transformer Pose PDF
2020-10-27 Fast Interleaved Bidirectional Sequence Generation Biao Zhang, Ivan Titov, Rico Sennrich arXiv_CL arXiv_CL Transformer Attention Summarization Inference PDF
2020-10-27 Co-attentional Transformers for Story-Based Video Understanding Björn Bebensee, Byoung-Tak Zhang arXiv_AI arXiv_AI Transformer Video_Caption Pose Action Attention QA PDF
2020-10-27 MMFT-BERT: Multimodal Fusion Transformer with BERT Encodings for Visual Question Answering Aisha Urooj Khan, Amir Mazaheri, Niels da Vitoria Lobo, Mubarak Shah arXiv_CV arXiv_CV Transformer Bert Knowledge Pose VQA QA PDF
2020-10-27 To BERT or Not to BERT: Comparing Task-specific and Task-agnostic Semi-Supervised Approaches for Sequence Tagging Kasturi Bhattacharjee, Miguel Ballesteros, Rishita Anubhai, Smaranda Muresan, Jie Ma, Faisal Ladhak, Yaser Al-Onaizan arXiv_CL arXiv_CL Transformer Bert PDF
2020-10-26 Recent Developments on ESPnet Toolkit Boosted by Conformer Pengcheng Guo, Florian Boyer, Xuankai Chang, Tomoki Hayashi, Yosuke Higuchi, Hirofumi Inaguma, Naoyuki Kamo, Chenda Li, Daniel Garcia-Romero, Jiatong Shi, Jing Shi, Shinji Watanabe, Kun Wei, Wangyou Zhang, Yuekai Zhang arXiv_SD arXiv_SD Transformer Recognition Speech Pose Speech_Recognition PDF
2020-10-26 Controlled Molecule Generator for Optimizing Multiple Chemical Properties Bonggun Shin, Sungsoo Park, JinYeong Bak, Joyce C. Ho arXiv_AI arXiv_AI Transformer Optimization Pose Prediction PDF
2020-10-26 Peak Detection On Data Independent Acquisition Mass Spectrometry Data With Semisupervised Convolutional Transformers Leon L. Xu, Hannes L. Röst arXiv_CV arXiv_CV Transformer Segmentation Pose Quantitative Classification Detection Attention CNN Image_Classification PDF
2020-10-26 PowerTransformer: Unsupervised Controllable Revision for Biased Language Correction Xinyao Ma, Maarten Sap, Hannah Rashkin, Yejin Choi arXiv_AI arXiv_AI Transformer Reconstruction Unsupervised Knowledge Language_Model PDF
2020-10-26 Dutch Humor Detection by Generating Negative Examples Thomas Winters, Pieter Delobelle arXiv_AI arXiv_AI Transformer Recognition Bert Pose Classification Detection Text_Generation Language_Model PDF
2020-10-26 UPB at SemEval-2020 Task 12: Multilingual Offensive Language Detection on Social Media by Fine-tuning a Variety of BERT-based Models Mircea-Adrian Tanase, Dumitru-Clementin Cercel, Costing-Gabriel Chiru arXiv_CL arXiv_CL Transformer