Transformer

2021-07-27 PlaneTR: Structure-Guided Transformers for 3D Plane Recovery Bin Tan, Nan Xue, Song Bai, Tianfu Wu, Gui-Song Xia arXiv_CV arXiv_CV Transformer Embedding 3D PDF
2021-07-27 Exceeding the Limits of Visual-Linguistic Multi-Task Learning Cameron R. Wolfe, Keld T. Lundgaard arXiv_AI arXiv_AI Transformer Pose Classification PDF
2021-07-27 Exploring Sequence Feature Alignment for Domain Adaptive Detection Transformers Wen Wang, Yang Cao, Jing Zhang, Fengxiang He, Zheng-Jun Zha, Yonggang Wen, Dacheng Tao arXiv_CV arXiv_CV Transformer Pose Detection Relation Object_Detection Attention Prediction Matching PDF
2021-07-27 PiSLTRc: Position-informed Sign Language Transformer with Content-aware Convolution Pan Xie, Mengyi Zhao, Xiaohui Hu arXiv_CV arXiv_CV Transformer Recognition Gesture Pose Attention PDF
2021-07-26 Don't Sweep your Learning Rate under the Rug: A Closer Look at Cross-modal Transfer of Pretrained Transformers Danielle Rothermel, Margaret Li, Tim Rocktäschel, Jakob Foerster arXiv_AI arXiv_AI Transformer Self-Supervised Language_Model PDF
2021-07-26 Spatial-Temporal Transformer for Dynamic Scene Graph Generation Yuren Cong, Wentong Liao, Hanno Ackermann, Michael Ying Yang, Bodo Rosenhahn arXiv_CV arXiv_CV Transformer Pose Action Relation Visual_Relation PDF
2021-07-26 Contextual Transformer Networks for Visual Recognition Yehao Li, Ting Yao, Yingwei Pan, Tao Mei arXiv_AI arXiv_AI Transformer Segmentation Recognition Detection Object_Detection Attention PDF
2021-07-26 Language Models as Zero-shot Visual Semantic Learners Yue Jiao, Jonathon Hare, Adam Prügel-Bennett arXiv_CV arXiv_CV Transformer Embedding Recognition Zero-Shot Knowledge Pose Language_Model PDF
2021-07-25 H-Transformer-1D: Fast One-Dimensional Hierarchical Attention for Sequences Zhenhai Zhu, Radu Soricut arXiv_CL arXiv_CL Transformer Pose Attention PDF
2021-07-25 Hybrid Autoregressive Solver for Scalable Abductive Natural Language Inference Marco Valentino, Mokanarangan Thayaparan, Deborah Ferreira, André Freitas arXiv_AI arXiv_AI Transformer Sparse Pose Attention Inference PDF
2021-07-25 Go Wider Instead of Deeper Fuzhao Xue, Ziji Shi, Yuxuan Lou, Yong Liu, Yang You arXiv_AI arXiv_AI Transformer Pose PDF
2021-07-24 Two Headed Dragons: Multimodal Fusion and Cross Modal Transactions Rupak Bose, Shivam Pande, Biplab Banerjee arXiv_CV arXiv_CV Transformer Recognition Pose Action Classification PDF
2021-07-24 The USYD-JD Speech Translation System for IWSLT 2021 Liang Ding, Di Wu, Dacheng Tao arXiv_AI arXiv_AI Transformer Knowledge Speech Pose NMT PDF
2021-07-23 Mixed SIGNals: Sign Language Production via a Mixture of Motion Primitives Ben Saunders, Necati Cihan Camgoz, Richard Bowden arXiv_CV arXiv_CV Transformer Pose Deep_Learning Inference PDF
2021-07-23 A Differentiable Language Model Adversarial Attack on Text Classifiers Ivan Fursov, Alexey Zaytsev, Pavel Burnyshev, Ekaterina Dmitrieva, Nikita Klyuchnikov, Andrey Kravchenko, Ekaterina Artemova, Evgeny Burnaev arXiv_CL arXiv_CL Transformer Adversarial Pose Deep_Learning Language_Model PDF
2021-07-23 OLR 2021 Challenge: Datasets, Rules and Baselines Binling Wang, Wenxuan Hu, Jing Li, Yiming Zhi, Zheng Li, Qingyang Hong, Lin Li, Dong Wang, Liming Song, Cheng Yang arXiv_CL arXiv_CL Transformer Recognition Speech Speech_Recognition PDF
2021-07-23 Class-Incremental Domain Adaptation with Smoothing and Calibration for Surgical Report Generation Mengya Xu, Mobarakol Islam, Chwee Ming Lim, Hongliang Ren arXiv_CV arXiv_CV Transformer Embedding Pose Deep_Learning Few-Shot Caption Prediction PDF
2021-07-23 SALADnet: Self-Attentive multisource Localization in the Ambisonics Domain Pierre-Amaury Grumiaux, Srdan Kitic, Prerak Srivastava, Laurent Girin, Alexandre Guérin arXiv_SD arXiv_SD Transformer RNN Pose Attention CNN PDF
2021-07-22 FNetAR: Mixing Tokens with Autoregressive Fourier Transforms Tim Lou, Michael Park, Mohammad Ramezanali, Vincent Tang arXiv_CL arXiv_CL Transformer Sparse Attention Language_Model Prediction PDF
2021-07-22 Did the Cat Drink the Coffee? Challenging Transformers with Generalized Event Knowledge Paolo Pedinotti, Giulia Rambelli, Emmanuele Chersoni, Enrico Santus, Alessandro Lenci, Philippe Blache arXiv_CL arXiv_CL Transformer Knowledge Face Relation Language_Model Prediction PDF
2021-07-22 Query2Label: A Simple Transformer Way to Multi-Label Classification Shilong Liu, Lei Zhang, Xiao Yang, Hang Su, Jun Zhu arXiv_CV arXiv_CV Transformer Embedding Pose Classification Attention PDF
2021-07-22 EAN: Event Adaptive Network for Enhanced Action Recognition Yuan Tian, Yichao Yan, Xiongkuo Min, Guo Lu, Guangtao Zhai, Guodong Guo, Zhiyong Gao arXiv_CV arXiv_CV Transformer Recognition Sparse Pose Action_Recognition Action Prediction PDF
2021-07-22 Confidence-Aware Scheduled Sampling for Neural Machine Translation Yijin Liu, Fandong Meng, Yufeng Chen, Jinan Xu, Jie Zhou arXiv_CL arXiv_CL Transformer Pose Inference Prediction PDF
2021-07-21 Multi-Stream Transformers Mikhail Burtsev, Anna Rumshisky arXiv_CL arXiv_CL Transformer PDF
2021-07-21 Small-text: Active Learning for Text Classification in Python Christopher Schröder, Lydia Müller, Andreas Niekler, Martin Potthast arXiv_CL arXiv_CL Transformer Text_Classification Face Classification PDF
2021-07-21 CycleMLP: A MLP-like Architecture for Dense Prediction Shoufa Chen, Enze Xie, Chongjian Ge, Ding Liang, Ping Luo arXiv_CV arXiv_CV Transformer Segmentation Semantic_Segmentation Recognition Classification Detection Object_Detection Prediction PDF
2021-07-21 Improved Text Classification via Contrastive Adversarial Training Lin Pan, Chung-Wei Hang, Avirup Sil, Saloni Potdar, Mo Yu arXiv_CL arXiv_CL Transformer Embedding Bert Text_Classification Adversarial Pose Contrastive_Learning Classification PDF
2021-07-21 Comparison of Czech Transformers on Text Classification Tasks Jan Lehečka, Jan Švec arXiv_CL arXiv_CL Transformer Text_Classification Classification PDF
2021-07-21 Audio Captioning Transformer Xinhao Mei, Xubo Liu, Qiushi Huang, Mark D. Plumbley, Wenwu Wang arXiv_SD arXiv_SD Transformer RNN Pose Relation Caption CNN PDF
2021-07-20 Different kinds of cognitive plausibility: why are transformers better than RNNs at predicting N400 amplitude? James A. Michaelov, Megan D. Bardolph, Seana Coulson, Benjamin K. Bergen arXiv_AI arXiv_AI Transformer RNN Pose Language_Model Prediction PDF
2021-07-20 QVHighlights: Detecting Moments and Highlights in Videos via Natural Language Queries Jie Lei, Tamara L. Berg, Mohit Bansal arXiv_AI arXiv_AI Transformer Weakly_Supervised Salient Caption Prediction PDF
2021-07-20 WikiGraphs: A Wikipedia Text - Knowledge Graph Paired Dataset Luyu Wang, Yujia Li, Ozlem Aslan, Oriol Vinyals arXiv_AI arXiv_AI Transformer Represenation_Learning Knowledge Knowledge_Graph Text_Generation PDF
2021-07-20 Assessment of Self-Attention on Learned Features For Sound Event Localization and Detection Parthasaarathy Sudarsanam, Archontis Politis, Konstantinos Drossos arXiv_SD arXiv_SD Transformer Embedding RNN Detection Relation Attention CNN Inference PDF
2021-07-20 MIMO: Mutual Integration of Patient Journey and Medical Ontology for Healthcare Representation Learning Xueping Peng, and Guodong Long, Tao Shen, Sen Wang, Zhendong Niu, Chengqi Zhang arXiv_AI arXiv_AI Transformer Embedding Represenation_Learning RNN Knowledge Knowledge_Graph Self-Supervised Pose Ontology Attention Medical Language_Model Prediction PDF
2021-07-20 Generative Video Transformer: Can Objects be the Words? Yi-Fu Wu, Jaesik Yoon, Sungjin Ahn arXiv_CV arXiv_CV Transformer Unsupervised RNN Pose PDF
2021-07-19 Sequence-to-Sequence Piano Transcription with Transformers Curtis Hawthorne, Ian Simon, Rigel Swavely, Ethan Manilow, Jesse Engel arXiv_SD arXiv_SD Transformer PDF
2021-07-19 Image Fusion Transformer Vibashan VS, Jeya Maria Jose Valanarasu, Poojan Oza, Vishal M. Patel arXiv_CV arXiv_CV Transformer Pose Attention CNN PDF
2021-07-19 OODformer: Out-Of-Distribution Detection Transformer Rajat Koner, Poulami Sinhamahapatra, Karsten Roscher, Stephan Günnemann, Volker Tresp arXiv_CV arXiv_CV Transformer Reconstruction Embedding Pose Contrastive_Learning Classification Detection Attention Image_Classification PDF
2021-07-19 Clinical Relation Extraction Using Transformer-based Models Xi Yang, Zehao Yu, Yi Guo, Jiang Bian, Yonghui Wu arXiv_CL arXiv_CL Transformer Bert Action Classification Relation Relation_Extraction Medical PDF
2021-07-19 Learning Attributed Graph Representations with Communicative Message Passing Transformer Jianwen Chen, Shuangjia Zheng, Ying Song, Jiahua Rao, Yuedong Yang arXiv_AI arXiv_AI Transformer Represenation_Learning Pose Action PDF
2021-07-19 Stock Movement Prediction with Financial News using Contextualized Embedding from BERT Qinkai Chen arXiv_CL arXiv_CL Transformer Embedding Bert RNN Prediction PDF
2021-07-19 CETransformer: Casual Effect Estimation via Transformer Based Representation Learning Zhenyu Guo, Shuai Zheng, Zhizhe Liu, Kun Yan, Zhenfeng Zhu arXiv_AI arXiv_AI Transformer Represenation_Learning Adversarial Self-Supervised Pose Face Relation Attention PDF
2021-07-19 LeViT-UNet: Make Faster Encoders with Transformer for Medical Image Segmentation Guoping Xu, Xingrong Wu, Xuan Zhang, Xinwei He arXiv_CV arXiv_CV Transformer Segmentation Pose Face Relation Medical CNN PDF
2021-07-18 Stock price prediction using BERT and GAN Priyank Sonkiya, Vikas Bajpai, Anukriti Bansal arXiv_CL arXiv_CL Transformer Bert RNN Adversarial Pose Emotion Deep_Learning Sentiment GAN Prediction PDF
2021-07-18 Pre-trained Language Models as Prior Knowledge for Playing Text-based Games Ishika Singh, Gargi Singh, Ashutosh Modi arXiv_AI arXiv_AI Transformer Knowledge Pose Action Language_Model PDF
2021-07-18 Dynamic Convolution for 3D Point Cloud Instance Segmentation Tong He, Chunhua Shen, Anton van den Hengel arXiv_CV arXiv_CV Transformer Segmentation Point_Cloud 3D Pose Inference PDF
2021-07-18 AS-MLP: An Axial Shifted MLP Architecture for Vision Dongze Lian, Zehao Yu, Xing Sun, Shenghua Gao arXiv_CV arXiv_CV Transformer Segmentation Semantic_Segmentation Pose Detection Object_Detection Attention PDF
2021-07-17 Tea: Program Repair Using Neural Network Based on Program Information Attention Matrix Wenshuo Wang, Chen Wu, Liang Cheng, Yang Zhang arXiv_AI arXiv_AI Transformer Pose Attention PDF
2021-07-17 Dynamic Transformer for Efficient Machine Translation on Embedded Devices Hishan Parry, Lei Xun, Amin Sabet, Jia Bi, Jonathon Hare, Geoff V. Merrett arXiv_CL arXiv_CL Transformer Pose PDF
2021-07-17 RAMS-Trans: Recurrent Attention Multi-scale Transformer forFine-grained Image Recognition Yunqing Hu, Xuan Jin, Yin Zhang, Haiwen Hong, Jingfeng Zhang, Yuan He, Hui Xue arXiv_CV arXiv_CV Transformer Recognition Pose Attention CNN PDF
2021-07-16 The Law of Large Documents: Understanding the Structure of Legal Contracts Using Visual Cues Allison Hegel, Marina Shah, Genevieve Peaslee, Brendan Roof, Emad Elwany arXiv_CL arXiv_CL Transformer Segmentation Bert Action Classification PDF
2021-07-16 CCVS: Context-aware Controllable Video Synthesis Guillaume Le Moing, Jean Ponce, Cordelia Schmid arXiv_CV arXiv_CV Transformer Adversarial Self-Supervised Pose Quantitative Optical_Flow Prediction PDF
2021-07-16 Is attention to bounding boxes all you need for pedestrian action prediction? Lina Achaji, Julien Moreau, Thibault Fouqueray, Francois Aioun, Francois Charpillet arXiv_RO arXiv_RO Transformer Action Attention Autonomous Prediction PDF
2021-07-16 Graph Kernel Attention Transformers Krzysztof Choromanski, Han Lin, Haoxian Chen, Jack Parker-Holder arXiv_AI arXiv_AI Transformer Sketch Pose Classification Detection Attention PDF
2021-07-16 Are Multilingual Models the Best Choice for Moderately Under-resourced Languages? A Comprehensive Assessment for Catalan Jordi Armengol-Estapé, Casimiro Pio Carrino, Carlos Rodriguez-Penagos, Ona de Gibert Bonet, Carme Armentano-Oller, Aitor Gonzalez-Agirre, Maite Melero, Marta Villegas arXiv_CL arXiv_CL Transformer Recognition Bert Text_Classification Speech Action Classification Language_Model PDF
2021-07-16 A Comparison of Deep Learning Classification Methods on Small-scale Image Data set: from Converlutional Neural Networks to Visual Transformers Peng Zhao, Chen Li, Md Mamunur Rahaman, Hechen Yang, Tao Jiang, Marcin Grzegorzek arXiv_CV arXiv_CV Transformer Classification Deep_Learning CNN Image_Classification PDF
2021-07-16 Align before Fuse: Vision and Language Representation Learning with Momentum Distillation Junnan Li, Ramprasaath R. Selvaraju, Akhilesh Deepak Gotmare, Shafiq Joty, Caiming Xiong, Steven Hoi arXiv_CV arXiv_CV Transformer Represenation_Learning Pose Action VQA Attention Inference QA PDF
2021-07-15 AutoBERT-Zero: Evolving BERT Backbone from Scratch Jiahui Gao, Hang Xu, Han shi, Xiaozhe Ren, Philip L.H. Yu, Xiaodan Liang, Xin Jiang, Zhenguo Li arXiv_CL arXiv_CL Transformer NAS Bert Pose Attention Language_Model PDF
2021-07-15 Wordcraft: a Human-AI Collaborative Editor for Story Writing Andy Coenen, Luke Davis, Daphne Ippolito, Emily Reif, Ann Yuan arXiv_CL arXiv_CL Transformer Pose Face Action Few-Shot Language_Model PDF
2021-07-15 Transformer-based Machine Learning for Fast SAT Solvers and Logic Synthesis Feng Shi, Chonghan Lee, Mohammad Khairul Bashar, Nikhil Shukla, Song-Chun Zhu, Vijaykrishnan Narayanan arXiv_AI arXiv_AI Transformer Optimization Pose Action Attention PDF
2021-07-15 Uncertainty-Aware Reliable Text Classification Yibo Hu, Latifur Khan arXiv_AI arXiv_AI Transformer Text_Classification RNN Knowledge Pose Classification Detection Prediction PDF
2021-07-15 STAR: Sparse Transformer-based Action Recognition Feng Shi, Chonghan Lee, Liang Qiu, Yizhou Zhao, Tianyi Shen, Shivran Muralidhar, Tian Han, Song-Chun Zhu, Vijaykrishnan Narayanan arXiv_AI arXiv_AI Transformer Recognition Sparse Pose Action_Recognition Action Deep_Learning Attention Inference PDF
2021-07-15 Learning Sparse Interaction Graphs of Partially Observed Pedestrians for Trajectory Prediction Zhe Huang, Ruohua Li, Kazuki Shin, Katherine Driggs-Campbell arXiv_CV arXiv_CV Transformer Sparse RNN Pose Action Attention Autonomous Prediction PDF
2021-07-14 Surgical Instruction Generation with Transformers Jinglu Zhang, Yinyu Nie, Jian Chang, Jian Jun Zhang arXiv_CV arXiv_CV Transformer Reinforcement_Learning Relation Medical Caption Activity PDF
2021-07-14 Extreme Precipitation Seasonal Forecast Using a Transformer Neural Network Daniel Salles Civitarese, Daniela Szwarcman, Bianca Zadrozny, Campbell Watson arXiv_AI arXiv_AI Transformer Prediction PDF
2021-07-14 High-Speed and High-Quality Text-to-Lip Generation Jinglin Liu, Zhiying Zhu, Yi Ren, Zhou Zhao arXiv_CV arXiv_CV Transformer Adversarial Speech Pose Face Attention Inference Prediction PDF
2021-07-14 Indonesia's Fake News Detection using Transformer Network Aisyah Awalina, Jibran Fawaid, Rifky Yunus Krisnabayu, Novanto Yudistira arXiv_CL arXiv_CL Transformer Bert RNN Face Detection PDF
2021-07-14 A Note on Learning Rare Events in Molecular Dynamics using LSTM and Transformer Wenqi Zeng, Siqin Cao, Xuhui Huang, Yuan Yao arXiv_AI arXiv_AI Transformer RNN Action Language_Model PDF
2021-07-14 Transformer with Peak Suppression and Knowledge Guidance for Fine-grained Image Recognition Xinda Liu, Lili Wang, Xiaoguang Han arXiv_CV arXiv_CV Transformer Embedding Recognition Knowledge Pose Classification Attention PDF
2021-07-14 Serialized Multi-Layer Multi-Head Attention for Neural Speaker Embedding Hongning Zhu, Kong Aik Lee, Haizhou Li arXiv_AI arXiv_AI Transformer Embedding Pose Attention PDF
2021-07-13 CMT: Convolutional Neural Networks Meet Vision Transformers Jianyuan Guo, Kai Han, Han Wu, Chang Xu, Yehui Tang, Chunjing Xu, Yunhe Wang arXiv_CV arXiv_CV Transformer Recognition Pose CNN PDF
2021-07-13 HAT: Hierarchical Aggregation Transformers for Person Re-identification Guowen Zhang, Pingping Zhang, Jinqing Qi, Huchuan Lu arXiv_AI arXiv_AI Transformer Person_Re-identification Knowledge Pose Re-identification CNN PDF
2021-07-13 The Piano Inpainting Application Gaëtan Hadjeres, Léopold Crestel arXiv_AI arXiv_AI Transformer Inpainting Action Inference PDF
2021-07-13 Conformer-based End-to-end Speech Recognition With Rotary Position Embedding Shengqiang Li, Menglong Xu, Xiao-Lei Zhang arXiv_CL arXiv_CL Transformer Embedding Recognition Speech Attention Speech_Recognition PDF
2021-07-13 Speech Representation Learning Combining Conformer CPC with Deep Cluster for the ZeroSpeech Challenge 2021 Takashi Maekaku, Xuankai Chang, Yuya Fujita, Li-Wei Chen, Shinji Watanabe, Alexander Rudnicky arXiv_SD arXiv_SD Transformer Represenation_Learning Speech PDF
2021-07-13 ST-DETR: Spatio-Temporal Object Traces Attention Detection Transformer Eslam Mohamed, Ahmad El-Sallab arXiv_CV arXiv_CV Transformer Embedding Pose Detection Relation Object_Detection Attention PDF
2021-07-13 Exploiting Network Structures to Improve Semantic Representation for the Financial Domain Chao Feng, Shi-jie We arXiv_CL arXiv_CL Transformer Embedding Bert Knowledge Knowledge_Graph Pose Inference Language_Model PDF
2021-07-13 Deep Neural Networks Evolve Human-like Attention Distribution during Reading Comprehension Jiajie Zou, Nai Ding arXiv_AI arXiv_AI Transformer Optimization Quantitative Attention PDF
2021-07-13 Visual Parser: Representing Part-whole Hierarchies with Transformers Shuyang Sun*, Xiaoyu Yue*, Song Bai, Philip Torr arXiv_CV arXiv_CV Transformer Segmentation Pose Action Classification Detection Object_Detection Attention PDF
2021-07-12 Combiner: Full Attention Transformer with Sparse Computation Cost Hongyu Ren, Hanjun Dai, Zihang Dai, Mengjiao Yang, Jure Leskovec, Dale Schuurmans, Bo Dai arXiv_CV arXiv_CV Transformer Embedding Sparse Pose Action Attention PDF
2021-07-12 Uncertainty-based Query Strategies for Active Learning with Transformers Christopher Schröder, Andreas Niekler, Martin Potthast arXiv_CL arXiv_CL Transformer Text_Classification Classification Language_Model PDF
2021-07-12 Accenture at CheckThat! 2021: Interesting claim identification and ranking with contextually sensitive lexical training data augmentation Evan Williams, Paul Rodrigues, Sieu Tran arXiv_CL arXiv_CL Transformer PDF
2021-07-12 End-to-end Multi-modal Video Temporal Grounding Yi-Wen Chen, Yi-Hsuan Tsai, Ming-Hsuan Yang arXiv_CV arXiv_CV Transformer Self-Supervised Pose Action Caption Activity Optical_Flow PDF
2021-07-12 GiT: Graph Interactive Transformer for Vehicle Re-identification Fei Shen, Yi Xie, Jianqing Zhu, Xiaobin Zhu, Huanqiang Zeng arXiv_CV arXiv_CV Transformer Knowledge Pose Relation Re-identification PDF
2021-07-12 Scenes and Surroundings: Scene Graph Generation using Relation Transformer Rajat Koner, Poulami Sinhamahapatra, Volker Tresp arXiv_CV arXiv_CV Transformer Pose Action Deep_Learning Detection Relation Attention PDF
2021-07-12 CoBERL: Contrastive BERT for Reinforcement Learning Andrea Banino, Adrià Puidomenech Badia, Jacob Walker, Tim Scholtes, Jovana Mitrovic, Charles Blundell arXiv_AI arXiv_AI Transformer Reinforcement_Learning 3D Bert RNN Pose Prediction PDF
2021-07-12 MECT: Multi-Metadata Embedding based Cross-Transformer for Chinese Named Entity Recognition Shuang Wu, Xiaoning Song, Zhenhua Feng arXiv_AI arXiv_AI Transformer Segmentation Embedding Enhancement Recognition Pose PDF
2021-07-12 Visual Transformer with Statistical Test for COVID-19 Classification Chih-Chung Hsu, Guan-Lin Chen, Mei-Hsuan Wu arXiv_CV arXiv_CV Transformer Pose Classification CNN PDF
2021-07-12 TransAttUnet: Multi-level Attention-guided U-Net with Transformer for Medical Image Segmentation Bingzhi Chen, Yishu Liu, Zheng Zhang, Guangming Lu, David Zhang arXiv_CV arXiv_CV Transformer Segmentation Semantic_Segmentation Pose Action Attention Medical PDF
2021-07-12 MidiBERT-Piano: Large-scale Pre-training for Symbolic Music Understanding Yi-Hui Chou, I-Chun Chen, Chin-Jui Chang, Joann Ching, Yi-Hsuan Yang arXiv_SD arXiv_SD Transformer Bert Pose Emotion Action Classification Attention Language_Model Prediction PDF
2021-07-12 TransClaw U-Net: Claw U-Net with Transformers for Medical Image Segmentation Yao Chang, Hu Menghan, Zhai Guangtao, Zhang Xiao-Ping arXiv_AI arXiv_AI Transformer Segmentation Pose Classification Attention GAN Medical CNN PDF
2021-07-12 Spatial and Temporal Networks for Facial Expression Recognition in the Wild Videos Shuyi Mao, Xinqi Fan, Xiaojiang Peng arXiv_CV arXiv_CV Transformer Recognition RNN Knowledge Pose Face Classification Face_Recognition CNN PDF
2021-07-12 MOOCRep: A Unified Pre-trained Embedding of MOOC Entities Shalini Pandey, Jaideep Srivastava arXiv_AI arXiv_AI Transformer Embedding OCR Represenation_Learning Knowledge Pose Relation Language_Model Prediction Recommendation PDF
2021-07-10 Few-Shot Domain Adaptation with Polymorphic Transformers Shaohua Li, Xiuchao Sui, Jie Fu, Huazhu Fu, Xiangde Luo, Yangqin Feng, Xinxing Xu, Yong Liu, Daniel Ting, Rick Siow Mong Goh arXiv_CV arXiv_CV Transformer Segmentation Embedding Pose Action Few-Shot Medical PDF
2021-07-10 Local-to-Global Self-Attention in Vision Transformers Jinpeng Li, Yichao Yan, Shengcai Liao, Xiaokang Yang, Ling Shao arXiv_CV arXiv_CV Transformer Segmentation Semantic_Segmentation Pose Classification Attention Image_Classification PDF
2021-07-09 ViTGAN: Training GANs with Vision Transformers Kwonjoon Lee, Huiwen Chang, Lu Jiang, Han Zhang, Zhuowen Tu, Ce Liu arXiv_CV arXiv_CV Transformer Recognition Regularization Adversarial Attention GAN PDF
2021-07-09 Can Deep Neural Networks Predict Data Correlations from Column Names? Immanuel Trummer arXiv_CL arXiv_CL Transformer Pose Detection Relation Language_Model Prediction PDF
2021-07-09 Benchmarking for Biomedical Natural Language Processing Tasks with a Domain Specific ALBERT Usman Naseem, Adam G. Dunn, Matloob Khushi, Jinman Kim arXiv_CL arXiv_CL Transformer Recognition Bert Action Classification Relation Relation_Extraction Medical Language_Model PDF
2021-07-09 Dropout Regularization for Self-Supervised Learning of Transformer Encoder Speech Representation Jian Luo, Jianzong Wang, Ning Cheng, Jing Xiao arXiv_SD arXiv_SD Transformer Recognition Regularization Speech Self-Supervised Pose Classification Attention PDF
2021-07-09 Levi Graph AMR Parser using Heterogeneous Attention Han He, Jinho D. Choi arXiv_AI arXiv_AI Transformer Attention Prediction PDF
2021-07-08 Learning to Delegate for Large-scale Vehicle Routing Sirui Li, Zhongxia Yan, Cathy Wu arXiv_AI arXiv_AI Transformer PDF
2021-07-08 Learning Vision-Guided Quadrupedal Locomotion End-to-End with Cross-Modal Transformers Ruihan Yang, Minghao Zhang, Nicklas Hansen, Huazhe Xu, Xiaolong Wang arXiv_CV arXiv_CV Transformer Reinforcement_Learning Pose Action PDF
2021-07-08 EEG-ConvTransformer for Single-Trial EEG based Visual Stimuli Classification Subhranil Bagchi, Deepti R. Bathula arXiv_CV arXiv_CV Transformer Face Action Quantitative Classification Attention CNN PDF
2021-07-08 A hybrid deep learning framework for Covid-19 detection via 3D Chest CT Images Shuang Liang arXiv_CV arXiv_CV Transformer 3D Pose Deep_Learning Detection Attention CNN PDF
2021-07-08 A Review of Bangla Natural Language Processing Tasks and the Utility of Transformer Models Firoj Alam, Arid Hasan, Tanvir Alam, Akib Khan, Janntatul Tajrin, Naira Khan, Shammur Absar Chowdhury arXiv_AI arXiv_AI Transformer Sparse Review Survey PDF
2021-07-08 Grid Partitioned Attention: Efficient TransformerApproximation with Inductive Bias for High Resolution Detail Generation Nikolay Jetchev, Gökhan Yildirim, Christian Bracher, Roland Vollgraf arXiv_CV arXiv_CV Transformer Sparse Pose Deep_Learning Relation Attention PDF
2021-07-08 Calliope -- A Polyphonic Music Transformer Andrea Valenti, Stefano Berti, Davide Bacciu arXiv_SD arXiv_SD Transformer Reconstruction Deep_Learning PDF
2021-07-07 Can Transformer Models Measure Coherence In Text? Re-Thinking the Shuffle Test Philippe Laban, Luke Dai, Lucas Bandarkar, Marti A. Hearst arXiv_CL arXiv_CL Transformer Bert Zero-Shot PDF
2021-07-07 BumbleBee: A Transformer for Music Lucas Fenaux, Maria Juliana Quintero arXiv_SD arXiv_SD Transformer RNN Attention PDF
2021-07-07 LanguageRefer: Spatial-Language Model for 3D Visual Grounding Junha Roh, Karthik Desingh, Ali Farhadi, Dieter Fox arXiv_CV arXiv_CV Transformer Embedding Point_Cloud 3D Bert Pose Language_Model PDF
2021-07-07 Long Short-Term Transformer for Online Action Detection Mingze Xu, Yuanjun Xiong, Hao Chen, Xinyu Li, Wei Xia, Zhuowen Tu, Stefano Soatto arXiv_CV arXiv_CV Transformer Action Detection PDF
2021-07-07 End-to-End Rich Transcription-Style Automatic Speech Recognition with Semi-Supervised Learning Tomohiro Tanaka, Ryo Masumura, Mana Ihori, Akihiko Takashima, Shota Orihashi, Naoki Makishima arXiv_CL arXiv_CL Transformer Recognition Speech Pose Speech_Recognition PDF
2021-07-07 Trans4Trans: Efficient Transformer for Transparent Object Segmentation to Help Visually Impaired People Navigate in the Real World Jiaming Zhang, Kailun Yang, Angela Constantinescu, Kunyu Peng, Karin Müller, Rainer Stiefelhagen arXiv_CV arXiv_CV Transformer Segmentation 3D Pose PDF
2021-07-07 MedGPT: Medical Concept Prediction from Clinical Narratives Zeljko Kraljevic, Anthony Shek, Daniel Bean, Rebecca Bendayan, James Teo, Richard Dobson arXiv_CL arXiv_CL Transformer Recognition RNN Salient Knowledge Attention GAN Medical Prediction PDF
2021-07-07 Learning Vision Transformer with Squeeze and Excitation for Facial Expression Recognition Mouath Aouayeb, Wassim Hamidouche, Catherine Soladie, Kidiyo Kpalma, Renaud Seguier arXiv_CV arXiv_CV Transformer Recognition Pose Attention CNN PDF
2021-07-07 MACCIF-TDNN: Multi aspect aggregation of channel and context interdependence features in TDNN-based speaker verification Fangyuan Wang, Zhigang Song, Hongchen Jiang, Bo Xu arXiv_CL arXiv_CL Transformer Pose PDF
2021-07-07 Efficient Transformer for Direct Speech Translation Belen Alastruey, Gerard I. Gállego, Marta R. Costa-jussà arXiv_CL arXiv_CL Transformer Speech Pose Face CNN PDF
2021-07-07 Transformer Network for Significant Stenosis Detection in CCTA of Coronary Arteries Xinghua Ma, Gongning Luo, Wei Wang, Kuanquan Wang arXiv_CV arXiv_CV Transformer Pose Detection Relation CNN PDF
2021-07-07 SpectralFormer: Rethinking Hyperspectral Image Classification with Transformers Danfeng Hong, Zhu Han, Jing Yao, Lianru Gao, Bing Zhang, Antonio Plaza, Jocelyn Chanussot arXiv_AI arXiv_AI Transformer Embedding Pose Classification CNN Image_Classification PDF
2021-07-07 GLiT: Neural Architecture Search for Global and Local Image Transformer Boyu Chen, Peixia Li, Chuming Li, Baopu Li, Lei Bai, Chen Lin, Ming Sun, Junjie yan, Wanli Ouyang arXiv_CV arXiv_CV Transformer NAS Recognition Pose Classification Relation Image_Classification PDF
2021-07-06 COVID-19 Pneumonia Severity Prediction using Hybrid Convolution-Attention Neural Architectures Nam Nguyen, J. Morris Chang arXiv_CV arXiv_CV Transformer Pose Relation Attention Prediction PDF
2021-07-06 Automatic size and pose homogenization with spatial transformer network to improve and accelerate pediatric segmentation Giammarco La Barbera, Pietro Gori, Haithem Boussaid, Bruno Belucci, Alessandro Delmonte, Jeanne Goulin, Sabine Sarnacki, Laurence Rouet, Isabelle Bloch arXiv_AI arXiv_AI Transformer Segmentation Pose Deep_Learning Detection PDF
2021-07-06 Detecting Hypo-plastic Left Heart Syndrome in Fetal Ultrasound via Disease-specific Atlas Maps Samuel Budd, Matthew Sinclair, Thomas Day, Athanasios Vlontzos, Jeremy Tan, Tianrui Liu, Jaqueline Matthew, Emily Skelton, John Simpson, Reza Razavi, Ben Glocker, Daniel Rueckert, Emma C. Robinson, Bernhard Kainz arXiv_CV arXiv_CV Transformer Segmentation Pose Classification Detection Image_Classification Prediction PDF
2021-07-06 Combining EfficientNet and Vision Transformers for Video Deepfake Detection Davide Coccomini, Nicola Messina, Claudio Gennaro, Fabrizio Falchi arXiv_CV arXiv_CV Transformer Deep_Learning Detection GAN CNN PDF
2021-07-06 Point Cloud Registration using Representative Overlapping Points Lifa Zhu, Dongrui Liu, Changwei Lin, Rui Yan, Francisco Gómez-Fernández, Ninghua Yang, Ziyong Feng arXiv_CV arXiv_CV Transformer Point_Cloud 3D Pose Deep_Learning Matching PDF
2021-07-06 The NiuTrans End-to-End Speech Translation System for IWSLT 2021 Offline Task Chen Xu, Xiaoqian Liu, Xiaowen Liu, Laohu Wang, Canan Huang, Tong Xiao, Jingbo Zhu arXiv_CL arXiv_CL Transformer Speech Prediction PDF
2021-07-06 Learning Disentangled Representation Implicitly via Transformer for Occluded Person Re-Identification Mengxi Jia, Xinhua Cheng, Shijian Lu, Jian Zhang arXiv_CV arXiv_CV Transformer Person_Re-identification Represenation_Learning Pose Relation Re-identification Matching PDF
2021-07-06 Discrete-Valued Neural Communication Dianbo Liu Dianbo_Liu, Alex Lamb, Kenji Kawaguchi, Anirudh Goyal, Chen Sun, Michael Curtis Mozer, Yoshua Bengio arXiv_AI arXiv_AI Transformer Quantization Sparse Pose Deep_Learning GAN PDF
2021-07-06 Feature Fusion Vision Transformer Fine-Grained Visual Categorization Jun Wang, Xiaohan Yu, Yongsheng Gao arXiv_CV arXiv_CV Transformer Recognition Pose Classification Attention PDF
2021-07-05 What Helps Transformers Recognize Conversational Structure? Importance of Context, Punctuation, and Labels in Dialog Act Recognition Piotr Żelasko, Raghavendra Pappagari, Najim Dehak arXiv_CL arXiv_CL Transformer Segmentation Recognition PDF
2021-07-05 Experiments with adversarial attacks on text genres Mikhail Lepekhin, Serge Sharoff arXiv_CL arXiv_CL Transformer Embedding Bert Adversarial Classification Prediction PDF
2021-07-05 Vision Xformers: Efficient Attention for Image Classification Pranav Jeevan, Amit Sethi (Indian Institute of Technology Bombay) arXiv_AI arXiv_AI Transformer Embedding OCR Classification Attention CNN Image_Classification PDF
2021-07-05 Long-Short Transformer: Efficient Transformers for Language and Vision Chen Zhu, Wei Ping, Chaowei Xiao, Mohammad Shoeybi, Tom Goldstein, Anima Anandkumar, Bryan Catanzaro arXiv_CV arXiv_CV Transformer Pose Classification Relation Attention Language_Model PDF
2021-07-05 TransformerFusion: Monocular RGB Scene Reconstruction using Transformers Aljaž Božič, Pablo Palafox, Justus Thies, Angela Dai, Matthias Nießner arXiv_CV arXiv_CV Transformer Reconstruction 3D RNN Face CNN Prediction PDF
2021-07-05 What Makes for Hierarchical Vision Transformer? Yuxin Fang, Xinggang Wang, Rui Wu, Jianwei Niu, Wenyu Liu arXiv_AI arXiv_AI Transformer Recognition Attention PDF
2021-07-05 Test-Time Personalization with a Transformer for Human Pose Estimation Miao Hao, Yizhuo Li, Zonglin Di, Nitesh B. Gundavarapu, Xiaolong Wang arXiv_CV arXiv_CV Transformer Pose_Estimation Self-Supervised Pose PDF
2021-07-05 RATCHET: Medical Transformer for Chest X-ray Diagnosis and Reporting Benjamin Hou, Georgios Kaissis, Ronald Summers, Bernhard Kainz arXiv_CV arXiv_CV Transformer RNN Pose Classification Medical Caption PDF
2021-07-05 DeepRapper: Neural Rap Generation with Rhyme and Rhythm Modeling Lanqing Xue, Kaitao Song, Duocai Wu, Xu Tan, Nevin L. Zhang, Tao Qin, Wei-Qiang Zhang, Tie-Yan Liu arXiv_AI arXiv_AI Transformer Enhancement Knowledge Language_Model PDF
2021-07-04 End-to-end Neural Coreference Resolution Revisited: A Simple yet Effective Baseline Tuan Manh Lai, Trung Bui, Doo Soon Kim arXiv_CL arXiv_CL Transformer Reinforcement_Learning Pose Inference Language_Model PDF
2021-07-04 COVID-VIT: Classification of COVID-19 from CT chest images based on vision transformer models Xiaohong Gao, Yu Qian, Alice Gao arXiv_CV arXiv_CV Transformer 3D Classification Deep_Learning Attention CNN PDF
2021-07-04 Arabic Code-Switching Speech Recognition using Monolingual Data Ahmed Ali, Shammur Chowdhury, Amir Hussein, Yasser Hifny arXiv_CL arXiv_CL Transformer Recognition Speech Speech_Recognition PDF
2021-07-04 Cross-Modal Transformer-Based Neural Correction Models for Automatic Speech Recognition Tomohiro Tanaka, Ryo Masumura, Mana Ihori, Akihiko Takashima, Takafumi Moriya, Takanori Ashihara, Shota Orihashi, Naoki Makishima arXiv_CL arXiv_CL Transformer Recognition Speech Pose Relation Attention Speech_Recognition PDF
2021-07-04 Unified Autoregressive Modeling for Joint End-to-End Multi-Talker Overlapped Speech Recognition and Speaker Attribute Estimation Ryo Masumura, Daiki Okamura, Naoki Makishima, Mana Ihori, Akihiko Takashima, Tomohiro Tanaka, Shota Orihashi arXiv_CL arXiv_CL Transformer Recognition Speech Pose Relation Speech_Recognition PDF
2021-07-04 TENET: A Time-reversal Enhancement Network for Noise-robust ASR Fu-An Chao, Shao-Wei Fan Jiang, Bi-Cheng Yan, Jeih-weih Hung, Berlin Chen arXiv_SD arXiv_SD Transformer Enhancement Recognition Adversarial Speech Deep_Learning Speech_Recognition PDF
2021-07-03 TagRec: Automated Tagging of Questions with Hierarchical Learning Taxonomy Venktesh V, Mukesh Mohania, Vikram Goyal arXiv_CL arXiv_CL Transformer Embedding Pose Face Classification GAN PDF
2021-07-03 Efficient Vision Transformers via Fine-Grained Manifold Distillation Ding Jia, Kai Han, Yunhe Wang, Yehui Tang, Jianyuan Guo, Chao Zhang, Dacheng Tao arXiv_CV arXiv_CV Transformer Knowledge Pose Relation Attention Inference PDF
2021-07-03 Can Transformers Jump Around Right in Natural Language? Assessing Performance Transfer from SCAN Rahma Chaabouni, Roberto Dessì, Eugene Kharitonov arXiv_AI arXiv_AI Transformer PDF
2021-07-02 Relaxed Attention: A Simple Method to Boost Performance of End-to-End Automatic Speech Recognition Timo Lohrenz, Patrick Schwarz, Zhengyang Li, Tim Fingscheidt arXiv_CL arXiv_CL Transformer Recognition Speech Attention Speech_Recognition Language_Model PDF
2021-07-02 Dual Causal/Non-Causal Self-Attention for Streaming End-to-End Speech Recognition Niko Moritz, Takaaki Hori, Jonathan Le Roux arXiv_SD arXiv_SD Transformer Recognition Speech Pose Attention Speech_Recognition PDF
2021-07-02 Visual Relationship Forecasting in Videos Li Mi, Yangjun Ou, Zhenzhong Chen arXiv_AI arXiv_AI Transformer Action Relation Visual_Relation CNN Prediction PDF
2021-07-02 Ultrasound Video Transformers for Cardiac Ejection Fraction Estimation Hadrien Reynaud, Athanasios Vlontzos, Benjamin Hou, Arian Beqiri, Paul Leeson, Bernhard Kainz arXiv_CV arXiv_CV Transformer Segmentation Bert Pose Action Classification Detection PDF
2021-07-02 R2D2: Recursive Transformer based on Differentiable Tree for Interpretable Hierarchical Language Modeling Xiang Hu, Haitao Mi, Zujie Wen, Yafang Wang, Yi Su, Jing Zheng, Gerard de Melo arXiv_CL arXiv_CL Transformer Unsupervised Pose Action Language_Model PDF
2021-07-02 A Novel Deep Reinforcement Learning Based Stock Direction Prediction using Knowledge Graph and Community Aware Sentiments Anil Berk Altuner, Zeynep Hilal Kilimci arXiv_AI arXiv_AI Transformer Reinforcement_Learning Bert Knowledge Knowledge_Graph Pose Relation Sentiment Prediction PDF
2021-07-02 Learned Token Pruning for Transformers Sehoon Kim, Sheng Shen, David Thorsley, Amir Gholami, Joseph Hassoun, Kurt Keutzer arXiv_CL arXiv_CL Transformer Attention Inference PDF
2021-07-02 Cross-view Geo-localization with Evolving Transformer Hongji Yang, Xiufan Lu, Yingying Zhu arXiv_CV arXiv_CV Transformer Embedding Knowledge Pose Relation Attention Matching PDF
2021-07-02 1st Place Solutions for UG2+ Challenge 2021 -- supervised Face detection in the low light condition Pengcheng Wang, Lingqiao Ji, Zhilong Ji, Yuan Gao, Xiao Liu arXiv_CV arXiv_CV Transformer Face_Detection Enhancement Image_Enhancement Face Detection Object_Detection PDF
2021-07-02 Transformer-F: A Transformer network with effective methods for learning universal sentence representation Yu Shi arXiv_CL arXiv_CL Transformer Text_Classification Speech Pose Action Classification Relation Attention PDF
2021-07-02 Target-dependent UNITER: A Transformer-Based Multimodal Language Comprehension Model for Domestic Service Robots Shintaro Ishikawa, Komei Sugiura arXiv_CV arXiv_CV Transformer Pose Classification Relation PDF
2021-07-02 Case Relation Transformer: A Crossmodal Language Generation Model for Fetching Instructions Motonari Kambara, Komei Sugiura arXiv_CV arXiv_CV Transformer Pose Relation PDF
2021-07-02 UTNet: A Hybrid Transformer Architecture for Medical Image Segmentation Yunhe Gao, Mu Zhou, Dimitris Metaxas arXiv_CV arXiv_CV Transformer Segmentation Pose Attention Medical CNN PDF
2021-07-01 CSWin Transformer: A General Vision Transformer Backbone with Cross-Shaped Windows Xiaoyi Dong, Jianmin Bao, Dongdong Chen, Weiming Zhang, Nenghai Yu, Lu Yuan, Dong Chen, Baining Guo arXiv_CV arXiv_CV Transformer Segmentation Semantic_Segmentation Pose Action Detection Attention PDF
2021-07-01 AutoFormer: Searching Transformers for Visual Recognition Minghao Chen, Houwen Peng, Jianlong Fu, Haibin Ling arXiv_CV arXiv_CV Transformer NAS Embedding Recognition Pose Classification Detection Image_Classification PDF
2021-07-01 CLIP-It! Language-Guided Video Summarization Medhini Narasimhan, Anna Rohrbach, Trevor Darrell arXiv_AI arXiv_AI Transformer Unsupervised Video_Caption Salient Pose Relation Summarization Caption Language_Model PDF
2021-07-01 Global Filter Networks for Image Classification Yongming Rao, Wenliang Zhao, Zheng Zhu, Jiwen Lu, Jie Zhou arXiv_AI arXiv_AI Transformer Action Classification Attention Image_Classification PDF
2021-07-01 Stabilizing Deep Q-Learning with ConvNets and Vision Transformers under Data Augmentation Nicklas Hansen, Hao Su, Xiaolong Wang arXiv_CV arXiv_CV Transformer Reinforcement_Learning Pose PDF
2021-07-01 Focal Self-attention for Local-Global Interactions in Vision Transformers Jianwei Yang, Chunyuan Li, Pengchuan Zhang, Xiyang Dai, Bin Xiao, Lu Yuan, Jianfeng Gao arXiv_AI arXiv_AI Transformer Segmentation Semantic_Segmentation Pose Action Classification Detection Object_Detection Attention Image_Classification PDF
2021-07-01 Action Transformer: A Self-Attention Model for Short-Time Human Action Recognition Vittorio Mazzia, Simone Angarano, Francesco Salvetti, Federico Angelini, Marcello Chiaberge arXiv_CV arXiv_CV Transformer Recognition Pose Action_Recognition Action Attention CNN PDF
2021-07-01 Multimodal Graph-based Transformer Framework for Biomedical Relation Extraction Sriram Pingali, Shweta Yadav, Pratik Dutta, Sriparna Saha arXiv_CL arXiv_CL Transformer Bert Knowledge Pose Action Relation Relation_Extraction Medical PDF
2021-07-01 TransSC: Transformer-based Shape Completion for Grasp Evaluation Wenkai Chen, Hongzhuo Liang, Zhaopeng Chen, Fuchun Sun, Jianwei Zhang arXiv_RO arXiv_RO Transformer Point_Cloud Sparse Pose Face Quantitative PDF
2021-07-01 VideoLightFormer: Lightweight Action Recognition using Transformers Raivo Koot, Haiping Lu arXiv_CV arXiv_CV Transformer Recognition Pose Action_Recognition Action CNN PDF
2021-07-01 What do End-to-End Speech Models Learn about Speaker, Language and Channel Information? A Layer-wise and Neuron-level Analysis Shammur Absar Chowdhury, Nadir Durrani, Ahmed Ali arXiv_CL arXiv_CL Transformer Reconstruction Recognition Salient Knowledge Speech PDF
2021-07-01 CBNetV2: A Composite Backbone Network Architecture for Object Detection Tingting Liang, Xiaojie Chu, Yudong Liu, Yongtao Wang, Zhi Tang, Wei Chu, Jingdong Chen, Haibing Ling arXiv_CV arXiv_CV Transformer Pose Detection Object_Detection PDF
2021-07-01 GlyphCRM: Bidirectional Encoder Representation for Chinese Character with its Glyph Yunxin Li, Yu Zhao, Baotian Hu, Qingcai Chen, Yang Xiang, Xiaolong Wang, Yuxin Ding, Lin Ma arXiv_AI arXiv_AI Transformer Embedding Bert Pose CNN PDF
2021-07-01 Egocentric Image Captioning for Privacy-Preserved Passive Dietary Intake Monitoring Jianing Qiu, Frank P.-W. Lo, Xiao Gu, Modou L. Jobarteh, Wenyan Jia, Tom Baranowski, Matilda Steiner-Asiedu, Alex K. Anderson, Megan A McCrory, Edward Sazonov, Mingui Sun, Gary Frost, Benny Lo arXiv_CV arXiv_CV Image_Caption Transformer Recognition Knowledge Pose Caption PDF
2021-07-01 E-DSSR: Efficient Dynamic Surgical Scene Reconstruction with Transformer-based Stereoscopic Depth Perception Yonghao Long, Zhaoshuo Li, Chi Hang Yee, Chi Fai Ng, Russell H. Taylor, Mathias Unberath, Qi Dou arXiv_AI arXiv_AI Transformer Reconstruction Pose PDF
2021-07-01 Word-Free Spoken Language Understanding for Mandarin-Chinese Zhiyuan Guo, Yuexin Li, Guo Chen, Xingyu Chen, Akshat Gupta arXiv_CL arXiv_CL Transformer Recognition Speech Pose Classification Speech_Recognition Language_Model PDF
2021-06-30 Attention Bottlenecks for Multimodal Fusion Arsha Nagrani, Shan Yang, Anurag Arnab, Aren Jansen, Cordelia Schmid, Chen Sun arXiv_CV arXiv_CV Transformer Classification Attention Prediction Video_Classification PDF
2021-06-30 On the Power of Saturated Transformers: A View from Circuit Complexity William Merrill, Yoav Goldberg, Roy Schwartz, Noah A. Smith arXiv_CL arXiv_CL Transformer Attention PDF
2021-06-30 Small in-distribution changes in 3D perspective and lighting fool both CNNs and Transformers Spandan Madan, Tomotake Sasaki, Tzu-Mao Li, Xavier Boix, Hanspeter Pfister arXiv_CV arXiv_CV Transformer 3D Classification PDF
2021-06-30 Early Risk Detection of Pathological Gambling, Self-Harm and Depression Using BERT Ana-Maria Bucur, Adrian Cosma, Liviu P. Dinu arXiv_CL arXiv_CL Transformer Bert Detection PDF
2021-06-30 A Generative Model for Raw Audio Using Transformer Architectures Prateek Verma, Chris Chafe arXiv_AI arXiv_AI Transformer Pose Attention Prediction PDF
2021-06-30 ResViT: Residual vision transformers for multi-modal medical image synthesis Onat Dalmaz, Mahmut Yurt, Tolga Çukur arXiv_CV arXiv_CV Transformer Adversarial Pose Quantitative Attention GAN Medical CNN PDF
2021-06-30 MissFormer: attention-based handling of missing observations for trajectory filtering and prediction Stefan Becker, Ronny Hug, Wolfgang Hübner, Michael Arens, Brendan T. Morris arXiv_CV arXiv_CV Transformer Tracking Object_Tracking Deep_Learning Attention Inference Prediction PDF
2021-06-30 Improving the Efficiency of Transformers for Resource-Constrained Devices Hamid Tabani, Ajay Balasubramaniam, Shabbir Marzban, Elahe Arani, Bahram Zonooz arXiv_CV arXiv_CV Transformer Pose PDF
2021-06-30 Augmented Shortcuts for Vision Transformers Yehui Tang, Kai Han, Chang Xu, An Xiao, Yiping Deng, Chao Xu, Yunhe Wang arXiv_CV arXiv_CV Transformer Pose Relation PDF
2021-06-30 Dual Aspect Self-Attention based on Transformer for Remaining Useful Life Prediction Zhizheng Zhang, Wen Song, Qiqiang Li arXiv_AI arXiv_AI Transformer Pose Action Deep_Learning Attention Prediction PDF
2021-06-29 Looking Outside the Window: Wider-Context Transformer for the Semantic Segmentation of High-Resolution Remote Sensing Images Lei Ding, Dong Lin, Shaofu Lin, Jing Zhang, Xiaojie Cui, Yuebin Wang, Hao Tang, Lorenzo Bruzzone arXiv_CV arXiv_CV Transformer Segmentation Semantic_Segmentation Pose Action Relation PDF
2021-06-29 Unified Questioner Transformer for Descriptive Question Generation in Goal-Oriented Visual Dialogue Shoya Matsumori, Kosuke Shingyouchi, Yuki Abe, Yosuke Fukuchi, Komei Sugiura, Michita Imai arXiv_CV arXiv_CV Transformer Pose Quantitative Attention PDF
2021-06-29 Fact Check: Analyzing Financial Events from Multilingual News Sources Yang Linyi, Ng Tin Lok James, Smyth Barry, Dong Ruihai arXiv_AI arXiv_AI Transformer Unsupervised Pose Face Deep_Learning PDF
2021-06-29 Rethinking the Evaluation of Neural Machine Translation Jianhao Yan, Chenming Wu, Fandong Meng, Jie Zhou arXiv_AI arXiv_AI Transformer Pose PDF
2021-06-29 N-Singer: A Non-Autoregressive Korean Singing Voice Synthesis System for Pronunciation Enhancement Gyeong-Hoon Lee, Tae-Woo Kim, Hanbin Bae, Min-Ji Lee, Young-Ik Kim, Hoon-Young Cho arXiv_SD arXiv_SD Transformer Enhancement Adversarial Pose CNN PDF
2021-06-29 Multi-Exit Vision Transformer for Dynamic Inference Arian Bakhtiarnia, Qi Zhang, Alexandros Iosifidis arXiv_CV arXiv_CV Transformer Pose Classification Inference PDF
2021-06-29 FastPitchFormant: Source-filter based Decomposed Modeling for Speech Synthesis Taejun Bak, Jae-Sung Bae, Hanbin Bae, Young-Ik Kim, Hoon-Young Cho arXiv_SD arXiv_SD Transformer Speech Pose Relation PDF
2021-06-29 An Efficient Cervical Whole Slide Image Analysis Framework Based on Multi-scale Semantic and Spatial Features using Deep Learning Ziquan Wei, Shenghua Cheng, Xiuli Liu, Shaoqun Zeng arXiv_CV arXiv_CV Transformer Sparse Pose Classification Deep_Learning Prediction PDF
2021-06-29 Packing: Towards 2x NLP BERT Acceleration Matej Kosec, Sheng Fu, Mario Michael Krell arXiv_CL arXiv_CL Transformer Bert Attention PDF
2021-06-28 Rethinking Token-Mixing MLP for MLP-based Vision Backbone Tan Yu, Xu Li, Yunfeng Cai, Mingming Sun, Ping Li arXiv_CV arXiv_CV Transformer Pose Classification CNN PDF
2021-06-28 Early Convolutions Help Transformers See Better Tete Xiao, Mannat Singh, Eric Mintun, Trevor Darrell, Piotr Dollár, Ross Girshick arXiv_CV arXiv_CV Transformer Optimization CNN PDF
2021-06-28 TENT: Tensorized Encoder Transformer for Temperature Forecasting Onur Bilgin, Paweł Mąka, Thomas Vergutz, Siamak Mehrkanoon arXiv_AI arXiv_AI Transformer 3D Knowledge Pose Attention CNN Prediction PDF
2021-06-28 Feature Combination Meets Attention: Baidu Soccer Embeddings and Transformer based Temporal Detection Xin Zhou, Le Kang, Zhiyu Cheng, Bo He, Jingyu Xin arXiv_AI arXiv_AI Transformer Embedding Recognition Video_Caption Action_Recognition Action Detection Attention Activity PDF
2021-06-28 A Knowledge-Grounded Dialog System Based on Pre-Trained Language Models Weijie Zhang, Jiaoxuan Chen, Haipang Wu, Sanhui Wan, Gongfeng Li arXiv_CL arXiv_CL Transformer Transfer_Learning Knowledge Language_Model Matching PDF
2021-06-28 Efficient Dialogue State Tracking by Masked Hierarchical Transformer Min Mao, Jiasheng Liu, Jingyao Zhou, Haipang Wu arXiv_CL arXiv_CL Transformer Tracking Pose Classification PDF
2021-06-28 Multi-Compound Transformer for Accurate Biomedical Image Segmentation Yuanfeng Ji, Ruimao Zhang, Huijie Wang, Zhen Li, Lingyun Wu, Shaoting Zhang, Ping Luo arXiv_CV arXiv_CV Transformer Segmentation Embedding Enhancement Action Classification Relation Attention Medical CNN Image_Classification PDF
2021-06-27 Power Law Graph Transformer for Machine Translation and Representation Learning Burc Gokden arXiv_AI arXiv_AI Transformer Quantization Represenation_Learning Attention Prediction PDF
2021-06-27 MTrans: Multi-Modal Transformer for Accelerated MR Imaging Chun-Mei Feng, Yunlu Yan, Geng Chen, Huazhu Fu, Yong Xu, Ling Shao arXiv_CV arXiv_CV Transformer Knowledge Pose Attention CNN PDF
2021-06-27 Post-Training Quantization for Vision Transformer Zhenhua Liu, Yunhe Wang, Kai Han, Siwei Ma, Wen Gao arXiv_CV arXiv_CV Transformer Quantization Pose Relation Attention CNN PDF
2021-06-27 SymbolicGPT: A Generative Transformer Model for Symbolic Regression Mojtaba Valipour, Bowen You, Maysum Panju, Ali Ghodsi arXiv_CL arXiv_CL Transformer Deep_Learning Language_Model PDF
2021-06-27 Graph Convolutional Memory for Deep Reinforcement Learning Steven D. Morad, Stephan Liwicki, Amanda Prorok arXiv_AI arXiv_AI Transformer Reinforcement_Learning 3D RNN Knowledge Knowledge_Graph CNN PDF
2021-06-26 An Image Classifier Can Suffice Video Understanding Quanfu Fan, Chun-Fu (Richard) Chen, Rameswar Panda arXiv_CV arXiv_CV Transformer Recognition Video_Caption Pose Action_Recognition Action PDF
2021-06-26 OffRoadTranSeg: Semi-Supervised Segmentation using Transformers on OffRoad environments Anukriti Singh, Kartikeya Singh, P.B. Sujit arXiv_CV arXiv_CV Transformer Segmentation 3D Self-Supervised Pose Autonomous PDF
2021-06-25 Transflower: probabilistic autoregressive dance generation with multimodal attention Guillermo Valle-Pérez, Gustav Eje Henter, Jonas Beskow, André Holzapfel, Pierre-Yves Oudeyer, Simon Alexanderson arXiv_SD arXiv_SD Transformer 3D Pose Attention PDF
2021-06-25 PVTv2: Improved Baselines with Pyramid Vision Transformer Wenhai Wang, Enze Xie, Xiang Li, Deng-Ping Fan, Kaitao Song, Ding Liang, Tong Lu, Ping Luo, Ling Shao arXiv_CV arXiv_CV Transformer Segmentation Classification Detection Attention PDF
2021-06-25 Privileged Zero-Shot AutoML Nikhil Singh, Brandon Kates, Jeff Mentch, Anant Kharkar, Madeleine Udell, Iddo Drori arXiv_CL arXiv_CL Transformer Embedding Unsupervised Zero-Shot Represenation_Learning Classification Prediction PDF
2021-06-25 Vision Transformer Architecture Search Xiu Su, Shan You, Jiyang Xie, Mingkai Zheng, Fei Wang, Chen Qian, Changshui Zhang, Xiaogang Wang, Chang Xu arXiv_CV arXiv_CV Transformer NAS Embedding Pose Attention PDF
2021-06-25 Shape registration in the time of transformers Giovanni Trappolini, Luca Cosmo, Luca Moschella, Riccardo Marin, Emanuele Rodolà arXiv_CV arXiv_CV Transformer Point_Cloud 3D Sparse Pose Face Quantitative Matching PDF
2021-06-25 Exploring the Representation of Word Meanings in Context: A Case Study on Homonymy and Synonymy Marcos Garcia arXiv_CL arXiv_CL Transformer Relation PDF
2021-06-25 Probing Inter-modality: Visual Parsing with Self-Attention for Vision-Language Pre-training Hongwei Xue, Yupan Huang, Bei Liu, Houwen Peng, Jianlong Fu, Houqiang Li, Jiebo Luo arXiv_CV arXiv_CV Image_Caption Transformer Embedding Optimization Knowledge Pose Action Relation VQA Attention Visual_Relation QA PDF
2021-06-25 A Picture May Be Worth a Hundred Words for Visual Question Answering Yusuke Hirota, Noa Garcia, Mayu Otani, Chenhui Chu, Yuta Nakashima, Ittetsu Taniguchi, Takao Onoye arXiv_CV arXiv_CV Image_Caption Transformer Pose VQA Language_Model QA PDF
2021-06-25 NP-DRAW: A Non-Parametric Structured Latent Variable Modelfor Image Generation Xiaohui Zeng, Raquel Urtasun, Richard Zemel, Sanja Fidler, Renjie Liao arXiv_CV arXiv_CV Transformer RNN Pose PDF
2021-06-25 To the Point: Efficient 3D Object Detection in the Range Image with Graph Convolution Kernels Yuning Chai, Pei Sun, Jiquan Ngiam, Weiyue Wang, Benjamin Caine, Vijay Vasudevan, Xiao Zhang, Dragomir Anguelov arXiv_CV arXiv_CV Transformer 3D Pose Detection Object_Detection CNN PDF
2021-06-24 You are AllSet: A Multiset Function Framework for Hypergraph Neural Networks Eli Chien, Chao Pan, Jianhao Peng, Olgica Milenkovic arXiv_AI arXiv_AI Transformer Pose Action Classification Deep_Learning PDF
2021-06-24 Video Swin Transformer Ze Liu, Jia Ning, Yue Cao, Yixuan Wei, Zheng Zhang, Stephen Lin, Han Hu arXiv_AI arXiv_AI Transformer Recognition Pose Action_Recognition Action Attention PDF
2021-06-24 Exploring Corruption Robustness: Inductive Biases in Vision Transformers and MLP-Mixers Katelyn Morrison, Benjamin Gilby, Colton Lipchak, Adam Mattioli, Adriana Kovashka arXiv_CV arXiv_CV Transformer Pose Attention CNN PDF
2021-06-24 VOLO: Vision Outlooker for Visual Recognition Li Yuan, Qibin Hou, Zihang Jiang, Jiashi Feng, Shuicheng Yan arXiv_CV arXiv_CV Transformer Segmentation Recognition Classification Attention CNN PDF
2021-06-24 Pre-training transformer-based framework on large-scale pediatric claims data for downstream population-specific tasks Xianlong Zeng, Simon Lin, Chang Liu arXiv_AI arXiv_AI Transformer Knowledge Deep_Learning Medical Prediction PDF
2021-06-24 A Transformer-based Cross-modal Fusion Model with Adversarial Training for VQA Challenge 2021 Ke-Han Lu, Bo-Han Fang, Kuan-Yu Chen arXiv_CV arXiv_CV Transformer Adversarial Pose VQA QA PDF
2021-06-24 Exploring Stronger Feature for Temporal Action Localization Zhiwu Qing, Xiang Wang, Ziyuan Huang, Yutong Feng, Shiwei Zhang, jianwen Jiang, Mingqian Tang, Changxin Gao, Nong Sang arXiv_CV arXiv_CV Transformer Action_Localization Action Classification Detection PDF
2021-06-24 Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecasting Haixu Wu, Jiehui Xu, Jianmin Wang, Mingsheng Long arXiv_AI arXiv_AI Transformer Sparse Pose Relation Attention PDF
2021-06-24 AIT-QA: Question Answering Dataset over Complex Tables in the Airline Industry Yannis Katsis, Saneem Chemmengath, Vishwajeet Kumar, Samarth Bharadwaj, Mustafa Canim, Michael Glass, Alfio Gliozzo, Feifei Pan, Jaydeep Sen, Karthik Sankaranarayanan, Soumen Chakrabarti arXiv_AI arXiv_AI Transformer Bert Zero-Shot Pose Relation QA PDF
2021-06-24 Unsupervised Deep Image Stitching: Reconstructing Stitched Features to Images Lang Nie, Chunyu Lin, Kang Liao, Shuaicheng Liu, Yao Zhao arXiv_CV arXiv_CV Transformer Reconstruction Unsupervised Pose Detection PDF
2021-06-24 Towards Automatic Speech to Sign Language Generation Parul Kapoor, Rudrabha Mukhopadhyay, Sindhu B Hegde, Vinay Namboodiri, C V Jawahar arXiv_CV arXiv_CV Transformer Speech Pose PDF
2021-06-24 Bidding via Clustering Ads Intentions: an Efficient Search Engine Marketing System for E-commerce Cheng Jie, Da Xu, Zigeng Wang, Lu Wang, Wei Shen arXiv_CL arXiv_CL Transformer Optimization Knowledge Face Relation Prediction PDF
2021-06-23 Charformer: Fast Character Transformers via Gradient-based Subword Tokenization Yi Tay, Vinh Q. Tran, Sebastian Ruder, Jai Gupta, Hyung Won Chung, Dara Bahri, Zhen Qin, Simon Baumgartner, Cong Yu, Donald Metzler arXiv_AI arXiv_AI Transformer Pose PDF
2021-06-23 Transformer-based unsupervised patient representation learning based on medical claims for risk stratification and analysis Xianlong Zeng, Simon Lin, Chang Liu arXiv_AI arXiv_AI Transformer Embedding Unsupervised Represenation_Learning Medical PDF
2021-06-23 IA-RED$^2$: Interpretability-Aware Redundancy Reduction for Vision Transformers Bowen Pan, Yifan Jiang, Rameswar Panda, Zhangyang Wang, Rogerio Feris, Aude Oliva arXiv_CV arXiv_CV Transformer Quantitative Attention PDF
2021-06-23 Dealing with training and test segmentation mismatch: FBK@IWSLT2021 Sara Papi, Marco Gaido, Matteo Negri, Marco Turchi arXiv_CL arXiv_CL Transformer Segmentation Knowledge Speech Pose Detection Activity Inference PDF
2021-06-23 Stable, Fast and Accurate: Kernelized Attention with Relative Positional Encoding Shengjie Luo, Shanda Li, Tianle Cai, Di He, Dinglan Peng, Shuxin Zheng, Guolin Ke, Liwei Wang, Tie-Yan Liu arXiv_CL arXiv_CL Transformer Optimization Pose Attention PDF
2021-06-23 BERT-based Multi-Task Model for Country and Province Level Modern Standard Arabic and Dialectal Arabic Identification Abdellah El Mekki, Abdelkader El Mahdaouy, Kabil Essefar, Nabil El Mamoun, Ismail Berrada, Ahmed Khoumsi arXiv_CL arXiv_CL Transformer Bert Deep_Learning Attention PDF
2021-06-23 Deep Multi-Task Model for Sarcasm Detection and Sentiment Analysis in Arabic Language Abdelkader El Mahdaouy, Abdellah El Mekki, Kabil Essefar, Nabil El Mamoun, Ismail Berrada, Ahmed Khoumsi arXiv_CL arXiv_CL Transformer Bert Knowledge Pose Action Detection Sentiment Attention PDF
2021-06-23 Transformer Meets Convolution: A Bilateral Awareness Net-work for Semantic Segmentation of Very Fine Resolution Ur-ban Scene Images Libo Wang, Rui Li, Dongzhi Wang, Chenxi Duan, Teng Wang, Xiaoliang Meng arXiv_CV arXiv_CV Transformer Segmentation Semantic_Segmentation Pose Classification Deep_Learning Relation Attention Autonomous PDF
2021-06-23 Co-advise: Cross Inductive Bias Distillation Sucheng Ren, Zhengqi Gao, Tianyu Hua, Zihui Xue, Yonglong Tian, Shengfeng He, Hang Zhao arXiv_CV arXiv_CV Transformer Knowledge Pose PDF
2021-06-23 Vision Permutator: A Permutable MLP-Like Architecture for Visual Recognition Qibin Hou, Zihang Jiang, Li Yuan, Ming-Ming Cheng, Shuicheng Yan, Jiashi Feng arXiv_CV arXiv_CV Transformer Recognition Attention CNN PDF
2021-06-23 Instance-based Vision Transformer for Subtyping of Papillary Renal Cell Carcinoma in Histopathological Image Zeyu Gao, Bangyang Hong, Xianli Zhang, Yang Li, Chang Jia, Jialun Wu, Chunbao Wang, Deyu Meng, Chen Li arXiv_CV arXiv_CV Transformer Embedding Pose Classification Attention PDF
2021-06-23 Deformed2Self: Self-Supervised Denoising for Dynamic Medical Imaging Junshen Xu, Elfar Adalsteinsson arXiv_CV arXiv_CV Transformer Unsupervised Self-Supervised Pose Deep_Learning Relation Denoising Medical Inference PDF
2021-06-23 Probabilistic Attention for Interactive Segmentation Prasad Gabbur, Manjot Bilkhu, Javier Movellan arXiv_AI arXiv_AI Transformer Segmentation Semantic_Segmentation Pose Attention Inference PDF
2021-06-23 LegoFormer: Transformers for Block-by-Block Multi-view 3D Reconstruction Farid Yagubbayli, Alessio Tonioni, Federico Tombari arXiv_CV arXiv_CV Transformer Reconstruction 3D RNN Pose Deep_Learning Attention Prediction PDF
2021-06-22 Team PyKale Submission to the EPIC-Kitchens 2021 Unsupervised Domain Adaptation Challenge for Action Recognition Xianyuan Liu, Raivo Koot, Shuo Zhou, Tao Lei, Haiping Lu arXiv_CV arXiv_CV Transformer Unsupervised Recognition Adversarial Action_Recognition Action Attention PDF
2021-06-22 P2T: Pyramid Pooling Transformer for Scene Understanding Yu-Huan Wu, Yun Liu, Xin Zhan, Ming-Ming Cheng arXiv_CV arXiv_CV Transformer Segmentation Semantic_Segmentation Salient Pose Action Classification Detection Object_Detection Attention Image_Classification PDF
2021-06-22 Residual Networks as Flows of Velocity Fields for Diffeomorphic Time Series Alignment Hao Huang, Boulbaba Ben Amor, Xichan Lin, Fan Zhu, Yi Fang arXiv_CV arXiv_CV Transformer 3D Pose Action Classification GAN Activity PDF
2021-06-22 A Latent Transformer for Disentangled and Identity-Preserving Face Editing Xu Yao, Alasdair Newson, Yann Gousseau, Pierre Hellier arXiv_CV arXiv_CV Transformer Pose Face Quantitative GAN PDF
2021-06-22 A Comparison for Patch-level Classification of Deep Learning Methods on Transparent Images: from Convolutional Neural Networks to Visual Transformers Hechen Yang, Chen Li, Peng Zhao, Ao Chen, Xin Zhao, Marcin Grzegorzek arXiv_CV arXiv_CV Transformer Classification Deep_Learning CNN PDF
2021-06-22 DocFormer: End-to-End Transformer for Document Understanding Srikar Appalaraju, Bhavan Jasani, Bhargava Urala Kota, Yusheng Xie, R. Manmatha arXiv_CV arXiv_CV Transformer Embedding Unsupervised Action Attention PDF
2021-06-22 Key-Sparse Transformer with Cascaded Cross-Attention Block for Multimodal Speech Emotion Recognition Weidong Chen, Xiaofeng Xing, Xiangmin Xu, Jichen Yang, Jianxin Pang arXiv_SD arXiv_SD Transformer Recognition Sparse Speech Pose Emotion Action Attention PDF
2021-06-22 Fine-tune the Entire RAG Architecture for Question-Answering Shamane Siriwardhana, Rivindu Weerasekera, Elliott Wen, Suranga Nanayakkara arXiv_CL arXiv_CL Transformer Face PDF
2021-06-22 A Comprehensive Exploration of Pre-training Language Models Tong Guo arXiv_CL arXiv_CL Transformer Bert RNN Language_Model PDF
2021-06-21 MODETR: Moving Object Detection with Transformers Eslam Mohamed, Ahmad El-Sallab arXiv_CV arXiv_CV Transformer Pose Detection Relation Object_Detection Attention CNN Autonomous Optical_Flow Prediction PDF
2021-06-21 Spatio-Temporal Multi-Task Learning Transformer for Joint Moving Object Detection and Segmentation Eslam Mohamed, Ahmed El-Sallab arXiv_CV arXiv_CV Transformer Segmentation Pose Detection Object_Detection Autonomous PDF
2021-06-21 Towards Long-Form Video Understanding Chao-Yuan Wu, Philipp Krähenbühl arXiv_CV arXiv_CV Transformer Recognition Video_Caption PDF
2021-06-21 OadTR: Online Action Detection with Transformers Xiang Wang, Shiwei Zhang, Zhiwu Qing, Yuanjie Shao, Zhengrong Zuo, Changxin Gao, Nong Sang arXiv_CV arXiv_CV Transformer RNN Pose Action Detection Relation Inference PDF
2021-06-21 TCIC: Theme Concepts Learning Cross Language and Vision for Image Captioning Zhihao Fan, Zhongyu Wei, Siyuan Wang, Ruize Wang, Zejun Li, Haijun Shan, Xuanjing Huang arXiv_CV arXiv_CV Image_Caption Transformer Represenation_Learning Pose Relation Caption PDF
2021-06-21 Ad Text Classification with Transformer-Based Natural Language Processing Methods Umut Özdil, Büşra Arslan, D. Emre Taşar, Gökçe Polat, Şükrü Ozan arXiv_CL arXiv_CL Transformer Bert Text_Classification Pose Classification Language_Model PDF
2021-06-20 Solution for Large-scale Long-tailed Recognition with Noisy Labels Yuqiao Xian, Jia-Xin Zhuang, Fufu Yu arXiv_AI arXiv_AI Transformer Recognition Pose Classification PDF
2021-06-20 More than Encoder: Introducing Transformer Decoder to Upsample Yijiang Li, Wentian Cai, Ying Gao, Xiping Hu arXiv_CV arXiv_CV Transformer Reconstruction Segmentation Pose Attention Prediction PDF
2021-06-20 Do Encoder Representations of Generative Dialogue Models Encode Sufficient Information about the Task ? Prasanna Parthasarathi, Joelle Pineau, Sarath Chandar arXiv_CL arXiv_CL Transformer RNN Pose Text_Generation PDF
2021-06-19 Exploring Vision Transformers for Fine-grained Classification Marcos V. Conde, Kerem Turgutlu arXiv_CV arXiv_CV Transformer Recognition Pose Classification Attention Image_Classification PDF
2021-06-19 JointGT: Graph-Text Joint Representation Learning for Text Generation from Knowledge Graphs Pei Ke, Haozhe Ji, Yu Ran, Xin Cui, Liwei Wang, Linfeng Song, Xiaoyan Zhu, Minlie Huang arXiv_AI arXiv_AI Transformer Reconstruction Embedding Represenation_Learning Knowledge Knowledge_Graph Pose Text_Generation PDF
2021-06-19 Transformers for Headline Selection for Russian News Clusters Pavel Voropaev, Olga Sopilnyak arXiv_CL arXiv_CL Transformer Embedding PDF
2021-06-19 Improving Compositional Generalization in Classification Tasks via Structure Annotations Juyong Kim, Pradeep Ravikumar, Joshua Ainslie, Santiago Ontañón arXiv_CL arXiv_CL Transformer Classification Attention PDF
2021-06-18 Multi-Task Learning for User Engagement and Adoption in Live Video Streaming Events Stefanos Antaris, Dimitrios Rafailidis, Romina Arriaza arXiv_AI arXiv_AI Transformer Reinforcement_Learning Pose Action PDF
2021-06-18 End-to-end Temporal Action Detection with Transformer Xiaolong Liu, Qimeng Wang, Yao Hu, Xu Tang, Song Bai, Xiang Bai arXiv_CV arXiv_CV Transformer Video_Caption Action Detection Object_Detection Activity Prediction PDF
2021-06-18 How to train your ViT? Data, Augmentation, and Regularization in Vision Transformers Andreas Steiner, Alexander Kolesnikov, Xiaohua Zhai, Ross Wightman, Jakob Uszkoreit, Lucas Beyer arXiv_AI arXiv_AI Transformer Segmentation Regularization Classification Detection Object_Detection CNN Image_Classification PDF
2021-06-18 BitFit: Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-models Elad Ben Zaken, Shauli Ravfogel, Yoav Goldberg arXiv_CL arXiv_CL Transformer Bert Sparse Knowledge PDF
2021-06-18 All You Can Embed: Natural Language based Vehicle Retrieval with Spatio-Temporal Transformers Carmelo Scribano, Davide Sapienza, Giorgia Franchini, Micaela Verucchi, Marko Bertogna arXiv_CV arXiv_CV Transformer Embedding Tracking Bert Pose CNN PDF
2021-06-18 Recurrent Stacking of Layers in Neural Networks: An Application to Neural Machine Translation Raj Dabre, Atsushi Fujita arXiv_CL arXiv_CL Transformer Transfer_Learning Knowledge Pose NMT Attention CNN Prediction PDF
2021-06-18 SPBERT: Pre-training BERT on SPARQL Queries for End-to-end Question Answering over Knowledge Graphs Hieu Tran, Long Phan, Truong-Son Nguyen arXiv_CL arXiv_CL Transformer Bert Knowledge Knowledge_Graph Pose Language_Model QA PDF
2021-06-18 A Neural Edge-Editing Approach for Document-Level Relation Graph Extraction Kohei Makino, Makoto Miwa, Yutaka Sasaki arXiv_CL arXiv_CL Transformer Pose Action Relation CNN PDF
2021-06-18 An Improved Single Step Non-autoregressive Transformer for Automatic Speech Recognition Ruchao Fan, Wei Chu, Peng Chang, Jing Xiao, Abeer Alwan arXiv_AI arXiv_AI Transformer Embedding Recognition Speech Pose Relation Attention Speech_Recognition Inference Language_Model PDF
2021-06-17 Efficient Self-supervised Vision Transformers for Representation Learning Chunyuan Li, Jianwei Yang, Pengchuan Zhang, Mei Gao, Bin Xiao, Xiyang Dai, Lu Yuan, Jianfeng Gao arXiv_AI arXiv_AI Transformer Sparse Represenation_Learning Self-Supervised Pose Classification Attention Matching PDF
2021-06-17 Multi-mode Transformer Transducer with Stochastic Future Context Kwangyoun Kim, Felix Wu, Prashant Sridhar, Kyu J. Han, Shinji Watanabe arXiv_CL arXiv_CL Transformer Recognition Speech Pose Speech_Recognition Inference PDF
2021-06-17 LoRA: Low-Rank Adaptation of Large Language Models Edward J. Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu, Yuanzhi Li, Shean Wang, Weizhu Chen arXiv_AI arXiv_AI Transformer Pose Inference Language_Model PDF
2021-06-17 XCiT: Cross-Covariance Image Transformers Alaaeldin El-Nouby, Hugo Touvron, Mathilde Caron, Piotr Bojanowski, Matthijs Douze, Armand Joulin, Ivan Laptev, Natalia Neverova, Gabriel Synnaeve, Jakob Verbeek, Hervé Jegou arXiv_CV arXiv_CV Transformer Segmentation Semantic_Segmentation Self-Supervised Pose Action Classification Detection Object_Detection Attention CNN Image_Classification PDF
2021-06-17 Multi-head or Single-head? An Empirical Comparison for Transformer Training Liyuan Liu, Jialu Liu, Jiawei Han arXiv_CL arXiv_CL Transformer Bert Deep_Learning Attention PDF
2021-06-17 Learning Knowledge Graph-based World Models of Textual Environments Prithviraj Ammanabrolu, Mark O. Riedl arXiv_AI arXiv_AI Transformer Reinforcement_Learning Zero-Shot Knowledge Knowledge_Graph Action PDF
2021-06-17 Do Large Scale Molecular Language Representations Capture Important Structural Information? Jerret Ross, Brian Belgodere, Vijil Chenthamarakshan, Inkit Padhi, Youssef Mroueh, Payel Das arXiv_CL arXiv_CL Transformer Embedding Pose Attention Language_Model Prediction PDF
2021-06-17 Semi-Autoregressive Transformer for Image Captioning Yuanen Zhou, Yong Zhang, Zhenzhen Hu, Meng Wang arXiv_CV arXiv_CV Image_Caption Transformer Pose Caption Inference PDF
2021-06-17 THUNDR: Transformer-based 3D HUmaN Reconstruction with Markers Mihai Zanfir, Andrei Zanfir, Eduard Gabriel Bazavan, William T. Freeman, Rahul Sukthankar, Cristian Sminchisescu arXiv_CV arXiv_CV Transformer Reconstruction 3D Self-Supervised Pose Face Prediction PDF
2021-06-17 Time Series is a Special Sequence: Forecasting with Sample Convolution and Interaction Minhao Liu, Ailing Zeng, Qiuxia Lai, Qiang Xu arXiv_AI arXiv_AI Transformer Pose Action Deep_Learning CNN Prediction PDF
2021-06-17 X-FACT: A New Benchmark Dataset for Multilingual Fact Checking Ashim Gupta, Vivek Srikumar arXiv_CL arXiv_CL Transformer Zero-Shot PDF
2021-06-17 Efficient Conformer with Prob-Sparse Attention Mechanism for End-to-EndSpeech Recognition Xiong Wang, Sining Sun, Lei Xie, Long Ma arXiv_SD arXiv_SD Transformer Recognition Sparse Speech Attention Speech_Recognition Inference PDF
2021-06-17 Layer Pruning on Demand with Intermediate CTC Jaesong Lee, Jingu Kang, Shinji Watanabe arXiv_CL arXiv_CL Transformer Recognition Regularization Speech Pose Classification Relation Speech_Recognition PDF
2021-06-17 Long-Short Temporal Contrastive Learning of Video Transformers Jue Wang, Gedas Bertasius, Du Tran, Lorenzo Torresani arXiv_AI arXiv_AI Transformer Recognition Video_Caption 3D Self-Supervised Pose Contrastive_Learning Action_Recognition Action Attention PDF
2021-06-16 Probing Image-Language Transformers for Verb Understanding Lisa Anne Hendricks, Aida Nematzadeh arXiv_CV arXiv_CV Transformer Image_Retrieval Speech VQA Caption PDF
2021-06-16 End-to-End Semi-Supervised Object Detection with Soft Teacher Mengde Xu, Zheng Zhang, Han Hu, Jianfeng Wang, Lijuan Wang, Fangyun Wei, Xiang Bai, Zicheng Liu arXiv_AI arXiv_AI Transformer Segmentation Pose Classification Detection Object_Detection PDF
2021-06-16 End-to-End Spoken Language Understanding for Generalized Voice Assistants Michael Saxon, Samridhi Choudhary, Joseph P. McKenna, Athanasios Mouchtaris arXiv_AI arXiv_AI Transformer Speech Pose Classification PDF
2021-06-16 Grounding Spatio-Temporal Language with Transformers Tristan Karch, Laetitia Teodorescu, Katja Hofmann, Clément Moulin-Frier, Pierre-Yves Oudeyer arXiv_AI arXiv_AI Transformer Face Attention Autonomous PDF
2021-06-16 Algorithm to Compilation Codesign: An Integrated View of Neural Network Sparsity Fu-Ming Guo, Austin Huang arXiv_AI arXiv_AI Transformer Bert Optimization Sparse Regularization Relation Attention Inference Language_Model PDF
2021-06-16 Domain-independent User Simulation with Transformers for Task-oriented Dialogue Systems Hsien-chin Lin, Nurul Lubis, Songbo Hu, Carel van Niekerk, Christian Geishauser, Michael Heck, Shutong Feng, Milica Gašić arXiv_CL arXiv_CL Transformer Reinforcement_Learning Zero-Shot Pose Action PDF
2021-06-16 Shuffle Transformer with Feature Alignment for Video Face Parsing Rui Zhang, Yang Han, Zilong Huang, Pei Cheng, Guozhong Luo, Gang Yu, Bin Fu arXiv_CV arXiv_CV Transformer Segmentation Pose Face PDF
2021-06-16 Optimizing Graph Transformer Networks with Graph-based Techniques Loc Hoang, Udit Agarwal, Gurbinder Gill, Roshan Dathathri, Abhik Seal, Brian Martin, Keshav Pingali arXiv_AI arXiv_AI Transformer CNN Inference PDF
2021-06-15 ASR Adaptation for E-commerce Chatbots using Cross-Utterance Context and Multi-Task Language Modeling Ashish Shenoy, Sravan Bodapati, Katrin Kirchhoff arXiv_CL arXiv_CL Transformer Embedding Recognition RNN Speech Pose Action Detection Speech_Recognition Language_Model QA PDF
2021-06-15 Scene Transformer: A unified multi-task model for behavior prediction and planning Jiquan Ngiam, Benjamin Caine, Vijay Vasudevan, Zhengdong Zhang, Hao-Tien Lewis Chiang, Jeffrey Ling, Rebecca Roelofs, Alex Bewley, Chenxi Liu, Ashish Venugopal, David Weiss, Ben Sapp, Zhifeng Chen, Jonathon Shlens arXiv_CV arXiv_CV Transformer Action Attention Autonomous Language_Model Prediction PDF
2021-06-15 What Context Features Can Transformer Language Models Use? Joe O'Connor, Jacob Andreas arXiv_CL arXiv_CL Transformer Language_Model Prediction PDF
2021-06-15 Dynamic Head: Unifying Object Detection Heads with Attentions Xiyang Dai, Yinpeng Chen, Bin Xiao, Dongdong Chen, Mengchen Liu, Lu Yuan, Lei Zhang arXiv_CV arXiv_CV Transformer Pose Classification Detection Object_Detection Attention PDF
2021-06-15 BEiT: BERT Pre-Training of Image Transformers Hangbo Bao, Li Dong, Furu Wei arXiv_CV arXiv_CV Transformer Segmentation Semantic_Segmentation Bert Self-Supervised Pose Classification Image_Classification PDF
2021-06-15 PairConnect: A Compute-Efficient MLP Alternative to Attention Zhaozhuo Xu, Minghao Yan, Junyan Zhang, Anshumali Shrivastava arXiv_CL arXiv_CL Transformer Embedding Action Attention Inference Language_Model PDF
2021-06-15 Direction is what you need: Improving Word Embedding Compression in Large Language Models Klaudia Bałazy, Mohammadreza Banaei, Rémi Lebret, Jacek Tabor, Karl Aberer arXiv_CL arXiv_CL Transformer Embedding Pose Inference Language_Model PDF
2021-06-15 Semantic Representation and Inference for NLP Dongsheng Wang arXiv_AI arXiv_AI Transformer Embedding RNN Knowledge Review Knowledge_Graph Pose Deep_Learning Attention CNN Inference PDF
2021-06-15 Medical Code Prediction from Discharge Summary: Document to Sequence BERT using Sequence Attention Tak-Sung Heo, Yongmin Yoo, Yeongjoon Park, Byeong-Cheol Jo arXiv_AI arXiv_AI Transformer Bert Pose Classification Attention Medical Prediction PDF
2021-06-14 Improved Transformer for High-Resolution GANs Long Zhao, Zizhao Zhang, Ting Chen, Dimitris N. Metaxas, Han Zhang arXiv_CV arXiv_CV Transformer Adversarial Pose Attention GAN PDF
2021-06-14 Delving Deep into the Generalization of Vision Transformers under Distribution Shifts Chongzhi Zhang, Mingyuan Zhang, Shanghang Zhang, Daisheng Jin, Qiang Zhou, Zhongang Cai, Haiyu Zhao, Shuai Yi, Xianglong Liu, Ziwei Liu arXiv_CV arXiv_CV Transformer Adversarial Self-Supervised PDF
2021-06-14 S$^2$-MLP: Spatial-Shift MLP Architecture for Vision Tan Yu, Xu Li, Yunfeng Cai, Mingming Sun, Ping Li arXiv_AI arXiv_AI Transformer Recognition Pose Attention PDF
2021-06-14 NG+ : A Multi-Step Matrix-Product Natural Gradient Method for Deep Learning Minghan Yang, Dong Xu, Qiwen Cui, Zaiwen Wen, Pengxiang Xu arXiv_AI arXiv_AI Transformer Pose Classification Deep_Learning Image_Classification Recommendation PDF
2021-06-14 Partial success in closing the gap between human and machine vision Robert Geirhos, Kantharaju Narayanappa, Benjamin Mitzkus, Tizian Thieringer, Matthias Bethge, Felix A. Wichmann, Wieland Brendel arXiv_AI arXiv_AI Transformer Adversarial Self-Supervised Matching PDF
2021-06-14 Automatic Document Sketching: Generating Drafts from Analogous Texts Zeqiu Wu, Michel Galley, Chris Brockett, Yizhe Zhang, Bill Dolan arXiv_CL arXiv_CL Transformer Reinforcement_Learning Weakly_Supervised Sketch Review Text_Generation Language_Model Prediction PDF
2021-06-14 End-to-end Neural Diarization: From Transformer to Conformer Yi Chieh Liu, Eunjung Han, Chul Lee, Andreas Stolcke arXiv_CL arXiv_CL Transformer Speech Pose Relation CNN PDF
2021-06-14 2rd Place Solutions in the HC-STVG track of Person in Context Challenge 2021 YiYu, XinyingWang, WeiHu, XunLuo, ChengLi arXiv_CV arXiv_CV Transformer PDF
2021-06-14 Selection of Source Images Heavily Influences the Effectiveness of Adversarial Attacks Utku Ozbulak, Esla Timothy Anzaku, Wesley De Neve, Arnout Van Messem arXiv_CV arXiv_CV Transformer Adversarial Pose PDF
2021-06-14 Why Can You Lay Off Heads? Investigating How BERT Heads Transfer Ting-Rui Chiang, Yun-Nung Chen arXiv_CL arXiv_CL Transformer Transfer_Learning Bert Pose PDF
2021-06-13 Styleformer: Transformer based Generative Adversarial Networks with Style Vector Jeeseung Park, Younggeun Kim arXiv_CV arXiv_CV Transformer Adversarial Pose GAN PDF
2021-06-13 Thinking Like Transformers Gail Weiss, Yoav Goldberg, Eran Yahav arXiv_CL arXiv_CL Transformer RNN Action Attention PDF
2021-06-13 InfoBehavior: Self-supervised Representation Learning for Ultra-long Behavior Sequence via Hierarchical Grouping Runshi Liu, Pengda Qin, Yuhong Li, Weigao Wen, Dong Li, Kefeng Deng, Qiang Wu arXiv_CL arXiv_CL Transformer Embedding Represenation_Learning Self-Supervised Pose Face Action Classification PDF
2021-06-13 Memory-efficient Transformers via Top-$k$ Attention Ankit Gupta, Guy Dar, Shaya Goodman, David Ciprut, Jonathan Berant arXiv_CL arXiv_CL Transformer Zero-Shot Pose Attention Inference Language_Model QA PDF
2021-06-12 Can Transformer Language Models Predict Psychometric Properties? Antonio Laverghetta Jr., Animesh Nighojkar, Jamshidbek Mirzakhalov, John Licato arXiv_CL arXiv_CL Transformer Language_Model Prediction PDF
2021-06-12 Video Super-Resolution Transformer Jiezhang Cao, Yawei Li, Kai Zhang, Luc Van Gool arXiv_CV arXiv_CV Transformer Embedding Super_Resolution Pose Action Relation Attention CNN Optical_Flow Prediction PDF
2021-06-12 Dynamic Clone Transformer for Efficient Convolutional Neural Netwoks Longqing Ye arXiv_CV arXiv_CV Transformer Pose CNN PDF
2021-06-12 Task Transformer Network for Joint MRI Reconstruction and Super-Resolution Chun-Mei Feng, Yunlu Yan, Huazhu Fu, Li Chen, Yong Xu arXiv_CV arXiv_CV Transformer Reconstruction Super_Resolution Pose Quantitative Relation PDF
2021-06-12 DS-TransUNet:Dual Swin Transformer U-Net for Medical Image Segmentation Ailiang Lin, Bingzhi Chen, Jiayu Xu, Zheng Zhang, Guangming Lu arXiv_CV arXiv_CV Transformer Segmentation Semantic_Segmentation Pose Deep_Learning Attention Medical CNN PDF
2021-06-11 HR-NAS: Searching Efficient High-Resolution Neural Architectures with Lightweight Transformers Mingyu Ding, Xiaochen Lian, Linjie Yang, Peng Wang, Xiaojie Jin, Zhiwu Lu, Ping Luo arXiv_CV arXiv_CV Transformer NAS Segmentation Semantic_Segmentation Pose_Estimation Pose Classification Detection CNN Image_Classification Prediction PDF
2021-06-11 N-Best ASR Transformer: Enhancing SLU Performance using Multiple ASR Hypotheses Karthik Ganesan, Pakhi Bamdev, Jaivarsan B, Amresh Venugopal, Abhinav Tushar arXiv_CL arXiv_CL Transformer Bert Speech PDF
2021-06-11 Zero-Shot Controlled Generation with Encoder-Decoder Transformers Devamanyu Hazarika, Mahdi Namazifar, Dilek Hakkani-Tür arXiv_AI arXiv_AI Transformer Zero-Shot Knowledge Pose Attention Summarization PDF
2021-06-11 ViT-Inception-GAN for Image Colourising Tejas Bana, Jatan Loya, Siddhant Kulkarni arXiv_CV arXiv_CV Transformer Embedding Adversarial Pose Attention GAN PDF
2021-06-11 Graph Transformer Networks: Learning Meta-path Graphs to Improve GNNs Seongjun Yun, Minbyul Jeong, Sungdong Yoo, Seunghun Lee, Sean S. Yi, Raehyun Kim, Jaewoo Kang, Hyunwoo J. Kim arXiv_AI arXiv_AI Transformer Pose Classification PDF
2021-06-11 MlTr: Multi-label Classification with Transformer Xing Cheng, Hezheng Lin, Xiangyu Wu, Fan Yang, Dong Shen, Zhongyuan Wang, Nian Shi, Honglin Liu arXiv_CV arXiv_CV Transformer Pose Classification Attention CNN Image_Classification PDF
2021-06-11 Modeling Sequences as Distributions with Uncertainty for Sequential Recommendation Ziwei Fan, Zhiwei Liu, Lei Zheng, Shen Wang, Philip S. Yu arXiv_AI arXiv_AI Transformer Pose Action Relation Recommendation PDF
2021-06-11 Hybrid Generative-Contrastive Representation Learning Saehoon Kim, Sungwoong Kim, Juho Lee arXiv_AI arXiv_AI Transformer Unsupervised Represenation_Learning Contrastive_Learning PDF
2021-06-11 Spectral Unsupervised Domain Adaptation for Visual Recognition Jingyi Zhang, Jiaxing Huang, Shijian Lu arXiv_CV arXiv_CV Transformer Segmentation Unsupervised Recognition Adversarial Pose Classification Detection Attention PDF
2021-06-11 Transformer-based Spatial-Temporal Feature Learning for EEG Decoding Yonghao Song, Xueyu Jia, Lie Yang, Longhan Xie arXiv_AI arXiv_AI Transformer Pose Face Classification Relation Attention CNN PDF
2021-06-10 Domain Transformer: Predicting Samples of Unseen, Future Domains Johannes Schneider arXiv_AI arXiv_AI Transformer Unsupervised GAN PDF
2021-06-10 Rethinking Architecture Design for Tackling Data Heterogeneity in Federated Learning Liangqiong Qu, Yuyin Zhou, Paul Pu Liang, Yingda Xia, Feifei Wang, Li Fei-Fei, Ehsan Adeli, Daniel Rubin arXiv_CV arXiv_CV Transformer Optimization Attention GAN CNN PDF
2021-06-10 Space-time Mixing Attention for Video Transformer Adrian Bulat, Juan-Manuel Perez-Rua, Swathikiran Sudhakaran, Brais Martinez, Georgios Tzimiropoulos arXiv_AI arXiv_AI Transformer Recognition Pose Attention PDF
2021-06-10 Scaling Vision with Sparse Mixture of Experts Carlos Riquelme, Joan Puigcerver, Basil Mustafa, Maxim Neumann, Rodolphe Jenatton, André Susano Pinto, Daniel Keysers, Neil Houlsby arXiv_CV arXiv_CV Transformer Recognition Sparse Pose Inference PDF
2021-06-10 Deciphering Implicit Hate: Evaluating Automated Detection Algorithms for Multimodal Hate Austin Botelho, Bertie Vidgen, Scott A. Hale arXiv_CV arXiv_CV Transformer Classification Detection PDF
2021-06-10 KARI: KAnari/QCRI's End-to-End systems for the INTERSPEECH 2021 Indian Languages Code-Switching Challenge Amir Hussein, Shammur Chowdhury, Ahmed Ali arXiv_CL arXiv_CL Transformer Transfer_Learning Recognition Speech Speech_Recognition Language_Model PDF
2021-06-10 Enforcing Morphological Information in Fully Convolutional Networks to Improve Cell Instance Segmentation in Fluorescence Microscopy Images Willard Zamora-Cardenas, Mauro Mendez, Saul Calderon-Ramirez, Martin Vargas, Gerardo Monge, Steve Quiros, David Elizondo, David Elizondo, Miguel A. Molina-Cabello arXiv_CV arXiv_CV Transformer Segmentation Tracking Pose CNN PDF
2021-06-10 GroupBERT: Enhanced Transformer Architecture with Efficient Grouped Structures Ivan Chelombiev, Daniel Justus, Douglas Orr, Anastasia Dietrich, Frithjof Gressmann, Alexandros Koliousis, Carlo Luschi arXiv_CL arXiv_CL Transformer Bert Represenation_Learning Action Attention CNN Language_Model PDF
2021-06-10 CAT: Cross Attention in Vision Transformer Hezheng Lin, Xing Cheng, Xiangyu Wu, Fan Yang, Dong Shen, Zhongyuan Wang, Qing Song, Wei Yuan arXiv_AI arXiv_AI Transformer Pose Attention Inference PDF
2021-06-10 MST: Masked Self-Supervised Transformer for Visual Representation Zhaowen Li, Zhiyang Chen, Fan Yang, Wei Li, Yousong Zhu, Chaoyang Zhao, Rui Deng, Liwei Wu, Rui Zhao, Ming Tang, Jinqiao Wang arXiv_CV arXiv_CV Transformer Segmentation Self-Supervised Pose Detection Object_Detection Attention Language_Model Prediction PDF
2021-06-10 Convolutions and Self-Attention: Re-interpreting Relative Positions in Pre-trained Language Models Tyler A. Chang, Yifan Xu, Weijian Xu, Zhuowen Tu arXiv_CL arXiv_CL Transformer Embedding Bert Pose Relation Attention CNN Language_Model PDF
2021-06-09 Keeping Your Eye on the Ball: Trajectory Attention in Video Transformers Mandela Patrick, Dylan Campbell, Yuki M. Asano, Ishan Misra Florian Metze, Christoph Feichtenhofer, Andrea Vedaldi, Jo\ão F. Henriques arXiv_CV arXiv_CV Transformer Recognition Pose Action_Recognition Action Attention PDF
2021-06-09 Semi-Supervised 3D Hand-Object Poses Estimation with Interactions in Time Shaowei Liu, Hanwen Jiang, Jiarui Xu, Sifei Liu, Xiaolong Wang arXiv_CV arXiv_CV Transformer 3D Pose_Estimation Pose Action PDF
2021-06-09 Do Transformers Really Perform Bad for Graph Representation? Chengxuan Ying, Tianle Cai, Shengjie Luo, Shuxin Zheng, Guolin Ke, Di He, Yanming Shen, Tie-Yan Liu arXiv_AI arXiv_AI Transformer Represenation_Learning Pose Prediction PDF
2021-06-09 Grounding inductive biases in natural images:invariance stems from variations in data Diane Bouchacourt, Mark Ibrahim, Ari S. Morcos arXiv_CV arXiv_CV Transformer Pose CNN PDF
2021-06-09 Towards Training Stronger Video Vision Transformers for EPIC-KITCHENS-100 Action Recognition Ziyuan Huang, Zhiwu Qing, Xiang Wang, Yutong Feng, Shiwei Zhang, Jianwen Jiang, Zhurong Xia, Mingqian Tang, Nong Sang, Marcelo H. Ang Jr arXiv_CV arXiv_CV Transformer Recognition Point_Cloud Video_Caption Action_Recognition Action Classification CNN Prediction PDF
2021-06-09 Instantaneous Grammatical Error Correction with Shallow Aggressive Decoding Xin Sun, Tao Ge, Furu Wei, Houfeng Wang arXiv_CL arXiv_CL Transformer Pose Inference Prediction PDF
2021-06-09 Auto-tagging of Short Conversational Sentences using Natural Language Processing Methods Şükrü Ozan, D. Emre Taşar arXiv_CL arXiv_CL Transformer Bert Attention Language_Model QA PDF
2021-06-09 Phraseformer: Multimodal Key-phrase Extraction using Transformer and Graph Embedding Narjes Nikzad-Khasmakhi, Mohammad-Reza Feizi-Derakhshi, Meysam Asgari-Chenaghlu, Mohammad-Ali Balafar, Ali-Reza Feizi-Derakhshi, Taymaz Rahkar-Farshi, Majid Ramezani, Zoleikha Jahanbakhsh-Nagadeh, Elnaz Zafarani-Moattar, Mehrdad Ranjbar-Khadivi arXiv_AI arXiv_AI Transformer Embedding Bert Action Classification PDF
2021-06-09 Automatic Sexism Detection with Multilingual Transformer Models Schütz Mina, Boeck Jaqueline, Liakhovets Daria, Slijepčević Djordje, Kirchknopf Armin, Hecht Manuel, Bogensperger Johannes, Schlarb Sven, Schindler Alexander, Zeppelzauer Matthias arXiv_AI arXiv_AI Transformer Unsupervised Bert Classification Detection PDF
2021-06-09 RealTranS: End-to-End Simultaneous Speech Translation with Convolutional Weighted-Shrinking Transformer Xingshan Zeng, Liangyou Li, Qun Liu arXiv_CL arXiv_CL Transformer Speech Pose CNN PDF
2021-06-09 CoAtNet: Marrying Convolution and Attention for All Data Sizes Zihang Dai, Hanxiao Liu, Quoc V. Le, Mingxing Tan arXiv_CV arXiv_CV Transformer Attention CNN Matching PDF
2021-06-08 FastSeq: Make Sequence Generation Faster Yu Yan, Fei Hu, Jiusheng Chen, Nikhil Bhendawade, Ting Ye, Yeyun Gong, Nan Duan, Desheng Cui, Bingyu Chi, Ruifei Zhang arXiv_CL arXiv_CL Transformer Optimization Pose Attention Inference PDF
2021-06-08 TED-net: Convolution-free T2T Vision Transformer-based Encoder-decoder Dilation network for Low-dose CT Denoising Dayang Wang, Zhan Wu, Hengyong Yu arXiv_CV arXiv_CV Transformer Pose Action Deep_Learning Denoising PDF
2021-06-08 On the Lack of Robust Interpretability of Neural Text Classifiers Muhammad Bilal Zafar, Michele Donini, Dylan Slack, Cédric Archambeau, Sanjiv Das, Krishnaram Kenthapadi arXiv_CL arXiv_CL Transformer Language_Model Prediction PDF
2021-06-08 PAM: Understanding Product Images in Cross Product Category Attribute Extraction Rongmei Lin, Xiang He, Jie Feng, Nasser Zalmout, Yan Liang, Li Xiong, Xin Luna Dong arXiv_CV arXiv_CV Transformer Recognition OCR Optical_Character Knowledge Knowledge_Graph Pose Action VQA PDF
2021-06-08 Are Pretrained Transformers Robust in Intent Classification? A Missing Ingredient in Evaluation of Out-of-Scope Intent Detection Jian-Guo Zhang, Kazuma Hashimoto, Yao Wan, Ye Liu, Caiming Xiong, Philip S. Yu arXiv_AI arXiv_AI Transformer Recognition Classification Detection Few-Shot PDF
2021-06-08 XtremeDistilTransformers: Task Transfer for Task-agnostic Distillation Subhabrata Mukherjee, Ahmed Hassan Awadallah, Jianfeng Gao arXiv_AI arXiv_AI Transformer Knowledge Pose PDF
2021-06-08 Scaling Vision Transformers Xiaohua Zhai, Alexander Kolesnikov, Neil Houlsby, Lucas Beyer arXiv_AI arXiv_AI Transformer Relation Few-Shot Attention Language_Model PDF
2021-06-08 A Survey of Transformers Tianyang Lin, Yuxin Wang, Xiangyang Liu, Xipeng Qiu arXiv_AI arXiv_AI Transformer Review Pose Survey PDF
2021-06-08 DETReg: Unsupervised Pretraining with Region Priors for Object Detection Amir Bar, Xin Wang, Vadim Kantorov, Colorado J Reed, Roei Herzig, Gal Chechik, Anna Rohrbach, Trevor Darrell, Amir Globerson arXiv_CV arXiv_CV Transformer Embedding Unsupervised Self-Supervised Detection Object_Detection PDF
2021-06-08 Chasing Sparsity in Vision Transformers:An End-to-End Exploration Tianlong Chen, Yu Cheng, Zhe Gan, Lu Yuan, Lei Zhang, Zhangyang Wang arXiv_AI arXiv_AI Transformer Sparse Pose Attention Inference PDF
2021-06-08 MViT: Mask Vision Transformer for Facial Expression Recognition in the wild Hanting Li, Mingzhe Sui, Feng Zhao, Zhengjun Zha, Feng Wu arXiv_CV arXiv_CV Transformer Recognition Pose Face Action Classification Attention PDF
2021-06-08 Parameter-efficient Multi-task Fine-tuning for Transformers via Shared Hypernetworks Rabeeh Karimi Mahabadi, Sebastian Ruder, Mostafa Dehghani, James Henderson arXiv_CL arXiv_CL Transformer Knowledge Few-Shot Language_Model PDF
2021-06-08 CLTR: An End-to-End, Transformer-Based System for Cell Level TableRetrieval and Table Question Answering Feifei Pan, Mustafa Canim, Michael Glass, Alfio Gliozzo, Peter Fox arXiv_CL arXiv_CL Transformer Pose QA PDF
2021-06-08 Hash Layers For Large Sparse Models Stephen Roller, Sainbayar Sukhbaatar, Arthur Szlam, Jason Weston arXiv_CL arXiv_CL Transformer Sparse Language_Model PDF
2021-06-08 Speech BERT Embedding For Improving Prosody in Neural TTS Liping Chen, Yan Deng, Xi Wang, Frank K. Soong, Lei He arXiv_SD arXiv_SD Transformer Embedding Bert Speech Pose PDF
2021-06-08 Staircase Attention for Recurrent Processing of Sequences Da Ju, Stephen Roller, Sainbayar Sukhbaatar, Jason Weston arXiv_CL arXiv_CL Transformer Tracking Attention Language_Model PDF
2021-06-08 Demystifying Local Vision Transformer: Sparse Connectivity, Weight Sharing, and Dynamic Weight Qi Han, Zejia Fan, Qi Dai, Lei Sun, Ming-Ming Cheng, Jiaying Liu, Jingdong Wang arXiv_CV arXiv_CV Transformer Segmentation Semantic_Segmentation Recognition Sparse Regularization Classification Detection Object_Detection Attention PDF
2021-06-08 On Improving Adversarial Transferability of Vision Transformers Muzammal Naseer, Kanchana Ranasinghe, Salman Khan, Fahad Shahbaz Khan, Fatih Porikli arXiv_AI arXiv_AI Transformer Adversarial Pose Attention CNN PDF
2021-06-08 Fully Transformer Networks for Semantic ImageSegmentation Sitong Wu, Tianyi Wu, Fangjian Lin, Shengwei Tian, Guodong Guo arXiv_CV arXiv_CV Transformer Segmentation Semantic_Segmentation Pose PDF
2021-06-08 Diverse Part Discovery: Occluded Person Re-identification with Part-Aware Transformer Yulin Li, Jianfeng He, Tianzhu Zhang, Xiang Liu, Yongdong Zhang, Feng Wu arXiv_CV arXiv_CV Transformer Person_Re-identification Weakly_Supervised Knowledge Pose Re-identification PDF
2021-06-08 LocalTrans: A Multiscale Local Transformer Network for Cross-Resolution Homography Estimation Ruizhi Shao, Gaochang Wu, Yuemei Zhou, Ying Fu, Lu Fang, Yebin Liu arXiv_CV arXiv_CV Transformer Pose Attention PDF
2021-06-07 Investigating Transfer Learning in Multilingual Pre-trained Language Models through Chinese Natural Language Inference Hai Hu, He Zhou, Zuoyu Tian, Yiwen Zhang, Yina Ma, Yanting Li, Yixin Nie, Kyle Richardson arXiv_AI arXiv_AI Transformer Transfer_Learning Zero-Shot Knowledge Adversarial Inference Language_Model PDF
2021-06-07 PILOT: Introducing Transformers for Probabilistic Sound Event Localization Christopher Schymura, Benedikt Bönninghoff, Tsubasa Ochiai, Marc Delcroix, Keisuke Kinoshita, Tomohiro Nakatani, Shoko Araki, Dorothea Kolossa arXiv_SD arXiv_SD Transformer RNN Pose Deep_Learning Detection Attention PDF
2021-06-07 Visual Transformer for Task-aware Active Learning Razvan Caramalau, Binod Bhattarai, Tae-Kyun Kim arXiv_AI arXiv_AI Transformer Pose Classification Deep_Learning Detection Relation PDF
2021-06-07 DoubleField: Bridging the Neural Surface and Radiance Fields for High-fidelity Human Rendering Ruizhi Shao, Hongwen Zhang, He Zhang, Yanpei Cao, Tao Yu, Yebin Liu arXiv_CV arXiv_CV Transformer Embedding Transfer_Learning Sparse Face Quantitative Inference PDF
2021-06-07 Efficient Training of Visual Transformers with Small-Size Datasets Yahui Liu, Enver Sangineto, Wei Bi, Nicu Sebe, Bruno Lepri, Marco De Nadai arXiv_CV arXiv_CV Transformer Self-Supervised Pose Relation CNN PDF
2021-06-07 Reveal of Vision Transformers Robustness against Adversarial Attacks Ahmed Aldahdooh, Wassim Hamidouche, Olivier Deforges arXiv_CV arXiv_CV Transformer Adversarial Pose Classification Attention CNN Image_Classification PDF
2021-06-07 Person Re-Identification with a Locally Aware Transformer Charu Sharma, Siddhant R. Kapil, David Chapman arXiv_CV arXiv_CV Transformer Surveillance Person_Re-identification Recognition Pose Classification Re-identification CNN PDF
2021-06-07 Diverse Pretrained Context Encodings Improve Document Translation Domenic Donato, Lei Yu, Chris Dyer arXiv_CL arXiv_CL Transformer Pose PDF
2021-06-07 Refiner: Refining Self-attention for Vision Transformers Daquan Zhou, Yujun Shi, Bingyi Kang, Weihao Yu, Zihang Jiang, Yuan Li, Xiaojie Jin, Qibin Hou, Jiashi Feng arXiv_CV arXiv_CV Transformer Classification Attention Image_Classification PDF
2021-06-07 Shuffle Transformer: Rethinking Spatial Shuffle for Vision Transformer Zilong Huang, Youcheng Ben, Guozhong Luo, Pei Cheng, Gang Yu, Bin Fu arXiv_CV arXiv_CV Transformer Segmentation Semantic_Segmentation Pose Classification Detection Object_Detection Attention Image_Classification PDF
2021-06-07 Document-level Relation Extraction as Semantic Segmentation Ningyu Zhang, Xiang Chen, Xin Xie, Shumin Deng, Chuanqi Tan, Mosha Chen, Fei Huang, Luo Si, Huajun Chen arXiv_CL arXiv_CL Transformer Segmentation Semantic_Segmentation OCR Pose Action Relation Relation_Extraction PDF
2021-06-07 Attention Temperature Matters in Abstractive Summarization Distillation Shengqiang Zhang, Xingxing Zhang, Hangbo Bao, Furu Wei arXiv_CL arXiv_CL Transformer Pose Attention Summarization Inference PDF
2021-06-07 Hierarchical Task Learning from Language Instructions with Unified Transformers and Self-Monitoring Yichi Zhang, Joyce Chai arXiv_AI arXiv_AI Transformer Pose PDF
2021-06-07 Progressive Open-Domain Response Generation with Multiple Controllable Attributes Haiqin Yang, Xiaoyuan Yao, Yiqun Duan, Jianping Shen, Jie Zhong, Kun Zhang arXiv_CL arXiv_CL Transformer Pose PDF
2021-06-07 ViTAE: Vision Transformer Advanced by Exploring Intrinsic Inductive Bias Yufei Xu, Qiming Zhang, Jing Zhang, Dacheng Tao arXiv_CV arXiv_CV Transformer Pose Attention PDF
2021-06-07 Video Instance Segmentation using Inter-Frame Communication Transformers Sukjun Hwang, Miran Heo, Seoung Wug Oh, Seon Joo Kim arXiv_CV arXiv_CV Transformer Segmentation Pose Inference PDF
2021-06-06 Itihasa: A large-scale corpus for Sanskrit to English translation Rahul Aralikatte, Miryam de Lhoneux, Anoop Kunchukuttan, Anders Søgaard arXiv_CL arXiv_CL Transformer PDF
2021-06-06 Transient Chaos in BERT Katsuma Inoue, Soh Ohara, Yasuo Kuniyoshi, Kohei Nakajima arXiv_AI arXiv_AI Transformer Bert Action PDF
2021-06-06 Transformer in Convolutional Neural Networks Yun Liu, Guolei Sun, Yu Qiu, Le Zhang, Ajad Chhatkuli, Luc Van Gool arXiv_CV arXiv_CV Transformer Recognition Pose Relation Attention CNN PDF
2021-06-06 Attend and Select: A Segment Attention based Selection Mechanism for Microblog Hashtag Generation Qianren Mao, Xi Li, Hao Peng, Bang Liu, Shu Guo, Jianxin Li, Lihong Wang, Philip S. Yu arXiv_AI arXiv_AI Transformer Pose Action Attention PDF
2021-06-06 Oriented Object Detection with Transformer Teli Ma, Mingyuan Mao, Honghui Zheng, Peng Gao, Xiaodi Wang, Shumin Han, Errui Ding, Baochang Zhang, David Doermann arXiv_CV arXiv_CV Transformer Detection Object_Detection Attention PDF
2021-06-06 CAPE: Encoding Relative Positions with Continuous Augmented Positional Embeddings Tatiana Likhomanenko, Qiantong Xu, Ronan Collobert, Gabriel Synnaeve, Alex Rogozhnikov arXiv_CV arXiv_CV Transformer Embedding Recognition Speech Pose Attention Speech_Recognition PDF
2021-06-06 Rethinking Training from Scratch for Object Detection Yang Li, Hong Zhang, Yu Zhang arXiv_CV arXiv_CV Transformer Pose Detection Object_Detection PDF
2021-06-06 Uformer: A General U-Shaped Transformer for Image Restoration Zhendong Wang, Xiaodong Cun, Jianmin Bao, Jianzhuang Liu arXiv_CV arXiv_CV Transformer Restoration Denoising Attention PDF
2021-06-06 Referring Transformer: A One-step Approach to Multi-task Visual Grounding Muchen Li, Leonid Sigal arXiv_CV arXiv_CV Transformer Segmentation Pose PDF
2021-06-06 Do Grammatical Error Correction Models Realize Grammatical Generalization? Masato Mita, Hitomi Yanaka arXiv_CL arXiv_CL Transformer Knowledge PDF
2021-06-05 Patch Slimming for Efficient Vision Transformers Yehui Tang, Kai Han, Yunhe Wang, Chang Xu, Jianyuan Guo, Chao Xu, Dacheng Tao arXiv_CV arXiv_CV Transformer Pose Attention CNN PDF
2021-06-05 Learnable Fourier Features for Multi-DimensionalSpatial Positional Encoding Yang Li, Si Si, Gang Li, Cho-Jui Hsieh, Samy Bengio arXiv_AI arXiv_AI Transformer Pose Relation Attention PDF
2021-06-05 Motion Planning Transformers: One Model to Plan Them All Jacob J. Johnson, Linjun Li, Ahmed H. Qureshi, Michael C. Yip arXiv_AI arXiv_AI Transformer Pose Attention CNN PDF
2021-06-05 Signal Transformer: Complex-valued Attention and Meta-Learning for Signal Recognition Yihong Dong, Ying Peng, Muqiao Yang, Songtao Lu, Qingjiang Shi arXiv_AI arXiv_AI Transformer Recognition Knowledge Pose Deep_Learning Few-Shot Attention PDF
2021-06-04 SketchGen: Generating Constrained CAD Sketches Wamiq Reyaz Para, Shariq Farooq Bhat, Paul Guerrero, Tom Kelly, Niloy Mitra, Leonidas Guibas, Peter Wonka arXiv_AI arXiv_AI Transformer Sketch Pose Prediction PDF
2021-06-04 RegionViT: Regional-to-Local Attention for Vision Transformers Chun-Fu Chen, Rameswar Panda, Quanfu Fan arXiv_CV arXiv_CV Transformer Recognition Pose Action_Recognition Action Classification Detection Object_Detection Attention CNN Image_Classification PDF
2021-06-04 Layered gradient accumulation and modular pipeline parallelism: fast and efficient training of large language models Joel Lamy-Poirier arXiv_AI arXiv_AI Transformer Action Language_Model PDF
2021-06-04 Churn Reduction via Distillation Heinrich Jiang, Harikrishna Narasimhan, Dara Bahri, Andrew Cotter, Afshin Rostamizadeh arXiv_AI arXiv_AI Transformer CNN Prediction PDF
2021-06-04 Associating Objects with Transformers for Video Object Segmentation Zongxin Yang, Yunchao Wei, Yi Yang arXiv_CV arXiv_CV Transformer Segmentation Embedding Pose Matching PDF
2021-06-04 BERT based sentiment analysis: A software engineering perspective Himanshu Batra, Narinder Singh Punn, Sanjay Kumar Sonbhadra, Sonali Agarwal arXiv_CV arXiv_CV Transformer Bert Text_Classification Pose Classification Sentiment Recommendation PDF
2021-06-04 Semantic Correspondence with Transformers Seokju Cho, Sunghwan Hong, Sangryul Jeon, Yunsung Lee, Kwanghoon Sohn, Seungryong Kim arXiv_CV arXiv_CV Transformer Pose Relation Attention Matching PDF
2021-06-04 The Image Local Autoregressive Transformer Chenjie Cao, Yuxin Hong, Xiang Li, Chengrong Wang, Chengming Xu, XiangYang Xue, Yanwei Fu arXiv_CV arXiv_CV Transformer Adversarial Pose Face Quantitative Attention GAN Inference PDF
2021-06-04 A New Gastric Histopathology Subsize Image Database for Classification Algorithm Test: from Linear Regression to Visual Transformer Weiming Hu, Chen Li, Xiaoyan Li, Haoyuan Chen, Wanli Liu, Changhao Sun, Marcin Grzegorzek arXiv_CV arXiv_CV Transformer Classification Image_Classification PDF
2021-06-04 SOLQ: Segmenting Objects by Learning Queries Bin Dong, Fangao Zeng, Tiancai Wang, Xiangyu Zhang, Yichen Wei arXiv_CV arXiv_CV Transformer Segmentation Pose Classification Detection Inference PDF
2021-06-04 cs60075_team2 at SemEval-2021 Task 1 : Lexical Complexity Prediction using Transformer-based Language Models pre-trained on various text corpora Abhilash Nandy, Sayantan Adak, Tanurima Halder, Sai Mahesh Pokala arXiv_AI arXiv_AI Transformer Relation Language_Model Prediction PDF
2021-06-04 Few-Shot Segmentation via Cycle-Consistent Transformer Gengwei Zhang, Guoliang Kang, Yunchao Wei, Yi Yang arXiv_CV arXiv_CV Transformer Segmentation Semantic_Segmentation Pose Relation Few-Shot Attention Prediction PDF
2021-06-04 Minimum Word Error Rate Training with Language Model Fusion for End-to-End Speech Recognition Zhong Meng, Yu Wu, Naoyuki Kanda, Liang Lu, Xie Chen, Guoli Ye, Eric Sun, Jinyu Li, Yifan Gong arXiv_AI arXiv_AI Transformer Recognition Speech Pose Speech_Recognition Inference Language_Model PDF
2021-06-04 Dutch Named Entity Recognition and De-identification Methods for the Human Resource Domain Chaïm van Toledo, Friso van Dijk, Marco Spruit arXiv_CL arXiv_CL Transformer Recognition Bert PDF
2021-06-04 Glance-and-Gaze Vision Transformer Qihang Yu, Yingda Xia, Yutong Bai, Yongyi Lu, Alan Yuille, Wei Shen arXiv_CV arXiv_CV Transformer Pose Attention CNN Prediction PDF
2021-06-04 Visual Question Rewriting for Increasing Response Rate Jiayi Wei, Xilian Li, Yi Zhang, Xin Wang arXiv_AI arXiv_AI Transformer Emotion VQA PDF
2021-06-04 X-volution: On the unification of convolution and self-attention Xuanhong Chen, Hang Wang, Bingbing Ni arXiv_CV arXiv_CV Transformer Segmentation Pose Action Classification Detection Relation Attention PDF
2021-06-04 Scalable Transformers for Neural Machine Translation Peng Gao, Shijie Geng, Xiaogang Wang, Jifeng Dai, Hongsheng Li arXiv_CL arXiv_CL Transformer Pose NMT PDF
2021-06-04 ERNIE-Tiny : A Progressive Distillation Framework for Pretrained Transformer Compression Weiyue Su, Xuyi Chen, Shikun Feng, Jiaxiang Liu, Weixin Liu, Yu Sun, Hao Tian, Hua Wu, Haifeng Wang arXiv_CL arXiv_CL Transformer Bert Knowledge Pose Inference Language_Model PDF
2021-06-03 Reinforcement Learning as One Big Sequence Modeling Problem Michael Janner, Qiyang Li, Sergey Levine arXiv_AI arXiv_AI Transformer Reinforcement_Learning Action Prediction PDF
2021-06-03 Anticipative Video Transformer Rohit Girdhar, Kristen Grauman arXiv_AI arXiv_AI Transformer Pose Action Attention PDF
2021-06-03 DynamicViT: Efficient Vision Transformers with Dynamic Token Sparsification Yongming Rao, Wenliang Zhao, Benlin Liu, Jiwen Lu, Jie Zhou, Cho-Jui Hsieh arXiv_AI arXiv_AI Transformer Recognition Sparse Pose Action Attention Prediction PDF
2021-06-03 ProtoRes: Proto-Residual Architecture for Deep Modeling of Human Pose Boris N. Oreshkin, Florent Bocquelet, Félix H. Harvey, Bay Raitt, Dominic Laflamme arXiv_CV arXiv_CV Transformer 3D Sparse Pose Face PDF
2021-06-03 Defending Democracy: Using Deep Learning to Identify and Prevent Misinformation Anusua Trivedi, Alyssa Suhm, Prathamesh Mahankal, Subhiksha Mukuntharaj, Meghana D. Parab, Malvika Mohan, Meredith Berger, Arathi Sethumadhavan, Ashish Jaiman, Rahul Dodhia arXiv_AI arXiv_AI Transformer OCR Bert Deep_Learning Detection PDF
2021-06-03 The Case for Translation-Invariant Self-Attention in Transformer-Based Language Models Ulme Wennberg, Gustav Eje Henter arXiv_AI arXiv_AI Transformer Embedding Bert Pose Attention Language_Model PDF
2021-06-03 An Improved Model for Voicing Silent Speech David Gaddy, Dan Klein arXiv_CL arXiv_CL Transformer Speech CNN PDF
2021-06-03 A Comparison for Anti-noise Robustness of Deep Learning Classification Methods on a Tiny Object Image Dataset: from Convolutional Neural Network to Visual Transformer and Performer Ao Chen, Chen Li, Haoyuan Chen, Hechen Yang, Peng Zhao, Weiming Hu, Wanli Liu, Shuojia Zou, Marcin Grzegorzek arXiv_CV arXiv_CV Transformer Review Adversarial Classification Deep_Learning CNN Image_Classification PDF
2021-06-03 E2E-VLP: End-to-End Vision-Language Pre-training Enhanced by Visual Learning Haiyang Xu, Ming Yan, Chenliang Li, Bin Bi, Songfang Huang, Wenming Xiao, Fei Huang arXiv_AI arXiv_AI Image_Caption Transformer Embedding Pose Face Detection Object_Detection Caption PDF
2021-06-03 Auto-tagging of Short Conversational Sentences using Transformer Methods D. Emre Taşar, Şükrü Ozan, Umut Özdil, M. Fatih Akca, Oğuzhan Ölmez, Semih Gülüm, Seçilay Kutal, Ceren Belhan arXiv_CL arXiv_CL Transformer Bert Speech Pose Classification PDF
2021-06-03 Attention mechanisms and deep learning for machine vision: A survey of the state of the art Abdul Mueed Hafiz, Shabir Ahmad Parah, Rouf Ul Alam Bhat arXiv_AI arXiv_AI Transformer Survey Deep_Learning Attention PDF
2021-06-03 Tail-to-Tail Non-Autoregressive Sequence Prediction for Chinese Grammatical Error Correction Piji Li, Shuming Shi arXiv_AI arXiv_AI Transformer Bert Detection Prediction PDF
2021-06-03 Self-Guided Contrastive Learning for BERT Sentence Representations Taeuk Kim, Kang Min Yoo, Sang-goo Lee arXiv_AI arXiv_AI Transformer Embedding Bert Represenation_Learning Self-Supervised Pose Contrastive_Learning Inference PDF
2021-06-03 When Vision Transformers Outperform ResNets without Pretraining or Strong Data Augmentations Xiangning Chen, Cho-Jui Hsieh, Boqing Gong arXiv_CV arXiv_CV Transformer Transfer_Learning Optimization Sparse Adversarial Pose Attention Inference PDF
2021-06-03 Luna: Linear Unified Nested Attention Xuezhe Ma, Xiang Kong, Sinong Wang, Chunting Zhou, Jonathan May, Hao Ma, Luke Zettlemoyer arXiv_CL arXiv_CL Transformer Pose Attention Language_Model PDF
2021-06-02 Container: Context Aggregation Network Peng Gao, Jiasen Lu, Hongsheng Li, Roozbeh Mottaghi, Aniruddha Kembhavi arXiv_CV arXiv_CV Transformer Segmentation Self-Supervised Pose Action Detection Object_Detection CNN PDF
2021-06-02 Decision Transformer: Reinforcement Learning via Sequence Modeling Lili Chen, Kevin Lu, Aravind Rajeswaran, Kimin Lee, Aditya Grover, Michael Laskin, Pieter Abbeel, Aravind Srinivas, Igor Mordatch arXiv_AI arXiv_AI Transformer Reinforcement_Learning Bert Action Language_Model PDF
2021-06-02 On the Distribution, Sparsity, and Inference-time Quantization of Attention Values in Transformers Tianchu Ji, Shraddhan Jain, Michael Ferdman, Peter Milder, H. Andrew Schwartz, Niranjan Balasubramanian arXiv_CL arXiv_CL Transformer Quantization Bert Optimization Sentiment Attention Inference PDF
2021-06-02 Enriching Transformers with Structured Tensor-Product Representations for Abstractive Summarization Yichen Jiang, Asli Celikyilmaz, Paul Smolensky, Paul Soulos, Sudha Rao, Hamid Palangi, Roland Fernandez, Caitlin Smith, Mohit Bansal, Jianfeng Gao arXiv_AI arXiv_AI Transformer Salient Relation Summarization PDF
2021-06-02 More Identifiable yet Equally Performant Transformers for Text Classification Rishabh Bhardwaj, Navonil Majumder, Soujanya Poria, Eduard Hovy arXiv_CL arXiv_CL Transformer Text_Classification Classification Relation Attention Prediction PDF
2021-06-02 IrEne: Interpretable Energy Prediction for Transformers Qingqing Cao, Yash Kumar Lal, Harsh Trivedi, Aruna Balasubramanian, Niranjan Balasubramanian arXiv_CL arXiv_CL Transformer Action Inference Prediction PDF
2021-06-02 T-BERT -- Model for Sentiment Analysis of Micro-blogs Integrating Topic Model and BERT Sarojadevi Palani, Prabhu Rajagopal, Sidharth Pancholi arXiv_AI arXiv_AI Transformer Embedding Unsupervised Bert Sentiment_Classification Pose Classification Sentiment PDF
2021-06-02 SyGNS: A Systematic Generalization Testbed Based on Natural Language Semantics Hitomi Yanaka, Koji Mineshima, Kentaro Inui arXiv_CL arXiv_CL Transformer Pose PDF
2021-06-02 Database Reasoning Over Text James Thorne, Majid Yazdani, Marzieh Saeidi, Fabrizio Silvestri, Sebastian Riedel, Alon Halevy arXiv_AI arXiv_AI Transformer Pose PDF
2021-06-02 Evidence-based Factual Error Correction James Thorne, Andreas Vlachos arXiv_AI arXiv_AI Transformer PDF
2021-06-02 Topic-Driven and Knowledge-Aware Transformer for Dialogue Emotion Detection Lixing Zhu, Gabriele Pergola, Lin Gui, Deyu Zhou, Yulan He arXiv_CL arXiv_CL Transformer Knowledge Pose Emotion Quantitative Detection Language_Model Prediction PDF
2021-06-02 Rethinking Cross-modal Interaction from a Top-down Perspective for Referring Video Object Segmentation Chen Liang, Yu Wu, Tianfei Zhou, Wenguan Wang, Zongxin Yang, Yunchao Wei, Yi Yang arXiv_CV arXiv_CV Transformer Segmentation Pose Action Relation Visual_Relation PDF
2021-06-02 Examining the Inductive Bias of Neural Language Models with Artificial Languages Jennifer C. White, Ryan Cotterell arXiv_CL arXiv_CL Transformer RNN Pose Language_Model PDF
2021-06-02 Hi-Transformer: Hierarchical Interactive Transformer for Efficient and Effective Long Document Modeling Chuhan Wu, Fangzhao Wu, Tao Qi, Yongfeng Huang arXiv_CL arXiv_CL Transformer Embedding Pose PDF
2021-06-02 Who Blames or Endorses Whom? Entity-to-Entity Directed Sentiment Extraction in News Text Kunwoo Park, Zhufeng Pan, Jungseock Joo arXiv_CL arXiv_CL Transformer Pose Action Relation Sentiment PDF
2021-06-02 A Span Extraction Approach for Information Extraction on Visually-Rich Documents Tuan-Anh D. Nguyen, Hieu M. Vu, Nguyen Hong Son, Minh-Tien Nguyen arXiv_AI arXiv_AI Transformer Knowledge Pose Action Relation Language_Model PDF
2021-06-02 Answer Generation for Retrieval-based Question Answering Systems Chao-Chun Hsu, Eric Lind, Luca Soldaini, Alessandro Moschitti arXiv_CL arXiv_CL Transformer Pose QA PDF
2021-06-02 Unsupervised Out-of-Domain Detection via Pre-trained Transformers Keyang Xu, Tongzheng Ren, Shikun Zhang, Yihao Feng, Caiming Xiong arXiv_CL arXiv_CL Transformer Unsupervised Pose Classification Detection Object_Detection PDF
2021-06-02 TransMIL: Transformer based Correlated Multiple Instance Learning for Whole Slide Image Classication Zhuchen Shao, Hao Bian, Yang Chen, Yifeng Wang, Jian Zhang, Xiangyang Ji, Yongbing Zhang arXiv_CV arXiv_CV Transformer Weakly_Supervised Pose Classification Relation PDF
2021-06-02 Solving Arithmetic Word Problems with Transformers and Preprocessing of Problem Text Kaden Griffith, Jugal Kalita arXiv_CL arXiv_CL Transformer PDF
2021-06-01 Comparing Test Sets with Item Response Theory Clara Vania, Phu Mon Htut, William Huang, Dhara Mungra, Richard Yuanzhe Pang, Jason Phang, Haokun Liu, Kyunghyun Cho, Samuel R. Bowman arXiv_CL arXiv_CL Transformer Prediction QA PDF
2021-06-01 On using distributed representations of source code for the detection of C security vulnerabilities David Coimbra, Sofia Reis, Rui Abreu, Corina Păsăreanu, Hakan Erdogmus arXiv_AI arXiv_AI Transformer Bert Detection PDF
2021-06-01 Implicit Representations of Meaning in Neural Language Models Belinda Z. Li, Maxwell Nye, Jacob Andreas arXiv_CL arXiv_CL Transformer Face Relation Language_Model Prediction PDF
2021-06-01 You Only Look at One Sequence: Rethinking Transformer in Vision through Object Detection Yuxin Fang, Bencheng Liao, Xinggang Wang, Jiemin Fang, Jiyang Qi, Rui Wu, Jianwei Niu, Wenyu Liu arXiv_AI arXiv_AI Transformer Recognition Bert Knowledge Detection Object_Detection PDF
2021-06-01 Validating GAN-BioBERT: A Methodology For Assessing Reporting Trends In Clinical Trials Joshua J Myszewski, Emily Klossowski, Patrick Meyer, Kristin Bevil, Lisa Klesius, Kristopher M Schroeder arXiv_CL arXiv_CL Transformer Bert Sentiment_Classification Pose Classification Sentiment Attention GAN PDF
2021-06-01 TransVOS: Video Object Segmentation with Transformers Jianbiao Mei, Mengmeng Wang, Yeneng Lin, Yong Liu arXiv_AI arXiv_AI Transformer Segmentation Pose Relation PDF
2021-06-01 Predicting Vehicles Trajectories in Urban Scenarios with Transformer Networks and Augmented Information A. Quintanar, D. Fernández-Llorca, I. Parra, R. Izquierdo, M. A. Sotelo arXiv_CV arXiv_CV Transformer Action Prediction PDF
2021-06-01 Cooperative Multi-Agent Transfer Learning with Level-Adaptive Credit Assignment Tianze Zhou, Fubiao Zhang, Kun Shao, Kai Li, Wenhan Huang, Jun Luo, Weixun Wang, Yaodong Yang, Hangyu Mao, Bin Wang, Dong Li, Wulong Liu, Jianye Hao arXiv_AI arXiv_AI Transformer Transfer_Learning Reinforcement_Learning Knowledge Pose Attention PDF
2021-06-01 CIDER: Commonsense Inference for Dialogue Explanation and Reasoning Deepanway Ghosal, Pengfei Hong, Siqi Shen, Navonil Majumder, Rada Mihalcea, Soujanya Poria arXiv_AI arXiv_AI Transformer Knowledge Pose Action Inference PDF
2021-06-01 THG: Transformer with Hyperbolic Geometry Zhe Liu, Yibin Xu arXiv_AI arXiv_AI Transformer Pose Classification Deep_Learning Attention PDF
2021-06-01 DoT: An efficient Double Transformer for NLP tasks with tables Syrine Krichene, Thomas Müller, Julian Martin Eisenschlos arXiv_CL arXiv_CL Transformer Pose Attention Inference PDF
2021-06-01 Towards Efficient Cross-Modal Visual Textual Retrieval using Transformer-Encoder Deep Features Nicola Messina, Giuseppe Amato, Fabrizio Falchi, Claudio Gennaro, Stéphane Marchand-Maillet arXiv_CV arXiv_CV Transformer Attention Caption Matching PDF
2021-06-01 Preview, Attend and Review: Schema-Aware Curriculum Learning for Multi-Domain Dialog State Tracking Yinpei Dai, Hangyu Li, Yongbin Li, Jian Sun, Fei Huang, Luo Si, Xiaodan Zhu arXiv_CL arXiv_CL Transformer Tracking RNN Review Pose PDF
2021-06-01 Question-aware Transformer Models for Consumer Health Question Summarization Shweta Yadav, Deepak Gupta, Asma Ben Abacha, Dina Demner-Fushman arXiv_CL arXiv_CL Transformer Recognition Pose Summarization Medical PDF
2021-06-01 Multilingual Speech Translation with Unified Transformer: Huawei Noah's Ark Lab at IWSLT 2021 Xingshan Zeng, Liangyou Li, Qun Liu arXiv_CL arXiv_CL Transformer Recognition Zero-Shot Speech Speech_Recognition PDF
2021-06-01 Gender Bias Amplification During Speed-Quality Optimization in Neural Machine Translation Adithya Renduchintala, Denise Diaz, Kenneth Heafield, Xian Li, Mona Diab arXiv_CL arXiv_CL Transformer Quantization Optimization NMT Attention PDF
2021-05-31 An Exploratory Analysis of Multilingual Word-Level Quality Estimation with Cross-Lingual Transformers Tharindu Ranasinghe, Constantin Orasan, Ruslan Mitkov arXiv_AI arXiv_AI Transformer Zero-Shot Pose Few-Shot PDF
2021-05-31 SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformers Enze Xie, Wenhai Wang, Zhiding Yu, Anima Anandkumar, Jose M. Alvarez, Ping Luo arXiv_CV arXiv_CV Transformer Segmentation Semantic_Segmentation Zero-Shot Pose Attention PDF
2021-05-31 MSG-Transformer: Exchanging Local Spatial Information by Manipulating Messenger Tokens Jiemin Fang, Lingxi Xie, Xinggang Wang, Xiaopeng Zhang, Wenyu Liu, Qi Tian arXiv_CV arXiv_CV Transformer Recognition Pose Classification Detection Object_Detection Attention CNN Image_Classification Inference PDF
2021-05-31 Analogous to Evolutionary Algorithm: Designing a Unified Sequence Model Jiangning Zhang, Chao Xu, Jian Li, Wenzhou Chen, Yabiao Wang, Ying Tai, Shuo Chen, Chengjie Wang, Feiyue Huang, Yong Liu arXiv_CV arXiv_CV Transformer Image_Retrieval Pose Classification PDF
2021-05-31 Beyond Noise: Mitigating the Impact of Fine-grained Semantic Divergences on Neural Machine Translation Eleftheria Briakou, Marine Carpuat arXiv_CL arXiv_CL Transformer NMT Prediction PDF
2021-05-31 Exploring Sparse Expert Models and Beyond An Yang, Junyang Lin, Rui Men, Chang Zhou, Le Jiang, Xianyan Jia, Ang Wang, Jie Zhang, Jiamang Wang, Yong Li, Di Zhang, Wei Lin, Lin Qu, Jingren Zhou, Hongxia Yang arXiv_CL arXiv_CL Transformer Sparse Pose PDF
2021-05-31 Can Attention Enable MLPs To Catch Up With CNNs? Meng-Hao Guo, Zheng-Ning Liu, Tai-Jiang Mu, Dun Liang, Ralph R. Martin, Shi-Min Hu arXiv_CV arXiv_CV Transformer Pose Face Attention CNN PDF
2021-05-31 SDNet: mutil-branch for single image deraining using swin Fuxiang Tan, YuTing Kong, Yingying Fan, Feng Liu, Daxin Zhou, Hao zhang, Long Chen, Liang Gao, Yurong Qian arXiv_CV arXiv_CV Transformer Pose Action CNN Autonomous Inference PDF
2021-05-31 Not All Images are Worth 16x16 Words: Dynamic Vision Transformers with Adaptive Sequence Length Yulin Wang, Rui Huang, Shiji Song, Zeyi Huang, Gao Huang arXiv_AI arXiv_AI Transformer Recognition Pose Action Relation Inference Prediction PDF
2021-05-31 Telling Stories through Multi-User Dialogue by Modeling Character Relations Wai Man Si, Prithviraj Ammanabrolu, Mark O. Riedl arXiv_AI arXiv_AI Transformer Relation PDF
2021-05-31 VidFace: A Full-Transformer Solver for Video FaceHallucination with Unaligned Tiny Snapshots Yuan Gan, Yawei Luo, Xin Yu, Bang Zhang, Yi Yang arXiv_CV arXiv_CV Transformer Embedding Knowledge Pose Face PDF
2021-05-31 Connecting Language and Vision for Natural Language-Based Vehicle Retrieval Shuai Bai, Zhedong Zheng, Xiaohan Wang, Junyang Lin, Zhu Zhang, Chang Zhou, Yi Yang, Hongxia Yang arXiv_CV arXiv_CV Transformer Tracking Optimization Pose Quantitative Re-identification Language_Model Matching PDF
2021-05-31 Verdi: Quality Estimation and Error Detection for Bilingual Mingjun Zhao, Haijiang Wu, Di Niu, Zixuan Wang, Xiaoli Wang arXiv_AI arXiv_AI Transformer Pose NMT Detection Language_Model Prediction PDF
2021-05-31 Cascaded Head-colliding Attention Lin Zheng, Zhiyong Wu, Lingpeng Kong arXiv_CL arXiv_CL Transformer Action Attention Language_Model PDF
2021-05-31 Greedy Layer Pruning: Decreasing Inference Time of Transformer Models David Peer, Sebastian Stabinger, Stefan Engl, Antonio Rodriguez-Sanchez arXiv_CL arXiv_CL Transformer Unsupervised Knowledge Inference PDF
2021-05-31 G-Transformer for Document-level Machine Translation Guangsheng Bao, Yue Zhang, Zhiyang Teng, Boxing Chen, Weihua Luo arXiv_CL arXiv_CL Transformer Pose Attention PDF
2021-05-31 Dual-stream Network for Visual Recognition Mingyuan Mao, Renrui Zhang, Honghui Zheng, Peng Gao, Teli Ma, Yan Peng, Errui Ding, Shumin Han arXiv_CV arXiv_CV Transformer Segmentation Recognition Pose Actio