Transformer

Transformer

• 2022-01-21 Improving Across-Dataset Brain Tissue Segmentation Using Transformer    Vishwanatha M. Rao, Zihan Wan, David J. Ma, Pin-Yu Lee, Ye Tian, Andrew F. Laine, Jia Guo arXiv_CV arXiv_CV  Transformer  Segmentation  3D  Relation  Medical  CNN  PDF
• 2022-01-21 Less is Less: When Are Snippets Insufficient for Human vs Machine Relevance Estimation?    Gabriella Kazai, Bhaskar Mitra, Anlei Dong, Nick Craswell, Linjun Yang arXiv_AI arXiv_AI  Transformer  Bert  Pose  PDF
• 2022-01-21 A Comprehensive Study of Vision Transformers on Dense Prediction Tasks    Kishaan Jeeveswaran, Senthilkumar Kathiresan, Arnav Varma, Omar Magdy, Bahram Zonooz, Elahe Arani arXiv_CV arXiv_CV  Transformer  Segmentation  Semantic_Segmentation  Adversarial  Pose  Detection  Object_Detection  Attention  CNN  Prediction  PDF
• 2022-01-21 Fast Differentiable Matrix Square Root    Yue Song, Nicu Sebe, Wei Wang arXiv_CV arXiv_CV  Transformer  Pose  PDF
• 2022-01-21 SegTransVAE: Hybrid CNN -- Transformer with Regularization for medical image segmentation    Quan-Dung Pham (1), Hai Nguyen-Truong (1, 2 and 3), Nam Nguyen Phuong (1), Khoa N. A. Nguyen (1, 2 and 3) ((1) VinBrain JSC., Vietnam, (2) University of Science, Ho Chi Minh City, Vietnam, (3) Vietnam National University, Ho Chi Minh City, Vietnam) arXiv_CV arXiv_CV  Transformer  Segmentation  Regularization  Knowledge  Pose  Deep_Learning  Medical  Inference  PDF
• 2022-01-20 MeMViT: Memory-Augmented Multiscale Vision Transformer for Efficient Long-Term Video Recognition    Chao-Yuan Wu, Yanghao Li, Karttikeya Mangalam, Haoqi Fan, Bo Xiong, Jitendra Malik, Christoph Feichtenhofer arXiv_CV arXiv_CV  Transformer  Recognition  Pose  Action  Classification  PDF
• 2022-01-20 Omnivore: A Single Model for Many Visual Modalities    Rohit Girdhar, Mannat Singh, Nikhila Ravi, Laurens van der Maaten, Armand Joulin, Ishan Misra arXiv_AI arXiv_AI  Transformer  Recognition  3D  Pose  Classification  PDF
• 2022-01-20 LaMDA: Language Models for Dialog Applications    Romal Thoppilan, Daniel De Freitas, Jamie Hall, Noam Shazeer, Apoorv Kulshreshtha, Heng-Tze Cheng, Alicia Jin, Taylor Bos, Leslie Baker, Yu Du, YaGuang Li, Hongrae Lee, Huaixiu Steven Zheng, Amin Ghafouri, Marcelo Menegali, Yanping Huang, Maxim Krikun, Dmitry Lepikhin, James Qin, Dehao Chen, Yuanzhong Xu, Zhifeng Chen, Adam Roberts, Maarten Bosma, Yanqi Zhou, Chung-Ching Chang, Igor Krivokon, Will Rusch, Marc Pickett, Kathleen Meier-Hellstern, Meredith Ringel Morris, Tulsee Doshi, Renelito Delos Santos, Toju Duke, Johnny Soraker, Ben Zevenbergen, Vinodkumar Prabhakaran, Mark Diaz, Ben Hutchinson, Kristen Olson, Alejandra Molina, Erin Hoffman-John, Josh Lee, Lora Aroyo, Ravi Rajakumar, Alena Butryna, Matthew Lamm, Viktoriya Kuzmina, Joe Fenton, Aaron Cohen, Rachel Bernstein, Ray Kurzweil, et al. (5 additional authors not shown) arXiv_AI arXiv_AI  Transformer  Knowledge  Language_Model  Recommendation  PDF
• 2022-01-20 HumanIBR: High Quality Image-based Rendering of Challenging Human Performers using Sparse Views    Tiansong Zhou, Tao Yu, Ruizhi Shao, Kun Li arXiv_CV arXiv_CV  Transformer  Reconstruction  Sparse  Pose  Relation  PDF
• 2022-01-20 Cross-Lingual Text-to-Speech Using Multi-Task Learning and Speaker Classifier Joint Training    J. Yang, Lei He arXiv_AI arXiv_AI  Transformer  Speech  Pose  PDF
• 2022-01-20 TerViT: An Efficient Ternary Vision Transformer    Sheng Xu, Yanjing Li, Teli Ma, Bohan Zeng, Baochang Zhang, Peng Gao, Jinhu Lu arXiv_CV arXiv_CV  Transformer  Optimization  Face  PDF
• 2022-01-19 Look Closer: Bridging Egocentric and Third-Person Views with Transformers for Robotic Manipulation    Rishabh Jangir, Nicklas Hansen, Sambaral Ghosal, Mohit Jain, Xiaolong Wang arXiv_RO arXiv_RO  Transformer  Reinforcement_Learning  Pose  Attention  PDF
• 2022-01-19 Q-ViT: Fully Differentiable Quantization for Vision Transformer    Zhexin Li, Tong Yang, Peisong Wang, Jian Cheng arXiv_CV arXiv_CV  Transformer  Quantization  Pose  Attention  PDF
• 2022-01-19 Uncovering More Shallow Heuristics: Probing the Natural Language Inference Capacities of Transformer-Based Pre-Trained Language Models Using Syllogistic Patterns    Reto Gubelmann, Siegfried Handschuh arXiv_CL arXiv_CL  Transformer  Inference  Language_Model  PDF
• 2022-01-19 TransFuse: A Unified Transformer-based Image Fusion Framework using Self-supervised Learning    Linhao Qu, Shaolei Liu, Manning Wang, Shiman Li, Siqi Yin, Qin Qiao, Zhijian Song arXiv_CV arXiv_CV  Transformer  Reconstruction  Optimization  Self-Supervised  Pose  Action  PDF
• 2022-01-19 TourBERT: A pretrained language model for the tourism industry    Veronika Arefieva, Roman Egger arXiv_CL arXiv_CL  Transformer  Bert  Language_Model  PDF
• 2022-01-19 Global-Local Path Networks for Monocular Depth Estimation with Vertical CutDepth    Doyeon Kim, Woonghyun Ga, Pyungwhan Ahn, Donggyu Joo, Sehwan Chun, Junmo Kim arXiv_CV arXiv_CV  Transformer  Pose  CNN  Prediction  PDF
• 2022-01-19 GAP-Gen: Guided Automatic Python Code Generation    Junchen Zhao, Yurun Song, Junlin Wang, Ian G. Harris arXiv_CL arXiv_CL  Transformer  Pose  Language_Model  PDF
• 2022-01-19 Interpreting Arabic Transformer Models    Ahmed Abdelali, Nadir Durrani, Fahim Dalvi, Hassan Sajjad arXiv_CL arXiv_CL  Transformer  Embedding  Knowledge  Face  Language_Model  PDF
• 2022-01-19 Cross-Language Binary-Source Code Matching with Intermediate Representations    Yi Gui, Yao Wan, Hongyu Zhang, Huifang Huang, Yulei Sui, Guandong Xu, Zhiyuan Shao, Hai Jin arXiv_AI arXiv_AI  Transformer  Embedding  Pose  Detection  Matching  PDF
• 2022-01-19 Poseur: Direct Human Pose Regression with Transformers    Weian Mao, Yongtao Ge, Chunhua Shen, Zhi Tian, Xinlong Wang, Zhibin Wang, Anton van den Hengel arXiv_CV arXiv_CV  Transformer  Pose_Estimation  Pose  Attention  Prediction  PDF
• 2022-01-19 Neural Language Models are Effective Plagiarists    Stella Biderman, Edward Raff arXiv_CL arXiv_CL  Transformer  Detection  Language_Model  PDF
• 2022-01-19 Swin-Pose: Swin Transformer Based Human Pose Estimation    Zinan Xiong, Chenxi Wang, Ying Li, Yan Luo, Yu Cao arXiv_CV arXiv_CV  Transformer  Pose_Estimation  Pose  CNN  PDF
• 2022-01-18 Annotating the Tweebank Corpus on Named Entity Recognition and Building NLP Models for Social Media Analysis    Hang Jiang, Yining Hua, Doug Beeferman, Deb Roy arXiv_CL arXiv_CL  Transformer  Recognition  Speech  Pose  PDF
• 2022-01-18 Boosting Robustness of Image Matting with Context Assembling and Strong Data Augmentation    Yutong Dai, Brian Price, He Zhang, Chunhua Shen arXiv_CV arXiv_CV  Transformer  Image_Matting  Pose  Attention  PDF
• 2022-01-18 Syntax-based data augmentation for Hungarian-English machine translation    Attila Nagy, Patrick Nanys, Balázs Frey Konrád, Bence Bial, Judit Ács arXiv_CL arXiv_CL  Transformer  PDF
• 2022-01-18 RePre: Improving Self-Supervised Vision Transformer with Reconstructive Pre-training    Luya Wang, Feng Liang, Yangguang Li, Wanli Ouyang, Honggang Zhang, Jing Shao arXiv_AI arXiv_AI  Transformer  Represenation_Learning  Self-Supervised  Contrastive_Learning  Attention  PDF
• 2022-01-18 Resistance Training using Prior Bias: toward Unbiased Scene Graph Generation    Chao Chen, Yibing Zhan, Baosheng Yu, Liu Liu, Yong Luo, Bo Du arXiv_CV arXiv_CV  Transformer  Pose  Relation  PDF
• 2022-01-18 Hierarchical Neural Network Approaches for Long Document Classification    Snehal Khandve, Vedangi Wagh, Apurva Wani, Isha Joshi, Raviraj Joshi arXiv_CL arXiv_CL  Transformer  Transfer_Learning  Bert  Text_Classification  RNN  Pose  Classification  Deep_Learning  Relation  Attention  PDF
• 2022-01-18 Emojis as Anchors to Detect Arabic Offensive Language and Hate Speech    Hamdy Mubarak, Sabit Hassan, Shammur Absar Chowdhury arXiv_CL arXiv_CL  Transformer  Speech  Pose  Face  Classification  PDF
• 2022-01-18 GTrans: Spatiotemporal Autoregressive Transformer with Graph Embeddings for Nowcasting Extreme Events    Bo Feng, Geoffrey Fox arXiv_AI arXiv_AI  Transformer  Embedding  Pose  Relation  Attention  GAN  CNN  Prediction  PDF
• 2022-01-17 VAQF: Fully Automatic Software-hardware Co-design Framework for Low-bit Vision Transformer    Mengshu Sun, Haoyu Ma, Guoliang Kang, Yifan Jiang, Tianlong Chen, Xiaolong Ma, Zhangyang Wang, Yanzhi Wang arXiv_CV arXiv_CV  Transformer  Quantization  Knowledge  Pose  Attention  Inference  PDF
• 2022-01-17 RuMedBench: A Russian Medical Language Understanding Benchmark    Pavel Blinov, Arina Reshetnikova, Aleksandr Nesterov, Galina Zubkova, Vladimir Kokh arXiv_CL arXiv_CL  Transformer  Recognition  Knowledge  Classification  Medical  Inference  PDF
• 2022-01-17 ArCovidVac: Analyzing Arabic Tweets About COVID-19 Vaccination    Hamdy Mubarak, Sabit Hassan, Shammur Absar Chowdhury, Firoj Alam arXiv_CL arXiv_CL  Transformer  Action  Detection  PDF
• 2022-01-17 SwinUNet3D -- A Hierarchical Architecture for Deep Traffic Prediction using Shifted Window Transformers    Alabi Bojesomo, Hasan Al Marzouqi, Panos Liatsis arXiv_CV arXiv_CV  Transformer  3D  Pose  Action  Relation  Prediction  PDF
• 2022-01-17 RestoreFormer: High-Quality Blind Face Restoration From Undegraded Key-Value Pairs    Zhouxia Wang, Jiawei Zhang, Runjian Chen, Wenping Wang, Ping Luo arXiv_CV arXiv_CV  Transformer  Reconstruction  Restoration  Pose  Face  Action  Attention  PDF
• 2022-01-17 Disentangled Latent Transformer for Interpretable Monocular Height Estimation    Zhitong Xiong Sining Chen, Yilei Shi, Xiao Xiang Zhu arXiv_CV arXiv_CV  Transformer  Segmentation  Unsupervised  Semantic_Segmentation  3D  Pose  PDF
• 2022-01-17 Language Model-Based Paired Variational Autoencoders for Robotic Language Learning    Ozan Özdemir, Matthias Kerzel, Cornelius Weber, Jae Hee Lee, Stefan Wermter arXiv_RO arXiv_RO  Transformer  Recognition  Bert  Action  Language_Model  PDF
• 2022-01-17 Continual Transformers: Redundancy-Free Attention for Online Inference    Lukas Hedegaard, Arian Bakhtiarnia, Alexandros Iosifidis arXiv_AI arXiv_AI  Transformer  Pose  Action  Classification  Detection  Attention  Inference  PDF
• 2022-01-17 Automatic Segmentation of Head and Neck Tumor: How Powerful Transformers Are?    Ikboljon Sobirov, Otabek Nazarov, Hussain Alasmawi, Mohammad Yaqub arXiv_CV arXiv_CV  Transformer  Segmentation  Deep_Learning  CNN  PDF
• 2022-01-17 Korean-Specific Dataset for Table Question Answering    Changwook Jun, Jooyoung Choi, Myoseop Sim, Hyun Kim, Hansol Jang, Kyungkoo Min arXiv_CL arXiv_CL  Transformer  Unsupervised  Relation  Language_Model  PDF
• 2022-01-17 Evaluation of HTR models without Ground Truth Material    Phillip Benjamin Ströbel, Simon Clematide, Martin Volk, Raphael Schwitter, Tobias Hodel, David Schoch arXiv_CL arXiv_CL  Transformer  Recognition  Face  Language_Model  PDF
• 2022-01-16 Is it Possible to Predict MGMT Promoter Methylation from Brain Tumor MRI Scans using Deep Learning Models?    Numan Saeed, Shahad Hardan, Kudaibergen Abutalip, Mohammad Yaqub arXiv_CV arXiv_CV  Transformer  3D  Pose  Deep_Learning  PDF
• 2022-01-16 Sequential Recommendation via Stochastic Self-Attention    Ziwei Fan, Zhiwei Liu, Yu Wang, Alice Wang, Zahra Nazari, Lei Zheng, Hao Peng, Philip S. Yu arXiv_AI arXiv_AI  Transformer  Optimization  Regularization  Pose  Relation  Attention  Recommendation  PDF
• 2022-01-16 Video Transformers: A Survey    Javier Selva, Anders S. Johansen, Sergio Escalera, Kamal Nasrollahi, Thomas B. Moeslund, Albert Clapés arXiv_CV arXiv_CV  Transformer  3D  Self-Supervised  Survey  Action  Classification  Attention  PDF
• 2022-01-16 In Situ Answer Sentence Selection at Web-scale    Zeyu Zhang, Thuy Vu, Alessandro Moschitti arXiv_CL arXiv_CL  Transformer  Pose  Inference  QA  PDF
• 2022-01-16 Double Retrieval and Ranking for Accurate Question Answering    Zeyu Zhang, Thuy Vu, Alessandro Moschitti arXiv_CL arXiv_CL  Transformer  Embedding  PDF
• 2022-01-15 ViTBIS: Vision Transformer for Biomedical Image Segmentation    Abhinav Sagar arXiv_CV arXiv_CV  Transformer  Segmentation  Pose  Attention  GAN  Medical  PDF
• 2022-01-15 Domain Adaptation via Bidirectional Cross-Attention Transformer    Xiyu Wang, Pengxin Guo, Yu Zhang arXiv_CV arXiv_CV  Transformer  Knowledge  Pose  Attention  PDF
• 2022-01-15 ConvMixer: Feature Interactive Convolution with Curriculum Learning for Small Footprint and Noisy Far-field Keyword Spotting    Dianwen Ng, Yunqi Chen, Biao Tian, Qiang Fu, Eng Siong Chng arXiv_SD arXiv_SD  Transformer  Speech  Pose  Attention  CNN  PDF
• 2022-01-15 Spectral Compressive Imaging Reconstruction Using Convolution and Spectral Contextual Transformer    Lishun Wang, Zongliang Wu, Yong Zhong, Xin Yuan arXiv_CV arXiv_CV  Transformer  Reconstruction  Pose  Face  PDF
• 2022-01-15 Ensemble Transformer for Efficient and Accurate Ranking Tasks: an Application to Question Answering Systems    Yoshitomo Matsubara, Luca Soldaini, Eric Lind, Alessandro Moschitti arXiv_CL arXiv_CL  Transformer  Knowledge  Pose  PDF
• 2022-01-15 Kformer: Knowledge Injection in Transformer Feed-Forward Layers    Yunzhi Yao, Shaohan Huang, Ningyu Zhang, Li Dong, Furu Wei, Huajun Chen arXiv_CL arXiv_CL  Transformer  Knowledge  Pose  Medical  Language_Model  QA  PDF
• 2022-01-14 Transformers in Action:Weakly Supervised Action Segmentation    John Ridley, Huseyin Coskun, David Joseph Tan, Nassir Navab, Federico Tombari arXiv_CV arXiv_CV  Transformer  Segmentation  Embedding  Weakly_Supervised  RNN  Salient  Pose  Action  Attention  Inference  PDF
• 2022-01-14 Czech Grammar Error Correction with a Large and Diverse Corpus    Jakub Náplava, Milan Straka, Jana Straková, Alexandr Rosen arXiv_CL arXiv_CL  Transformer  PDF
• 2022-01-14 The Dark Side of the Language: Pre-trained Transformers in the DarkNet    Leonardo Ranaldi, Aria Nourbakhsh, Arianna Patrizi, Elena Sofia Ruzzetti, Dario Onorati, Francesca Fallucchi Fabio Massimo Zanzotto arXiv_CL arXiv_CL  Transformer  Classification  GAN  PDF
• 2022-01-14 A Survey of Controllable Text Generation using Transformer-based Pre-trained Language Models    Hanqing Zhang, Haolin Song, Shaoyu Li, Ming Zhou, Dawei Song arXiv_CL arXiv_CL  Transformer  Knowledge  Review  Survey  Text_Generation  Language_Model  PDF
• 2022-01-14 MMNet: Muscle motion-guided network for micro-expression recognition    Hanting Li, Mingzhe Sui, Zhaoqing Zhu, Feng Zhao arXiv_CV arXiv_CV  Transformer  Embedding  Recognition  Pose  Face  Action  Attention  PDF
• 2022-01-13 Pushing the limits of self-supervised ResNets: Can we outperform supervised learning without labels on ImageNet?    Nenad Tomasev, Ioana Bica, Brian McWilliams, Lars Buesing, Razvan Pascanu, Charles Blundell, Jovana Mitrovic arXiv_CV arXiv_CV  Transformer  Represenation_Learning  Self-Supervised  Pose  Classification  PDF
• 2022-01-13 TransVOD: End-to-end Video Object Detection with Spatial-Temporal Transformers    Qianyu Zhou, Xiangtai Li, Lu He, Yibo Yang, Guangliang Cheng, Yunhai Tong, Lizhuang Ma, Dacheng Tao arXiv_CV arXiv_CV  Transformer  Pose  Detection  Relation  Object_Detection  Optical_Flow  Inference  PDF
• 2022-01-13 Technical Report for ICCV 2021 Challenge SSLAD-Track3B: Transformers Are Better Continual Learners    Duo Li, Guimei Cao, Yunlu Xu, Zhanzhan Cheng, Yi Niu arXiv_CV arXiv_CV  Transformer  Knowledge  Pose  Detection  Object_Detection  CNN  PDF
• 2022-01-13 Hand-Object Interaction Reasoning    Jian Ma, Dima Damen arXiv_CV arXiv_CV  Transformer  Recognition  Pose  Action_Recognition  Action  Relation  PDF
• 2022-01-12 Uniformer: Unified Transformer for Efficient Spatiotemporal Representation Learning    Kunchang Li, Yali Wang, Peng Gao, Guanglu Song, Yu Liu, Hongsheng Li, Yu Qiao arXiv_CV arXiv_CV  Transformer  3D  Represenation_Learning  Pose  Relation  Attention  CNN  PDF
• 2022-01-12 GateFormer: Speeding Up News Feed Recommendation with Input Gated Transformers    Peitian Zhang, Zheng liu arXiv_AI arXiv_AI  Transformer  Pose  Language_Model  Recommendation  PDF
• 2022-01-12 Multiview Transformers for Video Recognition    Shen Yan, Xuehan Xiong, Anurag Arnab, Zhichao Lu, Mi Zhang, Chen Sun, Cordelia Schmid arXiv_CV arXiv_CV  Transformer  Recognition  Video_Caption  PDF
• 2022-01-11 HyperTransformer: Model Generation for Supervised and Semi-Supervised Few-Shot Learning    Andrey Zhmoginov, Mark Sandler, Max Vladymyrov arXiv_CV arXiv_CV  Transformer  Embedding  Pose  Few-Shot  CNN  PDF
• 2022-01-11 Uni-EDEN: Universal Encoder-Decoder Network by Multi-Granular Vision-Language Pre-training    Yehao Li, Jiahao Fan, Yingwei Pan, Ting Yao, Weiyao Lin, Tao Mei arXiv_CV arXiv_CV  Image_Caption  Transformer  Knowledge  Action  Classification  VQA  Caption  Language_Model  Matching  PDF
• 2022-01-11 Pyramid Fusion Transformer for Semantic Segmentation    Zipeng Qin, Jianbo Liu, Xiaolin Zhang, Maoqing Tian, Aojun Zhou, Shuai Yi, Hongsheng Li arXiv_CV arXiv_CV  Transformer  Segmentation  Semantic_Segmentation  Pose  Classification  Attention  Inference  PDF
• 2022-01-11 On the Efficacy of Co-Attention Transformer Layers in Visual Question Answering    Ankur Sikarwar, Gabriel Kreiman arXiv_CV arXiv_CV  Transformer  Speech  Action  Quantitative  VQA  Attention  QA  PDF
• 2022-01-11 The GINCO Training Dataset for Web Genre Identification of Documents Out in the Wild    Taja Kuzman, Peter Rupnik, Nikola Ljubešić arXiv_CL arXiv_CL  Transformer  PDF
• 2022-01-10 A ConvNet for the 2020s    Zhuang Liu, Hanzi Mao, Chao-Yuan Wu, Christoph Feichtenhofer, Trevor Darrell, Saining Xie arXiv_CV arXiv_CV  Transformer  Segmentation  Semantic_Segmentation  Recognition  Face  Classification  Detection  Object_Detection  GAN  Image_Classification  PDF
• 2022-01-10 Language-driven Semantic Segmentation    Boyi Li, Kilian Q. Weinberger, Serge Belongie, Vladlen Koltun, René Ranftl arXiv_CV arXiv_CV  Transformer  Segmentation  Embedding  Semantic_Segmentation  Zero-Shot  Few-Shot  PDF
• 2022-01-10 Polish Natural Language Inference and Factivity -- an Expert-based Dataset and Benchmarks    Daniel Ziembicki, Anna Wróblewska, Karolina Seweryn arXiv_CL arXiv_CL  Transformer  Bert  Pose  Activity  Inference  Prediction  PDF
• 2022-01-10 TiltedBERT: Resource Adjustable Version of BERT    Sajjad Kachuee, Mohammad Sharifkhani arXiv_CL arXiv_CL  Transformer  Bert  Pose  Classification  Sentiment  Inference  PDF
• 2022-01-10 Swin Transformer for Fast MRI    Jiahao Huang, Yingying Fang, Yinzhe Wu, Huanjun Wu, Zhifan Gao, Yang Li, Javier Del Ser, Jun Xia, Guang Yang arXiv_AI arXiv_AI  Transformer  Reconstruction  Segmentation  Pose  Action  Deep_Learning  Attention  CNN  PDF
• 2022-01-10 Local Information Assisted Attention-free Decoder for Audio Captioning    Feiyang Xiao, Jian Guan, Qiaoxi Zhu, Haiyan Lan, Wenwu Wang arXiv_SD arXiv_SD  Transformer  Pose  Action  Attention  Caption  PDF
• 2022-01-10 Swin transformers make strong contextual encoders for VHR image road extraction    Tao Chen, Daguang Jiang, Ruirui Li arXiv_CV arXiv_CV  Transformer  Segmentation  Pose  Action  Deep_Learning  PDF
• 2022-01-10 Pedestrian Detection: Domain Generalization, CNNs, Transformers and Beyond    Irtiza Hasan, Shengcai Liao, Jinpeng Li, Saad Ullah Akram, Ling Shao arXiv_CV arXiv_CV  Transformer  Surveillance  Tracking  Object_Tracking  Pose  Deep_Learning  Detection  Object_Detection  Autonomous  PDF
• 2022-01-09 Semantic and sentiment analysis of selected Bhagavad Gita translations using BERT-based language framework    Rohitash Chandra, Venkatesh Kulkarni arXiv_AI arXiv_AI  Transformer  Embedding  Bert  Deep_Learning  Sentiment  Language_Model  PDF
• 2022-01-09 ImageSubject: A Large-scale Dataset for Subject Detection    Xin Miao, Jiayi Liu, Huayan Wang, Jun Fu arXiv_CV arXiv_CV  Transformer  Salient  Detection  Object_Detection  PDF
• 2022-01-09 An Ensemble Approach to Acronym Extraction using Transformers    Prashant Sharma, Hadeel Saadany, Leonardo Zilio, Diptesh Kanojia, Constantin Orăsan arXiv_CL arXiv_CL  Transformer  Action  CNN  Language_Model  PDF
• 2022-01-09 Learning class prototypes from Synthetic InSAR with Vision Transformers    Nikolaos Ioannis Bountos, Dimitrios Michail, Ioannis Papoutsis arXiv_CV arXiv_CV  Transformer  Knowledge  Pose  Classification  Deep_Learning  Detection  CNN  PDF
• 2022-01-09 MAXIM: Multi-Axis MLP for Image Processing    Zhengzhong Tu, Hossein Talebi, Han Zhang, Feng Yang, Peyman Milanfar, Alan Bovik, Yinxiao Li arXiv_CV arXiv_CV  Transformer  Enhancement  Recognition  Restoration  Pose  Action  Denoising  Attention  CNN  PDF
• 2022-01-08 Spatio-Temporal Tuples Transformer for Skeleton-Based Action Recognition    Helei Qiu, Biao Hou, Bo Ren, Xiaohua Zhang arXiv_CV arXiv_CV  Transformer  Recognition  Pose  Action_Recognition  Action  Relation  Attention  PDF
• 2022-01-08 A Fair and Efficient Hybrid Federated Learning Framework based on XGBoost for Distributed Power Prediction    Haizhou Liu, Xuan Zhang, Xinwei Shen, Hongbin Sun arXiv_AI arXiv_AI  Transformer  Pose  GAN  Prediction  PDF
• 2022-01-08 QuadTree Attention for Vision Transformers    Shitao Tang, Jiahui Zhang, Siyu Zhu, Ping Tan arXiv_CV arXiv_CV  Transformer  Segmentation  Semantic_Segmentation  Pose  Classification  Detection  Object_Detection  Attention  Prediction  Matching  PDF
• 2022-01-07 Generalized Category Discovery    Sagar Vaze, Kai Han, Andrea Vedaldi, Andrew Zisserman arXiv_CV arXiv_CV  Transformer  Recognition  Represenation_Learning  Pose  Classification  PDF
• 2022-01-07 Learning Target-aware Representation for Visual Tracking via Informative Interactions    Mingzhe Guo, Zhipeng Zhang, Heng Fan, Liping Jing, Yilin Lyu, Bing Li, Weiming Hu arXiv_CV arXiv_CV  Transformer  Tracking  Represenation_Learning  Knowledge  Pose  Action  Matching  PDF
• 2022-01-07 Automatic Speech Recognition Datasets in Cantonese Language: A Survey and a New Dataset    Tiezheng Yu, Rita Frieske, Peng Xu, Samuel Cahyawijaya, Cheuk Tung Shadow Yiu, Holy Lovenia, Wenliang Dai, Elham J. Barezi, Qifeng Chen, Xiaojuan Ma, Bertram E. Shi, Pascale Fung arXiv_SD arXiv_SD  Transformer  Recognition  Review  Speech  Survey  Speech_Recognition  PDF
• 2022-01-07 The Defeat of the Winograd Schema Challenge    Vid Kocijan, Ernest Davis, Thomas Lukasiewicz, Gary Marcus, Leora Morgenstern arXiv_CL arXiv_CL  Transformer  Knowledge  Review  Pose  Language_Model  PDF
• 2022-01-06 TransVPR: Transformer-based place recognition with multi-level attention aggregation    Ruotong Wang, Yanqing Shen, Weiliang Zuo, Sanping Zhou, Nanning Zhen arXiv_CV arXiv_CV  Image_Caption  Transformer  Recognition  Attention  Autonomous  Matching  PDF
• 2022-01-06 Compact Bidirectional Transformer for Image Captioning    Yuanen Zhou, Zhenzhen Hu, Daqing Liu, Huixia Ben, Meng Wang arXiv_CV arXiv_CV  Image_Caption  Transformer  Regularization  Action  Caption  PDF
• 2022-01-06 Flow-Guided Sparse Transformer for Video Deblurring    Jing Lin, Yuanhao Cai, Xiaowan Hu, Haoqian Wang, Youliang Yan, Xueyi Zou, Henghui Ding, Yulun Zhang, Radu Timofte, Luc Van Gool arXiv_CV arXiv_CV  Transformer  Embedding  Sparse  Pose  Attention  Optical_Flow  PDF
• 2022-01-05 Lumbar Bone Mineral Density Estimation from Chest X-ray Images: Anatomy-aware Attentive Multi-ROI Modeling    Fakai Wang, Kang Zheng, Le Lu, Jing Xiao, Min Wu, Chang-Fu Kuo, Shun Miao arXiv_CV arXiv_CV  Transformer  Pose  Classification  Relation  Medical  PDF
• 2022-01-05 Does entity abstraction help generative Transformers reason?    Nicolas Gontier, Siva Reddy, Christopher Pal arXiv_AI arXiv_AI  Transformer  Embedding  Knowledge  Pose  Action  Relation  Language_Model  Prediction  QA  PDF
• 2022-01-05 Lawin Transformer: Improving Semantic Segmentation Transformer with Multi-Scale Representations via Large Window Attention    Haotian Yan, Chuang Zhang, Ming Wu arXiv_CV arXiv_CV  Transformer  Segmentation  Semantic_Segmentation  Pose  Classification  Attention  CNN  Image_Classification  PDF
• 2022-01-05 NumHTML: Numeric-Oriented Hierarchical Transformer Model for Multi-task Financial Forecasting    Linyi Yang, Jiazheng Li, Ruihai Dong, Yue Zhang, Barry Smyth arXiv_AI arXiv_AI  Transformer  Quantitative  Deep_Learning  Prediction  PDF
• 2022-01-04 ZeroBERTo -- Leveraging Zero-Shot Text Classification by Topic Modeling    Alexandre Alcoforado, Thomas Palmeira Ferraz, Rodrigo Gerber, Enzo Bustos, André Seidel Oliveira, Bruno Miguel Veloso, Fabio Levy Siqueira, Anna Helena Reali Costa arXiv_CL arXiv_CL  Transformer  Unsupervised  Bert  Zero-Shot  Text_Classification  Pose  Classification  Language_Model  PDF
• 2022-01-04 A Transformer-Based Siamese Network for Change Detection    Wele Gedara Chaminda Bandara, Vishal M. Patel arXiv_CV arXiv_CV  Transformer  Pose  Detection  CNN  PDF
• 2022-01-04 Swin UNETR: Swin Transformers for Semantic Segmentation of Brain Tumors in MRI Images    Ali Hatamizadeh, Vishwesh Nath, Yucheng Tang, Dong Yang, Holger Roth, Daguang Xu arXiv_CV arXiv_CV  Transformer  Segmentation  Embedding  Semantic_Segmentation  3D  Pose  Attention  Medical  CNN  Prediction  PDF
• 2022-01-04 Short Range Correlation Transformer for Occluded Person Re-Identification    Yunbin Zhao, Songhao Zhu, Dongsheng Wang, Zhiwei Liang arXiv_AI arXiv_AI  Transformer  Reconstruction  Person_Re-identification  Enhancement  Recognition  Pose  Face  Action  Relation  Attention  Re-identification  CNN  PDF
• 2022-01-04 PyramidTNT: Improved Transformer-in-Transformer Baselines with Pyramid Architecture    Kai Han, Jianyuan Guo, Yehui Tang, Yunhe Wang arXiv_CV arXiv_CV  Transformer  CNN  PDF
• 2022-01-04 Submix: Practical Private Prediction for Large-Scale Language Models    Antonio Ginart, Laurens van der Maaten, James Zou, Chuan Guo arXiv_AI arXiv_AI  Transformer  Pose  Action  Language_Model  Prediction  PDF
• 2022-01-04 Classifying Autism from Crowdsourced Semi-Structured Speech Recordings: A Machine Learning Approach    Nathan A. Chi, Peter Washington, Aaron Kline, Arman Husic, Cathy Hou, Chloe He, Kaitlyn Dunlap, Dennis Wall arXiv_SD arXiv_SD  Transformer  Speech  Attention  CNN  PDF
• 2022-01-03 Vision Transformer Slimming: Multi-Dimension Searching in Continuous Optimization Space    Arnav Chavan, Zhiqiang Shen, Zhuang Liu, Zechun Liu, Kwang-Ting Cheng, Eric Xing arXiv_CV arXiv_CV  Transformer  Optimization  PDF
• 2022-01-03 DFA-NeRF: Personalized Talking Head Generation via Disentangled Face Attributes Neural Rendering    Shunyu Yao, RuiZhe Zhong, Yichao Yan, Guangtao Zhai, Xiaokang Yang arXiv_CV arXiv_CV  Transformer  Pose  Face  PDF
• 2022-01-03 Toxicity Detection for Indic Multilingual Social Media Content    Manan Jhaveri, Devanshu Ramaiya, Harveen Singh Chadha arXiv_CL arXiv_CL  Transformer  Bert  Pose  Classification  Detection  PDF
• 2022-01-03 Which Student is Best? A Comprehensive Knowledge Distillation Exam for Task-Specific BERT Models    Made Nindyatama Nityasya, Haryo Akbarianto Wibowo, Rendi Chevi, Radityo Eko Prasojo, Alham Fikri Aji arXiv_CL arXiv_CL  Transformer  Embedding  Bert  Text_Classification  RNN  Knowledge  Pose  Classification  PDF
• 2022-01-03 Vision Transformer with Deformable Attention    Zhuofan Xia, Xuran Pan, Shiji Song, Li Erran Li, Gao Huang arXiv_CV arXiv_CV  Transformer  Sparse  Pose  Classification  Relation  Attention  Image_Classification  Prediction  PDF
• 2022-01-03 Language as Queries for Referring Video Object Segmentation    Jiannan Wu, Yi Jiang, Peize Sun, Zehuan Yuan, Ping Luo arXiv_CV arXiv_CV  Transformer  Segmentation  Tracking  Object_Tracking  Pose  PDF
• 2022-01-03 CaFT: Clustering and Filter on Tokens of Transformer for Weakly Supervised Object Localization    Ming Li arXiv_CV arXiv_CV  Transformer  Weakly_Supervised  Pose  Classification  Attention  PDF
• 2022-01-03 RFormer: Transformer-based Generative Adversarial Network for Real Fundus Image Restoration on A New Clinical Benchmark    Zhuo Deng, Yuanhao Cai, Lu Chen, Zheng Gong, Qiqi Bao, Xue Yao, Dong Fang, Shaochong Zhang, Lan Ma arXiv_CV arXiv_CV  Transformer  Segmentation  Restoration  Adversarial  Pose  Detection  Attention  PDF
• 2022-01-03 D-Former: A U-shaped Dilated Transformer for 3D Medical Image Segmentation    Yixuan Wu, Kuanlun Liao, Jintai Chen, Danny Z. Chen, Jinhong Wang, Honghao Gao, Jian Wu arXiv_AI arXiv_AI  Transformer  Segmentation  3D  Pose  Relation  Attention  GAN  Medical  CNN  PDF
• 2022-01-02 Splicing ViT Features for Semantic Appearance Transfer    Narek Tumanyan, Omer Bar-Tal, Shai Bagon, Tali Dekel arXiv_CV arXiv_CV  Transformer  Segmentation  Semantic_Segmentation  Adversarial  Pose  Attention  PDF
• 2022-01-02 Establishing Strong Baselines for TripClick Health Retrieval    Sebastian Hofstätter, Sophia Althammer, Mete Sertkan, Allan Hanbury arXiv_CL arXiv_CL  Transformer  PDF
• 2022-01-02 Detail-Preserving Transformer for Light Field Image Super-Resolution    Shunzhou Wang, Tianfei Zhou, Yao Lu, Huijun Di arXiv_CV arXiv_CV  Transformer  Reconstruction  Super_Resolution  Pose  Relation  Attention  PDF
• 2022-01-02 Towards Trustworthy AutoGrading of Short, Multi-lingual, Multi-type Answers    Johannes Schneider, Robin Richner, Micha Riser arXiv_CL arXiv_CL  Transformer  PDF
• 2022-01-02 Informed Multi-context Entity Alignment    Kexuan Xin, Zequn Sun, Wen Hua, Wei Hu, Xiaofang Zhou arXiv_CL arXiv_CL  Transformer  Embedding  Knowledge  Knowledge_Graph  Pose  Action  Relation  PDF
• 2022-01-01 The GatedTabTransformer. An enhanced deep learning architecture for tabular modeling    Radostin Cholakov, Todor Kolev arXiv_AI arXiv_AI  Transformer  Pose  Classification  Deep_Learning  Relation  Attention  PDF
• 2022-01-01 SAFL: A Self-Attention Scene Text Recognizer with Focal Loss    Bao Hieu Tran, Thanh Le-Cong, Huu Manh Nguyen, Duc Anh Le, Thanh Hung Nguyen, Phi Le Nguyen arXiv_CV arXiv_CV  Transformer  Recognition  RNN  Optical_Character  Pose  Scene_Text  Attention  PDF
• 2022-01-01 PatchTrack: Multiple Object Tracking Using Frame Patches    Xiaotong Chen, Seyed Mehdi Iranmanesh, Kuo-Chin Lien arXiv_CV arXiv_CV  Transformer  Tracking  Object_Tracking  Pose  Detection  Attention  Prediction  PDF
• 2021-12-31 How do lexical semantics affect translation? An empirical study    Vivek Subramanian, Dhanasekar Sundararaman arXiv_CL arXiv_CL  Transformer  Speech  NMT  Relation  PDF
• 2021-12-31 Transformer Embeddings of Irregularly Spaced Events and Their Participants    Chenghao Yang, Hongyuan Mei, Jason Eisner arXiv_AI arXiv_AI  Transformer  Embedding  RNN  Pose  Attention  Matching  PDF
• 2021-12-31 Multi-Dimensional Model Compression of Vision Transformer    Zejiang Hou, Sun-Yuan Kung arXiv_CV arXiv_CV  Transformer  Optimization  Pose  Attention  PDF
• 2021-12-31 A Neural Network Solves and Generates Mathematics Problems by Program Synthesis: Calculus, Differential Equations, Linear Algebra, and More    Iddo Drori, Sunny Tran, Roman Wang, Newman Cheng, Kevin Liu, Leonard Tang, Elizabeth Ke, Nikhil Singh, Taylor L. Patti, Jayson Lynch, Avi Shporer, Nakul Verma, Eugene Wu, Gilbert Strang arXiv_AI arXiv_AI  Transformer  Survey  PDF
• 2021-12-31 Scene-Adaptive Attention Network for Crowd Counting    Xing Wei, Yuanrui Kang, Jihao Yang, Yunfeng Qiu, Dahu Shi, Wenming Tan, Yihong Gong arXiv_CV arXiv_CV  Transformer  Enhancement  Pose  Attention  PDF
• 2021-12-31 TransLog: A Unified Transformer-based Framework for Log Anomaly Detection    Hongcheng Guo, Xingyu Lin, Jian Yang, Yi Zhuang, Jiaqi Bai, Bo Zhang, Tieqiao Zheng, Zhoujun Li arXiv_AI arXiv_AI  Transformer  Knowledge  Pose  Detection  PDF
• 2021-12-31 OpenQA: Hybrid QA System Relying on Structured Knowledge Base as well as Non-structured Data    Gaochen Wu, Bin Xu, Yuxin Qin, Yang Liu, Lingyu Liu, Ziwei Wang arXiv_CL arXiv_CL  Transformer  Represenation_Learning  Knowledge  Pose  QA  PDF
• 2021-12-31 InverseMV: Composing Piano Scores with a Convolutional Video-Music Transformer    Chin-Tung Lin, Mu Yang arXiv_SD arXiv_SD  Transformer  Knowledge  Pose  Attention  CNN  Matching  PDF
• 2021-12-31 CSformer: Bridging Convolution and Transformer for Compressive Sensing    Dongjie Ye, Zhangkai Ni, Hanli Wang, Jian Zhang, Shiqi Wang, Sam Kwong arXiv_CV arXiv_CV  Transformer  Reconstruction  Represenation_Learning  Pose  Relation  Compressive_Sensing  Attention  CNN  PDF
• 2021-12-31 ERNIE-ViLG: Unified Generative Pre-training for Bidirectional Vision-Language Generation    Han Zhang, Weichong Yin, Yewei Fang, Lanxin Li, Boqiang Duan, Zhihua Wu, Yu Sun, Hao Tian, Hua Wu, Haifeng Wang arXiv_CV arXiv_CV  Image_Caption  Transformer  Quantization  Pose  Text_Generation  Caption  PDF
• 2021-12-31 ViNMT: Neural Machine Translation Tookit    Nguyen Hoang Quan, Nguyen Thanh Dat, Nguyen Hoang Minh Cong, Nguyen Van Vinh, Ngo Thi Vinh, Nguyen Phuong Thai, Tran Hong Viet arXiv_CL arXiv_CL  Transformer  NMT  Prediction  PDF
• 2021-12-30 Stochastic Layers in Vision Transformers    Nikola Popovic, Danda Pani Paudel, Thomas Probst, Luc Van Gool arXiv_CV arXiv_CV  Transformer  Transfer_Learning  Recognition  Adversarial  Inference  PDF
• 2021-12-30 ChunkFormer: Learning Long Time Series with Multi-stage Chunked Transformer    Yue Ju, Alka Isac, Yimin Nie arXiv_AI arXiv_AI  Transformer  Pose  Attention  PDF
• 2021-12-30 A Lightweight and Accurate Spatial-Temporal Transformer for Traffic Forecasting    Guanyao Li, Shuhan Zhong, Letian Xiang, S.-H. Gary Chan, Ruiyuan Li, Chih-Chieh Hung, Wen-Chih Peng arXiv_AI arXiv_AI  Transformer  Pose  Prediction  PDF
• 2021-12-30 THE Benchmark: Transferable Representation Learning for Monocular Height Estimation    Zhitong Xiong, Wei Huang, Jingtao Hu, Yilei Shi, Qi Wang, Xiao Xiang Zhu arXiv_CV arXiv_CV  Transformer  Transfer_Learning  3D  Zero-Shot  Represenation_Learning  Pose  Few-Shot  PDF
• 2021-12-29 Materialized Knowledge Bases from Commonsense Transformers    Tuan-Phong Nguyen, Simon Razniewski arXiv_CL arXiv_CL  Transformer  Knowledge  Attention  Language_Model  PDF
• 2021-12-29 HPRN: Holistic Prior-embedded Relation Network for Spectral Super-Resolution    Chaoxiong Wu, Jiaojiao Li, Rui Song, Yunsong Li, Qian Du arXiv_AI arXiv_AI  Transformer  Reconstruction  Super_Resolution  Pose  Action  Relation  CNN  PDF
• 2021-12-29 Fine-Tuning Transformers: Vocabulary Transfer    Igor Samenko, Alexey Tikhonov, Borislav Kozlovskii, Ivan P. Yamshchikov arXiv_AI arXiv_AI  Transformer  Transfer_Learning  PDF
• 2021-12-29 Dense-to-Sparse Gate for Mixture-of-Experts    Xiaonan Nie, Shijie Cao, Xupeng Miao, Lingxiao Ma, Jilong Xue, Youshan Miao, Zichao Yang, Zhi Yang, Bin Cui arXiv_AI arXiv_AI  Transformer  Sparse  Pose  PDF
• 2021-12-29 Fake or Genuine? Contextualised Text Representation for Fake Review Detection    Rami Mohawesh, Shuxiang Xu, Matthew Springer, Muna Al-Hawawreh, Sumbal Maqsood arXiv_AI arXiv_AI  Transformer  Review  Pose  Detection  PDF
• 2021-12-28 Extended Self-Critical Pipeline for Transforming Videos to Text -- Team: MMCUniAugsburg    Philipp Harzig, Moritz Einfalt, Katja Ludwig, Rainer Lienhart arXiv_CV arXiv_CV  Image_Caption  Transformer  Attention  Caption  PDF
• 2021-12-28 Synchronized Audio-Visual Frames with Fractional Positional Encoding for Transformers in Video-to-Text Translation    Philipp Harzig, Moritz Einfalt, Rainer Lienhart arXiv_CV arXiv_CV  Image_Caption  Transformer  Action  Caption  PDF
• 2021-12-28 APRIL: Finding the Achilles' Heel on Privacy for Vision Transformers    Jiahao Lu, Xi Sheryl Zhang, Tianli Zhao, Xiangyu He, Jian Cheng arXiv_CV arXiv_CV  Transformer  Pose  Attention  CNN  PDF
• 2021-12-28 Pale Transformer: A General Vision Transformer Backbone with Pale-Shaped Attention    Sitong Wu, Tianyi Wu, Haoru Tan, Guodong Guo arXiv_CV arXiv_CV  Transformer  Segmentation  Semantic_Segmentation  Pose  Classification  Detection  Object_Detection  Attention  PDF
• 2021-12-28 Siamese Network with Interactive Transformer for Video Object Segmentation    Meng Lan, Jing Zhang, Fengxiang He, Lefei Zhang arXiv_CV arXiv_CV  Transformer  Segmentation  Embedding  Pose  Action  PDF
• 2021-12-27 SPViT: Enabling Faster Vision Transformers via Soft Token Pruning    Zhenglun Kong, Peiyan Dong, Xiaolong Ma, Xin Meng, Wei Niu, Mengshu Sun, Bin Ren, Minghai Qin, Hao Tang, Yanzhi Wang arXiv_CV arXiv_CV  Transformer  Pose  Classification  Attention  Image_Classification  PDF
• 2021-12-27 Contextual Sentence Analysis for the Sentiment Prediction on Financial Data    Elvys Linhares Pontes, Mohamed Benjannet arXiv_CL arXiv_CL  Transformer  Bert  Pose  Sentiment  Prediction  PDF
• 2021-12-27 Transformer Uncertainty Estimation with Hierarchical Stochastic Attention    Jiahuan Pei, Cheng Wang, György Szarvas arXiv_AI arXiv_AI  Transformer  Text_Classification  Pose  Classification  Attention  Medical  Prediction  PDF
• 2021-12-27 Augmenting Convolutional networks with attention-based aggregation    Hugo Touvron, Matthieu Cord, Alaaeldin El-Nouby, Piotr Bojanowski, Armand Joulin, Gabriel Synnaeve, Hervé Jégou arXiv_CV arXiv_CV  Transformer  Segmentation  Classification  Detection  Attention  CNN  PDF
• 2021-12-27 HeteroQA: Learning towards Question-and-Answering through Multiple Information Sources via Heterogeneous Graph Modeling    Shen Gao, Yuchi Zhang, Yongliang Wang, Yang Dong, Xiuying Chen, Dongyan Zhao, Rui Yan arXiv_AI arXiv_AI  Transformer  Knowledge  Pose  QA  PDF
• 2021-12-27 Multimodal Image Synthesis and Editing: A Survey    Fangneng Zhan, Yingchen Yu, Rongliang Wu, Jiahui Zhang, Shijian Lu arXiv_CV arXiv_CV  Transformer  Adversarial  Survey  Action  Deep_Learning  GAN  PDF
• 2021-12-27 Learning Robust and Lightweight Model through Separable Structured Transformations    Yanhui Huang, Yangyu Xu, Xian Wei arXiv_CV arXiv_CV  Transformer  Adversarial  Pose  Deep_Learning  CNN  PDF
• 2021-12-27 ViR:the Vision Reservoir    Bin Wang, Jiehuang Shi, Xian Wei arXiv_CV arXiv_CV  Transformer  Pose  Classification  Image_Classification  PDF
• 2021-12-27 Learning Generative Vision Transformer with Energy-Based Latent Space for Saliency Prediction    Jing Zhang, Jianwen Xie, Nick Barnes, Ping Li arXiv_CV arXiv_CV  Transformer  Salient  Pose  Detection  Object_Detection  Prediction  PDF
• 2021-12-27 MSHT: Multi-stage Hybrid Transformer for the ROSE Image Analysis of Pancreatic Cancer    Tianyi Zhang, Yunlu Feng, Yu Zhao, Guangda Fan, Aiming Yang, Shangqin Lyu, Peng Zhang, Fan Song, Chenbin Ma, Yangyang Sun, Youdan Feng, Guanglei Zhang arXiv_CV arXiv_CV  Transformer  Pose  Classification  Deep_Learning  Attention  CNN  PDF
• 2021-12-27 Vision Transformer for Small-Size Datasets    Seung Hoon Lee, Seunghyun Lee, Byung Cheol Song arXiv_CV arXiv_CV  Transformer  Pose  Classification  Attention  CNN  Image_Classification  PDF
• 2021-12-27 Video Joint Modelling Based on Hierarchical Transformer for Co-summarization    Li Haopeng, Ke Qiuhong, Gong Mingming, Zhang Rui arXiv_CV arXiv_CV  Transformer  Reconstruction  Video_Caption  Pose  Relation  Summarization  PDF
• 2021-12-26 Miti-DETR: Object Detection based on Transformers with Mitigatory Self-Attention Convergence    Wenchi Ma, Tianxiao Zhang, Guanghui Wang arXiv_CV arXiv_CV  Transformer  Pose  Detection  Object_Detection  Attention  PDF
• 2021-12-25 CABACE: Injecting Character Sequence Information and Domain Knowledge for Enhanced Acronym and Long-Form Extraction    Nithish Kannen, Divyanshu Sheth, Abhranil Chandra, Shubhraneel Pal arXiv_AI arXiv_AI  Transformer  Bert  Zero-Shot  Knowledge  Adversarial  Pose  Action  Language_Model  PDF
• 2021-12-25 An Ensemble of Pre-trained Transformer Models For Imbalanced Multiclass Malware Classification    Ferhat Demirkıran, Aykut Çayır, Uğur Ünal, Hasan Dağ arXiv_AI arXiv_AI  Transformer  Embedding  Bert  RNN  Pose  Classification  Deep_Learning  Relation  Attention  PDF
• 2021-12-25 Combining Improvements for Exploiting Dependency Trees in Neural Semantic Parsing    Defeng Xie, Jianmin Ji, Jiafei Xu, Ran Ji arXiv_CL arXiv_CL  Transformer  Embedding  Action  Relation  Attention  PDF
• 2021-12-24 SimViT: Exploring a Simple Vision Transformer with sliding windows    Gang Li, Di Xu, Xing Cheng, Lingyu Si, Changwen Zheng arXiv_CV arXiv_CV  Transformer  Pose  Relation  Attention  Prediction  PDF
• 2021-12-24 Generalized Wasserstein Dice Loss, Test-time Augmentation, and Transformers for the BraTS 2021 challenge    Lucas Fidon, Suprosanna Shit, Ivan Ezhov, Johannes C. Paetzold, Sébastien Ourselin, Tom Vercauteren arXiv_CV arXiv_CV  Transformer  Segmentation  3D  Medical  Inference  PDF
• 2021-12-24 Grounding Linguistic Commands to Navigable Regions    Nivedita Rufus, Kanishk Jain, Unni Krishnan R Nair, Vineet Gandhi, K Madhava Krishna arXiv_CV arXiv_CV  Transformer  Segmentation  Pose  Autonomous  PDF
• 2021-12-24 Raw Produce Quality Detection with Shifted Window Self-Attention    Oh Joon Kwon, Byungsoo Kim, Youngduck Choi arXiv_CV arXiv_CV  Transformer  Knowledge  Deep_Learning  Detection  Attention  CNN  PDF
• 2021-12-24 SGTR: End-to-end Scene Graph Generation with Transformer    Rongjie Li, Songyang Zhang, Xuming He arXiv_CV arXiv_CV  Transformer  Pose  Relation  Inference  PDF
• 2021-12-24 Multi-initialization Optimization Network for Accurate 3D Human Pose and Shape Estimation    Zhiwei Liu, Xiangyu Zhu, Lu Yang, Xiang Yan, Ming Tang, Zhen Lei, Guibo Zhu, Xuetao Feng, Yan Wang, Jinqiao Wang arXiv_CV arXiv_CV  Transformer  Reconstruction  3D  Optimization  Pose  Attention  PDF
• 2021-12-24 Spoiler in a Textstack: How Much Can Transformers Help?    Anna Wróblewska, Paweł Rzepiński, Sylwia Sysko-Romańczuk arXiv_CL arXiv_CL  Transformer  Transfer_Learning  Review  Deep_Learning  Detection  GAN  PDF
• 2021-12-23 ELSA: Enhanced Local Self-Attention for Vision Transformer    Jingkai Zhou, Pichao Wang, Fan Wang, Qiong Liu, Hao Li, Rong Jin arXiv_CV arXiv_CV  Transformer  Embedding  OCR  Pose  Attention  PDF
• 2021-12-23 SeMask: Semantically Masked Transformers for Semantic Segmentation    Jitesh Jain, Anukriti Singh, Nikita Orlov, Zilong Huang, Jiachen Li, Steven Walton, Humphrey Shi arXiv_CV arXiv_CV  Transformer  Segmentation  Semantic_Segmentation  Pose  Attention  PDF
• 2021-12-23 SLIP: Self-supervision meets Language-Image Pre-training    Norman Mu, Alexander Kirillov, David Wagner, Saining Xie arXiv_CV arXiv_CV  Transformer  Recognition  Zero-Shot  Represenation_Learning  Self-Supervised  Classification  PDF
• 2021-12-23 Assessing the Impact of Attention and Self-Attention Mechanisms on the Classification of Skin Lesions    Rafael Pedro, Arlindo L. Oliveira arXiv_CV arXiv_CV  Transformer  Pose  Classification  Attention  CNN  PDF
• 2021-12-23 3D Skeleton-based Few-shot Action Recognition with JEANIE is not so Na'ive    Lei Wang, Jun Liu, Piotr Koniusz arXiv_CV arXiv_CV  Transformer  Recognition  3D  Pose  Action_Recognition  Action  Few-Shot  Activity  PDF
• 2021-12-23 LaTr: Layout-Aware Transformer for Scene-Text VQA    Ali Furkan Biten, Ron Litman, Yusheng Xie, Srikar Appalaraju, R. Manmatha arXiv_CV arXiv_CV  Transformer  OCR  Pose  Scene_Text  Detection  VQA  Object_Detection  QA  PDF
• 2021-12-23 DD-NeRF: Double-Diffusion Neural Radiance Field as a Generalizable Implicit Body Representation    Guangming Yao, Hongzhi Wu, Yi Yuan, Kun Zhou arXiv_CV arXiv_CV  Transformer  Reconstruction  Sparse  Pose  CNN  PDF
• 2021-12-23 S+PAGE: A Speaker and Position-Aware Graph Neural Network Model for Emotion Recognition in Conversation    Chen Liang, Chong Yang, Jing Xu, Juyang Huang, Yongliang Wang, Yang Dong arXiv_CL arXiv_CL  Transformer  Recognition  Pose  Emotion  Action  Relation  Attention  PDF
• 2021-12-22 Multimodal Personality Recognition using Cross-Attention Transformer and Behaviour Encoding    Tanay Agrawal, Dhruv Agarwal, Michal Balazia, Neelabh Sinha, Francois Bremond arXiv_AI arXiv_AI  Transformer  Recognition  Pose  Relation  Attention  PDF
• 2021-12-22 DA-FDFtNet: Dual Attention Fake Detection Fine-tuning Network to Detect Various AI-Generated Fake Images    Young Oh Bang, Simon S. Woo arXiv_CV arXiv_CV  Transformer  Adversarial  Pose  Face  Detection  Few-Shot  Attention  GAN  PDF
• 2021-12-22 Toward Educator-focused Automated Scoring Systems for Reading and Writing    Mike Hardy arXiv_CL arXiv_CL  Transformer  Embedding  Transfer_Learning  Classification  Attention  PDF
• 2021-12-22 Multimodal Analysis of memes for sentiment extraction    Nayan Varma Alluri, Neeli Dheeraj Krishna arXiv_AI arXiv_AI  Transformer  Review  Emotion  Action  Classification  Sentiment  PDF
• 2021-12-22 BEVDet: High-performance Multi-camera 3D Object Detection in Bird-Eye-View    Junjie Huang, Guan Huang, Zheng Zhu, Dalong Du arXiv_CV arXiv_CV  Transformer  3D  Pose  Detection  Object_Detection  GAN  Autonomous  PDF
• 2021-12-22 CLEVR3D: Compositional Language and Elementary Visual Reasoning for Question Answering in 3D Real-World Scenes    Xu Yan, Zhihao Yuan, Yuhao Du, Yinghong Liao, Yao Guo, Zhen Li, Shuguang Cui arXiv_CV arXiv_CV  Transformer  Recognition  3D  Pose  Classification  Relation  VQA  QA  PDF
• 2021-12-22 Cost Aggregation Is All You Need for Few-Shot Segmentation    Sunghwan Hong, Seokju Cho, Jisu Nam, Seungryong Kim arXiv_CV arXiv_CV  Transformer  Segmentation  Embedding  Pose  Relation  Few-Shot  CNN  Matching  PDF
• 2021-12-22 Domain Adaptation with Pre-trained Transformers for Query Focused Abstractive Text Summarization    Md Tahmid Rahman Laskar, Enamul Hoque, Jimmy Xiangji Huang arXiv_AI arXiv_AI  Transformer  Transfer_Learning  Weakly_Supervised  Pose  Summarization  PDF
• 2021-12-22 Joint-training on Symbiosis Networks for Deep Nueral Machine Translation models    Zhengzhe Yu, Jiaxin Guo, Minghan Wang, Daimeng Wei, Hengchao Shang, Zongyao Li, Zhanglin Wu, Yuxia Wang, Yimeng Chen, Chang Su, Min Zhang, Lizhi Lei, shimin tao, Hao Yang arXiv_AI arXiv_AI  Transformer  Regularization  Pose  NMT  PDF
• 2021-12-22 Diformer: Directional Transformer for Neural Machine Translation    Minghan Wang, Jiaxin Guo, Yuxia Wang, Daimeng Wei, Hengchao Shang, Chang Su, Yimeng Chen, Yinglu Li, Min Zhang, Shimin Tao, Hao Yang arXiv_AI arXiv_AI  Transformer  Pose  Inference  Language_Model  Prediction  PDF
• 2021-12-21 MIA-Former: Efficient and Robust Vision Transformers via Multi-grained Input-Adaptation    Zhongzhi Yu, Yonggan Fu, Sicheng Li, Chaojian Li, Yingyan Lin arXiv_CV arXiv_CV  Transformer  Adversarial  Pose  Attention  PDF
• 2021-12-21 Learned Queries for Efficient Local Attention    Moab Arar, Ariel Shamir, Amit H. Bermano arXiv_CV arXiv_CV  Transformer  Pose  Action  Attention  CNN  PDF
• 2021-12-21 Voice Quality and Pitch Features in Transformer-Based Speech Recognition    Guillermo Cámbara, Jordi Luque, Mireia Farrús arXiv_CL arXiv_CL  Transformer  Recognition  Knowledge  Speech  Pose  Attention  Speech_Recognition  CNN  PDF
• 2021-12-21 Supervised Graph Contrastive Pretraining for Text Classification    Samujjwal Ghosh, Subhadeep Maji, Maunendra Sankar Desarkar arXiv_CL arXiv_CL  Transformer  Embedding  Unsupervised  Zero-Shot  Text_Classification  Knowledge  Pose  Contrastive_Learning  Classification  PDF
• 2021-12-21 Contrastive Object Detection Using Knowledge Graph Embeddings    Christopher Lang, Alexander Braun, Abhinav Valada arXiv_CV arXiv_CV  Transformer  Embedding  Recognition  Knowledge  Knowledge_Graph  Classification  Detection  Object_Detection  PDF
• 2021-12-21 iSegFormer: Interactive Image Segmentation with Transformers    Qin Liu arXiv_CV arXiv_CV  Transformer  Segmentation  Pose  PDF
• 2021-12-21 SOIT: Segmenting Objects with Instance-Aware Transformers    Xiaodong Yu, Dahu Shi, Xing Wei, Ye Ren, Tingqun Ye, Wenming Tan arXiv_CV arXiv_CV  Transformer  Segmentation  Embedding  Detection  Prediction  PDF
• 2021-12-21 On Cross-Lingual Retrieval with Multilingual Text Encoders    Robert Litschko, Ivan Vulić, Simone Paolo Ponzetto, Goran Glavaš arXiv_CL arXiv_CL  Transformer  Unsupervised  Zero-Shot  Matching  PDF
• 2021-12-21 MPViT: Multi-Path Vision Transformer for Dense Prediction    Youngwan Lee, Jonghee Kim, Jeff Willette, Sung Ju Hwang arXiv_CV arXiv_CV  Transformer  Segmentation  Embedding  Semantic_Segmentation  Classification  Detection  Object_Detection  CNN  Prediction  PDF
• 2021-12-20 Lite Vision Transformer with Enhanced Self-Attention    Chenglin Yang, Yilin Wang, Jianming Zhang, He Zhang, Zijun Wei, Zhe Lin, Alan Yuille arXiv_CV arXiv_CV  Transformer  Segmentation  Semantic_Segmentation  Recognition  Pose  Attention  CNN  Prediction  PDF
• 2021-12-20 StyleSwin: Transformer-based GAN for High-resolution Image Generation    Bowen Zhang, Shuyang Gu, Bo Zhang, Jianmin Bao, Dong Chen, Fang Wen, Yong Wang, Baining Guo arXiv_CV arXiv_CV  Transformer  Knowledge  Adversarial  Pose  Attention  GAN  PDF
• 2021-12-20 RvS: What is Essential for Offline RL via Supervised Learning?    Scott Emmons, Benjamin Eysenbach, Ilya Kostrikov, Sergey Levine arXiv_AI arXiv_AI  Transformer  Reinforcement_Learning  Regularization  PDF
• 2021-12-20 Proving Theorems using Incremental Learning and Hindsight Experience Replay    Eser Aygün, Laurent Orseau, Ankit Anand, Xavier Glorot, Vlad Firoiu, Lei M. Zhang, Doina Precup, Shibl Mourad arXiv_AI arXiv_AI  Transformer  Pose  PDF
• 2021-12-20 Self-attention Presents Low-dimensional Knowledge Graph Embeddings for Link Prediction    Peyman Baghershahi, Reshad Hosseini, Hadi Moradi arXiv_AI arXiv_AI  Transformer  Embedding  Knowledge  Knowledge_Graph  Pose  Deep_Learning  Relation  Attention  Prediction  PDF
• 2021-12-20 Diaformer: Automatic Diagnosis via Symptoms Sequence Generation    Junying Chen, Dongfang Li, Qingcai Chen, Wenxiu Zhou, Xin Liu arXiv_AI arXiv_AI  Transformer  Reinforcement_Learning  Pose  Attention  Prediction  PDF
• 2021-12-20 Article Reranking by Memory-Enhanced Key Sentence Matching for Detecting Previously Fact-Checked Claims    Qiang Sheng, Juan Cao, Xueyao Zhang, Xirong Li, Lei Zhong arXiv_CL arXiv_CL  Transformer  Pose  Detection  Matching  PDF
• 2021-12-19 Task-Oriented Multi-User Semantic Communications    Huiqiang Xie, Zhijin Qin, Xiaoming Tao, Khaled B. Letaief arXiv_CV arXiv_CV  Transformer  Embedding  Image_Retrieval  Pose  Deep_Learning  VQA  QA  PDF
• 2021-12-19 End-to-End Learning of Multi-category 3D Pose and Shape Estimation    Yigit Baran Can, Alexander Liniger, Danda Pani Paudel, Luc Van Gool arXiv_CV arXiv_CV  Transformer  3D  Sparse  Pose  Detection  PDF
• 2021-12-19 On Efficient Transformer and Image Pre-training for Low-level Vision    Wenbo Li, Xin Lu, Jiangbo Lu, Xiangyu Zhang, Jiaya Jia arXiv_CV arXiv_CV  Transformer  Super_Resolution  Pose  Denoising  PDF
• 2021-12-19 LocFormer: Enabling Transformers to Perform Temporal Moment Localization on Long Untrimmed Videos With a Feature Sampling Approach    Cristian Rodriguez-Opazo, Edison Marrese-Taylor, Basura Fernando, Hiroya Takamura, Qi Wu arXiv_CV arXiv_CV  Transformer  Pose  Attention  PDF
• 2021-12-18 Prompt-Based Multi-Modal Image Segmentation    Timo Lüddecke, Alexander S. Ecker arXiv_CV arXiv_CV  Transformer  Segmentation  Zero-Shot  Pose  Prediction  PDF
• 2021-12-18 Leveraging Transformers for Hate Speech Detection in Conversational Code-Mixed Tweets    Zaki Mustafa Farooqi, Sreyan Ghosh, Rajiv Ratn Shah arXiv_AI arXiv_AI  Transformer  Embedding  Bert  Speech  Pose  Classification  Detection  Sentiment  PDF
• 2021-12-18 Pre-Training Transformers for Domain Adaptation    Burhan Ul Tayyab, Nicholas Chua arXiv_CV arXiv_CV  Transformer  Unsupervised  Knowledge  PDF
• 2021-12-18 Cascading Adaptors to Leverage English Data to Improve Performance of Question Answering for Low-Resource Languages    Hariom A. Pandya, Bhavik Ardeshna, Dr. Brijesh S. Bhatt arXiv_AI arXiv_AI  Transformer  Transfer_Learning  Zero-Shot  Pose  QA  PDF
• 2021-12-18 Calorie Aware Automatic Meal Kit Generation from an Image    Ahmad Babaeian Jelodar, Yu Sun arXiv_AI arXiv_AI  Transformer  Pose  Face  CNN  PDF
• 2021-12-18 Exploiting Long-Term Dependencies for Generating Dynamic Scene Graphs    Shengyu Feng, Subarna Tripathi, Hesham Mostafa, Marcel Nassar, Somdeb Majumdar arXiv_CV arXiv_CV  Transformer  Video_Caption  Pose  Action  Detection  Relation  Visual_Relation  Prediction  PDF
• 2021-12-17 A Simple Single-Scale Vision Transformer for Object Localization and Instance Segmentation    Wuyang Chen, Xianzhi Du, Fan Yang, Lucas Beyer, Xiaohua Zhai, Tsung-Yi Lin, Huizhong Chen, Jing Li, Xiaodan Song, Zhangyang Wang, Denny Zhou arXiv_CV arXiv_CV  Transformer  Segmentation  Pose  Classification  Detection  Object_Detection  CNN  Image_Classification  Prediction  PDF
• 2021-12-17 Light Field Neural Rendering    Mohammed Suhail, Carlos Esteves, Leonid Sigal, Ameesh Makadia arXiv_CV arXiv_CV  Transformer  Reconstruction  Bert  Sparse  Action  Inference  PDF
• 2021-12-17 Efficient Visual Tracking with Exemplar Transformers    Philippe Blatter, Menelaos Kanakis, Martin Danelljan, Luc Van Gool arXiv_CV arXiv_CV  Transformer  Tracking  Object_Tracking  Attention  PDF
• 2021-12-17 Neuromorphic Camera Denoising using Graph Neural Network-driven Transformers    Yusra Alkendi, Rana Azzam, Abdulla Ayyad, Sajid Javed, Lakmal Seneviratne, Yahya Zweiri arXiv_CV arXiv_CV  Transformer  Pose  Relation  Denoising  PDF
• 2021-12-17 Sublinear Time Approximation of Text Similarity Matrices    Archan Ray, Nicholas Monath, Andrew McCallum, Cameron Musco arXiv_CL arXiv_CL  Transformer  Classification  PDF
• 2021-12-17 Align and Prompt: Video-and-Language Pre-training with Entity Prompts    Dongxu Li, Junnan Li, Hongdong Li, Juan Carlos Niebles, Steven C.H. Hoi arXiv_CV arXiv_CV  Transformer  Pose  Action  Detection  Object_Detection  QA  Video_Retrieval  PDF
• 2021-12-17 Continual Learning for Monolingual End-to-End Automatic Speech Recognition    Steven Vander Eeckt, Hugo Van hamme arXiv_CL arXiv_CL  Transformer  Recognition  Speech  Speech_Recognition  PDF
• 2021-12-17 SiamTrans: Zero-Shot Multi-Frame Image Restoration with Pre-Trained Siamese Transformers    Lin Liu, Shanxin Yuan, Jianzhuang Liu, Xin Guo, Youliang Yan, Qi Tian arXiv_CV arXiv_CV  Transformer  Restoration  Zero-Shot  Self-Supervised  Pose  Denoising  Attention  PDF
• 2021-12-17 Full Transformer Framework for Robust Point Cloud Registration with Deep Information Interaction    Guangyan Chen, Meiling Wang, Yufeng Yue, Qingxiang Zhang, Li Yuan arXiv_AI arXiv_AI  Transformer  Point_Cloud  Pose  Action  Classification  Relation  Matching  PDF
• 2021-12-17 Unified 2D and 3D Pre-training for Medical Image classification and Segmentation    Yutong Xie, Jianpeng Zhang, Yong Xia, Qi Wu arXiv_CV arXiv_CV  Transformer  Segmentation  Embedding  3D  Self-Supervised  Pose  Classification  Medical  Image_Classification  PDF
• 2021-12-17 Overview of the HASOC Subtrack at FIRE 2021: Hate Speech and Offensive Content Identification in English and Indo-Aryan Languages    Thomas Mandl, Sandip Modha, Gautam Kishore Shahi, Hiren Madhu, Shrey Satapara, Prasenjit Majumder, Johannes Schaefer, Tharindu Ranasinghe, Marcos Zampieri, Durgesh Nandini, Amit Kumar Jaiswal arXiv_AI arXiv_AI  Transformer  Speech  Pose  Classification  PDF
• 2021-12-17 Towards End-to-End Image Compression and Analysis with Transformers    Yuanchao Bai, Xu Yang, Xianming Liu, Junjun Jiang, Yaowei Wang, Xiangyang Ji, Wen Gao arXiv_CV arXiv_CV  Transformer  Reconstruction  Embedding  Optimization  Pose  Classification  Attention  Image_Compression  CNN  Image_Classification  PDF
• 2021-12-16 How to augment your ViTs? Consistency loss and StyleAug, a random style transfer augmentation    Akash Umakantha, Joao D. Semedo, S. Alireza Golestaneh, Wan-Yi S. Lin arXiv_CV arXiv_CV  Transformer  Style_Transfer  Regularization  Classification  CNN  Image_Classification  PDF
• 2021-12-16 Logically at the Factify 2022: Multimodal Fact Verification    Jie Gao, Hella-Franziska Hoffmann, Stylianos Oikonomou, David Kiskovski, Anil Bandhakavi arXiv_CV arXiv_CV  Transformer  Salient  Pose  Action  Classification  Relation  Attention  PDF
• 2021-12-16 Learning Bounded Context-Free-Grammar via LSTM and the Transformer:Difference and Explanations    Hui Shi, Sicun Gao, Yuandong Tian, Xinyun Chen, Jishen Zhao arXiv_CL arXiv_CL  Transformer  RNN  Pose  PDF
• 2021-12-16 Masked Feature Prediction for Self-Supervised Visual Pre-Training    Chen Wei, Haoqi Fan, Saining Xie, Chao-Yuan Wu, Alan Yuille, Christoph Feichtenhofer arXiv_CV arXiv_CV  Transformer  Recognition  Knowledge  Self-Supervised  Prediction  PDF
• 2021-12-16 Pushing the Limits of Rule Reasoning in Transformers through Natural Language Satisfiability    Kyle Richardson, Ashish Sabharwal arXiv_CL arXiv_CL  Transformer  Pose  PDF
• 2021-12-16 Gendered Language in Resumes and its Implications for Algorithmic Bias in Hiring    Prasanna Parasurama, João Sedoc arXiv_CL arXiv_CL  Transformer  Embedding  Relation  PDF
• 2021-12-16 Looking Outside the Box to Ground Language in 3D Scenes    Ayush Jain, Nikolaos Gkanatsios, Ishita Mediratta, Katerina Fragkiadaki arXiv_CV arXiv_CV  Transformer  Point_Cloud  3D  Pose  Action  Quantitative  Detection  Object_Detection  Attention  PDF
• 2021-12-16 Utilizing Evidence Spans via Sequence-Level Contrastive Learning for Long-Context Question Answering    Avi Caciularu, Ido Dagan, Jacob Goldberger, Arman Cohan arXiv_AI arXiv_AI  Transformer  Pose  Contrastive_Learning  QA  PDF
• 2021-12-16 DProST: 6-DoF Object Pose Estimation Using Space Carving and Dynamic Projective Spatial Transformer    Jaewoo Park, Nam Ik Cho arXiv_CV arXiv_CV  Transformer  3D  Pose_Estimation  Pose  Deep_Learning  PDF
• 2021-12-16 CLIN-X: pre-trained language models and a study on cross-task transfer for concept extraction in the clinical domain    Lukas Lange, Heike Adel, Jannik Strötgen, Dietrich Klakow arXiv_CL arXiv_CL  Transformer  Pose  Face  Action  Language_Model  PDF
• 2021-12-16 Domain Prompts: Towards memory and compute efficient domain adaptation of ASR systems    Saket Dingliwal, Ashish Shenoy, Sravan Bodapati, Ankur Gandhe, Ravi Teja Gadde, Katrin Kirchhoff arXiv_CL arXiv_CL  Transformer  Embedding  Recognition  Speech  Speech_Recognition  Language_Model  PDF
• 2021-12-16 IsometricMT: Neural Machine Translation for Automatic Dubbing    Surafel M. Lakew, Yogesh Virkar, Prashant Mathur, Marcello Federico arXiv_CL arXiv_CL  Transformer  Speech  NMT  PDF
• 2021-12-16 Reconsidering the Past: Optimizing Hidden States in Language Models    Davis Yoshida, Kevin Gimpel arXiv_CL arXiv_CL  Transformer  Optimization  Few-Shot  Inference  Language_Model  PDF
• 2021-12-16 Extreme Zero-Shot Learning for Extreme Text Classification    Yuanhao Xiong, Wei-Cheng Chang, Cho-Jui Hsieh, Hsiang-Fu Yu, Inderjit Dhillon arXiv_CL arXiv_CL  Transformer  Embedding  Zero-Shot  Text_Classification  Regularization  Self-Supervised  Pose  Face  Classification  Few-Shot  PDF
• 2021-12-16 QAHOI: Query-Based Anchors for Human-Object Interaction Detection    Junwen Chen, Keiji Yanai arXiv_CV arXiv_CV  Transformer  Pose  Action  Detection  Relation  Object_Detection  QA  PDF
• 2021-12-16 TransZero++: Cross Attribute-Guided Transformer for Zero-Shot Learning    Shiming Chen, Ziming Hong, Guo-Sen Xie, Jian Zhao, Xinge You, Shuicheng Yan, Ling Shao arXiv_AI arXiv_AI  Transformer  Embedding  Recognition  Zero-Shot  Knowledge  Pose  Relation  Attention  PDF
• 2021-12-16 Call for Customized Conversation: Customized Conversation Grounding Persona and Knowledge    Yoonna Jang, Jungwoo Lim, Yuna Hur, Dongsuk Oh, Suhyune Son, Yeonsoo Lee, Donghoon Shin, Seungryong Kim, Heuiseok Lim arXiv_AI arXiv_AI  Transformer  Knowledge  Pose  Language_Model  PDF
• 2021-12-16 Masked Measurement Prediction: Learning to Jointly Predict Quantities and Units from Textual Context    Daniel Spokoyny, Ivan Lee, Zhao Jin, Taylor Berg-Kirkpatrick arXiv_CL arXiv_CL  Transformer  Bert  Pose  Language_Model  Prediction  PDF
• 2021-12-16 KAT: A Knowledge Augmented Transformer for Vision-and-Language    Liangke Gui, Borui Wang, Qiuyuan Huang, Alex Hauptmann, Yonatan Bisk, Jianfeng Gao arXiv_CL arXiv_CL  Transformer  Knowledge  Pose  VQA  Prediction  QA  PDF
• 2021-12-16 Goal-Directed Story Generation: Augmenting Generative Language Models with Reinforcement Learning    Amal Alabdulkarim, Winston Li, Lara J. Martin, Mark O. Riedl arXiv_AI arXiv_AI  Transformer  Reinforcement_Learning  Optimization  Knowledge  Knowledge_Graph  Attention  Language_Model  PDF
• 2021-12-16 SGEITL: Scene Graph Enhanced Image-Text Learning for Visual Commonsense Reasoning    Zhecan Wang, Haoxuan You, Liunian Harold Li, Alireza Zareian, Suji Park, Yiqing Liang, Kai-Wei Chang, Shih-Fu Chang arXiv_AI arXiv_AI  Transformer  Knowledge  Pose  Action  Attention  PDF
• 2021-12-16 Does Pre-training Induce Systematic Inference? How Masked Language Models Acquire Commonsense Knowledge    Ian Porada, Alessandro Sordoni, Jackie Chi Kit Cheung arXiv_CL arXiv_CL  Transformer  Bert  Knowledge  Face  Inference  Language_Model  PDF
• 2021-12-16 Block-Skim: Efficient Question Answering for Transformer    Yue Guan, Zhengyi Li, Jingwen Leng, Zhouhan Lin, Minyi Guo, Yuhao Zhu arXiv_CL arXiv_CL  Transformer  Bert  Pose  Classification  Attention  Inference  QA  PDF
• 2021-12-16 Learning Rich Representation of Keyphrases from Text    Mayank Kulkarni, Debanjan Mahata, Ravneet Arora, Rajarshi Bhowmik arXiv_CL arXiv_CL  Transformer  Recognition  Action  Relation  Relation_Extraction  Summarization  Language_Model  QA  PDF
• 2021-12-16 Trees in transformers: a theoretical analysis of the Transformer's ability to represent trees    Qi He, João Sedoc, Jordan Rodu arXiv_CL arXiv_CL  Transformer  PDF
• 2021-12-15 Dense Video Captioning Using Unsupervised Semantic Information    Valter Estevam, Rayson Laroca, Helio Pedrini, David Menotti arXiv_CV arXiv_CV  Transformer  Unsupervised  Video_Caption  Pose  Caption  CNN  PDF
• 2021-12-15 Automatic Product Copywriting for E-Commerce    Xueying Zhang, Yanyan Zou, Hainan Zhang, Jing Zhou, Shiliang Diao, Jiajia Chen, Zhuoye Ding, Zhen He, Xueqi He, Yun Xiao, Bo Long, Han Yu, Lingfei Wu arXiv_AI arXiv_AI  Transformer  Pose  Recommendation  PDF
• 2021-12-15 DSGPT: Domain-Specific Generative Pre-Training of Transformers for Text Generation in E-commerce Title and Review Summarization    Xueying Zhang, Yunjiang Jiang, Yue Shang, Zhaomeng Cheng, Chi Zhang, Xiaochuan Fan, Yun Xiao, Bo Long arXiv_AI arXiv_AI  Transformer  Knowledge  Review  Pose  Summarization  Text_Generation  PDF
• 2021-12-15 3D Question Answering    Shuquan Ye, Dongdong Chen, Songfang Han, Jing Liao arXiv_CV arXiv_CV  Transformer  Point_Cloud  3D  Bert  Pose  VQA  QA  PDF
• 2021-12-15 GenIE: Generative Information Extraction    Martin Josifoski, Nicola De Cao, Maxime Peyrard, Robert West arXiv_CL arXiv_CL  Transformer  Knowledge  Action  Relation  PDF
• 2021-12-15 Evaluating Pretrained Transformer Models for Entity Linking in Task-Oriented Dialog    Sai Muralidhar Jayanthi, Varsha Embar, Karthik Raghunathan arXiv_CL arXiv_CL  Transformer  Unsupervised  Prediction  PDF
• 2021-12-15 Is 'my favorite new movie' my favorite movie? Probing the Understanding of Recursive Noun Phrases    Qing Lyu, Hua Zheng, Daoxin Li, Li Zhang, Marianna Apidianaki, Chris Callison-Burch arXiv_CL arXiv_CL  Transformer  Zero-Shot  Knowledge  Detection  Language_Model  PDF
• 2021-12-15 SeqFormer: a Frustratingly Simple Model for Video Instance Segmentation    Junfeng Wu, Yi Jiang, Wenqing Zhang, Xiang Bai, Song Bai arXiv_CV arXiv_CV  Transformer  Segmentation  Tracking  Pose  Relation  Attention  PDF
• 2021-12-15 EEG-Transformer: Self-attention from Transformer Architecture for Decoding EEG of Imagined Speech    Young-Eun Lee, Seo-Hyun Lee arXiv_SD arXiv_SD  Transformer  RNN  Speech  Pose  Classification  Deep_Learning  Attention  CNN  PDF
• 2021-12-15 Lesan -- Machine Translation for Low Resource Languages    Asmelash Teka Hadgu, Abel Aregawi, Adam Beaudoin arXiv_CL arXiv_CL  Transformer  OCR  PDF
• 2021-12-15 Vision Transformer Based Video Hashing Retrieval for Tracing the Source of Fake Videos    Pengfei Pei, Xianfeng Zhao, Jinchuan Li, Yun Cao, Xiaowei Yi arXiv_CV arXiv_CV  Transformer  Pose  Detection  Video_Retrieval  PDF
• 2021-12-15 SPTS: Single-Point Text Spotting    Dezhi Peng, Xinyu Wang, Yuliang Liu, Jiaxin Zhang, Mingxin Huang, Songxuan Lai, Shenggao Zhu, Jing Li, Dahua Lin, Chunhua Shen, Lianwen Jin arXiv_CV arXiv_CV  Transformer  Recognition  Pose  Scene_Text  Detection  Language_Model  Prediction  PDF
• 2021-12-15 LongT5: Efficient Text-To-Text Transformer for Long Sequences    Mandy Guo, Joshua Ainslie, David Uthus, Santiago Ontanon, Jianmo Ni, Yun-Hsuan Sung, Yinfei Yang arXiv_CL arXiv_CL  Transformer  Attention  Summarization  PDF
• 2021-12-15 Zero-shot Audio Source Separation through Query-based Learning from Weakly-labeled Data    Ke Chen, Xingjian Du, Bilei Zhu, Zejun Ma, Taylor Berg-kirkpatrick, Shlomo Dubnov arXiv_AI arXiv_AI  Transformer  Embedding  Zero-Shot  Pose  Face  Deep_Learning  Detection  PDF
• 2021-12-15 Oracle Linguistic Graphs Complement a Pretrained Transformer Language Model: A Cross-formalism Comparison    Jakob Prange, Nathan Schneider, Lingpeng Kong arXiv_CL arXiv_CL  Transformer  Speech  Language_Model  PDF
• 2021-12-15 Tracing Text Provenance via Context-Aware Lexical Substitution    Xi Yang, Jie Zhang, Kejiang Chen, Weiming Zhang, Zehua Ma, Feng Wang, Nenghai Yu arXiv_CL arXiv_CL  Transformer  OCR  Bert  Pose  Language_Model  PDF
• 2021-12-15 Cross-Domain Generalization and Knowledge Transfer in Transformers Trained on Legal Data    Jaromir Savelka, Hannes Westermann, Karim Benyekhlef arXiv_CL arXiv_CL  Transformer  Knowledge  Language_Model  Prediction  PDF
• 2021-12-14 A Simple But Powerful Graph Encoder for Temporal Knowledge Graph Completion    Zifeng Ding, Yunpu Ma, Bailan He, Volker Tresp arXiv_AI arXiv_AI  Transformer  Knowledge  Knowledge_Graph  Pose  Action  Deep_Learning  Relation  Attention  PDF
• 2021-12-14 AdaViT: Adaptive Tokens for Efficient Vision Transformer    Hongxu Yin, Arash Vahdat, Jose Alvarez, Arun Mallya, Jan Kautz, Pavlo Molchanov arXiv_CV arXiv_CV  Transformer  Regularization  Pose  Classification  Image_Classification  Inference  PDF
• 2021-12-14 End-to-end speaker diarization with transformer    Yongquan Lai, Xin Tang, Yuanyuan Fu, Rui Fang arXiv_SD arXiv_SD  Transformer  Segmentation  Embedding  Semantic_Segmentation  RNN  Speech  Pose  Detection  Activity  Prediction  PDF
• 2021-12-14 You Only Need One Model for Open-domain Question Answering    Haejun Lee, Akhil Kedia, Jongwon Lee, Ashwin Paranjape, Christopher D. Manning, Kyoung-Gu Woo arXiv_AI arXiv_AI  Transformer  Knowledge  Pose  Attention  QA  PDF
• 2021-12-14 Geometry-Contrastive Transformer for Generalized 3D Pose Transfer    Haoyu Chen, Hao Tang, Zitong Yu, Nicu Sebe, Guoying Zhao arXiv_CV arXiv_CV  Transformer  3D  Regularization  Pose  Quantitative  Attention  PDF
• 2021-12-14 Temporal Transformer Networks with Self-Supervision for Action Recognition    Yongkang Zhang, Jun Li, Guoming Wu, Han Zhang, Zhiping Shi, Zhaoxun Liu, Zizhang Wu, Na Jiang arXiv_CV arXiv_CV  Transformer  Recognition  Pose  Action_Recognition  Action  Relation  CNN  PDF
• 2021-12-14 Multi-Instance Training for Question Answering Across Table and Linked Text    Vishwajeet Kumar, Saneem Chemmengath, Yash Gupta, Jaydeep Sen, Samarth Bharadwaj, Soumen Chakrabarti arXiv_AI arXiv_AI  Transformer  Pose  QA  Matching  PDF
• 2021-12-14 Improving Hybrid CTC/Attention End-to-end Speech Recognition with Pretrained Acoustic and Language Model    Keqi Deng, Songjun Cao, Yike Zhang, Long Ma arXiv_CL arXiv_CL  Transformer  Recognition  Knowledge  Speech  Self-Supervised  Pose  Attention  Speech_Recognition  Inference  Language_Model  PDF
• 2021-12-14 ACE-BERT: Adversarial Cross-modal Enhanced BERT for E-commerce Retrieval    Boxuan Zhang, Chao Wei, Yan Jin, Weiru Zhang arXiv_AI arXiv_AI  Image_Caption  Transformer  Bert  Adversarial  Pose  PDF
• 2021-12-14 Co-training Transformer with Videos and Images Improves Action Recognition    Bowen Zhang, Jiahui Yu, Christopher Fifty, Wei Han, Andrew M. Dai, Ruoming Pang, Fei Sha arXiv_CV arXiv_CV  Transformer  Recognition  Action_Recognition  Action  PDF
• 2021-12-14 Discovering Explanatory Sentences in Legal Case Decisions Using Pre-trained Language Models    Jaromir Savelka, Kevin D. Ashley arXiv_CL arXiv_CL  Transformer  Relation  Language_Model  Prediction  PDF
• 2021-12-14 Towards a Unified Foundation Model: Jointly Pre-Training Transformers on Unpaired Images and Text    Qing Li, Boqing Gong, Yin Cui, Dan Kondratyuk, Xianzhi Du, Ming-Hsuan Yang, Matthew Brown arXiv_CV arXiv_CV  Transformer  Bert  Knowledge  Pose  Classification  Image_Classification  PDF
• 2021-12-13 Keyphrase Generation Beyond the Boundaries of Title and Abstract    Krishna Garg, Jishnu Ray Chowdhury, Cornelia Caragea arXiv_CL arXiv_CL  Transformer  Pose  PDF
• 2021-12-13 Hformer: Hybrid CNN-Transformer for Fringe Order Prediction in Phase Unwrapping of Fringe Projection    Xinjun Zhu, Zhiqiang Han, Mengkai Yuan, Qinghua Guo, Hongyi Wang arXiv_CV arXiv_CV  Transformer  3D  Knowledge  Pose  Deep_Learning  Attention  CNN  Prediction  PDF
• 2021-12-13 Attentive Contextual Carryover for Multi-Turn End-to-End Spoken Language Understanding    Kai Wei, Thanh Tran, Feng-Ju Chang, Kanthashree Mysore Sathyendra, Thejaswi Muniyappa, Jing Liu, Anirudh Raju, Ross McGowan, Nathan Susanj, Ariya Rastrow, Grant P. Strimel arXiv_AI arXiv_AI  Transformer  Pose  Action  Attention  PDF
• 2021-12-13 Learning Semantic-Aligned Feature Representation for Text-based Person Search    Shiping Li, Min Cao, Min Zhang arXiv_AI arXiv_AI  Transformer  Embedding  Pose  Attention  PDF
• 2021-12-13 Anchor Retouching via Model Interaction for Robust Object Detection in Aerial Images    Dong Liang, Qixiang Geng, Zongqi Wei, Dmitry A. Vorontsov, Ekaterina L. Kim, Mingqiang Wei, Huiyu Zhou arXiv_CV arXiv_CV  Transformer  Enhancement  Pose  Action  Detection  Object_Detection  Inference  PDF
• 2021-12-13 Pedestrian Trajectory Prediction via Spatial Interaction Transformer Network    Tong Su, Yu Meng, Yan Xu arXiv_CV arXiv_CV  Transformer  Pose  Action  Relation  Attention  Autonomous  Prediction  PDF
• 2021-12-13 SAC-GAN: Structure-Aware Image-to-Image Composition for Self-Driving    Hang Zhou, Ali Mahdavi-Amiri, Rui Ma, Hao Zhang arXiv_CV arXiv_CV  Transformer  Adversarial  Pose  GAN  PDF
• 2021-12-13 ITA: Image-Text Alignments for Multi-Modal Named Entity Recognition    Xinyu Wang, Min Gui, Yong Jiang, Zixia Jia, Nguyen Bach, Tao Wang, Zhongqiang Huang, Fei Huang, Kewei Tu arXiv_CL arXiv_CL  Transformer  Embedding  Recognition  Pose  Action  Detection  Object_Detection  Attention  Caption  PDF
• 2021-12-13 SVIP: Sequence VerIfication for Procedures in Videos    Yicheng Qian, Weixin Luo, Dongze Lian, Xu Tang, Peilin Zhao, Shenghua Gao arXiv_CV arXiv_CV  Transformer  Segmentation  Recognition  Pose  Action_Recognition  Action  Detection  GAN  PDF
• 2021-12-13 PartGlot: Learning Shape Part Segmentation from Language Reference Games    Juil Koo, Ian Huang, Panos Achlioptas, Leonidas Guibas, Minhyuk Sung arXiv_CV arXiv_CV  Transformer  Segmentation  Recognition  3D  Attention  PDF
• 2021-12-13 5th Place Solution for VSPW 2021 Challenge    Jiafan Zhuang, Yixin Zhang, Xinyu Hu, Junjie Li, Zilei Wang arXiv_CV arXiv_CV  Transformer  Segmentation  Semantic_Segmentation  Recognition  PDF
• 2021-12-13 Embracing Single Stride 3D Object Detector with Sparse Transformer    Lue Fan, Ziqi Pang, Tianyuan Zhang, Yu-Xiong Wang, Hang Zhao, Feng Wang, Naiyan Wang, Zhaoxiang Zhang arXiv_CV arXiv_CV  Transformer  Point_Cloud  3D  Sparse  Pose  Detection  Object_Detection  Autonomous  PDF
• 2021-12-13 Learning Generalizable Vision-Tactile Robotic Grasping Strategy for Deformable Objects via Transformer    Yunhai Han, Rahul Batra, Nathan Boyd, Tuo Zhao, Yu She, Seth Hutchinson, Ye Zhao arXiv_RO arXiv_RO  Transformer  Embedding  RNN  Pose  Action  Detection  CNN  Inference  Prediction  PDF
• 2021-12-13 Dependency Learning for Legal Judgment Prediction with a Unified Text-to-Text Transformer    Yunyun Huang, Xiaoyu Shen, Chuanyi Li, Jidong Ge, Bin Luo arXiv_AI arXiv_AI  Transformer  Pose  Classification  Language_Model  Prediction  PDF
• 2021-12-12 ValueNet: A New Dataset for Human Value Driven Dialogue System    Liang Qiu, Yizhou Zhao, Jinchao Li, Pan Lu, Baolin Peng, Jianfeng Gao, Song-Chun Zhu arXiv_AI arXiv_AI  Transformer  Recognition  Reinforcement_Learning  Knowledge  Emotion  GAN  QA  PDF
• 2021-12-12 Contextualized Scene Imagination for Generative Commonsense Reasoning    PeiFeng Wang, Jonathan Zamora, Junfeng Liu, Filip Ilievski, Muhao Chen, Xiang Ren arXiv_CL arXiv_CL  Transformer  Knowledge  Knowledge_Graph  Pose  Relation  Text_Generation  Language_Model  PDF
• 2021-12-12 Towards More Efficient Insertion Transformer with Fractional Positional Encoding    Zhisong Zhang, Yizhe Zhang, Bill Dolan arXiv_CL arXiv_CL  Transformer  Action  Text_Generation  PDF
• 2021-12-12 Implicit Transformer Network for Screen Content Image Continuous Super-Resolution    Jingyu Yang, Sheng Shen, Huanjing Yue, Kun Li arXiv_CV arXiv_CV  Transformer  Super_Resolution  Pose  PDF
• 2021-12-12 Magnifying Networks for Images with Billions of Pixels    Neofytos Dimitriou, Ognjen Arandjelovic arXiv_CV arXiv_CV  Transformer  Optimization  Pose  Deep_Learning  Medical  CNN  PDF
• 2021-12-12 Injecting Numerical Reasoning Skills into Knowledge Base Question Answering Models    Yu Feng, Jing Zhang, Xiaokang Zhang, Lemao Liu, Cuiping Li, Hong Chen arXiv_CL arXiv_CL  Transformer  Embedding  Knowledge  Pose  QA  PDF
• 2021-12-12 Improving Vision Transformers for Incremental Learning    Pei Yu, Yinpeng Chen, Ying Jin, Zicheng Liu arXiv_CV arXiv_CV  Transformer  CNN  PDF
• 2021-12-11 U-shaped Transformer with Frequency-Band Aware Attention for Speech Enhancement    Yi Li, Yang Sun, Syed Mohsen Naqvi arXiv_SD arXiv_SD  Transformer  Enhancement  Speech  Pose  Deep_Learning  Attention  PDF
• 2021-12-11 COMPOSER: Compositional Learning of Group Activity in Videos    Honglu Zhou, Asim Kadav, Aviv Shamsian, Shijie Geng, Farley Lai, Long Zhao, Ting Liu, Mubbasir Kapadia, Hans Peter Graf arXiv_CV arXiv_CV  Transformer  Recognition  Pose  Relation  Attention  Activity  Prediction  PDF
• 2021-12-10 TempoQR: Temporal Question Reasoning over Knowledge Graphs    Costas Mavromatis, Prasanna Lakkur Subramanyam, Vassilis N. Ioannidis, Soji Adeshina, Phillip R. Howard, Tetiana Grinberg, Nagib Hakim, George Karypis arXiv_AI arXiv_AI  Transformer  Embedding  Knowledge  Knowledge_Graph  Relation  Prediction  QA  PDF
• 2021-12-10 Short and Long Range Relation Based Spatio-Temporal Transformer for Micro-Expression Recognition    Liangfei Zhang, Xiaopeng Hong, Ognjen Arandjelovic, Guoying Zhao arXiv_CV arXiv_CV  Transformer  Recognition  Knowledge  Pose  Emotion  Classification  Deep_Learning  Relation  CNN  Inference  PDF
• 2021-12-10 Building a great multi-lingual teacher with sparsely-gated mixture of experts for speech recognition    Kenichi Kumatani, Robert Gmyr, Felipe Cruz Salinas, Linquan Liu, Wei Zuo, Devang Patel, Eric Sun, Yu Shi arXiv_AI arXiv_AI  Transformer  Recognition  Sparse  Speech  Speech_Recognition  PDF
• 2021-12-10 Deep ViT Features as Dense Visual Descriptors    Shir Amir, Yossi Gandelsman, Shai Bagon, Tali Dekel arXiv_CV arXiv_CV  Transformer  Segmentation  Self-Supervised  Pose  Quantitative  PDF
• 2021-12-10 Pre-training and Fine-tuning Transformers for fMRI Prediction Tasks    Itzik Malkiel, Gony Rosenman, Lior Wolf, Talma Hendler arXiv_CV arXiv_CV  Transformer  Reconstruction  Recognition  3D  Self-Supervised  Prediction  PDF
• 2021-12-10 VUT: Versatile UI Transformer for Multi-Modal Multi-Task User Interface Modeling    Yang Li, Gang Li, Xin Zhou, Mostafa Dehghani, Alexey Gritsenko arXiv_AI arXiv_AI  Transformer  Face  Detection  Object_Detection  PDF
• 2021-12-10 Analysis and Prediction of NLP Models Via Task Embeddings    Damien Sileo, Marie-Francine Moens arXiv_CL arXiv_CL  Transformer  Embedding  Transfer_Learning  Zero-Shot  Pose  Inference  Prediction  PDF
• 2021-12-10 Automated tabulation of clinical trial results: A joint entity and relation extraction approach with transformer-based language representations    Jetsun Whitton, Anthony Hunter arXiv_AI arXiv_AI  Transformer  Transfer_Learning  Recognition  Review  Action  Relation  Relation_Extraction  PDF
• 2021-12-10 Visual Transformers with Primal Object Queries for Multi-Label Image Classification    Vacit Oguz Yazici, Joost van de Weijer, Longlong Yu arXiv_CV arXiv_CV  Transformer  Pose  Classification  Detection  Object_Detection  Attention  Image_Classification  Prediction  PDF
• 2021-12-10 Couplformer:Rethinking Vision Transformer with Coupling Attention Map    Hai Lan, Xihao Wang, Xian Wei arXiv_CV arXiv_CV  Transformer  Pose  Classification  Attention  Image_Classification  PDF
• 2021-12-10 Rethinking the Two-Stage Framework for Grounded Situation Recognition    Meng Wei, Long Chen, Wei Ji, Xiaoyu Yue, Tat-Seng Chua arXiv_CV arXiv_CV  Transformer  Recognition  Salient  Pose  Classification  Detection  Relation  Activity  Prediction  PDF
• 2021-12-10 Human Interpretation and Exploitation of Self-attention Patterns in Transformers: A Case Study in Extractive Summarization    Raymond Li, Wen Xiao, Lanjun Wang, Giuseppe Carenini arXiv_AI arXiv_AI  Transformer  Bert  Knowledge  Pose  Attention  Summarization  PDF
• 2021-12-10 Sketching as a Tool for Understanding and Accelerating Self-attention for Long Sequences    Yifan Chen, Qi Zeng, Dilek Hakkani-Tur, Di Jin, Heng Ji, Yun Yang arXiv_CL arXiv_CL  Transformer  Sketch  Pose  Attention  PDF
• 2021-12-10 Findings on Conversation Disentanglement    Rongxin Zhu, Jey Han Lau, Jianzhong Qi arXiv_CL arXiv_CL  Transformer  Bert  Classification  Summarization  PDF
• 2021-12-10 FaceFormer: Speech-Driven 3D Facial Animation with Transformers    Yingruo Fan, Zhaojiang Lin, Jun Saito, Wenping Wang, Taku Komura arXiv_CV arXiv_CV  Transformer  3D  Speech  Self-Supervised  Pose  Face  Attention  PDF
• 2021-12-10 LCTR: On Awakening the Local Continuity of Transformer for Weakly Supervised Object Localization    Zhiwei Chen, Changan Wang, Yabiao Wang, Guannan Jiang, Yunhang Shen, Ying Tai, Chengjie Wang, Wei Zhang, Liujuan Cao arXiv_CV arXiv_CV  Transformer  Weakly_Supervised  Pose  Relation  Attention  CNN  PDF
• 2021-12-09 Injecting Semantic Concepts into End-to-End Image Captioning    Zhiyuan Fang, Jianfeng Wang, Xiaowei Hu, Lin Liang, Zhe Gan, Lijuan Wang, Yezhou Yang, Zicheng Liu arXiv_CV arXiv_CV  Image_Caption  Transformer  Pose  Classification  Detection  Object_Detection  Caption  Inference  PDF
• 2021-12-09 GAN-Supervised Dense Visual Alignment    William Peebles, Jun-Yan Zhu, Richard Zhang, Antonio Torralba, Alexei Efros, Eli Shechtman arXiv_CV arXiv_CV  Transformer  Self-Supervised  Pose  GAN  PDF
• 2021-12-09 Assistive Tele-op: Leveraging Transformers to Collect Robotic Task Demonstrations    Henry M. Clever, Ankur Handa, Hammad Mazhar, Kevin Parker, Omer Shapira, Qian Wan, Yashraj Narang, Iretiayo Akinola, Maya Cakmak, Dieter Fox arXiv_RO arXiv_RO  Transformer  Action  Autonomous  PDF
• 2021-12-09 Transferring BERT-like Transformers' Knowledge for Authorship Verification    Andrei Manolache, Florin Brad, Elena Burceanu, Antonio Barbalau, Radu Ionescu, Marius Popescu arXiv_CL arXiv_CL  Transformer  Bert  Knowledge  Pose  PDF
• 2021-12-09 BLT: Bidirectional Layout Transformer for Controllable Layout Generation    Xiang Kong, Lu Jiang, Huiwen Chang, Han Zhang, Yuan Hao, Haifeng Gong, Irfan Essa arXiv_CV arXiv_CV  Transformer  Pose  Inference  PDF
• 2021-12-09 Locally Shifted Attention With Early Global Integration    Shelly Sheynin, Sagie Benaim, Adam Polyak, Lior Wolf arXiv_AI arXiv_AI  Transformer  Pose  Action  Classification  Attention  CNN  Image_Classification  PDF
• 2021-12-09 Opinion Extraction as A Structured Sentiment Analysis using Transformers    Yucheng Liu, Tian Zhu arXiv_CL arXiv_CL  Transformer  Recognition  Action  Relation  Sentiment  PDF
• 2021-12-09 PE-former: Pose Estimation Transformer    Paschalis Panteleris, Antonis Argyros arXiv_CV arXiv_CV  Transformer  Pose_Estimation  Pose  Action  Classification  CNN  Image_Classification  PDF
• 2021-12-09 Semi-Supervised Medical Image Segmentation via Cross Teaching between CNN and Transformer    Xiangde Luo, Minhao Hu, Tao Song, Guotai Wang, Shaoting Zhang arXiv_CV arXiv_CV  Transformer  Segmentation  Regularization  Deep_Learning  Medical  CNN  Prediction  PDF
• 2021-12-09 A Bilingual, OpenWorld Video Text Dataset and End-to-end Video Text Spotter with Transformer    Weijia Wu, Yuanqiang Cai, Debing Zhang, Sibo Wang, Zhuang Li, Jiahong Li, Yejun Tang, Hong Zhou arXiv_CV arXiv_CV  Transformer  Tracking  Pose  Scene_Text  Attention  Caption  Prediction  PDF
• 2021-12-09 Nice perfume. How long did you marinate in it? Multimodal Sarcasm Explanation    Poorav Desai, Tanmoy Chakraborty, Md Shad Akhtar arXiv_CL arXiv_CL  Transformer  Pose  Classification  Attention  Caption  Prediction  PDF
• 2021-12-09 3D Medical Point Transformer: Introducing Convolution to Attention Networks for Medical Point Cloud Analysis    Jianhui Yu, Chaoyi Zhang, Heng Wang, Dingxin Zhang, Yang Song, Tiange Xiang, Dongnan Liu, Weidong Cai arXiv_CV arXiv_CV  Transformer  Segmentation  Embedding  Point_Cloud  3D  Knowledge  Pose  Action  Classification  Detection  Attention  Medical  PDF
• 2021-12-09 Extending AdamW by Leveraging Its Second Moment and Magnitude    Guoqiang Zhang, Niwa Kenta, W. Bastiaan Kleijn arXiv_AI arXiv_AI  Transformer  Tracking  Pose  Deep_Learning  PDF
• 2021-12-09 Multimodal Fake News Detection    Santiago Alonso-Bartolome, Isabel Segura-Bedmar arXiv_CL arXiv_CL  Transformer  Bert  Classification  Detection  CNN  PDF
• 2021-12-09 Fast Point Transformer    Chunghyun Park, Yoonwoo Jeong, Minsu Cho, Jaesik Park arXiv_CV arXiv_CV  Transformer  Segmentation  Semantic_Segmentation  Point_Cloud  3D  Pose  Detection  Attention  Inference  Prediction  PDF
• 2021-12-09 DualFormer: Local-Global Stratified Transformer for Efficient Video Recognition    Yuxuan Liang, Pan Zhou, Roger Zimmermann, Shuicheng Yan arXiv_AI arXiv_AI  Transformer  Recognition  3D  Pose  Action  Attention  Inference  PDF
• 2021-12-09 Recurrent Glimpse-based Decoder for Detection with Transformer    Zhe Chen, Jing Zhang, Dacheng Tao arXiv_CV arXiv_CV  Transformer  Embedding  Detection  Object_Detection  Attention  Inference  PDF
• 2021-12-09 Towards Neural Functional Program Evaluation    Torsten Scholak, Jonathan Pilault, Joey Velez-Ginorio arXiv_CL arXiv_CL  Transformer  Language_Model  PDF
• 2021-12-08 Scaling Language Models: Methods, Analysis & Insights from Training Gopher    Jack W. Rae, Sebastian Borgeaud, Trevor Cai, Katie Millican, Jordan Hoffmann, Francis Song, John Aslanides, Sarah Henderson, Roman Ring, Susannah Young, Eliza Rutherford, Tom Hennigan, Jacob Menick, Albin Cassirer, Richard Powell, George van den Driessche, Lisa Anne Hendricks, Maribeth Rauh, Po-Sen Huang, Amelia Glaese, Johannes Welbl, Sumanth Dathathri, Saffron Huang, Jonathan Uesato, John Mellor, Irina Higgins, Antonia Creswell, Nat McAleese, Amy Wu, Erich Elsen, Siddhant Jayakumar, Elena Buchatskaya, David Budden, Esme Sutherland, Karen Simonyan, Michela Paganini, Laurent Sifre, Lena Martens, Xiang Lorraine Li, Adhiguna Kuncoro, Aida Nematzadeh, Elena Gribovskaya, Domenic Donato, Angeliki Lazaridou, Arthur Mensch, Jean-Baptiste Lespiau, Maria Tsimpoukelli, Nikolai Grigorev, Doug Fritz, et al. (31 additional authors not shown) arXiv_AI arXiv_AI  Transformer  Knowledge  Language_Model  PDF
• 2021-12-08 Prompting Visual-Language Models for Efficient Video Understanding    Chen Ju, Tengda Han, Kunhao Zheng, Ya Zhang, Weidi Xie arXiv_CV arXiv_CV  Transformer  Recognition  Video_Caption  Zero-Shot  Pose  Action_Recognition  Action  Few-Shot  Language_Model  Video_Retrieval  PDF
• 2021-12-08 MLP Architectures for Vision-and-Language Modeling: An Empirical Study    Yixin Nie, Linjie Li, Zhe Gan, Shuohang Wang, Chenguang Zhu, Michael Zeng, Zicheng Liu, Mohit Bansal, Lijuan Wang arXiv_CV arXiv_CV  Transformer  VQA  Attention  Language_Model  QA  PDF
• 2021-12-08 Everything at Once -- Multi-modal Fusion Transformer for Video Retrieval    Nina Shvetsova, Brian Chen, Andrew Rouditchenko, Samuel Thomas, Brian Kingsbury, Rogerio Feris, David Harwath, James Glass, Hilde Kuehne arXiv_CV arXiv_CV  Transformer  Embedding  Zero-Shot  Action_Localization  Pose  Action  Classification  Attention  Video_Retrieval  PDF
• 2021-12-08 Audio-Visual Synchronisation in the wild    Honglie Chen, Weidi Xie, Triantafyllos Afouras, Arsha Nagrani, Andrea Vedaldi, Andrew Zisserman arXiv_CV arXiv_CV  Transformer  Speech  Pose  Relation  PDF
• 2021-12-08 Improving language models by retrieving from trillions of tokens    Sebastian Borgeaud, Arthur Mensch, Jordan Hoffmann, Trevor Cai, Eliza Rutherford, Katie Millican, George van den Driessche, Jean-Baptiste Lespiau, Bogdan Damoc, Aidan Clark, Diego de Las Casas, Aurelia Guy, Jacob Menick, Roman Ring, Tom Hennigan, Saffron Huang, Loren Maggiore, Chris Jones, Albin Cassirer, Andy Brock, Michela Paganini, Geoffrey Irving, Oriol Vinyals, Simon Osindero, Karen Simonyan, Jack W. Rae, Erich Elsen, Laurent Sifre arXiv_CL arXiv_CL  Transformer  Bert  Knowledge  Attention  Language_Model  PDF
• 2021-12-08 Transformer based trajectory prediction    Aleksey Postnikov, Aleksander Gamayunov, Gonzalo Ferrer arXiv_RO arXiv_RO  Transformer  Pose  Attention  Autonomous  Prediction  PDF
• 2021-12-08 Progressive Multi-stage Interactive Training in Mobile Network for Fine-grained Recognition    Zhenxin Wu, Qingliang Chen, Yifeng Liu, Yinqi Zhang, Chengkai Zhu, Yang Yu arXiv_CV arXiv_CV  Transformer  Recognition  Pose  Action  Classification  CNN  PDF
• 2021-12-08 VIRT: Improving Representation-based Models for Text Matching through Virtual Interaction    Dan Li, Yang Yang, Hongyin Tang, Jingang Wang, Tong Xu, Wei Wu, Enhong Chen arXiv_CL arXiv_CL  Transformer  Knowledge  Pose  Action  Inference  Matching  PDF
• 2021-12-08 Transformer-Based Approach for Joint Handwriting and Named Entity Recognition in Historical documents    Ahmed Cheikh Rouhoua, Marwa Dhiaf, Yousri Kessentini, Sinda Ben Salem arXiv_CV arXiv_CV  Transformer  Segmentation  Handwriting  Recognition  Pose  Face  Action  Language_Model  Prediction  PDF
• 2021-12-08 Transformaly -- Two Are Better Than One    Matan Jacob Cohen, Shai Avidan arXiv_CV arXiv_CV  Transformer  Action  Detection  PDF
• 2021-12-08 Symmetry Perception by Deep Networks: Inadequacy of Feed-Forward Architectures and Improvements with Recurrent Connections    Shobhita Sundaram, Darius Sinha, Matthew Groth, Tomotake Sasaki, Xavier Boix arXiv_CV arXiv_CV  Transformer  Recognition  Action  PDF
• 2021-12-08 Garment4D: Garment Reconstruction from Point Cloud Sequences    Fangzhou Hong, Liang Pan, Zhongang Cai, Ziwei Liu arXiv_CV arXiv_CV  Transformer  Reconstruction  Point_Cloud  3D  Pose  Action  Quantitative  PDF
• 2021-12-07 MS-TCT: Multi-Scale Temporal ConvTransformer for Action Detection    Rui Dai, Srijan Das, Kumara Kahatapitiya, Michael S. Ryoo, Francois Bremond arXiv_CV arXiv_CV  Transformer  Pose  Action  Classification  Detection  Relation  PDF
• 2021-12-07 Natural Answer Generation: From Factoid Answer to Full-length Answer using Grammar Correction    Manas Jain, Sriparna Saha, Pushpak Bhattacharyya, Gladvin Chinnadurai, Manish Kumar Vatsa arXiv_AI arXiv_AI  Transformer  Pose  Inference  QA  PDF
• 2021-12-07 raceBERT -- A Transformer-based Model for Predicting Race from Names    Prasanna Parasurama arXiv_CL arXiv_CL  Transformer  Bert  RNN  Knowledge  Prediction  PDF
• 2021-12-07 Regularity Learning via Explicit Distribution Modeling for Skeletal Video Anomaly Detection    Shoubin Yu, Zhongyin Zhao, Haoshu Fang, Andong Deng, Haisheng Su, Dongliang Wang, Weihao Gan, Cewu Lu, Wei Wu arXiv_CV arXiv_CV  Transformer  Surveillance  Reconstruction  Self-Supervised  Pose  Detection  Optical_Flow  PDF
• 2021-12-07 SSAT: A Symmetric Semantic-Aware Transformer Network for Makeup Transfer and Removal    Zhaoyang Sun, Yaxiong Chen, Shengwu Xiong arXiv_CV arXiv_CV  Transformer  Weakly_Supervised  Pose  PDF
• 2021-12-07 Parsing with Pretrained Language Models, Multiple Datasets, and Dataset Embeddings    Rob van der Goot, Miryam de Lhoneux arXiv_CL arXiv_CL  Transformer  Embedding  Language_Model  PDF
• 2021-12-07 A deep language model to predict metabolic network equilibria    François Charton, Amaury Hayat, Sean T. McQuade, Nathaniel J. Merrill, Benedetto Piccoli arXiv_CL arXiv_CL  Transformer  Quantitative  Deep_Learning  Language_Model  PDF
• 2021-12-07 Bootstrapping ViTs: Towards Liberating Vision Transformers from Pre-training    Haofei Zhang, Jiarui Duan, Mengqi Xue, Jie Song, Li Sun, Mingli Song arXiv_AI arXiv_AI  Transformer  Optimization  Pose  CNN  PDF
• 2021-12-07 Decision-based Black-box Attack Against Vision Transformers via Patch-wise Adversarial Removal    Yucheng Shi, Yahong Han arXiv_CV arXiv_CV  Transformer  Adversarial  Pose  Action  CNN  PDF
• 2021-12-06 DoodleFormer: Creative Sketch Drawing with Transformers    Ankan Kumar Bhunia, Salman Khan, Hisham Cholakkal, Rao Muhammad Anwer, Fahad Shahbaz Khan, Jorma Laaksonen, Michael Felsberg arXiv_CV arXiv_CV  Transformer  Sketch  Pose  Quantitative  Relation  Activity  PDF
• 2021-12-06 Human Parity on CommonsenseQA: Augmenting Self-Attention with External Attention    Yichong Xu, Chenguang Zhu, Shuohang Wang, Siqi Sun, Hao Cheng, Xiaodong Liu, Jianfeng Gao, Pengcheng He, Michael Zeng, Xuedong Huang arXiv_AI arXiv_AI  Transformer  OCR  Knowledge  Pose  Attention  Prediction  QA  PDF
• 2021-12-06 Scaling Up Influence Functions    Andrea Schioppa, Polina Zablotskaia, David Vilar, Artem Sokolov arXiv_CV arXiv_CV  Transformer  Tracking  Knowledge  Pose  Classification  Image_Classification  Prediction  PDF
• 2021-12-06 PTTR: Relational 3D Point Cloud Object Tracking with Transformer    Changqing Zhou, Zhipeng Luo, Yueru Luo, Tianrui Liu, Liang Pan, Zhongang Cai, Haiyu Zhao, Shijian Lu arXiv_CV arXiv_CV  Transformer  Tracking  Point_Cloud  3D  Object_Tracking  Pose  Relation  Attention  Prediction  Matching  PDF
• 2021-12-06 Offline Pre-trained Multi-Agent Decision Transformer: One Big Sequence Model Conquers All StarCraftII Tasks    Linghui Meng, Muning Wen, Yaodong Yang, Chenyang Le, Xiyun Li, Weinan Zhang, Ying Wen, Haifeng Zhang, Jun Wang, Bo Xu arXiv_AI arXiv_AI  Transformer  Enhancement  Reinforcement_Learning  Zero-Shot  Knowledge  Pose  Action  PDF
• 2021-12-06 GETAM: Gradient-weighted Element-wise Transformer Attention Map for Weakly-supervised Semantic segmentation    Weixuan Sun, Jing Zhang, Zheyuan Liu, Yiran Zhong, Nick Barnes arXiv_CV arXiv_CV  Transformer  Segmentation  Semantic_Segmentation  Weakly_Supervised  Pose  Attention  CNN  Prediction  PDF
• 2021-12-06 Make It Move: Controllable Image-to-Video Generation with Text Descriptions    Yaosi Hu, Chong Luo, Zhenzhong Chen arXiv_CV arXiv_CV  Transformer  Pose  PDF
• 2021-12-06 One-shot Talking Face Generation from Single-speaker Audio-Visual Correlation Learning    Suzhen Wang, Lincheng Li, Yu Ding, Xin Yu arXiv_CV arXiv_CV  Transformer  Speech  Pose  Face  Relation  PDF
• 2021-12-05 Dynamic Token Normalization Improves Vision Transformer    Wenqi Shao, Yixiao Ge, Zhaoyang Zhang, Xuyuan Xu, Xiaogang Wang, Ying Shan, Ping Luo arXiv_AI arXiv_AI  Transformer  Embedding  Detection  Object_Detection  PDF
• 2021-12-05 PolyphonicFormer: Unified Query Learning for Depth-aware Video Panoptic Segmentation    Haobo Yuan, Xiangtai Li, Yibo Yang, Guangliang Cheng, Jing Zhang, Yunhai Tong, Lefei Zhang, Dacheng Tao arXiv_CV arXiv_CV  Transformer  Segmentation  Tracking  Pose  Relation  PDF
• 2021-12-05 Learning Tracking Representations via Dual-Branch Fully Transformer Networks    Fei Xie, Chunyu Wang, Guangting Wang, Wankou Yang, Wenjun Zeng arXiv_CV arXiv_CV  Transformer  Tracking  Object_Tracking  Attention  Inference  Matching  PDF
• 2021-12-05 Adaptive Channel Encoding Transformer for Point Cloud Analysis    Guoquan Xu, Hezhi Cao, Jianwei Wan, Ke Xu, Yanxin Ma, Cong Zhang arXiv_CV arXiv_CV  Transformer  Segmentation  Point_Cloud  Pose  Classification  Relation  Attention  PDF
• 2021-12-05 Pose-guided Feature Disentangling for Occluded Person Re-identification Based on Transformer    Tao Wang, Hong Liu, Pinhao Song, Tianyu Guo, Wei Shi arXiv_CV arXiv_CV  Transformer  Person_Re-identification  Pose  Re-identification  Matching  PDF
• 2021-12-04 Unraveling Social Perceptions & Behaviors towards Migrants on Twitter    Aparup Khatua, Wolfgang Nejdl arXiv_CL arXiv_CL  Transformer  Bert  Speech  Pose  Face  Detection  PDF
• 2021-12-04 3rd Place: A Global and Local Dual Retrieval Solution to Facebook AI Image Similarity Challenge    Xinlong Sun, Yangyang Qin, Xuyuan Xu, Guoping Gong, Yang Fang, Yexin Wang arXiv_CV arXiv_CV  Transformer  Self-Supervised  Pose  Face  Detection  GAN  Matching  PDF
• 2021-12-04 TransCMD: Cross-Modal Decoder Equipped with Transformer for RGB-D Salient Object Detection    Youwei Pang, Xiaoqi Zhao, Lihe Zhang, Huchuan Lu arXiv_CV arXiv_CV  Transformer  Embedding  Salient  Pose  Detection  Object_Detection  PDF
• 2021-12-04 Ablation study of self-supervised learning for image classification    Ilias Papastratis arXiv_CV arXiv_CV  Transformer  Recognition  Self-Supervised  Classification  CNN  Image_Classification  PDF
• 2021-12-04 U2-Former: A Nested U-shaped Transformer for Image Restoration    Haobo Ji, Xin Feng, Wenjie Pei, Jinxing Li, Guangming Lu arXiv_CV arXiv_CV  Transformer  Restoration  Pose  Contrastive_Learning  Action  Attention  PDF
• 2021-12-04 A Multi-Strategy based Pre-Training Method for Cold-Start Recommendation    Bowen Hao, Hongzhi Yin, Jing Zhang, Cuiping Li, Hong Chen arXiv_AI arXiv_AI  Transformer  Reconstruction  Embedding  Self-Supervised  Pose  Contrastive_Learning  Relation  Inference  Recommendation  PDF
• 2021-12-04 LAVT: Language-Aware Vision Transformer for Referring Image Segmentation    Zhao Yang, Jiaqi Wang, Yansong Tang, Kai Chen, Hengshuang Zhao, Philip H.S. Torr arXiv_CV arXiv_CV  Transformer  Segmentation  Relation  PDF
• 2021-12-03 NN-LUT: Neural Approximation of Non-Linear Operations for Efficient Transformer Inference    Joonsang Yu, Junki Park, Seongmin Park, Minsoo Kim, Sihwa Lee, Dong Hyun Lee, Jungwook Choi arXiv_AI arXiv_AI  Transformer  Bert  Pose  Inference  PDF
• 2021-12-03 CTIN: Robust Contextual Transformer Network for Inertial Navigation    Bingbing Rao, Ehsan Kazemi, Yifan Ding, Devu M Shila, Frank M. Tucker, Liqiang Wang arXiv_AI arXiv_AI  Transformer  Knowledge  Pose  Attention  Prediction  PDF
• 2021-12-03 Linear algebra with transformers    François Charton arXiv_CL arXiv_CL  Transformer  Few-Shot  PDF
• 2021-12-03 Efficient Two-Stage Detection of Human-Object Interactions with a Novel Unary-Pairwise Transformer    Frederic Z. Zhang, Dylan Campbell, Stephen Gould arXiv_AI arXiv_AI  Transformer  Recognition  Pose  Action  Detection  Object_Detection  Inference  PDF
• 2021-12-03 Semantic Segmentation of Legal Documents via Rhetorical Roles    Vijit Malik, Rishabh Sanjay, Shouvik Kumar Guha, Shubham Kumar Nigam, Angshuman Hazarika, Arnab Bhattacharya, Ashutosh Modi arXiv_AI arXiv_AI  Transformer  Segmentation  Semantic_Segmentation  Pose  Deep_Learning  Prediction  PDF
• 2021-12-03 Siamese BERT-based Model for Web Search Relevance Ranking Evaluated on a New Czech Dataset    Matěj Kocián, Jakub Náplava, Daniel Štancl, Vladimír Kadlec arXiv_CL arXiv_CL  Transformer  Bert  Language_Model  PDF
• 2021-12-03 MT-TransUNet: Mediating Multi-Task Tokens in Transformers for Skin Lesion Segmentation and Classification    Jingye Chen, Jieneng Chen, Zongwei Zhou, Bin Li, Alan Yuille, Yongyi Lu arXiv_CV arXiv_CV  Transformer  Segmentation  Pose  Classification  Inference  PDF
• 2021-12-03 Multitask Finetuning for Improving Neural Machine Translation in Indian Languages    Shaily Desai, Atharva Kshirsagar, Manisha Marathe arXiv_CL arXiv_CL  Transformer  Text_Classification  Pose  Classification  Language_Model  PDF
• 2021-12-03 Single-Shot Black-Box Adversarial Attacks Against Malware Detectors: A Causal Language Model Approach    James Lee Hu, Mohammadreza Ebrahimi, Hsinchun Chen arXiv_AI arXiv_AI  Transformer  Adversarial  Pose  Action  Deep_Learning  Detection  Object_Detection  Attention  Language_Model  PDF
• 2021-12-03 Improving Predictions of Tail-end Labels using Concatenated BioMed-Transformers for Long Medical Documents    Vithya Yogarajan, Bernhard Pfahringer, Tony Smith, Jacob Montiel arXiv_AI arXiv_AI  Transformer  Knowledge  Classification  Relation  Medical  Language_Model  Prediction  PDF
• 2021-12-03 TransCouplet:Transformer based Chinese Couplet Generation    Kuan-Yu Chiang, Shihao Lin, Joe Chen, Qian Yin, Qizhen Jin arXiv_AI arXiv_AI  Transformer  Bert  Speech  Pose  PDF
• 2021-12-03 LMR-CBT: Learning Modality-fused Representations with CB-Transformer for Multimodal Emotion Recognition from Unaligned Multimodal Sequences    Ziwang Fu, Feng Liu, Hanyang Wang, Siyuan Shen, Jiahao Zhang, Jiayin Qi, Xiangling Fu, Aimin Zhou arXiv_CV arXiv_CV  Transformer  Recognition  Pose  Emotion  Action  Attention  PDF
• 2021-12-03 Hybrid Instance-aware Temporal Fusion for Online Video Instance Segmentation    Xiang Li, Jinglu Wang, Xiao Li, Yan Lu arXiv_CV arXiv_CV  Transformer  Segmentation  Pose  Attention  Matching  PDF
• 2021-12-03 Make A Long Image Short: Adaptive Token Length for Vision Transformers    Yichen Zhu, Yuqin Zhu, Jie Du, Yi Wang, Zhicai Ou, Feifei Feng, Jian Tang arXiv_CV arXiv_CV  Transformer  Recognition  Pose  Action_Recognition  Action  Classification  Image_Classification  Inference  Prediction  PDF
• 2021-12-03 TransZero: Attribute-guided Transformer for Zero-Shot Learning    Shiming Chen, Ziming Hong, Yang Liu, Guo-Sen Xie, Baigui Sun, Hao Li, Qinmu Peng, Ke Lu, Xinge You arXiv_AI arXiv_AI  Transformer  Embedding  Zero-Shot  Knowledge  Pose  Action  Relation  Attention  PDF
• 2021-12-03 The Influence of Data Pre-processing and Post-processing on Long Document Summarization    Xinwei Du, Kailun Dong, Yuchen Zhang, Yongsheng Li, Ruei-Yu Tsay arXiv_AI arXiv_AI  Transformer  Attention  Summarization  PDF
• 2021-12-02 Probabilistic Tracking with Deep Factors    Fan Jiang, Andrew Marmon, Ildebrando De Courten, Marc Rasi, Frank Dellaert arXiv_CV arXiv_CV  Transformer  Tracking  3D  Knowledge  Pose  Classification  Image_Classification  PDF
• 2021-12-02 PLSUM: Generating PT-BR Wikipedia by Summarizing Multiple Websites    André Seidel Oliveira, Anna Helena Reali Costa arXiv_CL arXiv_CL  Transformer  Knowledge  PDF
• 2021-12-02 BEVT: BERT Pretraining of Video Transformers    Rui Wang, Dongdong Chen, Zuxuan Wu, Yinpeng Chen, Xiyang Dai, Mengchen Liu, Yu-Gang Jiang, Luowei Zhou, Lu Yuan arXiv_CV arXiv_CV  Transformer  Recognition  Bert  Represenation_Learning  Prediction  PDF
• 2021-12-02 Masked-attention Mask Transformer for Universal Image Segmentation    Bowen Cheng, Ishan Misra, Alexander G. Schwing, Alexander Kirillov, Rohit Girdhar arXiv_AI arXiv_AI  Transformer  Segmentation  Semantic_Segmentation  Attention  PDF
• 2021-12-02 Improved Multiscale Vision Transformers for Classification and Detection    Yanghao Li, Chao-Yuan Wu, Haoqi Fan, Karttikeya Mangalam, Bo Xiong, Jitendra Malik, Christoph Feichtenhofer arXiv_CV arXiv_CV  Transformer  Embedding  Recognition  Pose  Classification  Detection  Object_Detection  Attention  Video_Classification  PDF
• 2021-12-02 Uni-Perceiver: Pre-training Unified Architecture for Generic Perception for Zero-shot and Few-shot Tasks    Xizhou Zhu, Jinguo Zhu, Hao Li, Xiaoshi Wu, Xiaogang Wang, Hongsheng Li, Xiaohua Wang, Jifeng Dai arXiv_CV arXiv_CV  Transformer  Zero-Shot  Few-Shot  PDF
• 2021-12-02 Self-supervised Video Transformer    Kanchana Ranasinghe, Muzammal Naseer, Salman Khan, Fahad Shahbaz Khan, Michael Ryoo arXiv_CV arXiv_CV  Transformer  Recognition  Knowledge  Self-Supervised  Pose  Action_Recognition  Action  Relation  PDF
• 2021-12-02 OW-DETR: Open-world Detection Transformer    Akshita Gupta, Sanath Narayan, K J Joseph, Salman Khan, Fahad Shahbaz Khan, Mubarak Shah arXiv_CV arXiv_CV  Transformer  Knowledge  Pose  Classification  Detection  Object_Detection  Attention  PDF
• 2021-12-02 ScaleVLAD: Improving Multimodal Sentiment Analysis via Multi-Scale Fusion of Locally Descriptors    Huaishao Luo, Lei Ji, Yanyong Huang, Bin Wang, Shenggong Ji, Tianrui Li arXiv_AI arXiv_AI  Transformer  Self-Supervised  Pose  Sentiment  Attention  Prediction  PDF
• 2021-12-02 AST-Transformer: Encoding Abstract Syntax Trees Efficiently for Code Summarization    Ze Tang, Chuanyi Li, Jidong Ge, Xiaoyu Shen, Zheling Zhu, Bin Luo arXiv_CL arXiv_CL  Transformer  Pose  Summarization  PDF
• 2021-12-02 MTFNet: Mutual-Transformer Fusion Network for RGB-D Salient Object Detection    Xixi Wang, Bo Jiang, Xiao Wang, Bin Luo arXiv_CV arXiv_CV  Transformer  Regularization  Salient  Pose  Action  Detection  Object_Detection  PDF
• 2021-12-02 Unsupervised Law Article Mining based on Deep Pre-Trained Language Representation Models with Application to the Italian Civil Code    Andrea Tagarelli, Andrea Simeri arXiv_AI arXiv_AI  Transformer  Unsupervised  Bert  Knowledge  Classification  Deep_Learning  Few-Shot  Attention  Prediction  PDF
• 2021-12-02 TCTN: A 3D-Temporal Convolutional Transformer Network for Spatiotemporal Predictive Learning    Ziao Yang, Xiangrui Yang, Qifeng Lin arXiv_CV arXiv_CV  Transformer  3D  RNN  Pose  CNN  PDF
• 2021-12-02 TBN-ViT: Temporal Bilateral Network with Vision Transformer for Video Scene Parsing    Bo Yan, Leilei Cao, Hongbin Wang arXiv_CV arXiv_CV  Transformer  Scene_Parsing  Pose  PDF
• 2021-12-02 TransMEF: A Transformer-Based Multi-Exposure Image Fusion Framework using Self-Supervised Multi-Task Learning    Linhao Qu, Shaolei Liu, Manning Wang, Zhijian Song arXiv_CV arXiv_CV  Transformer  Reconstruction  Self-Supervised  Pose  Deep_Learning  PDF
• 2021-12-02 Differentiable Spatial Planning using Transformers    Devendra Singh Chaplot, Deepak Pathak, Jitendra Malik arXiv_AI arXiv_AI  Transformer  Pose  Action  CNN  PDF
• 2021-12-02 SwinTrack: A Simple and Strong Baseline for Transformer Tracking    Liting Lin, Heng Fan, Yong Xu, Haibin Ling arXiv_CV arXiv_CV  Transformer  Tracking  Pose  Action  Attention  CNN  PDF
• 2021-12-02 Object-Centric Unsupervised Image Captioning    Zihang Meng, David Yang, Xuefei Cao, Ashish Shah, Ser-Nam Lim arXiv_AI arXiv_AI  Image_Caption  Transformer  Unsupervised  Relation  Caption  PDF
• 2021-12-02 Vision Pair Learning: An Efficient Training Framework for Image Classification    Bei Tong, Xiaoyuan Yu arXiv_CV arXiv_CV  Transformer  Represenation_Learning  Pose  Classification  Attention  Image_Classification  PDF
• 2021-12-02 Multi-Domain Transformer-Based Counterfactual Augmentation for Earnings Call Analysis    Zixuan Yuan, Yada Zhu, Wei Zhang, Ziming Huang, Guangnan Ye, Hui Xiong arXiv_AI arXiv_AI  Transformer  Unsupervised  Pose  Deep_Learning  Inference  PDF
• 2021-12-02 Visual-Semantic Transformer for Scene Text Recognition    Xin Tang, Yongquan Lai, Ying Liu, Yuanyuan Fu, Rui Fang arXiv_CV arXiv_CV  Transformer  Recognition  Pose  Scene_Text  Action  Prediction  PDF
• 2021-12-01 Object-aware Video-language Pre-training for Retrieval    Alex Jinpeng Wang, Yixiao Ge, Guanyu Cai, Rui Yan, Xudong Lin, Ying Shan, Xiaohu Qie, Mike Zheng Shou arXiv_CV arXiv_CV  Transformer  Pose  Matching  PDF
• 2021-12-01 Transformer-based Network for RGB-D Saliency Detection    Yue Wang, Xu Jia, Lu Zhang, Yuke Li, James Elder, Huchuan Lu arXiv_CV arXiv_CV  Transformer  Enhancement  Salient  Pose  Detection  Prediction  PDF
• 2021-12-01 Systematic Generalization with Edge Transformers    Leon Bergen, Timothy J. O'Donnell, Dzmitry Bahdanau arXiv_CL arXiv_CL  Transformer  Pose  Relation  Attention  PDF
• 2021-12-01 Empirical evaluation of shallow and deep learning classifiers for Arabic sentiment analysis    Ali Bou Nassif, Abdollah Masoud Darya, Ashraf Elnagar arXiv_CL arXiv_CL  Transformer  Embedding  Bert  RNN  Review  Classification  Deep_Learning  Sentiment  CNN  PDF
• 2021-12-01 Human-Object Interaction Detection via Weak Supervision    Mert Kilickaya, Arnold Smeulders arXiv_CV arXiv_CV  Transformer  Pose  Action  Detection  Object_Detection  PDF
• 2021-12-01 Learning Transformer Features for Image Quality Assessment    Chao Zeng, Sam Kwong arXiv_CV arXiv_CV  Transformer  Pose  Deep_Learning  Relation  CNN  QA  PDF
• 2021-12-01 Score Transformer: Generating Musical Score from Note-level Representation    Masahiro Suzuki arXiv_SD arXiv_SD  Transformer  Pose  PDF
• 2021-12-01 Multi-View Stereo with Transformer    Jie Zhu, Bo Peng, Wanqing Li, Haifeng Shen, Zhe Zhang, Jianjun Lei arXiv_CV arXiv_CV  Transformer  3D  Pose  Action  Attention  Matching  PDF
• 2021-12-01 VoRTX: Volumetric 3D Reconstruction With Transformers for Voxelwise View Selection and Fusion    Noah Stier, Alexander Rich, Pradeep Sen, Tobias Höllerer arXiv_CV arXiv_CV  Transformer  Reconstruction  3D  Pose  Face  PDF
• 2021-12-01 Deliberation of Streaming RNN-Transducer by Non-autoregressive Decoding    Weiran Wang, Ke Hu, Tara Sainath arXiv_CL arXiv_CL  Transformer  Recognition  RNN  Pose  Attention  PDF
• 2021-11-30 AdaViT: Adaptive Vision Transformers for Efficient Image Recognition    Lingchen Meng, Hengduo Li, Bor-Chun Chen, Shiyi Lan, Zuxuan Wu, Yu-Gang Jiang, Ser-Nam Lim arXiv_CV arXiv_CV  Transformer  Recognition  Quantitative  Attention  Inference  PDF
• 2021-11-30 ATS: Adaptive Token Sampling For Efficient Vision Transformers    Mohsen Fayyaz, Soroush Abbasi Kouhpayegani, Farnoush Rezaei Jafari, Eric Sommerlade, Hamid Reza Vaezi Joze, Hamed Pirsiavash, Juergen Gall arXiv_CV arXiv_CV  Transformer  Pose  Classification  Image_Classification  PDF
• 2021-11-30 Donut: Document Understanding Transformer without OCR    Geewook Kim, Teakgyu Hong, Moonbin Yim, Jinyoung Park, Jinyeong Yim, Wonseok Hwang, Sangdoo Yun, Dongyoon Han, Seunghyun Park arXiv_AI arXiv_AI  Transformer  Recognition  OCR  Optical_Character  Pose  Deep_Learning  PDF
• 2021-11-30 Attentive Prototypes for Source-free Unsupervised Domain Adaptive 3D Object Detection    Deepti Hegde, Vishal Patel arXiv_CV arXiv_CV  Transformer  Unsupervised  3D  Pose  Detection  Object_Detection  PDF
• 2021-11-30 Robust Partial-to-Partial Point Cloud Registration in a Full Range    Liang Pan, Zhongang Cai, Ziwei Liu arXiv_CV arXiv_CV  Transformer  Point_Cloud  3D  Sparse  Pose  Relation  Matching  PDF
• 2021-11-30 KARL-Trans-NER: Knowledge Aware Representation Learning for Named Entity Recognition using Transformers    Avi Chawla, Nidhi Mulay, Vikas Bishnoi, Gaurav Dhama arXiv_CL arXiv_CL  Transformer  Recognition  Bert  Represenation_Learning  Knowledge  Pose  Summarization  PDF
• 2021-11-30 A Comparative Study of Transformers on Word Sense Disambiguation    Avi Chawla, Nidhi Mulay, Vikas Bishnoi, Gaurav Dhama, Dr. Anil Kumar Singh arXiv_CL arXiv_CL  Transformer  Embedding  Bert  Pose  Classification  PDF
• 2021-11-30 CT-block: a novel local and global features extractor for point cloud    Shangwei Guo, Jun Li, Zhengchao Lai, Xiantong Meng, Shaokun Han arXiv_CV arXiv_CV  Transformer  Segmentation  Point_Cloud  Pose  Classification  Deep_Learning  Attention  PDF
• 2021-11-30 NLP Techniques for Water Quality Analysis in Social Media Content    Muhammad Asif Ayub, Khubaib Ahmad, Kashif Ahmad, Nasir Ahmad, Ala Al-Fuqaha arXiv_CL arXiv_CL  Transformer  Bert  RNN  PDF
• 2021-11-30 EdiBERT, a generative model for image editing    Thibaut Issenhuth, Ugo Tanielian, Jérémie Mary, David Picard arXiv_CV arXiv_CV  Transformer  Inpainting  Bert  Pose  Denoising  PDF
• 2021-11-30 SP-SEDT: Self-supervised Pre-training for Sound Event Detection Transformer    Zhirong Ye, Xiangdong Wang, Hong Liu, Yueliang Qian, Rui Tao, Long Yan, Kazushige Ouchi arXiv_SD arXiv_SD  Transformer  Self-Supervised  Pose  Detection  Object_Detection  PDF
• 2021-11-30 Contrastive Learning for Local and Global Learning MRI Reconstruction    Qiaosi Yi, Jinhao Liu, Le Hu, Faming Fang, Guixu Zhang arXiv_CV arXiv_CV  Transformer  Reconstruction  Pose  Contrastive_Learning  Deep_Learning  Attention  Medical  PDF
• 2021-11-30 Shunted Self-Attention via Multi-Scale Token Aggregation    Sucheng Ren, Daquan Zhou, Shengfeng He, Jiashi Feng, Xinchao Wang arXiv_CV arXiv_CV  Transformer  Pose  Relation  Attention  PDF
• 2021-11-30 Improvement in Machine Translation with Generative Adversarial Networks    Jay Ahn, Hari Madhu, Viet Nguyen arXiv_CL arXiv_CL  Transformer  Adversarial  NMT  GAN  Text_Generation  PDF
• 2021-11-30 CycleTransGAN-EVC: A CycleGAN-based Emotional Voice Conversion Model with Transformer    Changzeng Fu, Chaoran Liu, Carlos Toshinori Ishi, Hiroshi Ishiguro arXiv_SD arXiv_SD  Transformer  Speech  Pose  Emotion  Relation  GAN  PDF
• 2021-11-30 HEAT: Holistic Edge Attention Transformer for Structured Reconstruction    Jiacheng Chen, Yiming Qian, Yasutaka Furukawa arXiv_CV arXiv_CV  Transformer  Reconstruction  Quantitative  Classification  Detection  Object_Detection  Attention  PDF
• 2021-11-30 A Unified Pruning Framework for Vision Transformers    Hao Yu, Jianxin Wu arXiv_CV arXiv_CV  Transformer  Classification  Deep_Learning  Detection  Object_Detection  PDF
• 2021-11-30 Pyramid Adversarial Training Improves ViT Performance    Charles Herrmann, Kyle Sargent, Lu Jiang, Ramin Zabih, Huiwen Chang, Ce Liu, Dilip Krishnan, Deqing Sun arXiv_CV arXiv_CV  Transformer  Sketch  Regularization  Adversarial  PDF
• 2021-11-29 DAFormer: Improving Network Architectures and Training Strategies for Domain-Adaptive Semantic Segmentation    Lukas Hoyer, Dengxin Dai, Luc Van Gool arXiv_CV arXiv_CV  Transformer  Segmentation  Unsupervised  Semantic_Segmentation  Pose  PDF
• 2021-11-29 End-to-End Referring Video Object Segmentation with Multimodal Transformers    Adam Botach, Evgenii Zheltonozhskii, Chaim Baskin arXiv_CV arXiv_CV  Transformer  Segmentation  Tracking  Video_Caption  Pose  Attention  GAN  Prediction  PDF
• 2021-11-29 Point-BERT: Pre-training 3D Point Cloud Transformers with Masked Point Modeling    Xumin Yu, Lulu Tang, Yongming Rao, Tiejun Huang, Jie Zhou, Jiwen Lu arXiv_AI arXiv_AI  Transformer  Point_Cloud  3D  Bert  Pose  Classification  Few-Shot  PDF
• 2021-11-29 TransWeather: Transformer-based Restoration of Images Degraded by Adverse Weather Conditions    Jeya Maria Jose Valanarasu, Rajeev Yasarla, Vishal M. Patel arXiv_CV arXiv_CV  Transformer  NAS  Embedding  Restoration  Pose  Attention  PDF
• 2021-11-29 Classification-Regression for Chart Comprehension    Matan Levy, Rami Ben-Ari, Dani Lischinski arXiv_CV arXiv_CV  Transformer  Pose  Action  Classification  Relation  Attention  QA  PDF
• 2021-11-29 Self-Supervised Pre-Training of Swin Transformers for 3D Medical Image Analysis    Yucheng Tang, Dong Yang, Wenqi Li, Holger Roth, Bennett Landman, Daguang Xu, Vishwesh Nath, Ali Hatamizadeh arXiv_AI arXiv_AI  Transformer  Segmentation  3D  Self-Supervised  Pose  GAN  Medical  PDF
• 2021-11-29 Searching the Search Space of Vision Transformer    Minghao Chen, Kan Wu, Bolin Ni, Houwen Peng, Bei Liu, Jianlong Fu, Hongyang Chao, Haibin Ling arXiv_CV arXiv_CV  Transformer  NAS  Segmentation  Semantic_Segmentation  Recognition  Pose  Detection  VQA  Object_Detection  PDF
• 2021-11-29 TransMVSNet: Global Context-aware Multi-view Stereo Network with Transformers    Yikang Ding, Wentao Yuan, Qingtian Zhu, Haotian Zhang, Xiangyue Liu, Yuanjiang Wang, Xiao Liu arXiv_CV arXiv_CV  Transformer  Knowledge  Pose  Relation  Attention  Matching  PDF
• 2021-11-29 Recurrent Vision Transformer for Solving Visual Reasoning Problems    Nicola Messina, Giuseppe Amato, Fabio Carrara, Claudio Gennaro, Fabrizio Falchi arXiv_CV arXiv_CV  Transformer  Attention  CNN  Prediction  PDF
• 2021-11-29 Mixed Precision Low-bit Quantization of Neural Network Language Models for Speech Recognition    Junhao Xu, Jianwei Yu, Shoukang Hu, Xunying Liu, Helen Meng arXiv_CL arXiv_CL  Transformer  NAS  Quantization  Gradient_Descent  Recognition  RNN  Speech  Pose  Speech_Recognition  Language_Model  PDF
• 2021-11-29 BuildFormer: Automatic building extraction with vision transformer    Libo Wang, Yuechi Yang, Rui Li arXiv_CV arXiv_CV  Transformer  Segmentation  Semantic_Segmentation  Pose  Action  Classification  Deep_Learning  Detection  Object_Detection  CNN  Image_Classification  PDF
• 2021-11-29 Mixed Precision of Quantization of Transformer Language Models for Speech Recognition    Junhao Xu, Shoukang Hu, Jianwei Yu, Xunying Liu, Helen Meng arXiv_SD arXiv_SD  Transformer  NAS  Quantization  Recognition  Speech  Pose  Speech_Recognition  Language_Model  PDF
• 2021-11-29 ROBIN : A Benchmark for Robustness to Individual Nuisancesin Real-World Out-of-Distribution Shifts    Bingchen Zhao, Shaozuo Yu, Wufei Ma, Mingxin Yu, Shenxiao Mei, Angtian Wang, Ju He, Alan Yuille, Adam Kortylewski arXiv_AI arXiv_AI  Transformer  3D  Pose_Estimation  Pose  Classification  Detection  Object_Detection  CNN  Image_Classification  PDF
• 2021-11-29 Improving Deep Learning Interpretability by Saliency Guided Training    Aya Abdelsalam Ismail, Héctor Corrada Bravo, Soheil Feizi arXiv_AI arXiv_AI  Transformer  RNN  Salient  Quantitative  Deep_Learning  CNN  Prediction  PDF
• 2021-11-29 Sparse DETR: Efficient End-to-End Object Detection with Learnable Sparsity    Byungseok Roh, JaeWoong Shin, Wuhyun Shin, Saehoon Kim arXiv_CV arXiv_CV  Transformer  Sparse  Pose  Detection  Object_Detection  Attention  PDF
• 2021-11-28 Zero-Shot Cross-Lingual Transfer in Legal Domain Using Transformer models    Zein Shaheen, Gerhard Wohlgenannt, Dmitry Muromtsev arXiv_AI arXiv_AI  Transformer  Bert  Zero-Shot  Text_Classification  Classification  Language_Model  PDF
• 2021-11-28 MIST-net: Multi-domain Integrative Swin Transformer network for Sparse-View CT Reconstruction    Jiayi Pan, Weiwen Wu, Zhifan Gao, Heye Zhang arXiv_CV arXiv_CV  Transformer  Reconstruction  Sparse  Pose  Quantitative  Deep_Learning  Attention  PDF
• 2021-11-28 Topic Driven Adaptive Network for Cross-Domain Sentiment Classification    Yicheng Zhu, Yiqiao Qiu, Yanghui Rao arXiv_AI arXiv_AI  Transformer  Sentiment_Classification  Pose  Classification  Sentiment  Attention  PDF
• 2021-11-28 ORCHARD: A Benchmark For Measuring Systematic Generalization of Multi-Hierarchical Reasoning    Bill Tuck Weng Pung, Alvin Chan arXiv_AI arXiv_AI  Transformer  RNN  Pose  Relation  Inference  PDF
• 2021-11-28 FastTrees: Parallel Latent Tree-Induction for Faster Sequence Encoding    Bill Tuck Weng Pung, Alvin Chan arXiv_CL arXiv_CL  Transformer  RNN  Pose  Sentiment  Inference  Language_Model  PDF
• 2021-11-27 Exploring Low-Cost Transformer Model Compression for Large-Scale Commercial Reply Suggestions    Vaishnavi Shrivastava, Radhika Gaonkar, Shashank Gupta, Abhishek Jha arXiv_CL arXiv_CL  Transformer  Language_Model  Recommendation  PDF
• 2021-11-27 Abusive and Threatening Language Detection in Urdu using Boosting based and BERT based models: A Comparative Approach    Mithun Das, Somnath Banerjee, Punyajoy Saha arXiv_CL arXiv_CL  Transformer  Bert  Pose  Action  Detection  GAN  PDF
• 2021-11-27 Exploring Transformer Based Models to Identify Hate Speech and Offensive Content in English and Indo-Aryan Languages    Somnath Banerjee, Maulindu Sarkar, Nancy Agrawal, Punyajoy Saha, Mithun Das arXiv_CL arXiv_CL  Transformer  Bert  Speech  Classification  Detection  PDF
• 2021-11-27 Learning A 3D-CNN and Transformer Prior for Hyperspectral Image Super-Resolution    Qing Ma, Junjun Jiang, Xianming Liu, Jiayi Ma arXiv_CV arXiv_CV  Transformer  Super_Resolution  3D  Regularization  Pose  Action  Quantitative  Deep_Learning  Relation  Attention  CNN  PDF
• 2021-11-27 FQ-ViT: Fully Quantized Vision Transformer without Retraining    Yang Lin, Tianyu Zhang, Peiqin Sun, Zheng Li, Shuchang Zhou arXiv_CV arXiv_CV  Transformer  Quantization  Knowledge  Pose  Attention  CNN  Inference  PDF
• 2021-11-27 Video Frame Interpolation Transformer    Zhihao Shi, Xiangyu Xu, Xiaohong Liu, Jun Chen, Ming-Hsuan Yang arXiv_CV arXiv_CV  Transformer  Pose  Quantitative  Attention  CNN  PDF
• 2021-11-26 BCH-NLP at BioCreative VII Track 3: medications detection in tweets using transformer networks and multi-task learning    Dongfang Xu, Shan Chen, Timothy Miller arXiv_CL arXiv_CL  Transformer  OCR  Text_Classification  Action  Classification  Detection  PDF
• 2021-11-26 GMFlow: Learning Optical Flow via Global Matching    Haofei Xu, Jing Zhang, Jianfei Cai, Hamid Rezatofighi, Dacheng Tao arXiv_CV arXiv_CV  Transformer  Enhancement  Pose  Relation  Attention  Optical_Flow  Inference  Prediction  Matching  PDF
• 2021-11-26 SWAT: Spatial Structure Within and Among Tokens    Kumara Kahatapitiya, Michael S. Ryoo arXiv_CV arXiv_CV  Transformer  Segmentation  Pose  Classification  Relation  Attention  PDF
• 2021-11-26 Mask Transfiner for High-Quality Instance Segmentation    Lei Ke, Martin Danelljan, Xia Li, Yu-Wing Tai, Chi-Keung Tang, Fisher Yu arXiv_CV arXiv_CV  Transformer  Segmentation  Sparse  Pose  PDF
• 2021-11-26 GeoNeRF: Generalizing NeRF with Geometry Priors    Mohammad Mahdi Johari, Yann Lepoittevin, François Fleuret arXiv_CV arXiv_CV  Transformer  Pose  Action  Attention  PDF
• 2021-11-26 Semi-Supervised Music Tagging Transformer    Minz Won, Keunwoo Choi, Xavier Serra arXiv_SD arXiv_SD  Transformer  Knowledge  Pose  Attention  CNN  PDF
• 2021-11-26 Simple Contrastive Representation Adversarial Learning for NLP Tasks    Deshui Miao, Jiaqi Zhang, Wenbo Xie, Jian Song, Xin Li, Lijuan Jia, Ning Guo arXiv_CL arXiv_CL  Transformer  Embedding  Unsupervised  Bert  Sparse  Adversarial  Self-Supervised  Pose  Contrastive_Learning  Classification  Attention  PDF
• 2021-11-26 A Volumetric Transformer for Accurate 3D Tumor Segmentation    Himashi Peiris, Munawar Hayat, Zhaolin Chen, Gary Egan, Mehrtash Harandi arXiv_CV arXiv_CV  Transformer  Segmentation  3D  Pose  Attention  Medical  PDF
• 2021-11-26 Exploiting full Resolution Feature Context for Liver Tumor and Vessel Segmentation via Fusion Encoder: Application to Liver Tumor and Vessel 3D reconstruction    Xiangyu Meng, Xudong Zhang, Gan Wang, Ying Zhang, Xin Shi, Huanhuan Dai, Zixuan Wang, Xun Wang arXiv_CV arXiv_CV  Transformer  Reconstruction  Segmentation  Recognition  3D  Pose  Deep_Learning  Attention  Medical  PDF
• 2021-11-25 New Approaches to Long Document Summarization: Fourier Transform Based Attention in a Transformer Model    Andrew Kiruluta, Andreas Lemos, Eric Lundy arXiv_CL arXiv_CL  Transformer  Embedding  Attention  Summarization  PDF
• 2021-11-25 SwinBERT: End-to-End Transformers with Sparse Attention for Video Captioning    Kevin Lin, Linjie Li, Chung-Ching Lin, Faisal Ahmed, Zhe Gan, Zicheng Liu, Yumao Lu, Lijuan Wang arXiv_CV arXiv_CV  Transformer  Video_Caption  3D  Bert  Sparse  Pose  Attention  Caption  PDF
• 2021-11-25 Transformer-based Korean Pretrained Language Models: A Survey on Three Years of Progress    Kichang Yang arXiv_CL arXiv_CL  Transformer  Bert  Survey  Attention  GAN  Language_Model  PDF
• 2021-11-25 Global Interaction Modelling in Vision Transformer via Super Tokens    Ammarah Farooq, Muhammad Awais, Sara Ahmed, Josef Kittler arXiv_CV arXiv_CV  Transformer  Embedding  Recognition  Represenation_Learning  Pose  Action  Classification  Attention  CNN  Image_Classification  Inference  PDF
• 2021-11-25 Scene Representation Transformer: Geometry-Free Novel View Synthesis Through Set-Latent Scene Representations    Mehdi S. M. Sajjadi, Henning Meyer, Etienne Pot, Urs Bergmann, Klaus Greff, Noha Radwan, Suhani Vora, Mario Lucic, Daniel Duckworth, Alexey Dosovitskiy, Jakob Uszkoreit, Tom Funkhouser, Andrea Tagliasacchi arXiv_AI arXiv_AI  Transformer  Reconstruction  Segmentation  Semantic_Segmentation  3D  Pose  PDF
• 2021-11-25 TunBERT: Pretrained Contextualized Text Representation for Tunisian Dialect    Abir Messaoudi, Ahmed Cheikhrouhou, Hatem Haddad, Nourchene Ferchichi, Moez BenHajhmida, Abir Korched, Malek Naski, Faten Ghriss, Amine Kerkeni arXiv_CL arXiv_CL  Transformer  Bert  Sparse  Pose  Sentiment  Attention  Language_Model  PDF
• 2021-11-25 BoxeR: Box-Attention for 2D and 3D Transformers    Duy-Kien Nguyen, Jihong Ju, Olaf Booji, Martin R. Oswald, Cees G. M. Snoek arXiv_CV arXiv_CV  Transformer  Segmentation  3D  Optimization  Pose  Action  Detection  Object_Detection  Attention  PDF
• 2021-11-25 NomMer: Nominate Synergistic Context in Vision Transformer for Visual Recognition    Hao Liu, Xinghua Jiang, Xin Li, Zhimin Bao, Deqiang Jiang, Bo Ren arXiv_CV arXiv_CV  Transformer  Segmentation  Semantic_Segmentation  Recognition  Pose  Classification  Detection  Object_Detection  Attention  Prediction  PDF
• 2021-11-25 PolyViT: Co-training Vision Transformers on Images, Videos and Audio    Valerii Likhosherstov, Anurag Arnab, Krzysztof Choromanski, Mario Lucic, Yi Tay, Adrian Weller, Mostafa Dehghani arXiv_CV arXiv_CV  Transformer  Classification  PDF
• 2021-11-25