Transformer
-
When Attention Meets Fast Recurrence: Training Language Models with Reduced Compute
Tao Lei
arXiv_CL
arXiv_CL
Transformer
Attention
Language_Model
PDF
-
Re-Evaluating GermEval17 Using German Pre-Trained Language Models
M. Aßenmacher, A. Corvonato, C. Heumann
arXiv_CL
arXiv_CL
Transformer
Bert
Face
Relation
Language_Model
PDF
-
GEM: Glare or Gloom, I Can Still See You -- End-to-End Multimodal Object Detector
Osama Mazhar, Jens Kober, Robert Babuska
arXiv_CV
arXiv_CV
Transformer
Knowledge
Pose
Detection
Object_Detection
PDF
-
LRG at SemEval-2021 Task 4: Improving Reading Comprehension with Abstract Words using Augmentation, Linguistic Features and Voting
Abheesht Sharma, Harshit Pandey, Gunjan Chhablani, Yash Bhartia, Tirtharaj Dash
arXiv_CL
arXiv_CL
Transformer
Bert
Pose
Language_Model
Prediction
PDF
-
From Universal Language Model to Downstream Task: Improving RoBERTa-Based Vietnamese Hate Speech Detection
Quang Huu Pham, Viet Anh Nguyen, Linh Bao Doan, Ngoc N. Tran, Ta Minh Thanh
arXiv_CL
arXiv_CL
Transformer
Bert
Text_Classification
Speech
Pose
Classification
Detection
Language_Model
PDF
-
Pyramid Vision Transformer: A Versatile Backbone for Dense Prediction without Convolutions
Wenhai Wang, Enze Xie, Xiang Li, Deng-Ping Fan, Kaitao Song, Ding Liang, Tong Lu, Ping Luo, Ling Shao
arXiv_CV
arXiv_CV
Transformer
Segmentation
Pose
Classification
Detection
Object_Detection
CNN
Image_Classification
Prediction
PDF
-
Zero-Shot Text-to-Image Generation
Aditya Ramesh, Mikhail Pavlov, Gabriel Goh, Scott Gray, Chelsea Voss, Alec Radford, Mark Chen, Ilya Sutskever
arXiv_CV
arXiv_CV
Transformer
Segmentation
Zero-Shot
PDF
-
Hopeful_Men@LT-EDI-EACL2021: Hope Speech Detection Using Indic Transliteration and Transformers
Ishan Sanjeev Upadhyay, Nikhil E, Anshul Wadhawan, Radhika Mamidi
arXiv_CL
arXiv_CL
Transformer
Embedding
Bert
RNN
Speech
Detection
PDF
-
Do Transformer Modifications Transfer Across Implementations and Applications?
Sharan Narang, Hyung Won Chung, Yi Tay, William Fedus, Thibault Fevry, Michael Matena, Karishma Malkan, Noah Fiedel, Noam Shazeer, Zhenzhong Lan, Yanqi Zhou, Wei Li, Nan Ding, Jake Marcus, Adam Roberts, Colin Raffel
arXiv_CL
arXiv_CL
Transformer
Pose
Recommendation
PDF
-
Unsupervised Brain Anomaly Detection and Segmentation with Transformers
Walter Hugo Lopez Pinaya, Petru-Daniel Tudosiu, Robert Gray, Geraint Rees, Parashkev Nachev, Sebastien Ourselin, M. Jorge Cardoso
arXiv_CV
arXiv_CV
Transformer
Segmentation
Unsupervised
Action
Detection
Attention
GAN
Medical
PDF
-
Dual-Path Modeling for Long Recording Speech Separation in Meetings
Chenda Li, Zhuo Chen, Yi Luo, Cong Han, Tianyan Zhou, Keisuke Kinoshita, Marc Delcroix, Shinji Watanabe, Yanmin Qian
arXiv_SD
arXiv_SD
Transformer
Speech
Pose
CNN
PDF
-
Deep Deformation Detail Synthesis for Thin Shell Models
Lan Chen, Lin Gao, Jie Yang, Shibiao Xu, Juntao Ye, Xiaopeng Zhang, Yu-Kun Lai
arXiv_CV
arXiv_CV
Transformer
Pose
Attention
Prediction
PDF
-
Parallelizing Legendre Memory Unit Training
Narsimha Chilkuri, Chris Eliasmith
arXiv_AI
arXiv_AI
Transformer
Bert
RNN
Pose
Sentiment
Inference
PDF
-
MixUp Training Leads to Reduced Overfitting and Improved Calibration for the Transformer Architecture
Wancong Zhang, Ieshan Vaidya
arXiv_CL
arXiv_CL
Transformer
Embedding
Bert
Pose
PDF
-
Deepfake Video Detection Using Convolutional Vision Transformer
Deressa Wodajo, Solomon Atnafu
arXiv_CV
arXiv_CV
Transformer
Pose
Face
Deep_Learning
Detection
Attention
CNN
PDF
-
Position Information in Transformers: An Overview
Philipp Dufter, Martin Schmitt, Hinrich Schütze
arXiv_AI
arXiv_AI
Transformer
Survey
PDF
-
Better Call the Plumber: Orchestrating Dynamic Information Extraction Pipelines
Mohamad Yaser Jaradeh, Kuldeep Singh, Markus Stocker, Andreas Both, Sören Auer
arXiv_CL
arXiv_CL
Transformer
Embedding
Optimization
Knowledge
Knowledge_Graph
Pose
Action
Classification
Relation
Relation_Extraction
PDF
-
Using Prior Knowledge to Guide BERT's Attention in Semantic Textual Matching Tasks
Tingyu Xia, Yue Wang, Yuan Tian, Yi Chang
arXiv_AI
arXiv_AI
Transformer
Bert
Salient
Knowledge
Pose
Attention
Matching
PDF
-
Do We Really Need Explicit Position Encodings for Vision Transformers?
Xiangxiang Chu, Bo Zhang, Zhi Tian, Xiaolin Wei, Huaxia Xia
arXiv_AI
arXiv_AI
Transformer
Pose
Classification
Attention
PDF
-
Transformer is All You Need: Multimodal Multitask Learning with a Unified Transformer
Ronghang Hu, Amanpreet Singh
arXiv_CV
arXiv_CV
Transformer
Pose
Detection
Object_Detection
Prediction
PDF
-
Pre-Training BERT on Arabic Tweets: Practical Considerations
Ahmed Abdelali, Sabit Hassan, Hamdy Mubarak, Kareem Darwish, Younes Samih
arXiv_AI
arXiv_AI
Transformer
Segmentation
Bert
QA
PDF
-
Medical Transformer: Gated Axial-Attention for Medical Image Segmentation
Jeya Maria Jose Valanarasu, Poojan Oza, Ilker Hacihaliloglu, Vishal M. Patel
arXiv_CV
arXiv_CV
Transformer
Segmentation
Pose
Attention
Medical
CNN
PDF
-
Towards Accurate and Compact Architectures via Neural Architecture Transformer
Yong Guo, Yin Zheng, Mingkui Tan, Qi Chen, Zhipeng Li, Jian Chen, Peilin Zhao, Junzhou Huang
arXiv_CV
arXiv_CV
Transformer
NAS
Optimization
Pose
PDF
-
Multilingual Answer Sentence Reranking via Automatically Translated Data
Thuy Vu, Alessandro Moschitti
arXiv_CL
arXiv_CL
Transformer
QA
PDF
-
Hate-Alert@DravidianLangTech-EACL2021: Ensembling strategies for Transformer-based Offensive language Detection
Debjoy Saha, Naman Paharia, Debajit Chakraborty, Punyajoy Saha, Animesh Mukherjee
arXiv_AI
arXiv_AI
Transformer
Detection
PDF
-
Using Transformer based Ensemble Learning to classify Scientific Articles
Sohom Ghosh, Ankush Chopra
arXiv_CL
arXiv_CL
Transformer
Bert
Review
Prediction
PDF
-
TransMask: A Compact and Fast Speech Separation Model Based on Transformer
Zining Zhang, Bingsheng He, Zhenjie Zhang
arXiv_SD
arXiv_SD
Transformer
Speech
Pose
Deep_Learning
Attention
Inference
PDF
-
Towards Emotion Recognition in Hindi-English Code-Mixed Data: A Transformer Based Approach
Anshul Wadhawan, Akshita Aggarwal
arXiv_CL
arXiv_CL
Transformer
Embedding
Recognition
Bert
RNN
Emotion
Action
Deep_Learning
Detection
Sentiment
Attention
Language_Model
PDF
-
Progressive Transformer-Based Generation of Radiology Reports
Farhad Nooralahzadeh, Nicolas Perez Gonzalez, Thomas Frauenfelder, Koji Fujimoto, Michael Krauthammer
arXiv_CL
arXiv_CL
Image_Caption
Transformer
Pose
PDF
-
Dialect Identification in Nuanced Arabic Tweets Using Farasa Segmentation and AraBERT
Anshul Wadhawan
arXiv_CL
arXiv_CL
Transformer
Segmentation
Bert
PDF
-
Multilingual Augmenter: The Model Chooses
Matthew Ciolino, David Noever, Josh Kalin
arXiv_CL
arXiv_CL
Transformer
Embedding
PDF
-
Going Full-TILT Boogie on Document Understanding with Text-Image-Layout Transformer
Rafał Powalski, Łukasz Borchmann, Dawid Jurkiewicz, Tomasz Dwojak, Michał Pietruszka, Gabriela Pałka
arXiv_CL
arXiv_CL
Transformer
VQA
Attention
QA
PDF
-
UnibucKernel: Geolocating Swiss-German Jodels Using Ensemble Learning
Mihaela Gaman, Sebastian Cojocariu, Radu Tudor Ionescu
arXiv_CL
arXiv_CL
Transformer
Embedding
Bert
Prediction
PDF
-
Quiz-Style Question Generation for News Stories
Adam D. Lelkes, Vinh Q. Tran, Cong Yu
arXiv_CL
arXiv_CL
Transformer
Knowledge
Pose
Survey
QA
PDF
-
Beyond Fully-Connected Layers with Quaternions: Parameterization of Hypercomplex Multiplications with $1/n$ Parameters
Aston Zhang, Yi Tay, Shuai Zhang, Alvin Chan, Anh Tuan Luu, Siu Cheung Hui, Jie Fu
arXiv_AI
arXiv_AI
Transformer
Style_Transfer
Represenation_Learning
RNN
Pose
Inference
PDF
-
Revisiting Language Encoding in Learning Multilingual Representations
Shengjie Luo, Kaiyuan Gao, Shuxin Zheng, Guolin Ke, Di He, Liwei Wang, Tie-Yan Liu
arXiv_CL
arXiv_CL
Transformer
Embedding
Pose
Action
Relation
Attention
PDF
-
End-to-End Automatic Speech Recognition with Deep Mutual Learning
Ryo Masumura, Mana Ihori, Akihiko Takashima, Tomohiro Tanaka, Takanori Ashihara
arXiv_CL
arXiv_CL
Transformer
Recognition
Knowledge
Speech
Pose
Classification
Speech_Recognition
Prediction
PDF
-
IronMan: GNN-assisted Design Space Exploration in High-Level Synthesis via Reinforcement Learning
Nan Wu, Yuan Xie, Cong Hao
arXiv_CL
arXiv_CL
Transformer
Reinforcement_Learning
Optimization
Pose
Action
Prediction
Matching
PDF
-
GradInit: Learning to Initialize Neural Networks for Stable and Efficient Training
Chen Zhu, Renkun Ni, Zheng Xu, Kezhi Kong, W. Ronny Huang, Tom Goldstein
arXiv_CV
arXiv_CV
Transformer
CNN
Language_Model
PDF
-
Exploring Transformers in Natural Language Generation: GPT, BERT, and XLNet
M. Onat Topal, Anil Bas, Imke van Heerden
arXiv_CL
arXiv_CL
Transformer
Bert
RNN
Attention
Summarization
Text_Generation
Language_Model
PDF
-
TransFuse: Fusing Transformers and CNNs for Medical Image Segmentation
Yundong Zhang, Huiye Liu, Qiang Hu
arXiv_AI
arXiv_AI
Transformer
Segmentation
Pose
Medical
CNN
Inference
PDF
-
TeraPipe: Token-Level Pipeline Parallelism for Training Large-Scale Language Models
Zhuohan Li, Siyuan Zhuang, Shiyuan Guo, Danyang Zhuo, Hao Zhang, Dawn Song, Ion Stoica
arXiv_CL
arXiv_CL
Transformer
Language_Model
PDF
-
Hierarchical Transformer-based Large-Context End-to-end ASR with Large-Context Knowledge Distillation
Ryo Masumura, Naoki Makishima, Mana Ihori, Akihiko Takashima, Tomohiro Tanaka, Shota Orihashi
arXiv_CL
arXiv_CL
Transformer
Recognition
Knowledge
Speech
Pose
Speech_Recognition
Language_Model
PDF
-
User-Inspired Posterior Network for Recommendation Reason Generation
Haolan Zhan, Hainan Zhang, Hongshen Chen, Lei Shen, Yanyan Lan, Zhuoye Ding, Dawei Yin
arXiv_CL
arXiv_CL
Transformer
Knowledge
Pose
Attention
QA
Recommendation
PDF
-
Translational Equivariance in Kernelizable Attention
Max Horn, Kumar Shridhar, Elrich Groenewald, Philipp F. M. Baumann
arXiv_CV
arXiv_CV
Transformer
Recognition
Action
Attention
CNN
PDF
-
BERT's output layer recognizes all hidden layers? Some Intriguing Phenomena and a simple way to boost BERT
Wei-Tsung Kao, Tsung-Han Wu, Po-Han Chi, Chun-Cheng Hsieh, Hung-Yi Lee
arXiv_CL
arXiv_CL
Transformer
Bert
Pose
PDF
-
Thank you for Attention: A survey on Attention-based Artificial Neural Networks for Automatic Speech Recognition
Priyabrata Karmakar, Shyh Wei Teng, Guojun Lu
arXiv_CL
arXiv_CL
Transformer
Recognition
Review
Speech
Survey
Attention
Speech_Recognition
PDF
-
indicnlp@kgp at DravidianLangTech-EACL2021: Offensive Language Identification in Dravidian Languages
Kushal Kedia, Abhilash Nandy
arXiv_CL
arXiv_CL
Transformer
Transfer_Learning
Bert
Text_Classification
RNN
Classification
PDF
-
TransGAN: Two Transformers Can Make One Strong GAN
Yifan Jiang, Shiyu Chang, Zhangyang Wang
arXiv_CV
arXiv_CV
Transformer
Segmentation
Embedding
Adversarial
Classification
Detection
Attention
GAN
CNN
PDF
-
Multimodal Punctuation Prediction with Contextual Dropout
Andrew Silva, Barry-John Theobald, Nicholas Apostoloff
arXiv_AI
arXiv_AI
Transformer
Recognition
Speech
Speech_Recognition
Prediction
PDF
-
End-to-end Audio-visual Speech Recognition with Conformers
Pingchuan Ma, Stavros Petridis, Maja Pantic
arXiv_CV
arXiv_CV
Transformer
Recognition
Speech
Pose
Attention
Speech_Recognition
Language_Model
PDF
-
Optimizing Inference Performance of Transformers on CPUs
Dave Dice, Alex Kogan
arXiv_AI
arXiv_AI
Transformer
Bert
Optimization
Pose
Face
Attention
Inference
PDF
-
Improving Zero-shot Neural Machine Translation on Language-specific Encoders-Decoders
Junwei Liao, Yu Shi, Ming Gong, Linjun Shou, Hong Qu, Michael Zeng
arXiv_CL
arXiv_CL
Transformer
Zero-Shot
Pose
NMT
Denoising
Attention
PDF
-
Transformer Language Models with LSTM-based Cross-utterance Information Representation
G. Sun, C. Zhang, P. C. Woodland
arXiv_AI
arXiv_AI
Transformer
Recognition
RNN
Speech
Pose
Speech_Recognition
Language_Model
PDF
-
On Efficient Training, Controllability and Compositional Generalization of Insertion-based Language Generators
Sidi Lu, Nanyun Peng
arXiv_CL
arXiv_CL
Transformer
Pose
Attention
Text_Generation
Caption
Language_Model
PDF
-
Neural Inverse Text Normalization
Monica Sunkara, Chaitanya Shivade, Sravan Bodapati, Katrin Kirchhoff
arXiv_CL
arXiv_CL
Transformer
Pose
PDF
-
Speech-language Pre-training for End-to-end Spoken Language Understanding
Yao Qian, Ximo Bian, Yu Shi, Naoyuki Kanda, Leo Shen, Zhen Xiao, Michael Zeng
arXiv_CL
arXiv_CL
Transformer
Speech
Pose
Inference
Language_Model
PDF
-
Proof Artifact Co-training for Theorem Proving with Language Models
Jesse Michael Han, Jason Rute, Yuhuai Wu, Edward W. Ayers, Stanislas Polu
arXiv_AI
arXiv_AI
Transformer
Self-Supervised
Pose
Language_Model
Prediction
PDF
-
Text Compression-aided Transformer Encoding
Zuchao Li, Zhuosheng Zhang, Hai Zhao, Rui Wang, Kehai Chen, Masao Utiyama, Eiichiro Sumita
arXiv_CL
arXiv_CL
Transformer
Pose
Attention
PDF
-
Generating Coherent and Diverse Slogans with Sequence-to-Sequence Transformer
Yiping Jin, Akshay Bhatia, Dittaya Wanvarie, Phu T. V. Le
arXiv_CL
arXiv_CL
Transformer
Pose
Quantitative
GAN
Inference
PDF
-
Training Vision Transformers for Image Retrieval
Alaaeldin El-Nouby, Natalia Neverova, Ivan Laptev, Hervé Jégou
arXiv_CV
arXiv_CV
Transformer
Image_Retrieval
Pose
Classification
Image_Classification
PDF
-
Multi-turn Dialogue Reading Comprehension with Pivot Turns and Knowledge
Zhuosheng Zhang, Junlong Li, Hai Zhao
arXiv_AI
arXiv_AI
Transformer
Knowledge
Knowledge_Graph
Pose
Language_Model
Prediction
Matching
PDF
-
Origami spring-inspired shape morphing for flexible robotics
Qianying Chen, Fan Feng, Pengyu Lv, Huiling Duan
arXiv_RO
arXiv_RO
Transformer
Pose
PDF
-
Is Space-Time Attention All You Need for Video Understanding?
Gedas Bertasius, Heng Wang, Lorenzo Torresani
arXiv_CV
arXiv_CV
Transformer
Recognition
Video_Caption
3D
Action_Recognition
Action
Classification
Attention
CNN
Video_Classification
PDF
-
Improving Visual Reasoning by Exploiting The Knowledge in Texts
Sahand Sharifzadeh, Sina Moayed Baharlou, Martin Schmitt, Hinrich Schütze, Volker Tresp
arXiv_AI
arXiv_AI
Transformer
Knowledge
Self-Supervised
Classification
Relation
PDF
-
Bayesian Transformer Language Models for Speech Recognition
Boyang Xue, Jianwei Yu, Junhao Xu, Shansong Liu, Shoukang Hu, Zi Ye, Mengzhe Geng, Xunying Liu, Helen Meng
arXiv_CL
arXiv_CL
Transformer
Embedding
Recognition
Speech
Pose
Attention
Speech_Recognition
Inference
Language_Model
PDF
-
Conversational Query Rewriting with Self-supervised Learning
Hang Liu, Meng Chen, Youzheng Wu, Xiaodong He, Bowen Zhou
arXiv_CL
arXiv_CL
Transformer
Self-Supervised
Pose
Detection
PDF
-
Transfer Learning Approach for Arabic Offensive Language Detection System -- BERT-Based Model
Fatemah Husain, Ozlem Uzuner
arXiv_CL
arXiv_CL
Transformer
Transfer_Learning
Bert
Knowledge
Detection
PDF
-
Joint Intent Detection and Slot Filling with Wheel-Graph Attention Networks
Pengfei Wei, Bi Zeng, Wenxiong Liao
arXiv_AI
arXiv_AI
Transformer
Bert
Pose
Deep_Learning
Detection
Attention
PDF
-
Wake Word Detection with Streaming Transformers
Yiming Wang, Hang Lv, Daniel Povey, Lei Xie, Sanjeev Khudanpur
arXiv_CL
arXiv_CL
Transformer
Embedding
RNN
Pose
Detection
CNN
PDF
-
Colorization Transformer
Manoj Kumar, Dirk Weissenborn, Nal Kalchbrenner
arXiv_AI
arXiv_AI
Transformer
Attention
PDF
-
TransReID: Transformer-based Object Re-Identification
Shuting He, Hao Luo, Pichao Wang, Fan Wang, Hao Li, Wei Jiang
arXiv_CV
arXiv_CV
Transformer
Embedding
Knowledge
Pose
Re-identification
CNN
PDF
-
Unlocking Pixels for Reinforcement Learning via Implicit Attention
Krzysztof Choromanski, Deepali Jain, Jack Parker-Holder, Xingyou Song, Valerii Likhosherstov, Anirban Santara, Aldo Pacchiano, Yunhao Tang, Adrian Weller
arXiv_AI
arXiv_AI
Transformer
Reinforcement_Learning
Pose
Action
Relation
Attention
PDF
-
Generating Fake Cyber Threat Intelligence Using Transformer-Based Models
Priyanka Ranade, Aritran Piplai, Sudip Mittal, Anupam Joshi, Tim Finin
arXiv_AI
arXiv_AI
Transformer
Knowledge
Knowledge_Graph
Language_Model
PDF
-
TransUNet: Transformers Make Strong Encoders for Medical Image Segmentation
Jieneng Chen, Yongyi Lu, Qihang Yu, Xiangde Luo, Ehsan Adeli, Yan Wang, Le Lu, Alan L. Yuille, Yuyin Zhou
arXiv_CV
arXiv_CV
Transformer
Segmentation
Pose
Attention
GAN
Medical
CNN
Prediction
PDF
-
SLUA: A Super Lightweight Unsupervised Word Alignment Model via Cross-Lingual Contrastive Learning
Di Wu, Liang Ding, Shuo Yang, Dacheng Tao
arXiv_AI
arXiv_AI
Transformer
Embedding
Unsupervised
Pose
Contrastive_Learning
Attention
PDF
-
End-to-End Multi-Channel Transformer for Speech Recognition
Feng-Ju Chang, Martin Radfar, Athanasios Mouchtaris, Brian King, Siegfried Kunzmann
arXiv_CL
arXiv_CL
Transformer
Recognition
Speech
Relation
Attention
Speech_Recognition
PDF
-
Iconographic Image Captioning for Artworks
Eva Cetinic
arXiv_CV
arXiv_CV
Image_Caption
Transformer
Quantitative
Classification
Relation
Caption
PDF
-
Nystr'omformer: A Nystr'om-Based Algorithm for Approximating Self-Attention
Yunyang Xiong, Zhanpeng Zeng, Rudrasis Chakraborty, Mingxing Tan, Glenn Fung, Yin Li, Vikas Singh
arXiv_CL
arXiv_CL
Transformer
Review
Pose
Attention
PDF
-
Unsupervised Sentence-embeddings by Manifold Approximation and Projection
Subhradeep Kayal
arXiv_CL
arXiv_CL
Transformer
Embedding
Unsupervised
Text_Classification
Pose
Action
Classification
PDF
-
RoI Tanh-polar Transformer Network for Face Parsing in the Wild
Yiming Lin, Jie Shen, Yujiang Wang, Maja Pantic
arXiv_CV
arXiv_CV
Transformer
Represenation_Learning
Pose
Face
Action
CNN
PDF
-
Adaptive Semiparametric Language Models
Dani Yogatama, Cyprien de Masson d'Autume, Lingpeng Kong
arXiv_CL
arXiv_CL
Transformer
Pose
Language_Model
Prediction
PDF
-
MUFASA: Multimodal Fusion Architecture Search for Electronic Health Records
Zhen Xu, David R. So, Andrew M. Dai
arXiv_AI
arXiv_AI
Transformer
NAS
Sparse
Pose
Deep_Learning
Prediction
PDF
-
DiSCoL: Toward Engaging Dialogue Systems through Conversational Line Guided Response Generation
Sarik Ghazarian, Zixi Liu, Tuhin Chakrabarty, Xuezhe Ma, Aram Galstyan, Nanyun Peng
arXiv_CL
arXiv_CL
Transformer
Language_Model
PDF
-
Bootstrapping Multilingual AMR with Contextual Word Alignments
Janaki Sheth, Young-Suk Lee, Ramon Fernandez Astudillo, Tahira Naseem, Radu Florian, Salim Roukos, Todd Ward
arXiv_AI
arXiv_AI
Transformer
Embedding
Bert
Weakly_Supervised
PDF
-
Neural Transfer Learning with Transformers for Social Science Text Analysis
Sandra Wankmüller
arXiv_CL
arXiv_CL
Transformer
Transfer_Learning
Bert
Deep_Learning
Prediction
PDF
-
Top-down Discourse Parsing via Sequence Labelling
Fajri Koto, Jey Han Lau, Timothy Baldwin
arXiv_CL
arXiv_CL
Transformer
RNN
Pose
PDF
-
Towards Natural and Controllable Cross-Lingual Voice Conversion Based on Neural TTS Model and Phonetic Posteriorgram
Shengkui Zhao, Hao Wang, Trung Hieu Nguyen, Bin Ma
arXiv_SD
arXiv_SD
Transformer
Speech
Pose
Inference
PDF
-
Riiid! Answer Correctness Prediction Kaggle Challenge: 4th Place Solution Summary
Duc Kinh Le Tran
arXiv_AI
arXiv_AI
Transformer
Embedding
Attention
Prediction
PDF
-
Pitfalls of Static Language Modelling
Angeliki Lazaridou, Adhiguna Kuncoro, Elena Gribovskaya, Devang Agrawal, Adam Liska, Tayfun Terzi, Mai Gimenez, Cyprien de Masson d'Autume, Sebastian Ruder, Dani Yogatama, Kris Cao, Tomas Kocisky, Susannah Young, Phil Blunsom
arXiv_AI
arXiv_AI
Transformer
Knowledge
Language_Model
PDF
-
Roughly Collected Dataset for Contact Force Sensing Catheter
Seunghyuk Cho, Minsoo Koo, Dongwoo Kim, Juyong Lee, Yeonwoo Jung, Kibyung Nam, Changmo Hwang
arXiv_RO
arXiv_RO
Transformer
RNN
CNN
PDF
-
HeBERT & HebEMO: a Hebrew BERT Model and a Tool for Polarity Analysis and Emotion Recognition
Avihay Chriqui, Inbal Yahav
arXiv_CL
arXiv_CL
Transformer
Recognition
Bert
Pose
Emotion
Classification
Detection
Sentiment
Language_Model
PDF
-
Relaxed Transformer Decoders for Direct Action Proposal Generation
Jing Tan, Jiaqi Tang, Limin Wang, Gangshan Wu
arXiv_CV
arXiv_CV
Transformer
Video_Caption
Sparse
Action
Detection
Activity
Matching
PDF
-
Clickbait Headline Detection in Indonesian News Sites using Multilingual Bidirectional Encoder Representations from Transformers
Muhammad N. Fakhruzzaman, Saidah Z. Jannah, Ratih A. Ningrum, Indah Fahmiyah
arXiv_CL
arXiv_CL
Transformer
Embedding
Bert
Text_Classification
Pose
Classification
Detection
Language_Model
PDF
-
Improving Distantly-Supervised Relation Extraction through BERT-based Label & Instance Embeddings
Despina Christou, Grigorios Tsoumakas
arXiv_CL
arXiv_CL
Transformer
Embedding
Bert
Pose
Action
Relation
Relation_Extraction
Attention
PDF
-
Civil Rephrases Of Toxic Texts With Self-Supervised Transformers
Leo Laugier, John Pavlopoulos, Jeffrey Sorensen, Lucas Dixon
arXiv_AI
arXiv_AI
Transformer
Style_Transfer
Self-Supervised
Detection
Denoising
PDF
-
Scaling Federated Learning for Fine-tuning of Large Language Models
Agrin Hilmkil, Sebastian Callh, Matteo Barbieri, Leon René Sütfeld, Edvin Listo Zec, Olof Mogren
arXiv_CL
arXiv_CL
Transformer
Bert
Text_Classification
Review
Classification
Sentiment
Language_Model
PDF
-
Automated Query Reformulation for Efficient Search based on Query Logs From Stack Overflow
Kaibo Cao (1), Chunyang Chen (2), Sebastian Baltes (3), Christoph Treude (3), Xiang Chen (4) ((1) Software Institute, Nanjing University, China, (2) Faculty of Information Technology, Monash University, Australia, (3) School of Computer Science, University of Adelaide, Australia, (4) School of Information Science and Technology, Nantong University, China)
arXiv_AI
arXiv_AI
Transformer
Pose
Deep_Learning
PDF
-
GTAE: Graph-Transformer based Auto-Encoders for Linguistic-Constrained Text Style Transfer
Yukai Shi, Sen Zhang, Chenxing Zhou, Xiaodan Liang, Xiaojun Yang, Liang Lin
arXiv_AI
arXiv_AI
Transformer
Embedding
Style_Transfer
Pose
Action
Quantitative
PDF
-
Video Transformer Network
Daniel Neimark, Omri Bar, Maya Zohar, Dotan Asselmann
arXiv_CV
arXiv_CV
Transformer
Recognition
3D
Action_Recognition
Action
Inference
PDF
-
Short Text Clustering with Transformers
Leonid Pugachev, Mikhail Burtsev
arXiv_CL
arXiv_CL
Transformer
Embedding
Transfer_Learning
Enhancement
Classification
Language_Model
PDF
-
Decoupling the Role of Data, Attention, and Losses in Multimodal Transformers
Lisa Anne Hendricks, John Mellor, Rosalia Schneider, Jean-Baptiste Alayrac, Aida Nematzadeh
arXiv_CV
arXiv_CV
Transformer
Zero-Shot
Image_Retrieval
Self-Supervised
Attention
PDF
-
Extending Neural Keyword Extraction with TF-IDF tagset matching
Boshko Koloski, Senja Pollak, Blaž Škrlj, Matej Martinc
arXiv_CL
arXiv_CL
Transformer
Unsupervised
Bert
RNN
Action
Recommendation
Matching
PDF
-
ShufText: A Simple Black Box Approach to Evaluate the Fragility of Text Classification Models
Rutuja Taware, Shraddha Varat, Gaurav Salunke, Chaitanya Gawande, Geetanjali Kale, Rahul Khengare, Raviraj Joshi
arXiv_CL
arXiv_CL
Transformer
Bert
Text_Classification
RNN
Pose
Classification
Deep_Learning
Sentiment
Language_Model
PDF
-
MUSE: Multi-Scale Temporal Features Evolution for Knowledge Tracing
Chengwei Zhang, Yangzhou Jiang, Wei Zhang, Chengyu Gu
arXiv_AI
arXiv_AI
Transformer
Knowledge
Pose
Attention
Prediction
PDF
-
NLPBK at VLSP-2020 shared task: Compose transformer pretrained models for Reliable Intelligence Identification on Social network
Thanh Chinh Nguyen, Van Nha Nguyen
arXiv_CL
arXiv_CL
Transformer
Bert
Pose
PDF
-
Transition based Graph Decoder for Neural Machine Translation
Leshem Choshen, Omri Abend
arXiv_CL
arXiv_CL
Transformer
RNN
Pose
NMT
PDF
-
Fine-tuning BERT-based models for Plant Health Bulletin Classification
Shufan Jiang (CRESTIC, ISEP), Rafael Angarita (ISEP), Stephane Cormier (CRESTIC), Francis Rousseaux (CRESTIC)
arXiv_CL
arXiv_CL
Transformer
Bert
Represenation_Learning
Knowledge
Pose
Classification
Deep_Learning
Language_Model
PDF
-
Combining pre-trained language models and structured knowledge
Pedro Colon-Hernandez, Catherine Havasi, Jason Alonso, Matthew Huggins, Cynthia Breazeal
arXiv_CL
arXiv_CL
Transformer
Knowledge
Knowledge_Graph
Survey
Language_Model
PDF
-
Modeling Context in Answer Sentence Selection Systems on a Latency Budget
Rujun Han, Luca Soldaini, Alessandro Moschitti
arXiv_CL
arXiv_CL
Transformer
Unsupervised
Attention
QA
PDF
-
A Neural Few-Shot Text Classification Reality Check
Thomas Dopierre, Christophe Gravier, Wilfried Logerais
arXiv_CL
arXiv_CL
Transformer
Embedding
Text_Classification
Pose
Classification
Detection
Few-Shot
PDF
-
Vx2Text: End-to-End Learning of Video-Based Text Generation From Multimodal Inputs
Xudong Lin, Gedas Bertasius, Jue Wang, Shih-Fu Chang, Devi Parikh, Lorenzo Torresani
arXiv_CV
arXiv_CV
Transformer
Embedding
Speech
Pose
Text_Generation
Caption
PDF
-
A transformer based approach for fighting COVID-19 fake news
S.M. Sadiq-Ur-Rahman Shifath, Mohammad Faiyaz Khan, Md. Saiful Islam
arXiv_CL
arXiv_CL
Transformer
Pose
Detection
PDF
-
Tokens-to-Token ViT: Training Vision Transformers from Scratch on ImageNet
Li Yuan, Yunpeng Chen, Tao Wang, Weihao Yu, Yujun Shi, Francis EH Tay, Jiashi Feng, Shuicheng Yan
arXiv_CV
arXiv_CV
Transformer
Pose
Classification
Relation
Attention
Image_Classification
Language_Model
PDF
-
LSTM-SAKT: LSTM-Encoded SAKT-like Transformer for Knowledge Tracing, 2nd place solution for Riiid! Answer Correctness Prediction
Takashi Oya, Shigeo Morishima
arXiv_CL
arXiv_CL
Transformer
RNN
Knowledge
Pose
Prediction
PDF
-
The Role of Syntactic Planning in Compositional Image Captioning
Emanuele Bugliarello, Desmond Elliott
arXiv_CV
arXiv_CV
Image_Caption
Transformer
RNN
Caption
PDF
-
DRAG: Director-Generator Language Modelling Framework for Non-Parallel Author Stylized Rewriting
Hrituraj Singh, Gaurav Verma, Aparna Garimella, Balaji Vasan Srinivasan
arXiv_AI
arXiv_AI
Transformer
Pose
Quantitative
Denoising
Language_Model
PDF
-
Bottleneck Transformers for Visual Recognition
Aravind Srinivas, Tsung-Yi Lin, Niki Parmar, Jonathon Shlens, Pieter Abbeel, Ashish Vaswani
arXiv_AI
arXiv_AI
Transformer
Segmentation
Recognition
Classification
Detection
Object_Detection
Attention
Image_Classification
PDF
-
Transformer Based Deliberation for Two-Pass Speech Recognition
Ke Hu, Ruoming Pang, Tara N. Sainath, Trevor Strohman
arXiv_CL
arXiv_CL
Transformer
Recognition
RNN
Speech
Attention
Speech_Recognition
PDF
-
Spatial-Channel Transformer Network for Trajectory Prediction on the Traffic Scenes
Jingwen Zhao, Xuanpeng Li, Qifan Xue, Weigong Zhang
arXiv_CV
arXiv_CV
Transformer
RNN
Action
Attention
Autonomous
Prediction
PDF
-
Adversarial Stylometry in the Wild: Transferable Lexical Substitution Attacks on Author Profiling
Chris Emmery, Ákos Kádár, Grzegorz Chrupała
arXiv_CL
arXiv_CL
Transformer
Adversarial
Pose
PDF
-
Exploring multi-task multi-lingual learning of transformer models for hate speech and offensive speech identification in social media
Sudhanshu Mishra, Shivangi Prasad, Shubhanshu Mishra
arXiv_AI
arXiv_AI
Transformer
Speech
Pose
Inference
PDF
-
Event-Driven News Stream Clustering using Entity-Aware Contextual Embeddings
Kailash Karthik Saravanakumar, Miguel Ballesteros, Muthu Kumar Chandrasekaran, Kathleen McKeown
arXiv_AI
arXiv_AI
Transformer
Embedding
Sparse
Knowledge
Pose
Classification
PDF
-
'Laughing at you or with you': The Role of Sarcasm in Shaping the Disagreement Space
Debanjan Ghosh, Ritvik Shrivastava, Smaranda Muresan
arXiv_CL
arXiv_CL
Transformer
RNN
Action
Classification
Deep_Learning
Detection
Relation
Attention
PDF
-
Attention Can Reflect Syntactic Structure
Vinit Ravishankar, Artur Kulmizev, Mostafa Abdou, Anders Søgaard, Joakim Nivre
arXiv_CL
arXiv_CL
Transformer
Bert
Pose
Relation
Attention
PDF
-
CPTR: Full Transformer Network for Image Captioning
Wei Liu, Sihan Chen, Longteng Guo, Xinxin Zhu, Jing Liu
arXiv_CV
arXiv_CV
Image_Caption
Transformer
Pose
Attention
Caption
Prediction
PDF
-
Analyzing Zero-shot Cross-lingual Transfer in Supervised NLP Tasks
Hyunjin Choi, Judong Kim, Seongho Joe, Seungjai Min, Youngjune Gwon
arXiv_AI
arXiv_AI
Transformer
Embedding
Bert
Zero-Shot
Sentiment
Language_Model
PDF
-
Coloring the Black Box: What Synesthesia Tells Us about Character Embeddings
Katharina Kann, Mauro M. Monsalve-Mercado
arXiv_CL
arXiv_CL
Transformer
Embedding
RNN
GAN
PDF
-
Randomized Deep Structured Prediction for Discourse-Level Processing
Manuel Widmoser, Maria Leonor Pacheco, Jean Honorio, Dan Goldwasser
arXiv_AI
arXiv_AI
Transformer
RNN
Inference
Prediction
PDF
-
Learning From Revisions: Quality Assessment of Claims in Argumentation at Scale
Gabriella Skitalinskaya, Jonas Klaff, Henning Wachsmuth
arXiv_CL
arXiv_CL
Transformer
Embedding
Pose
PDF
-
CHOLAN: A Modular Approach for Neural Entity Linking on Wikipedia and Wikidata
Manoj Prabhakar Kannan Ravi, Kuldeep Singh, Isaiah Onando Mulang', Saeedeh Shekarpour, Johannes Hoffart, Jens Lehmann
arXiv_CL
arXiv_CL
Transformer
Knowledge
Pose
Face
PDF
-
ECOL-R: Encouraging Copying in Novel Object Captioning with Reinforcement Learning
Yufei Wang, Ian D. Wood, Stephen Wan, Mark Johnson
arXiv_CV
arXiv_CV
Image_Caption
Transformer
Reinforcement_Learning
Zero-Shot
Salient
Knowledge
Pose
Detection
Object_Detection
Caption
PDF
-
Does Dialog Length matter for Next Response Selection task? An Empirical Study
Jatin Ganhotra, Sachindra Joshi
arXiv_CL
arXiv_CL
Transformer
Bert
Attention
PDF
-
WangchanBERTa: Pretraining transformer-based Thai Language Models
Lalita Lowphansirikul, Charin Polpanumas, Nawat Jantrakulchai, Sarana Nutanong
arXiv_CL
arXiv_CL
Transformer
Bert
Classification
Language_Model
PDF
-
BERT Transformer model for Detecting Arabic GPT2 Auto-Generated Tweets
Fouzi Harrag, Maria Debbah, Kareem Darwish, Ahmed Abdelali
arXiv_CL
arXiv_CL
Transformer
Embedding
Transfer_Learning
Bert
RNN
Knowledge
Pose
Language_Model
PDF
-
Drug and Disease Interpretation Learning with Biomedical Entity Representation Transformer
Zulfat Miftahutdinov, Artur Kadurin, Roman Kudrin, Elena Tutubalina
arXiv_CL
arXiv_CL
Transformer
Embedding
Bert
Zero-Shot
Knowledge
Pose
Medical
PDF
-
Extracting Lifestyle Factors for Alzheimer's Disease from Clinical Notes Using Deep Learning with Weak Supervision
Zitao Shen (1), Yoonkwon Yi (1), Anusha Bompelli (2), Fang Yu (3), Yanshan Wang (4), Rui Zhang (2 and 5) ((1) College of Science & Engineering, University of Minnesota, (2) Department of Pharmaceutical Care & Health Systems, University of Minnesota, (3) Edson College of Nursing and Health Innovation, Arizona State University, (4) Department of AI & Informatics, Mayo Clinic, (5) Institute for Health Informatics, University of Minnesota)
arXiv_CL
arXiv_CL
Transformer
Bert
Pose
Deep_Learning
Medical
Activity
PDF
-
The heads hypothesis: A unifying statistical approach towards understanding multi-headed attention in BERT
Madhura Pande, Aakriti Budhraja, Preksha Nema, Pratyush Kumar, Mitesh M. Khapra
arXiv_AI
arXiv_AI
Transformer
Bert
Pose
Classification
Relation
Attention
Inference
PDF
-
Multilingual Pre-Trained Transformers and Convolutional NN Classification Models for Technical Domain Identification
Suman Dowlagar, Radhika Mamidi
arXiv_CL
arXiv_CL
Transformer
Transfer_Learning
Bert
Text_Classification
Classification
CNN
PDF
-
CMSAOne@Dravidian-CodeMix-FIRE2020: A Meta Embedding and Transformer model for Code-Mixed Sentiment Analysis on Social Media Text
Suman Dowlagar, Radhika Mamidi
arXiv_CL
arXiv_CL
Transformer
Embedding
Pose
Sentiment
PDF
-
Enriching Non-Autoregressive Transformer with Syntactic and SemanticStructures for Neural Machine Translation
Ye Liu, Yao Wan, Jian-Guo Zhang, Wenting Zhao, Philip S. Yu
arXiv_AI
arXiv_AI
Transformer
Pose
PDF
-
Distilling Large Language Models into Tiny and Effective Students using pQRNN
Prabhu Kaliamoorthi, Aditya Siddhant, Edward Li, Melvin Johnson
arXiv_AI
arXiv_AI
Transformer
Embedding
Bert
RNN
Pose
Language_Model
PDF
-
SSTVOS: Sparse Spatiotemporal Transformers for Video Object Segmentation
Brendan Duke, Abdalla Ahmed, Christian Wolf, Parham Aarabi, Graham W. Taylor
arXiv_CV
arXiv_CV
Transformer
Segmentation
Sparse
Pose
Attention
PDF
-
Learn to Dance with AIST++: Music Conditioned 3D Dance Generation
Ruilong Li, Shan Yang, David A. Ross, Angjoo Kanazawa
arXiv_CV
arXiv_CV
Transformer
3D
Knowledge
Pose
Quantitative
Relation
Attention
PDF
-
DAF:re: A Challenging, Crowd-Sourced, Large-Scale, Long-Tailed Dataset For Anime Character Recognition
Edwin Arkel Rios, Wen-Huang Cheng, Bo-Cheng Lai
arXiv_CV
arXiv_CV
Transformer
Transfer_Learning
Recognition
Pose
Face
Classification
Attention
PDF
-
Activity Graph Transformer for Temporal Action Localization
Megha Nawhal, Greg Mori
arXiv_AI
arXiv_AI
Transformer
Action_Localization
Pose
Action
Detection
Activity
PDF
-
Adv-OLM: Generating Textual Adversaries via OLM
Vijit Malik, Ashwani Bhat, Ashutosh Modi
arXiv_AI
arXiv_AI
Transformer
Text_Classification
Adversarial
Classification
Deep_Learning
Language_Model
PDF
-
Segmenting Transparent Object in the Wild with Transformer
Enze Xie, Wenjia Wang, Wenhai Wang, Peize Sun, Hang Xu, Ding Liang, Ping Luo
arXiv_CV
arXiv_CV
Transformer
Segmentation
Semantic_Segmentation
Pose
PDF
-
Arabic Speech Recognition by End-to-End, Modular Systems and Human
Amir Hussein, Shinji Watanabe, Ahmed Ali
arXiv_CL
arXiv_CL
Transformer
Recognition
Speech
Speech_Recognition
PDF
-
Evaluating Multilingual Text Encoders for Unsupervised Cross-Lingual Retrieval
Robert Litschko, Ivan Vulić, Simone Paolo Ponzetto, Goran Glavaš
arXiv_CL
arXiv_CL
Transformer
Embedding
Unsupervised
Bert
Represenation_Learning
Pose
PDF
-
Aesthetics, Personalization and Recommendation: A survey on Deep Learning in Fashion
Wei Gong, Laila Khalid
arXiv_CV
arXiv_CV
Transformer
Knowledge
Survey
Deep_Learning
GAN
Recommendation
PDF
-
Fast deep learning correspondence for neuron tracking and identification in C.elegans using synthetic training
Xinwei Yu, Matthew S. Creamer, Francesco Randi, Anuj K. Sharma, Scott W. Linderman, Andrew M. Leifer
arXiv_CV
arXiv_CV
Transformer
Tracking
Transfer_Learning
Deep_Learning
GAN
PDF
-
Open-Domain Conversational Search Assistant with Transformers
Rafael Ferreira, Mariana Leite, David Semedo, Joao Magalhaes
arXiv_CL
arXiv_CL
Transformer
Pose
PDF
-
Active Learning for Sequence Tagging with Deep Pre-trained Models and Bayesian Uncertainty Estimates
Artem Shelmanov, Dmitri Puzyrev, Lyubov Kupriyanova, Denis Belyakov, Daniil Larionov, Nikita Khromov, Olga Kozlova, Ekaterina Artemova, Dmitry V. Dylov, Alexander Panchenko
arXiv_CL
arXiv_CL
Transformer
Transfer_Learning
Classification
PDF
-
Classifying Scientific Publications with BERT -- Is Self-Attention a Feature Selection Method?
Andres Garcia-Silva, Jose Manuel Gomez-Perez
arXiv_AI
arXiv_AI
Transformer
Bert
Text_Classification
Classification
Attention
PDF
-
UPDeT: Universal Multi-agent Reinforcement Learning via Policy Decoupling with Transformers
Siyi Hu, Fengda Zhu, Xiaojun Chang, Xiaodan Liang
arXiv_AI
arXiv_AI
Transformer
Reinforcement_Learning
RNN
Pose
Action
Attention
PDF
-
PGT: Pseudo Relevance Feedback Using a Graph-Based Transformer
HongChien Yu, Zhuyun Dai, Jamie Callan
arXiv_AI
arXiv_AI
Transformer
Attention
PDF
-
Towards Facilitating Empathic Conversations in Online Mental Health Support: A Reinforcement Learning Approach
Ashish Sharma, Inna W. Lin, Adam S. Miner, David C. Atkins, Tim Althoff
arXiv_CL
arXiv_CL
Transformer
Style_Transfer
Reinforcement_Learning
Pose
Emotion
Language_Model
PDF
-
Fast Convergence of DETR with Spatially Modulated Co-Attention
Peng Gao, Minghang Zheng, Xiaogang Wang, Jifeng Dai, Hongsheng Li
arXiv_CV
arXiv_CV
Transformer
Pose
Detection
Object_Detection
Attention
PDF
-
Teach me how to Label: Labeling Functions from Natural Language with Text-to-text Transformers
Yannis Papanikolaou
arXiv_CL
arXiv_CL
Transformer
Pose
PDF
-
Mitigating the Position Bias of Transformer Models in Passage Re-Ranking
Sebastian Hofstätter, Aldo Lipani, Sophia Althammer, Markus Zlabinger, Allan Hanbury
arXiv_CL
arXiv_CL
Transformer
Pose
PDF
-
HinFlair: pre-trained contextual string embeddings for pos tagging and text classification in the Hindi language
Harsh Patel
arXiv_CL
arXiv_CL
Transformer
Embedding
Recognition
Text_Classification
RNN
Classification
Language_Model
PDF
-
Transformer-Based Models for Question Answering on COVID19
Hillary Ngai, Yoona Park, John Chen, Mahboobeh Parsapoor (Mah Parsa)
arXiv_CL
arXiv_CL
Transformer
Bert
Pose
QA
PDF
-
Dual-Level Collaborative Transformer for Image Captioning
Yunpeng Luo, Jiayi Ji, Xiaoshuai Sun, Liujuan Cao, Yongjian Wu, Feiyue Huang, Chia-Wen Lin, Rongrong Ji
arXiv_CV
arXiv_CV
Image_Caption
Transformer
Pose
Detection
Relation
Object_Detection
Attention
Caption
PDF
-
Match-Ignition: Plugging PageRank into Transformer for Long-form Text Matching
Liang Pang, Yanyan Lan, Xueqi Cheng
arXiv_CL
arXiv_CL
Transformer
Pose
Attention
Matching
PDF
-
To Understand Representation of Layer-aware Sequence Encoders as Multi-order-graph
Sufeng Duan, Hai Zhao, Rui Wang
arXiv_CL
arXiv_CL
Transformer
Salient
Pose
Relation
Attention
PDF
-
TextGNN: Improving Text Encoder via Graph Neural Network in Sponsored Search
Jason Zhu, Yanling Cui, Yuming Liu, Hao Sun, Xue Li, Markus Pelger, Liangjie Zhang, Tianqi Yan, Ruofei Zhang, Huasha Zhao
arXiv_CL
arXiv_CL
Transformer
Bert
Pose
PDF
-
LIME: Learning Inductive Bias for Primitives of Mathematical Reasoning
Yuhuai Wu, Markus Rabe, Wenda Li, Jimmy Ba, Roger Grosse, Christian Szegedy
arXiv_AI
arXiv_AI
Transformer
Knowledge
Action
PDF
-
Temporal-Relational CrossTransformers for Few-Shot Action Recognition
Toby Perrett, Alessandro Masullo, Tilo Burghardt, Majid Mirmehdi, Dima Damen
arXiv_CV
arXiv_CV
Transformer
Recognition
Pose
Action_Recognition
Action
Relation
Few-Shot
Attention
Matching
PDF
-
Reasoning over Vision and Language: Exploring the Benefits of Supplemental Knowledge
Violetta Shevchenko, Damien Teney, Anthony Dick, Anton van den Hengel
arXiv_CV
arXiv_CV
Transformer
Embedding
Knowledge
Pose
Relation
VQA
Language_Model
QA
Matching
PDF
-
KDLSQ-BERT: A Quantized Bert Combining Knowledge Distillation with Learned Step Size Quantization
Jing Jin, Cai Liang, Tiancheng Wu, Liqin Zou, Zhiliang Gan
arXiv_AI
arXiv_AI
Transformer
Quantization
Bert
Knowledge
Pose
Inference
Language_Model
PDF
-
Stacked DeBERT: All Attention in Incomplete Data for Text Classification
Gwenaelle Cunha Sergio, Minho Lee
arXiv_CL
arXiv_CL
Transformer
Reconstruction
Embedding
Bert
Text_Classification
Speech
Pose
Classification
Sentiment
Denoising
Attention
QA
PDF
-
Transformer-based Language Model Fine-tuning Methods for COVID-19 Fake News Detection
Ben Chen, Bin Chen, Dehong Gao, Qijin Chen, Chengfu Huo, Xiaonan Meng, Weijun Ren, Yang Zhou
arXiv_AI
arXiv_AI
Transformer
OCR
Bert
Knowledge
Adversarial
Pose
Quantitative
Detection
Language_Model
PDF
-
Exploration of Visual Features and their weighted-additive fusion for Video Captioning
Praveen S V, Akhilesh Bharadwaj, Harsh Raj, Janhavi Dadhania, Ganesh Samarth C.A, Nikhil Pareek, S R M Prasanna
arXiv_CV
arXiv_CV
Transformer
Video_Caption
Caption
Activity
CNN
PDF
-
Coarse and Fine-Grained Hostility Detection in Hindi Posts using Fine Tuned Multilingual Embeddings
Arkadipta De, Venkatesh E, Kaushal Kumar Maurya, Maunendra Sankar Desarkar
arXiv_CL
arXiv_CL
Transformer
Embedding
Bert
Pose
Face
Classification
Detection
PDF
-
COVID-19 Deterioration Prediction via Self-Supervised Representation Learning and Multi-Image Prediction
Anuroop Sriram, Matthew Muckley, Koustuv Sinha, Farah Shamout, Joelle Pineau, Krzysztof J. Geras, Lea Azour, Yindalon Aphinyanaphongs, Nafissa Yakubova, William Moore
arXiv_CV
arXiv_CV
Image_Caption
Transformer
Represenation_Learning
Self-Supervised
Pose
Prediction
PDF
-
Of Non-Linearity and Commutativity in BERT
Sumu Zhao, Damian Pascual, Gino Brunner, Roger Wattenhofer
arXiv_AI
arXiv_AI
Transformer
Bert
Pose
Action
Attention
PDF
-
Neural Contract Element Extraction Revisited
Ilias Chalkidis, Manos Fergadiotis, Prodromos Malakasiotis, Ion Androutsopoulos
arXiv_CL
arXiv_CL
Transformer
Embedding
Bert
RNN
Action
Language_Model
PDF
-
BERT-GT: Cross-sentence n-ary relation extraction with BERT and Graph Transformer
Po-Ting Lai, Zhiyong Lu
arXiv_CL
arXiv_CL
Transformer
Bert
RNN
Pose
Action
Relation
Relation_Extraction
Attention
Medical
PDF
-
Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsity
William Fedus, Barret Zoph, Noam Shazeer
arXiv_AI
arXiv_AI
Transformer
Sparse
Pose
Deep_Learning
Language_Model
PDF
-
A More Efficient Chinese Named Entity Recognition base on BERT and Syntactic Analysis
Xiao Fu, Guijun Zhang
arXiv_CL
arXiv_CL
Transformer
Segmentation
Recognition
Bert
Speech
Pose
PDF
-
Spherical Transformer: Adapting Spherical Signal to ConvolutionalNetworks
Haikuan Du, Hui Cao, Shen Cai, Junchi Yan, Siyu Zhang
arXiv_CV
arXiv_CV
Transformer
Segmentation
Semantic_Segmentation
Recognition
3D
Pose
Classification
CNN
Image_Classification
PDF
-
Model Generalization on COVID-19 Fake News Detection
Yejin Bang, Etsuko Ishii, Samuel Cahyawijaya, Ziwei Ji, Pascale Fung
arXiv_AI
arXiv_AI
Transformer
Pose
Detection
Language_Model
PDF
-
Revisiting Mahalanobis Distance for Transformer-Based Out-of-Domain Detection
Alexander Podolskiy, Dmitry Lipin, Andrey Bout, Ekaterina Artemova, Irina Piontkovskaya
arXiv_CL
arXiv_CL
Transformer
Classification
Detection
Attention
PDF
-
Investigating the Vision Transformer Model for Image Retrieval Tasks
Socratis Gkelios, Yiannis Boutalis, Savvas A. Chatzichristofis
arXiv_CV
arXiv_CV
Transformer
Image_Retrieval
Pose
CNN
PDF
-
Summaformers @ LaySumm 20, LongSumm 20
Sayar Ghosh Roy, Nikhil Pinnaparaju, Risubh Jain, Manish Gupta, Vasudeva Varma
arXiv_AI
arXiv_AI
Transformer
Pose
Deep_Learning
Summarization
PDF
-
Channel Boosting Feature Ensemble for Radar-based Object Detection
Shoaib Azam, Farzeen Munir, Moongu Jeon
arXiv_CV
arXiv_CV
Transformer
Pose
Detection
Object_Detection
Autonomous
Prediction
PDF
-
Cisco at AAAI-CAD21 shared task: Predicting Emphasis in Presentation Slides using Contextualised Embeddings
Sreyan Ghosh, Sonal Kumar, Harsh Jalan, Hemant Yadav, Rajiv Ratn Shah
arXiv_CL
arXiv_CL
Transformer
Embedding
Bert
RNN
Pose
PDF
-
Task Adaptive Pretraining of Transformers for Hostility Detection
Tathagata Raha, Sayar Ghosh Roy, Ujwal Narayan, Zubair Abid, Vasudeva Varma
arXiv_CL
arXiv_CL
Transformer
Classification
Detection
PDF
-
Learning Better Sentence Representation with Syntax Information
Chen Yang (University of Science and Technology of China)
arXiv_CL
arXiv_CL
Transformer
Bert
Text_Classification
RNN
Knowledge
Pose
Action
Classification
Relation
Sentiment
Relation_Extraction
Language_Model
PDF
-
LightXML: Transformer with Dynamic Negative Sampling for High-Performance Extreme Multi-label Text Classification
Ting Jiang, Deqing Wang, Leilei Sun, Huayi Yang, Zhengyang Zhao, Fuzhen Zhuang
arXiv_CL
arXiv_CL
Transformer
Text_Classification
Pose
Classification
Deep_Learning
Attention
PDF
-
Trankit: A Light-Weight Transformer-based Toolkit for Multilingual Natural Language Processing
Minh Nguyen, Viet Lai, Amir Pouran Ben Veyseh, Thien Huu Nguyen
arXiv_CL
arXiv_CL
Transformer
Segmentation
Speech
Language_Model
PDF
-
Leveraging Multilingual Transformers for Hate Speech Detection
Sayar Ghosh Roy, Ujwal Narayan, Tathagata Raha, Zubair Abid, Vasudeva Varma
arXiv_AI
arXiv_AI
Transformer
Speech
Classification
Detection
Language_Model
PDF
-
Multistage BiCross Encoder: Team GATE Entry for MLIA Multilingual Semantic Search Task 2
Iknoor Singh, Carolina Scarton, Kalina Bontcheva
arXiv_AI
arXiv_AI
Transformer
PDF
-
TrackFormer: Multi-Object Tracking with Transformers
Tim Meinhardt, Alexander Kirillov, Laura Leal-Taixe, Christoph Feichtenhofer
arXiv_CV
arXiv_CV
Transformer
Segmentation
Embedding
Tracking
Video_Caption
Object_Tracking
Detection
Object_Detection
Attention
PDF
-
Ask2Transformers: Zero-Shot Domain labelling with Pre-trained Language Models
Oscar Sainz, German Rigau
arXiv_CL
arXiv_CL
Transformer
Zero-Shot
Knowledge
Pose
Language_Model
PDF
-
Compound Word Transformer: Learning to Compose Full-Song Music over Dynamic Directed Hypergraphs
Wen-Yi Hsiao, Jen-Yu Liu, Yin-Cheng Yeh, Yi-Hsuan Yang
arXiv_AI
arXiv_AI
Transformer
Pose
PDF
-
Exploring Text-transformers in AAAI 2021 Shared Task: COVID-19 Fake News Detection in English
Xiangyang Li, Yu Xia, Xiang Long, Zheng Li, Sujian Li
arXiv_AI
arXiv_AI
Transformer
Bert
Pose
Detection
Language_Model
PDF
-
Line Segment Detection Using Transformers without Edges
Yifan Xu, Weijian Xu, David Cheung, Zhuowen Tu
arXiv_CV
arXiv_CV
Transformer
Segmentation
Detection
Attention
Inference
PDF
-
Trear: Transformer-based RGB-D Egocentric Action Recognition
Xiangyu Li, Yonghong Hou, Pichao Wang, Zhimin Gao, Mingliang Xu, Wanqing Li
arXiv_CV
arXiv_CV
Transformer
Recognition
Pose
Action_Recognition
Action
Attention
Optical_Flow
PDF
-
AutoDropout: Learning Dropout Patterns to Regularize Deep Networks
Hieu Pham, Quoc V. Le
arXiv_AI
arXiv_AI
Transformer
Recognition
Regularization
Pose
Language_Model
PDF
-
I-BERT: Integer-only BERT Quantization
Sehoon Kim, Amir Gholami, Zhewei Yao, Michael W. Mahoney, Kurt Keutzer
arXiv_CL
arXiv_CL
Transformer
Quantization
Bert
Pose
Inference
PDF
-
Transformers and Transfer Learning for Improving Portuguese Semantic Role Labeling
Sofia Oliveira, Daniel Loureiro, Alípio Jorge
arXiv_CL
arXiv_CL
Transformer
Transfer_Learning
Bert
Pose
PDF
-
Transformers in Vision: A Survey
Salman Khan, Muzammal Naseer, Munawar Hayat, Syed Waqas Zamir, Fahad Shahbaz Khan, Mubarak Shah
arXiv_AI
arXiv_AI
Transformer
Segmentation
Recognition
Point_Cloud
Super_Resolution
3D
Knowledge
Survey
Action_Recognition
Action
Classification
Detection
Object_Detection
Attention
Activity
Image_Classification
PDF
-
Transformer-based Conditional Variational Autoencoder for Controllable Story Generation
Le Fang, Tao Zeng, Chaochun Liu, Liefeng Bo, Wen Dong, Changyou Chen
arXiv_AI
arXiv_AI
Transformer
Represenation_Learning
Language_Model
PDF
-
An Efficient Transformer Decoder with Compressed Sub-layers
Yanyang Li, Ye Lin, Tong Xiao, Jingbo Zhu
arXiv_CL
arXiv_CL
Transformer
Pose
Attention
PDF
-
VinVL: Making Visual Representations Matter in Vision-Language Models
Pengchuan Zhang, Xiujun Li, Xiaowei Hu, Jianwei Yang, Lei Zhang, Lijuan Wang, Yejin Choi, Jianfeng Gao
arXiv_AI
arXiv_AI
Transformer
Detection
Object_Detection
Language_Model
PDF
-
Coreference Resolution without Span Representations
Yuval Kirstain, Ori Ram, Omer Levy
arXiv_CL
arXiv_CL
Transformer
Language_Model
PDF
-
Zero-shot Learning by Generating Task-specific Adapters
Qinyuan Ye, Xiang Ren
arXiv_CL
arXiv_CL
Transformer
Zero-Shot
Text_Generation
PDF
-
KM-BART: Knowledge Enhanced Multimodal BART for Visual Commonsense Generation
Yiran Xing, Zai Shi, Zhao Meng, Yunpu Ma, Roger Wattenhofer
arXiv_CL
arXiv_CL
Transformer
Knowledge
Knowledge_Graph
Pose
Language_Model
PDF
-
Lex-BERT: Enhancing BERT based NER with lexicons
Wei Zhu, Daniel Cheung
arXiv_CL
arXiv_CL
Transformer
Embedding
Recognition
Bert
PDF
-
What all do audio transformer models hear? Probing Acoustic Representations for Language Delivery and its Structure
Jui Shah, Yaman Kumar Singla, Changyou Chen, Rajiv Ratn Shah
arXiv_CL
arXiv_CL
Transformer
Embedding
Bert
Speech
Face
PDF
-
VisualSparta: Sparse Transformer Fragment-level Matching for Large-scale Text-to-Image Search
Xiaopeng Lu, Tiancheng Zhao, Kyusong Lee
arXiv_CV
arXiv_CV
Transformer
Sparse
Image_Retrieval
Knowledge
Pose
Matching
PDF
-
Semantic Parsing with Less Prior and More Monolingual Data
Sajad Norouzi, Yanshuai Cao
arXiv_CL
arXiv_CL
Transformer
Knowledge
PDF
-
Subformer: Exploring Weight Sharing for Parameter Efficiency in Generative Transformers
Machel Reid, Edison Marrese-Taylor, Yutaka Matsuo
arXiv_CL
arXiv_CL
Transformer
Embedding
Pose
Summarization
Language_Model
PDF
-
Transformer based Automatic COVID-19 Fake News Detection System
Sunil Gundapu, Radhika Mamid
arXiv_CL
arXiv_CL
Transformer
Bert
Detection
PDF
-
A Multi-modal Deep Learning Model for Video Thumbnail Selection
Zhifeng Yu, Nanchun Shi
arXiv_AI
arXiv_AI
Transformer
Knowledge
Pose
Face
Action
Deep_Learning
Attention
CNN
PDF
-
Rethinking Semantic Segmentation from a Sequence-to-Sequence Perspective with Transformers
Sixiao Zheng, Jiachen Lu, Hengshuang Zhao, Xiatian Zhu, Zekun Luo, Yabiao Wang, Yanwei Fu, Jianfeng Feng, Tao Xiang, Philip H.S. Torr, Li Zhang
arXiv_CV
arXiv_CV
Transformer
Segmentation
Semantic_Segmentation
Attention
CNN
Prediction
PDF
-
Shortformer: Better Language Modeling using Shorter Inputs
Ofir Press, Noah A. Smith, Mike Lewis
arXiv_CL
arXiv_CL
Transformer
Embedding
Language_Model
PDF
-
Fully Non-autoregressive Neural Machine Translation: Tricks of the Trade
Jiatao Gu, Xiang Kong
arXiv_CL
arXiv_CL
Transformer
Pose
Inference
PDF
-
MiniLMv2: Multi-Head Self-Attention Relation Distillation for Compressing Pretrained Transformers
Wenhui Wang, Hangbo Bao, Shaohan Huang, Li Dong, Furu Wei
arXiv_CL
arXiv_CL
Transformer
Bert
Knowledge
Action
Relation
Attention
PDF
-
Promoting Graph Awareness in Linearized Graph-to-Text Generation
Alexander Hoyle, Ana Marasović, Noah Smith
arXiv_CL
arXiv_CL
Transformer
Denoising
Text_Generation
PDF
-
Revisiting Robust Neural Machine Translation: A Transformer Case Study
Peyman Passban, Puneeth S.M. Saladi, Qun Liu
arXiv_CL
arXiv_CL
Transformer
Pose
NMT
PDF
-
ERNIE-DOC: The Retrospective Long-Document Modeling Transformer
Siyu Ding, Junyuan Shang, Shuohuan Wang, Yu Sun, Hao Tian, Hua Wu, Haifeng Wang
arXiv_CL
arXiv_CL
Transformer
Text_Classification
Sparse
Pose
Classification
Relation
Attention
Language_Model
PDF
-
HateCheck: Functional Tests for Hate Speech Detection Models
Paul Röttger, Bertram Vidgen, Dong Nguyen, Zeerak Waseem, Helen Margetts, Janet Pierrehumbert
arXiv_CL
arXiv_CL
Transformer
Review
Speech
Detection
PDF
-
XLM-T: Scaling up Multilingual Machine Translation with Pretrained Cross-lingual Transformer Encoders
Shuming Ma, Jian Yang, Haoyang Huang, Zewen Chi, Li Dong, Dongdong Zhang, Hany Hassan Awadalla, Alexandre Muzio, Akiko Eriguchi, Saksham Singhal, Xia Song, Arul Menezes, Furu Wei
arXiv_CL
arXiv_CL
Transformer
Unsupervised
Classification
Language_Model
PDF
-
AraGPT2: Pre-Trained Transformer for Arabic Language Generation
Wissam Antoun, Fady Baly, Hazem Hajj
arXiv_CL
arXiv_CL
Transformer
Language_Model
PDF
-
TransTrack: Multiple-Object Tracking with Transformer
Peize Sun, Yi Jiang, Rufeng Zhang, Enze Xie, Jinkun Cao, Xinting Hu, Tao Kong, Zehuan Yuan, Changhu Wang, Ping Luo
arXiv_CV
arXiv_CV
Transformer
Tracking
Object_Tracking
Pose
Action
Detection
Object_Detection
PDF
-
Verb Knowledge Injection for Multilingual Event Processing
Olga Majewska, Ivan Vulić, Goran Glavaš, Edoardo M. Ponti, Anna Korhonen
arXiv_CL
arXiv_CL
Transformer
Zero-Shot
Knowledge
Action
Language_Model
PDF
-
An Experimental Evaluation of Transformer-based Language Models in the Biomedical Domain
Paul Grouchy, Shobhit Jain, Michael Liu, Kuhan Wang, Max Tian, Nidhi Arora, Hillary Ngai, Faiza Khan Khattak, Elham Dolatabadi, Sedef Akinli Kocak
arXiv_CL
arXiv_CL
Transformer
Bert
Medical
Language_Model
QA
PDF
-
Directed Beam Search: Plug-and-Play Lexically Constrained Language Generation
Damian Pascual, Beni Egressy, Florian Bolli, Roger Wattenhofer
arXiv_AI
arXiv_AI
Transformer
Pose
Language_Model
PDF
-
Optimizing Deeper Transformers on Small Datasets: An Application on Text-to-SQL Semantic Parsing
Peng Xu, Wei Yang, Wenjie Zi, Keyi Tang, Chengyang Huang, Jackie Chi Kit Cheung, Yanshuai Cao
arXiv_CL
arXiv_CL
Transformer
Bert
Relation
Prediction
PDF
-
Deriving Contextualised Semantic Features from BERT Embeddings
Jacob Turton, David Vinson, Robert Elliott Smith
arXiv_CL
arXiv_CL
Transformer
Embedding
Bert
Pose
PDF
-
Unnatural Language Inference
Koustuv Sinha, Prasanna Parthasarathi, Joelle Pineau, Adina Williams
arXiv_CL
arXiv_CL
Transformer
Bert
Pose
Inference
PDF
-
Transformer for Image Quality Assessment
Junyong You, Jari Korhonen
arXiv_CV
arXiv_CV
Transformer
Embedding
Pose
CNN
PDF
-
Improving BERT with Syntax-aware Local Attention
Zhongli Li, Qingyu Zhou, Chao Li, Ke Xu, Yunbo Cao
arXiv_CL
arXiv_CL
Transformer
Bert
Pose
Classification
Attention
Language_Model
PDF
-
Reservoir Transformer
Sheng Shen, Alexei Baevski, Ari S. Morcos, Kurt Keutzer, Michael Auli, Douwe Kiela
arXiv_CL
arXiv_CL
Transformer
Language_Model
PDF
-
Few-Shot Named Entity Recognition: A Comprehensive Study
Jiaxin Huang, Chunyuan Li, Krishan Subudhi, Damien Jose, Shobana Balakrishnan, Weizhu Chen, Baolin Peng, Jianfeng Gao, Jiawei Han
arXiv_CL
arXiv_CL
Transformer
Recognition
Self-Supervised
Pose
Few-Shot
Language_Model
PDF
-
Transformer Feed-Forward Layers Are Key-Value Memories
Mor Geva, Roei Schuster, Jonathan Berant, Omer Levy
arXiv_CL
arXiv_CL
Transformer
Language_Model
PDF
-
A Hierarchical Transformer with Speaker Modeling for Emotion Recognition in Conversation
Jiangnan Li, Zheng Lin, Peng Fu, Qingyi Si, Weiping Wang
arXiv_CL
arXiv_CL
Transformer
Recognition
Pose
Emotion
Action
Relation
Attention
Prediction
PDF
-
LayoutLMv2: Multi-modal Pre-training for Visually-Rich Document Understanding
Yang Xu, Yiheng Xu, Tengchao Lv, Lei Cui, Furu Wei, Guoxin Wang, Yijuan Lu, Dinei Florencio, Cha Zhang, Wanxiang Che, Min Zhang, Lidong Zhou
arXiv_CL
arXiv_CL
Transformer
Action
Relation
VQA
Attention
Language_Model
QA
Matching
PDF
-
SIT3: Code Summarization with Structure-Induced Transformer
Hongqiu Wu, Hai Zhao, Min Zhang
arXiv_CL
arXiv_CL
Transformer
RNN
Knowledge
Pose
Attention
Summarization
PDF
-
DeepHateExplainer: Explainable Hate Speech Detection in Under-resourced Bengali Language
Md. Rezaul Karim, Sumon Kanti Dey, Bharathi Raja Chakravarthi
arXiv_CL
arXiv_CL
Transformer
Embedding
Bert
RNN
Speech
Pose
Detection
PDF
-
Context-Aware Personality Inference in Dyadic Scenarios: Introducing the UDIVA Dataset
Cristina Palmero, Javier Selva, Sorina Smeureanu, Julio C. S. Jacques Junior, Albert Clapés, Alexa Moseguí, Zejian Zhang, David Gallardo, Georgina Guilera, David Leiva, Sergio Escalera
arXiv_AI
arXiv_AI
Transformer
Pose
Face
Action
Relation
Inference
PDF
-
Lattice-Free MMI Adaptation Of Self-Supervised Pretrained Acoustic Models
Apoorv Vyas, Srikanth Madikeri, Hervé Bourlard
arXiv_SD
arXiv_SD
Transformer
Speech
Self-Supervised
Pose
PDF
-
TransPose: Towards Explainable Human Pose Estimation by Transformer
Sen Yang, Zhibin Quan, Mu Nie, Wankou Yang
arXiv_CV
arXiv_CV
Transformer
Pose_Estimation
Pose
Relation
Attention
CNN
PDF
-
Red Dragon AI at TextGraphs 2020 Shared Task: LIT : LSTM-Interleaved Transformer for Multi-Hop Explanation Ranking
Yew Ken Chia, Sam Witteveen, Martin Andrews
arXiv_AI
arXiv_AI
Transformer
RNN
Pose
Action
Inference
PDF
-
Syntax-Enhanced Pre-trained Model
Zenan Xu, Daya Guo, Duyu Tang, Qinliang Su, Linjun Shou, Ming Gong, Wanjun Zhong, Xiaojun Quan, Nan Duan, Daxin Jiang
arXiv_CL
arXiv_CL
Transformer
Bert
Classification
Relation
Attention
PDF
-
Portfolio Optimization with 2D Relative-Attentional Gated Transformer
Tae Wan Kim, Matloob Khushi
arXiv_AI
arXiv_AI
Transformer
Embedding
Reinforcement_Learning
Optimization
Pose
Action
Attention
PDF
-
SG-Net: Syntax Guided Transformer for Language Representation
Zhuosheng Zhang, Yuwei Wu, Junru Zhou, Sufeng Duan, Hai Zhao, Rui Wang
arXiv_AI
arXiv_AI
Transformer
Knowledge
Pose
Attention
Inference
PDF
-
ARBERT & MARBERT: Deep Bidirectional Transformers for Arabic
Muhammad Abdul-Mageed, AbdelRahim Elmadany, El Moatez Billah Nagoudi
arXiv_CL
arXiv_CL
Transformer
Bert
Pose
Classification
Language_Model
PDF
-
Learning Light-Weight Translation Models from Deep Transformer
Bei Li, Ziyang Wang, Hui Liu, Quan Du, Tong Xiao, Chunliang Zhang, Jingbo Zhu
arXiv_CL
arXiv_CL
Transformer
Knowledge
Pose
NMT
PDF
-
Inserting Information Bottlenecks for Attribution in Transformers
Zhiying Jiang, Raphael Tang, Ji Xin, Jimmy Lin
arXiv_CL
arXiv_CL
Transformer
Bert
Quantitative
Prediction
PDF
-
I like fish, especially dolphins: Addressing Contradictions in Dialogue Modelling
Yixin Nie, Mary Williamson, Mohit Bansal, Douwe Kiela, Jason Weston
arXiv_AI
arXiv_AI
Transformer
Detection
QA
PDF
-
To what extent do human explanations of model behavior align with actual model behavior?
Grusha Prasad, Yixin Nie, Mohit Bansal, Robin Jia, Douwe Kiela, Adina Williams
arXiv_CL
arXiv_CL
Transformer
Bert
Survey
Inference
PDF
-
Detecting Hateful Memes Using a Multimodal Deep Ensemble
Vlad Sandulescu
arXiv_CV
arXiv_CV
Transformer
Speech
Pose
PDF
-
ProofWriter: Generating Implications, Proofs, and Abductive Statements over Natural Language
Oyvind Tafjord, Bhavana Dalvi Mishra, Peter Clark
arXiv_AI
arXiv_AI
Transformer
PDF
-
Disentangling semantics in language throughs VAEs and a certain architectural choice
Ghazi Felhi, Joseph Le Roux, Djamé Seddah
arXiv_CL
arXiv_CL
Transformer
Unsupervised
Action
PDF
-
The 2020 ESPnet update: new features, broadened applications, performance improvements, and future plans
Shinji Watanabe, Florian Boyer, Xuankai Chang, Pengcheng Guo, Tomoki Hayashi, Yosuke Higuchi, Takaaki Hori, Wen-Chin Huang, Hirofumi Inaguma, Naoyuki Kamo, Shigeki Karita, Chenda Li, Jing Shi, Aswin Shanmugam Subramanian, Wangyou Zhang
arXiv_SD
arXiv_SD
Transformer
Enhancement
Recognition
Speech
Denoising
Speech_Recognition
PDF
-
Training data-efficient image transformers & distillation through attention
Hugo Touvron, Matthieu Cord, Matthijs Douze, Francisco Massa, Alexandre Sablayrolles, Hervé Jégou
arXiv_CV
arXiv_CV
Image_Caption
Transformer
Classification
Attention
Image_Classification
PDF
-
A Survey on Visual Transformer
Kai Han, Yunhe Wang, Hanting Chen, Xinghao Chen, Jianyuan Guo, Zhenhua Liu, Yehui Tang, An Xiao, Chunjing Xu, Yixing Xu, Zhaohui Yang, Yiman Zhang, Dacheng Tao
arXiv_AI
arXiv_AI
Transformer
Review
Pose
Survey
Classification
Attention
CNN
Image_Classification
PDF
-
Future-Guided Incremental Transformer for Simultaneous Translation
Shaolei Zhang, Yang Feng, Liangyou Li
arXiv_AI
arXiv_AI
Transformer
Embedding
Knowledge
Pose
Face
PDF
-
Multi-Head Self-Attention with Role-Guided Masks
Dongsheng Wang, Casper Hansen, Lucas Chaves Lima, Christian Hansen, Maria Maistro, Jakob Grue Simonsen, Christina Lioma
arXiv_CL
arXiv_CL
Transformer
Text_Classification
RNN
Pose
Classification
Attention
PDF
-
Domain Adaptation of NMT models for English-Hindi Machine Translation Task at AdapMT ICON 2020
Ramchandra Joshi, Rushabh Karnavat, Kaustubh Jirapure, Raviraj Joshi
arXiv_CL
arXiv_CL
Transformer
RNN
NMT
PDF
-
Pre-Training a Language Model Without Human Language
Cheng-Han Chiang, Hung-yi Lee
arXiv_CL
arXiv_CL
Transformer
Language_Model
PDF
-
g2tmn at Constraint@AAAI2021: Exploiting CT-BERT and Ensembling Learning for COVID-19 Fake News Detection
Anna Glazkova, Maksim Glazkov, Timofey Trifonov
arXiv_CL
arXiv_CL
Transformer
Bert
Pose
Detection
PDF
-
Recognizing Emotion Cause in Conversations
Soujanya Poria, Navonil Majumder, Devamanyu Hazarika, Deepanway Ghosal, Rishabh Bhardwaj, Samson Yu Bai Jian, Romila Ghosh, Niyati Chhaya, Alexander Gelbukh, Rada Mihalcea
arXiv_CL
arXiv_CL
Transformer
Emotion
Action
PDF
-
Improved Biomedical Word Embeddings in the Transformer Era
jiho Noh, Ramakanth Kavuluru
arXiv_CL
arXiv_CL
Transformer
Embedding
Bert
Pose
Classification
Relation
Medical
PDF
-
Encoding Syntactic Knowledge in Transformer Encoder for Intent Detection and Slot Filling
Jixuan Wang, Kai Wei, Martin Radfar, Weiwei Zhang, Clement Chung
arXiv_AI
arXiv_AI
Transformer
Knowledge
Speech
Pose
Detection
Attention
Inference
PDF
-
Semantic Audio-Visual Navigation
Changan Chen, Ziad Al-Halah, Kristen Grauman
arXiv_CV
arXiv_CV
Transformer
3D
Pose
PDF
-
3D Object Detection with Pointformer
Xuran Pan, Zhuofan Xia, Shiji Song, Li Erran Li, Gao Huang
arXiv_CV
arXiv_CV
Transformer
Point_Cloud
3D
Pose
Action
Detection
Object_Detection
PDF
-
Leveraging ParsBERT and Pretrained mT5 for Persian Abstractive Text Summarization
Mehrdad Farahani, Mohammad Gharachorloo, Mohammad Manthouri
arXiv_CL
arXiv_CL
Transformer
Bert
Pose
Summarization
PDF
-
KRISP: Integrating Implicit and Symbolic Knowledge for Open-Domain Knowledge-Based VQA
Kenneth Marino, Xinlei Chen, Devi Parikh, Abhinav Gupta, Marcus Rohrbach
arXiv_CV
arXiv_CV
Transformer
Embedding
Unsupervised
Knowledge
Knowledge_Graph
VQA
Prediction
QA
PDF
-
Adaptive Bi-directional Attention: Exploring Multi-Granularity Representations for Machine Reading Comprehension
Nuo Chen, Fenglin Liu, Chenyu You, Peilin Zhou, Yuexian Zou
arXiv_AI
arXiv_AI
Transformer
Pose
Attention
PDF
-
A hybrid deep-learning approach for complex biochemical named entity recognition
Jian Liu, Lei Gao, Sujie Guo, Rui Ding, Xin Huang, Long Ye, Qinghua Meng, Asef Nazari, Dhananjay Thiruvady
arXiv_CL
arXiv_CL
Transformer
Recognition
Bert
RNN
Pose
Action
Deep_Learning
Relation
Relation_Extraction
Attention
Medical
PDF
-
Atlas-ISTN: Joint Segmentation, Registration and Atlas Construction with Image-and-Spatial Transformer Networks
Matthew Sinclair, Andreas Schuh, Karl Hahn, Kersten Petersen, Ying Bai, James Batten, Michiel Schaap, Ben Glocker
arXiv_CV
arXiv_CV
Transformer
Segmentation
Semantic_Segmentation
3D
Pose
Quantitative
Deep_Learning
Prediction
PDF
-
Understood in Translation, Transformers for Domain Understanding
Dimitrios Christofidellis, Matteo Manica, Leonidas Georgopoulos, Hans Vandierendonck
arXiv_CL
arXiv_CL
Transformer
Unsupervised
OCR
RNN
Knowledge
Knowledge_Graph
Pose
Action
PDF
-
Exploring Fluent Query Reformulations with Text-to-Text Transformers and Reinforcement Learning
Jerry Zikun Chen, Shi Yu, Haoran Wang
arXiv_AI
arXiv_AI
Transformer
Transfer_Learning
Reinforcement_Learning
Knowledge
Quantitative
Classification
PDF
-
Toward Transformer-Based Object Detection
Josh Beal, Eric Kim, Eric Tzeng, Dong Huk Park, Andrew Zhai, Dmitry Kislyuk
arXiv_AI
arXiv_AI
Transformer
Segmentation
Pose
Classification
Detection
Object_Detection
Attention
CNN
PDF
-
Can Transformers Reason About Effects of Actions?
Pratyay Banerjee, Chitta Baral, Man Luo, Arindam Mitra, Kuntal Pal, Tran C. Son, Neeraj Varshney
arXiv_AI
arXiv_AI
Transformer
Knowledge
Action
QA
PDF
-
Human Mesh Recovery from Multiple Shots
Georgios Pavlakos, Jitendra Malik, Angjoo Kanazawa
arXiv_CV
arXiv_CV
Transformer
Reconstruction
3D
Optimization
Pose
Action
PDF
-
Taming Transformers for High-Resolution Image Synthesis
Patrick Esser, Robin Rombach, Björn Ommer
arXiv_CV
arXiv_CV
Transformer
Segmentation
Action
PDF
-
Transformer Interpretability Beyond Attention Visualization
Hila Chefer, Shir Gur, Lior Wolf
arXiv_CV
arXiv_CV
Transformer
Text_Classification
Pose
Classification
Attention
PDF
-
SceneFormer: Indoor Scene Generation with Transformers
Xinpeng Wang, Chandan Yeshwanth, Matthias Nießner
arXiv_CV
arXiv_CV
Transformer
3D
Scene_Generation
Relation
Attention
PDF
-
End-to-end Deep Object Tracking with Circular Loss Function for Rotated Bounding Box
Vladislav Belyaev, Aleksandra Malysheva, Aleksei Shpilman
arXiv_CV
arXiv_CV
Transformer
Surveillance
Tracking
Object_Tracking
Deep_Learning
Attention
Autonomous
PDF
-
End-to-End Human Pose and Mesh Reconstruction with Transformers
Kevin Lin, Lijuan Wang, Zicheng Liu
arXiv_CV
arXiv_CV
Transformer
Reconstruction
3D
Pose
Action
Relation
Attention
PDF
-
PCT: Point Cloud Transformer
Meng-Hao Guo, Jun-Xiong Cai, Zheng-Ning Liu, Tai-Jiang Mu, Ralph R. Martin, Shi-Min Hu
arXiv_CV
arXiv_CV
Transformer
Segmentation
Embedding
Point_Cloud
Classification
PDF
-
Autoregressive Reasoning over Chains of Facts with Transformers
Ruben Cartuyvels, Graham Spinks, Marie-Francine Moens
arXiv_CL
arXiv_CL
Transformer
Pose
Inference
PDF
-
COVID-19 Emotion Monitoring as a Tool to Increase Preparedness for Disease Outbreaks in Developing Regions
Santiago Cortes, Juan Muñoz, David Betancur, Mauricio Toro
arXiv_CL
arXiv_CL
Transformer
Bert
Emotion
PDF
-
Point Transformer
Hengshuang Zhao, Li Jiang, Jiaya Jia, Philip Torr, Vladlen Koltun
arXiv_CV
arXiv_CV
Transformer
Segmentation
Point_Cloud
3D
Classification
Detection
Object_Detection
Attention
Image_Classification
PDF
-
No Budget? Don't Flex! Cost Consideration when Planning to Adopt NLP for Your Business
Made Nindyatama Nityasya, Haryo Akbarianto Wibowo, Radityo Eko Prasojo, Alham Fikri Aji
arXiv_CL
arXiv_CL
Transformer
Face
PDF
-
Focusing More on Conflicts with Mis-Predictions Helps Language Pre-Training
Chen Xing, Wencong Xiao, Yong Li, Wei Lin
arXiv_CL
arXiv_CL
Transformer
Unsupervised
Bert
Pose
Detection
Object_Detection
Attention
Prediction
PDF
-
A Closer Look at the Robustness of Vision-and-Language Pre-trained Models
Linjie Li, Zhe Gan, Jingjing Liu
arXiv_CV
arXiv_CV
Transformer
Embedding
Bert
Adversarial
Pose
PDF
-
Pre-Training Transformers as Energy-Based Cloze Models
Kevin Clark, Minh-Thang Luong, Quoc V. Le, Christopher D. Manning
arXiv_CL
arXiv_CL
Transformer
Recognition
Bert
Represenation_Learning
Speech
Pose
Speech_Recognition
Language_Model
PDF
-
The Monte Carlo Transformer: a stochastic self-attention model for sequence prediction
Alice Martin (CMAP, IP Paris, CITI, TIPIC-SAMOVAR), Charles Ollion (CMAP), Florian Strub, Sylvain Le Corff (IP Paris, CITI, TIPIC-SAMOVAR), Olivier Pietquin
arXiv_AI
arXiv_AI
Transformer
Pose
Attention
Prediction
PDF
-
Enhance Multimodal Transformer With External Label And In-Domain Pretrain: Hateful Meme Challenge Winning Solution
Ron Zhu
arXiv_CV
arXiv_CV
Transformer
Knowledge
Detection
PDF
-
*-CFQ: Analyzing the Scalability of Machine Learning on a Compositional Task
Dmitry Tsarkov, Tibor Tihon, Nathan Scales, Nikola Momchev, Danila Sinopalnikov, Nathanael Schärli
arXiv_CL
arXiv_CL
Transformer
PDF
-
MeisterMorxrc at SemEval-2020 Task 9: Fine-Tune Bert and Multitask Learning for Sentiment Analysis of Code-Mixed Tweets
Qi Wu, Peng Wang, Chenghao Huang
arXiv_CL
arXiv_CL
Transformer
Bert
Text_Classification
Classification
Sentiment
PDF
-
A Response Retrieval Approach for Dialogue Using a Multi-Attentive Transformer
Matteo A. Senese, Alberto Benincasa, Barbara Caputo, Giuseppe Rizzo
arXiv_AI
arXiv_AI
Transformer
GAN
PDF
-
Writing Polishment with Simile: Task, Dataset and A Neural Approach
Jiayi Zhang, Zhi Cui, Xiaoqiang Xia, Yalong Guo, Yanran Li, Chen Wei, Jianwei Cui
arXiv_CL
arXiv_CL
Transformer
Speech
Pose
PDF
-
Traditional IR rivals neural models on the MS~MARCO Document Ranking Leaderboard
Leonid Boytsov
arXiv_CL
arXiv_CL
Transformer
Bert
PDF
-
A review of on-device fully neural end-to-end automatic speech recognition algorithms
Chanwoo Kim, Dhananjaya Gowda, Dongsoo Lee, Jiyeon Kim, Ankur Kumar, Sungsoo Kim, Abhinav Garg, Changwoo Han
arXiv_CL
arXiv_CL
Transformer
Recognition
Optimization
RNN
Review
Speech
Pose
Classification
Attention
Speech_Recognition
Language_Model
PDF
-
Vartani Spellcheck -- Automatic Context-Sensitive Spelling Correction of OCR-generated Hindi Text Using BERT and Levenshtein Distance
Aditya Pal, Abhijit Mustafi
arXiv_AI
arXiv_AI
Transformer
Recognition
OCR
Bert
Optical_Character
Pose
Detection
Language_Model
PDF
-
Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecasting
Haoyi Zhou (1), Shanghang Zhang (2), Jieqi Peng (1), Shuai Zhang (1), Jianxin Li (1), Hui Xiong (3), Wancai Zhang (4) ((1) Beihang University, (2) UC Berkeley, (3) Rutgers University, (4) Beijing Guowang Fuda Science & Technology Development Company)
arXiv_AI
arXiv_AI
Transformer
Sparse
Attention
Inference
Prediction
PDF
-
Reasoning in Dialog: Improving Response Generation by Context Reading Comprehension
Xiuying Chen, Zhi Cui, Jiayi Zhang, Chen Wei, Jianwei Cui, Bin Wang, Dongyan Zhao, Rui Yan
arXiv_CL
arXiv_CL
Transformer
3D
Pose
PDF
-
Contrastive Learning with Adversarial Perturbations for Conditional Text Generation
Seanie Lee, Dong Bok Lee, Sung Ju Hwang
arXiv_CL
arXiv_CL
Transformer
Adversarial
Pose
Contrastive_Learning
Summarization
Text_Generation
PDF
-
Improving Image Captioning by Leveraging Intra- and Inter-layer Global Representation in Transformer Network
Jiayi Ji, Yunpeng Luo, Xiaoshuai Sun, Fuhai Chen, Gen Luo, Yongjian Wu, Yue Gao, Rongrong Ji
arXiv_CV
arXiv_CV
Image_Caption
Transformer
Embedding
Pose
Action
Attention
Caption
PDF
-
KVL-BERT: Knowledge Enhanced Visual-and-Linguistic BERT for Visual Commonsense Reasoning
Dandan Song, Siyi Ma, Zhanchen Sun, Sicheng Yang, Lejian Liao
arXiv_AI
arXiv_AI
Transformer
Embedding
Bert
Knowledge
Pose
Attention
PDF
-
Radial Deformation Emplacement in Power Transformers Using Long Short-Term Memory Networks
Arash Moradzadeh, Kazem Pourhossein, Behnam Mohammadi-Ivatloo, Tohid Khalili, Ali Bidram
arXiv_CV
arXiv_CV
Transformer
RNN
Memory_Networks
Pose
Action
Deep_Learning
PDF
-
MiniVLM: A Smaller and Faster Vision-Language Model
Jianfeng Wang, Xiaowei Hu, Pengchuan Zhang, Xiujun Li, Lijuan Wang, Lei Zhang, Jianfeng Gao, Zicheng Liu
arXiv_CV
arXiv_CV
Transformer
Bert
Pose
Action
Caption
Inference
Language_Model
PDF
-
DETR for Pedestrian Detection
Matthieu Lin, Chuming Li, Xingyuan Bu, Ming Sun, Chen Lin, Junjie Yan, Wanli Ouyang, Zhidong Deng
arXiv_CV
arXiv_CV
Transformer
Pose
Action
Detection
Object_Detection
Prediction
PDF
-
Yelp Review Rating Prediction: Machine Learning and Deep Learning Models
Zefang Liu
arXiv_CL
arXiv_CL
Transformer
Bert
Review
Classification
Deep_Learning
Prediction
PDF
-
TabTransformer: Tabular Data Modeling Using Contextual Embeddings
Xin Huang, Ashish Khetan, Milan Cvitkovic, Zohar Karnin
arXiv_AI
arXiv_AI
Transformer
Embedding
Unsupervised
Pose
Deep_Learning
Attention
Prediction
PDF
-
DeCoAR 2.0: Deep Contextualized Acoustic Representations with Vector Quantization
Shaoshi Ling, Yuzong Liu
arXiv_CL
arXiv_CL
Transformer
Reconstruction
Quantization
Recognition
Sparse
Represenation_Learning
RNN
Speech
Self-Supervised
Pose
Speech_Recognition
PDF
-
Orthogonal Language and Task Adapters in Zero-Shot Cross-Lingual Transfer
Marko Vidoni, Ivan Vulić, Goran Glavaš
arXiv_CL
arXiv_CL
Transformer
Zero-Shot
Knowledge
Pose
PDF
-
Spatial Temporal Transformer Network for Skeleton-based Action Recognition
Chiara Plizzari, Marco Cannici, Matteo Matteucci
arXiv_CV
arXiv_CV
Transformer
Recognition
3D
Pose
Action_Recognition
Action
Relation
Attention
PDF
-
Towards Neural Programming Interfaces
Zachary C. Brown, Nathaniel Robinson, David Wingate, Nancy Fulda
arXiv_AI
arXiv_AI
Transformer
Speech
Pose
Face
GAN
Language_Model
PDF
-
Leveraging Transfer Learning for Reliable Intelligence Identification on Vietnamese SNSs
Trung-Hieu Tran, Long Phan, Truong-Son Nguyen
arXiv_AI
arXiv_AI
Transformer
Transfer_Learning
Pose
PDF
-
Look Before you Speak: Visually Contextualized Utterances
Paul Hongsuck Seo, Arsha Nagrani, Cordelia Schmid
arXiv_CV
arXiv_CV
Transformer
Speech
Attention
Activity
Prediction
QA
PDF
-
As good as new. How to successfully recycle English GPT-2 to make models for other languages
Wietse de Vries, Malvina Nissim
arXiv_CL
arXiv_CL
Transformer
Embedding
Pose
Language_Model
PDF
-
Unified Streaming and Non-streaming Two-pass End-to-end Model for Speech Recognition
Binbin Zhang, Di Wu, Zhuoyuan Yao, Xiong Wang, Fan Yu, Chao Yang, Liyong Guo, Yaguang Hu, Lei Xie, Xin Lei
arXiv_SD
arXiv_SD
Transformer
Recognition
Speech
Pose
Attention
Speech_Recognition
Inference
PDF
-
Rewriter-Evaluator Framework for Neural Machine Translation
Yangming Li, Kaisheng Yao
arXiv_CL
arXiv_CL
Transformer
Gradient_Descent
Pose
NMT
PDF
-
Topological Planning with Transformers for Vision-and-Language Navigation
Kevin Chen, Junshen K. Chen, Jo Chuang, Marynel Vázquez, Silvio Savarese
arXiv_AI
arXiv_AI
Transformer
Tracking
Pose
Action
Attention
PDF
-
Simple is not Easy: A Simple Strong Baseline for TextVQA and TextCaps
Qi Zhu, Chenyu Gao, Peng Wang, Qi Wu
arXiv_CV
arXiv_CV
Image_Caption
Transformer
Recognition
OCR
Optical_Character
VQA
Attention
Caption
QA
PDF
-
Mapping the Space of Chemical Reactions Using Attention-Based Neural Networks
Philippe Schwaller, Daniel Probst, Alain C. Vaucher, Vishnu H. Nair, David Kreutter, Teodoro Laino, Jean-Louis Reymond
arXiv_CL
arXiv_CL
Transformer
Action
Classification
Attention
GAN
PDF
-
Proactive Interaction Framework for Intelligent Social Receptionist Robots
Yang Xue, Fan Wang, Hao Tian, Min Zhao, Jiangyong Li, Haiqing Pan, Yueqiang Dong
arXiv_RO
arXiv_RO
Transformer
Pose
Action
PDF
-
River: machine learning for streaming data in Python
Jacob Montiel, Max Halford, Saulo Martiello Mastelini, Geoffrey Bolmier, Raphael Sourty, Robin Vaysse, Adil Zouitine, Heitor Murilo Gomes, Jesse Read, Talel Abdessalem, Albert Bifet
arXiv_AI
arXiv_AI
Transformer
PDF
-
Transformer Guided Geometry Model for Flow-Based Unsupervised Visual Odometry
Xiangyu Li, Yonghong Hou, Pichao Wang, Zhimin Gao, Mingliang Xu, Wanqing Li
arXiv_CV
arXiv_CV
Transformer
Unsupervised
RNN
Pose
Relation
PDF
-
Extractive Opinion Summarization in Quantized Transformer Spaces
Stefanos Angelidis, Reinald Kim Amplayo, Yoshihiko Suhara, Xiaolan Wang, Mirella Lapata
arXiv_CL
arXiv_CL
Transformer
Unsupervised
Review
Pose
Action
Summarization
PDF
-
Parameter Efficient Multimodal Transformers for Video Representation Learning
Sangho Lee, Youngjae Yu, Gunhee Kim, Thomas Breuel, Jan Kautz, Yale Song
arXiv_CV
arXiv_CV
Transformer
Embedding
Represenation_Learning
Pose
Classification
Language_Model
PDF
-
Detecting Insincere Questions from Text: A Transfer Learning Approach
Ashwin Rachha, Gaurav Vanmane
arXiv_AI
arXiv_AI
Transformer
Transfer_Learning
Bert
Knowledge
Action
Classification
PDF
-
Confidence-aware Non-repetitive Multimodal Transformers for TextCaps
Zhaokai Wang, Renda Bao, Qi Wu, Si Liu
arXiv_CV
arXiv_CV
Image_Caption
Transformer
Embedding
Recognition
OCR
Optical_Character
Pose
NMT
Caption
PDF
-
Topical Change Detection in Documents via Embeddings of Long Sequences
Dennis Aumiller, Satya Almasian, Sebastian Lackner, Michael Gertz
arXiv_CL
arXiv_CL
Transformer
Segmentation
Embedding
Deep_Learning
Detection
Summarization
Language_Model
Prediction
PDF
-
Deep Policy Networks for NPC Behaviors that Adapt to Changing Design Parameters in Roguelike Games
Alessandro Sestini, Alexander Kuhnle, Andrew D. Bagdanov
arXiv_AI
arXiv_AI
Transformer
Embedding
Reinforcement_Learning
Pose
Face
Relation
Attention
PDF
-
Improvements and Extensions on Metaphor Detection
Weicheng Ma, Ruibo Liu, Lili Wang, Soroush Vosoughi
arXiv_CL
arXiv_CL
Transformer
Classification
Detection
PDF
-
Document Graph for Neural Machine Translation
Mingzhou Xu, Liangyou Li, Derek. F. Wai, Qun Liu, Lidia S. Chao
arXiv_CL
arXiv_CL
Transformer
NMT
Relation
CNN
PDF
-
An Empirical Survey of Unsupervised Text Representation Methods on Twitter Data
Lili Wang, Chongyang Gao, Jason Wei, Weicheng Ma, Ruibo Liu, Soroush Vosoughi
arXiv_CL
arXiv_CL
Transformer
Unsupervised
Bert
Survey
Language_Model
PDF
-
Pre-training Protein Language Models with Label-Agnostic Binding Pairs Enhances Performance in Downstream Tasks
Modestas Filipavicius, Matteo Manica, Joris Cadow, Maria Rodriguez Martinez
arXiv_CL
arXiv_CL
Transformer
Bert
Self-Supervised
Classification
Attention
Language_Model
Prediction
PDF
-
Urban Crowdsensing using Social Media: An Empirical Study on Transformer and Recurrent Neural Networks
Jerome Heng, Junhua Liu, Kwan Hui Lim
arXiv_AI
arXiv_AI
Transformer
RNN
Detection
Prediction
PDF
-
Enhanced Offensive Language Detection Through Data Augmentation
Ruibo Liu, Guangxuan Xu, Soroush Vosoughi
arXiv_CL
arXiv_CL
Transformer
Bert
RNN
Classification
Detection
Attention
PDF
-
Data-Efficient Methods for Dialogue Systems
Igor Shalyminov
arXiv_CL
arXiv_CL
Transformer
RNN
Knowledge
Pose
Face
Deep_Learning
Detection
Matching
PDF
-
Learning Equivariant Representations
Carlos Esteves
arXiv_CV
arXiv_CV
Transformer
Segmentation
Embedding
Recognition
3D
Pose_Estimation
Pose
Classification
Deep_Learning
CNN
Image_Classification
PDF
-
Fine-tuning BERT for Low-Resource Natural Language Understanding via Active Learning
Daniel Grießhaber, Johannes Maucher, Ngoc Thang Vu
arXiv_CL
arXiv_CL
Transformer
Bert
Knowledge
Language_Model
PDF
-
Understanding Guided Image Captioning Performance across Domains
Edwin G. Ng, Bo Pang, Piyush Sharma, Radu Soricut
arXiv_CV
arXiv_CV
Image_Caption
Transformer
VQA
Caption
QA
PDF
-
Do We Really Need That Many Parameters In Transformer For Extractive Summarization? Discourse Can Help !
Wen Xiao, Patrick Huber, Giuseppe Carenini
arXiv_CL
arXiv_CL
Transformer
Pose
Attention
Summarization
PDF
-
BERT-hLSTMs: BERT and Hierarchical LSTMs for Visual Storytelling
Jing Su, Qingyun Dai, Frank Guerin, Mian Zhou
arXiv_CV
arXiv_CV
Transformer
Embedding
Bert
RNN
Pose
PDF
-
GottBERT: a pure German Language Model
Raphael Scheible, Fabian Thomczyk, Patric Tippmann, Victor Jaravine, Martin Boeker
arXiv_CL
arXiv_CL
Transformer
Recognition
Bert
Text_Classification
Optimization
Classification
Language_Model
PDF
-
Saying No is An Art: Contextualized Fallback Responses for Unanswerable Dialogue Queries
Ashish Shrivastava, Kaustubh Dhole, Abhinav Bhatt, Sharvani Raghunath
arXiv_AI
arXiv_AI
Transformer
Action
PDF
-
DialogBERT: Discourse-Aware Response Generation via Learning to Recover and Rank Utterances
Xiaodong Gu, Kang Min Yoo, Jung-Woo Ha
arXiv_AI
arXiv_AI
Transformer
Bert
Pose
Quantitative
Attention
Language_Model
PDF
-
Pedestrian Trajectory Prediction using Context-Augmented Transformer Networks
Khaled Saleh
arXiv_CV
arXiv_CV
Transformer
RNN
Action
Autonomous
Prediction
PDF
-
Adapt-and-Adjust: Overcoming the Long-Tail Problem of Multilingual Speech Recognition
Genta Indra Winata, Guangsen Wang, Caiming Xiong, Steven Hoi
arXiv_AI
arXiv_AI
Transformer
Recognition
Bert
Speech
Pose
Speech_Recognition
Inference
Language_Model
PDF
-
Contour Transformer Network for One-shot Segmentation of Anatomical Structures
Yuhang Lu, Kang Zheng, Weijian Li, Yirui Wang, Adam P. Harrison, Chihung Lin, Song Wang, Jing Xiao, Le Lu, Chang-Fu Kuo, Shun Miao
arXiv_CV
arXiv_CV
Transformer
Segmentation
Deep_Learning
Contour
Medical
CNN
PDF
-
ArCorona: Analyzing Arabic Tweets in the Early Days of Coronavirus Pandemic
Hamdy Mubarak, Sabit Hassan
arXiv_CL
arXiv_CL
Transformer
Classification
PDF
-
Cross-modal Retrieval and Synthesis : Closing the modality gap in shared subspace
Ricardo Guerrero, Hai Xuan Pham, Vladimir Pavlovic
arXiv_CV
arXiv_CV
Transformer
Embedding
Pose
PDF
-
Interactive Teaching for Conversational AI
Qing Ping, Feiyang Niu, Govind Thattai, Joel Chengottusseriyil, Qiaozi Gao, Aishwarya Reganti, Prashanth Rajagopal, Gokhan Tur, Dilek Hakkani-Tur, Prem Nataraja
arXiv_CL
arXiv_CL
Transformer
Pose
Action
PDF
-
StructFormer: Joint Unsupervised Induction of Dependency and Constituency Structure from Masked Language Modeling
Yikang Shen, Yi Tay, Che Zheng, Dara Bahri, Donald Metzler, Aaron Courville
arXiv_AI
arXiv_AI
Transformer
Unsupervised
Pose
Relation
Attention
Language_Model
PDF
-
Pose-based Sign Language Recognition using GCN and BERT
Anirudh Tunga, Sai Vidyaranya Nuthalapati, Juan Wachs
arXiv_CV
arXiv_CV
Transformer
Recognition
Bert
Pose
Action
CNN
Prediction
PDF
-
MaX-DeepLab: End-to-End Panoptic Segmentation with Mask Transformers
Huiyu Wang, Yukun Zhu, Hartwig Adam, Alan Yuille, Liang-Chieh Chen
arXiv_CV
arXiv_CV
Transformer
Segmentation
Detection
Matching
PDF
-
Denoising Pre-Training and Data Augmentation Strategies for Enhanced RDF Verbalization with Transformers
Sebastien Montella, Betty Fabre, Tanguy Urvoy, Johannes Heinecke, Lina Rojas-Barahona
arXiv_CL
arXiv_CL
Transformer
Knowledge
Pose
Denoising
Text_Generation
PDF
-
Just Ask: Learning to Answer Questions from Millions of Narrated Videos
Antoine Yang, Antoine Miech, Josef Sivic, Ivan Laptev, Cordelia Schmid
arXiv_CV
arXiv_CV
Transformer
Embedding
Zero-Shot
Pose
VQA
Activity
QA
PDF
-
Pre-Trained Image Processing Transformer
Hanting Chen, Yunhe Wang, Tianyu Guo, Chang Xu, Yiping Deng, Zhenhua Liu, Siwei Ma, Chunjing Xu, Chao Xu, Wen Gao
arXiv_CV
arXiv_CV
Transformer
Super_Resolution
Bert
Contrastive_Learning
Deep_Learning
Denoising
PDF
-
Modifying Memories in Transformer Models
Chen Zhu, Ankit Singh Rawat, Manzil Zaheer, Srinadh Bhojanapalli, Daliang Li, Felix Yu, Sanjiv Kumar
arXiv_CL
arXiv_CL
Transformer
Knowledge
Pose
Language_Model
PDF
-
Detecting expressions with multimodal transformers
Srinivas Parthasarathy, Shiva Sundaram
arXiv_SD
arXiv_SD
Transformer
Tracking
Pose
Detection
Activity
PDF
-
Transformer-Transducers for Code-Switched Speech Recognition
Siddharth Dalmia, Yuzong Liu, Srikanth Ronanki, Katrin Kirchhoff
arXiv_CL
arXiv_CL
Transformer
Recognition
Speech
Pose
Speech_Recognition
PDF
-
Machine Translation of Novels in the Age of Transformer
Antonio Toral, Antoni Oliver, Pau Ribas Ballestín
arXiv_CL
arXiv_CL
Transformer
NMT
PDF
-
Flood Detection via Twitter Streams using Textual and Visual Features
Firoj Alam, Zohaib Hassan, Kashif Ahmad, Asma Gul, Michael Reiglar, Nicola Conci, Ala AL-Fuqaha
arXiv_CV
arXiv_CV
Transformer
Bert
Pose
Detection
PDF
-
Dynamic Curriculum Learning for Low-Resource Neural Machine Translation
Chen Xu, Bojie Hu, Yufan Jiang, Kai Feng, Zeyang Wang, Shen Huang, Qi Ju, Tong Xiao, Jingbo Zhu
arXiv_CL
arXiv_CL
Transformer
Pose
NMT
PDF
-
End-to-End Video Instance Segmentation with Transformers
Yuqing Wang, Zhaoliang Xu, Xinlong Wang, Chunhua Shen, Baoshan Cheng, Hao Shen, Huaxia Xia
arXiv_CV
arXiv_CV
Transformer
Segmentation
Tracking
Video_Caption
Pose
Prediction
Matching
PDF
-
EdgeBERT: Optimizing On-Chip Inference for Multi-Task NLP
Thierry Tambe, Coleman Hooper, Lillian Pentecost, En-Yu Yang, Marco Donato, Victor Sanh, Alexander M. Rush, David Brooks, Gu-Yeon Wei
arXiv_CL
arXiv_CL
Transformer
Embedding
Quantization
Bert
Attention
Inference
Language_Model
PDF
-
AdaBins: Depth Estimation using Adaptive Bins
Shariq Farooq Bhat, Ibraheem Alhashim, Peter Wonka
arXiv_CV
arXiv_CV
Transformer
Pose
CNN
PDF
-
Disentangling Homophemes in Lip Reading using Perplexity Analysis
Souheil Fenghour, Daqing Chen, Kun Guo, Perry Xiao
arXiv_CL
arXiv_CL
Transformer
Text_Classification
Speech
Pose
Classification
Language_Model
Prediction
PDF
-
Transformer Query-Target Knowledge Discovery : Drug Discovery from CORD-19
Leo K. Tam, Xiaosong Wang, Daguang Xu
arXiv_CL
arXiv_CL
Transformer
Bert
Knowledge
Language_Model
Prediction
PDF
-
Understanding How BERT Learns to Identify Edits
Samuel Stevens, Yu Su
arXiv_CL
arXiv_CL
Transformer
Bert
Pose
Classification
Attention
Language_Model
PDF
-
General Multi-label Image Classification with Transformers
Jack Lanchantin, Tianlu Wang, Vicente Ordonez, Yanjun Qi
arXiv_AI
arXiv_AI
Transformer
Pose
Classification
CNN
Image_Classification
Inference
PDF
-
Relation Clustering in Narrative Knowledge Graphs
Simone Mellace, K Vani, Alessandro Antonucci
arXiv_AI
arXiv_AI
Transformer
Unsupervised
Bert
Knowledge
Knowledge_Graph
Action
Relation
PDF
-
Temporal-Channel Transformer for 3D Lidar-Based Video Object Detection in Autonomous Driving
Zhenxun Yuan, Xiao Song, Lei Bai, Wengang Zhou, Zhe Wang, Wanli Ouyang
arXiv_CV
arXiv_CV
Transformer
3D
Pose
Detection
Relation
Object_Detection
Autonomous
PDF
-
PCLs: Geometry-aware Neural Reconstruction of 3D Pose with Perspective Crop Layers
Frank Yu, Mathieu Salzmann, Pascal Fua, Helge Rhodin
arXiv_CV
arXiv_CV
Transformer
Reconstruction
3D
Pose
PDF
-
Robust Attacks on Deep Learning Face Recognition in the Physical World
Meng Shen, Hao Yu, Liehuang Zhu, Ke Xu, Qi Li, Xiaojiang Du
arXiv_CV
arXiv_CV
Transformer
Recognition
Adversarial
Pose
Face
Deep_Learning
Face_Recognition
PDF
-
Generative Layout Modeling using Constraint Graphs
Wamiq Para, Paul Guerrero, Tom Kelly, Leonidas Guibas, Peter Wonka
arXiv_CV
arXiv_CV
Transformer
Optimization
Pose
PDF
-
DyCo3D: Robust Instance Segmentation of 3D Point Clouds through Dynamic Convolution
Tong He, Chunhua Shen, Anton van den Hengel
arXiv_CV
arXiv_CV
Transformer
Segmentation
Point_Cloud
3D
Sparse
Pose
Action
CNN
Inference
PDF
-
Two Stage Transformer Model for COVID-19 Fake News Detection and Fact Checking
Rutvik Vijjali, Prathyush Potluri, Siddharth Kumar, Sundeep Teki
arXiv_CL
arXiv_CL
Transformer
Bert
Knowledge
Detection
PDF
-
Molecular representation learning with language models and domain-relevant auxiliary tasks
Benedek Fabian, Thomas Edlich, Héléna Gaspar, Marwin Segler, Joshua Meyers, Marco Fiscato, Mohamed Ahmed
arXiv_AI
arXiv_AI
Transformer
Bert
Represenation_Learning
Self-Supervised
Language_Model
PDF
-
Transformer-Based Models for Automatic Identification of Argument Relations: A Cross-Domain Evaluation
Ramon Ruiz-Dolz, Stella Heras, Jose Alemany, Ana García-Fornes
arXiv_CL
arXiv_CL
Transformer
Bert
Relation
PDF
-
Multi-view Depth Estimation using Epipolar Spatio-Temporal Network
Xiaoxiao Long, Lingjie Liu, Wei Li, Christian Theobalt, Wenping Wang
arXiv_CV
arXiv_CV
Transformer
Reconstruction
3D
Regularization
Relation
Matching
PDF
-
A Recurrent Vision-and-Language BERT for Navigation
Yicong Hong, Qi Wu, Yuankai Qi, Cristian Rodriguez-Opazo, Stephen Gould
arXiv_CV
arXiv_CV
Transformer
Bert
Pose
Attention
PDF
-
Neural Representations for Modeling Variation in English Speech
Martijn Bartelds, Wietse de Vries, Faraz Sanal, Caitlin Richter, Mark Liberman, Martijn Wieling
arXiv_CL
arXiv_CL
Transformer
Embedding
Speech
Self-Supervised
Action
PDF
-
Combining Semantic Guidance and Deep Reinforcement Learning For Generating Human Level Paintings
Jaskirat Singh, Liang Zheng
arXiv_CV
arXiv_CV
Transformer
Reinforcement_Learning
Salient
Pose
PDF
-
Enhancing deep neural networks with morphological information
Matej Klemen, Luka Krsnik, Marko Robnik-Šikonja
arXiv_CL
arXiv_CL
Transformer
Recognition
Bert
RNN
Speech
Deep_Learning
Language_Model
PDF
-
SpinNet: Learning a General Surface Descriptor for 3D Point Cloud Registration
Sheng Ao, Qingyong Hu, Bo Yang, Andrew Markham, Yulan Guo
arXiv_AI
arXiv_AI
Transformer
Reconstruction
Point_Cloud
3D
Optimization
Face
CNN
Matching
PDF
-
Tackling Domain-Specific Winograd Schemas with Knowledge-Based Reasoning and Machine Learning
Suk Joon Hong, Brandon Bennett
arXiv_AI
arXiv_AI
Transformer
Bert
Knowledge
Pose
PDF
-
Large Scale Multimodal Classification Using an Ensemble of Transformer Models and Co-Attention
Varnith Chordia, Vijay Kumar BG
arXiv_AI
arXiv_AI
Transformer
Embedding
Classification
Relation
VQA
Attention
QA
Recommendation
PDF
-
Rethinking Transformer-based Set Prediction for Object Detection
Zhiqing Sun, Shengcao Cao, Yiming Yang, Kris Kitani
arXiv_CV
arXiv_CV
Transformer
Optimization
Pose
Detection
Object_Detection
Attention
Prediction
PDF
-
Self-Supervised learning with cross-modal transformers for emotion recognition
Aparna Khare, Srinivas Parthasarathy, Shiva Sundaram
arXiv_CL
arXiv_CL
Transformer
Embedding
Recognition
Bert
Speech
Self-Supervised
Emotion
Language_Model
PDF
-
Fine-Tuning BERT for Sentiment Analysis of Vietnamese Reviews
Quoc Thai Nguyen, Thoai Linh Nguyen, Ngoc Hoang Luong, Quoc Hung Ngo
arXiv_CL
arXiv_CL
Transformer
Bert
Review
Pose
Classification
Deep_Learning
Sentiment
PDF
-
SophiaPop: Experiments in Human-AI Collaboration on Popular Music
David Hanson, Frankie Storm, Wenwei Huang, Vytas Krisciunas, Tiger Darrow, Audrey Brown, Mengna Lei, Matthew Aylett, Adam Pickrell, Sophia the Robot
arXiv_AI
arXiv_AI
Transformer
Pose
Relation
PDF
-
ConvTransformer: A Convolutional Transformer Network for Video Frame Synthesis
Zhouyong Liu, Shun Luo, Wubin Li, Jingben Lu, Yufan Wu, Chunguo Li, Luxi Yang
arXiv_CV
arXiv_CV
Transformer
RNN
Knowledge
Pose
Attention
CNN
PDF
-
Sentiment Classification in Bangla Textual Content: A Comparative Study
Md. Arid Hasan, Jannatul Tajrin, Shammur Absar Chowdhury, Firoj Alam
arXiv_CL
arXiv_CL
Transformer
Sentiment_Classification
Classification
Deep_Learning
Sentiment
PDF
-
Persuasive Dialogue Understanding: the Baselines and Negative Results
Hui Chen, Deepanway Ghosal, Navonil Majumder, Amir Hussain, Soujanya Poria
arXiv_CL
arXiv_CL
Transformer
Recognition
Optimization
RNN
Speech
Action
Relation
Attention
CNN
PDF
-
Everybody Sign Now: Translating Spoken Language to Photo Realistic Sign Language Video
Ben Saunders, Necati Cihan Camgoz, Richard Bowden
arXiv_CV
arXiv_CV
Transformer
Pose
Quantitative
GAN
Inference
PDF
-
Attention-Based Transformers for Instance Segmentation of Cells in Microstructures
Tim Prangemeier, Christoph Reich, Heinz Koeppl
arXiv_CV
arXiv_CV
Transformer
Segmentation
Semantic_Segmentation
Pose
Quantitative
Deep_Learning
Detection
Attention
Medical
PDF
-
Universal MelGAN: A Robust Neural Vocoder for High-Fidelity Waveform Generation in Multiple Domains
Won Jang, Dan Lim, Jaesam Yoon
arXiv_CL
arXiv_CL
Transformer
Speech
Pose
Emotion
GAN
Inference
PDF
-
Palomino-Ochoa at SemEval-2020 Task 9: Robust System based on Transformer for Code-Mixed Sentiment Classification
Daniel Palomino, Jose Ochoa-Luna
arXiv_CL
arXiv_CL
Transformer
Transfer_Learning
Bert
Sentiment_Classification
Classification
Detection
Sentiment
Language_Model
PDF
-
EWareNet: Emotion Aware Human Intent Prediction and Adaptive Spatial Profile Fusion for Social Robot Navigation
Venkatraman Narayanan, Bala Murali Manoghar, Rama Prashanth RV, Aniket Bera
arXiv_RO
arXiv_RO
Transformer
Reinforcement_Learning
3D
Pose
Emotion
Prediction
PDF
-
End-to-End Object Detection with Adaptive Clustering Transformer
Minghang Zheng, Peng Gao, Xiaogang Wang, Hongsheng Li, Hao Dong
arXiv_CV
arXiv_CV
Transformer
Pose
Action
Detection
Object_Detection
Attention
Inference
PDF
-
The Ubiqus English-Inuktitut System for WMT20
François Hernandez, Vincent Nguyen
arXiv_CL
arXiv_CL
Transformer
PDF
-
Do Fine-tuned Commonsense Language Models Really Generalize?
Mayank Kejriwal, Ke Shen
arXiv_AI
arXiv_AI
Transformer
Bert
Language_Model
PDF
-
UP-DETR: Unsupervised Pre-training for Object Detection with Transformers
Zhigang Dai, Bolun Cai, Yugeng Lin, Junying Chen
arXiv_CV
arXiv_CV
Transformer
Reconstruction
Unsupervised
Pose
Classification
Detection
Object_Detection
Attention
PDF
-
Sequence-Level Mixed Sample Data Augmentation
Demi Guo, Yoon Kim, Alexander M. Rush
arXiv_CL
arXiv_CL
Transformer
Pose
PDF
-
s-Transformer: Segment-Transformer for Robust Neural Speech Synthesis
Xi Wang, Huaiping Ming, Lei He, Frank K. Soong
arXiv_SD
arXiv_SD
Transformer
Speech
Pose
Attention
PDF
-
It's a Thin Line Between Love and Hate: Using the Echo in Modeling Dynamics of Racist Online Communities
Eyal Arviv, Simo Hanouna, Oren Tsur
arXiv_CL
arXiv_CL
Transformer
Reconstruction
Tracking
Bert
RNN
Speech
Pose
Detection
PDF
-
End-to-end spoken language understanding using transformer networks and self-supervised pre-trained features
Edmilson Morais, Hong-Kwang J. Kuo, Samuel Thomas, Zoltan Tuske, Brian Kingsbury
arXiv_CL
arXiv_CL
Transformer
Self-Supervised
Action
PDF
-
On the Effectiveness of Vision Transformers for Zero-shot Face Anti-Spoofing
Anjith George, Sebastien Marcel
arXiv_CV
arXiv_CV
Transformer
Transfer_Learning
Recognition
Zero-Shot
Pose
Face
Face_Recognition
PDF
-
Conditioned Natural Language Generation using only Unconditioned Language Model: An Exploration
Fan-Keng Sun, Cheng-I Lai
arXiv_CL
arXiv_CL
Transformer
Text_Generation
Language_Model
PDF
-
DebateSum: A large-scale argument mining and summarization dataset
Allen Roush, Arvind Balaji
arXiv_CL
arXiv_CL
Transformer
Speech
Summarization
PDF
-
ActBERT: Learning Global-Local Video-Text Representations
Linchao Zhu, Yi Yang
arXiv_CV
arXiv_CV
Transformer
Segmentation
Video_Caption
Bert
Represenation_Learning
Self-Supervised
Action
Relation
Caption
PDF
-
Utilizing Bidirectional Encoder Representations from Transformers for Answer Selection
Md Tahmid Rahman Laskar, Enamul Hoque, Jimmy Xiangji Huang
arXiv_CL
arXiv_CL
Transformer
Bert
Language_Model
QA
PDF
-
FLERT: Document-Level Features for Named Entity Recognition
Stefan Schweter, Alan Akbik
arXiv_CL
arXiv_CL
Transformer
Recognition
Bert
RNN
Prediction
Recommendation
PDF
-
Transformer-Encoder Detector Module: Using Context to Improve Robustness to Adversarial Attacks on Object Detection
Faisal Alamri, Sinan Kalkan, Nicolas Pugeault
arXiv_CV
arXiv_CV
Transformer
Recognition
Adversarial
Pose
Detection
Object_Detection
PDF
-
EDITOR: an Edit-Based Transformer with Repositioning for Neural Machine Translation with Soft Lexical Constraints
Weijia Xu, Marine Carpuat
arXiv_CL
arXiv_CL
Transformer
PDF
-
Augmenting BERT Carefully with Underrepresented Linguistic Features
Aparna Balagopalan, Jekaterina Novikova
arXiv_CL
arXiv_CL
Transformer
Bert
Speech
Classification
Detection
PDF
-
Hurricane Forecasting: A Novel Multimodal Machine Learning Framework
Léonard Boussioux, Cynthia Zeng, Théo Guénais, Dimitris Bertsimas
arXiv_AI
arXiv_AI
Transformer
Pose
PDF
-
Transformers for One-Shot Visual Imitation
Sudeep Dasari, Abhinav Gupta
arXiv_CV
arXiv_CV
Transformer
Knowledge
Self-Supervised
Action
Attention
PDF
-
TRAILER: Transformer-based Time-wise Long Term Relation Modeling for Citywide Traffic Flow Prediction
Hao Xue, Flora D Salim
arXiv_AI
arXiv_AI
Transformer
Pose
Deep_Learning
Relation
Prediction
PDF
-
E.T.: Entity-Transformers. Coreference augmented Neural Language Model for richer mention representations via Entity-Transformer blocks
Nikolaos Stylianou, Ioannis Vlahavas
arXiv_CL
arXiv_CL
Transformer
Recognition
Language_Model
PDF
-
Human-centric Spatio-Temporal Video Grounding With Visual Transformers
Zongheng Tang, Yue Liao, Si Liu, Guanbin Li, Xiaojie Jin, Hongxu Jiang, Qian Yu, Dong Xu
arXiv_AI
arXiv_AI
Transformer
Surveillance
Pose
Matching
PDF
-
Translating Similar Languages: Role of Mutual Intelligibility in Multilingual Transformers
Ife Adebara, El Moatez Billah Nagoudi, Muhammad Abdul Mageed
arXiv_CL
arXiv_CL
Transformer
Relation
PDF
-
When Do You Need Billions of Words of Pretraining Data?
Yian Zhang, Alex Warstadt, Haau-Sing Li, Samuel R. Bowman
arXiv_CL
arXiv_CL
Transformer
Unsupervised
Bert
Knowledge
Pose
Language_Model
PDF
-
A Transfer Learning Approach for Dialogue Act Classification of GitHub Issue Comments
Ayesha Enayet, Gita Sukthankar
arXiv_CL
arXiv_CL
Transformer
Transfer_Learning
Bert
Classification
PDF
-
EstBERT: A Pretrained Language-Specific BERT for Estonian
Hasan Tanvir, Claudia Kittask, Kairit Sirts
arXiv_CL
arXiv_CL
Transformer
Recognition
Bert
Text_Classification
Classification
PDF
-
VisBERT: Hidden-State Visualizations for Transformers
Betty van Aken, Benjamin Winter, Alexander Löser, Felix A. Gers
arXiv_CL
arXiv_CL
Transformer
Bert
Attention
Inference
Prediction
PDF
-
Bangla Text Classification using Transformers
Tanvirul Alam, Akib Khan, Firoj Alam
arXiv_CL
arXiv_CL
Transformer
Text_Classification
Emotion
Classification
Deep_Learning
Detection
Sentiment
PDF
-
BERT-JAM: Boosting BERT-Enhanced Neural Machine Translation with Joint Attention
Zhebin Zhang, Sai Wu, Dawei Jiang, Gang Chen
arXiv_CL
arXiv_CL
Transformer
Bert
Optimization
Pose
NMT
Attention
PDF
-
Gated Recurrent Fusion with Joint Training Framework for Robust End-to-End Speech Recognition
Cunhang Fan, Jiangyan Yi, Jianhua Tao, Zhengkun Tian, Bin Liu, Zhengqi Wen
arXiv_CL
arXiv_CL
Transformer
Enhancement
Recognition
Speech
Pose
Speech_Recognition
PDF
-
End-to-end Lane Shape Prediction with Transformers
Ruijin Liu, Zejian Yuan, Tie Liu, Zhiliang Xiong
arXiv_AI
arXiv_AI
Transformer
Pose
Action
Detection
Attention
Autonomous
Prediction
PDF
-
Efficient End-to-End Speech Recognition Using Performers in Conformers
Peidong Wang, DeLiang Wang
arXiv_CL
arXiv_CL
Transformer
Recognition
Speech
Pose
Attention
Speech_Recognition
PDF
-
On the Usefulness of Self-Attention for Automatic Speech Recognition with Transformers
Shucong Zhang, Erfan Loweimi, Peter Bell, Steve Renals
arXiv_CL
arXiv_CL
Transformer
Recognition
Speech
Relation
Attention
Speech_Recognition
PDF
-
Long Range Arena: A Benchmark for Efficient Transformers
Yi Tay, Mostafa Dehghani, Samira Abnar, Yikang Shen, Dara Bahri, Philip Pham, Jinfeng Rao, Liu Yang, Sebastian Ruder, Donald Metzler
arXiv_AI
arXiv_AI
Transformer
Sparse
Pose
Attention
PDF
-
Stochastic Attention Head Removal: A Simple and Effective Method for Improving Automatic Speech Recognition with Transformers
Shucong Zhang, Erfan Loweimi, Peter Bell, Steve Renals
arXiv_CL
arXiv_CL
Transformer
Recognition
Speech
Pose
Attention
Speech_Recognition
PDF
-
On the Practical Ability of Recurrent Neural Networks to Recognize Hierarchical Languages
Satwik Bhattamishra, Kabir Ahuja, Navin Goyal
arXiv_CL
arXiv_CL
Transformer
RNN
PDF
-
PointTransformer for Shape Classification and Retrieval of 3D and ALS Roof PointClouds
Dimple A Shajahan, Mukund Varma T, Ramanathan Muthuganapathy
arXiv_CV
arXiv_CV
Transformer
Point_Cloud
3D
Pose
Classification
Deep_Learning
Attention
PDF
-
Rethinking the Value of Transformer Components
Wenxuan Wang, Zhaopeng Tu
arXiv_CL
arXiv_CL
Transformer
Pose
PDF
-
Know What You Don't Need: Single-Shot Meta-Pruning for Attention Heads
Zhengyan Zhang, Fanchao Qi, Zhiyuan Liu, Qun Liu, Maosong Sun
arXiv_CL
arXiv_CL
Transformer
Knowledge
Pose
Attention
Inference
PDF
-
Semi-Supervised Low-Resource Style Transfer of Indonesian Informal to Formal Language with Iterative Forward-Translation
Haryo Akbarianto Wibowo, Tatag Aziz Prawiro, Muhammad Ihsan, Alham Fikri Aji, Radityo Eko Prasojo, Rahmad Mahendra
arXiv_CL
arXiv_CL
Transformer
Style_Transfer
PDF
-
From Dataset Recycling to Multi-Property Extraction and Beyond
Tomasz Dwojak, Michał Pietruszka, Łukasz Borchmann, Jakub Chłędowski, Filip Graliński
arXiv_CL
arXiv_CL
Transformer
Pose
Action
PDF
-
Improving RNN Transducer Based ASR with Auxiliary Tasks
Chunxi Liu, Frank Zhang, Duc Le, Suyoun Kim, Yatharth Saraf, Geoffrey Zweig
arXiv_CL
arXiv_CL
Transformer
Recognition
RNN
Speech
Pose
Speech_Recognition
Prediction
PDF
-
Competence-Level Prediction and Resume & Job Description Matching Using Context-Aware Transformer Models
Changmao Li, Elaine Fisher, Rebecca Thomas, Steve Pittard, Vicki Hertzberg, Jinho D. Choi
arXiv_CL
arXiv_CL
Transformer
Classification
Attention
Prediction
Matching
PDF
-
Revisiting Stereo Depth Estimation From a Sequence-to-Sequence Perspective with Transformers
Zhaoshuo Li, Xingtong Liu, Francis X. Creighton, Russell H. Taylor, Mathias Unberath
arXiv_CV
arXiv_CV
Transformer
Pose
Attention
Matching
PDF
-
BW-EDA-EEND: Streaming End-to-End Neural Speaker Diarization for a Variable Number of Speakers
Eunjung Han, Chul Lee, Andreas Stolcke
arXiv_CL
arXiv_CL
Transformer
Pose
PDF
-
Lets Play Music: Audio-driven Performance Video Generation
Hao Zhu, Yi Li, Feixia Zhu, Aihua Zheng, Ran He
arXiv_CV
arXiv_CV
Transformer
Pose
PDF
-
Indic-Transformers: An Analysis of Transformer Language Models for Indian Languages
Kushal Jain, Adwait Deshpande, Kumar Shridhar, Felix Laumann, Ayushman Dash
arXiv_CL
arXiv_CL
Transformer
Text_Classification
Classification
Language_Model
PDF
-
Optimizing Transformer for Low-Resource Neural Machine Translation
Ali Araabi, Christof Monz
arXiv_CL
arXiv_CL
Transformer
PDF
-
Sound Natural: Content Rephrasing in Dialog Systems
Arash Einolghozati, Anchit Gupta, Keith Diedrick, Sonal Gupta
arXiv_CL
arXiv_CL
Transformer
RNN
Pose
Language_Model
PDF
-
Tabular Transformers for Modeling Multivariate Time Series
Inkit Padhi, Yair Schiff, Igor Melnyk, Mattia Rigotti, Youssef Mroueh, Pierre Dognin, Jerret Ross, Ravi Nair, Erik Altman
arXiv_AI
arXiv_AI
Transformer
Bert
Pose
Action
Deep_Learning
Detection
PDF
-
Learning Representations from Audio-Visual Spatial Alignment
Pedro Morgado, Yi Li, Nuno Vasconcelos
arXiv_CV
arXiv_CV
Transformer
Segmentation
Semantic_Segmentation
Recognition
Represenation_Learning
Self-Supervised
Pose
Action_Recognition
Action
PDF
-
Rotational Rectification Network: Enabling Pedestrian Detection for Mobile Vision
Xinshuo Weng, Shangxuan Wu, Fares Beainy, Kris Kitani
arXiv_CV
arXiv_CV
Transformer
Pose
Detection
Object_Detection
CNN
PDF
-
Joint Entity and Relation Extraction with Set Prediction Networks
Dianbo Sui, Yubo Chen, Kang Liu, Jun Zhao, Xiangrong Zeng, Shengping Liu
arXiv_CL
arXiv_CL
Transformer
Pose
Action
Relation
Relation_Extraction
Prediction
Matching
PDF
-
Improving RNN transducer with normalized jointer network
Mingkun Huang, Jun Zhang, Meng Cai, Yang Zhang, Jiali Yao, Yongbin You, Yi He, Zejun Ma
arXiv_SD
arXiv_SD
Transformer
Recognition
RNN
Speech
Pose
Speech_Recognition
Language_Model
PDF
-
BioNerFlair: biomedical named entity recognition using flair embedding and sequence tagger
Harsh Patel
arXiv_CL
arXiv_CL
Transformer
Embedding
Recognition
OCR
Bert
RNN
Action
Medical
PDF
-
The Devil is in the Details: Evaluating Limitations of Transformer-based Methods for Granular Tasks
Brihi Joshi, Neil Shah, Francesco Barbieri, Leonardo Neves
arXiv_CL
arXiv_CL
Transformer
Embedding
Pose
Sentiment
Language_Model
Matching
PDF
-
A Closer Look at Linguistic Knowledge in Masked Language Models: The Case of Relative Clauses in American English
Marius Mosbach, Stefania Degaetano-Ortlieb, Marie-Pauline Krielke, Badr M. Abdullah, Dietrich Klakow
arXiv_CL
arXiv_CL
Transformer
Bert
Knowledge
Language_Model
Prediction
PDF
-
How Far Does BERT Look At:Distance-based Clustering and Analysis of BERTś Attention
Yue Guan, Jingwen Leng, Chao Li, Quan Chen, Minyi Guo
arXiv_CL
arXiv_CL
Transformer
Unsupervised
Bert
Pose
Attention
PDF
-
Point Transformer
Nico Engel, Vasileios Belagiannis, Klaus Dietmayer
arXiv_CV
arXiv_CV
Transformer
Segmentation
Pose
Classification
Relation
Attention
PDF
-
Adapting Pretrained Transformer to Lattices for Spoken Language Understanding
Chao-Wei Huang, Yun-Nung Chen
arXiv_AI
arXiv_AI
Transformer
Segmentation
Recognition
Speech
Pose
Speech_Recognition
Language_Model
PDF
-
Multitask Learning and Joint Optimization for Transformer-RNN-Transducer Speech Recognition
Jae-Jin Jeon, Eesung Kim
arXiv_SD
arXiv_SD
Transformer
Recognition
Optimization
RNN
Speech
Pose
Speech_Recognition
Prediction
PDF
-
Dual-decoder Transformer for Joint Automatic Speech Recognition and Multilingual Speech Translation
Hang Le, Juan Pino, Changhan Wang, Jiatao Gu, Didier Schwab, Laurent Besacier
arXiv_CL
arXiv_CL
Transformer
Recognition
Speech
Pose
Attention
Speech_Recognition
PDF
-
Social Chemistry 101: Learning to Reason about Social and Moral Norms
Maxwell Forbes, Jena D. Hwang, Vered Shwartz, Maarten Sap, Yejin Choi
arXiv_AI
arXiv_AI
Transformer
Action
PDF
-
COOT: Cooperative Hierarchical Transformer for Video-Text Representation Learning
Simon Ging (1), Mohammadreza Zolfaghari (1), Hamed Pirsiavash (2), Thomas Brox (1) ((1) University of Freiburg, (2) University of Maryland Baltimore County)
arXiv_AI
arXiv_AI
Transformer
Represenation_Learning
Pose
Action
Attention
PDF
-
TransQuest: Translation Quality Estimation with Cross-lingual Transformers
Tharindu Ranasinghe, Constantin Orasan, Ruslan Mitkov
arXiv_AI
arXiv_AI
Transformer
Transfer_Learning
Pose
PDF
-
SMRT Chatbots: Improving Non-Task-Oriented Dialog with Simulated Multiple Reference Training
Huda Khayrallah, João Sedoc
arXiv_CL
arXiv_CL
Transformer
QA
PDF
-
Transformer-based Multi-Aspect Modeling for Multi-Aspect Multi-Sentiment Analysis
Zhen Wu, Chengcan Ying, Xinyu Dai, Shujian Huang, Jiajun Chen
arXiv_CL
arXiv_CL
Transformer
Bert
Pose
Relation
Sentiment
PDF
-
Investigation of BERT Model on Biomedical Relation Extraction Based on Revised Fine-tuning Mechanism
Peng Su, K. Vijay-Shanker
arXiv_CL
arXiv_CL
Transformer
Bert
Knowledge
Action
Classification
Relation
Relation_Extraction
Medical
PDF
-
Streaming Simultaneous Speech Translation with Augmented Memory Transformer
Xutai Ma, Yongqiang Wang, Mohammad Javad Dousti, Philipp Koehn, Juan Pino
arXiv_CL
arXiv_CL
Transformer
Recognition
Speech
Pose
Attention
Speech_Recognition
PDF
-
SLM: Learning a Discourse Language Representation with Sentence Unshuffling
Haejun Lee, Drew A. Hudson, Kangwook Lee, Christopher D. Manning
arXiv_CL
arXiv_CL
Transformer
Bert
Self-Supervised
Pose
Classification
Relation
Language_Model
PDF
-
Generating Radiology Reports via Memory-driven Transformer
Zhihong Chen, Yan Song, Tsung-Hui Chang, Xiang Wan
arXiv_CL
arXiv_CL
Transformer
Knowledge
Pose
Relation
Attention
Medical
PDF
-
VECO: Variable Encoder-decoder Pre-training for Cross-lingual Understanding and Generation
Fuli Luo, Wei Wang, Jiahao Liu, Yijia Liu, Bin Bi, Songfang Huang, Fei Huang, Luo Si
arXiv_CL
arXiv_CL
Transformer
Text_Classification
Classification
Relation
GAN
Inference
Language_Model
PDF
-
RuREBus: a Case Study of Joint Named Entity Recognition and Relation Extraction from e-Government Domain
Vitaly Ivanin, Ekaterina Artemova, Tatiana Batura, Vladimir Ivanov, Veronika Sarkisyan, Elena Tutubalina, Ivan Smurov
arXiv_CL
arXiv_CL
Transformer
Recognition
Action
Relation
Relation_Extraction
PDF
-
RussianSuperGLUE: A Russian Language Understanding Evaluation Benchmark
Tatiana Shavrina, Alena Fenogenova, Anton Emelyanov, Denis Shevelev, Ekaterina Artemova, Valentin Malykh, Vladislav Mikhailov, Maria Tikhonova, Andrey Chertok, Andrey Evlampiev
arXiv_AI
arXiv_AI
Transformer
Detection
GAN
Inference
Language_Model
PDF
-
Reducing Non-Normative Text Generation from Language Models
Xiangyu Peng, Siyan Li, Spencer Frazier, Mark Riedl
arXiv_CL
arXiv_CL
Transformer
Reinforcement_Learning
Text_Generation
Language_Model
PDF
-
RelationNet++: Bridging Visual Representations for Object Detection via Transformer Decoder
Cheng Chi, Fangyun Wei, Han Hu
arXiv_CV
arXiv_CV
Transformer
Embedding
Pose
Action
Classification
Detection
Relation
Object_Detection
Attention
PDF
-
T-vectors: Weakly Supervised Speaker Identification Using Hierarchical Transformer Model
Yanpei Shi, Mingjie Chen, Qiang Huang, Thomas Hain
arXiv_CL
arXiv_CL
Transformer
Weakly_Supervised
Pose
Attention
PDF
-
Memory Attentive Fusion: External Language Model Integration for Transformer-based Sequence-to-Sequence Model
Mana Ihori, Ryo Masumura, Naoki Makishima, Tomohiro Tanaka, Akihiko Takashima, Shota Orihashi
arXiv_CL
arXiv_CL
Transformer
Knowledge
Pose
Attention
Language_Model
PDF
-
Tilde at WMT 2020: News Task Systems
Rihards Krišlauks, Mārcis Pinnis
arXiv_CL
arXiv_CL
Transformer
PDF
-
Multiple Sclerosis Severity Classification From Clinical Text
Alister D Costa, Stefan Denkovski, Michal Malyska, Sae Young Moon, Brandon Rufino, Zhen Yang, Taylor Killian, Marzyeh Ghassemi
arXiv_CL
arXiv_CL
Transformer
Embedding
Bert
Knowledge
Classification
Language_Model
Prediction
PDF
-
Graph-based Topic Extraction from Vector Embeddings of Text Documents: Application to a Corpus of News Articles
M. Tarik Altuncu, Sophia N. Yaliraki, Mauricio Barahona
arXiv_AI
arXiv_AI
Transformer
Embedding
Unsupervised
Bert
Action
PDF
-
Non-Autoregressive Transformer ASR with CTC-Enhanced Decoder Input
Xingchen Song, Zhiyong Wu, Yiheng Huang, Chao Weng, Dan Su, Helen Meng
arXiv_CL
arXiv_CL
Transformer
Recognition
Speech
Pose
Speech_Recognition
Inference
Prediction
PDF
-
The Volctrans Machine Translation System for WMT20
Liwei Wu, Xiao Pan, Zehui Lin, Yaoming Zhu, Mingxuan Wang, Lei Li
arXiv_CL
arXiv_CL
Transformer
PDF
-
Decoupling Pronunciation and Language for End-to-end Code-switching Automatic Speech Recognition
Shuai Zhang, Jiangyan Yi, Zhengkun Tian, Ye Bai, Jianhua Tao, Zhengqi wen
arXiv_CL
arXiv_CL
Transformer
Recognition
Speech
Pose
Attention
Speech_Recognition
PDF
-
CASS-NAT: CTC Alignment-based Single Step Non-autoregressive Transformer for Speech Recognition
Ruchao Fan, Wei Chu, Peng Chang, Jing Xiao
arXiv_CL
arXiv_CL
Transformer
Embedding
Recognition
Speech
Pose
Speech_Recognition
Inference
PDF
-
Scaling Laws for Autoregressive Generative Modeling
Tom Henighan, Jared Kaplan, Mor Katz, Mark Chen, Christopher Hesse, Jacob Jackson, Heewoo Jun, Tom B. Brown, Prafulla Dhariwal, Scott Gray, Chris Hallacy, Benjamin Mann, Alec Radford, Aditya Ramesh, Nick Ryder, Daniel M. Ziegler, John Schulman, Dario Amodei, Sam McCandlish
arXiv_CV
arXiv_CV
Transformer
Classification
Relation
Caption
Prediction
PDF
-
Transformer in action: a comparative study of transformer-based acoustic models for large scale speech recognition applications
Yongqiang Wang, Yangyang Shi, Frank Zhang, Chunyang Wu, Julian Chan, Ching-Feng Yeh, Alex Xiao
arXiv_CL
arXiv_CL
Transformer
Recognition
Video_Caption
RNN
Speech
Action
Speech_Recognition
Caption
Inference
PDF
-
Language ID in the Wild: Unexpected Challenges on the Path to a Thousand-Language Web Text Corpus
Isaac Caswell, Theresa Breiner, Daan van Esch, Ankur Bapna
arXiv_CL
arXiv_CL
Transformer
Pose
PDF
-
Fast Interleaved Bidirectional Sequence Generation
Biao Zhang, Ivan Titov, Rico Sennrich
arXiv_CL
arXiv_CL
Transformer
Attention
Summarization
Inference
PDF
-
Co-attentional Transformers for Story-Based Video Understanding
Björn Bebensee, Byoung-Tak Zhang
arXiv_AI
arXiv_AI
Transformer
Video_Caption
Pose
Action
Attention
QA
PDF
-
MMFT-BERT: Multimodal Fusion Transformer with BERT Encodings for Visual Question Answering
Aisha Urooj Khan, Amir Mazaheri, Niels da Vitoria Lobo, Mubarak Shah
arXiv_CV
arXiv_CV
Transformer
Bert
Knowledge
Pose
VQA
QA
PDF
-
To BERT or Not to BERT: Comparing Task-specific and Task-agnostic Semi-Supervised Approaches for Sequence Tagging
Kasturi Bhattacharjee, Miguel Ballesteros, Rishita Anubhai, Smaranda Muresan, Jie Ma, Faisal Ladhak, Yaser Al-Onaizan
arXiv_CL
arXiv_CL
Transformer
Bert
PDF
-
Recent Developments on ESPnet Toolkit Boosted by Conformer
Pengcheng Guo, Florian Boyer, Xuankai Chang, Tomoki Hayashi, Yosuke Higuchi, Hirofumi Inaguma, Naoyuki Kamo, Chenda Li, Daniel Garcia-Romero, Jiatong Shi, Jing Shi, Shinji Watanabe, Kun Wei, Wangyou Zhang, Yuekai Zhang
arXiv_SD
arXiv_SD
Transformer
Recognition
Speech
Pose
Speech_Recognition
PDF
-
Controlled Molecule Generator for Optimizing Multiple Chemical Properties
Bonggun Shin, Sungsoo Park, JinYeong Bak, Joyce C. Ho
arXiv_AI
arXiv_AI
Transformer
Optimization
Pose
Prediction
PDF
-
Peak Detection On Data Independent Acquisition Mass Spectrometry Data With Semisupervised Convolutional Transformers
Leon L. Xu, Hannes L. Röst
arXiv_CV
arXiv_CV
Transformer
Segmentation
Pose
Quantitative
Classification
Detection
Attention
CNN
Image_Classification
PDF
-
PowerTransformer: Unsupervised Controllable Revision for Biased Language Correction
Xinyao Ma, Maarten Sap, Hannah Rashkin, Yejin Choi
arXiv_AI
arXiv_AI
Transformer
Reconstruction
Unsupervised
Knowledge
Language_Model
PDF
-
Dutch Humor Detection by Generating Negative Examples
Thomas Winters, Pieter Delobelle
arXiv_AI
arXiv_AI
Transformer
Recognition
Bert
Pose
Classification
Detection
Text_Generation
Language_Model
PDF
-
UPB at SemEval-2020 Task 12: Multilingual Offensive Language Detection on Social Media by Fine-tuning a Variety of BERT-based Models
Mircea-Adrian Tanase, Dumitru-Clementin Cercel, Costing-Gabriel Chiru
arXiv_CL
arXiv_CL
Transformer