VQA

2021-05-16 Survey of Visual-Semantic Embedding Methods for Zero-Shot Image Retrieval Kazuya Ueki arXiv_CV arXiv_CV Image_Caption Embedding Zero-Shot Image_Retrieval Survey VQA Caption QA Matching PDF
2021-05-15 Show Why the Answer is Correct! Towards Explainable AI using Compositional Temporal Attention Nihar Bendre, Kevin Desai, Peyman Najafirad arXiv_CV arXiv_CV Pose Deep_Learning VQA Attention Autonomous QA PDF
2021-05-12 TextOCR: Towards large-scale end-to-end reasoning for arbitrary-shaped scene text Amanpreet Singh, Guan Pang, Mandy Toh, Jing Huang, Wojciech Galuba, Tal Hassner arXiv_CV arXiv_CV Recognition OCR Optical_Character Pose Scene_Text Detection VQA QA PDF
2021-05-11 GANs for Medical Image Synthesis: An Empirical Study Youssef Skandarani, Pierre-Marc Jodoin, Alain Lalande arXiv_CV arXiv_CV Segmentation Adversarial VQA GAN Medical PDF
2021-05-11 Reinforcement Learning from Reformulations in Conversational Question Answering over Knowledge Graphs Magdalena Kaiser, Rishiraj Saha Roy, Gerhard Weikum arXiv_CL arXiv_CL Reinforcement_Learning Knowledge Knowledge_Graph Action VQA QA PDF
2021-05-11 Found a Reason for me? Weakly-supervised Grounded Visual Question Answering using Capsules Aisha Urooj Khan, Hilde Kuehne, Kevin Duarte, Chuang Gan, Niels Lobo, Mubarak Shah arXiv_CV arXiv_CV Weakly_Supervised Pose Detection VQA Object_Detection Attention QA PDF
2021-05-11 Cross-Modal Generative Augmentation for Visual Question Answering Zixu Wang, Yishu Miao, Lucia Specia arXiv_CV arXiv_CV Pose Relation VQA PDF
2021-05-05 Proposal-free One-stage Referring Expression via Grid-Word Cross-Attention Wei Suo, Mengyang Sun, Peng Wang, Qi Wu arXiv_CV arXiv_CV Transformer VQA Attention PDF
2021-05-05 AdaVQA: Overcoming Language Priors with Adapted Margin Cosine Loss Yangyang Guo, Liqiang Nie, Zhiyong Cheng, Feng Ji, Ji Zhang, Alberto Del Bimbo arXiv_CV arXiv_CV Sparse Classification VQA Prediction QA PDF
2021-05-02 A survey on VQA_Datasets and Approaches Yeyun Zou, Qiyu Xie arXiv_AI arXiv_AI Review Pose Survey VQA QA PDF
2021-04-30 Chop Chop BERT: Visual Question Answering by Chopping VisualBERT's Heads Chenyu Gao, Qi Zhu, Peng Wang, Qi Wu arXiv_CV arXiv_CV Transformer Bert VQA Attention QA PDF
2021-04-29 Optimal training of variational quantum algorithms without barren plateaus Tobias Haug, M.S. Kim arXiv_CV arXiv_CV Optimization Pose VQA QA PDF
2021-04-29 A First Look: Towards Explainable TextVQA Models via Visual and Textual Explanations Varun Nagaraj Rao, Xingjian Zhen, Karen Hovsepian, Mingwei Shen arXiv_AI arXiv_AI Pose Quantitative Deep_Learning VQA Prediction QA PDF
2021-04-26 MDETR -- Modulated Detection for End-to-End Multi-Modal Understanding Aishwarya Kamath, Mannat Singh, Yann LeCun, Ishan Misra, Gabriel Synnaeve, Nicolas Carion arXiv_CV arXiv_CV Transformer Segmentation Pose Detection VQA Few-Shot Object_Detection Caption QA PDF
2021-04-26 InfographicVQA Minesh Mathew, Viraj Bagal, Rubèn Pérez Tito, Dimosthenis Karatzas, Ernest Valveny, C.V Jawahar arXiv_CV arXiv_CV VQA QA PDF
2021-04-24 RelTransformer: Balancing the Visual Relationship Detection from Local Context, Scene and Memory Jun Chen, Aniket Agarwal, Sherif Abdelkarim, Deyao Zhu, Mohamed Elhoseiny arXiv_AI arXiv_AI Image_Caption Transformer Recognition Pose Detection Relation VQA Visual_Relation Caption Prediction QA PDF
2021-04-23 Playing Lottery Tickets with Vision and Language Zhe Gan, Yen-Chun Chen, Linjie Li, Tianlong Chen, Yu Cheng, Shuohang Wang, Jingjing Liu arXiv_CV arXiv_CV Transformer Bert Adversarial VQA QA Matching PDF
2021-04-20 GraghVQA: Language-Guided Graph Neural Networks for Graph-based Visual Question Answering Weixin Liang, Yanhao Jiang, Zixuan Liu arXiv_CV arXiv_CV Pose Relation VQA QA PDF
2021-04-20 An efficient measure for the expressivity of variational quantum algorithms Yuxuan Du, Zhuozhuo Tu, Xiao Yuan, Dacheng Tao arXiv_CV arXiv_CV Quantitative VQA QA PDF
2021-04-16 Cross-Modal Retrieval Augmentation for Multi-Modal Classification Shir Gur, Natalia Neverova, Chris Stauffer, Ser-Nam Lim, Douwe Kiela, Austin Reiter arXiv_CV arXiv_CV Image_Caption Transformer Embedding Knowledge Classification VQA Caption Inference QA PDF
2021-04-16 VGNMN: Video-grounded Neural Module Network to Video-Grounded Language Tasks Hung Le, Nancy F. Chen, Steven C.H. Hoi arXiv_AI arXiv_AI Pose Action VQA QA PDF
2021-04-14 Jointly Learning Truth-Conditional Denotations and Groundings using Parallel Attention Leon Bergen, Dzmitry Bahdanau, Timothy J. O'Donnell arXiv_CL arXiv_CL VQA Attention PDF
2021-04-13 Neuro-Symbolic VQA: A review from the perspective of AGI desiderata Ian Berlot-Attwell arXiv_CV arXiv_CV Review VQA QA PDF
2021-04-13 CLEVR_HYP: A Challenge Dataset and Baselines for Visual Question Answering with Hypothetical Actions over Images Shailaja Keyur Sampat, Akshay Kumar, Yezhou Yang, Chitta Baral arXiv_CV arXiv_CV Pose Action VQA Language_Model QA PDF
2021-04-13 Dealing with Missing Modalities in the Visual Question Answer-Difference Prediction Task through Knowledge Distillation Jae Won Cho, Dong-Jin Kim, Jinsoo Choi, Yunjae Jung, In So Kweon arXiv_CV arXiv_CV Knowledge VQA Prediction QA PDF
2021-04-08 How Transferable are Reasoning Patterns in VQA? Corentin Kervadec, Theo Jaunet, Grigory Antipov, Moez Baccouche, Romain Vuillemot, Christian Wolf arXiv_CV arXiv_CV Transformer Pose VQA Attention QA PDF
2021-04-07 Beyond Question-Based Biases: Assessing Multimodal Shortcut Learning in Visual Question Answering Corentin Dancette, Remi Cadene, Damien Teney, Matthieu Cord arXiv_AI arXiv_AI Face VQA QA PDF
2021-04-07 Multimodal Continuous Visual Attention Mechanisms António Farinhas, André F. T. Martins, Pedro M. Q. Aguiar arXiv_CV arXiv_CV Pose VQA Attention QA PDF
2021-04-05 Compressing Visual-linguistic Model via Knowledge Distillation Zhiyuan Fang, Jianfeng Wang, Xiaowei Hu, Lijuan Wang, Yezhou Yang, Zicheng Liu arXiv_AI arXiv_AI Image_Caption Transformer Knowledge Pose Detection VQA Object_Detection Attention Caption QA PDF
2021-04-03 MMBERT: Multimodal BERT Pretraining for Improved Medical VQA Yash Khare, Viraj Bagal, Minesh Mathew, Adithi Devi, U Deva Priyakumar, CV Jawahar arXiv_CV arXiv_CV Transformer Bert Self-Supervised Pose VQA Attention Medical Caption Language_Model QA PDF
2021-04-02 VisQA: X-raying Vision and Language Reasoning in Transformers Theo Jaunet, Corentin Kervadec, Romain Vuillemot, Grigory Antipov, Moez Baccouche, Christian Wolf arXiv_CV arXiv_CV Transformer Pose Deep_Learning VQA Attention Prediction QA PDF
2021-04-01 UC2: Universal Cross-lingual Cross-modal Vision-and-Language Pre-training Mingyang Zhou, Luowei Zhou, Shuohang Wang, Yu Cheng, Linjie Li, Zhou Yu, Jingjing Liu arXiv_CV arXiv_CV Embedding Represenation_Learning Pose VQA Caption Language_Model Matching PDF
2021-04-01 An Investigation of Critical Issues in Bias Mitigation Techniques Robik Shrestha, Kushal Kafle, Christopher Kanan arXiv_AI arXiv_AI Knowledge Deep_Learning VQA QA PDF
2021-03-31 Analysis on Image Set Visual Question Answering Abhinav Khattar, Aviral Joshi, Har Simrat Singh, Pulkit Goel, Rohit Prakash Barnwal arXiv_CV arXiv_CV Bert Regularization Adversarial VQA QA PDF
2021-03-31 Classically optimal variational quantum algorithms Jonathan Wurtz, Peter Love arXiv_CV arXiv_CV Optimization Pose VQA QA PDF
2021-03-29 Domain-robust VQA with diverse datasets and methods but no target labels Mingda Zhang, Tristan Maidment, Ahmad Diab, Adriana Kovashka, Rebecca Hwa arXiv_CV arXiv_CV Transformer Unsupervised Recognition Optimization Classification VQA QA PDF
2021-03-29 Variational quantum algorithms to estimate rank, quantum entropies, fidelity and Fisher information via purity minimization Kok Chuan Tan, Tyler Volkoff arXiv_CV arXiv_CV Pose Action VQA QA PDF
2021-03-29 Generic Attention-model Explainability for Interpreting Bi-Modal and Encoder-Decoder Transformers Hila Chefer, Shir Gur, Lior Wolf arXiv_CV arXiv_CV Transformer Segmentation Pose Detection VQA Object_Detection Attention Prediction PDF
2021-03-28 Quantum agents in the Gym: a variational quantum algorithm for deep Q-learning Andrea Skolik, Sofiene Jerbi, Vedran Dunjko arXiv_CV arXiv_CV Unsupervised Reinforcement_Learning Optimization VQA QA PDF
2021-03-28 'Just because you are right, doesn't mean I am wrong': Overcoming a Bottleneck in the Development and Evaluation of Open-Ended Visual Question Answering Tasks Man Luo, Shailaja Keyur Sampat, Riley Tallman, Yankai Zeng, Manuha Vancha, Akarshan Sajja, Chitta Baral arXiv_CL arXiv_CL Pose VQA Language_Model QA PDF
2021-03-28 Encoding strongly-correlated many-boson wavefunctions on a photonic quantum computer: application to the attractive Bose-Hubbard model Saad Yalouz, Bruno Senjean, Vedran Dunjko arXiv_CV arXiv_CV Pose VQA QA PDF
2021-03-26 Knowing What VQA Does Not: Pointing to Error-Inducing Regions to Improve Explanation Helpfulness Arijit Ray, Michael Cogswell, Xiao Lin, Kamran Alipour, Ajay Divakaran, Yi Yao, Giedrius Burachas arXiv_CV arXiv_CV Pose VQA Attention QA PDF
2021-03-26 On the hidden treasure of dialog in video question answering Deniz Engin, Yannis Avrithis, Ngoc Q. K. Duong, François Schnitzler arXiv_CV arXiv_CV Transformer Video_Caption Knowledge VQA Attention Summarization QA PDF
2021-03-25 Visual Grounding Strategies for Text-Only Natural Language Processing Damien Sileo arXiv_CL arXiv_CL Bert Image_Retrieval Pose Classification VQA Language_Model PDF
2021-03-24 Structured Co-reference Graph Attention for Video-grounded Dialogue Junyeong Kim, Sunjae Yoon, Dahyun Kim, Chang D. Yoo arXiv_CV arXiv_CV Pose VQA Attention QA PDF
2021-03-23 Multi-Modal Answer Validation for Knowledge-Based VQA Jialin Wu, Jiasen Lu, Ashish Sabharwal, Roozbeh Mottaghi arXiv_CV arXiv_CV Knowledge Pose VQA QA PDF
2021-03-22 How to Design Sample and Computationally Efficient VQA Models Karan Samel, Zelin Zhao, Binghong Chen, Kuan Wang, Robin Luo, Le Song arXiv_CV arXiv_CV Pose VQA QA PDF
2021-03-17 Automatic Generation of Contrast Sets from Scene Graphs: Probing the Compositional Consistency of GQA Yonatan Bitton, Gabriel Stanovsky, Roy Schwartz, Michael Elhadad arXiv_CV arXiv_CV Image_Caption Relation VQA QA PDF
2021-03-17 Scene Graphs: A Survey of Generations and Applications Xiaojun Chang, Pengzhen Ren, Pengfei Xu, Zhihui Li, Xiaojiang Chen, Alex Hauptmann arXiv_CV arXiv_CV Image_Caption Knowledge Survey Detection Relation VQA Attention Visual_Relation Caption QA PDF
2021-03-16 Variational Quantum Algorithms for Euclidean Discrepancy and Covariate-Balancing Jiří Lebl, Asif Shakeel arXiv_CV arXiv_CV Optimization VQA QA PDF
2021-03-13 VMAF And Variants: Towards A Unified VQA Pankaj Topiwala, Wei Dai, Jiangfeng Pian arXiv_CV arXiv_CV VQA QA PDF
2021-03-11 Neural Predictor based Quantum Architecture Search Shi-Xin Zhang, Chang-Yu Hsieh, Shengyu Zhang, Hong Yao arXiv_CV arXiv_CV NAS Pose Deep_Learning VQA QA PDF
2021-03-10 RL-CSDia: Representation Learning of Computer Science Diagrams Shaowei Wang, LingLing Zhang, Xuan Luo, Yi Yang, Xin Hu, Jun Liu arXiv_AI arXiv_AI Represenation_Learning Knowledge Pose Classification Relation VQA PDF
2021-03-09 Select, Substitute, Search: A New Benchmark for Knowledge-Augmented Visual Question Answering Aman Jain, Mayank Kothyari, Vishwajeet Kumar, Preethi Jyothi, Ganesh Ramakrishnan, Soumen Chakrabarti arXiv_CV arXiv_CV OCR Knowledge Knowledge_Graph Action Quantitative VQA QA PDF
2021-03-06 Contextual Dropout: An Efficient Sample-Dependent Dropout Module Xinjie Fan, Shujian Zhang, Korawat Tanwisuth, Xiaoning Qian, Mingyuan Zhou arXiv_CV arXiv_CV Pose Classification VQA Image_Classification Prediction QA PDF
2021-03-04 Visual Question Answering: which investigated applications? Silvio Barra, Carmen Bisogni, Maria De Marsico, Stefano Ricciardi arXiv_CV arXiv_CV Image_Caption Pose Survey VQA Summarization Caption QA PDF
2021-03-03 Weakly-Supervised Open-Retrieval Conversational Question Answering Chen Qu, Liu Yang, Cen Chen, W. Bruce Croft, Kalpesh Krishna, Mohit Iyyer arXiv_CL arXiv_CL VQA QA PDF
2021-03-01 Learning Reasoning Paths over Semantic Graphs for Video-grounded Dialogues Hung Le, Nancy F. Chen, Steven C.H. Hoi arXiv_AI arXiv_AI Pose VQA Prediction PDF
2021-02-21 Learning Compositional Representation for Few-shot Visual Question Answering Dalu Guo, Dacheng Tao arXiv_CV arXiv_CV Pose Deep_Learning VQA Few-Shot GAN QA PDF
2021-02-18 Going Full-TILT Boogie on Document Understanding with Text-Image-Layout Transformer Rafał Powalski, Łukasz Borchmann, Dawid Jurkiewicz, Tomasz Dwojak, Michał Pietruszka, Gabriela Pałka arXiv_CL arXiv_CL Transformer VQA Attention QA PDF
2021-02-18 SLAKE: A Semantically-Labeled Knowledge-Enhanced Dataset for Medical Visual Question Answering Bo Liu, Li-Ming Zhan, Li Xu, Lin Ma, Yan Yang, Xiao-Ming Wu arXiv_AI arXiv_AI Knowledge VQA Medical QA PDF
2021-02-17 Conceptual 12M: Pushing Web-Scale Image-Text Pre-Training To Recognize Long-Tail Visual Concepts Soravit Changpinyo, Piyush Sharma, Nan Ding, Radu Soricut arXiv_CV arXiv_CV Image_Caption Recognition Quantitative VQA Caption PDF
2021-02-17 Enhanced Magnetic Resonance Image Synthesis with Contrast-Aware Generative Adversarial Networks Jonas Denck, Jens Guehring, Andreas Maier, Eva Rothgang arXiv_CV arXiv_CV Review Adversarial Deep_Learning VQA GAN PDF
2021-02-04 Unifying Vision-and-Language Tasks via Text Generation Jaemin Cho, Jie Lei, Hao Tan, Mohit Bansal arXiv_AI arXiv_AI Image_Caption Pose VQA Text_Generation Caption Language_Model PDF
2021-02-03 Answer Questions with Right Image Regions: A Visual Attention Regularization Approach Yibing Liu, Yangyang Guo, Jianhua Yin, Xuemeng Song, Weifeng Liu, Liqiang Nie arXiv_CV arXiv_CV Regularization Pose VQA Attention Prediction QA PDF
2021-01-31 An Empirical Study on the Generalization Power of Neural Representations Learned via Visual Guessing Games Alessandro Suglia, Yonatan Bisk, Ioannis Konstas, Antonio Vergari, Emanuele Bastianelli, Andrea Vanzo, Oliver Lemon arXiv_CV arXiv_CV Pose VQA QA PDF
2021-01-30 A Quantum Interpretation of Bunched Logic for Quantum Separation Logic Li Zhou, Gilles Barthe, Justin Hsu, Mingsheng Ying, Nengkun Yu arXiv_CV arXiv_CV Pose VQA QA PDF
2021-01-27 VisualMRC: Machine Reading Comprehension on Document Images Ryota Tanaka, Kyosuke Nishida, Sen Yoshida arXiv_CV arXiv_CV VQA QA PDF
2021-01-25 Unanswerable Questions about Images and Texts Ernest Davis arXiv_AI arXiv_AI VQA QA PDF
2021-01-22 Visual Question Answering based on Local-Scene-Aware Referring Expression Generation Jung-Jun Kim, Dong-Gyu Lee, Jialin Wu, Hong-Gyu Jung, Seong-Whan Lee arXiv_CV arXiv_CV Embedding Pose Quantitative Relation VQA Attention Prediction QA PDF
2021-01-18 Training variational quantum algorithms is NP-hard -- even for logarithmically many qubits and free fermionic systems Lennart Bittel, Martin Kliesch arXiv_CV arXiv_CV Optimization Pose VQA QA PDF
2021-01-17 Understanding in Artificial Intelligence Stefan Maetschke, David Martinez Iraola, Pieter Barnard, Elaheh ShafieiBavani, Peter Zhong, Ying Xu, Antonio Jimeno Yepes arXiv_AI arXiv_AI Review Deep_Learning VQA PDF
2021-01-16 Latent Variable Models for Visual Question Answering Zixu Wang, Yishu Miao, Lucia Specia arXiv_AI arXiv_AI Pose VQA Attention Caption Inference QA PDF
2021-01-15 Reasoning over Vision and Language: Exploring the Benefits of Supplemental Knowledge Violetta Shevchenko, Damien Teney, Anthony Dick, Anton van den Hengel arXiv_CV arXiv_CV Transformer Embedding Knowledge Pose Relation VQA Language_Model QA Matching PDF
2021-01-15 Recent Advances in Video Question Answering: A Review of Datasets and Methods Devshree Patel, Ratnam Parikh, Yesha Shastri arXiv_CV arXiv_CV Video_Caption Knowledge Review Survey VQA Caption QA PDF
2021-01-14 Understanding the Role of Scene Graphs in Visual Question Answering Vinay Damodaran, Sharanya Chakravarthy, Akshay Kumar, Anjana Umapathy, Teruko Mitamura, Yuta Nakashima, Noa Garcia, Chenhui Chu arXiv_CV arXiv_CV Image_Caption Pose Face VQA QA PDF
2021-01-12 Predicting Relative Depth between Objects from Semantic Features Stefan Cassar, Adrian Muscat, Dylan Seychell arXiv_AI arXiv_AI Recognition 3D Classification Detection Relation VQA Visual_Relation PDF
2021-01-05 End-to-End Video Question-Answer Generation with Generator-Pretester Network Hung-Ting Su, Chen-Hsi Chang, Po-Wei Shen, Yu-Siang Wang, Ya-Liang Chang, Yu-Cheng Chang, Pu-Jen Cheng, Winston H. Hsu arXiv_CV arXiv_CV Transfer_Learning Pose VQA Caption QA PDF
2020-12-31 Seeing is Knowing! Fact-based Visual Question Answering using Knowledge Graph Embeddings Kiran Ramnath, Mark Hasegawa-Johnson arXiv_CL arXiv_CL Image_Caption Embedding Knowledge Knowledge_Graph Pose VQA Attention Inference QA PDF
2020-12-29 Detecting Hate Speech in Multi-modal Memes Abhishek Das, Japsimar Singh Wahi, Siyao Li arXiv_CV arXiv_CV Image_Caption Speech Pose Face Classification Detection Sentiment VQA Object_Detection Caption Prediction PDF
2020-12-29 LayoutLMv2: Multi-modal Pre-training for Visually-Rich Document Understanding Yang Xu, Yiheng Xu, Tengchao Lv, Lei Cui, Furu Wei, Guoxin Wang, Yijuan Lu, Dinei Florencio, Cha Zhang, Wanxiang Che, Min Zhang, Lidong Zhou arXiv_CL arXiv_CL Transformer Action Relation VQA Attention Language_Model QA Matching PDF
2020-12-21 Object-Centric Diagnosis of Visual Reasoning Jianwei Yang, Jiayuan Mao, Jiajun Wu, Devi Parikh, David D. Cox, Joshua B. Tenenbaum, Chuang Gan arXiv_AI arXiv_AI Image_Caption Relation VQA Attention QA PDF
2020-12-21 Learning content and context with language bias for Visual Question Answering Chao Yang, Su Feng, Dongsheng Li, Huawei Shen, Guoqing Wang, Bin Jiang arXiv_CV arXiv_CV Pose VQA QA PDF
2020-12-20 KRISP: Integrating Implicit and Symbolic Knowledge for Open-Domain Knowledge-Based VQA Kenneth Marino, Xinlei Chen, Devi Parikh, Abhinav Gupta, Marcus Rohrbach arXiv_CV arXiv_CV Transformer Embedding Unsupervised Knowledge Knowledge_Graph VQA Prediction QA PDF
2020-12-18 Trying Bilinear Pooling in Video-QA Thomas Winterbottom, Sarah Xiao, Alistair McLean, Noura Al Moubayed arXiv_CV arXiv_CV Pose Action VQA Attention QA PDF
2020-12-18 On Modality Bias in the TVQA Dataset Thomas Winterbottom, Sarah Xiao, Alistair McLean, Noura Al Moubayed arXiv_AI arXiv_AI Embedding Bert Pose VQA QA PDF
2020-12-17 Overcoming Language Priors with Self-supervised Learning for Visual Question Answering Xi Zhu, Zhendong Mao, Chunxiao Liu, Peng Zhang, Bin Wang, Yongdong Zhang arXiv_CV arXiv_CV Self-Supervised Pose VQA QA PDF
2020-12-16 Variational Quantum Algorithms M. Cerezo, Andrew Arrasmith, Ryan Babbush, Simon C. Benjamin, Suguru Endo, Keisuke Fujii, Jarrod R. McClean, Kosuke Mitarai, Xiao Yuan, Lukasz Cincio, Patrick J. Coles arXiv_CV arXiv_CV Review Pose VQA QA PDF
2020-12-14 Knowledge-Routed Visual Question Reasoning: Challenges for Deep Representation Embedding Qingxing Cao, Bailin Li, Xiaodan Liang, Keze Wang, Liang Lin arXiv_CV arXiv_CV Embedding Knowledge Pose Relation VQA QA PDF
2020-12-13 Variational Quantum algorithm for Poisson equation Hailing Liu, Yusen Wu, Linchun Wan, Shijie Pan, Sujuan Qin, Fei Gao, Qiaoyan Wen arXiv_CV arXiv_CV Pose VQA QA PDF
2020-12-09 Simple is not Easy: A Simple Strong Baseline for TextVQA and TextCaps Qi Zhu, Chenyu Gao, Peng Wang, Qi Wu arXiv_CV arXiv_CV Image_Caption Transformer Recognition OCR Optical_Character VQA Attention Caption QA PDF
2020-12-08 TAP: Text-Aware Pre-training for Text-VQA and Text-Caption Zhengyuan Yang, Yijuan Lu, Jianfeng Wang, Xi Yin, Dinei Florencio, Lijuan Wang, Cha Zhang, Lei Zhang, Jiebo Luo arXiv_CV arXiv_CV Image_Caption OCR Represenation_Learning Pose Scene_Text Relation VQA Caption Language_Model Prediction QA Matching PDF
2020-12-08 Study on the Assessment of the Quality of Experience of Streaming Video Aleksandr Ivchenko, Pavel Kononyuk, Alexander Dvorkovich, Liubov Antiufrieva arXiv_CV arXiv_CV Pose Relation VQA QA PDF
2020-12-08 CRAFT: A Benchmark for Causal Reasoning About Forces and inTeractions Tayfun Ates, Muhammed Samil Atesoglu, Cagatay Yigit, Ilker Kesen, Mert Kobas, Erkut Erdem, Aykut Erdem, Tilbe Goksun, Deniz Yuret arXiv_AI arXiv_AI Action Deep_Learning VQA PDF
2020-12-05 FloodNet: A High Resolution Aerial Imagery Dataset for Post Flood Scene Understanding Maryam Rahnemoonfar, Tashnim Chowdhury, Argho Sarkar, Debvrat Varshney, Masoud Yari, Robin Murphy arXiv_CV arXiv_CV Segmentation Semantic_Segmentation Pose Classification Deep_Learning Detection VQA Object_Detection Image_Classification PDF
2020-12-04 Self-Supervised VQA: Answering Visual Questions using Images and Captions Pratyay Banerjee, Tejas Gokhale, Yezhou Yang, Chitta Baral arXiv_CV arXiv_CV Self-Supervised Pose Detection VQA Object_Detection Caption QA PDF
2020-12-04 Understanding Guided Image Captioning Performance across Domains Edwin G. Ng, Bo Pang, Piyush Sharma, Radu Soricut arXiv_CV arXiv_CV Image_Caption Transformer VQA Caption QA PDF
2020-12-01 Open-Ended Multi-Modal Relational Reason for Video Question Answering Haozheng Luo, Ruiyang Qin arXiv_AI arXiv_AI Action Relation VQA QA PDF
2020-12-01 Just Ask: Learning to Answer Questions from Millions of Narrated Videos Antoine Yang, Antoine Miech, Josef Sivic, Ivan Laptev, Cordelia Schmid arXiv_CV arXiv_CV Transformer Embedding Zero-Shot Pose VQA Activity QA PDF
2020-11-27 Point and Ask: Incorporating Pointing into Visual Question Answering Arjun Mani, Will Hinthorn, Nobline Yoo, Olga Russakovsky arXiv_CV arXiv_CV Recognition Gesture VQA QA PDF
2020-11-27 Patch-VQ: 'Patching Up' the Video Quality Problem Zhenqiang Ying (1), Maniratnam Mandal (1), Deepti Ghadiyaram (2), Alan Bovik (1) ((1) University of Texas at Austin, (2) Facebook AI) arXiv_CV arXiv_CV Review VQA Prediction QA PDF
2020-11-26 Learning from Lexical Perturbations for Consistent Visual Question Answering Spencer Whitehead, Hui Wu, Yi Ren Fung, Heng Ji, Rogerio Feris, Kate Saenko arXiv_CV arXiv_CV Regularization Pose VQA QA PDF
2020-11-26 Transformation Driven Visual Reasoning Xin Hong, Yanyan Lan, Liang Pang, Jiafeng Guo, Xueqi Cheng arXiv_AI arXiv_AI Pose Relation VQA QA PDF
2020-11-23 Large Scale Multimodal Classification Using an Ensemble of Transformer Models and Co-Attention Varnith Chordia, Vijay Kumar BG arXiv_AI arXiv_AI Transformer Embedding Classification Relation VQA Attention QA Recommendation PDF
2020-11-23 Siamese Tracking with Lingual Object Constraints Maximilian Filtenborg, Efstratios Gavves, Deepak Gupta arXiv_CV arXiv_CV Surveillance Tracking Object_Tracking Pose VQA Summarization PDF
2020-11-21 LRTA: A Transparent Neural-Symbolic Reasoning Framework with Modular Supervision for Visual Question Answering Weixin Liang, Feiyang Niu, Aishwarya Reganti, Govind Thattai, Gokhan Tur arXiv_AI arXiv_AI Pose Quantitative Relation VQA Prediction QA PDF
2020-11-19 Logically Consistent Loss for Visual Question Answering Anh-Cat Le-Ngo, Truyen Tran, Santu Rana, Sunil Gupta, Svetha Venkatesh arXiv_AI arXiv_AI Knowledge Pose VQA GAN QA PDF
2020-11-17 Generating Natural Questions from Images for Multimodal Assistants Alkesh Patel, Akanksha Bindal, Hadas Kotek, Christopher Klein, Jason Williams arXiv_AI arXiv_AI Knowledge VQA QA PDF
2020-11-16 iPerceive: Applying Common-Sense Reasoning to Multi-Modal Dense Video Captioning and Video Question Answering Aman Chadha, Gurneet Arora, Navpreet Kaloty arXiv_AI arXiv_AI Recognition Video_Caption Knowledge Speech Pose Relation VQA Attention Caption Activity QA PDF
2020-11-11 End-to-End Chinese Landscape Painting Creation Using Generative Adversarial Networks Alice Xue arXiv_CV arXiv_CV Sketch Adversarial Pose VQA GAN PDF
2020-11-09 CapWAP: Captioning with a Purpose Adam Fisch, Kenton Lee, Ming-Wei Chang, Jonathan H. Clark, Regina Barzilay arXiv_CV arXiv_CV Image_Caption Reinforcement_Learning Pose VQA Caption Inference QA PDF
2020-11-09 Unified Quality Assessment of In-the-Wild Videos with Mixed Datasets Training Dingquan Li, Tingting Jiang, Ming Jiang arXiv_CV arXiv_CV Pose Face VQA QA PDF
2020-11-07 Learning to Model and Ignore Dataset Bias with Mixed Capacity Ensembles Christopher Clark, Mark Yatskar, Luke Zettlemoyer arXiv_CV arXiv_CV Recognition Pose Relation VQA PDF
2020-11-06 Disentangling 3D Prototypical Networks For Few-Shot Concept Learning Mihir Prabhudesai, Shamit Lal, Darshan Patil, Hsiao-Yu Tung, Adam W Harley, Katerina Fragkiadaki arXiv_CV arXiv_CV 3D Self-Supervised Pose Classification Detection Relation VQA Few-Shot Object_Detection PDF
2020-11-04 An Improved Attention for Visual Question Answering Tanzila Rahman, Shih-Han Chou, Leonid Sigal, Giuseppe Carenini arXiv_CV arXiv_CV Pose Relation VQA Attention QA PDF
2020-11-02 Reasoning Over History: Context Aware Visual Dialog Muhammad A. Shah, Shikib Mehri, Tejas Srinivasan arXiv_CL arXiv_CL Pose VQA Attention QA PDF
2020-10-30 Loss-rescaling VQA: Revisiting Language Prior Problem from a Class-imbalance View Yangyang Guo, Liqiang Nie, Zhiyong Cheng, Qi Tian arXiv_CV arXiv_CV Recognition Sparse Pose Face Classification VQA Face_Recognition Image_Classification Prediction QA PDF
2020-10-28 Leveraging Visual Question Answering to Improve Text-to-Image Synthesis Stanislav Frolov, Shailza Jolly, Jörn Hees, Andreas Dengel arXiv_CV arXiv_CV Image_Generation Pose Face VQA QA PDF
2020-10-27 MMFT-BERT: Multimodal Fusion Transformer with BERT Encodings for Visual Question Answering Aisha Urooj Khan, Amir Mazaheri, Niels da Vitoria Lobo, Mubarak Shah arXiv_CV arXiv_CV Transformer Bert Knowledge Pose VQA QA PDF
2020-10-26 ST-GREED: Space-Time Generalized Entropic Differences for Frame Rate Dependent Video Quality Prediction Pavan C. Madhusudana, Neil Birkbeck, Yilin Wang, Balu Adsumilli, Alan C. Bovik arXiv_CV arXiv_CV VQA Prediction QA PDF
2020-10-24 RUArt: A Novel Text-Centered Solution for Text-Based Visual Question Answering Zan-Xia Jin, Heran Wu, Chun Yang, Fang Zhou, Jingyan Qin, Lei Xiao, Xu-Cheng Yin arXiv_AI arXiv_AI Recognition OCR Optical_Character Pose Relation VQA QA Matching PDF
2020-10-24 Beyond VQA: Generating Multi-word Answer and Rationale to Visual Questions Radhika Dua, Sai Srinivas Kancheti, Vineeth N Balasubramanian arXiv_AI arXiv_AI Pose Quantitative Classification VQA QA PDF
2020-10-21 Removing Bias in Multi-modal Classifiers: Regularization by Maximizing Functional Entropies Itai Gat, Idan Schwartz, Alexander Schwing, Tamir Hazan arXiv_CV arXiv_CV Regularization Pose Classification VQA QA PDF
2020-10-20 SOrT-ing VQA Models : Contrastive Gradient Learning for Improved Consistency Sameer Dharur, Purva Tendulkar, Dhruv Batra, Devi Parikh, Ramprasaath R. Selvaraju arXiv_AI arXiv_AI Pose VQA QA PDF
2020-10-18 Hierarchical Conditional Relation Networks for Multimodal Video Question Answering Thao Minh Le, Vuong Le, Svetha Venkatesh, Truyen Tran arXiv_AI arXiv_AI Pose Relation VQA QA PDF
2020-10-17 Answer-checking in Context: A Multi-modal FullyAttention Network for Visual Question Answering Hantao Huang, Tao Han, Wei Han, Deep Yap, Cheng-Ming Chiang arXiv_CV arXiv_CV Image_Caption Bert Pose Relation VQA Attention QA PDF
2020-10-16 Measurement Error Mitigation for Variational Quantum Algorithms George S. Barron, Christopher J. Wood arXiv_CV arXiv_CV Relation VQA QA PDF
2020-10-16 New Ideas and Trends in Deep Multimodal Content Understanding: A Review Wei Chen, Weiping Wang, Li Liu, Michael S. Lew arXiv_CV arXiv_CV Image_Caption Embedding Review Adversarial Survey Deep_Learning VQA Caption PDF
2020-10-15 Natural Language Rationales with Full-Stack Visual Reasoning: From Pixels to Semantic Frames to Commonsense Graphs Ana Marasović, Chandra Bhagavatula, Jae Sung Park, Ronan Le Bras, Noah A. Smith, Yejin Choi arXiv_CV arXiv_CV Image_Caption Transformer Recognition VQA Attention Language_Model PDF
2020-10-13 Does my multimodal model learn cross-modal interactions? It's harder to tell than you might think! Jack Hessel, Lillian Lee arXiv_CV arXiv_CV Text_Classification Pose Action Classification VQA Prediction PDF
2020-10-13 Contrast and Classify: Alternate Training for Robust VQA Yash Kant, Abhinav Moudgil, Dhruv Batra, Devi Parikh, Harsh Agrawal arXiv_CV arXiv_CV Adversarial Pose Contrastive_Learning Classification VQA QA PDF
2020-10-10 Interpretable Neural Computation for Real-World Compositional Visual Question Answering Ruixue Tang, Chao Ma arXiv_CV arXiv_CV VQA Attention QA PDF
2020-10-08 Characterizing Datasets for Social Visual Question Answering, and the New TinySocial Dataset Zhanwen Chen, Shiyao Li, Roxanne Rashedi, Xiaoman Zi, Morgan Elrod-Erickson, Bryan Hollis, Angela Maliakal, Xinyu Shen, Simeng Zhao, Maithilee Kunda arXiv_CV arXiv_CV VQA QA PDF
2020-10-06 Finding the Evidence: Localization-aware Answer Prediction for Text Visual Question Answering Wei Han, Hantao Huang, Tao Han arXiv_CV arXiv_CV Recognition OCR Optical_Character Pose VQA Prediction QA PDF
2020-10-06 Pathological Visual Question Answering Xuehai He, Zhuo Cai, Wenlan Wei, Yichen Zhang, Luntian Mou, Eric Xing, Pengtao Xie arXiv_CV arXiv_CV Knowledge Self-Supervised Pose VQA Medical QA PDF
2020-10-05 Attention Guided Semantic Relationship Parsing for Visual Question Answering Moshiur Farazi, Salman Khan, Nick Barnes arXiv_AI arXiv_AI Pose Action Relation VQA Attention QA PDF
2020-10-02 CAPTION: Correction by Analyses, POS-Tagging and Interpretation of Objects using only Nouns Leonardo Anjoletto Ferreira, Douglas De Rizzo Meneghetti, Paulo Eduardo Santos arXiv_CV arXiv_CV Image_Caption Pose Deep_Learning Detection VQA Object_Detection Caption PDF
2020-10-01 ISAAQ -- Mastering Textbook Questions with Pre-trained Transformers and Bottom-Up and Top-Down Attention Jose Manuel Gomez-Perez, Raul Ortega arXiv_AI arXiv_AI Transformer Relation VQA Attention Language_Model QA PDF
2020-09-30 Graph-based Heuristic Search for Module Selection Procedure in Neural Module Network Yuxuan Wu, Hideki Nakayama arXiv_AI arXiv_AI Reinforcement_Learning Pose VQA QA PDF
2020-09-29 Spatial Attention as an Interface for Image Captioning Models Philipp Sadler arXiv_CV arXiv_CV Image_Caption Face Action Deep_Learning VQA Attention Caption PDF
2020-09-27 Hierarchical Deep Multi-modal Network for Medical Visual Question Answering Deepak Gupta, Swati Suman, Asif Ekbal arXiv_CV arXiv_CV Pose Quantitative VQA Medical Prediction QA PDF
2020-09-23 X-LXMERT: Paint, Caption and Answer Questions with Multi-Modal Transformers Jaemin Cho, Jiasen Lu, Dustin Schwenk, Hannaneh Hajishirzi, Aniruddha Kembhavi arXiv_AI arXiv_AI Image_Caption Transformer Bert VQA Caption Language_Model PDF
2020-09-23 Multiple interaction learning with question-type prior knowledge for constraining answer search space in visual question answering Tuong Do, Binh X. Nguyen, Huy Tran, Erman Tjiputra, Quang D. Tran, Thanh-Toan Do arXiv_CV arXiv_CV Knowledge Pose Action VQA QA PDF
2020-09-21 Regularizing Attention Networks for Anomaly Detection in Visual Question Answering Doyup Lee, Yeongjae Cheon, Wook-Shin Han arXiv_CV arXiv_CV Regularization Pose Detection VQA Attention QA PDF
2020-09-18 MUTANT: A Training Paradigm for Out-of-Distribution Generalization in Visual Question Answering Tejas Gokhale, Pratyay Banerjee, Chitta Baral, Yezhou Yang arXiv_CV arXiv_CV Knowledge Pose Relation VQA QA PDF
2020-09-17 A Multimodal Memes Classification: A Survey and Open Research Issues Tariq Habib Afridi, Aftab Alam, Muhammad Numan Khan, Jawad Khan, Young-Koo Lee arXiv_AI arXiv_AI Image_Caption Bert Knowledge Pose Survey Classification VQA Attention Caption QA PDF
2020-09-17 Self-supervised pre-training and contrastive representation learning for multiple-choice video QA Seonhoon Kim, Seohyeong Jeong, Eunbyul Kim, Inho Kang, Nojun Kwak arXiv_CL arXiv_CL Represenation_Learning Self-Supervised Pose Contrastive_Learning VQA Attention QA PDF
2020-09-14 From pulses to circuits and back again: A quantum optimal control perspective on variational quantum algorithms Alicia B. Magann, Christian Arenz, Matthew D. Grace, Tak-San Ho, Robert L. Kosut, Jarrod R. McClean, Herschel A. Rabitz, Mohan Sarovar arXiv_CV arXiv_CV Optimization Pose Action VQA QA PDF
2020-09-07 Deep Local and Global Spatiotemporal Feature Aggregation for Blind Video Quality Assessment Wei Zhou, Zhibo Chen arXiv_CV arXiv_CV Pose Deep_Learning VQA CNN QA PDF
2020-09-03 A Comparison of Pre-trained Vision-and-Language Models for Multimodal Representation Learning across Medical Images and Reports Yikuan Li, Hanyin Wang, Yuan Luo arXiv_CV arXiv_CV Embedding Bert Represenation_Learning RNN Classification VQA Attention Medical Language_Model PDF
2020-08-31 Cross-modal Knowledge Reasoning for Knowledge-based Visual Question Answering Jing Yu, Zihao Zhu, Yujing Wang, Weifeng Zhang, Yue Hu, Jianlong Tan arXiv_AI arXiv_AI Knowledge Knowledge_Graph Pose VQA QA PDF
2020-08-28 A Dataset and Baselines for Visual Question Answering on Art Noa Garcia, Chentao Ye, Zihua Liu, Qingtao Hu, Mayu Otani, Chenhui Chu, Yuta Nakashima, Teruko Mitamura arXiv_CV arXiv_CV Knowledge VQA QA PDF
2020-08-27 Visual Question Answering on Image Sets Ankan Bansal, Yuting Zhang, Rama Chellappa arXiv_CV arXiv_CV Relation VQA QA PDF
2020-08-22 Data augmentation techniques for the Video Question Answering task Alex Falcon, Oswald Lanz, Giuseppe Serra arXiv_CV arXiv_CV Pose Action VQA QA PDF
2020-08-20 Document Visual Question Answering Challenge 2020 Minesh Mathew, Ruben Tito, Dimosthenis Karatzas, R. Manmatha, C.V. Jawahar arXiv_CV arXiv_CV Pose Deep_Learning VQA GAN PDF
2020-08-18 Linguistically-aware Attention for Reducing the Semantic-Gap in Vision-Language Tasks Gouthaman KV, Athira Nambiar, Kancheti Sai Srinivas, Anurag Mittal arXiv_CV arXiv_CV Image_Caption Pose Detection Relation VQA Object_Detection Attention Caption Language_Model QA PDF
2020-08-16 DeVLBert: Learning Deconfounded Visio-Linguistic Representations Shengyu Zhang, Tan Jiang, Tan Wang, Kun Kuang, Zhou Zhao, Jianke Zhu, Jin Yu, Hongxia Yang, Fei Wu arXiv_CV arXiv_CV Bert Zero-Shot Image_Retrieval Pose Quantitative Relation VQA PDF
2020-08-15 Graph Edit Distance Reward: Learning to Edit Scene Graph Lichang Chen, Guosheng Lin, Shijie Wang, Qingyao Wu arXiv_CV arXiv_CV Image_Retrieval Pose VQA QA Matching PDF
2020-08-08 Assisting Scene Graph Generation with Self-Supervision Sandeep Inuganti, Vineeth N Balasubramanian arXiv_CV arXiv_CV Image_Caption Pose Action Detection Relation VQA Object_Detection Caption PDF
2020-08-03 Quantum-optimal-control-inspired ansatz for variational quantum algorithms Alexandre Choquette, Agustin Di Paolo, Panagiotis Kl. Barkoutsos, David Sénéchal, Ivano Tavernelli, Alexandre Blais arXiv_CV arXiv_CV VQA QA PDF
2020-07-31 No-Reference Video Quality Assessment Using Space-Time Chips Joshua P. Ebenezer, Zaixi Shang, Yongjun Wu, Hai Wei, Alan C. Bovik arXiv_CV arXiv_CV Pose Relation VQA QA PDF
2020-07-28 Noise-Induced Barren Plateaus in Variational Quantum Algorithms Samson Wang, Enrico Fontana, M. Cerezo, Kunal Sharma, Akira Sone, Lukasz Cincio, Patrick J. Coles arXiv_CV arXiv_CV VQA QA PDF
2020-07-27 REXUP: I REason, I EXtract, I UPdate with Structured Compositional Reasoning for Visual Question Answering Siwen Luo, Soyeon Caren Han, Kaiyuan Sun, Josiah Poon arXiv_AI arXiv_AI Pose Action Quantitative Relation VQA Attention QA PDF
2020-07-26 Contrastive Visual-Linguistic Pretraining Lei Shi, Kai Shuang, Shijie Geng, Peng Su, Zhengkai Jiang, Peng Gao, Zuohui Fu, Gerard de Melo, Sen Su arXiv_CV arXiv_CV Bert Represenation_Learning Self-Supervised Pose Contrastive_Learning Classification VQA QA PDF
2020-07-24 Dialog without Dialog Data: Learning Visual Dialog Agents from VQA Data Michael Cogswell, Jiasen Lu, Rishabh Jain, Stefan Lee, Devi Parikh, Dhruv Batra arXiv_AI arXiv_AI VQA QA PDF
2020-07-23 Spatially Aware Multimodal Transformers for TextVQA Yash Kant, Dhruv Batra, Peter Anderson, Alex Schwing, Devi Parikh, Jiasen Lu, Harsh Agrawal arXiv_CV arXiv_CV Transformer OCR Pose Relation VQA Attention QA PDF
2020-07-19 Semantic Equivalent Adversarial Data Augmentation for Visual Question Answering Ruixue Tang, Chao Ma, Wei Emma Zhang, Qi Wu, Xiaokang Yang arXiv_CV arXiv_CV Adversarial VQA QA PDF
2020-07-17 Learning to Discretely Compose Reasoning Module Networks for Video Captioning Ganchao Tan, Daqing Liu, Meng Wang, Zheng-Jun Zha arXiv_CV arXiv_CV Video_Caption Pose VQA Caption PDF
2020-07-17 Knowledge-Based Video Question Answering with Unsupervised Scene Descriptions Noa Garcia, Yuta Nakashima arXiv_CV arXiv_CV Transformer Unsupervised Weakly_Supervised Knowledge Action VQA QA PDF
2020-07-13 Reducing Language Biases in Visual Question Answering with Visually-Grounded Question Encoder Gouthaman KV, Anurag Mittal arXiv_CV arXiv_CV Pose VQA QA PDF
2020-07-12 Applying recent advances in Visual Question Answering to Record Linkage Marko Smilevski arXiv_AI arXiv_AI Pose Deep_Learning Detection VQA Attention CNN Matching PDF
2020-07-10 Image Captioning with Compositional Neural Module Networks Junjiao Tian, Jean Oh arXiv_CV arXiv_CV Image_Caption Pose VQA Caption PDF
2020-07-08 IQ-VQA: Intelligent Visual Question Answering Vatsal Goel, Mohit Chandak, Ashish Anand, Prithwijit Guha arXiv_CV arXiv_CV Pose Quantitative VQA Attention QA PDF
2020-07-04 Modality Shifting Attention Network for Multi-modal Video Question Answering Junyeong Kim, Minuk Ma, Trung Pham, Kyungsu Kim, Chang D. Yoo arXiv_CV arXiv_CV Pose VQA Attention Prediction QA PDF
2020-07-03 Eliminating Catastrophic Interference with Biased Competition Amelia Elizabeth Pollard, Jonathan L. Shapiro arXiv_CV arXiv_CV Pose Action VQA Attention QA PDF
2020-07-03 Visual Question Answering as a Multi-Task Problem Amelia Elizabeth Pollard, Jonathan L. Shapiro arXiv_AI arXiv_AI VQA QA PDF
2020-07-02 Scene Graph Reasoning for Visual Question Answering Marcel Hildebrandt, Hang Li, Rajat Koner, Volker Tresp, Stephan Günnemann arXiv_CV arXiv_CV Pose Relation VQA Autonomous QA PDF
2020-07-02 The Impact of Explanations on AI Competency Prediction in VQA Kamran Alipour, Arijit Ray, Xiao Lin, Jurgen P. Schulze, Yi Yao, Giedrius T. Burachas arXiv_AI arXiv_AI Bert Pose Relation VQA Language_Model Prediction QA PDF
2020-07-01 DocVQA: A Dataset for VQA on Document Images Minesh Mathew, Dimosthenis Karatzas, R. Manmatha, C.V. Jawahar arXiv_CV arXiv_CV VQA QA PDF
2020-06-30 Ontology-guided Semantic Composition for Zero-Shot Learning Jiaoyan Chen, Freddy Lecue, Yuxia Geng, Jeff Z. Pan, Huajun Chen arXiv_AI arXiv_AI Embedding Zero-Shot Pose Ontology Classification Relation VQA Image_Classification PDF
2020-06-28 Improving VQA and its Explanations by Comparing Competing Explanations Jialin Wu, Liyan Chen, Raymond J. Mooney arXiv_CV arXiv_CV Knowledge VQA QA PDF
2020-06-26 Graph Optimal Transport for Cross-Domain Alignment Liqun Chen, Zhe Gan, Yu Cheng, Linjie Li, Lawrence Carin, Jingjing Liu arXiv_CV arXiv_CV Image_Caption Sparse Pose VQA Attention Summarization Caption Matching PDF
2020-06-25 Self-Segregating and Coordinated-Segregating Transformer for Focused Deep Multi-Modular Network for Visual Question Answering Chiranjib Sur arXiv_CV arXiv_CV Transformer Enhancement VQA Attention QA PDF
2020-06-20 Neuro-Symbolic Visual Reasoning: Disentangling 'Visual' from 'Reasoning' Saeed Amizadeh, Hamid Palangi, Oleksandr Polozov, Yichen Huang, Kazuhito Koishida arXiv_AI arXiv_AI Represenation_Learning Pose VQA QA PDF
2020-06-16 Mucko: Multi-Layer Cross-Modal Knowledge Reasoning for Fact-based VisualQuestion Answering Zihao Zhu, Jing Yu, Yujing Wang, Yajing Sun, Yue Hu, Qi Wu arXiv_AI arXiv_AI Knowledge Pose VQA CNN QA PDF
2020-06-15 ORD: Object Relationship Discovery for Visual Dialogue Generation Ziwei Wang, Zi Huang, Yadan Luo, Huimin Lu arXiv_CV arXiv_CV Image_Caption Embedding Pose Action Relation VQA Attention Visual_Relation Caption CNN PDF
2020-06-12 Sparse and Continuous Attention Mechanisms André F. T. Martins, Marcos Treviso, António Farinhas, Vlad Niculae, Mário A. T. Figueiredo, Pedro M. Q. Aguiar arXiv_CV arXiv_CV Text_Classification Sparse Classification VQA Attention PDF
2020-06-12 Video Understanding as Machine Translation Bruno Korbar, Fabio Petroni, Rohit Girdhar, Lorenzo Torresani arXiv_CV arXiv_CV Video_Caption Speech Self-Supervised Pose Classification VQA Caption QA Video_Classification PDF
2020-06-11 Closed Loop Neural-Symbolic Learning via Integrating Neural Perception, Grammar Parsing, and Symbolic Reasoning Qing Li, Siyuan Huang, Yining Hong, Yixin Chen, Ying Nian Wu, Song-Chun Zhu arXiv_AI arXiv_AI Recognition Reinforcement_Learning Sparse Pose VQA PDF
2020-06-11 Exploring Weaknesses of VQA Models through Attribution Driven Insights Shaunak Halbe arXiv_CV arXiv_CV Adversarial VQA Prediction QA PDF
2020-06-11 Large-Scale Adversarial Training for Vision-and-Language Representation Learning Zhe Gan, Yen-Chun Chen, Linjie Li, Chen Zhu, Yu Cheng, Jingjing Liu arXiv_CV arXiv_CV Embedding Represenation_Learning Regularization Adversarial Pose VQA PDF
2020-06-10 Estimating semantic structure for the VQA answer space Corentin Kervadec (imagine), Grigory Antipov, Moez Baccouche, Christian Wolf (imagine) arXiv_CV arXiv_CV Pose Classification VQA QA PDF
2020-06-09 Roses Are Red, Violets Are Blue... but Should Vqa Expect Them To? Corentin Kervadec (LIRIS), Grigory Antipov, Moez Baccouche (imagine), Christian Wolf (imagine) arXiv_CV arXiv_CV VQA GAN Prediction QA PDF
2020-06-08 Counterfactual VQA: A Cause-Effect Look at Language Bias Yulei Niu, Kaihua Tang, Hanwang Zhang, Zhiwu Lu, Xian-Sheng Hua, Ji-Rong Wen arXiv_CV arXiv_CV Knowledge Pose VQA Inference QA PDF
2020-06-01 Multimodal grid features and cell pointers for Scene Text Visual Question Answering Lluís Gómez, Ali Furkan Biten, Rubèn Tito, Andrés Mafla, Dimosthenis Karatzas arXiv_CV arXiv_CV Pose Scene_Text VQA Attention QA PDF
2020-06-01 Structured Multimodal Attentions for TextVQA Chenyu Gao, Qi Zhu, Peng Wang, Hui Li, Yuliang Liu, Anton van den Hengel, Qi Wu arXiv_CV arXiv_CV Recognition OCR Optical_Character Pose Relation VQA Attention QA PDF
2020-05-29 UGC-VQA: Benchmarking Blind Video Quality Assessment for User Generated Content Zhengzhong Tu, Yilin Wang, Neil Birkbeck, Balu Adsumilli, Alan C. Bovik arXiv_CV arXiv_CV Deep_Learning VQA Prediction QA PDF
2020-05-22 Open-Retrieval Conversational Question Answering Chen Qu, Liu Yang, Cen Chen, Minghui Qiu, W. Bruce Croft, Mohit Iyyer arXiv_CL arXiv_CL Transformer Regularization VQA QA PDF
2020-05-21 Fluent Response Generation for Conversational Question Answering Ashutosh Baheti, Alan Ritter, Kevin Small arXiv_CL arXiv_CL Bert Pose Action VQA QA PDF
2020-05-19 On the Value of Out-of-Distribution Testing: An Example of Goodhart's Law Damien Teney, Kushal Kafle, Robik Shrestha, Ehsan Abbasnejad, Christopher Kanan, Anton van den Hengel arXiv_CV arXiv_CV Knowledge VQA QA PDF
2020-05-18 User-generated Video Quality Assessment: A Subjective and Objective Study Yang Li, Shengbin Meng, Xinfeng Zhang, Shiqi Wang, Yue Wang, Siwei Ma arXiv_CV arXiv_CV Optimization Pose VQA QA PDF
2020-05-16 Visual Relationship Detection using Scene Graphs: A Survey Aniket Agarwal, Ayush Mangal, Vipul arXiv_CV arXiv_CV Image_Caption Segmentation Recognition Image_Retrieval Survey Deep_Learning Detection Relation VQA Visual_Relation Caption PDF
2020-05-15 C3VQG: Category Consistent Cyclic Visual Question Generation Shagun Uppal, Anish Madan, Sarthak Bhagat, Yi Yu, Rajiv Ratn Shah arXiv_CV arXiv_CV Pose Quantitative VQA Inference Prediction PDF
2020-05-13 Dense-Caption Matching and Frame-Selection Gating for Temporal Localization in VideoQA Hyounghun Kim, Zineng Tang, Mohit Bansal arXiv_CV arXiv_CV Image_Caption Salient Pose Action Classification Relation VQA Attention Caption QA Matching PDF
2020-05-12 Cross-Modality Relevance for Reasoning on Language and Vision Chen Zheng, Quan Guo, Parisa Kordjamshidi arXiv_CL arXiv_CL Pose Relation VQA QA PDF
2020-05-09 Character Matters: Video Story Understanding with Character-Aware Relations Shijie Geng, Ji Zhang, Zuohui Fu, Peng Gao, Hang Zhang, Gerard de Melo arXiv_CV arXiv_CV Transformer Pose Face Relation VQA QA Matching PDF
2020-05-07 COBRA: Contrastive Bi-Modal Representation Algorithm Vishaal Udandarao, Abhishek Maiti, Deepak Srivatsav, Suryatej Reddy Vyalla, Yifang Yin, Rajiv Ratn Shah arXiv_CV arXiv_CV Image_Caption Embedding Relation VQA Caption PDF
2020-05-04 Visual Question Answering with Prior Class Semantics Violetta Shevchenko, Damien Teney, Anthony Dick, Anton van den Hengel arXiv_CV arXiv_CV Embedding Knowledge Relation VQA Prediction QA PDF
2020-05-01 Diverse Visuo-Lingustic Question Answering Challenge Shailaja Sampat, Yezhou Yang, Chitta Baral arXiv_AI arXiv_AI Deep_Learning VQA Inference QA PDF
2020-04-30 Dynamic Language Binding in Relational Visual Reasoning Thao Minh Le, Vuong Le, Svetha Venkatesh, Truyen Tran arXiv_CV arXiv_CV Knowledge Pose Relation VQA Attention QA PDF
2020-04-29 Pragmatic Issue-Sensitive Image Captioning Allen Nie, Reuben Cohn-Gordon, Christopher Potts arXiv_CV arXiv_CV Image_Caption Speech Pose VQA Caption PDF
2020-04-27 A Novel Attention-based Aggregation Function to Combine Vision and Language Matteo Stefanini, Marcella Cornia, Lorenzo Baraldi, Rita Cucchiara arXiv_CV arXiv_CV Image_Caption Pose Classification VQA Attention Caption QA Matching PDF
2020-04-25 Deep Multimodal Neural Architecture Search Zhou Yu, Yuhao Cui, Jun Yu, Meng Wang, Dacheng Tao, Qi Tian arXiv_CV arXiv_CV NAS VQA Matching PDF
2020-04-24 Revisiting Modulated Convolutions for Visual Counting and Beyond Duy-Kien Nguyen, Vedanuj Goswami, Xinlei Chen arXiv_CV arXiv_CV Pose VQA CNN Inference QA PDF
2020-04-23 Visual Question Answering Using Semantic Information from Image Descriptions Tasmia Tasrin, Md Sultan Al Nahian, Brent Harrison arXiv_AI arXiv_AI Image_Caption Knowledge Pose VQA Attention QA PDF
2020-04-20 Learning What Makes a Difference from Counterfactual Examples and Gradient Supervision Damien Teney, Ehsan Abbasnedjad, Anton van den Hengel arXiv_CV arXiv_CV Pose Classification Deep_Learning Relation Sentiment VQA Image_Classification Inference PDF
2020-04-19 Are we pretraining it right? Digging deeper into visio-linguistic pretraining Amanpreet Singh, Vedanuj Goswami, Devi Parikh arXiv_CV arXiv_CV Pose VQA Attention Caption QA PDF
2020-04-17 Knowledge-Based Visual Question Answering in Videos Noa Garcia, Mayu Otani, Chenhui Chu, Yuta Nakashima arXiv_CV arXiv_CV Video_Caption Knowledge Pose VQA QA PDF
2020-04-12 A negative case analysis of visual grounding methods for VQA Robik Shrestha, Kushal Kafle, Christopher Kanan arXiv_AI arXiv_AI Regularization Pose Relation VQA Attention QA PDF
2020-04-12 Which visual questions are difficult to answer? Analysis with Entropy of Answer Distributions Kento Terao, Toru Tamaki, Bisser Raytchev, Kazufumi Kaneda, Shun'ichi Satoh arXiv_CV arXiv_CV Pose VQA QA PDF
2020-04-12 YouMakeup VQA Challenge: Towards Fine-grained Action Understanding in Domain-Specific Videos Shizhe Chen, Weiying Wang, Ludan Ruan, Linli Yao, Qin Jin arXiv_CV arXiv_CV Pose Action VQA QA PDF
2020-04-10 Rephrasing visual questions by specifying the entropy of the answer distribution Kento Terao, Toru Tamaki, Bisser Raytchev, Kazufumi Kaneda, Shun'ichi Satoh arXiv_CV arXiv_CV Pose VQA QA PDF
2020-04-08 Understanding Knowledge Gaps in Visual Question Answering: Implications for Gap Identification and Testing Goonmeet Bajaj, Bortik Bandyopadhyay, Daniel Schmidt, Pranav Maneriker, Christopher Myers, Srinivasan Parthasarathy arXiv_AI arXiv_AI Knowledge VQA QA PDF
2020-04-06 Predicting the Quality of Compressed Videos with Pre-Existing Distortions Xiangxu Yu, Neil Birkbeck, Yilin Wang, Christos G. Bampis, Balu Adsumilli, Alan C. Bovik arXiv_CV arXiv_CV VQA QA PDF
2020-04-04 Generating Rationales in Visual Question Answering Hammad A. Ayyubi, Md. Mehrab Tanjim, Julian J. McAuley, Garrison W. Cottrell arXiv_AI arXiv_AI Bert Quantitative VQA QA PDF
2020-04-04 Evaluating Multimodal Representations on Visual Semantic Textual Similarity Oier Lopez de Lacalle, Ander Salaberria, Aitor Soroa, Gorka Azkune, Eneko Agirre arXiv_CL arXiv_CL Image_Caption VQA Caption Inference PDF
2020-04-02 Pixel-BERT: Aligning Image Pixels with Text by Deep Multi-Modal Transformers Zhicheng Huang, Zhaoyang Zeng, Bei Liu, Dongmei Fu, Jianlong Fu arXiv_CV arXiv_CV Transformer Embedding Bert Pose VQA Language_Model QA Matching PDF
2020-03-31 X-Linear Attention Networks for Image Captioning Yingwei Pan, Ting Yao, Yehao Li, Tao Mei arXiv_CV arXiv_CV Image_Caption Transformer Recognition Action VQA Attention Caption PDF
2020-03-31 Multi-Modal Graph Neural Network for Joint Reasoning on Vision and Scene Text Difei Gao, Ke Li, Ruiping Wang, Shiguang Shan, Xilin Chen arXiv_CV arXiv_CV Embedding Pose Scene_Text VQA QA PDF
2020-03-27 Assessing Image Quality Issues for Real-World Problem Tai-Yin Chiu, Yinan Zhao, Danna Gurari arXiv_CV arXiv_CV Image_Caption VQA Caption PDF
2020-03-26 P $approx$ NP, at least in Visual Question Answering Shailza Jolly, Sebastian Palacio, Joachim Folz, Federico Raue, Jorn Hees, Andreas Dengel arXiv_CV arXiv_CV Embedding VQA QA PDF
2020-03-23 Linguistically Driven Graph Capsule Network for Visual Question Reasoning Qingxing Cao, Xiaodan Liang, Keze Wang, Liang Lin arXiv_CV arXiv_CV Embedding Pose VQA CNN Inference QA PDF
2020-03-22 Visual Question Answering for Cultural Heritage Pietro Bongini, Federico Becattini, Andrew D. Bagdanov, Alberto Del Bimbo arXiv_CV arXiv_CV Knowledge Pose Action VQA QA PDF
2020-03-19 Normalized and Geometry-Aware Self-Attention Network for Image Captioning Longteng Guo, Jing Liu, Xinxin Zhu, Peng Yao, Shichen Lu, Hanqing Lu arXiv_CV arXiv_CV Image_Caption Transformer Video_Caption Pose Relation VQA Attention Caption PDF
2020-03-16 RSVQA: Visual Question Answering for Remote Sensing Data Sylvain Lobry, Diego Marcos, Jesse Murray, Devis Tuia arXiv_CV arXiv_CV RNN Knowledge Pose Classification Detection Relation VQA CNN QA PDF
2020-03-16 Towards Ground Truth Evaluation of Visual Explanations Ahmed Osman, Leila Arras, Wojciech Samek arXiv_AI arXiv_AI 3D Salient Pose Relation VQA PDF
2020-03-14 Counterfactual Samples Synthesizing for Robust Visual Question Answering Long Chen, Xin Yan, Jun Xiao, Hanwang Zhang, Shiliang Pu, Yueting Zhuang arXiv_CV arXiv_CV Pose Relation VQA QA PDF
2020-03-07 PathVQA: 30000+ Questions for Medical Visual Question Answering Xuehai He, Yichen Zhang, Luntian Mou, Eric Xing, Pengtao Xie arXiv_AI arXiv_AI Knowledge VQA Medical Caption QA PDF
2020-03-03 XGPT: Cross-modal Generative Pre-Training for Image Captioning Qiaolin Xia, Haoyang Huang, Nan Duan, Dongdong Zhang, Lei Ji, Zhifang Sui, Edward Cui, Taroon Bharti, Ming Zhou arXiv_CV arXiv_CV Image_Caption Bert Image_Retrieval Pose VQA Denoising Caption Language_Model QA PDF
2020-03-02 A Question-Centric Model for Visual Question Answering in Medical Imaging Minh H. Vu, Tommy Löfstedt, Tufve Nyholm, Raphael Sznitman arXiv_CV arXiv_CV Pose Deep_Learning VQA Medical Prediction PDF
2020-03-01 A Study on Multimodal and Interactive Explanations for Visual Question Answering Kamran Alipour, Jurgen P. Schulze, Yi Yao, Avi Ziskind, Giedrius Burachas arXiv_AI arXiv_AI VQA Attention Prediction QA PDF
2020-02-27 Visual Commonsense R-CNN Tan Wang, Jianqiang Huang, Hanwang Zhang, Qianru Sun arXiv_CV arXiv_CV Image_Caption Unsupervised Represenation_Learning Knowledge VQA Caption CNN Language_Model Prediction QA PDF
2020-02-27 Unbiased Scene Graph Generation from Biased Training Kaihua Tang, Yulei Niu, Jianqiang Huang, Jiaxin Shi, Hanwang Zhang arXiv_CV arXiv_CV Pose VQA Inference Prediction QA PDF
2020-02-27 Unshuffling Data for Improved Generalization Damien Teney, Ehsan Abbasnejad, Anton van den Hengel arXiv_CV arXiv_CV Unsupervised Knowledge Relation VQA QA PDF
2020-02-25 BERT Can See Out of the Box: On the Cross-modal Transferability of Text Representations Thomas Scialom, Patrick Bordes, Paul-Alexis Dray, Jacopo Staiano, Patrick Gallinari arXiv_CV arXiv_CV Bert Zero-Shot Pose Action VQA Text_Generation Language_Model PDF
2020-02-25 A Comparative Evaluation of Temporal Pooling Methods for Blind Video Quality Assessment Zhengzhong Tu, Chia-Ju Chen, Li-Heng Chen, Neil Birkbeck, Balu Adsumilli, Alan C. Bovik arXiv_CV arXiv_CV Pose VQA Attention Prediction QA PDF
2020-02-24 On the General Value of Evidence, and Bilingual Scene-Text Visual Question Answering Xinyu Wang, Yuliang Liu, Chunhua Shen, Chun Chet Ng, Canjie Luo, Lianwen Jin, Chee Seng Chan, Anton van den Hengel, Liangwei Wang arXiv_CV arXiv_CV Relation VQA QA PDF
2020-02-19 VQA-LOL: Visual Question Answering under the Lens of Logic Tejas Gokhale, Pratyay Banerjee, Chitta Baral, Yezhou Yang arXiv_CV arXiv_CV Embedding Pose VQA QA PDF
2020-02-17 CQ-VQA: Visual Question Answering on Categorized Questions Aakansha Mishra, Ashish Anand, Prithwijit Guha arXiv_CV arXiv_CV Pose VQA QA PDF
2020-02-13 Sparse and Structured Visual Attention Pedro Henrique Martins, Vlad Niculae, Zita Marinho, André Martins arXiv_CV arXiv_CV Image_Caption Transformer Sparse RNN Pose VQA Attention Caption QA PDF
2020-02-13 EndoL2H: Deep Super-Resolution for Capsule Endoscopy Yasin Almalioglu, Abdulkadir Gokce, Kagan Incetan, Muhammed Ali Simsek, Kivanc Ararat, Richard J. Chen, Nichalos J. Durr, Faisal Mahmood, Mehmet Turan arXiv_CV arXiv_CV Super_Resolution Adversarial Pose Quantitative Detection VQA Attention GAN PDF
2020-02-12 Component Analysis for Visual Question Answering Architectures Camila Kolling, Jônatas Wehrmann, Rodrigo C. Barros arXiv_AI arXiv_AI Represenation_Learning VQA Attention QA PDF
2020-02-04 Cost-Function-Dependent Barren Plateaus in Shallow Quantum Neural Networks M. Cerezo, Akira Sone, Tyler Volkoff, Lukasz Cincio, Patrick J. Coles arXiv_CV arXiv_CV Pose VQA QA PDF
2020-01-31 Augmenting Visual Question Answering with Semantic Frame Information in a Multitask Learning Approach Mehrdad Alizadeh, Barbara Di Eugenio arXiv_CV arXiv_CV RNN Pose Classification VQA QA PDF
2020-01-23 Uncertainty based Class Activation Maps for Visual Question Answering Badri N. Patro, Mayank Lunayach, Vinay P. Namboodiri arXiv_CV arXiv_CV Pose Deep_Learning Relation VQA Attention PDF
2020-01-23 Deep Bayesian Network for Visual Question Generation Badri N. Patro, Vinod K. Kurmi, Sandeep Kumar, Vinay P. Namboodiri arXiv_CV arXiv_CV Pose Quantitative VQA Caption PDF
2020-01-23 Robust Explanations for Visual Question Answering Badri N. Patro, Shivansh Pate, Vinay P. Namboodiri arXiv_CV arXiv_CV Pose Relation VQA QA PDF
2020-01-20 Recommending Themes for Ad Creative Design via Visual-Linguistic Representations Yichao Zhou, Shaunak Mishra, Manisha Verma, Narayan Bhamidipati, Wei Wang arXiv_CV arXiv_CV Transformer Knowledge Pose Classification VQA QA Recommendation PDF
2020-01-20 Accuracy vs. Complexity: A Trade-off in Visual Question Answering Models Moshiur R. Farazi, Salman H. Khan, Nick Barnes arXiv_CV arXiv_CV Embedding Action Classification VQA Attention QA PDF
2020-01-20 SQuINTing at VQA Models: Interrogating VQA Models with Sub-Questions Ramprasaath R. Selvaraju, Purva Tendulkar, Devi Parikh, Eric Horvitz, Marco Ribeiro, Besmira Nushi, Ece Kamar arXiv_CV arXiv_CV Knowledge Pose Relation VQA Attention QA PDF
2020-01-11 MHSAN: Multi-Head Self-Attention Network for Visual Semantic Embedding Geondo Park, Chihye Han, Wonjun Yoon, Daeshik Kim arXiv_CV arXiv_CV Image_Caption Embedding Pose Relation VQA Attention Caption PDF
2020-01-10 In Defense of Grid Features for Visual Question Answering Huaizu Jiang, Ishan Misra, Marcus Rohrbach, Erik Learned-Miller, Xinlei Chen arXiv_CV arXiv_CV Image_Caption VQA Attention Caption CNN QA PDF
2020-01-10 Visual Question Answering on 360° Images Shih-Han Chou, Wei-Lun Chao, Wei-Sheng Lai, Min Sun, Ming-Hsuan Yang arXiv_CV arXiv_CV VQA Attention QA PDF
2020-01-06 Think Locally, Act Globally: Federated Learning with Local and Global Representations Paul Pu Liang, Terrance Liu, Liu Ziyin, Ruslan Salakhutdinov, Louis-Philippe Morency arXiv_CV arXiv_CV Recognition Represenation_Learning Pose VQA QA PDF
2020-01-03 Multi-Layer Content Interaction Through Quaternion Product For Visual Question Answering Lei Shi, Shijie Geng, Kai Shuang, Chiori Hori, Songxiang Liu, Peng Gao, Sen Su arXiv_CV arXiv_CV Bert Pose Action VQA Caption QA PDF
2019-12-26 Vision and Language: from Visual Perception to Content Creation Tao Mei, Wei Zhang, Ting Yao arXiv_CV arXiv_CV Video_Caption Review Action VQA Caption PDF
2019-12-19 Deep Exemplar Networks for VQA and VQG Badri N. Patro, Vinay P. Namboodiri arXiv_CV arXiv_CV Pose Deep_Learning VQA Attention QA PDF
2019-12-17 No-Reference Video Quality Assessment using Multi-Level Spatially Pooled Features Franz Götz-Hahn, Vlad Hosu, Hanhe Lin, Dietmar Saupe arXiv_CV arXiv_CV Transfer_Learning Pose Deep_Learning Relation VQA QA PDF
2019-12-16 Towards Causal VQA: Revealing and Reducing Spurious Correlations by Invariant and Covariant Semantic Editing Vedika Agarwal, Rakshith Shetty, Mario Fritz arXiv_CV arXiv_CV Pose Relation VQA Prediction QA PDF
2019-12-09 AI2D-RST: A multimodal corpus of 1000 primary school science diagrams Tuomo Hiippala, Malihe Alikhani, Jonas Haverinen, Timo Kalliokoski, Evanfiya Logacheva, Serafina Orekhova, Aino Tuomainen, Matthew Stone, John A. Bateman arXiv_CV arXiv_CV Segmentation Relation VQA PDF
2019-12-06 Weak Supervision helps Emergence of Word-Object Alignment and improves Vision-Language Tasks Corentin Kervadec (LIRIS), Grigory Antipov, Moez Baccouche, Christian Wolf (LIRIS) arXiv_CV arXiv_CV Transformer Bert Image_Retrieval Pose Classification Relation VQA Attention QA PDF
2019-12-05 Large-scale Pretraining for Visual Dialog: A Simple State-of-the-Art Baseline Vishvak Murahari, Dhruv Batra, Devi Parikh, Abhishek Das arXiv_AI arXiv_AI Bert Represenation_Learning Pose VQA Caption Language_Model Prediction PDF
2019-12-05 12-in-1: Multi-Task Vision and Language Representation Learning Jiasen Lu, Vedanuj Goswami, Marcus Rohrbach, Devi Parikh, Stefan Lee arXiv_AI arXiv_AI Represenation_Learning Image_Retrieval Relation VQA Caption PDF
2019-12-02 Deep Bayesian Active Learning for Multiple Correct Outputs Khaled Jedoui, Ranjay Krishna, Michael Bernstein, Li Fei-Fei arXiv_CV arXiv_CV Image_Caption Pose Classification VQA Caption QA PDF
2019-12-02 TutorialVQA: Question Answering Dataset for Tutorial Videos Anthony Colas, Seokhwan Kim, Franck Dernoncourt, Siddhesh Gupte, Daisy Zhe Wang, Doo Soon Kim arXiv_CL arXiv_CL Pose VQA QA PDF
2019-11-30 Assessing the Robustness of Visual Question Answering Jia-Hong Huang, Modar Alfadly, Bernard Ghanem, Marcel Worring arXiv_CV arXiv_CV Optimization Adversarial Pose VQA QA PDF
2019-11-30 A Free Lunch in Generating Datasets: Building a VQG and VQA System with Attention and Humans in the Loop Jihyeon Janel Lee, Sho Arora arXiv_CV arXiv_CV Knowledge Pose VQA Attention QA PDF
2019-11-29 OptiBox: Breaking the Limits of Proposals for Visual Grounding Zicong Fan, Si Yi Meng, Leonid Sigal, James J. Little arXiv_CV arXiv_CV Image_Caption Reconstruction Pose VQA Attention Caption QA PDF
2019-11-23 Unsupervised Keyword Extraction for Full-sentence VQA Kohei Uehara, Tatsuya Harada arXiv_CV arXiv_CV Unsupervised Pose Action VQA QA PDF
2019-11-21 Temporal Reasoning via Audio Question Answering Haytham M. Fayek, Justin Johnson arXiv_AI arXiv_AI Pose VQA QA PDF
2019-11-19 Explanation vs Attention: A Two-Player Game to Obtain Attention for VQA Badri N. Patro, Anupriy, Vinay P. Namboodiri arXiv_CV arXiv_CV Adversarial Pose Relation VQA Attention QA PDF
2019-11-17 DualVD: An Adaptive Dual Encoding Model for Deep Visual Understanding in Visual Dialogue Xiaoze Jiang, Jing Yu, Zengchang Qin, Yingying Zhuang, Xingxing Zhang, Yue Hu, Qi Wu arXiv_CV arXiv_CV Image_Caption Pose Relation VQA Attention PDF
2019-11-14 Question-Conditioned Counterfactual Image Generation for VQA Jingjing Pan, Yash Goyal, Stefan Lee arXiv_CV arXiv_CV Pose VQA QA PDF
2019-11-14 Iterative Answer Prediction with Pointer-Augmented Multimodal Transformers for TextVQA Ronghang Hu, Amanpreet Singh, Trevor Darrell, Marcus Rohrbach arXiv_CV arXiv_CV Transformer Embedding Pose Classification VQA Attention Prediction QA PDF
2019-11-11 Open-Ended Visual Question Answering by Multi-Modal Domain Adaptation Yiming Xu, Lin Chen, Zhongwei Cheng, Lixin Duan, Jiebo Luo arXiv_CV arXiv_CV Embedding Pose VQA QA PDF
2019-11-10 Multimodal Intelligence: Representation Learning, Information Fusion, and Applications Chao Zhang, Zichao Yang, Xiaodong He, Li Deng arXiv_AI arXiv_AI Embedding Recognition Represenation_Learning Review Speech Deep_Learning VQA Speech_Recognition Caption PDF
2019-11-08 Are we asking the right questions in MovieQA? Bhavan Jasani, Rohit Girdhar, Deva Ramanan arXiv_CV arXiv_CV Embedding Pose VQA QA PDF
2019-10-31 TAB-VCR: Tags and Attributes based VCR Baselines Jingxiang Lin, Unnat Jain, Alexander G. Schwing arXiv_CV arXiv_CV RNN Pose VQA Attention PDF
2019-10-30 C3DVQA: Full-Reference Video Quality Assessment with 3D Convolutional Neural Network Munan Xu, Junming Chen, Haiqiang Wang, Shan Liu, Ge Li, Zhiqiang Bai arXiv_CV arXiv_CV 3D Pose VQA CNN QA PDF
2019-10-29 Learning Rich Image Region Representation for Visual Question Answering Bei Liu, Zhicheng Huang, Zhaoyang Zeng, Zheyu Chen, Jianlong Fu arXiv_CV arXiv_CV Bert Pose Detection VQA Object_Detection Language_Model QA PDF
2019-10-24 Assisting human experts in the interpretation of their visual process: A case study on assessing copper surface adhesive potency Tristan Hascoet, Xuejiao Deng, Kiyoto Tai, Mari Sugiyama, Yuji Adachi, Sachiko Nakamura, Yasuo Ariki, Tomoko Hayashi, Tetusya Takiguchi arXiv_CV arXiv_CV Recognition Face Deep_Learning VQA PDF
2019-10-23 KnowIT VQA: Answering Knowledge-Based Questions about Videos Noa Garcia, Mayu Otani, Chenhui Chu, Yuta Nakashima arXiv_CV arXiv_CV Video_Caption Knowledge Pose VQA QA PDF
2019-10-21 Good, Better, Best: Textual Distractors Generation for Multi-Choice VQA via Policy Gradient Jiaying Lu (1), Xin Ye (1), Yi Ren (1), Yezhou Yang (1) ((1) Arizona State University) arXiv_CV arXiv_CV Unsupervised Reinforcement_Learning Adversarial Pose VQA QA PDF
2019-10-21 Enforcing Reasoning in Visual Commonsense Reasoning Hammad A. Ayyubi, Md. Mehrab Tanjim, David J. Kriegman arXiv_AI arXiv_AI Reinforcement_Learning VQA Prediction QA PDF
2019-10-12 Neural Memory Plasticity for Anomaly Detection Tharindu Fernando, Simon Denman, David Ahmedt-Aristizabal, Sridha Sridharan, Kristin Laurens, Patrick Johnston, Clinton Fookes arXiv_CV arXiv_CV Tracking Sparse Object_Tracking Memory_Networks Knowledge Pose Classification Detection VQA Attention Medical Language_Model Prediction PDF
2019-10-11 Multi-modal Deep Analysis for Multimedia Wenwu Zhu, Xin Wang, Hongzhi Li arXiv_CV arXiv_CV Transfer_Learning Knowledge Relation VQA Summarization Recommendation PDF
2019-10-08 Modulated Self-attention Convolutional Network for VQA Jean-Benoit Delbrouck, Antoine Maiorca, Nathan Hubens, Stéphane Dupont arXiv_AI arXiv_AI Pose Action VQA Attention CNN QA PDF
2019-10-06 REMIND Your Neural Network to Prevent Catastrophic Forgetting Tyler L. Hayes, Kushal Kafle, Robik Shrestha, Manoj Acharya, Christopher Kanan arXiv_CV arXiv_CV Quantization Knowledge Pose VQA CNN QA PDF
2019-09-30 On Incorporating Semantic Prior Knowlegde in Deep Learning Through Embedding-Space Constraints Damien Teney, Ehsan Abbasnejad, Anton van den Hengel arXiv_CV arXiv_CV Embedding Knowledge Deep_Learning Relation VQA QA PDF
2019-09-26 Compact Trilinear Interaction for Visual Question Answering Tuong Do, Thanh-Toan Do, Huy Tran, Erman Tjiputra, Quang D. Tran arXiv_CV arXiv_CV Knowledge Pose Action Relation VQA QA PDF
2019-09-26 Overcoming Data Limitation in Medical Visual Question Answering Binh D. Nguyen, Thanh-Toan Do, Binh X. Nguyen, Tuong Do, Erman Tjiputra, Quang D. Tran arXiv_CV arXiv_CV Unsupervised Pose VQA Denoising Medical QA PDF
2019-09-25 UNITER: Learning UNiversal Image-TExt Representations Yen-Chun Chen, Linjie Li, Licheng Yu, Ahmed El Kholy, Faisal Ahmed, Zhe Gan, Yu Cheng, Jingjing Liu arXiv_CV arXiv_CV Embedding VQA Caption Language_Model Matching PDF
2019-09-24 Unified Vision-Language Pre-Training for Image Captioning and VQA Luowei Zhou, Hamid Palangi, Lei Zhang, Houdong Hu, Jason J. Corso, Jianfeng Gao arXiv_CV arXiv_CV Image_Caption Transformer Unsupervised Knowledge VQA Attention Caption Prediction QA PDF
2019-09-23 Non-monotonic Logical Reasoning Guiding Deep Learning for Explainable Visual Question Answering Heather Riley, Mohan Sridharan arXiv_AI arXiv_AI Recognition Knowledge Classification Deep_Learning VQA PDF
2019-09-23 Explainable High-order Visual Question Reasoning: A New Benchmark and Knowledge-routed Network Qingxing Cao, Bailin Li, Xiaodan Liang, Liang Lin arXiv_CV arXiv_CV Knowledge Pose Relation VQA Inference QA PDF
2019-09-19 Triplet-Aware Scene Graph Embeddings Brigit Schroeder, Subarna Tripathi, Hanlin Tang arXiv_CV arXiv_CV Embedding Image_Retrieval Knowledge Detection Relation VQA Visual_Relation Prediction PDF
2019-09-19 Learning Sparse Mixture of Experts for Visual Question Answering Vardaan Pahuja, Jie Fu, Christopher J. Pal arXiv_CV arXiv_CV Sparse Pose VQA CNN QA PDF
2019-09-17 Inverse Visual Question Answering with Multi-Level Attentions Yaser Alwatter, Yuhong Guo arXiv_AI arXiv_AI Pose VQA Attention QA PDF
2019-09-10 Sunny and Dark Outside?! Improving Answer Consistency in VQA through Entailed Question Generation Arijit Ray, Karan Sikka, Ajay Divakaran, Stefan Lee, Giedrius Burachas arXiv_AI arXiv_AI Pose Quantitative VQA QA PDF
2019-09-09 Don't Take the Easy Way Out: Ensemble Based Methods for Avoiding Known Dataset Biases Christopher Clark, Mark Yatskar, Luke Zettlemoyer arXiv_CV arXiv_CV Knowledge Adversarial VQA Prediction PDF
2019-09-04 Decoupled Box Proposal and Featurization with Ultrafine-Grained Semantic Labels Improve Image Captioning and Visual Question Answering Soravit Changpinyo, Bo Pang, Piyush Sharma, Radu Soricut arXiv_CV arXiv_CV Image_Caption Transfer_Learning Detection VQA Object_Detection Caption PDF
2019-09-03 Data Interpretation over Plots Nitesh Methani, Pritha Ganguly, Mitesh M. Khapra, Pratyush Kumar arXiv_AI arXiv_AI Pose Detection VQA QA PDF
2019-09-02 Virtual Thin Slice: 3D Conditional GAN-based Super-resolution for CT Slice Interval Akira Kudo, Yoshiro Kitamura, Yuanzhong Li, Satoshi Iizuka, Edgar Simo-Serra arXiv_CV arXiv_CV Super_Resolution 3D Adversarial Pose VQA GAN CNN PDF
2019-08-28 Adversarial Representation Learning for Text-to-Image Matching Nikolaos Sarafianos, Xiang Xu, Ioannis A. Kakadiaris arXiv_CV arXiv_CV Image_Caption Embedding Bert Represenation_Learning Adversarial Pose VQA Caption Language_Model Matching PDF
2019-08-27 Visual Question Answering using Deep Learning: A Survey and Performance Analysis Yash Srivastava, Vaishnav Murali, Shiv Ram Dubey, Snehasis Mukherjee arXiv_AI arXiv_AI Survey Deep_Learning VQA Attention Inference QA PDF
2019-08-26 Attentive History Selection for Conversational Question Answering Chen Qu, Liu Yang, Minghui Qiu, Yongfeng Zhang, Cen Chen, W. Bruce Croft, Mohit Iyyer arXiv_CV arXiv_CV Embedding Bert Pose VQA Attention Prediction QA PDF
2019-08-22 VL-BERT: Pre-training of Generic Visual-Linguistic Representations Weijie Su, Xizhou Zhu, Yue Cao, Bin Li, Lewei Lu, Furu Wei, Jifeng Dai arXiv_CV arXiv_CV Transformer Bert Classification Relation VQA Caption Language_Model Prediction PDF
2019-08-20 LXMERT: Learning Cross-Modality Encoder Representations from Transformers Hao Tan, Mohit Bansal arXiv_CV arXiv_CV Transformer Pose Classification Relation VQA Language_Model Prediction QA Matching PDF
2019-08-17 What is needed for simple spatial language capabilities in VQA? Alexander Kuhnle, Ann Copestake arXiv_AI arXiv_AI RNN Relation VQA QA PDF
2019-08-17 Language Features Matter: Effective Language Representations for Vision-Language Tasks Andrea Burns, Reuben Tan, Kate Saenko, Stan Sclaroff, Bryan A. Plummer arXiv_CV arXiv_CV Image_Caption Embedding Bert RNN Knowledge Pose VQA Attention Caption Language_Model PDF
2019-08-17 U-CAM: Visual Explanation using Uncertainty based Class Activation Maps Badri N. Patro, Mayank Lunayach, Shivansh Patel, Vinay P. Namboodiri arXiv_CV arXiv_CV Pose Deep_Learning Relation VQA Attention PDF
2019-08-16 2nd Place Solution to the GQA Challenge 2019 Shijie Geng, Ji Zhang, Hang Zhang, Ahmed Elgammal, Dimitris N. Metaxas arXiv_CV arXiv_CV Knowledge Action Detection VQA Object_Detection QA PDF
2019-08-14 Reactive Multi-Stage Feature Fusion for Multimodal Dialogue Modeling Yi-Ting Yeh, Tzu-Chuan Lin, Hsiao-Hua Cheng, Yu-Hsuan Deng, Shang-Yu Su, Yun-Nung Chen arXiv_CV arXiv_CV Pose Action VQA Attention PDF
2019-08-14 Fusion of Detected Objects in Text for Visual Question Answering Chris Alberti, Jeffrey Ling, Michael Collins, David Reitter arXiv_CV arXiv_CV Transformer VQA PDF
2019-08-14 VideoNavQA: Bridging the Gap between Visual and Embodied Question Answering Cătălina Cangea, Eugene Belilovsky, Pietro Liò, Aaron Courville arXiv_AI arXiv_AI Reinforcement_Learning 3D Pose VQA QA PDF
2019-08-12 Why Does a Visual Question Have Different Answers? Nilavra Bhattacharya, Qing Li, Danna Gurari arXiv_CV arXiv_CV Knowledge Pose VQA PDF
2019-08-12 Multimodal Unified Attention Networks for Vision-and-Language Interactions Zhou Yu, Yuhao Cui, Jun Yu, Dacheng Tao, Qi Tian arXiv_CV arXiv_CV Pose Action VQA Attention QA PDF
2019-08-10 Multi-modality Latent Interaction Network for Visual Question Answering Peng Gao, Haoxuan You, Zhanpeng Zhang, Xiaogang Wang, Hongsheng Li arXiv_CV arXiv_CV Bert Pose Action Relation VQA Summarization Language_Model QA PDF
2019-08-09 VisualBERT: A Simple and Performant Baseline for Vision and Language Liunian Harold Li, Mark Yatskar, Da Yin, Cho-Jui Hsieh, Kai-Wei Chang arXiv_CV arXiv_CV Image_Caption Transformer Tracking Bert Pose Relation VQA Attention Caption Language_Model QA PDF
2019-08-09 Question-Agnostic Attention for Visual Question Answering Moshiur R Farazi, Salman H Khan, Nick Barnes arXiv_CV arXiv_CV Pose VQA Attention QA PDF
2019-08-08 From Two Graphs to N Questions: A VQA Dataset for Compositional Reasoning on Vision and Commonsense Difei Gao, Ruiping Wang, Shiguang Shan, Xilin Chen arXiv_CV arXiv_CV Knowledge Knowledge_Graph Pose VQA QA PDF
2019-08-06 ViLBERT: Pretraining Task-Agnostic Visiolinguistic Representations for Vision-and-Language Tasks Jiasen Lu, Dhruv Batra, Devi Parikh, Stefan Lee arXiv_CV arXiv_CV Transformer Bert Image_Retrieval VQA Attention Caption PDF
2019-08-05 Answering Questions about Data Visualizations using Efficient Bimodal Fusion Kushal Kafle, Robik Shrestha, Brian Price, Scott Cohen, Christopher Kanan arXiv_AI arXiv_AI Embedding Recognition Optical_Character Pose VQA QA PDF
2019-07-31 An Empirical Study of Batch Normalization and Group Normalization in Conditional Computation Vincent Michalski, Vikram Voleti, Samira Ebrahimi Kahou, Anthony Ortiz, Pascal Vincent, Chris Pal, Doina Precup arXiv_CV arXiv_CV Optimization Pose VQA Few-Shot PDF
2019-07-30 LEAF-QA: Locate, Encode & Attend for Figure Question Answering Ritwick Chaudhry, Sumit Shekhar, Utkarsh Gupta, Pranav Maneriker, Prann Bansal, Ajay Joshi arXiv_CV arXiv_CV Pose VQA Attention QA PDF
2019-07-29 V-PROM: A Benchmark for Visual Reasoning Using Visual Progressive Matrices Damien Teney, Peng Wang, Jiewei Cao, Lingqiao Liu, Chunhua Shen, Anton van den Hengel arXiv_CV arXiv_CV Pose Face Deep_Learning Relation VQA PDF
2019-07-28 An Empirical Study on Leveraging Scene Graphs for Visual Question Answering Cheng Zhang, Wei-Lun Chao, Dong Xuan arXiv_CV arXiv_CV Knowledge Knowledge_Graph Pose Relation VQA Attention QA PDF
2019-07-23 Graph Reasoning Networks for Visual Question Answering Dalu Guo, Chang Xu, Dacheng Tao arXiv_CV arXiv_CV Action Relation VQA Attention QA PDF
2019-07-17 OmniNet: A unified architecture for multi-modal multi-task learning Subhojeet Pramanik, Priyanka Agrawal, Aman Hussain arXiv_CV arXiv_CV Image_Caption Transformer Recognition Speech Pose VQA Attention Caption Activity PDF
2019-07-11 Two-stream Spatiotemporal Feature for Video QA Task Chiwan Song, Woobin Im, Sung-eui Yoon arXiv_CV arXiv_CV Surveillance Recognition Pose Action_Recognition Action VQA Attention Autonomous QA Matching PDF
2019-07-10 Learning to Reason with Relational Video Representation for Question Answering Thao Minh Le, Vuong Le, Svetha Venkatesh, Truyen Tran arXiv_AI arXiv_AI Pose Action Relation VQA QA PDF
2019-07-09 Learning by Abstraction: The Neural State Machine Drew A. Hudson, Christopher D. Manning arXiv_AI arXiv_AI Action VQA Inference QA PDF
2019-06-30 ICDAR 2019 Competition on Scene Text Visual Question Answering Ali Furkan Biten, Rubèn Tito, Andres Mafla, Lluis Gomez, Marçal Rusiñol, Minesh Mathew, C.V. Jawahar, Ernest Valveny, Dimosthenis Karatzas arXiv_CV arXiv_CV Image_Caption Recognition Pose Scene_Text VQA GAN QA PDF
2019-06-25 Deep Modular Co-Attention Networks for Visual Question Answering Zhou Yu, Jun Yu, Yuhao Cui, Dacheng Tao, Qi Tian arXiv_CV arXiv_CV Pose Quantitative VQA Attention QA PDF
2019-06-24 RUBi: Reducing Unimodal Biases in Visual Question Answering Remi Cadene, Corentin Dancette, Hedi Ben-younes, Matthieu Cord, Devi Parikh arXiv_CV arXiv_CV Pose VQA Prediction QA PDF
2019-06-24 Integrating Knowledge and Reasoning in Image Understanding Somak Aditya, Yezhou Yang, Chitta Baral arXiv_AI arXiv_AI Image_Caption Segmentation Semantic_Segmentation Recognition Knowledge Pose Survey Deep_Learning VQA PDF
2019-06-24 Adversarial Multimodal Network for Movie Question Answering Zhaoquan Yuan, Siyuan Sun, Lixin Duan, Xiao Wu, Changsheng Xu arXiv_CV arXiv_CV Adversarial Pose Relation VQA Attention GAN QA PDF
2019-06-23 Investigating Biases in Textual Entailment Datasets Shawn Tan, Yikang Shen, Chin-wei Huang, Aaron Courville arXiv_CL arXiv_CL Pose Classification Relation VQA QA PDF
2019-06-20 Adversarial Regularization for Visual Question Answering: Strengths, Shortcomings, and Side Effects Gabriel Grand, Yonatan Belinkov arXiv_CV arXiv_CV Regularization Adversarial VQA Inference QA PDF
2019-06-14 Improving Visual Question Answering by Referring to Generated Paragraph Captions Hyounghun Kim, Mohit Bansal arXiv_CL arXiv_CL Image_Caption Pose VQA Attention Caption QA PDF
2019-06-12 Synthesizing Diverse Lung Nodules Wherever Massively: 3D Multi-Conditional GAN-based CT Image Augmentation for Object Detection Changhee Han, Yoshiro Kitamura, Akira Kudo, Akimichi Ichinose, Leonardo Rundo, Yujiro Furukawa, Kazuki Umemoto, Hideki Nakayama, Yuanzhong Li arXiv_CV arXiv_CV Segmentation 3D Adversarial Pose Detection VQA Object_Detection GAN Medical CNN PDF
2019-06-11 Mimic and Fool: A Task Agnostic Adversarial Attack Akshay Chaturvedi, Utpal Garain arXiv_CV arXiv_CV Image_Caption Segmentation Adversarial Pose Deep_Learning VQA Caption QA PDF
2019-06-10 Psycholinguistics meets Continual Learning: Measuring Catastrophic Forgetting in Visual Question Answering Claudio Greco, Barbara Plank, Raquel Fernández, Raffaella Bernardi arXiv_CL arXiv_CL VQA QA PDF
2019-06-10 Misleading Failures of Partial-input Baselines Shi Feng, Eric Wallace, Jordan Boyd-Graber arXiv_CV arXiv_CV VQA QA PDF
2019-06-03 Generating Question Relevant Captions to Aid Visual Question Answering Jialin Wu, Zeyuan Hu, Raymond J. Mooney arXiv_CV arXiv_CV Image_Caption Knowledge VQA Caption QA PDF
2019-05-31 OK-VQA: A Visual Question Answering Benchmark Requiring External Knowledge Kenneth Marino, Mohammad Rastegari, Ali Farhadi, Roozbeh Mottaghi arXiv_CV arXiv_CV Knowledge Detection VQA Object_Detection QA PDF
2019-05-31 Scene Text Visual Question Answering Ali Furkan Biten, Ruben Tito, Andres Mafla, Lluis Gomez, Marçal Rusiñol, Ernest Valveny, C.V. Jawahar, Dimosthenis Karatzas arXiv_CV arXiv_CV Recognition Pose Scene_Text VQA QA PDF
2019-05-31 Combining Noise-to-Image and Image-to-Image GANs: Brain MR Image Augmentation for Tumor Detection Changhee Han, Leonardo Rundo, Ryosuke Araki, Yudai Nagano, Yujiro Furukawa, Giancarlo Mauri, Hideki Nakayama, Hideaki Hayashi arXiv_CV arXiv_CV Unsupervised Adversarial Pose Classification Detection VQA GAN Medical CNN PDF
2019-05-29 Vision-to-Language Tasks Based on Attributes and Attention Mechanism Xuelong Li, Aihong Yuan, Xiaoqiang Lu arXiv_CV arXiv_CV Image_Caption Pose Relation VQA Attention Caption PDF
2019-05-28 Leveraging Medical Visual Question Answering with Supporting Facts Tomasz Kornuta, Deepta Rajan, Chaitanya Shivade, Alexis Asseman, Ahmet S. Ozcan arXiv_AI arXiv_AI Transfer_Learning VQA GAN Medical QA PDF
2019-05-28 Gaining Extra Supervision via Multi-task learning for Multi-Modal Video Question Answering Junyeong Kim, Minuk Ma, Kyungsu Kim, Sungjin Kim, Chang D. Yoo arXiv_CV arXiv_CV Multi_Task Pose VQA QA PDF
2019-05-26 Why do These Match? Explaining the Behavior of Image Similarity Models Bryan A. Plummer, Mariya I. Vasileva, Vitali Petsiuk, Kate Saenko, David Forsyth arXiv_CV arXiv_CV Recognition Salient Pose Classification Deep_Learning VQA Image_Classification PDF
2019-05-24 Self-Critical Reasoning for Robust Visual Question Answering Jialin Wu, Raymond J. Mooney arXiv_CV arXiv_CV Relation VQA QA PDF
2019-05-13 Quantifying and Alleviating the Language Prior Problem in Visual Question Answering Yangyang Guo, Zhiyong Cheng, Liqiang Nie, Yibing Liu, Yinglong Wang, Mohan Kankanhalli arXiv_CV arXiv_CV Regularization Pose Quantitative VQA Attention QA PDF
2019-05-01 State-of-the-art in 360° Video/Image Processing: Perception, Assessment and Compression Chen Li, Mai Xu, Shanyi Zhang, Patrick Le Callet arXiv_CV arXiv_CV Review Pose Survey VQA Attention QA PDF
2019-04-26 The Neuro-Symbolic Concept Learner: Interpreting Scenes, Words, and Sentences From Natural Supervision Jiayuan Mao, Chuang Gan, Pushmeet Kohli, Joshua B. Tenenbaum, Jiajun Wu arXiv_AI arXiv_AI Pose VQA PDF
2019-04-25 Scene Graph Prediction with Limited Labels Vincent S. Chen, Paroma Varma, Ranjay Krishna, Michael Bernstein, Christopher Re, Li Fei-Fei arXiv_CV arXiv_CV Transfer_Learning Sparse Knowledge Relation VQA Visual_Relation Caption Prediction PDF
2019-04-25 TVQA+: Spatio-Temporal Grounding for Video Question Answering Jie Lei, Licheng Yu, Tamara L. Berg, Mohit Bansal arXiv_AI arXiv_AI Pose VQA QA PDF
2019-04-19 Challenges and Prospects in Vision and Language Research Kushal Kafle, Robik Shrestha, Christopher Kanan arXiv_CV arXiv_CV Image_Caption Review Pose VQA PDF
2019-04-18 Towards VQA Models that can Read Amanpreet Singh, Vivek Natarajan, Meet Shah, Yu Jiang, Xinlei Chen, Dhruv Batra, Devi Parikh, Marcus Rohrbach arXiv_CV arXiv_CV Pose VQA QA PDF
2019-04-18 Progressive Attention Memory Network for Movie Story Question Answering Junyeong Kim, Minuk Ma, Kyungsu Kim, Sungjin Kim, Chang D. Yoo arXiv_CV arXiv_CV Pose VQA Attention Inference Prediction QA PDF
2019-04-17 Question Guided Modular Routing Networks for Visual Question Answering Yanze Wu, Qiang Sun, Jianqi Ma, Bin Li, Yanwei Fu, Yao Peng, Xiangyang Xue arXiv_CV arXiv_CV Knowledge Pose Face VQA QA PDF
2019-04-12 Evaluating the Representational Hub of Language and Vision Models Ravi Shekhar, Ece Takmaz, Raquel Fernández, Raffaella Bernardi arXiv_CV arXiv_CV Pose VQA PDF
2019-04-11 Factor Graph Attention Idan Schwartz, Seunghak Yu, Tamir Hazan, Alexander Schwing arXiv_AI arXiv_AI Pose VQA Attention PDF
2019-04-10 Text Guided Person Image Synthesis Xingran Zhou, Siyu Huang, Bin Li, Yingming Li, Jiachen Li, Zhongfei Zhang arXiv_CV arXiv_CV Pose VQA QA PDF
2019-04-09 Multi-Target Embodied Question Answering Licheng Yu, Xinlei Chen, Georgia Gkioxari, Mohit Bansal, Tamara L. Berg, Dhruv Batra arXiv_CV arXiv_CV Pose VQA QA PDF
2019-04-07 Transfer Learning via Unsupervised Task Discovery for Visual Question Answering Hyeonwoo Noh, Taehoon Kim, Jonghwan Mun, Bohyung Han arXiv_CL arXiv_CL Unsupervised Transfer_Learning Recognition Knowledge Pose VQA PDF
2019-04-05 Lucid Explanations Help: Using a Human-AI Image-Guessing Game to Evaluate Machine Explanation Helpfulness Arijit Ray, Giedrius Burachas, Yi Yao, Ajay Divakaran arXiv_CV arXiv_CV Pose VQA QA PDF
2019-04-05 Actively Seeking and Learning from Live Data Damien Teney, Anton van den Hengel arXiv_CV arXiv_CV Pose Face VQA Caption QA PDF
2019-04-04 MMED: A Multi-domain and Multi-modality Event Dataset Zhenguo Yan, Zehang Lin, Min Cheng, Qing Li, Wenyin Liu arXiv_CV arXiv_CV Knowledge VQA GAN PDF
2019-03-29 Relation-aware Graph Attention Network for Visual Question Answering Linjie Li, Zhe Gan, Yu Cheng, Jingjing Liu arXiv_AI arXiv_AI Pose Action Relation VQA Attention QA PDF
2019-03-27 Information Maximizing Visual Question Generation Ranjay Krishna, Michael Bernstein, Li Fei-Fei arXiv_CV arXiv_CV Pose Quantitative VQA PDF
2019-03-16 Visual Query Answering by Entity-Attribute Graph Matching and Reasoning Peixi Xiong, Huayi Zhan, Xin Wang, Baivab Sinha, Ying Wu arXiv_CV arXiv_CV Pose VQA Inference QA Matching PDF
2019-03-14 Episodic Memory Reader: Learning What to Remember for Question Answering from Streaming Data Moonsu Han, Minki Kang, Hyunwoo Jung, Sung Ju Hwang arXiv_CL arXiv_CL Transformer Pose VQA QA PDF
2019-03-13 AI2-THOR: An Interactive 3D Environment for Visual AI Eric Kolve, Roozbeh Mottaghi, Winson Han, Eli VanderBilt, Luca Weihs, Alvaro Herrasti, Daniel Gordon, Yuke Zhu, Abhinav Gupta, Ali Farhadi arXiv_AI arXiv_AI Segmentation Unsupervised Reinforcement_Learning 3D Represenation_Learning Action Detection VQA Object_Detection PDF
2019-03-07 RAVEN: A Dataset for Relational and Analogical Visual rEasoNing Chi Zhang, Feng Gao, Baoxiong Jia, Yixin Zhu, Song-Chun Zhu arXiv_AI arXiv_AI Tracking Recognition Pose Detection Relation VQA QA PDF
2019-03-01 Answer Them All! Toward Universal Visual Question Answering Models Robik Shrestha, Kushal Kafle, Christopher Kanan arXiv_CV arXiv_CV Image_Caption Pose VQA QA PDF
2019-02-26 Learning More with Less: Conditional PGGAN-based Data Augmentation for Brain Metastases Detection Using Highly-Rough Annotation on MR images Changhee Han, Kohei Murao, Tomoyuki Noguchi, Yusuke Kawata, Fumiya Uchiyama, Leonardo Rundo, Hideki Nakayama, Shin'ichi Satoh arXiv_CV arXiv_CV Adversarial Pose Detection VQA GAN Medical CNN PDF
2019-02-25 GQA: a new dataset for compositional question answering over real-world images Drew A. Hudson, Christopher D. Manning arXiv_AI arXiv_AI RNN VQA QA PDF
2019-02-25 MUREL: Multimodal Relational Reasoning for Visual Question Answering Remi Cadene, Hedi Ben-younes, Matthieu Cord, Nicolas Thome arXiv_AI arXiv_AI Pose Action Relation VQA Attention QA PDF
2019-02-25 Dual Attention Networks for Visual Reference Resolution in Visual Dialog Gi-Cheon Kang, Jaeseo Lim, Byoung-Tak Zhang arXiv_CV arXiv_CV Pose Quantitative Relation VQA Attention QA PDF
2019-02-21 Probabilistic Neural-symbolic Models for Interpretable Visual Question Answering Ramakrishna Vedantam, Karan Desai, Stefan Lee, Marcus Rohrbach, Dhruv Batra, Devi Parikh arXiv_AI arXiv_AI Pose VQA Prediction QA PDF
2019-02-15 Generating Natural Language Explanations for Visual Question Answering using Scene Graphs and Visual Attention Shalini Ghosh, Giedrius Burachas, Arijit Ray, Avi Ziskind arXiv_AI arXiv_AI Relation VQA Attention Caption Language_Model QA PDF
2019-02-15 Cycle-Consistency for Robust Visual Question Answering Meet Shah, Xinlei Chen, Marcus Rohrbach, Devi Parikh arXiv_CV arXiv_CV Pose VQA QA PDF
2019-02-11 Taking a HINT: Leveraging Explanations to Make Vision and Language Models More Grounded Ramprasaath R. Selvaraju, Stefan Lee, Yilin Shen, Hongxia Jin, Dhruv Batra, Devi Parikh arXiv_CV arXiv_CV Image_Caption Pose VQA Attention Caption Language_Model Prediction QA PDF
2019-02-01 Rethinking Visual Relationships for High-level Image Understanding Yuanzhi Liang, Yalong Bai, Wei Zhang, Xueming Qian, Li Zhu, Tao Mei arXiv_CV arXiv_CV Image_Caption Pose Action Relation VQA Visual_Relation Caption PDF
2019-01-31 BLOCK: Bilinear Superdiagonal Fusion for Visual Question Answering and Visual Relationship Detection Hedi Ben-younes, Rémi Cadene, Nicolas Thome, Matthieu Cord arXiv_CV arXiv_CV Represenation_Learning Action Deep_Learning Detection Relation VQA Visual_Relation QA PDF
2019-01-20 Visual Entailment: A Novel Task for Fine-Grained Image Understanding Ning Xie, Farley Lai, Derek Doran, Asim Kadav arXiv_CV arXiv_CV Image_Caption Pose VQA Attention Inference QA PDF
2019-01-18 Learning a Deep Convolution Network with Turing Test Adversaries for Microscopy Image Super Resolution Francis Tom, Himanshu Sharma, Dheeraj Mundhra, Tathagato Rai Dastidar, Debdoot Sheet arXiv_CV arXiv_CV Reconstruction Super_Resolution Adversarial Pose VQA Medical CNN PDF
2019-01-03 CLEVR-Ref+: Diagnosing Visual Reasoning with Referring Expressions Runtao Liu, Chenxi Liu, Yutong Bai, Alan Yuille arXiv_CV arXiv_CV Segmentation Knowledge Pose Quantitative Detection VQA Object_Detection PDF
2018-12-31 The meaning of 'most' for visual question answering models Alexander Kuhnle, Ann Copestake arXiv_AI arXiv_AI Deep_Learning VQA Inference PDF
2018-12-23 Multi-modal Learning with Prior Visual Relation Reasoning Zhuoqian Yang, Jing Yu, Chenghao Yang, Zengchang Qin, Yue Hu arXiv_CV arXiv_CV Image_Caption Embedding Knowledge Pose Relation VQA Visual_Relation CNN QA PDF
2018-12-13 Dynamic Fusion with Intra- and Inter- Modality Attention Flow for Visual Question Answering Gao Peng, Hongsheng Li, Haoxuan You, Zhengkai Jiang, Pan Lu, Steven Hoi, Xiaogang Wang arXiv_CV arXiv_CV Pose Action VQA Attention QA PDF
2018-12-12 Power of Tempospatially Unified Spectral Density for Perceptual Video Quality Assessment Mohammed A. Aabed, Gukyeong Kwon, Ghassan AlRegib arXiv_CV arXiv_CV 3D Pose Relation VQA QA PDF
2018-12-10 Learning Representations of Sets through Optimized Permutations Yan Zhang, Jonathon Hare, Adam Prügel-Bennett arXiv_CV arXiv_CV Pose Classification VQA PDF
2018-12-10 Spatial Knowledge Distillation to aid Visual Reasoning Somak Aditya, Rudra Saha, Yezhou Yang, Chitta Baral arXiv_CV arXiv_CV Knowledge Pose Relation VQA Attention Prediction PDF
2018-12-06 Recursive Visual Attention in Visual Dialog Yulei Niu, Hanwang Zhang, Manli Zhang, Jianhong Zhang, Zhiwu Lu, Ji-Rong Wen arXiv_CV arXiv_CV Pose Quantitative VQA Attention QA PDF
2018-12-05 Learning to Compose Dynamic Tree Structures for Visual Contexts Kaihua Tang, Hanwang Zhang, Baoyuan Wu, Wenhan Luo, Wei Liu arXiv_CV arXiv_CV Reinforcement_Learning RNN Pose Relation VQA QA PDF
2018-12-05 Explainable and Explicit Visual Reasoning over Scene Graphs Jiaxin Shi, Hanwang Zhang, Juanzi Li arXiv_CV arXiv_CV Knowledge Pose Relation VQA Attention QA PDF
2018-12-03 Multi-task Learning of Hierarchical Vision-Language Representation Duy-Kien Nguyen, Takayuki Okatani arXiv_CV arXiv_CV Image_Caption Knowledge Pose Relation VQA Attention Caption Prediction PDF
2018-11-30 Systematic Generalization: What Is Required and Can It Be Learned? Dzmitry Bahdanau, Shikhar Murty, Michael Noukhovitch, Thien Huu Nguyen, Harm de Vries, Aaron Courville arXiv_AI arXiv_AI Knowledge Pose VQA QA PDF
2018-11-30 From Known to the Unknown: Transferring Knowledge to Answer Questions about Novel Visual and Semantic Concepts Moshiur R Farazi, Salman H Khan, Nick Barnes arXiv_CV arXiv_CV Embedding Knowledge Pose VQA Attention Inference QA Matching PDF
2018-11-29 Visual Question Answering as Reading Comprehension Hui Li, Peng Wang, Chunhua Shen, Anton van den Hengel arXiv_CV arXiv_CV Knowledge Pose Action VQA QA PDF
2018-11-27 From Recognition to Cognition: Visual Commonsense Reasoning Rowan Zellers, Yonatan Bisk, Ali Farhadi, Yejin Choi arXiv_CV arXiv_CV Image_Caption Recognition Adversarial Action VQA Inference QA Matching PDF
2018-11-26 Visual Entailment Task for Visually-Grounded Language Learning Ning Xie, Farley Lai, Derek Doran, Asim Kadav arXiv_CV arXiv_CV Pose VQA Inference QA PDF
2018-11-26 CLEAR: A Dataset for Compositional Language and Elementary Acoustic Reasoning Jerome Abdelnour, Giampiero Salvi, Jean Rouat arXiv_CL arXiv_CL Knowledge Pose Relation VQA QA PDF
2018-11-20 VQA with no questions-answers training Ben-Zion Vatashsky, Shimon Ullman arXiv_CV arXiv_CV Pose VQA QA PDF
2018-11-19 Explicit Bias Discovery in Visual Question Answering Models Varun Manjunatha, Nirat Saini, Larry S. Davis arXiv_CV arXiv_CV VQA Attention QA PDF
2018-11-19 Large Scale Scene Text Verification with Guided Attention Dafang He, Yeqing Li, Alexander Gorban, Derrall Heath, Julian Ibarz, Qian Yu, Daniel Kifer, C. Lee Giles arXiv_CV arXiv_CV Recognition Pose Scene_Text Detection Relation VQA Attention Matching PDF
2018-11-02 Zero-Shot Transfer VQA Dataset Yuanpeng Li, Yi Yang, Jianyu Wang, Wei Xu arXiv_AI arXiv_AI Zero-Shot Knowledge Pose VQA GAN QA PDF
2018-11-01 Out of the Box: Reasoning with Graph Convolution Nets for Factual Visual Question Answering Medhini Narasimhan, Svetlana Lazebnik, Alexander G. Schwing arXiv_CV arXiv_CV Knowledge Relation VQA CNN QA PDF
2018-10-30 Compositional Attention Networks for Interpretability in Natural Language Question Answering Muru Selvakumar, Suriyadeepan Ramamoorthy, Vaidheeswaran Archana, Malaikannan Sankarasubbu arXiv_AI arXiv_AI Pose VQA Attention PDF
2018-10-30 Gated Hierarchical Attention for Image Captioning Qingzhong Wang, Antoni B. Chan arXiv_AI arXiv_AI Image_Caption Recognition Reinforcement_Learning Pose VQA Attention Caption CNN Prediction PDF
2018-10-29 TallyQA: Answering Complex Counting Questions Manoj Acharya, Kushal Kafle, Christopher Kanan arXiv_CV arXiv_CV Pose Detection Relation VQA Object_Detection QA PDF
2018-10-29 Do Explanations make VQA Models more Predictable to a Human? Arjun Chandrasekaran, Viraj Prabhu, Deshraj Yadav, Prithvijit Chattopadhyay, Devi Parikh arXiv_AI arXiv_AI VQA QA PDF
2018-10-25 Understand, Compose and Respond - Answering Visual Questions by a Composition of Abstract Procedures Ben Zion Vatashsky, Shimon Ullman arXiv_CV arXiv_CV Knowledge Pose Classification Detection Relation VQA PDF
2018-10-09 Knowing Where to Look? Analysis on Attention of Visual Question Answering System Wei Li, Zehuan Yuan, Xiangzhong Fang, Changhu Wang arXiv_CV arXiv_CV Action VQA Attention QA PDF
2018-10-08 Overcoming Language Priors in Visual Question Answering with Adversarial Regularization Sainandan Ramakrishnan, Aishwarya Agrawal, Stefan Lee arXiv_CV arXiv_CV Regularization Adversarial Pose Relation VQA QA PDF
2018-10-04 Neural-Symbolic VQA: Disentangling Reasoning from Vision and Language Understanding Kexin Yi, Jiajun Wu, Chuang Gan, Antonio Torralba, Pushmeet Kohli, Joshua B. Tenenbaum arXiv_CV arXiv_CV Recognition Represenation_Learning Knowledge VQA QA PDF
2018-09-26 Convolutional Neural Networks for Video Quality Assessment Michalis Giannopoulos, Grigorios Tsagkatakis, Saverio Blasi, Farzad Toutounchi, Athanasios Mouchtaris, Panagiotis Tsakalides, Marta Mrak, Ebroul Izquierdo arXiv_CV arXiv_CV Pose Action Deep_Learning VQA CNN QA PDF
2018-09-23 Textually Enriched Neural Module Networks for Visual Question Answering Khyathi Raghavi Chandu, Mary Arpita Pyreddy, Matthieu Felix, Narendra Nath Joshi arXiv_CV arXiv_CV Image_Caption Recognition Knowledge VQA Attention Caption QA PDF
2018-09-12 The Wisdom of MaSSeS: Majority, Subjectivity, and Semantic Similarity in the Evaluation of VQA Shailza Jolly, Sandro Pezzelle, Tassilo Klein, Andreas Dengel, Moin Nabi arXiv_AI arXiv_AI Pose Quantitative VQA QA PDF
2018-09-08 Faithful Multimodal Explanation for Visual Question Answering Jialin Wu, Raymond J. Mooney arXiv_CV arXiv_CV VQA QA PDF
2018-09-07 Adversarial Attacks Beyond the Image Space Xiaohui Zeng, Chenxi Liu, Yu-Siang Wang, Weichao Qiu, Lingxi Xie, Yu-Wing Tai, Chi Keung Tang, Alan L. Yuille arXiv_CV arXiv_CV 3D Adversarial Pose Face Classification VQA Attention Prediction PDF
2018-09-06 IQA: Visual Question Answering in Interactive Environments Daniel Gordon, Aniruddha Kembhavi, Mohammad Rastegari, Joseph Redmon, Dieter Fox, Ali Farhadi arXiv_CV arXiv_CV Reinforcement_Learning Pose Action VQA Autonomous QA PDF
2018-09-06 Cascaded Mutual Modulation for Visual Reasoning Yiqun Yao, Jiaming Xu, Feng Wang, Bo Xu arXiv_AI arXiv_AI Pose Action VQA PDF
2018-09-06 Visual Coreference Resolution in Visual Dialog using Neural Module Networks Satwik Kottur, José M. F. Moura, Devi Parikh, Dhruv Batra, Marcus Rohrbach arXiv_AI arXiv_AI Pose VQA QA PDF
2018-09-06 Interpretable Visual Question Answering by Reasoning on Dependency Trees Qingxing Cao, Xiaodan Liang, Bailin Li, Liang Lin arXiv_CV arXiv_CV Pose Relation VQA Attention QA PDF
2018-09-05 TVQA: Localized, Compositional Video Question Answering Jie Lei, Licheng Yu, Mohit Bansal, Tamara L. Berg arXiv_AI arXiv_AI VQA QA PDF
2018-09-04 Straight to the Facts: Learning Knowledge Base Retrieval for Factual Visual Question Answering Medhini Narasimhan, Alexander G. Schwing arXiv_AI arXiv_AI Embedding Knowledge Action VQA Autonomous Matching PDF
2018-08-29 From VQA to Multimodal CQA: Adapting Visual QA Models for Community QA Tasks Avikalp Srivastava, Hsin Wen Liu, Sumio Fujita arXiv_AI arXiv_AI Knowledge Pose Classification VQA QA PDF
2018-08-12 Multimodal Differential Network for Visual Question Generation Badri N. Patro, Sandeep Kumar, Vinod K. Kurmi, Vinay P. Namboodiri arXiv_CL arXiv_CL Pose Quantitative VQA Caption PDF
2018-08-08 Question-Guided Hybrid Convolution for Visual Question Answering Peng Gao, Pan Lu, Hongsheng Li, Shuang Li, Yikang Li, Steven Hoi, Xiaogang Wang arXiv_AI arXiv_AI Pose Relation VQA Attention Visual_Relation QA PDF
2018-08-07 A Joint Sequence Fusion Model for Video Question Answering and Retrieval Youngjae Yu, Jongseok Kim, Gunhee Kim arXiv_CV arXiv_CV 3D Pose VQA Attention CNN QA Matching PDF
2018-08-06 Visual Question Generation for Class Acquisition of Unknown Objects Kohei Uehara, Antonio Tejero-De-Pablos, Yoshitaka Ushiku, Tatsuya Harada arXiv_CV arXiv_CV Recognition Pose VQA PDF
2018-08-03 Visual Reasoning with Multi-hop Feature Modulation Florian Strub, Mathieu Seurin, Ethan Perez, Harm de Vries, Jérémie Mary, Philippe Preux, Aaron Courville, Olivier Pietquin arXiv_CV arXiv_CV Pose VQA CNN PDF
2018-08-01 Learning Visual Question Answering by Bootstrapping Hard Attention Mateusz Malinowski, Carl Doersch, Adam Santoro, Peter Battaglia arXiv_CL arXiv_CL VQA Attention PDF
2018-08-01 Interpretable Visual Question Answering by Visual Grounding from Attention Supervision Mining Yundong Zhang, Juan Carlos Niebles, Alvaro Soto arXiv_CL arXiv_CL Relation VQA Attention QA PDF
2018-07-29 Bridge the Gap Between VQA and Human Behavior on Omnidirectional Video: A Large-Scale Dataset and a Deep Learning Model Chen Li, Mai Xu, Xinzhe Du, Zulin Wang arXiv_CV arXiv_CV Pose Deep_Learning VQA QA PDF
2018-07-28 A user model for JND-based video quality assessment: theory and applications Haiqiang Wang, Ioannis Katsavounidis, Xinfeng Zhang, Chao Yang, C.-C. Jay Kuo arXiv_CV arXiv_CV Quantization Pose VQA Attention QA PDF
2018-07-26 Pythia v0.1: the Winning Entry to the VQA Challenge 2018 Yu Jiang, Vivek Natarajan, Xinlei Chen, Marcus Rohrbach, Dhruv Batra, Devi Parikh arXiv_CV arXiv_CV Face VQA QA PDF
2018-07-23 Question Relevance in Visual Question Answering Prakruthi Prabhakar, Nitish Kulkarni, Linghao Zhang arXiv_CV arXiv_CV Pose VQA QA PDF
2018-07-10 Latent Alignment and Variational Attention Yuntian Deng, Yoon Kim, Justin Chiu, Demi Guo, Alexander M. Rush arXiv_CL arXiv_CL Pose VQA Attention Inference PDF
2018-07-09 NMT-Keras: a Very Flexible Toolkit with a Focus on Interactive NMT and Online Learning Álvaro Peris, Francisco Casacuberta arXiv_CL arXiv_CL Video_Caption NMT Classification Deep_Learning VQA Caption PDF
2018-07-02 A JND-based Video Quality Assessment Model and Its Application Haiqiang Wang, Xinfeng Zhang, Chao Yang, C.-C. Jay Kuo arXiv_CV arXiv_CV Pose VQA QA PDF
2018-07-02 Transparency by Design: Closing the Gap Between Performance and Interpretability in Visual Reasoning David Mascharka, Philip Tran, Ryan Soklaski, Arjun Majumdar arXiv_CV arXiv_CV Pose VQA PDF
2018-06-21 End-to-End Audio Visual Scene-Aware Dialog using Multimodal Attention-Based Video Features Chiori Hori, Huda Alamri, Jue Wang, Gordon Winchern, Takaaki Hori, Anoop Cherian, Tim K. Marks, Vincent Cartillier, Raphael Gontijo Lopes, Abhishek Das, Irfan Essa, Dhruv Batra, Devi Parikh arXiv_CV arXiv_CV VQA Attention Caption QA PDF
2018-06-20 Learning Conditioned Graph Structures for Interpretable Visual Question Answering Will Norcliffe-Brown, Efstathios Vafeias, Sarah Parisot arXiv_CV arXiv_CV Image_Caption Pose Action Relation VQA QA PDF
2018-06-13 Learning Visual Knowledge Memory Networks for Visual Question Answering Zhou Su, Chen Zhu, Yinpeng Dong, Dongqi Cai, Yurong Chen, Jianguo Li arXiv_CV arXiv_CV Embedding Memory_Networks Knowledge Pose Relation VQA QA PDF
2018-06-12 iParaphrasing: Extracting Visually Grounded Paraphrases via an Image Chenhui Chu, Mayu Otani, Yuta Nakashima arXiv_CV arXiv_CV Image_Caption Pose VQA Attention Caption PDF
2018-06-08 CS-VQA: Visual Question Answering with Compressively Sensed Images Li-Chi Huang, Kuldeep Kulkarni, Anik Jha, Suhas Lohit, Suren Jayasuriya, Pavan Turaga arXiv_CV arXiv_CV Reconstruction Recognition VQA QA PDF
2018-06-03 On the Flip Side: Identifying Counterexamples in Visual Question Answering Gabriel Grand, Aron Szanto arXiv_CV arXiv_CV VQA Prediction QA PDF
2018-06-03 Don't Just Assume; Look and Answer: Overcoming Priors for Visual Question Answering Aishwarya Agrawal, Dhruv Batra, Devi Parikh, Aniruddha Kembhavi arXiv_CV arXiv_CV Recognition Pose Relation VQA Attention QA PDF
2018-05-26 Robustness Analysis of Visual QA Models by Basic Questions Jia-Hong Huang, Cuong Duc Dao, Modar Alfadly, C. Huck Yang, Bernard Ghanem arXiv_CV arXiv_CV Optimization Pose VQA QA PDF
2018-05-25 A Case for Variability-Aware Policies for NISQ-Era Quantum Computers Swamit S. Tannu, Moinuddin K.Qureshi arXiv_CV arXiv_CV Pose VQA QA PDF
2018-05-24 R-VQA: Learning Visual Relation Facts with Semantic Attention for Visual Question Answering Pan Lu, Lei Ji, Wei Zhang, Nan Duan, Ming Zhou, Jianyong Wang arXiv_CV arXiv_CV Embedding Knowledge Pose Detection Relation VQA Object_Detection Attention Visual_Relation QA PDF
2018-05-22 Joint Image Captioning and Question Answering Jialin Wu, Zeyuan Hu, Raymond J. Mooney arXiv_CV arXiv_CV Image_Caption Knowledge VQA Caption QA PDF
2018-05-21 Bilinear Attention Networks Jin-Hwa Kim, Jaehyun Jun, Byoung-Tak Zhang arXiv_CV arXiv_CV Pose Action Quantitative VQA Attention QA PDF
2018-05-20 Tree Memory Networks for Modelling Long-term Temporal Dependencies Tharindu Fernando, Simon Denman, Aaron McFadyen, Sridha Sridharan, Clinton Fookes arXiv_CV arXiv_CV Surveillance RNN Memory_Networks Speech Pose Relation VQA Prediction PDF
2018-05-11 Reciprocal Attention Fusion for Visual Question Answering Moshiur R Farazi, Salman Khan arXiv_CV arXiv_CV Pose Relation VQA Attention QA PDF
2018-05-09 VizWiz Grand Challenge: Answering Visual Questions from Blind People Danna Gurari, Qing Li, Abigale J. Stangl, Anhong Guo, Chi Lin, Kristen Grauman, Jiebo Luo, Jeffrey P. Bigham arXiv_CV arXiv_CV Pose VQA QA PDF
2018-05-08 The Effects of Statistical Multiplicity of Infection on Virus Quantification and Infectivity Assays Bhaven Mistry, Maria R. D'Orsogna, Tom Chou arXiv_CV arXiv_CV Pose Action VQA Activity QA PDF
2018-04-06 Generalized Hadamard-Product Fusion Operators for Visual Question Answering Brendan Duke, Graham W. Taylor arXiv_CV arXiv_CV NAS Pose VQA QA PDF
2018-04-06 Fooling Vision and Language Models Despite Localization and Attention Mechanism Xiaojun Xu, Xinyun Chen, Chang Liu, Anna Rohrbach, Trevor Darrell, Dawn Song arXiv_CV arXiv_CV Adversarial VQA Attention Caption Language_Model QA PDF
2018-04-06 Question Type Guided Attention in Visual Question Answering Yang Shi, Tommaso Furlanello, Sheng Zha, Animashree Anandkumar arXiv_CV arXiv_CV Recognition Pose VQA Attention Activity QA PDF
2018-04-03 Improved Fusion of Visual and Language Representations by Dense Symmetric Co-Attention for Visual Question Answering Duy-Kien Nguyen, Takayuki Okatani arXiv_CV arXiv_CV Pose Action VQA Attention Prediction QA PDF
2018-03-31 Visual Question Reasoning on General Dependency Tree Qingxing Cao, Xiaodan Liang, Bailing Li, Guanbin Li, Liang Lin arXiv_CV arXiv_CV Salient Knowledge Adversarial Pose Relation VQA Attention QA PDF
2018-03-29 Two can play this Game: Visual Dialog with Discriminative Question Generation and Answering Unnat Jain, Svetlana Lazebnik, Alexander Schwing arXiv_CV arXiv_CV Image_Caption VQA Caption PDF
2018-03-29 DVQA: Understanding Data Visualizations via Question Answering Kushal Kafle, Brian Price, Scott Cohen, Christopher Kanan arXiv_CV arXiv_CV Pose Face VQA QA PDF
2018-03-25 Visual Question Answering with Memory-Augmented Networks Chao Ma, Chunhua Shen, Anthony Dick, Qi Wu, Peng Wang, Anton van den Hengel, Ian Reid arXiv_CV arXiv_CV Pose VQA Attention QA PDF
2018-03-23 Explicit Reasoning over End-to-End Neural Architectures for Visual Question Answering Somak Aditya, Yezhou Yang, Chitta Baral arXiv_CV arXiv_CV Knowledge Face Relation VQA Visual_Relation Language_Model QA PDF
2018-03-21 Attention on Attention: Architectures for Visual Question Answering Jasdeep Singh, Vincent Ying, Alex Nutkiewicz arXiv_CV arXiv_CV NAS Deep_Learning VQA Attention QA PDF
2018-03-20 VQA-E: Explaining, Elaborating, and Enhancing Your Answers for Visual Questions Qing Li, Qingyi Tao, Shafiq Joty, Jianfei Cai, Jiebo Luo arXiv_CV arXiv_CV Pose Quantitative VQA Caption Prediction QA PDF
2018-03-16 Inverse Visual Question Answering: A New Benchmark and VQA Diagnosis Tool Feng Liu, Tao Xiang, Timothy M. Hospedales, Wankou Yang, Changyin Sun arXiv_CV arXiv_CV Reinforcement_Learning Pose VQA QA PDF
2018-03-16 iVQA: Inverse Visual Question Answering Feng Liu, Tao Xiang, Timothy M. Hospedales, Wankou Yang, Changyin Sun arXiv_CV arXiv_CV Pose VQA Attention Inference QA PDF
2018-03-16 A dataset and architecture for visual reasoning with a working memory Guangyu Robert Yang, Igor Ganichev, Xiao-Jing Wang, Jonathon Shlens, David Sussillo arXiv_CV arXiv_CV Zero-Shot Pose Deep_Learning VQA QA PDF
2018-03-14 Bottom-Up and Top-Down Attention for Image Captioning and Visual Question Answering Peter Anderson, Xiaodong He, Chris Buehler, Damien Teney, Mark Johnson, Stephen Gould, Lei Zhang arXiv_CV arXiv_CV Image_Caption Salient Pose VQA Attention Caption QA PDF
2018-03-08 ParlAI: A Dialog Research Software Platform Alexander H. Miller, Will Feng, Adam Fisch, Jiasen Lu, Dhruv Batra, Antoine Bordes, Devi Parikh, Jason Weston arXiv_CV arXiv_CV Reinforcement_Learning RNN Memory_Networks VQA QA PDF
2018-03-02 Interpretable Counting for Visual Question Answering Alexander Trott, Caiming Xiong, Richard Socher arXiv_CV arXiv_CV Action VQA QA PDF
2018-02-15 Learning to Count Objects in Natural Images for Visual Question Answering Yan Zhang, Jonathon Hare, Adam Prügel-Bennett arXiv_CV arXiv_CV Pose VQA Attention QA PDF
2018-02-07 Generating Triples with Adversarial Networks for Scene Graph Construction Matthew Klawonn, Eric Heim arXiv_CV arXiv_CV Image_Caption Adversarial Pose Classification Deep_Learning Detection Relation VQA Object_Detection Attention GAN Caption Image_Classification PDF
2018-02-01 Dual Recurrent Attention Units for Visual Question Answering Ahmed Osman, Wojciech Samek arXiv_CV arXiv_CV Embedding Pose Relation VQA Attention QA PDF
2018-01-29 Object-based reasoning in VQA Mikyas T. Desta, Larry Chen, Tomasz Kornuta arXiv_CV arXiv_CV Detection VQA Object_Detection QA PDF
2018-01-29 Game of Sketches: Deep Recurrent Models of Pictionary-style Word Guessing Ravi Kiran Sarvadevabhatla, Shiv Surya, Trisha Mittal, Venkatesh Babu Radhakrishnan arXiv_CV arXiv_CV Sketch Pose VQA QA PDF
2018-01-27 Tell-and-Answer: Towards Explainable Visual Question Answering using Attributes and Captions Qing Li, Jianlong Fu, Dongfei Yu, Tao Mei, Jiebo Luo arXiv_CV arXiv_CV Image_Caption Pose Detection VQA Object_Detection Attention Caption Inference QA PDF
2018-01-24 Structured Triplet Learning with POS-tag Guided Attention for Visual Question Answering Zhe Wang, Xiaoyi Liu, Liangjian Chen, Limin Wang, Yu Qiao, Xiaohui Xie, Charless Fowlkes arXiv_CV arXiv_CV Image_Caption Speech Action VQA Attention CNN QA PDF
2018-01-09 How to Fool Radiologists with Generative Adversarial Networks? A Visual Turing Test for Lung Cancer Diagnosis Maria J. M. Chuquicusma, Sarfaraz Hussein, Jeremy Burt, Ulas Bagci arXiv_AI arXiv_AI Unsupervised Adversarial Pose VQA GAN CNN PDF
2017-12-12 Co-attending Free-form Regions and Detections with Multi-modal Multiplicative Feature Embedding for Visual Question Answering Pan Lu, Hongsheng Li, Wei Zhang, Jianyong Wang, Xiaogang Wang arXiv_CV arXiv_CV Embedding Pose Detection VQA Attention QA PDF
2017-12-04 Learning by Asking Questions Ishan Misra, Ross Girshick, Rob Fergus, Martial Hebert, Abhinav Gupta, Laurens van der Maaten arXiv_CV arXiv_CV VQA QA PDF
2017-12-03 Incorporating External Knowledge to Answer Open-Domain Visual Questions with Dynamic Memory Networks Guohao Li, Hang Su, Wenwu Zhu arXiv_CV arXiv_CV Dynamic_Memory_Network Memory_Networks Knowledge Knowledge_Graph Pose Relation VQA Attention QA PDF
2017-12-03 TGIF-QA: Toward Spatio-Temporal Reasoning in Visual Question Answering Yunseok Jang, Yale Song, Youngjae Yu, Youngjin Kim, Gunhee Kim arXiv_CV arXiv_CV RNN Pose VQA Attention QA PDF
2017-11-22 Visual Question Answering as a Meta Learning Task Damien Teney, Anton van den Hengel arXiv_CV arXiv_CV Pose VQA QA PDF
2017-11-20 Visual Reference Resolution using Attention Memory for Visual Dialog Paul Hongsuck Seo, Andreas Lehrmann, Bohyung Han, Leonid Sigal arXiv_CV arXiv_CV Pose VQA Attention Prediction QA PDF
2017-11-19 A Novel Framework for Robustness Analysis of Visual QA Models Jia-Hong Huang, Cuong Duc Dao, Modar Alfadly, Bernard Ghanem arXiv_CV arXiv_CV Optimization Adversarial Pose VQA Attention QA PDF
2017-11-12 High-Order Attention Models for Visual Question Answering Idan Schwartz, Alexander G. Schwing, Tamir Hazan arXiv_CV arXiv_CV Pose Relation VQA Attention QA PDF
2017-11-06 Active Learning for Visual Question Answering: An Empirical Study Xiao Lin, Devi Parikh arXiv_CV arXiv_CV Pose VQA QA PDF
2017-10-16 Aligned Image-Word Representations Improve Inductive Transfer Across Vision-Language Tasks Tanmay Gupta, Kevin Shih, Saurabh Singh, Derek Hoiem arXiv_CV arXiv_CV Embedding Recognition VQA QA PDF
2017-10-15 Optimally Stopped Variational Quantum Algorithms Walter Vinci, Alireza Shabani arXiv_CV arXiv_CV Optimization Pose VQA QA PDF
2017-10-02 It Takes Two to Tango: Towards Theory of AI's Mind Arjun Chandrasekaran, Deshraj Yadav, Prithvijit Chattopadhyay, Viraj Prabhu, Devi Parikh arXiv_CV arXiv_CV Knowledge VQA