Paper Reading AI Learner

Searching for MobileNetV3

2019-05-06 19:38:31
Andrew Howard, Mark Sandler, Grace Chu, Liang-Chieh Chen, Bo Chen, Mingxing Tan, Weijun Wang, Yukun Zhu, Ruoming Pang, Vijay Vasudevan, Quoc V. Le, Hartwig Adam

Abstract

We present the next generation of MobileNets based on a combination of complementary search techniques as well as a novel architecture design. MobileNetV3 is tuned to mobile phone CPUs through a combination of hardware aware network architecture search (NAS) complemented by the NetAdapt algorithm and then subsequently improved through novel architecture advances. This paper starts the exploration of how automated search algorithms and network design can work together to harness complementary approaches improving the overall state of the art. Through this process we create two new MobileNet models for release: MobileNetV3-Large and MobileNetV3-Small which are targeted for high and low resource use cases. These models are then adapted and applied to the tasks of object detection and semantic segmentation. For the task of semantic segmentation (or any dense pixel prediction), we propose a new efficient segmentation decoder Lite Reduced Atrous Spatial Pyramid Pooling (LR-ASPP). We achieve new state of the art results for mobile classification, detection and segmentation. MobileNetV3-Large is 3.2% more accurate on ImageNet classification while reducing latency by 15% compared to MobileNetV2. MobileNetV2-Small is 4.6% more accurate while reducing latency by 5% compared to MobileNetV2. MobileNetV3-Large detection is 25% faster at roughly the same accuracy as MobileNetV2 on COCO detection. MobileNetV3-Large LR-ASPP is 30% faster than MobileNetV2 R-ASPP at similar accuracy for Cityscapes segmentation.

Abstract (translated)

我们介绍了基于互补搜索技术和新颖的体系结构设计相结合的下一代MobileNet。MobileNetv3通过硬件感知网络体系结构搜索(NAS)与Netadapt算法相结合,调到移动电话CPU,然后通过新的体系结构改进进行改进。本文开始探索自动搜索算法和网络设计如何协同工作,以利用互补的方法来提高整体技术水平。通过这个过程,我们为发布创建了两个新的mobilenet模型:mobilenetv3 large和mobilenetv3 small,它们是针对高和低资源使用情况的。然后将这些模型应用到对象检测和语义分割任务中。针对语义分割(或任何密集像素预测)的任务,我们提出了一种新的高效分割译码器Lite-Reduced Atrus空间金字塔池(LR-ASPP)。我们在移动分类、检测和分割方面取得了新的先进成果。与mobilenetv2相比,mobilenetv3 large在imagenet分类上更精确3.2%,同时将延迟降低了15%。与mobilenetv2相比,mobilenetv2 small的精确度提高了4.6%,同时将延迟降低了5%。mobilenetv3大型检测速度快25%,与mobilenetv2在COCO检测上的精度大致相同。mobilenetv3大型LR-ASPP比mobilenetv2 R-ASPP快30%,在城市景观分割方面具有相似的准确性。

URL

https://arxiv.org/abs/1905.02244

PDF

https://arxiv.org/pdf/1905.02244.pdf


Tags
3D Action Action_Localization Action_Recognition Activity Adversarial Agent Attention Autonomous Bert Boundary_Detection Caption Chat Classification CNN Compressive_Sensing Contour Contrastive_Learning Deep_Learning Denoising Detection Dialog Diffusion Drone Dynamic_Memory_Network Edge_Detection Embedding Embodied Emotion Enhancement Face Face_Detection Face_Recognition Facial_Landmark Few-Shot Gait_Recognition GAN Gaze_Estimation Gesture Gradient_Descent Handwriting Human_Parsing Image_Caption Image_Classification Image_Compression Image_Enhancement Image_Generation Image_Matting Image_Retrieval Inference Inpainting Intelligent_Chip Knowledge Knowledge_Graph Language_Model Matching Medical Memory_Networks Multi_Modal Multi_Task NAS NMT Object_Detection Object_Tracking OCR Ontology Optical_Character Optical_Flow Optimization Person_Re-identification Point_Cloud Portrait_Generation Pose Pose_Estimation Prediction QA Quantitative Quantitative_Finance Quantization Re-identification Recognition Recommendation Reconstruction Regularization Reinforcement_Learning Relation Relation_Extraction Represenation Represenation_Learning Restoration Review RNN Salient Scene_Classification Scene_Generation Scene_Parsing Scene_Text Segmentation Self-Supervised Semantic_Instance_Segmentation Semantic_Segmentation Semi_Global Semi_Supervised Sence_graph Sentiment Sentiment_Classification Sketch SLAM Sparse Speech Speech_Recognition Style_Transfer Summarization Super_Resolution Surveillance Survey Text_Classification Text_Generation Tracking Transfer_Learning Transformer Unsupervised Video_Caption Video_Classification Video_Indexing Video_Prediction Video_Retrieval Visual_Relation VQA Weakly_Supervised Zero-Shot