Paper Reading AI Learner

HiNet: A Novel Multi-Scenario & Multi-Task Learning Approach with Hierarchical Information Extraction

2023-03-10 17:24:41
Jie Zhou, Xianshuai Cao, Wenhao Li, Kun Zhang, Chuan Luo, Qian Yu

Abstract

Multi-scenario & multi-task learning has been widely applied to many recommendation systems in industrial applications, wherein an effective and practical approach is to carry out multi-scenario transfer learning on the basis of the Mixture-of-Expert (MoE) architecture. However, the MoE-based method, which aims to project all information in the same feature space, cannot effectively deal with the complex relationships inherent among various scenarios and tasks, resulting in unsatisfactory performance. To tackle the problem, we propose a Hierarchical information extraction Network (HiNet) for multi-scenario and multi-task recommendation, which achieves hierarchical extraction based on coarse-to-fine knowledge transfer scheme. The multiple extraction layers of the hierarchical network enable the model to enhance the capability of transferring valuable information across scenarios while preserving specific features of scenarios and tasks. Furthermore, a novel scenario-aware attentive network module is proposed to model correlations between scenarios explicitly. Comprehensive experiments conducted on real-world industrial datasets from Meituan Meishi platform demonstrate that HiNet achieves a new state-of-the-art performance and significantly outperforms existing solutions. HiNet is currently fully deployed in two scenarios and has achieved 2.87% and 1.75% order quantity gain respectively.

Abstract (translated)

多场景和多任务学习已经被广泛应用于工业应用中的许多推荐系统,其中一种有效且实用的方法是基于专家混合(MoE)架构进行多场景迁移学习。然而,基于MoE的方法旨在将所有信息放在相同的特征空间中,无法有效地处理各种场景和任务之间的复杂关系,导致性能不佳。为了解决这个问题,我们提出了一种Hierarchical information extraction Network(HiNet)多场景和多任务推荐,该方法基于细粒度知识传输方案实现Hierarchical提取。HiNet的多个提取层使模型能够增强在不同场景间传输有价值的信息的能力,同时保留场景和任务的特定特征。此外,我们提出了一种名为场景 aware attention network module的新模块,以 explicitly Modeling场景间的关系。从 Meituan Meishi 平台获取的真实工业数据集的 comprehensive 实验表明,HiNet实现了一种新的高性能,并显著优于现有的解决方案。HiNet目前完全部署在两个场景中,并分别实现了2.87%和1.75%的订单量增益。

URL

https://arxiv.org/abs/2303.06095

PDF

https://arxiv.org/pdf/2303.06095.pdf


Tags
3D Action Action_Localization Action_Recognition Activity Adversarial Agent Attention Autonomous Bert Boundary_Detection Caption Chat Classification CNN Compressive_Sensing Contour Contrastive_Learning Deep_Learning Denoising Detection Dialog Diffusion Drone Dynamic_Memory_Network Edge_Detection Embedding Embodied Emotion Enhancement Face Face_Detection Face_Recognition Facial_Landmark Few-Shot Gait_Recognition GAN Gaze_Estimation Gesture Gradient_Descent Handwriting Human_Parsing Image_Caption Image_Classification Image_Compression Image_Enhancement Image_Generation Image_Matting Image_Retrieval Inference Inpainting Intelligent_Chip Knowledge Knowledge_Graph Language_Model Matching Medical Memory_Networks Multi_Modal Multi_Task NAS NMT Object_Detection Object_Tracking OCR Ontology Optical_Character Optical_Flow Optimization Person_Re-identification Point_Cloud Portrait_Generation Pose Pose_Estimation Prediction QA Quantitative Quantitative_Finance Quantization Re-identification Recognition Recommendation Reconstruction Regularization Reinforcement_Learning Relation Relation_Extraction Represenation Represenation_Learning Restoration Review RNN Salient Scene_Classification Scene_Generation Scene_Parsing Scene_Text Segmentation Self-Supervised Semantic_Instance_Segmentation Semantic_Segmentation Semi_Global Semi_Supervised Sence_graph Sentiment Sentiment_Classification Sketch SLAM Sparse Speech Speech_Recognition Style_Transfer Summarization Super_Resolution Surveillance Survey Text_Classification Text_Generation Tracking Transfer_Learning Transformer Unsupervised Video_Caption Video_Classification Video_Indexing Video_Prediction Video_Retrieval Visual_Relation VQA Weakly_Supervised Zero-Shot