Paper Reading AI Learner

Activity-Dependent Plasticity in Morphogenetically-Grown Recurrent Networks

2026-04-03 18:35:13
Sergii Medvid, Andrii Valenia, Mykola Glybovets

Abstract

Developmental approaches to neural architecture search grow functional networks from compact genomes through self-organisation, but the resulting networks operate with fixed post-growth weights. We characterise Hebbian and anti-Hebbian plasticity across 50,000 morphogenetically grown recurrent controllers (5M+ configurations on CartPole and Acrobot), then test whether co-evolutionary experiments -- where plasticity parameters are encoded in the genome and evolved alongside the developmental architecture -- recover these patterns independently. Our characterisation reveals that (1) anti-Hebbian plasticity significantly outperforms Hebbian for competent networks (Cohen's d = 0.53-0.64), (2) regret (fraction of oracle improvement lost under the best fixed setting) reaches 52-100%, and (3) plasticity's role shifts from fine-tuning to genuine adaptation under non-stationarity. Co-evolution independently discovers these patterns: on CartPole, 70% of runs evolve anti-Hebbian plasticity (p = 0.043); on Acrobot, evolution finds near-zero eta with mixed signs -- exactly matching the characterisation. A random-RNN control shows that anti-Hebbian dominance is generic to small recurrent networks, but the degree of topology-dependence is developmental-specific: regret is 2-6x higher for morphogenetically grown networks than for random graphs with matched topology statistics.

Abstract (translated)

神经架构搜索的发展方法通过自组织从紧凑基因组中生成功能网络,但生成的网络使用固定的生长后权重运行。我们在5万个形态发生生长的循环控制器(在CartPole和Acrobot上超过500万个配置)中刻画赫布与反赫布可塑性,并检验协同进化实验——其中可塑性参数被编码在基因组中并与发育架构共同进化——是否能独立复现这些模式。我们的刻画揭示:(1) 对于胜任的网络,反赫布可塑性显著优于赫布可塑性(Cohen's d = 0.53-0.64);(2) 遗憾(在最佳固定设置下损失的神谕改进比例)达到52-100%;(3) 在非平稳条件下,可塑性的角色从微调转变为真正的适应。协同进化独立发现了这些模式:在CartPole上,70%的运行进化出反赫布可塑性(p = 0.043);在Acrobot上,进化发现接近零的eta且符号混合——与刻画完全匹配。随机RNN对照表明,反赫布主导性对小规模循环网络具有普遍性,但拓扑依赖程度具有发育特异性:形态发生生长的网络的遗憾比拓扑统计匹配的随机图高2-6倍。

URL

https://arxiv.org/abs/2604.03386

PDF

https://arxiv.org/pdf/2604.03386.pdf


Tags
3D Action Action_Localization Action_Recognition Activity Adversarial Agent Attention Autonomous Bert Boundary_Detection Caption Chat Classification CNN Compressive_Sensing Contour Contrastive_Learning Deep_Learning Denoising Detection Dialog Diffusion Drone Dynamic_Memory_Network Edge_Detection Embedding Embodied Emotion Enhancement Face Face_Detection Face_Recognition Facial_Landmark Few-Shot Gait_Recognition GAN Gaze_Estimation Gesture Gradient_Descent Handwriting Human_Parsing Image_Caption Image_Classification Image_Compression Image_Enhancement Image_Generation Image_Matting Image_Retrieval Inference Inpainting Intelligent_Chip Knowledge Knowledge_Graph Language_Model LLM Matching Medical Memory_Networks Multi_Modal Multi_Task NAS NMT Object_Detection Object_Tracking OCR Ontology Optical_Character Optical_Flow Optimization Person_Re-identification Point_Cloud Portrait_Generation Pose Pose_Estimation Prediction QA Quantitative Quantitative_Finance Quantization Re-identification Recognition Recommendation Reconstruction Regularization Reinforcement_Learning Relation Relation_Extraction Represenation Represenation_Learning Restoration Review RNN Robot Salient Scene_Classification Scene_Generation Scene_Parsing Scene_Text Segmentation Self-Supervised Semantic_Instance_Segmentation Semantic_Segmentation Semi_Global Semi_Supervised Sence_graph Sentiment Sentiment_Classification Sketch SLAM Sparse Speech Speech_Recognition Style_Transfer Summarization Super_Resolution Surveillance Survey Text_Classification Text_Generation Time_Series Tracking Transfer_Learning Transformer Unsupervised Video_Caption Video_Classification Video_Indexing Video_Prediction Video_Retrieval Visual_Relation VQA Weakly_Supervised Zero-Shot