Paper Reading AI Learner

Gradient-based Fuzzy System Optimisation via Automatic Differentiation -- FuzzyR as a Use Case

2024-03-18 23:18:16
Chao Chen, Christian Wagner, Jonathan M. Garibaldi

Abstract

Since their introduction, fuzzy sets and systems have become an important area of research known for its versatility in modelling, knowledge representation and reasoning, and increasingly its potential within the context explainable AI. While the applications of fuzzy systems are diverse, there has been comparatively little advancement in their design from a machine learning perspective. In other words, while representations such as neural networks have benefited from a boom in learning capability driven by an increase in computational performance in combination with advances in their training mechanisms and available tool, in particular gradient descent, the impact on fuzzy system design has been limited. In this paper, we discuss gradient-descent-based optimisation of fuzzy systems, focussing in particular on automatic differentiation--crucial to neural network learning--with a view to free fuzzy system designers from intricate derivative computations, allowing for more focus on the functional and explainability aspects of their design. As a starting point, we present a use case in FuzzyR which demonstrates how current fuzzy inference system implementations can be adjusted to leverage powerful features of automatic differentiation tools sets, discussing its potential for the future of fuzzy system design.

Abstract (translated)

自它们被引入以来,模糊集合和系统已成为一个重要的研究领域,以其在建模、知识表示和推理方面的灵活性而闻名,并且随着越来越多的应用于可解释性AI,其在该背景下的潜力也越来越受到关注。虽然模糊系统的应用领域各不相同,但从机器学习角度来看,它们的設計并没有取得太多進展。换句话说,虽然像神經网络這樣的表示形式从計算性能的提高以及訓練機制和可用工具的進步中受益,但在特別是大於神經網絡訓練強度的梯度下降的影響下,模糊系統的設計影響有限。在本文中,我們討論了基於梯度下降的模糊系統優化,重點關注自動 differentiation--關鍵於神經網絡學習--以 free fuzzy system designers from intricate derivative computations, allowing for more focus on the functional and explainability aspects of their design. 作為開始,我們在FuzzyR中展示了如何將 current fuzzy inference system implementations調整以利用自動 differentiation工具集的強大功能,探討其對未來模糊系統設計的潛力。

URL

https://arxiv.org/abs/2403.12308

PDF

https://arxiv.org/pdf/2403.12308.pdf


Tags
3D Action Action_Localization Action_Recognition Activity Adversarial Agent Attention Autonomous Bert Boundary_Detection Caption Chat Classification CNN Compressive_Sensing Contour Contrastive_Learning Deep_Learning Denoising Detection Dialog Diffusion Drone Dynamic_Memory_Network Edge_Detection Embedding Embodied Emotion Enhancement Face Face_Detection Face_Recognition Facial_Landmark Few-Shot Gait_Recognition GAN Gaze_Estimation Gesture Gradient_Descent Handwriting Human_Parsing Image_Caption Image_Classification Image_Compression Image_Enhancement Image_Generation Image_Matting Image_Retrieval Inference Inpainting Intelligent_Chip Knowledge Knowledge_Graph Language_Model LLM Matching Medical Memory_Networks Multi_Modal Multi_Task NAS NMT Object_Detection Object_Tracking OCR Ontology Optical_Character Optical_Flow Optimization Person_Re-identification Point_Cloud Portrait_Generation Pose Pose_Estimation Prediction QA Quantitative Quantitative_Finance Quantization Re-identification Recognition Recommendation Reconstruction Regularization Reinforcement_Learning Relation Relation_Extraction Represenation Represenation_Learning Restoration Review RNN Robot Salient Scene_Classification Scene_Generation Scene_Parsing Scene_Text Segmentation Self-Supervised Semantic_Instance_Segmentation Semantic_Segmentation Semi_Global Semi_Supervised Sence_graph Sentiment Sentiment_Classification Sketch SLAM Sparse Speech Speech_Recognition Style_Transfer Summarization Super_Resolution Surveillance Survey Text_Classification Text_Generation Tracking Transfer_Learning Transformer Unsupervised Video_Caption Video_Classification Video_Indexing Video_Prediction Video_Retrieval Visual_Relation VQA Weakly_Supervised Zero-Shot