Paper Reading AI Learner

How to Sample High Quality 3D Fractals for Action Recognition Pre-Training?

2026-02-12 10:48:25
Marko Putak, Thomas B. Moeslund, Joakim Bruslund Haurum

Abstract

Synthetic datasets are being recognized in the deep learning realm as a valuable alternative to exhaustively labeled real data. One such synthetic data generation method is Formula Driven Supervised Learning (FDSL), which can provide an infinite number of perfectly labeled data through a formula driven approach, such as fractals or contours. FDSL does not have common drawbacks like manual labor, privacy and other ethical concerns. In this work we generate 3D fractals using 3D Iterated Function Systems (IFS) for pre-training an action recognition model. The fractals are temporally transformed to form a video that is used as a pre-training dataset for downstream task of action recognition. We find that standard methods of generating fractals are slow and produce degenerate 3D fractals. Therefore, we systematically explore alternative ways of generating fractals and finds that overly-restrictive approaches, while generating aesthetically pleasing fractals, are detrimental for downstream task performance. We propose a novel method, Targeted Smart Filtering, to address both the generation speed and fractal diversity issue. The method reports roughly 100 times faster sampling speed and achieves superior downstream performance against other 3D fractal filtering methods.

Abstract (translated)

合成数据在深度学习领域中被认为是一种有价值的现实标记数据的替代方案。其中一种生成合成数据的方法是公式驱动监督学习(Formula Driven Supervised Learning,FDSL),它可以通过公式驱动的方式,如分形或轮廓,提供无限量的完美标注数据,而无需人工劳动,并且避免了隐私和其他伦理问题。在这项工作中,我们使用3D迭代函数系统(IFS)生成3D分形来预训练动作识别模型。这些分形在时间上变换形成视频,作为下游动作识别任务的预训练数据集。 我们发现传统的生成分形的方法速度慢,并且产生的三维分形质量较差。因此,我们系统地探索了替代方法以生成分形,结果发现过于严格的限制性方法虽然可以产生美观的分形图像,但对下游任务性能有害。为此,我们提出了一种新的方法——目标智能过滤法(Targeted Smart Filtering),旨在同时解决生成速度和分形多样性的问题。该方法报告称采样速度快了大约100倍,并且在与其他3D分形筛选方法相比时,在下游任务中表现出色。

URL

https://arxiv.org/abs/2602.11810

PDF

https://arxiv.org/pdf/2602.11810.pdf


Tags
3D Action Action_Localization Action_Recognition Activity Adversarial Agent Attention Autonomous Bert Boundary_Detection Caption Chat Classification CNN Compressive_Sensing Contour Contrastive_Learning Deep_Learning Denoising Detection Dialog Diffusion Drone Dynamic_Memory_Network Edge_Detection Embedding Embodied Emotion Enhancement Face Face_Detection Face_Recognition Facial_Landmark Few-Shot Gait_Recognition GAN Gaze_Estimation Gesture Gradient_Descent Handwriting Human_Parsing Image_Caption Image_Classification Image_Compression Image_Enhancement Image_Generation Image_Matting Image_Retrieval Inference Inpainting Intelligent_Chip Knowledge Knowledge_Graph Language_Model LLM Matching Medical Memory_Networks Multi_Modal Multi_Task NAS NMT Object_Detection Object_Tracking OCR Ontology Optical_Character Optical_Flow Optimization Person_Re-identification Point_Cloud Portrait_Generation Pose Pose_Estimation Prediction QA Quantitative Quantitative_Finance Quantization Re-identification Recognition Recommendation Reconstruction Regularization Reinforcement_Learning Relation Relation_Extraction Represenation Represenation_Learning Restoration Review RNN Robot Salient Scene_Classification Scene_Generation Scene_Parsing Scene_Text Segmentation Self-Supervised Semantic_Instance_Segmentation Semantic_Segmentation Semi_Global Semi_Supervised Sence_graph Sentiment Sentiment_Classification Sketch SLAM Sparse Speech Speech_Recognition Style_Transfer Summarization Super_Resolution Surveillance Survey Text_Classification Text_Generation Time_Series Tracking Transfer_Learning Transformer Unsupervised Video_Caption Video_Classification Video_Indexing Video_Prediction Video_Retrieval Visual_Relation VQA Weakly_Supervised Zero-Shot