Abstract
The increasing popularity of personalized avatar systems, such as Snapchat Bitmojis and Apple Memojis, highlights the growing demand for digital self-representation. Despite their widespread use, existing avatar platforms face significant limitations, including restricted expressivity due to predefined assets, tedious customization processes, or inefficient rendering requirements. Addressing these shortcomings, we introduce Snapmoji, an avatar generation system that instantly creates animatable, dual-stylized avatars from a selfie. We propose Gaussian Domain Adaptation (GDA), which is pre-trained on large-scale Gaussian models using 3D data from sources such as Objaverse and fine-tuned with 2D style transfer tasks, endowing it with a rich 3D prior. This enables Snapmoji to transform a selfie into a primary stylized avatar, like the Bitmoji style, and apply a secondary style, such as Plastic Toy or Alien, all while preserving the user's identity and the primary style's integrity. Our system is capable of producing 3D Gaussian avatars that support dynamic animation, including accurate facial expression transfer. Designed for efficiency, Snapmoji achieves selfie-to-avatar conversion in just 0.9 seconds and supports real-time interactions on mobile devices at 30 to 40 frames per second. Extensive testing confirms that Snapmoji outperforms existing methods in versatility and speed, making it a convenient tool for automatic avatar creation in various styles.
Abstract (translated)
个性化头像系统（如 Snapchat Bitmojis 和 Apple Memojis）日益流行，这表明了数字自我表达需求的增长。尽管这些平台被广泛使用，但现有的头像生成工具仍然存在一些显著的局限性，包括由于预定义资产导致的表情限制、繁琐的自定义过程或低效的渲染要求。为了克服这些问题，我们提出了 Snapmoji，这是一种能够从用户自拍照片即时创建可动画化且具有双风格化的头像系统。 Snapmoji 使用高斯领域适应（Gaussian Domain Adaptation, GDA）技术进行工作，该技术预先在大型高斯模型上训练，并使用如 Objaverse 等来源的 3D 数据集进行了微调，使其具备丰富的 3D 先验知识。这使得 Snapmoji 能够将自拍照片转换为像 Bitmoji 这样的基础风格化头像，并可以应用额外的样式，例如塑料玩具或外星人风格，同时保持用户的身份和原始风格的真实性和完整性。 Snapmoji 系统能够生成支持动态动画的 3D 高斯头像，包括准确的表情传递。为了提高效率，Snapmoji 实现了在仅需 0.9 秒内完成自拍到头像转换，并且能够在移动设备上以每秒 30 到 40 帧的速度支持实时互动。广泛的测试表明，与现有方法相比，Snapmoji 在多样性和速度方面具有优势，使其成为创建各种风格的自动头像的理想工具。
URL
https://arxiv.org/abs/2503.11978
