Abstract
We introduce the WorldScore benchmark, the first unified benchmark for world generation. We decompose world generation into a sequence of next-scene generation tasks with explicit camera trajectory-based layout specifications, enabling unified evaluation of diverse approaches from 3D and 4D scene generation to video generation models. The WorldScore benchmark encompasses a curated dataset of 3,000 test examples that span diverse worlds: static and dynamic, indoor and outdoor, photorealistic and stylized. The WorldScore metrics evaluate generated worlds through three key aspects: controllability, quality, and dynamics. Through extensive evaluation of 19 representative models, including both open-source and closed-source ones, we reveal key insights and challenges for each category of models. Our dataset, evaluation code, and leaderboard can be found at this https URL
Abstract (translated)
我们介绍了WorldScore基准测试，这是第一个用于世界生成的统一基准。我们将世界生成分解为一系列基于明确摄像机轨迹布局规范的下一场景生成任务，从而能够对从3D和4D场景生成到视频生成模型等多样方法进行统一评估。WorldScore基准测试包括一个精心策划的数据集，包含3,000个测试示例，涵盖了多样的世界：静态与动态、室内与室外、写实主义和风格化。 WorldScore指标通过三个关键方面来评价生成的世界：可控性、质量和动态特性。通过对19种代表性模型（包括开源和闭源模型）进行广泛的评估，我们揭示了每类模型的关键见解和挑战。我们的数据集、评估代码及排行榜可在此链接获取：[https URL]
URL
https://arxiv.org/abs/2504.00983
