Abstract
The principal goal of the RAG TREC Instrument for Multilingual Evaluation (RAGTIME) track at TREC is to study report generation from multilingual source documents. The track has created a document collection containing Arabic, Chinese, English, and Russian news stories. RAGTIME includes three task types: Multilingual Report Generation, English Report Generation, and Multilingual Information Retrieval (MLIR). A total of 125 runs were submitted by 13 participating teams (and as baselines by the track coordinators) for three tasks. This overview describes these three tasks and presents the available results.
Abstract (translated)
RAG TREC 多语言评估(RAGTIME)赛道的主要目标是研究从多语种源文档生成报告。该赛道创建了一个包含阿拉伯语、中文、英语和俄语文本的文档集,其中包括新闻故事等资料。RAGTIME 包括三种任务类型:多语言报告生成、英语报告生成以及多语言信息检索(MLIR)。共有13支参赛队伍提交了总计125份成果(其中一些由赛道协调员作为基准提供)用于这三个任务。本概览将描述这三项任务,并展示现有结果。
URL
https://arxiv.org/abs/2602.10024