Abstract
The paper discusses the capacities and limitations of current artificial intelligence (AI) technology to solve word problems that combine elementary knowledge with commonsense reasoning. No existing AI systems can solve these reliably. We review three approaches that have been developed, using AI natural language technology: outputting the answer directly, outputting a computer program that solves the problem, and outputting a formalized representation that can be input to an automated theorem verifier. We review some benchmarks that have been developed to evaluate these systems and some experimental studies. We argue that it is not clear whether these kinds of limitations will be important in developing AI technology for pure mathematical research, but that they will be important in applications of mathematics, and may well be important in developing programs capable of reading and understanding mathematical content written by humans.
Abstract (translated)
本论文讨论了当前人工智能(AI)技术解决结合基本知识和常识推理的语言问题的能力及其限制。目前,没有任何现有的AI系统能够可靠地解决这些问题。我们综述了三种使用AI自然语言技术开发的方案:直接输出答案、输出能够解决该问题的计算机程序,以及输出一种可输入到自动定理验证器的正式表示。我们综述了一些用于评估这些系统的标准以及一些实验研究。我们指出,这些类型的限制在开发纯粹的数学研究的AI技术中可能并不重要,但在数学应用中可能非常重要,甚至可能在开发能够阅读和理解人类编写的数学内容的程序设计中非常重要。
URL
https://arxiv.org/abs/2301.09723
