Abstract
Existing definitions and associated conceptual frameworks for computer-based system safety should be revisited in light of real-world experiences from deploying autonomous vehicles. Current terminology used by industry safety standards emphasizes mitigation of risk from specifically identified hazards, and carries assumptions based on human-supervised vehicle operation. Operation without a human driver dramatically increases the scope of safety concerns, especially due to operation in an open world environment, a requirement to self-enforce operational limits, participation in an ad hoc sociotechnical system of systems, and a requirement to conform to both legal and ethical constraints. Existing standards and terminology only partially address these new challenges. We propose updated definitions for core system safety concepts that encompass these additional considerations as a starting point for evolving safe-ty approaches to address these additional safety challenges. These results might additionally inform framing safety terminology for other autonomous system applications.
Abstract (translated)
现有的计算机系统安全定义和相关概念框架应该在考虑自动驾驶车辆的实际应用经验后进行重新审视。目前由行业安全标准使用的术语侧重于从明确确定的危险中减轻风险，并基于人类监督的车辆操作做出假设。在没有人类驾驶员的情况下，操作范围和安全问题的范围急剧扩大，特别是由于在开放世界环境中的操作，需要自我执行操作限制，参与临时社会技术系统的运作，以及符合法律和道德约束等。现有的标准和术语仅部分解决了这些新挑战。我们提出了涵盖这些额外考虑的核心系统安全概念的更新定义，作为发展安全方法应对这些额外安全挑战的起点。这些结果还可能告知其他自动驾驶系统应用的安全术语的制定。
URL
https://arxiv.org/abs/2404.16768
