RESUMO
Road transport is experiencing disruptive change from new first-of-a-kind technologies. While such technologies offer safety and operational benefits, they also pose new risks. It is critical to proactively identify risks during the design, development and testing of new technologies. The Systems Theoretic Accident Model and Processes (STAMP) method analyses the dynamic structure in place to manage safety risks. This study applied STAMP to develop a control structure model for emerging technologies in the Australian road transport system and identified control gaps. The control structure shows the actors responsible for managing risks associated with first-of-a-kind technologies and the existing control and feedback mechanisms. Gaps identified related to controls (e.g. legislation) and feedback mechanisms (e.g. monitoring for behavioural adaptation). The study provides an example of how STAMP can be used to identify control structure gaps requiring attention to support the safe introduction of new technologies.
This paper considers emerging risks associated with new technologies in the road transport system. It demonstrates a novel approach using STAMP to identify gaps in control and feedback mechanisms within the existing control structure which should be addressed to mitigate risk.
Assuntos
Acidentes de Trânsito , Análise de Sistemas , Humanos , Acidentes de Trânsito/prevenção & controle , Austrália , Segurança , TecnologiaRESUMO
Artificial Intelligence (AI) is being increasingly implemented within road transport systems worldwide. Next generation of AI, Artificial General Intelligence (AGI) is imminent, and is anticipated to be more powerful than current AI. AGI systems will have a broad range of abilities and be able to perform multiple cognitive tasks akin to humans that will likely produce many expected benefits, but also potential risks. This study applied the EAST Broken Links approach to forecast the functioning of an AGI system tasked with managing a road transport system and identify potential risks. In total, 363 risks were identified that could have adverse impacts on the stated goals of safety, efficiency, environmental sustainability, and economic performance of the road system. Further, risks beyond the stated goals were identified; removal from human control, mismanaging public relations, and self-preservation. A diverse set of systemic controls will be required when designing, implementing, and operating future advanced technologies.Practitioner summary: This study demonstrated the utility of HFE methods for formally considering risks associated with the design, implementation, and operation of future technologies. This study has implications for AGI research, design, and development to ensure safe and ethical AGI implementation.
