Assessing the impact of autonomy and overconfidence in UAV first-person view training.

With the rapid rise in unmanned aerial vehicles (UAVs) for military and civil first-person applications like infrastructure inspection, there is an increased need for skilled UAV operators. However, research on effective training of UAV pilots has not kept pace with the demand. How much autonomy should be onboard, how much training, and how much control humans should have are still points of debate. To help fill this gap, this paper examines how different training programs and levels of control autonomy affect training outcomes for people operating a UAV in inspection tasks with high onboard autonomy. Results revealed a cost-benefit trade space in that those top performers with both lower-level teleoperation and higher-level supervisory control training could achieve the best performance, but with higher variability, as compare to those who received just supervisory control training. Another important finding was that those trainees who were overconfident were more likely to spend too much time micro-controlling the UAV, and also 15 times more likely to crash. Given that commercial UAV licensing is expected to significantly increase in the next few years, these results suggest more work is needed to determine how to mitigate overconfidence bias both through training and design.

Boredom in the Workplace: A New Look at an Old Problem.

OBJECTIVE: We review historical and more recent efforts in boredom research and related fields. A framework is presented that organizes the various facets of boredom, particularly in supervisory control settings, and research gaps and future potential areas for study are highlighted. BACKGROUND: Given the ubiquity of boredom across a wide spectrum of work environments--exacerbated by increasingly automated systems that remove humans from direct, physical system interaction and possibly increasing tedium in the workplace--there is a need not only to better understand the multiple facets of boredom in work environments but to develop targeted mitigation strategies. METHOD: To better understand the relationships between the various influences and outcomes of boredom, a systems-based framework, called the Boredom Influence Diagram, is proposed that describes various elements of boredom and their interrelationships. RESULTS: Boredom is closely related to vigilance, attention management, and task performance. This review highlights the need to develop more naturalistic experiments that reflect the characteristics of a boring work environment. CONCLUSION: With the increase in automation, boredom in the workplace will likely become a more prevalent issue for motivation and retention. In addition, developing continuous measures of boredom based on physiological signals is critical. APPLICATION: Personnel selection and improvements in system and task design can potentially mitigate boredom. However, more work is needed to develop and evaluate other potential interventions.

Influencing Trust for Human-Automation Collaborative Scheduling of Multiple Unmanned Vehicles.

OBJECTIVE: We examined the impact of priming on operator trust and system performance when supervising a decentralized network of heterogeneous unmanned vehicles (UVs). BACKGROUND: Advances in autonomy have enabled a future vision of single-operator control of multiple heterogeneous UVs. Real-time scheduling for multiple UVs in uncertain environments requires the computational ability of optimization algorithms combined with the judgment and adaptability of human supervisors. Because of system and environmental uncertainty, appropriate operator trust will be instrumental to maintain high system performance and prevent cognitive overload. METHOD: Three groups of operators experienced different levels of trust priming prior to conducting simulated missions in an existing, multiple-UV simulation environment. RESULTS: Participants who play computer and video games frequently were found to have a higher propensity to overtrust automation. By priming gamers to lower their initial trust to a more appropriate level, system performance was improved by 10% as compared to gamers who were primed to have higher trust in the automation. CONCLUSION: Priming was successful at adjusting the operator's initial and dynamic trust in the automated scheduling algorithm, which had a substantial impact on system performance. APPLICATION: These results have important implications for personnel selection and training for futuristic multi-UV systems under human supervision. Although gamers may bring valuable skills, they may also be potentially prone to automation bias. Priming during training and regular priming throughout missions may be one potential method for overcoming this propensity to overtrust automation.

Comparing the performance of expert user heuristics and an integer linear program in aircraft carrier deck operations.

Planning operations across a number of domains can be considered as resource allocation problems with timing constraints. An unexplored instance of such a problem domain is the aircraft carrier flight deck, where, in current operations, replanning is done without the aid of any computerized decision support. Rather, veteran operators employ a set of experience-based heuristics to quickly generate new operating schedules. These expert user heuristics are neither codified nor evaluated by the United States Navy; they have grown solely from the convergent experiences of supervisory staff. As unmanned aerial vehicles (UAVs) are introduced in the aircraft carrier domain, these heuristics may require alterations due to differing capabilities. The inclusion of UAVs also allows for new opportunities for on-line planning and control, providing an alternative to the current heuristic-based replanning methodology. To investigate these issues formally, we have developed a decision support system for flight deck operations that utilizes a conventional integer linear program-based planning algorithm. In this system, a human operator sets both the goals and constraints for the algorithm, which then returns a proposed schedule for operator approval. As a part of validating this system, the performance of this collaborative human-automation planner was compared with that of the expert user heuristics over a set of test scenarios. The resulting analysis shows that human heuristics often outperform the plans produced by an optimization algorithm, but are also often more conservative.

Integrating ethics in design through the value-sensitive design approach.

The Accreditation Board of Engineering and Technology (ABET) has declared that to achieve accredited status, 'engineering programs must demonstrate that their graduates have an understanding of professional and ethical responsibility.' Many engineering professors struggle to integrate this required ethics instruction in technical classes and projects because of the lack of a formalized ethics-in-design approach. However, one methodology developed in human-computer interaction research, the Value-Sensitive Design approach, can serve as an engineering education tool which bridges the gap between design and ethics for many engineering disciplines. The three major components of Value-Sensitive Design, conceptual, technical, and empirical, exemplified through a case study which focuses on the development of a command and control supervisory interface for a military cruise missile.

Informed consent and investigational new drug abuses in the U.S. military.

OBJECTIVE: The focal point of this investigation was to research the ethical issues surrounding the military's requests for informed consent waivers when using investigational drugs, and the recent debate surrounding the anthrax vaccine as an investigational new drug (IND). DESIGN: The military's management of the informed consent process was examined using documents obtained through the Freedom of Information Act, Institutional Review Board (IRB) minutes, legal pleadings, and protocols for specific investigational drugs. RESULTS: In December 1990, prior to Operation Desert Storm, the Federal Drug Administration (FDA) granted the Department of Defense (DoD) an unprecedented waiver to the federally mandated informed-consent requirement for the use of investigational drugs. However, the waiver approval was conditional, and the FDA insisted on several safeguards. Partially in response to the subsequent Gulf War Syndrome debate, the FDA recently evaluated the military's use of investigational drugs during the Gulf War. The FDA cited the military for significant deviations from the originally approved protocols. Most notably, the military was found to be abusing the IRB process by convening a second IRB when the first IRB concluded that waiving informed consent was unethical. In addition, there was a gross lack of documentation and no monitoring of adverse reactions. The DoD's plan to use the current anthrax vaccine on all 2.4 million troops against inhalation anthrax has kindled an additional investigational drug controversy. The safety and efficacy of the use of the anthrax vaccine as a prophylactic against inhalation anthrax have been questioned by both military and medical organizations. There have never been any published studies of human efficacy or long-term effects for the anthrax vaccine. In addition, the military is not using the vaccine for its intended purpose, and it is also not adhering to prescribed dosing schedules. There is clear evidence to support the claim that, in fact, the military's use of the anthrax vaccine should be considered unethical. CONCLUSIONS: I argue that in medical situations, the military is obligated to treat its troops as autonomous persons entitled to basic rights and protections. The DoD is currently using an approved drug, the anthrax vaccine, for an unapproved purpose and in an unapproved manner. In doing so, the DoD is not only violating the FDA's regulations against such practices, it is also violating an executive order which only allows the president to authorize the use of INDs on service members without their consent.