Analysis of Relation between Brainwave Activity and Reaction Time of Short-Haul Pilots Based on EEG Data.

The purpose of this research is to examine and assess the relation between a pilot's concentration and reaction time with specific brain activity during short-haul flights. Participants took part in one-hour long flight sessions performed on the FNPT II class flight simulator. Subjects were instructed to respond to unexpected events that occurred during the flight. The brainwaves of each participant were recorded with the Emotiv EPOC+ Scientific Contextual EEG device. The majority of participants showed a statistically significant, positive correlation between Theta Power in the frontal lobe and response time. Additionally, most subjects exhibited statistically significant, positive correlations between band-power and reaction times in the Theta range for the temporal and parietal lobes. Statistically significant event-related changes (ERC) were observed for the majority of subjects in the frontal lobe for Theta frequencies, Beta waves in the frontal lobe and in all lobes for the Gamma band. Notably, significant ERC was also observed for Theta and Beta frequencies in the temporal and occipital Lobes, Alpha waves in the frontal, parietal and occipital lobes for most participants. A difference in brain activity patterns was observed, depending on the performance in time-restricted tasks.

Performance of QR Code Detectors near Nyquist Limits.

For the interacting with real world, augmented reality devices need lightweight yet reliable methods for recognition and identification of physical objects. In that regard, promising possibilities are offered by supporting computer vision with 2D barcode tags. These tags, as high contrast and visually well-defined objects, can be used for finding fiducial points in the space or to identify physical items. Currently, QR code readers have certain demands towards the size and visibility of the codes. However, the increase of resolution of built-in cameras makes it possible to identify smaller QR codes in the scene. On the other hand, growing resolutions cause the increase to the computational effort of tag location. Therefore, resolution reduction in decoders is a common trade-off between processing time and recognition capabilities. In this article, we propose the simulation method of QR codes scanning near limits that stem from Shannon's theorem. We analyze the efficiency of three publicly available decoders versus different size-to-sampling ratios (scales) and MTF characteristics of the image capture subsystem. The MTF we used is based on the characteristics of real devices, and it was modeled using Gaussian low-pass filtering. We tested two tasks-decoding and locating-and-decoding. The findings of the work are several-fold. Among others, we identified that, for practical decoding, the QR-code module should be no smaller than 3-3.5 pixels, regardless of MTF characteristics. We confirmed the superiority of Zbar in practical tasks and the worst recognition capabilities of OpenCV. On the other hand, we identified that, for borderline cases, or even below Nyquist limit where the other decoders fail, OpenCV is still capable of decoding some information.

Evaluation of Keypoint Descriptors for Flight Simulator Cockpit Elements: WrightBroS Database.

The goal of the WrightBroS project is to design a system supporting the training of pilots in a flight simulator. The desired software should work on smart glasses supplementing the visual information with augmented reality data, displaying, for instance, additional training information or descriptions of visible devices in real time. Therefore, the rapid recognition of observed objects and their exact positioning is crucial for successful deployment. The keypoint descriptor approach is a natural framework that is used for this purpose. For this to be applied, the thorough examination of specific keypoint location methods and types of keypoint descriptors is required first, as these are essential factors that affect the overall accuracy of the approach. In the presented research, we prepared a dedicated database presenting 27 various devices of flight simulator. Then, we used it to compare existing state-of-the-art techniques and verify their applicability. We investigated the time necessary for the computation of a keypoint position, the time needed for the preparation of a descriptor, and the classification accuracy of the considered approaches. In total, we compared the outcomes of 12 keypoint location methods and 10 keypoint descriptors. The best scores recorded for our database were almost 96% for a combination of the ORB method for keypoint localization followed by the BRISK approach as a descriptor.

Prediction of Pilot's Reaction Time Based on EEG Signals.

The main hypothesis of this work is that the time of delay in reaction to an unexpected event can be predicted on the basis of the brain activity recorded prior to that event. Such mental activity can be represented by electroencephalographic data. To test this hypothesis, we conducted a novel experiment involving 19 participants that took part in a 2-h long session of simulated aircraft flights. An EEG signal processing pipeline is proposed that consists of signal preprocessing, extracting bandpass features, and using regression to predict the reaction times. The prediction algorithms that are used in this study are the Least Absolute Shrinkage Operator and its Least Angle Regression modification, as well as Kernel Ridge and Radial Basis Support Vector Machine regression. The average Mean Absolute Error obtained across the 19 subjects was 114 ms. The present study demonstrates, for the first time, that it is possible to predict reaction times on the basis of EEG data. The presented solution can serve as a foundation for a system that can, in the future, increase the safety of air traffic.

A Machine Learning Approach to the Detection of Pilot's Reaction to Unexpected Events Based on EEG Signals.

This work considers the problem of utilizing electroencephalographic signals for use in systems designed for monitoring and enhancing the performance of aircraft pilots. Systems with such capabilities are generally referred to as cognitive cockpits. This article provides a description of the potential that is carried by such systems, especially in terms of increasing flight safety. Additionally, a neuropsychological background of the problem is presented. Conducted research was focused mainly on the problem of discrimination between states of brain activity related to idle but focused anticipation of visual cue and reaction to it. Especially, a problem of selecting a proper classification algorithm for such problems is being examined. For that purpose an experiment involving 10 subjects was planned and conducted. Experimental electroencephalographic data was acquired using an Emotiv EPOC+ headset. Proposed methodology involved use of a popular method in biomedical signal processing, the Common Spatial Pattern, extraction of bandpower features, and an extensive test of different classification algorithms, such as Linear Discriminant Analysis, k-nearest neighbors, and Support Vector Machines with linear and radial basis function kernels, Random Forests, and Artificial Neural Networks.

Alternatives to the Wright-Fisher model: the robustness of mitochondrial Eve dating.

Methods of calculating the distributions of the time to coalescence depend on the underlying model of population demography. In particular, the models assuming deterministic evolution of population size may not be applicable to populations evolving stochastically. Therefore the study of coalescence models involving stochastic demography is important for applications. One interesting approach which includes stochasticity is the O'Connell limit theory of genealogy in branching processes. Our paper explores how many generations are needed for the limiting distributions of O'Connell to become adequate approximations of exact distributions. We perform extensive simulations of slightly supercritical branching processes and compare the results to the O'Connell limits. Coalescent computations under the Wright-Fisher model are compared with limiting O'Connell results and with full genealogy-based predictions. These results are used to estimate the age of the so-called mitochondrial Eve, i.e., the root of the mitochondrial polymorphisms of the modern humans based on the DNA from humans and Neanderthal fossils.

Interactions of neanderthals and modern humans: what can be inferred from mitochondrial DNA?

This paper reviews the state-of-the-art knowledge concerning the relationship between Neanderthals and Upper Paleolithic modern humans. The branching-process method is applied to infer the upper limit of hypothetical Neanderthal admixture, consistent with the evidence based on mitochon- drial DNA sequences of contemporary modern humans, as well as Neanderthal and early modern European H. sapiens fossils. As a result, a maximum value of 15% admixture is obtained. This estimate is discussed in the context of its consequences for the two competing theories of modern human origin.