NeuroGaming: Merging Cognitive Neuroscience & Virtual Simulation in an Interactive Training Platform

Abstract: Serious gaming platforms are increasing in popularity for training in both industry and the military. Current training packages do not generally support adaptive training: the ability of a simulator to modify an ongoing training scenario based on real-time assessments of the trainee’s performance and/or psychophysiological state.

Creating a platform that can induce modifications to training environments may enhance instruction by optimizing the trainee’s pyschophysiological state during training. This paper reports preliminary data on the neurophysiological correlates of threat detection in a training simulation environment using Electroencelpholographic (EEG) metrics. Event-Related potential (ERP) and power analysis (ERD/ERS) distinguished threat type, threat difficulty, and predicted errors in performance. These neural signatures in a virtual environment serve as a foundation for developing a neurophysiologically driven adaptive simulation engine, the NeuroGaming Platform.

Berka, C., Pojman, N., Trejo, J., Coyne, J., Cole, A., Fidopiastis, C., & Nicholson, D. (2010). NeuroGaming: Merging Cognitive Neuroscience & Virtual Simulation in an Interactive Training Platform. Paper presented at the Applied Human Factors and Ergonomics Society (HFES), San Francisco, CA.