Current Projects

 

Multimodal Information Design Support (MIDS)

The Multimodal Information Design Support (MIDS) system is a software tool which aids designers in properly using multimodal information perceptualization (MIP) in system design. Using MIDS, designers will have access to theoretical and empirical MIP guidelines that factor in the dynamic nature of C4ISR environments and continuous fluctuations in an operator's workload. Designers input system specifications from their conceptual design or system requirements documents, and MIDS calculates dynamic operator workload, and provides support and guidance in the form of design guidelines and heuristics on the use of MIP.

Thus, environments designed with the support of MIDS will provide the right information to the right user at the right time through the optimal modality, thus minimizing errors due to misinterpreted or missed perceptual cues due to information overload. The use of MIDS in design will create C4ISR systems that optimize the information processing capabilities of battlespace controllers by providing designers with properly applied MIP guidelines grounded in the science of multimodal design. MIDS will be commercially available March 2006.

back to top

 

Virtual Technologies and Environments (VIRTE)

Under the Office of Naval Research's VIRTE program, the DI team is currently developing models and theories for multi-modal sensory integration in support of training transfer, building a human performance metric toolkit that can be used to assess training transfer, and conducting a set of training transfer studies that aim to validate the theorized models, theories, and metrics that are relevant for the evaluation of VIRTE Demo II systems. The goal of this effort is to develop design science to enhance reciprocity between training theory and practice.

For the VIRTE Demo III effort, the DI team is conducting training effectiveness evaluations (TEEs) for Combined Arms Staff Trainer (CAST) and Multi-purpose Supporting Arms Trainer (MSAT). For the CAST TEE, DI is developing a set of TEE metrics and an associated test plan that can be used to examine the benefits of iterative system builds. For the MSAT TEE, DI is supporting data collection of student performance during exercises with the legacy system (i.e., puffboard) versus the MSAT system, TEE metric development, and iterative evaluation during the phased implementation of MSAT.

back to top

 

Physiological Real-time Metric of Situation Awareness

Design Interactive is currently working with the Defense Advanced Research Projects Agency (DARPA) on the next generation of computing: Augmented Cognition. Augmented cognition seeks to revolutionize the way humans interact with computers by leveraging human physiological indicators to direct human-system interaction. It involves developing a closed-loop system in which the output from physiological indicators is used to gauge cognitive parameters and then trigger mitigation strategies that modify and adapt interaction such that joint human-system performance is substantially improved.

This SBIR Phase I effort for DARPA aims to develop a human-system dyad that enhances individual and team situation awareness (SA) through seamless transition of displayed data based on real-time neurophysiological sensors through development of objective measures of SA using electroencephalography (EEG) and an innovative mitigation display strategies framework.

During Phase I, researchers are focused on developing an event-based approach to optimizing perception of elements in the environment by monitoring EEG and behavioral measures. Tracking and analysis of display events through an event-based approach allows for better context-sensitivity, as cognitive gauges can now be related to individual events or even display objects, thereby providing the much needed context for how and where mitigations should be applied. In such an approach, each system event would be associated with increasing or decreasing the cognitive state of interest (e.g., when a new entity appears on the screen, participants should perceive this change and act accordingly – this should result in increased attentional demands which impact workload). However, it is impossible to assume that every missed perceptual event would require mitigation. For low priority events, mitigation should be triggered only if other higher priority tasks are not active. Disregarding this relationship may result in ineffective mitigation, as the mitigation strategy could, for example, try to shift the user’s attention to a less critical event. Using this approach, the system can determine not only when to mitigate, but also what and how to mitigate to enhance perception of elements, and increase overall SA and performance.

back to top

 

R.A.P.I.D. -
SATINT Analysis Using Neurophysiological Sensors

Through this effort, we will be developing the Revolutionary Accelerated Processing Image Detection (RAPID) system within the CASE program of the Disruptive Technology Office (DTO; formerly ARDA).

The project encompasses a two-stage process to significantly enhance intelligent analysts’ throughput and accuracy in imagery analysis by implementing a combination of EEG and eye tracking technology to assess bottom-up and top-down cognitive processing during rapid viewing of satellite imagery. Not only will this technology improve the speed with which analysts can identify potential objects of interest in images, but will also examine biases in top-down processing by capturing analysts’ unconscious use of prior and tacit knowledge, and provide mitigation strategies to assist in alleviating such biases.

Processes to capture detection and bias signatures, developed under this effort, may be applicable to other domains beyond intelligence gathering. E.g. C4ISR operators may significantly enhance speed and accuracy of operations, including identifying friend/foe, monitoring travel patterns, and identifying unbiased discrepancies in data.

back to top


 

Learn more about DI's capabilities :

View completed projects