Multitasking has become an integral part of work environments, even though people are not well-equipped cognitive-ly to handle numerous concurrent tasks effectively. Systems that support such multitasking may produce better performance and less frustration. However, without understanding the user's internal processes, it is difficult to determine optimal strategies for adapting interfaces, since all multitasking activity is not identical. We describe two experiments leading toward a system that detects cognitive multitasking processes and uses this information as input to an adaptive interface. Using functional near-infrared spectroscopy sensors, we differentiate four cognitive multitasking processes. These states cannot readily be distinguished using behavioral measures such as response time, accuracy, keystrokes or screen contents. We then present our human-robot system as a proof-of-concept that uses real-time cognitive state information as input and adapts in response. This prototype system serves as a platform to study interfaces that enable better task switching, interruption management, and multitasking. Copyright 2011 ACM.

Additional Metadata
Keywords Brain computer interface, FNIRS, Human-robot interaction, Interruption, Multitasking, Near-infrared spectroscopy
Persistent URL dx.doi.org/10.1145/1978942.1978997
Conference 29th Annual CHI Conference on Human Factors in Computing Systems, CHI 2011
Citation
Solovey, E.T. (Erin Treacy), Lalooses, F. (Francine), Chauncey, K. (Krysta), Weaver, D. (Douglas), Parasi, M. (Margarita), Scheutz, M. (Matthias), … Jacob, R.J.K. (Robert J.K.). (2011). Sensing cognitive multitasking for a brain-based adaptive user interface. In Conference on Human Factors in Computing Systems - Proceedings (pp. 383–392). doi:10.1145/1978942.1978997