In collaboration with Iowa State University, BANC3 is designing and developing InterchangeSE, a federated multimodal simulation environment, as a new means of studying interactions among several stakeholders representing different decision perspectives in a partially connected-automated multimodal transportation system. InterchangeSE will allow complex simulated scenarios involving live and virtual participants to be initialized and run. Its features include: multiplayer interactions, representation of different decision perspectives and dynamically changing scenarios, different levels of immersion, and interactions with real-world performance monitoring. InterchangeSE will be developed based on existing virtual reality/augmented reality technologies and software architecture with connectivity and communications between independent hardware and software components. This project will enhance the system architecture with built-in fault tolerance and integration with a performance monitoring system. The platform will demonstrate inclusion of future technologies such as wearable textile stress biosensors and a head-mounted augmented reality display. This $1.5 million project, which includes funding in part by the Federal Highway Administration, is slated for completion in 2021.

In support of this project, BANC3 is developing head-mounted AR displays for construction workers. Augmented reality (AR) has the potential to revolutionize the transportation industry and significantly change the transmittal and ingestion of information in different modes of transportation by providing just-in-time, heads-up, and hands-free interactions. This will lead to improved efficiency and safety in transportation. As an example, an optical see-through head-mounted display (HMD) can be life saving for construction workers in a connected world. The leading cause of construction worker fatalities involves collisions with construction vehicles. In a connected world, these incidences could be avoided with AR helmets that warn workers about time before an impending collision without distracting them from the job in hand.