In recent years, augmented reality (AR) has emerged as a powerful tool for enhancing spatial analysis and visual communication in various fields. One area where AR holds significant potential is in the domain of emergency management and response. The ability to effectively convey critical emergency-related information in a spatially accurate and contextually relevant manner is crucial for ensuring the safety and well-being of individuals during high-stress situations. During emergencies, accurate and timely dissemination of information plays a critical role in saving lives and minimizing damage. The traditional methods of conveying emergency-related information, such as paper maps, charts, and textual instructions, often fall short of providing individuals with the necessary spatial awareness and situational understanding during high-stress situations. As technology continues to advance, there is an increasing need to explore innovative approaches that enhance situational awareness and facilitate efficient decision-making in emergency scenarios. In complex built environments, understanding evacuation routes, locating emergency exits, and identifying potential hazards can be challenging, especially during moments of panic or confusion.

This study aims to explore the application of AR in spatial analysis and visual communication of emergency-related information. Spatial analysis plays a crucial role in real-world emergencies by providing valuable insights and aiding decision-making processes. It allows emergency responders to develop a comprehensive understanding of the emergency, identify hotspots, and make informed decisions regarding evacuation routes. By analyzing historical data, topography, critical infrastructure, and vulnerable areas; authorities can identify high-risk zones, develop emergency response plans, and implement preventive measures to mitigate risks and enhance preparedness. Spatial analysis also supports effective communication and dissemination of information during emergencies by visualizing data on maps or using geographic information systems (GIS). This enables authorities to convey critical information to the public, including evacuation orders, shelter locations, hazard zones, and real-time updates. Overall, the spatial analysis provides valuable insights into the geographic context of emergencies, enabling authorities and responders to make evidence-based decisions, allocate resources efficiently, plan for risks, and enhance overall emergency response and recovery efforts. Sharma et al. [1–7] have developed mobile AR applications for building evacuation using preexisting features in the building as markers. The application gives a visual representation of a building in 3D space, allows people to identify the exits in the building as well as creates alerts for emergency response such as fire and smoke. It also gives the path to the various exits from the current location as well as the shortest path to the exits, and directions to a safe zone.

Visual communication provides a quick and intuitive way to understand information, especially in high-stress situations. Visuals such as symbols, icons, maps, and diagrams can convey crucial details at a glance, enabling individuals to grasp the situation and take appropriate action swiftly. By using standardized symbols, colors, and visual elements, emergency authorities can ensure that information is uniform and recognizable, reducing confusion and improving response coordination. In situations where verbal communication is challenging, such as in noisy or chaotic environments, visual communication becomes indispensable. Signage, pictograms, and visual cues enable effective communication even in situations with limited verbal interaction or when individuals may be experiencing heightened stress or panic. By leveraging visual elements effectively, emergency authorities can improve information dissemination, enhance public safety, and enable individuals to make informed decisions during critical situations. In mobile augmented reality application (MARA), spatial analysis and visual communication are very essential as they provide users with methods for navigating and visualizing complex situations by overlaying digital data, sensor data about the floor blueprints, and maps and physically driving them onto the environment.

By harnessing the capabilities of AR, we can revolutionize the way emergency-related information is communicated, ultimately improving public safety and response effectiveness. This research opens new possibilities for spatial analysis and visual communication in emergency management, paving the way for innovative solutions that empower individuals to make informed decisions and take appropriate actions during critical situations. During critical situations like fire and smoke or active shooter events, providing basic information for first responders, building occupants, and decision-makers becomes very critical. The next-generation systems need to include a visual analytics environment that supports planning, detection, prediction, and decision-making for emergency evacuation. Such kinds of environments will require integration of spatial analysis, and situational awareness, including improved strategies for visual communication, and user-specific relevant information as a basis for actionable decision-making strategy. To this end, we have developed a new MARA incorporating the principles of spatial analysis and visual communication into a command-and-control environment for enhanced situational awareness as shown in Figure 1.

The rest of the paper is organized as follows: Section 2 discusses studies related to this study; Section 3 details the system framework of MARA by addressing hardware and software specifications used; Section 4 describes the spatial analysis implementation of the proposed mobile augmented reality system; Section 5 describes the visual communication implementation of the proposed mobile augmented reality system; Section 6 addresses the limited user study for evaluating MARA as well as the results of the study, and Section 7 concludes this paper and gives ideas for future work regarding this study.

During emergencies, it is important to communicate evacuation information to building occupants promptly. It sometimes becomes challenging for people to create a visual and mental representation of 3D space from a 2D floor plan displayed in a building. Therefore, it is imperative to convey the evacuation information to the user based on the current location and taking into account the architectural complexities of the building. Chen et al. [8] have developed an AR-based real-time mobile system for assistive indoor navigation with target segmentation (ARMSAINTS), which provides personalized turn-by-turn navigation instructions to the user. Their system utilizes an automatic graph construction method to generate a graph from a 2D floorplan for providing location sensing.

Marker-based indoor position systems do not require the installation of expensive infrastructure as compared to bluetooth-based indoor position systems and wi-fi-based indoor positioning systems. Marker-based systems estimate the device’s current location based on the predefined markers. Commute Booster [9] is a mobile application for navigation support for people with blindness and low vision. Their system provides real-time feedback to users regarding the presence or absence of relevant navigation signs. Similarly, an indoor navigation system [10] has been developed that uses QR codes to provide localization and navigation services to attender robots using contour detection techniques. AR markers are more accurate as compared to QR code markers. Sato [11] has utilized AR markers with sensors for user localization with power-saving mode. However, the marker-based positioning system still requires the installation and maintenance of the markers. But instead of installing new markers, the existing features in the building can act as markers for the AR system. Sharma et al. [12, 13] have explored the use of HoloLens for building evacuation by incorporating existing permanent features in the building as markers to trigger the floor plan and subsequent location of the person in the building.

Lately, there has been a rise in the development of mobile applications for emergency response and decision-making. MARAs have been used for heritage Tourism [14], assist visually impaired disabled people [15], and help blind people in indoor navigation [16]. Cognitive or mental maps are important representations of space stored in a user’s mind. Taylor et al. [17] suggested that the displays organizations use should meet users’ dynamic navigational goals and navigation systems should be adaptable to users’ spatial information preferences. However, evacuation maps are designed to show the evacuation plan to the user. There are three types of evacuation map styles namely planning, evacuation, and crisis [18]. Evacuation maps in buildings are located around corridors and within rooms to highlight the path to the nearest exit [19]. Chen et al. [20] have suggested that a successful evacuation map should be easily understood by the user and should follow cartographic principles. Evacuation maps are useful in case of emergency evacuation as they assist building occupants. However, evacuation maps are not easily available in every corridor and room. As a result, there is a need to find alternative ways to communicate evacuation routes to the user. MARA provides this functionality of spatial analysis and visually communicate the evacuation routes to the user. MARA also provides the user with both cognitive maps and evacuation maps for knowledge discovery and aids in evacuation.

Computer simulations and multi-agent systems are also powerful tools for communicating emergency information to the user during crises. Sharma et al. [21–24] have argued for the use of computer simulations and multi-agent systems for emergency evacuations. They conducted a study for modeling both individual behavior and group behavior during emergency evacuations. These simulations have been also incorporated into MARA and Google Glass as participatory agent-based simulations for indoor evacuation [25]. The participatory multi-agent simulation combines scenario-guided maps for users equipped with Google Glass. Sanchez et al. [25] have explored the use of Google Glass for evacuation to improve the visual communication of personalized evacuation routes for indoor positioning and tracking. Smartphones [26, 27], tablets [28], and wearable devices [29, 30] have been used to provide evacuation instructions to the user. Smartphones and tablets aid in spatial knowledge acquisition using automatic navigation systems [31].

The utilization of virtual reality (VR) and AR technology has potential benefits for indoor environment emergency management. Evacuation during emergencies is an important topic for emergency response and decision-making. Evacuation inside a building could be a result of fire and smoke. There have been a lot of studies conducted for using VR/AR experiments for fire emergencies by creating different what-if scenarios to study emergency response and conduct evacuation training safely. VR and AR have also been employed in training for fire emergencies safety education [32], wayfinding [33], evacuation experiments for evacuation [34], evaluating fire exit signs [35], recreating past disaster [36], and in search and rescue during disasters [37].

The system framework diagram provides a comprehensive overview of MARA, highlighting the essential components and their interactions and demonstrates how the user, devices, camera, and application functionalities are integrated. This framework serves as a fundamental structure for comprehending the infrastructure and processes underlying the utilization of AR technology on mobile devices. The user interacts with the application installed on either a phone or tablet running Android or iOS. The application opens up a camera that scans the marker i.e., room number in the building, and displays the floorplan of the building and the current location of the user in the building with a pin projected and superimposed on top of the floor plan, formulating the display that the user sees.

As shown in Figure 2, the user interface consists of buttons and legends that help the user acquire the respective information about the building. When the user clicks on any button which could be A Wing, B Wing, D Wing, E Wing, F Wing, G Wing, H Wing, J Wing, K Wing, M Wing, shelter areas, AED (Automated External Defibrillator), stairs to the shelter areas or exits, they get instructions via color mapping on the floor plan highlighting the respective area. The individual’s location on the floor plan would also be displayed along with the selected legend information with which the user can identify the nearest shelter areas, stairs, AEDs, and the exits from the location of the room. When a user scans a marker with an AR camera, a floor map is projected and a button for emergency navigation will be located on the display GUI. When the emergency navigation button is clicked, the navigation path to the nearest exits from the current location in the building for evacuation will dynamically be displayed which will help the user in navigation during an emergency. Some evacuation information could be only for privileged personnel. For example, certain zones in a building need a key card access to enter the area. There may be an exit located in the key card access area that might not be available to all the building occupants. In our proposed MARA we show the navigation path to the nearest exit from the current location for the public without incorporating key card access areas. The alternative path shows the next nearest exit which incorporates the navigation path through the key card access zones. As shown in Fig. 1, visual communication includes the emergency navigation button and arrows toward the nearest exit.

Implementing spatial analysis in an emergency navigation application can greatly enhance its effectiveness and provide critical support during crises. By integrating spatial analysis capabilities, MARA provides real-time navigation guidance, the current location of the person on the displayed map, the number of exits, user-specific personalized evacuation routes and improves overall situational awareness for users.

When users scan the marker in Figure 3 from the device, the application superimposes the appropriate floorplan above the markers with a pin indicating where the individual is located while also providing them with different legends as displayed in Fig. 3. The user interface allows users to engage with the system and when the user clicks on the wing button in the right corner of the floor map, the respective wing area on the floor plan is highlighted as shown in Figure 4.

When the user clicks on the shelter area button on the floor map, shelter areas on the map will be highlighted for user awareness. With a click of the exit button, all the exits in the building would be highlighted on the floor plan, and with the click of the stair and AED buttons, stairs and AEDs in the building would be highlighted. The users can adjust the zoom level of the floor map according to their requirements. They can zoom in to get a closer view of specific areas or details, and they can also zoom out to have a broader perspective of the entire floor map. This zooming functionality allows users to customize their view and navigate the floor map as needed, enhancing their understanding and interaction with the space. This visualization helps users orient themselves within the building, providing a clear understanding of the layout and locations of various rooms, corridors, and amenities. This cutting-edge technology enhances safety, improves navigation efficiency, and ensures individuals can quickly and confidently respond to emergencies within buildings.

As our world becomes increasingly complex, the integration of AR and data-driven solutions is paving the way for safer and more efficient experiences in indoor environments. MARA integrates geospatial data, such as building blueprints, occupancy data, and emergency response infrastructure, to provide comprehensive information for effective emergency navigation. MARA’s advanced features also include the ability to zoom in on images, providing users with detailed and magnified views of floor plans, markers, and critical information. By analyzing the spatial data, the application can identify optimal evacuation routes, identify potential hazards, and locate critical resources within the building. In the future, MARA can be used as a training and simulation tool for emergency preparedness. By simulating different emergency scenarios, users can practice navigating the building, following evacuation routes, and understanding emergency protocols, enhancing their readiness and confidence during real emergencies. The current location of the user is determined in MARA through the process of feature extraction using markers. Feature extraction through markers provides a reliable method for tracking and determining the user’s location in AR applications. It enables precise positioning and facilitates the overlaying of virtual content onto the real-world environment, enhancing the overall augmented reality experience. In emergencies where GPS and wi-fi capabilities may fail or be unreliable, having a MARA that can function without these technologies is essential. The proposed MARA is designed to operate independently of GPS and wi-fi, ensuring that it can still provide valuable assistance and support during emergencies.

The mobile AR application presented in this paper shows great potential in supporting effective decision-making during emergencies, benefiting both building occupants and emergency responders. Effective navigation during emergencies plays a critical role in ensuring the safety and well-being of individuals. Visual communication methods have the potential to significantly improve emergency navigation by providing clear and intuitive directions. This paper explores the use of visual communication techniques in emergency navigation and discusses their benefits, challenges, and potential applications. By leveraging visual cues and technologies such as AR, interactive maps, and signage systems, visual communication can enhance situational awareness, reduce response time, and facilitate efficient decision-making in emergency scenarios.

Visual communication techniques, such as interactive maps and AR overlays, provide real-time information about escape routes, obstacles, and emergency services, improving situational awareness for individuals navigating through emergency environments. Navigation routes for emergency evacuation are superimposed on the floor plan and the two nearest exit navigation paths are highlighted; this helps users in effective decision-making in case of emergency. When the user scans the room number using their device, the mobile augmented reality application displays the corresponding floor map. Upon clicking the Emergency Navigation button, the application shows an updated floor plan that includes recommended and alternative navigation paths. These paths guide the user from their current location to the nearest exit in case of an emergency.

Figure 5 illustrates this floor plan with the navigation paths. Whenever the user scans any marker, the navigation path to the nearest exit from the current location from where the user scanned the marker is updated on the floor plan dynamically. Users can exit the navigation flow by clicking on the Back button on the top left of the floor map as displayed in Fig. 5.

The MARA presented in this paper shows great potential in supporting effective decision-making during emergencies.

This paper presents location-aware MARA for multilevel spaces by incorporating situational awareness, spatial analysis, and visual communication of emergency information through AR. MARA was built for tablets and mobile phones. We have demonstrated how our proposed MARA can provide spatially contextualized AR visualizations that promote spatial knowledge acquisition and support cognitive mapping. We have introduced a series of AR visualizations that are designed to enhance spatial perception and situational awareness of multilevel spaces through situated AR evacuation displays. Our work demonstrates how AR tools can support improved emergency preparedness communication. These AR visualizations are developed to educate and prepare at-risk populations before the occurrence of a hazardous event. This study subtly represents how sophisticated and important it is to have strategic planning for emergency evacuation.

Buildings are often mounted with 2D evacuation maps throughout the building. A 2D floor plan provides a building outline and is considered as a traditional way for evacuation. Moreover, 2D evacuation maps require users to memorize the evacuation path and recall the path during evacuation. Even if the 2D evacuation maps are saved on smart phone devices, they are static floor plans and lack interactivity. Our proposed MARA permits building occupants to evacuate multi-level buildings during emergencies by enhancing situational awareness by promoting spatial knowledge and cognitive mapping to a larger degree than 2D visualizations. MARA is deployed in Android and iOS smart phones and tablets, and include image markers that are used to generate a 3D floorplan visualization when a device camera is pointed toward a relevant marker. The results from the user studies indicated that the MARA was useful in helping people evacuate the building and can be used as a substitute for traditional paper-based evacuation plans. 2D evacuation plans displayed at key places in the building are also used as a marker in our current MARA to make the plans more interactive.

The proposed MARA is currently created for a campus building. Every building has its own floor plan and room number signages. The deployment of MARA to other scenarios would be difficult because every building is different, and require a customized MARA. But a generalized framework can be created in the future, where a user can take a picture of the room number signages (as markers) and tag it on the floor plan. Future work can involve scaling up the project to include a learning phase for a new building. The learning phase might involve a user carrying a smartphone (or tablet or HoloLens) and capturing the permanent features in the building (such as room numbers, and signages) as markers and tagging them to their location in the floor plan. So next time when the user scans the same marker, the MARA will extract the floor plans with their current location. We hope that our project stands as a starting point and continuation of AR technology in emergency response and inspires more global researchers to contribute to this work. Future work will involve conducting a detailed user study and evaluation after getting IRB approval. We will also explore the integration of MARA with HoloLens incorporating touch and voice functionality.