Mechanisms of Augmented Reality (AR) and Virtual Reality (VR) on the Human Brain

Mechanisms of Augmented Reality (AR) on the Human Brain

Augmented Reality (AR) engages the human brain by overlaying digital content onto the real world, thereby enhancing sensory perception and cognitive engagement (Wen, 2021). Studies indicate that AR can significantly influence brain activity patterns, particularly through the increased demand for selective attention and spatial awareness (Suzuki et al. 2024). The interactive nature of AR environments requires users to integrate virtual elements with real-world contexts, which activates multiple brain regions, including those involved in visual processing, motor control, and cognitive functions such as attention and memory (Vortmann et al., 2021). AR's ability to present virtual information in real-time can lead to enhanced cognitive states and improved task performance. For instance, AR-guided navigation systems, although not yet offering precision advantages, have been shown to improve ergonomics and visualization, reduce surgical time, and decrease blood loss during minimally invasive surgical procedures (Brockmeyer et al., 2023). Additionally, AR's immersive nature can significantly impact the user's brainwave activity, particularly in enhancing cognitive functions and task performance through mechanisms such as brainwave entrainment (Argento et al., 2017) 

Mechanisms of Virtual Reality (VR) on the Human Brain

Virtual Reality (VR) engages the human brain by creating immersive, interactive environments that closely mimic real-world experiences (Riva et al., 2019). This technology stimulates multiple sensory modalities simultaneously, including visual, auditory, and sometimes haptic feedback, which significantly enhances the sense of presence and immersion (Kourtesis, 2024). VR activates various brain regions involved in sensory processing, motor control, spatial navigation, and emotional regulation (Mellet et al., 2010).

VR environments induce substantial activation of the brain's sensory and motor regions. For instance, studies have shown that VR can trigger neural responses similar to those experienced in real-life scenarios. This includes the activation of the occipital lobe for visual processing and the parietal lobe for spatial awareness and motor planning (Mellet et al., 2010). Furthermore, VR simulations can modulate spinal excitability, indicating an influence on lower nervous system levels (Grosprêtre et al., 2023). VR's immersive nature requires significant cognitive resources, leading to increased activation in brain regions associated with attention, memory, and executive function. For example, tasks in VR environments have been shown to enhance cognitive load and improve task performance by engaging the prefrontal cortex and other related areas (Mellet et al., 2010). VR can evoke strong emotional responses and modulate brain activity in regions responsible for emotional regulation, such as the amygdala and the insular cortex. This capability makes VR a valuable tool for therapeutic applications, such as treating anxiety disorders and PTSD by providing controlled exposure to stressors in a safe environment (Riva et al., 2019).

VR's ability to simulate real-world interactions has shown promise in neurorehabilitation. VR does this by directly engaging the brain networks responsible for motor and cognitive functions. In these environments, users relearn motor skills and cognitive strategies as the frontoparietal network is recruited during observation and imitation tasks, which are a key mechanism for effective rehabilitation exercises. (Adamovich et al., 2009). Combining VR with Brain-Computer Interface (BCI) technology allows for direct brain interaction with virtual environments. This integration enhances the control and feedback mechanisms in VR, making it possible to design adaptive systems that respond to the user's cognitive and emotional states in real-time (Kober et al., 2024).

Overall, VR engages a wide array of brain regions more extensively than traditional media, owing to its immersive and interactive nature. This engagement leads to enhanced sensory, cognitive, and emotional experiences, making VR a powerful tool for research, therapy, and training.

References

1.    Wen, Y. (2021). Augmented reality enhanced cognitive engagement: designing classroom-based collaborative learning activities for young language learners. Educational Technology Research and Development, 69(2), 843–860. https://www.jstor.org/stable/27285748

2.     Suzuki, Y., Wild, F., & Scanlon, E. (2024). Measuring cognitive load in augmented reality with physiological methods: A systematic review. Journal of Computer AssistedLearning, 40(2), 375–393. https://doi.org/10.1111/jcal.12882

3.      Vortmann, L.-M., Schwenke, L., & Putze, F. (2021). Using Brain Activity Patterns to Differentiate Real and Virtual Attended Targets during Augmented Reality Scenarios. Information, 12(6), 226. https://doi.org/10.3390/info12060226

4.      Brockmeyer, P., Wiechens, B., & Schliephake, H. (2023). The role of augmented reality in the advancement of minimally invasive surgery procedures: a scoping review. Bioengineering, 10(4), 501. https://doi.org/10.3390/bioengineering10040501

5.    Argento Emanuele, Papagiannakis George, Baka Eva,  Maniadakis Michail, Trahanias Panos, Sfakianakis Michael & Nestoros Joannis. (2017). Augmented Cognition via Brainwave Entrainment in Virtual Reality: An Open, Integrated Brain Augmentation in a Neuroscience System Approach. Augmented Human Research. 2. 10.1007/s41133-017-0005-3.

6.      Riva, G., Wiederhold, B. K., & Mantovani, F. (2019). Neuroscience of Virtual Reality: From Virtual Exposure to Embodied Medicine. Cyberpsychology, behavior and social networking, 22(1), 82–96. https://doi.org/10.1089/cyber.2017.29099.gri

7.     Kourtesis, P. (2024). A Comprehensive Review of Multimodal XR Applications, Risks, and Ethical Challenges in the Metaverse. Multimodal Technologies and Interaction, 8(11), 98. https://doi.org/10.3390/mti8110098

8.      Mellet, E., Laou, L., Petit, L., Zago, L., Mazoyer, B., & Tzourio-Mazoyer, N. (2010). Impact of the virtual reality on the neural representation of an environment. Human brain mapping, 31(7), 1065–1075. https://doi.org/10.1002/hbm.20917

9.      Grosprêtre, S., Eon, P., & Marcel-Millet, P. (2023). Virtual reality does not fool the brain only: spinal excitability changes during virtually simulated falling. Journal of neurophysiology, 129(2), 368–379. https://doi.org/10.1152/jn.00383.2022

10.  Adamovich, S. V., August, K., Merians, A., & Tunik, E. (2009). A virtual reality-based system integrated with fMRI to study neural mechanisms of action observation-execution: a proof of concept study. Restorative neurology and neuroscience, 27(3), 209–223. https://doi.org/10.3233/RNN-2009-0471

11.    Kober, S.E., Wood, G. & Berger, L.M. (2024). Controlling Virtual Reality With Brain Signals: State of the Art of Using VR-Based Feedback in Neurofeedback Applications. Appl Psychophysiol Biofeedback. https://doi.org/10.1007/s10484-024-09677-8