Development of an Interactive Holographic Narrative Experience with Choice-Based Decision using Fictional Characters and Air Gesture Technology: A Case Study of the Yellow Building, Vajira Hospital Museum
Article Sidebar
Main Article Content
Abstract
This research aims to design and develop an advanced interactive holographic display system to enhance the medical history learning-oriented museum experience at the Yellow Building, Vajira Hospital Museum. The project introduces three innovative features to tackle challenges associated with touch-based interfaces in hygienic environments and the limitations of conventional exhibitions. First, it employs a 45-degree plane reflection hardware architecture utilizing top-down projection to generate high-fidelity volumetric visuals at eye level. Second, it incorporates a choice-based branching narrative delivered by fictional digital characters acting as virtual guides, promoting visitor engagement. Lastly, it implements 100% touchless interaction through Ultraleap sensors and Touch Free software, positioned at a 45-degree angle via Snap Mounts for precise "Air Cursor" navigation. We want to make a working digital exhibition prototype that clearly shows the Results indicate that most participants historical importance of the Yellow Building while also making it easier for people to remember information and enjoy their visit. This study also lays out an important plan for how to use Natural User Interfaces (NUI) in modern museums, carefully balancing immersive user experiences with strict public health safety standards.
Article Details
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
I/we certify that I/we have participated sufficiently in the intellectual content, conception and design of this work or the analysis and interpretation of the data (when applicable), as well as the writing of the manuscript, to take public responsibility for it and have agreed to have my/our name listed as a contributor. I/we believe the manuscript represents valid work. Neither this manuscript nor one with substantially similar content under my/our authorship has been published or is being considered for publication elsewhere, except as described in the covering letter. I/we certify that all the data collected during the study is presented in this manuscript and no data from the study has been or will be published separately. I/we attest that, if requested by the editors, I/we will provide the data/information or will cooperate fully in obtaining and providing the data/information on which the manuscript is based, for examination by the editors or their assignees. Financial interests, direct or indirect, that exist or may be perceived to exist for individual contributors in connection with the content of this paper have been disclosed in the cover letter. Sources of outside support of the project are named in the cover letter.
I/We hereby transfer(s), assign(s), or otherwise convey(s) all copyright ownership, including any and all rights incidental thereto, exclusively to the Journal, in the event that such work is published by the Journal. The Journal shall own the work, including 1) copyright; 2) the right to grant permission to republish the article in whole or in part, with or without fee; 3) the right to produce preprints or reprints and translate into languages other than English for sale or free distribution; and 4) the right to republish the work in a collection of articles in any other mechanical or electronic format.
We give the rights to the corresponding author to make necessary changes as per the request of the journal, do the rest of the correspondence on our behalf and he/she will act as the guarantor for the manuscript on our behalf.
All persons who have made substantial contributions to the work reported in the manuscript, but who are not contributors, are named in the Acknowledgment and have given me/us their written permission to be named. If I/we do not include an Acknowledgment that means I/we have not received substantial contributions from non-contributors and no contributor has been omitted.
References
Sylaiou, S., Kasapakis, V., Dzardanova, E., and Gavalas, D. (2018). "Leveraging Mixed Reality Technologies to Enhance Museum Visitor Experiences." 2018 International Conference on Intelligent Systems (IS), pp. 586-591.
Meng, R., Li, H., Guo, Y., Wu, Y., Cheng, N., & Hao, L. (2022, August). Smart Museum Collection and Analysis for User Online Behavior. In 2022 International Conference on Culture-Oriented Science and Technology (CoST) (pp. 247-251). IEEE.
Fu, Y., and Zhao, H. (2021). “Realization of Digital Museum Design System Based on 3D Technology.” 2021 International Conference on Computer, Information and Telecommunication Systems (CITS), pp. 1-5.
Katoh, M., Shimizu, S., Takasaki, R., Miyauchi, Y., Kawamura, M., Sato, S., Matías-Lopes, J., and Hasebe, N. (2024). “All-Round Accommodator: Realistic Three-dimensional Aerial Projection using Pepper's Ghost and Focal Length Change.” 2024 11th International Conference on Industrial Engineering and Applications (ICIEA).
Umezu, N., and Iijima, S. (2024). "Pseudo-Holographic Display of Plant Models based on Pepper’s Ghost Illusion." 2024 IEEE 3rd Global Conference on Consumer Electronics (GCCE).
Sidharta, R., Hiyama, A., Tanikawa, T., and Hirose, M. (2006). "The Development of Multi-Depth Pepper's Ghost Display for Mixed Reality System." Proceedings of the 16th International Conference on Artificial Reality and Telexistence (ICAT'06), pp. 115-118.
De Angeli, D., Frangoudes, F., Avraam, S., Neokleous, K., & O'Neill, E. (2022, October). Towards engaging intangible holographic public displays. In 2022 international conference on interactive media, smart systems and emerging technologies (IMET) (pp. 01-08). IEEE.
Tsiviltidou, Z. (2015, November). Digital storytelling with mobile media for inquiry-based museum learning The student as author of the museum experience. In 2015 International Conference on Interactive Mobile Communication Technologies and Learning (IMCL) (pp. 91-95). IEEE.
Podzharaya, N. S., & Sochenkova, A. S. (2018, February). The virtual museum development with the use of intelligent and 3d technologies on the basis of the Maritime museum in Kotor. In 2018 23rd International Scientific-Professional Conference on Information Technology (IT) (pp. 1-4). IEEE.
Lombardo, V., & Damiano, R. (2012). Storytelling on mobile devices for cultural heritage. New Review of Hypermedia and Multimedia, 18(1-2), 11-35.
Unity Technologies. (n.d.). Camera.worldToCameraMatrix. Unity Scripting API. Retrieved December 29, 2025, from https://docs.unity3d.com/ScriptReference/Camera-worldToCameraMatrix.html
LaViola, J. J., Kruijff, E., McMahon, R. P., Bowman, D. A., & Poupyrev, I. (2017). 3D user interfaces: theory and practice. (No Title).
De Angeli, D., Frangoudes, F., Avraam, S., Neokleous, K., & O'Neill, E. (2022, October). Towards engaging intangible holographic public displays. In 2022 international conference on interactive media, smart systems and emerging technologies (IMET) (pp. 01-08). IEEE.
ISO, I. (2008). 7250-1: Basic human body measurements for technological design-Part 1: Body measurement definitions and landmarks. International Organization for Standardization, Geneva, Switzerland.
Sidharta, R., Hiyama, A., Tanikawa, T., & Hirose, M. (2006, November). The development of multi-depth Pepper's ghost display for mixed reality system. In 16th International Conference on Artificial Reality and Telexistence--Workshops (ICAT'06) (pp. 115-118). IEEE.
Katoh, M., Shimizu, S., Takasaki, R., Miyauchi, Y., Kawamura, M., Sato, S., ... & Hasebe, N. (2024, January). All-Round Accommodator: Realistic Three-dimensional Aerial Projection Using Pepper's Ghost and Focal Length Change. In 2024 IEEE/SICE International Symposium on System Integration (SII) (pp. 705-710). IEEE.
Umezu, N., & Iijima, S. (2024, November). Pseudo-Holographic Display of Plant Models based on Pepper's Ghost Illusion. In 2024 Joint 13th International Conference on Soft Computing and Intelligent Systems and 25th International Symposium on Advanced Intelligent Systems (SCIS&ISIS) (pp. 1-4). IEEE.
Norman, D. (2013). The design of everyday things: Revised and expanded edition. Basic books.
Podzharaya, N. S., & Sochenkova, A. S. (2018, February). The virtual museum development with the use of intelligent and 3d technologies on the basis of the Maritime museum in Kotor. In 2018 23rd International Scientific-Professional Conference on Information Technology (IT) (pp. 1-4). IEEE.
