Definitions
Experiential media (EM) refers to models of media computing that incorporate contextual understanding of human activity, at different scales of time and space, to affect the human experience of the content through such activity. It allows user engagement by utilizing live sensors as input to a media computing unit that then outputs multimedia to output sources, such as displays or speakers. Experiential media is dynamic real-time generated media based on the live physical activity perceived with the goal of achieving enhanced and unified physical-digital experiences (Sundaram and Rikakis 2008).
Introduction
Experiential media (or EM) was used primarily by the museum industry for specialized exhibits using methods of experiential learning (Huang and Lin 2013), but has grown since then into a general tool for experiential content delivery in...
This is a preview of subscription content, log in via an institution to check access.
References
Beyerer, J., Puente, L.F., Frese, C.: Introduction. In: Machine vision. Springer, Berlin/Heidelberg (2016). https://doi.org/10.1007/978-3-662-47794-6_1
Dubnov, T.: Interactive projection for aerial dance using depth sensing camera. SPIE 9012, The Engineering Reality of Virtual Reality 2014, 901202 (28 February 2014). https://doi.org/10.1117/12.2041905
Dubnov, T., Wang, C.: Free-body gesture tracking and augmented reality improvisation for floor and aerial dance. (2015). https://doi.org/10.13140/2.1.2863.1845.
Ebert, A., Deller, M., Steffen, D., Heintz, M.: “Where did i put that?” – effectiveness of kinesthetic memory in immersive virtual environments. In: Stephanidis, C. (eds.) Universal Access in Human-Computer Interaction. Applications and Services. UAHCI 2009. Lecture Notes in Computer Science, vol. 5616. Springer, Berlin/Heidelberg (2009). https://doi.org/10.1007/978-3-642-02713-0_19
Eye Setup – Set the Camera and Content Window | Zuzor App. 20 Aug 2019, https://www.zuzorapp.com/forum/tutorials/eye-setup-set-the-camera-and-content-window. Accessed Sep 2020
Huang, C., Lin, F.S.: Exploring Visitors’ Experiential Experience in the Museum: A Case of the National Museum of Taiwan Literature. National Yunlin University of Science and Technology (2013)
Intel® RealSense.: https://www.intelrealsense.com/. Accessed Sep 2020
Kasapakis, V., Gavalas, D., Dzardanova, E.: Mixed reality. In: Lee, N. (ed.) Encyclopedia of Computer Graphics and Games. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-08234-9_205-1
Li, Y.: Video representation. In: LIU, L., ÖZSU, M.T. (eds.) Encyclopedia of Database Systems. Springer, Boston (2009). https://doi.org/10.1007/978-0-387-39940-9_1441
LUMOplay.: https://www.lumoplay.com/. Accessed Sep 2020
Nawrat, A., Daniec, K., Warmuz, T.: Object detection using IR camera. In: Nawrat, A., Simek, K., Świerniak, A. (eds.) Advanced Technologies for Intelligent Systems of National Border Security Studies in Computational Intelligence, vol. 440. Springer, Berlin/Heidelberg (2013). https://doi.org/10.1007/978-3-642-31665-4_11
openFrameworks.: https://openframeworks.cc/. Accessed Sep 2020
Orbbec – Intelligent computing for everyone everywhere. https://orbbec3d.com/. Accessed Sep 2020
Performances Using Experiential Backdrops – YouTube. 17 Nov 2019, https://www.youtube.com/watch?v=4t_5QBsYi1w. Accessed 29 Dec 2020
Sigal, L.: Human pose estimation. In: Ikeuchi, K. (ed.) Computer Vision. Springer, Boston (2014). https://doi.org/10.1007/978-0-387-31439-6_584
Smisek, J., Jancosek, M., Pajdla, T.: 3D with Kinect. In: Fossati, A., Gall, J., Grabner, H., Ren, X., Konolige, K. (eds.) Consumer Depth Cameras for Computer Vision. Advances in Computer Vision and Pattern Recognition. Springer, London (2013). https://doi.org/10.1007/978-1-4471-4640-7_1
Su, Z., Xu, L., Zheng, Z., Yu, T., Liu, Y., Fang, L.: RobustFusion: human volumetric capture with data-driven visual cues using a RGBD camera. In: Vedaldi, A., Bischof, H., Brox, T., Frahm, J.M. (eds.) Computer Vision – ECCV 2020. ECCV 2020. Lecture Notes in Computer Science, vol. 12349. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-58548-8_15
Sundaram, H., Rikakis, T.: Experiential media systems. In: Furht, B. (ed.) Encyclopedia of Multimedia. Springer, Boston (2008). https://doi.org/10.1007/978-0-387-78414-4_317
Sutcliffe, A.: Human-computer Interface Design. Macmillan, UK (1995). https://doi.org/10.1007/978-1-349-13228-7
Unity.: https://unity.com/. Accessed Sep 2020
Wang, C., Dubnov, S.: The variable markov oracle: Algorithms for human gesture applications. IEEE MultiMedia. 22(4), 52–67 (2015)
Zuzor.: https://www.zuzor.co/. Accessed Sep 2020.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this entry
Cite this entry
Dubnov, T. (2021). Experiential Media: Using Machine Vision and Sensor-Input to Create Dynamic Real-Time Generated Media. In: Lee, N. (eds) Encyclopedia of Computer Graphics and Games. Springer, Cham. https://doi.org/10.1007/978-3-319-08234-9_403-1
Download citation
DOI: https://doi.org/10.1007/978-3-319-08234-9_403-1
Received:
Accepted:
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-08234-9
Online ISBN: 978-3-319-08234-9
eBook Packages: Springer Reference Computer SciencesReference Module Computer Science and Engineering