MODELS OF THE SPEAKER'S TEMPORAL ORIENTATION IN VIRTUAL REALITY AND THEIR IMPACT ON HUMAN-MACHINE INTERFACE SYSTEMS

Konstantin  I. Belousov; Natalia  V. Boronnikova; Aleksandar  H. Taleski

doi:10.21618/fil2532362b

Autori

Konstantin I. Belousov Belarusian State University of Foreign Languages, Faculty of English Language
Natalia V. Boronnikova Perm State University, Faculty of Philology
Aleksandar H. Taleski Perm State University, Faculty of Philology

DOI:

https://doi.org/10.21618/fil2532362b

Parole chiave:

virtual-temporal deixis, deictics, models, VR, speaker behavior, orientation, HMI

Abstract

The manuscript addresses models concerning the speaker's temporal orientation during communication within virtual reality (VR). VR denotes an environment constructed through computer technologies and technical apparatus. Presently, VR is regarded as an experimental domain or research methodology. The research was procured via experiment and analyzed 725 reactions from 24 participants, identifying temporal deictics that indicate temporal proximity or distance, which helped delineate temporal orientation modalities within VR. This research seeks to delve into the complexities of temporal orientation models within VR environments, concentrating on their role in shaping communication and optimizing human-machine interaction (HMI). Through a detailed VR-based experimental framework, the study investigates cognitive and communicative processes, uncovering distinctive temporal orientation models and their variations, which are influenced by extralinguistic factors. The analysis further highlights the speaker's temporal orientation in VR, referred to as virtual-temporal deixis, which forms a unique communicative-indicative coordinate system. The results underscore VR’s utility as a powerful tool for exploring cognitive and communicative dynamics, alongside mechanisms of language transformation. Moreover, the findings offer a theoretical basis for developing HMI systems that more closely align with human temporal perception, fostering more intuitive and natural user interactions.

Riferimenti bibliografici

Anderson, S.R. & Keenan, E. (1985) Deixis. In: Shopen, T. (ed.) Language Typology and Syntactic Fieldwork. Cambridge, Cambridge University Press, Vol. III, 259–308.

Apothéloz, D. (2021) Anaphore et temps verbaux [Anaphora and verbal tenses], Langue Francaise [French Language], 210(2), 21–40.

Apresyan, Y.D. (1986) Nekotorye soobrazheniya o dejksise v svyazi s ponyatiem naivnoj modeli mira [Some considerations about deixis in connection with the concept of a naive model of the world]. In: Dobrzyńska, T. (ed.) Teoriya tekstu [Theory of Text]. Wrocław, Ossolineum, 83–98.

Baranzini, L. & de Saussure, L. (eds.) (2021) Recherches actuelles sur le temps et l’aspect. Leiden, Brill. Available from: https://doi.org/10.1163/9789004468191 [Accessed 03 September 2024].

Belousov, K., Erofeeva, E. and Leshchenko, Y. (2017) ‘Semograph’ Information System as a Framework for Network-Based Science and Education, Smart Innovation, Systems and Technologies: Smart Education and e-Learning, 263–272.

Benveniste, E. (1956) La nature des pronoms. In: Benveniste, É. Problèmes de linguistique générale [Problems in General Linguistics]. Vol. I. Paris, Gallimard, pp. 251–257.

Blascovich, J., Loomis, J., Beall, A.C., Swinth, K.R., Hoyt, C.L. and Bailenson, J.N. (2002) Immersive Virtual Environment Technology as a Methodological Tool for Social Psychology. Personality and Social Psychology Review, 13(2), 103–124. DOI: 10.1207/S15327965PLI1302_01.

Bondarko, A.V. (1990) Funktsional'naya grammatika. Temporal'nost'. Modal'nost' [Functional Grammar: Temporality and Modality]. Leningrad, Nauka.

Bondarko, A.V. (2001) Printsipy funktsional'noy grammatiki i voprosy aspektologii [Principles of Functional Grammar and Aspects of Aspectology]. Moscow, Editorial URSS.

Bryson, S. (2013) Virtual reality: A definition history – A personal essay, arXiv, arXiv:1312.4322. Available at: https://arxiv.org/abs/1312.4322 [Accessed 16 August 2024].

Castronovo, F., Nikolic, D., Liu, Y. and Messner, J. (2013) An evaluation of immersive virtual reality systems for design reviews. In: Dawood, N. and Kassem, M. (eds.) International Conference on Construction Applications of Virtual Reality (CONVR). London, 20–29.

De Crescenzio, F. & Frau, G. (2013) Design of virtual reality based HMIs (humanmachine interfaces) of complex systems. 20th IEEE International Conference and Workshops on Engineering of Computer-Based Systems (ECBS), 181–186. IEEE. DOI: 10.1109/ECBS.2013.25.

Diessel, H. (1999) Demonstratives: Form, function, and grammaticalization. Philadelphia, John Benjamins Publishing Company. DOI: 10.1075/tsl.42.

Erzinkyan, E.J. (1978) Vremennoy deyksis v semantike raznykh chastey rechi [Temporal deixis in the semantics of different parts of speech], Vestnik Obshchestvennykh Nauk AN Armyanskoy SSR, (12), 21–32.

Fillmore, C. (1982) Towards a Descriptive Framework for Spatial Deixis. In: Jarvella, R. and Klein, W. (eds.) Space, Place and Action: Studies in Deixis and Related Topics. Chichester, John Wiley & Sons, pp. 31–59.

Fox, J., Arena, D. and Bailenson, J.N. (2009) Virtual Reality: A survival guide for the social scientist, Journal of Media Psychology, 21(3), 95–113. DOI: 10.1027/1864- 1105.21.3.95.

Gryaznova, E.V. (2013) Filosofskiy analiz kontseptsiy virtual'noy real'nosti [Philosophical analysis of the concepts of virtual reality]. Filosofskaya Mysl', (4), 53–82. DOI: 10.7256/2306-0174.2013.4.278.

Haspelmath, M. (1997) From space to time: Temporal adverbials in the world’s languages. Munich-Newcastle, LINCOM Europe. DOI: 10.5281/zenodo.831421.

Jungbluth, K. (2003) Deictics in the Conversation Dyad: Findings in Spanish and Some Cross-linguistic Outlines. In: Lenz, F. (ed.) Deictic Conceptualization of Space, Time and Person. Amsterdam: John Benjamins, pp. 13–40. DOI: 10.1075/pbns.112.04jun.

Katona, J. (2021) A Review of Human–Computer Interaction and Virtual Reality Research Fields in Cognitive InfoCommunications. Applied Sciences, 11(6), 2646. https://doi.org/10.3390/app11062646.

Lanier, G. (1992) Interview. Computer Graphics World, 15(4), 47–54.

Marino, S. (2020) Theoretical Reference Points. Available from: https://doi.org/10.1007/978-3-030-48145-2_3 [Accessed 12 September 2024].

McMillan, K. (1994) Virtual reality: Architecture and the broader community. [Online] Available at: http://www.arch.unsw.edu.au/subjects/arch/specres2/mcmillan/vr-arch.htm [Accessed May 2024].

Muhić, E. (2024) Within These Four Walls: The Perilousness of Elusive Guard Rails and Impermanence of Safety. Philologist – Journal of Language, Literature, and Cultural Studies, 15(29), 313–321. https://doi.org/10.21618/fil2429313m

Mütterlein, J. (2018) The three pillars of virtual reality? Investigating the roles of immersion, presence, and interactivity. Proceedings of the 51st Hawaii International Conference on System Sciences. DOI: 0.24251/hicss.2018.174.

Nosov, N.A. (2000) Psikhologicheskaya virtual'naya real'nost' [Psychological virtual reality], Chelovek. Filosofsko-entsiklopedicheskiy slovar'. Moscow, Nauka, 292–296.

Partarakis, N. & Zabulis, X. (2024) A Review of Immersive Technologies, Knowledge Representation, and AI for Human-Centered Digital Experiences, Electronics, 13(2), 269. https://doi.org/10.3390/electronics13020269.

Peeters, D. (2019) Virtual reality: A game-changing method for the language sciences. Psychonomic Bulletin & Review, 26(3), 894–900. DOI: 10.3758/s13423-019-01571-3.

Powell, C.S. (1996) Interview with Jaron Lanier. Scientific American, 15 September.

Reichenbach, H. (1947) Elements of Symbolic Logic. New York, Macmillan. DOI: 10.2307/2181740.

Ryabinin, K.V., Belousov, K.I. and Chuprina, S.I. (2020) Novel Circular Graph Capabilities for Comprehensive Visual Analytics of Interconnected Data in Digital Humanities. Scientific Visualization, 12(4), 56–70. DOI: 10.26583/sv.12.4.06.

Ryan, M.-L. (2015) Narrative as Virtual Reality 2: Revisiting Immersion and Interactivity in Literature and Electronic Media. JHU Press. DOI: 10.1353/book.72246.

Sherman, B. & Judkins, P. (1992) Glimpses of Heaven, Visions of Hell: Virtual Reality and its Implications. London, Hodder and Stoughton.

Shi, Y., Azzolin, N., Picardi, A., Zhu, T., Bordegoni, M. and Caruso, G. (2020) A Virtual Reality-based Platform to Validate HMI Design for Increasing User’s Trust in Autonomous Vehicle. Computer-Aided Design and Applications, 18(3), 502–518. DOI: 10.14733/cadaps.2021.502-518.

Slater, M. & Wilbur, S. (1997) A framework for immersive virtual environments (FIVE): Speculations on the role of presence in virtual environments. Presence: Teleoperators & Virtual Environments, 6(6), 603–616. DOI: 10.1162/pres.1997.6.6.603.

Smith, C.S. (2006) The Pragmatics and Semantics of Temporal Meaning. In: Denis, P. et al. (eds.) Proceedings of the 2004 Texas Linguistics Society Conference. Somerville, MA: Cascadilla Proceedings Project, pp. 92–106.

Steuer, J. (1992) Defining Virtual Reality: Dimensions Determining Telepresence. Communication in the Age of Virtual Reality. L. Erlbaum Associates Inc., 33–56. DOI: 10.1111/j.1460-2466.1992.tb00812.x.

Taleski, A. (2024) Modeli dejkticheskogo i kommunikativnogo povedeniya govoryashchego v virtual'noy real'nosti [Models of Deictic and Communicative Behavior of the Speaker in Virtual Reality]. Monograph. Edited by K.I. Belousov. Moscow, FLINTA.

Walsh, K.R. & Pawlowski, S.D. (2002) Virtual reality: A technology in need of IS research. Communications of the Association for Information Systems, 8(1), 297–313. DOI: 10.17705/1CAIS.00820.

Witmer, B.G. & Singer, M.J. (1998) Measuring presence in virtual environments: A presence questionnaire. Presence, 7(3), 225–240. DOI: 10.1162/105474698565686.

Zinchenko, Y.P., Menshikova, G.Y., Kovalev, A.I. and Shaigerova, L.A. (2015) Postnonclassical methodology and application of virtual reality technologies in social research. Psychology in Russia: State of the Art, 8(4), 60–71. DOI: 10.11621/pir.2015.0405.

Zherebilo, T.V. (2010) Slovar' lingvisticheskikh terminov [Dictionary of Linguistic Terms]. 5th edn. Nazran, Piligrim.