Skip to main navigation Skip to search Skip to main content

GPT-VR Nexus: ChatGPT-Powered Immersive Virtual Reality Experience

  • Jiangong Chen
  • , Tian Lan
  • , Bin Li

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

The fusion of generative Artificial Intelligence (AI) like ChatGPT and Virtual Reality (VR) can unlock new interaction capabilities through natural language. We introduce GPT-VR Nexus, a novel framework creating a truly immersive VR experience driven by an underlying generative AI engine. It employs a two-step prompt strategy and robust post-processing procedures, without fine-tuning the complex AI model. Our experimental results show quick responses to various user audio requests/inputs.

Original languageEnglish (US)
Title of host publicationProceedings - 2024 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2024
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages1178-1179
Number of pages2
ISBN (Electronic)9798350374490
DOIs
StatePublished - 2024
Event2024 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2024 - Orlando, United States
Duration: Mar 16 2024Mar 21 2024

Publication series

NameProceedings - 2024 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2024

Conference

Conference2024 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2024
Country/TerritoryUnited States
CityOrlando
Period3/16/243/21/24

All Science Journal Classification (ASJC) codes

  • Human-Computer Interaction
  • Media Technology
  • Modeling and Simulation

Fingerprint

Dive into the research topics of 'GPT-VR Nexus: ChatGPT-Powered Immersive Virtual Reality Experience'. Together they form a unique fingerprint.

Cite this