Sustainable Choices Room with an AI-based Assistant

About the project

Within the framework of the EU LIFE project, we created a VR application in which users can experience the consequences of their sustainability-related decisions in a playful way. After starting the game, the user finds themselves in an imaginary control center (the Sustainable Choices Room). A huge planet Earth rotates in the middle of the space, while animated infographics on the walls display various data about our world (e.g. world population growth, average temperature change). The user is presented with four different decisions or tasks. There is always an unsustainable, harmful option (e.g. a gasoline car) and an eco-conscious, sustainable alternative (e.g. an electric car). The user can also watch the consequences of their decision play out on the large central planet Earth. A virtual assistant also appears in the space, who can be asked anything. The assistant is actually an integration of OpenAI's ChatGPT application, trained with its own prompt database so it knows where it currently is, what surrounds it in the VR space, what data is shown on the infographics, and what the user can do there. The virtual assistant primarily relies on this database when asked questions related to the location and the game. Questions asked by the user are transcribed and displayed using integrated Speech-to-Text technology, and the answers generated by ChatGPT are spoken by the 3D model using Text-to-Speech technology. The version of the application without the AI assistant is used at various events nationwide.