In Russia, Virtual Guide Brings 'Live' Conversations to Museums

A new AI-powered guide created in Saratov can hold natural conversations with visitors, answer questions uniquely, and even gesture through a 3D avatar.

In Saratov, a virtual museum guide has been developed to create the effect of live interaction with visitors. The system was designed by a graduate of the Institute of Applied Information Technologies and Communications at Gagarin State Technical University. He built a special interaction module that integrates a large language model, speech synthesis service, and action planning system.

The guide can talk with visitors, show exhibits, and share interesting facts. Its animated 3D model accompanies speech with realistic gestures and facial 'emotions.' Thanks to the interaction module, the guide can also connect with users through chatbots and external services.

At the core of the system is a neural network trained on a specific subject area, meaning each response it generates is unique. Currently, the developer is creating a database dedicated to the Uvek archaeological expedition, which has been studying the medieval Golden Horde city of Ukek for more than 20 years. The assistant is already being prepared for an upcoming themed festival.

The AI helper is also being trained for use within the university itself, where it will assist applicants and first-year students.