Digital Twin for Virtual Reality

The outcome of the project is a fully operational digital twin. The digital twin offers the possibility to test different use cases on a construction site. Therefore, a flying drone with input sensing and modality as well as HMI output components, was developed. The drone serves as an interactive companion for the users, here construction workers, to support them by transporting small magnetic objects, by providing an overview of the construction site and by measuring distances on the construction site. To achieve this a VR environment of a construction site got developed, that contains specific areas tailored to test different use cases. Furthermore, the project included the design of the companion drone, which has a focus on the environment and worker safety, and the implementation of input and output modalities. To make the digital twin as realistic as possible, functioning gesture control with hands using Oculus Quest 2's hand recognition system is implemented to interact with the drone.