Date Added: Jun 2010
This paper presents a system for high level collaboration between humans and intelligent agents in a virtual reality. The proposed system is capable of creating virtual worlds with the simulation of Newtonian physics and their visualization as interface for humans. Furthermore, with voice recognition and synthesization the human interface provides a user friendly way for conversations with intelligent agents. The proposed system is able to connect the different communication modalities allowing the human user to control the intelligence agents using the brain-in-the-loop control method. The system has a standard modular build-up in order to connect different virtual worlds to each other. Finally the capabilities of the system are demonstrated on two examples.