Abstract: Benefiting from the principles of cognitive psychology in the real world,we combine visual representation of virtual scene with their semantic information in VEs to support the user’s interaction process. As a result,various types of 3D interaction techniques can be integrated into a consistent interaction framework,which makes 3D UIs more understandable and usable for users in complex VEs.By enhancing semantic-process ability of scene graph,we construct a special 3D interface architecture that supports high-level interaction semantics.Using this architecture,3D interactive systems can directly implement interaction tasks in geometric level and in semantic level.A VR application of guidance to touring in Children’s Amusement City is presented.