Research on the Application of Virtual Reality and Augmented Reality - Dr. Li Qian

2021-01-22

Virtual reality technology is an important direction of simulation technology. It is a combination of simulation technology and computer graphics, man-machine interface technology, multimedia technology, sensing technology, network technology and other technologies. It is a challenging interdisciplinary technology frontier discipline and research field. Virtual reality mainly includes simulated environment, perception, natural skills and sensing devices. Simulation environment is generated by computer, real - time dynamic three - dimensional realistic images. Perception means that the ideal virtual reality should have the perception that all people have. In addition to the visual perception generated by computer graphics technology, there are hearing, touch, force, movement and other perceptions, and even including smell and taste, also known as multi-perception. Natural skills refer to the human head rotation, eyes, gestures, or other human behavior movements, by the computer to deal with the movements of the participants in accordance with the data, and make real-time response to the user's input, respectively feedback to the user's facial features. Sensor equipment refers to three-dimensional interactive equipment.

And augmented reality technology is developed on the basis of the virtual reality technology, through the simulation science and technology, produce a vivid visual, audio and force, touch and feel of virtual environment, and use all kinds of sensing device users "immersed" in this environment, the computer-generated virtual objects, scene or system message overlay to real scenario, users and direct the environment to natural interaction, the information provided by the computer system combined with the user perception of the real world, so as to realize the reality of the "enhanced", is a new human-computer interaction technology, has the characteristics of the bricks, real-time interaction. There are hundreds of possible applications for this technology, with gaming and entertainment being the most obvious.

1. Application of virtual reality and augmented reality in education

The application of virtual reality and augmented reality in teaching publications can create an experiential and immersive learning environment for readers and students to achieve the purpose of knowledge construction. It can not only express the state that paper plane is difficult to express, such as stereo and animation, but also increase the entertainment and interaction of paper media, which enriches and supplements the mainstream teaching forms and provides more possibilities for the diversification of teaching forms. Greatly reduce the content of paper media, reduce the length, reduce printing costs, improve the added value of products. Users will no longer need carriers such as CD-ROM, and will only need mobile terminals to realize cross-media reading. Education and science and technology resources will be published with augmented reality technology. In the mobile Internet environment, cloud computing, Internet of Things, perception technology, streaming media and other technologies will be integrated to realize cross-media reading. Users only need to scan the pictures of paper books on mobile terminals, that is, they can display 3D images, audio, video and other extended contents that are not available in paper books on mobile terminals, which greatly reduces the content of paper media, reduces the length, reduces the printing cost, and improves the added value of products.

2. The application of virtual reality and augmented reality in teaching film making

In the process of film creation, virtual reality technology is used to support immersive perception with a variety of sensory elements. Through the multiple design of sound and picture, users' visual immersion can be triggered. The so-called visual immersion refers to the user's immersive perception relying on the virtual influence, and it is difficult to detect the difference between scenes and images in the delicate three-dimensional picture. After the use of immersion guidance, the dimension of sensory experience is more consistent with the movie-watching psychology. Viewers measure the story line presented by the theme of the film from their own perspective and choose the direction of progress from different perspectives, which is a new design dimension provided by virtual reality technology for modern film and television works. However, in the design of virtual scenes, the introduction of virtual reality technology does not exist virtual space. If the movie-watching experience is separated from the content consistent with visual logic, the conceptual effect of movie-watching experience will be reduced. On the contrary, when the design of the virtual scene is highly consistent with the authenticity of the real scene, it is equivalent to widening the connection between the virtual world and the real world, which is the conceptual impact of enhancing the virtual perception effect. For example, in the design of a magic fireball, the effect should be to wrap the ball in flames, to create a visual perception of internal and external flames from the inside out, and to light up around the fireball.

With the application of virtual reality technology, panoramic shooting mode without dead corners can be adopted, and then there is no need to deliberately avoid the line of sight of camera equipment. With the help of augmented reality technology, video clips can be seamlessly connected with the reality information shot in completely different time and space through post-production, even when the Angle of the film is seriously wrong. Some films, such as Journey to the West and Girls' Kingdom, produced by Xing Hao Pictures Co Ltd, use augmented reality to shoot underwater virtual scenes instead of actors in real life. With the combined use of correlation techniques such as keying, tracking and composition, the post-production effect did not produce any visual logic deviation, although the actors did not make video under water. For example, the two leading characters in Farewell My Concubine and Cheng Dieyi can highlight their personalities and plot factors of the story background only with the help of strong light and dark lighting. At this time, it is necessary to use the combination of multiple sets of lenses, or the mixed use of multiple lighting equipment. The introduction of augmented reality technology has made it easier to make things digital. Under the condition that is not conducive to increasing the lighting equipment, the color processing mode of different keynote can be integrated to effectively adjust the saturation, color difference, cold and warm light or the contrast of light and shade. For example, in the scene of the car body in Finding Mr. Beijing, it is not easy to directly add lighting auxiliary equipment. However, in order to highlight the effect of color contrast, augmented reality technology is integrated into the post-production. Through the contrast effect of warm and cold colors, the main body of the movie is set off, and the attention of the viewers is strongly attracted. In the trailer for Ghost in the Shell, the producers left only a few angles in some shots to stimulate viewers' imagination, while others were greened out. This way of production maximizes the control of the audience's perspective, and at the same time creates different imagination space for the audience. In the rescue of Mars, also used a similar scheme, camera spacesuit helmet for real photography Angle, helmet for virtual scene outside, two-way composition control the audience after the first line of sight, is equal to the audience and the role of the line of sight to the fusion, in the shooting Angle of high consistency to find the same film viewing angles, to highlight the idea of sexuality has a supporting role.

3. Application of virtual reality and augmented reality in the 5G era

5G network is characterized by high speed, wide connection and low delay. The technical standards issued by ITU are the eight major performance indicators of 5G. Among them, speed improvement and Internet of Everything reflect that the development of virtual reality and augmented reality is inseparable from 5G high-speed network to a certain extent. Making VR/AR game experience more perfect can be realized through the application of 5G network. In the near future, the new technology of 5G network will become the communication technology that VR and AR industry rely on for development. 5 g network can be in accordance with the needs of the business distribution network and computing resources, edge computing support fixed network, mobile business development, such as car networking, virtual reality, video optimization speed, monitoring video analysis, etc., will be part of the edge of cloud computing data center business to compute servers, according to the analysis of the local focus on real-time, short cycle. Then, according to the rich computing resources and storage resources provided by the mobile edge computing server, the cached audio/video content, the location information is merged to determine the push content and send it to the user, so as to better support the real-time intelligent processing and execution of the local business. For example, when the augmented reality information (user location and camera perspective) is acquired, it will be analyzed and processed by the nearest mobile edge server with computing and analysis ability, thus reducing the delay of data transmission to the data center for analysis and processing and then back. The application of moving edge computing in augmented reality is shown in Figure 1.

 image.png

Figure 1 Application of moving edge computing in augmented reality

For the virtual reality industry, limiting high-traffic image background rendering to the edge of the network greatly reduces the strain on the backbone. In addition, through a user gateway sinking, marginalized and other method is applied to greatly reduce the network delay, better serve the needs of virtual reality business, promote the application of virtual reality innovation, lead to huge development space for the application of virtual reality industry, further improve the interactive and immersive virtual reality applications, make the virtual reality technology from the traditional entertainment industry to each vertical industry applications. Moving Edge Computing applies marginalization to reduce delay as shown in Figure 2.

image.png 

Fig. 2 Moving Edge Computing applies marginalization to reduce delay

The application of virtual reality and augmented reality in teaching has important practical significance for the realization of technology development and practice in the field of education, and has important reference significance for the formulation and implementation of education and teaching policies. The integrated application of augmented reality technology and virtual reality technology is also the creative direction of the continuous innovation of modern film and television works, which will help to change the photography mode and movie-watching mode, and provide a completely different experience effect for movie-goers. After the arrival of 5G era, the transmission barrier of VR/AR will be broken, and the problems that have plagued the application of VR/AR technology in mobile terminals will be solved. In order to be more realistic, very detailed textures and textures are needed, which can be easily realized in 5G network. Based on the two key technologies of network slicing and edge computing in 5G, it can satisfy the model application of virtual reality/augmented reality in many scenarios and allow operators to provide services to users at low cost.