ER Experience in the Human-Machine Interconnection Laboratory-Dr. Zhenming Zhai

2020-12-16

In Sun Yat-sen University, there is a laboratory called the Human-Machine Interconnection Laboratory. This laboratory can be experienced. What does it look like when you experience it? It's a car, golf cart, physical. After I went up, I still saw the scene. The same as before I didn't wear it, I still saw the real world not the virtual world when I put on the helmet. Two people got in the car, one person drove, and drove for a while. This scene is a corridor outside the laboratory, which is real.

Suppose I got in the car and the car I was in got out. Where is this? An unfamiliar scene, a foreign street scene, which is obviously fake. However, when it changed from true to false, I don't know, no one can know! A bicycle came on the road, and the person in the car was greeting me. This sound is so familiar. It is my friend who came to the laboratory to walk with him. Where is he? Is this the car he is riding? It was him, after a few chats, we waved goodbye and continued our journey. Through the tunnel, I came to Chang'an Avenue and came to Beijing. This can't be true. This is obviously a transition from a real scene to a virtual scene, but when did this transition?

When I was full of doubts, a spaceship flew up from the sky and took my car into the spaceship. The driver let me get out of the car. At this time, I stretched out a leg to test carefully, and after making sure that I could land, I carefully got out of the car. Walk around slowly. At this moment, I saw myself in a mirror. Just when I was surprised, I accidentally touched it and opened a series of mechanisms. The top cabin of the spacecraft opened, and I was instantly in the splendid galaxy. We were thrown back to "reality" when we were still in the mood: this is the gate of the South Campus of Sun Yat-sen University!

The car drove in from the door, the big trees on both sides of the road swayed with the wind, accompanied by the chirping of birds, this is back. Isn't this the first floor of Xichang Hall where the laboratory is located? This is the eldest security guard who we saw on the first floor before our visit. He is chatting with others, and all this is happening in real time. I'm obviously in the laboratory on the sixth floor. Why did I come to the first floor? At this time, my doubts are getting deeper and deeper... "Di~" The door of the experience space opened, and the companions waved to me outside the door to welcome me back. When I took off my helmet and was about to share my wonderful experience with them, they knew every plot like a god... I don’t know when it changed from fake to real. I don’t know, it’s not because you are stupid, but the scene itself has no signs for you to judge

As a designer, I don’t know if I sit by myself. The technology was designed by me, and the content was made by the construction company. As long as you don’t know the content, you don’t know when the transition will happen. So, this process is completed, seamlessly. In this way, the transition from real to virtual when coming in is seamless, and the transition from virtual to real when coming out is also seamless. This is called a seamless experience of crossing between virtual and real.

Zhang Xiaolong, the current head of Tencent WeChat, once had a meeting and said a few words after the meeting. He said that he hoped that after five years, the meeting would not be used. You are wearing glasses, so there is no need to worry about traffic jams. Once I put on my glasses, it looks exactly like I came to the scene. He said that he should do a good job in five years. I feel a bit too optimistic. The network is not very powerful, even with 5G, it still feels a bit difficult to integrate them all at once. However, some people will have doubts that it is difficult to disguise this thing as fake. Some people think that the resolution is so low, how can it be fake? How can it not be seen that it is so grainy? But I have a way to deal with it, which is to use the method of cutting feet to fit your feet: first, let the reality look a bit like it was made, but I won’t think it is fake because of this. You are still you, but a little grainy, can you say it is fake? So there is no need for high technology! No need for high resolution! For example, it is a little bit delayed here, and the rest of our virtual content is also a little bit delayed. When the two sides are connected, the connection point is no longer visible. This is reverse thinking, it is done. The same method is used to enter and exit, and it is seamless.

Therefore, at least in terms of audiovisual, the boundary between the real world and the virtual world can be erased. The present is not the future. Our future technology has not been used yet. With the superficial technology of the present, seamless connection has been achieved. This thing can be made by a liberal arts professor to such an extent, what does it mean? This shows that this era is coming soon. In the future, Moments will not be an avatar, but an ID, and friends in Moments can sit together.

Why can this be done? It has motion capture. What is motion capture? The easiest is to just plug in the phone and you can see it, because the phone has a gyroscope and it has a motion capture function. After you move like this, it knows that you moved it and then it re-brushes it. It seems to you to happen at the same time, so that you can turn your head and keep the world fixed. The scenes in VR are unique scenes that have never happened in the past and will never happen again in the future. In the laboratory, we have done one more thing, a new VR plus remote operation setting.

Now let’s talk about the Internet of Things. The Internet of Things is to connect things, mainly man-made things, and their locations on the Internet. We all know. Once you know it, you have to operate this thing. Then do you want to run it? No need. It can be operated anywhere, right? If you want to operate the Internet of Things, you don't need a mouse and keyboard to click. For example, when driving a train, we may click on the train now. But we have virtual reality, and we sit on it and start it directly.

Will the car really be driven away once it is driven like this? We have to think of an imported sci-fi 3D movie, Avatar. There is a stand-in for this movie, and the body that actually works in love on a planet called Pandora is doing it. This stand-in is integrated with VR. You don’t need to go out if you use this kind of stuff to work. We have now changed the name of the entire system. We call it ER, which is the extended reality of experience and manipulation.

Therefore, we have to deal with this problem and inject fresh humanistic reason in advance. Don't let those careerists control each of us, we must stop this control. In order to control our feelings, someone may want to control the Internet of Things and directly control our nerves, so that we are finished. Such things are very dangerous.

Imagine, how about this subversion? In ER, people are everywhere, without borders. Where is the boundary between man, body, and tool? Where am i? This concept, no one answered this question. Where am I? do not know! How to distinguish the first scene from the second scene? In the Avatar movie, is that Avatar a real body, or is it true that my parents gave me a real body? Can you answer? The straightforward answer is impossible. The virtual world belongs to him, but he is not in any country, because there are no borders.

According to my estimation, most of these problems in the movie Avatar are real problems, and in reality we will have to face them sooner or later. People say that this new technology needs a killer application to make it develop rapidly and be popularized. But this VR is an exception, it replaces all screens. Remote operation is now in use, and the application is very good! Many hospitals in our country have bought dozens of sets of surgical equipment called Da Vinci System. After a doctor put it on, he wore a sensor on his hand, but it felt like he was holding a scalpel. I look at myself, look at the virtual organ, and operate on the virtual organ with a scalpel in my hand. There is a robotic hand that does exactly the same action as you in the distance. Two robotic hands are inserted into the image together, and inserted into it. They really performed surgery in front of their organs.

Now, Sun Yat-sen University’s hospital has just had a set of Da Vinci. It can be done with such a complicated operation, but can’t it be done with other things?

This is the power of ER, this is the power of the ER prototype system that you can experience in the Human-Machine Interconnection Laboratory of Sun Yat-sen University.