Lei feng's network by: this article is from micro-posting network of Lei feng. Vans iPhone 6
(Photo: fretting and vulnerable pupil common tried VR and MR Pok é Mon GO)
Day and night you want to hand manipulation of VR and MR Pok é Mon GO, we do it. Pok é Mon is the right way to GO to break the wall.
Pok é Mon GO so AR is combined with hand, streets and even social, is only a few keywords will attract enough people, and then adding the century Pok é Mon IP, did not seem to fire but doesn't make sense. But with a long press on the phone → slide touch-screen operation simulation of "throwing" spirit ball, treasure dream income which you can ... ... Will some slightly stiff and b?
Although country clothing also not open, but China players on Pok é Mon GO of thinking and imagine and many, Pok é Mon GO does with to we many surprise, but players most looks forward to see of not technology most primary of like, but will of and most for of technology performance form phase combined, from plot design and operation way view, VR/MR+ feel control can with to we more cool of experience.
| Easy to open a brain cavity, but true?
We tried VR and MR Pok é Mon GO, Bao dream lifted from the phone screen, you can grab to select Elf ball, in front of treasure dream throw after adjusted point of aim. If you encounter is a fierce and cunning of treasure dream, in order to avoid being brought rhythm, can also throw the circle the most spin Wizard ball, feed, no probably magical dreams can escape from your hands.
| About development tutorial
Believe you and old drivers VR understand really well, we did the demo unlocking catch treasure in addition to trying to help everyone can dream of a new position, also wanted to touch control MR+ techniques forms spread to everyone. Development tutorial, in addition we Vidoo SDK is also available in the official website for free download, developers are eating this expectation in mind conscience would inherit more from Amway.
Hand control:
First of all, through our binocular depth sensor depth images.
In the depth of the image, we modify the RGB values of each pixel is used to calibrate the pixel distance from the sensor. When we look at the depth of image, you will find the effect we are familiar with infrared thermal imaging image similar to, except that we replaced the temperature range.
In the following illustration, a depth on the left image on the right is the original image. Can be seen by observing, closer, more red color; the greater the distance, the color blue.
Secondly, we will meet the characteristics of human hand depth image segmentation of parts, hand gestures, movement recognition.
Here it should be noted that is a gesture recognition algorithm based on depth images instead of the normal image. So that we can obtain depth information for each point of the hand, thus restoring the whole skeletal structure of the hand. If we want to touch interaction with virtual objects, skeletal structure is an indispensable prerequisite.
Finally, our algorithm the sensor coordinate system (spatial information contains hand bones), virtual world coordinate system (spatial information that includes all virtual objects), the real coordinate system (containing environmental information and information in hand) the three coordinate system alignment.
In this way, we can detect the hand bones aligns with real hands; to be aligned with the realities of virtual objects. When real hand touch virtual objects, will have a similar mouse click events to drive the execution of the program, specific to Pok é Mon GO inside, is fed with Elf, threw out the Elves pitch, and so on.
At this point, the hand control part has been completed, and follow-up will further perfect logic of events in Unity3D, Lieutenant completed Pok é Mon GO Elf ball, food thrown to the Elf's features.
| MR show
Next, we want to do is display space in elements of the game Pok é Mon GO, and Pikachu and smart ball to appear in a reasonable amount of space within. iPhone Vans
We use video technology, through binocular cameras real-time you can see "real" world and digital, and then through a computer algorithm for real-time rendering images. Done both full overlay virtual images can also be seen after a computer-rendered new "real scenes", to meet our demand for virtual objects and real environment there.
After solving the core interaction and display technologies, joining the corresponding SDK in Unity3D, adjustment process logic. MR Pok é Mon GO was born.
| MR name
Referred to in this article, "MR" is not "mixed reality". MR is a technology between VR and AR called mediated reality, the "father of intelligent hardware" Toronto University Professor SteveMann-mediated reality, the full name of Mediated Reality (abbreviated MR). VR is pure virtual digital images, Mixed Reality is virtual digital images, including AR + naked reality, MR is a virtual digital + digital reality picture.
MR is not appeared in recent years, 780 of the last century, in order to enhance its visual effects, let your eyes in any and all circumstances to be able to "see" surroundings, Steve Mann designed a wearable intelligent hardware "Digital Eye Glass" as a visual aid, which is regarded as a preliminary exploration of MR.
Innovation capacity of human visual perception, not only involves digitally superimposed on reality, you also need to use other Visual modifications by means of added, starting from the last century 90 's, MR (mediated reality) to study at the University of Toronto, HI Labs, a group of top talents from the HI laboratories stand out.
Editor's Note: Lei feng's network (search for "Lei feng's network" public concerns) previous years following Steve Mann's easy Apple CTO Ai Tao article--the amazing virtual world: you may not have known the smart glasses, talked about the difference between AR/VR/MR.
(Figures for frequent pupil MR smart glasses--VMG-PROV)
| "Touch control" not "gesture recognition"
Touch control is not equal to gesture recognition, touch control, including gesture recognition.
Hand control must meet the following three basic points:
1, hand controls must have a depth sensor to know how far away from the user.
2, feel manipulated, including gesture recognition. Gesture recognition algorithm for image updates are hand gestures and hand movements instructions, hand gesture recognition information and depth information overlap, resulting in: hand far from me, complete information on what to do, can be called feel manipulated.
3, VR, and hand control to give users a real hand image. Algorithmically image closer to hand and vestibular senses user synchronization, can see the depth of information, giving users the most realistic feeling of control. If users see the hands or simulation of the mechanical hand and friendly interaction will be greatly reduced.
Lei Feng network Note: please contact the authorized retained source and author, no deletion of content.
If you are the VR professionals, or further study of VR technology, contributes to us: zhuanlan@leiphone.com.
