Apple VR headset can use your finger as a 3D controller - here

Apple VR headset can use your finger as a 3D controller - here

Speculation about Apple's VR and mixed reality headset continues to mount. The latest information reveals that the headset will not use a controller and will employ body (and finger) tracking.

This is detailed in a new patent discovered by Patently Apple. The patent shows that the Apple VR headset uses an external camera and sensors to generate a 3D model of the user's fingertips to sense that they are interacting with real world objects.

If this sounds familiar, it's because we've already heard rumors that the Apple VR headset will employ this type of system: an extensive report from Bloomberg broke the news about this particular feature, and another report from The Information claimed that the headset would feature 12 different tracking cameras.

So it is certainly no surprise to hear that Apple has a patent of this sort. Especially since it would mean that the headset could be controlled more efficiently by eliminating external remotes and controllers.

The patent itself mentions that the system could use a combination of cameras, depth sensors, and alignment algorithms to enable hand and finger tracking. Importantly, finger tracking can monitor individual fingers and record when they touch something in mid-air or make certain gestures.

In the example used in the patent, the user rotates his finger "in front of the camera to interact with the physical environment or to sign into an account."

Whether this exact system will actually make it into the final Apple VR headset cannot be guaranteed. After all, patents are often filed and left in the dust for a variety of reasons. However, given that we have already heard how the headset is supposed to work, it would be surprising if Apple does not include something very similar.

The term "VR headset" is often used, but Apple's headset appears to offer much more than that. Rumor has it that this headset is a precursor to Apple Glasses, which will offer full augmented reality in ordinary glasses.

The VR headset is reportedly being used to prepare developers (and the public) for the ongoing AR ambitions; the VR headset will offer virtual reality and mixed reality experiences, but with a full pass-through that allows users to see virtual objects in the real world They are also said to enable through AR, where virtual objects can be seen in the real world. As such, it will be equipped with a number of external cameras and sensors.

LiDAR, dual 8K displays, eye tracking, and even an external controller are rumored to be included. That's right, despite building a robust body tracking system, patents reveal that Apple is at least considering using a "smart ring" to provide finer hand and finger tracking.

But it all comes at a cost. Rumor has it that the headset could cost as much as $3,000. That's a much larger purchase than, say, the $299 Oculus Quest 2.

Of course, nothing has been confirmed by Apple, and we'll have to wait a while for Cupertino to give us more concrete information. Until mid-2022, if current rumors are to be believed.

Categories