Forget about Apple Glass: The next big thing is to control AR with your brain

Forget about Apple Glass: The next big thing is to control AR with your brain

Facebook is planning a neural interface to be used as a way to control devices like their Facebook AR glasses. The system would utilize a system similar to prosthetics used by people with upper limb disabilities. Sensors in a band worn around the wrist can detect and record impulses from the brain. These signals are so simple that Facebook calls them "clicks," which are reasonably easy to detect, at least at a basic level.

The idea is that the action of tapping the index finger and thumb together can be used as a way to confirm an action. The action of tapping the index finger and thumb together can be used as a way to confirm an action. It can be used while sitting, standing, or lying down, and the action can be subtle enough to not be noticed by others. Facebook says this is a major advantage over voice, which is much less private.

As development progresses, the company claims, it will be possible to activate the device without physically moving it. With increased accuracy, it may be possible to manipulate AR (or other interfaces) at higher speeds. After all, typing uses impulses from the brain to move arm and finger muscles. With sufficient artificial intelligence and training, there is a good chance that typing could be done in a virtual environment.

Facebook is not alone in exploring ways to interact with the virtual world. Apple is reportedly working on some next-generation eye tracking technology for the rumored new Apple AR and VR headsets. This is likely to be a more practical solution for now, and if designed well, could be just as powerful.

The advantage that a wrist-worn system would offer is the option to generate a tactile response from the actions one performs in the virtual world. One study is looking at attaching eight pneumatic bellows to a wristband and using them to simulate specific sensations or to signal events. Another design seeks to use vibration and pressure to signal the hardness of a button or to simulate different textures.

For obvious reasons, Facebook points out in a blog post that this is not the way to read your mind. For example, it is not hard to connect Facebook to privacy violations. The company tracks you wherever you go and tries to make literally everything have a Facebook account. This type of impulse detection device is nothing new, as robotic prosthetics have proven, and will not be able to read your mind.

Facebook wants to reach a consensus on how privacy will affect these technologies. Facebook is encouraging researchers to peer review their work and hopes that the community can help define what is acceptable and what is not.

Categories