Patent published on October 12, 2023

Meta's New Patent: Gesture-Controlled Text Editing for Quest 2

Imagine typing up an email, but instead of seeing your words appear through the tapping of keys on your computer, they form by simply moving your hand in the air. The complicated task of coordinating gestures and voice to easily produce and edit text messages is the chore being tackled by Meta's newly unveiled patent, No. US20230325002A1.

Until now, artificial intelligence devices required more than a handshake's worth of space to track motions and often demanded user movements that felt unnatural and awkward, garnering more than a few confused glances when performed in public. Not to mention, the required large, broad strokes tired out users swiftly. Such eccentric body language has, unfortunately, been a hurdle in the broad adoption of augmented and virtual reality beyond novelty gaming experiences.

Meta's innovative invention promises a departure from these past limitations. The patent reveals a wearable gadget like Meta Quest 2, which can interpret signals from your muscles as you flex your hand in thin air. Importantly, this gadget doesn't require you to perform any sweeping dramatic gestures. The whirling of a finger or slight flick of the wrist is all you need to amend text dictated by voice, making it easy, nearly invisible to curiosity seekers, and less strenuous on users.

Let's envision the possible future that this patent holds. You're on a crowded subway, leaning against the pole with one hand, and typing an urgent email with the other. No keyboard required, just your voice whispering out the words and your hand seamlessly making changes with inconspicuous air strokes. Or you're cooking dinner, your hands full of ingredients, but you want to revise a recipe you see on your smart glasses. Instead of washing your hands and grabbing your device, now you can just utter the changes and delicately gesture to update the recipe on your display.

However, before we get too carried away, it's essential to underline that this is a patent. There's no guarantee the hand gesturing text editor will ever make it to the shelves — the real world application of patented technologies is very uncertain. But one thing is sure, the innovation it proposes is a significant stride towards making the interaction with AR and VR technology more comfortable, less energy-consuming, and socially acceptable, not just within the limitless expanse of a gaming room but in everyday life scenarios.

Explore more