This site uses cookies to improve your experience. To help us insure we adhere to various privacy regulations, please select your country/region of residence. If you do not select a country, we will assume you are from the United States. Select your Cookie Settings or view our Privacy Policy and Terms of Use.
Cookie Settings
Cookies and similar technologies are used on this website for proper function of the website, for tracking performance analytics and for marketing purposes. We and some of our third-party providers may use cookie data for various purposes. Please review the cookie settings below and choose your preference.
Used for the proper function of the website
Used for monitoring website traffic and interactions
Cookie Settings
Cookies and similar technologies are used on this website for proper function of the website, for tracking performance analytics and for marketing purposes. We and some of our third-party providers may use cookie data for various purposes. Please review the cookie settings below and choose your preference.
Strictly Necessary: Used for the proper function of the website
Performance/Analytics: Used for monitoring website traffic and interactions
Ultraleap, a leading company focused on hand-tracking interfaces, this week announced it has secured a £60 million (~$82 million) Series D investment, with the goal of expanding its hand-tracking and mid-air haptic tech in the XR space and beyond. Last month the company released its latest revision.
Despite having only been available on Oculus Quest for roughly three months, independent developers have already established a sizable catalog of unique handtracking applications pushing the boundaries of Oculus technology. This includes everything from procedurally-generated first-person shooters to educational piano learning apps.
Google has released to researchers and developers its own mobile device-based handtracking method using machinelearning, something Google R esearch engineers Valentin Bazarevsky and Fan Zhang call a “new approach to hand perception.” in palm detection, researchers claim.
At F8 this week, Oculus showed work being done on hand-tracking to bring more intuitive control and accurate avatars into VR. Beyond hand-tracking, she also revealed the Oculus ‘Half Dome’ prototype , a headset with a 140 degree field of view and varifocal display.
January is a productive month for extended reality (XR) technologies following CES 2023; as February approaches, Meta and Shopify have introduced hand-tracking innovations for their customers, continuing the journey of XR innovation. Meta Debuts Hand-Tracking v2.1 This Thursday, Meta released hand-tracking v2.1
Meta today announced “major improvements” coming to Quest 2’s controllerless hand-tracking capability. The ‘re-architected computer vision and machinelearning approach’ is said to specifically improve reliability for overlapping or fast moving hands and specific gestures. With the 1.0
Oculus Connect 6 is starting today, and ahead of the festivities Facebook CEO Mark Zuckerberg teased a video showing off some pretty nuanced hand interaction, something he says will be apart of his talk today. Now, we know that Quest will soon include optical hand-tracking. At this point, who knows.
Similarly, Snap has also worked with Wabisabi to integrateits machinelearning model SnapML into Doggo Quest, thegamified dog-walking AR app , letting you overlay digital effects on your pooch as it tracks metrics such as routes and step counts.
Sony Interactive Entertainment (SIE) researchers unveiled a prototype motion controller recently which showcases experimental techniques into full handtracking using machinelearning and capacitive sensors.
HandTracking With Clay AIR. “By By offering handtracking with Clay AIR, Nreal offers its developers and users of the Nreal Light Consumer Kit an added degree of flexibility in how they might want to interact with their MR environment,” Nreal CEO and Founder Chi Xu said in the release. 7invensun focuses on eye-tracking.
They sold this money machine to focus on a technology that is currently not making any relevant money. What was until some time ago a very cool startup with a lot of knowledge about haptics and handtracking (and with a lot of friends of mine) is now just a ghost. Its a big bet on the bright future of XR.
More info Monado now supports handstracking Collabora, the company behind the open-source XR runtime Monado, has just shown that it has been able to implement a working version of handstracking into its framework. Now users will be able to move in the scene without the need of having a controller in their hands.
The key updates in the release are: 24-Point HandTracking; Full-Body Segmentation; 3D Multi-body Tracking; Updates to the Asset Library. Of the updates, full-body segmentation and multi-body tracking were a pretty sure thing. Handtracking in the update is more of a surprise.
Rec Room is working on support for body tracking on SteamVR, and handtracking on Quest. Support for body tracking on SteamVR, such as strapping on 3 or more Vive Trackers , should arrive alongside or soon after the full-body avatars update , slated for later this year. Rec Room’s avatars are currently legless.
In the place of clunky plastic controllers and remotes, we’re seeing the rise of hand and eye tracking solutions, allowing users to move more freely throughout the digital world. XR motion tracking could even be a way for professionals in the athletic and sporting industry to detect issues with form and posture for each athlete.
To bring a more organic and natural typing experience into VR, a group of researchers from the Department of Computer Science at ETH Zürich , Switzerland have developed a set of wristbands called TapID that—when combined with handtracking—allows you to “feel” the keys of your virtual keyboard as you type.
ManoMotion, a computer-vision and machinelearning company, today announced they’re integrated their company’s smartphone-based gesture control with Apple’s augmented reality developer tool ARKit , making it possible to bring basic hand-tracking into AR with only the use of the smartphone’s onboard processors and camera.
In this article, we will explore seven XR trends that have been taking shape over the past year to be the top trends in not only 2022, but within the long-term future of AR, VR and MR. MachineLearning. Cross-Application Content.
As people flock online during quarantine we now find ourselves experimenting with new platforms, pushing immersive technologies to the limits, and collaborating in new ways; from eye-tracking technology and facial tracking to biometrics and brain-control interfaces. Brain-Computer Interfaces.
Learn more (New policy on 18+) Learn more (Horizon is theoretically all 18+). Learn more. Learn more. Learn more. Learn more. Learn more. Learn more (Holoway announcement) Learn more (Holoway official website). Learn more. Learn more. According to him, it will cost $1500.
The SnapDragon service utilises machinelearning, hand-tracking, and cloud technology to facilitate immersive content creation for various devices. The New Zealand-based firm created the AR content creation platform StoryXR through Qualcomm’s SpaceDragon Spaces platform.
While it can technically play fully-immersive VR content, without motion controllers many of the VR games you’ll find on Quest simply won’t make the jump to the $3,500 device, which is instead being pitched as a productivity machine capable of running the standard fleet of iOS apps in addition to visionOS-native apps.
The glasses feature handtracking, and the main menu of Snap OS is anchored to one of your hands to be interacted with using the other. To identify, track, and augment real world objects, SnapML lets developers use custom machinelearning models in their Lenses.
Sony Filles Hand-Tracking Technology. Sony is also planning to introduce accurate hand-tracking technology for its upcoming hardware. An illustration detailing Sony’s patented hand-tracking tech PHOTO: Sony. Sony’s Metaverse.
The headset should be operated through the use of handtracking and eye tracking , exactly like the Vision Pro. Some of the news coming from there have been: NVIDIA announced new Grace Hopper chips to empower AI algorithms on server machines , and AI workbench to allow everyone to play around with AI models.
Apple delivered optimised MR features, including improved spatial capture, hand-tracking, key productivity enhancements, virtual environments, avatars, and more. The updated feature now allows machinelearning algorithms to improve capture results. The Vision Pro allows users to use voice, hand, and eye-base inputs.
The last big breakthrough we saw in ease-of-use interactivity was the launch of handtracking and gesture recognition on enterprise and consumer VAR devices. Curious to learn more, I reached out to Joe Pavitt, Master Inventor and Emerging Technology Specialist at IBM Research Europe. NATURAL LANGUAGE PROCESSING.
As you scan your environment, machinelearning technology automatically segments real-world objects in the background. Using hand-tracking technology, you’ll interact with a variety of virtual puzzles as you search for ancient Egyptian treasures. You can even explore an exact replica of King Tut’s tomb.
The neural interface is blurring the lines between human minds and machines on a massive scale. The stages involved in a neural interface’s functions include: Capturing bioelectrical signals: Electrodes and sensors are placed close to the brain or the muscles – wherever the machine wants to draw information from.
More info Some news about content Fast Travel Games and MoonHood are partnering to create a VR game that aims to replicate the look and feel of claymation Soul Covenant is a tactical VR action game set in a desolated near-future Japan that features the usual battle of men vs machines. Learn more Volumetrics secure $1.1M
The other main activities of our group are related to machinelearning and computer vision. Holo-BLSD is a self-learning tool in AR. They are easy to learn and do not require any specific medical knowledge. Currently, the gold standard for BLSD learning is instructor-led courses.
In an XR (Extended Reality) environment, learning how to use various additional tools and controllers can detract from the overall experience of the technology. Eye and handtracking solutions are emerging as a valuable alternative to old-fashioned control mechanisms. Data Collection and Insights. Enhanced Immersion.
Google debuted MediaPipe, an artificial intelligence (AI) framework that detects people and objects in 3D space, in 2019 and the machinelearning (ML) solution accurately tracks targets to transform 2D media as 3D spatial data.
The most interesting ones for me are related to hand tacking. Meta Quest will receive HandTracking 2.2, which makes the handtracking more responsive to fast movements of hands : the system can so track the hands also when the user is playing fitness games like FitXR (or HitMotion: Reloaded).
Store links - PC VR Augmented Empire - November 21 (Quest) Augmented Empire , the 2017 turn-based strategy game for Oculus Go and Gear VR, is being remastered this month with MR support, handtracking controls and upgraded visuals. You can read our recent preview below to learn more.
It has handtracking, and the Pro model also has eye tracking, like Apple’s device. The feature itself does not count, Apple counts Apple is a hype machine (Original image by Apple) The Apple brand is super strong everywhere in the world (including in China) and people feel cool flexing their own Apple devices.
TeamViewer Pilot – a solution that makes it easy for tech support teams to troubleshoot problems in AR to reduce downtime for machines. Figmin – a platform for creating, editing, and sharing holograms by the group “Figmin XR” Greg Madison , for Tangible UI – an exploration of handtracking on flat surfaces.
In the wake of Apple Vision Pro's announcement earlier this year, ByteDance-owned Pico appears to be switching its focus from controllers to handtracking. Apple, instead, opts for a fresh start with an interface based on a breakthrough combination of eye and handtracking.
The French startup headed by Stan Larroque is developing passthrough AR glasses with eye-tracking and handstracking that can offer a new paradigm to augmented reality. Learn more (Tweet about the event / 1) Learn more (Tweet about the event / 2). Learn more. Compliments to the organizers and the winners!
Alternatively, you can take advantage of the built-in hand-tracking capabilities enabled by the device’s cameras. The hand-tracking functionality is powered by Ultraleaps technology which I already know is extremely impressive. Plus, the hand-tracking capabilities leave a lot to be desired.
Someone in the communities argued with me that HoloLens 2 has still some advantages over Magic Leap 2: it is well integrated with Azure, it is standalone so it doesn’t need a potentially dangerous cable connecting the headset to the computational unit, and it doesn’t need controllers (it uses handstracking). Learn more.
We have seen that handstracking has enabled new kinds of experiences that we hadn’t even thought of before (think about the great experiments by Daniel Beauchamp ), and I’m sure that the same will happen with passthrough AR, too; Facebook is building a platform that will work for all future headsets. Learn more. Some XR fun.
The key updates in the release are: 24-Point HandTracking; Full-Body Segmentation; 3D Multi-body Tracking; Updates to the Asset Library. Of the updates, full-body segmentation and multi-body tracking were a pretty sure thing. Handtracking in the update is more of a surprise.
We'll also aim to note some major game updates to existing games once we learn more. Mixed reality mode lets you place virtual pinball machines across your play space, and online leaderboards are also supported. Interested in learning about more upcoming VR games ?
We organize all of the trending information in your field so you don't have to. Join 3,000+ users and stay up to date on the latest articles your peers are reading.
You know about us, now we want to get to know you!
Let's personalize your content
Let's get even more personalized
We recognize your account from another site in our network, please click 'Send Email' below to continue with verifying your account and setting a password.
Let's personalize your content