-
公开(公告)号:US20230341948A1
公开(公告)日:2023-10-26
申请号:US18307260
申请日:2023-04-26
Applicant: Snap Inc.
Inventor: Daniel Colascione , Daniel Harris , Andrei Rybin , Anoosh Kruba Chandar Mahalingam , Pierre-Yves Santerre , Jennica Pounds
CPC classification number: G06F3/017 , G06T19/006 , G02B27/0172 , G02B2027/0178
Abstract: An AR system includes multiple input-modalities. A hand-tracking pipeline supports Direct Manipulation of Virtual Object (DMVO) and gesture input methodologies. In addition, a voice processing pipeline provides for speech inputs. Direct memory buffer access to preliminary hand-tracking data, such as skeletal models, allows for low latency communication of the data for use by DMVO-based user interfaces. A system framework component routes higher level hand-tracking data, such as gesture identification and symbols generated based on hand positions, via a Snips protocol to gesture-based user interfaces.
-
公开(公告)号:US20240070994A1
公开(公告)日:2024-02-29
申请号:US17823810
申请日:2022-08-31
Applicant: Snap Inc.
CPC classification number: G06T19/006 , G02B27/0172 , G06F3/017 , G06T7/246 , G06T19/20 , G06V20/20 , G06V40/28 , G02B2027/0178 , G06T2207/20044 , G06V2201/07
Abstract: An Augmented Reality (AR) system is provided. The AR system uses a combination of gesture and DMVO methodologies to provide for the user's selection and modification of virtual objects of an AR experience. The user indicates that they want to interact with a virtual object of the AR experience by moving their hand to overlap the virtual object. While keeping their hand in an overlapping position, the user makes gestures that cause the user's viewpoint of the virtual object to either zoom in or zoom out. To end the interaction, the user moves their hand such that their hand is no longer overlapping the virtual object.
-
公开(公告)号:US20240070995A1
公开(公告)日:2024-02-29
申请号:US17823814
申请日:2022-08-31
Applicant: Snap Inc.
CPC classification number: G06T19/006 , G06T19/20 , G06T7/246 , G06V40/28 , G06V20/20 , G06F3/017 , G02B27/0172 , G02B2027/0178 , G06T2207/20044 , G06V2201/07
Abstract: An Augmented Reality (AR) system is provided. The AR system uses a combination of gesture and DMVO methodologies to provide for the user's selection and modification of virtual object of an AR experience. The user indicates that they want to interact with a virtual object of the AR experience by moving their hand to overlap the virtual object. While keeping their hand in an overlapping position, the user rotates their wrist and the virtual object is rotated as well. To end the interaction, the user moves their hand such that their hand is no longer overlapping the virtual object.
-
-