公开(公告)号：WO2022060549A2

公开(公告)日：2022-03-24

申请号：PCT/US2021/047637

申请日：2021-08-26

Applicant: SNAP INC.

Inventor： CANBERK, Ilteris ,  KUCHER, Dmytro ,  HOVOROV, Dmytro ,  SYDORAN, Artur

IPC: A63F13/213 ,  G06F3/01 ,  A63F13/24 ,  A63F13/25 ,  A63F13/26 ,  A63F13/428 ,  A63F13/5255 ,  A63F13/537 ,  A63F2300/8082 ,  G02B2027/0138 ,  G02B2027/0178 ,  G02B2027/0187 ,  G02B27/0176 ,  G06F3/012 ,  G06F3/017 ,  G06F3/0425 ,  G06F3/04817 ,  G06T11/60 ,  G06T2210/12 ,  G06T2210/21

Abstract: Example systems, devices, media, and methods are described for presenting an interactive game in augmented reality on the display of a smart eyewear device. A hand tracking utility detects and tracks the location of hand gestures in real time, based on high-definition video data. The detected hand gestures are compared to library of hand gestures and landmarks. Examples include synchronized, multi-player games in which each device detects and shares hand gestures with other devices for evaluation and scoring. A single-player example includes gesture-shaped icons presented on a virtual scroll that appears to move toward an apparent collision with corresponding key images, awarding points if the player's hand is located near the apparent collision and the detected hand shape matches the moving icon.

公开(公告)号：WO2022006069A1

公开(公告)日：2022-01-06

申请号：PCT/US2021/039553

申请日：2021-06-29

Applicant: SNAP INC.

Inventor： CANBERK, Ilteris ,  KANG, Shin Hwun ,  KUCHER, Dmytro

IPC: G06F3/01 ,  G02B27/0093 ,  G02C11/10 ,  G06F3/013 ,  G06F3/1454

Abstract: Eyewear providing an interactive augmented reality experience between two users of eyewear devices to perform a shared group object manipulation task. During the shared group task, each user of the eyewear controls movement of a respective virtual object in a virtual scene based on a portion of the virtual scene the user is gazing at. Each user can also generate a verbal command to generate a virtual object that interacts with one or more of the other virtual objects.

公开(公告)号：WO2022006116A1

公开(公告)日：2022-01-06

申请号：PCT/US2021/039628

申请日：2021-06-29

Applicant: SNAP INC.

Inventor： CANBERK, Llteris ,  KANG, Shin, Hwun ,  KUCHER, Dmytro

IPC: G06F3/01 ,  G06F40/58 ,  G10L13/00 ,  G10L15/26 ,  G02B2027/0138 ,  G02B2027/0178 ,  G02B27/0172 ,  G06F3/011 ,  G06F3/013 ,  G06T19/006 ,  G06T2207/30196 ,  G06T7/73 ,  G06V40/10 ,  H04N13/111 ,  H04N13/207 ,  H04N13/332 ,  H04N2213/008

Abstract: Eyewear presenting text corresponding to spoken words (e.g., in speech bubbles) and optionally translating from one language to another. In one example, an interactive augmented reality experience is provided between two users of eyewear devices to allow one user of an eyewear device to share a personal attribute of the user with a second user. The personal attribute can be speech spoken by a remote second user of eyewear converted to text. The converted text can be displayed on a display of eyewear of the first user proximate the viewed second user. The personal attribute may be displayed in a speech bubble proximate the second user, such as proximate the head or mouth of the second user. The language of the spoken speech can be recognized by the second user eyewear, and translated to a language that is understood by the first user. In another example, the spoken words of a remote person is captured by the eyewear of a user, the position of the remote person is identified, the spoken word are converted to text, and the text is displayed (e.g., in a speech bubble) on an AR display of the eyewear adjacent the remote person.

公开(公告)号：WO2021242634A1

公开(公告)日：2021-12-02

申请号：PCT/US2021/033642

申请日：2021-05-21

Applicant: SNAP INC.

Inventor： KANG, Shin, Hwun ,  CANBERK, Ilteris ,  POWDERLY, James ,  KUCHER, Dmytro ,  HOVOROV, Dmytro

IPC: A63F13/26 ,  A63F13/211 ,  A63F13/213 ,  A63F13/65 ,  A63F13/42 ,  A63F13/5375

Abstract: Interactive augmented reality experiences with an eyewear device including a position detection system and a display system. The eyewear device registers a first marker position for a user-controlled virtual game piece and a second marker for an interaction virtual game piece. The eyewear device monitors its position (e.g., location and orientation) and updates the position of the user-controlled virtual game piece accordingly. The eyewear device additionally monitors the position of the user-controlled virtual game piece with respect to the interaction virtual game piece for use in generating a score. Augmented reality examples include a "spheroidal balancing" augmented reality experience and a "spheroidal balancing" augmented reality experience.

公开(公告)号：WO2022005720A1

公开(公告)日：2022-01-06

申请号：PCT/US2021/036720

申请日：2021-06-10

Applicant: SNAP INC.

Inventor： CANBERK, Ilteris ,  KANG, Shin, Hwun ,  KUCHER, Dmytro

IPC: G02B27/01 ,  G06F3/0481 ,  G06T19/00 ,  A63F13/00 ,  A63F13/211 ,  A63F13/212 ,  A63F13/213 ,  A63F13/26 ,  A63F13/428 ,  A63F13/5255 ,  A63F13/655 ,  A63F13/98 ,  G02B2027/0178 ,  G02B27/017 ,  G02B27/0172 ,  G06F1/163 ,  G06F3/011 ,  G06F3/017 ,  G06F3/04815 ,  G06F3/04883 ,  G06F3/1454 ,  G06T19/006 ,  G06T2219/024

Abstract: Eyewear providing an interactive augmented reality experience between two users of eyewear devices to perform a shared group task. During a shared group task session, each eyewear user can manipulate virtual objects displayed in a respective virtual scene that is viewable to each user to perform collaboration. The virtual objects can include many different types of objects, such as a building structure that can be jointly created and edited by the eyewear users.

公开(公告)号：WO2021242688A1

公开(公告)日：2021-12-02

申请号：PCT/US2021/033892

申请日：2021-05-24

Applicant: SNAP INC.

Inventor： KANG, Shin, Hwun ,  KUCHER, Dmytro ,  HOVOROV, Dmytro ,  CANBERK, Ilteris

IPC: G06F3/01 ,  G01C21/20 ,  G01C21/34

Abstract: Augmented reality guidance for guiding a user through an environment using an eyewear device. The eyewear device includes a display system and a position detection system. A user is guided though an environment by monitoring a current position of the eyewear device within the environment, identifying marker positions within a threshold of the current position, the marker positions defined with respect to the environment and associated with guidance markers, registering the marker positions, generating overlay image including the guidance markers, and presenting the overlay image on a display of the eyewear device.