-
公开(公告)号:WO2022005715A1
公开(公告)日:2022-01-06
申请号:PCT/US2021/036537
申请日:2021-06-09
申请人: SNAP INC.
发明人: CANBERK, Ilteris , KANG, Shin, Hwun
IPC分类号: G02B27/01 , G06F3/01 , G06F3/0481 , G06T19/00 , G02B2027/0134 , G02B2027/0138 , G02B2027/014 , G02B2027/0178 , G02B27/0093 , G02B27/0101 , G02B27/0172 , G06T19/006 , G06T19/20 , G06T2219/2004 , G06V20/20
摘要: Eyewear providing an interactive augmented reality experience to allow a user of an eyewear device to display a 3D overlay image on a viewed person. The user can select the overlay image from a list of images, such as costumes, stored in memory or generated by the user. The images can be sorted in memory based on common attributes. Registration points of the person are continuously aligned with registration points of the overlay as the person moves such that the user appears to be wearing the 3D costume during movement. By aligning the registration points, the costume adapts to different body types and heights. The coloring of the costume can change based on the environment, such as the lighting, or to contrast with colors viewed in a viewfinder.
-
公开(公告)号:WO2022006116A1
公开(公告)日:2022-01-06
申请号:PCT/US2021/039628
申请日:2021-06-29
申请人: SNAP INC.
IPC分类号: G06F3/01 , G06F40/58 , G10L13/00 , G10L15/26 , G02B2027/0138 , G02B2027/0178 , G02B27/0172 , G06F3/011 , G06F3/013 , G06T19/006 , G06T2207/30196 , G06T7/73 , G06V40/10 , H04N13/111 , H04N13/207 , H04N13/332 , H04N2213/008
摘要: Eyewear presenting text corresponding to spoken words (e.g., in speech bubbles) and optionally translating from one language to another. In one example, an interactive augmented reality experience is provided between two users of eyewear devices to allow one user of an eyewear device to share a personal attribute of the user with a second user. The personal attribute can be speech spoken by a remote second user of eyewear converted to text. The converted text can be displayed on a display of eyewear of the first user proximate the viewed second user. The personal attribute may be displayed in a speech bubble proximate the second user, such as proximate the head or mouth of the second user. The language of the spoken speech can be recognized by the second user eyewear, and translated to a language that is understood by the first user. In another example, the spoken words of a remote person is captured by the eyewear of a user, the position of the remote person is identified, the spoken word are converted to text, and the text is displayed (e.g., in a speech bubble) on an AR display of the eyewear adjacent the remote person.
-
公开(公告)号:WO2021242634A1
公开(公告)日:2021-12-02
申请号:PCT/US2021/033642
申请日:2021-05-21
申请人: SNAP INC.
IPC分类号: A63F13/26 , A63F13/211 , A63F13/213 , A63F13/65 , A63F13/42 , A63F13/5375
摘要: Interactive augmented reality experiences with an eyewear device including a position detection system and a display system. The eyewear device registers a first marker position for a user-controlled virtual game piece and a second marker for an interaction virtual game piece. The eyewear device monitors its position (e.g., location and orientation) and updates the position of the user-controlled virtual game piece accordingly. The eyewear device additionally monitors the position of the user-controlled virtual game piece with respect to the interaction virtual game piece for use in generating a score. Augmented reality examples include a "spheroidal balancing" augmented reality experience and a "spheroidal balancing" augmented reality experience.
-
公开(公告)号:WO2022005720A1
公开(公告)日:2022-01-06
申请号:PCT/US2021/036720
申请日:2021-06-10
申请人: SNAP INC.
IPC分类号: G02B27/01 , G06F3/0481 , G06T19/00 , A63F13/00 , A63F13/211 , A63F13/212 , A63F13/213 , A63F13/26 , A63F13/428 , A63F13/5255 , A63F13/655 , A63F13/98 , G02B2027/0178 , G02B27/017 , G02B27/0172 , G06F1/163 , G06F3/011 , G06F3/017 , G06F3/04815 , G06F3/04883 , G06F3/1454 , G06T19/006 , G06T2219/024
摘要: Eyewear providing an interactive augmented reality experience between two users of eyewear devices to perform a shared group task. During a shared group task session, each eyewear user can manipulate virtual objects displayed in a respective virtual scene that is viewable to each user to perform collaboration. The virtual objects can include many different types of objects, such as a building structure that can be jointly created and edited by the eyewear users.
-
公开(公告)号:WO2021242688A1
公开(公告)日:2021-12-02
申请号:PCT/US2021/033892
申请日:2021-05-24
申请人: SNAP INC.
摘要: Augmented reality guidance for guiding a user through an environment using an eyewear device. The eyewear device includes a display system and a position detection system. A user is guided though an environment by monitoring a current position of the eyewear device within the environment, identifying marker positions within a threshold of the current position, the marker positions defined with respect to the environment and associated with guidance markers, registering the marker positions, generating overlay image including the guidance markers, and presenting the overlay image on a display of the eyewear device.
-
公开(公告)号:WO2022146678A1
公开(公告)日:2022-07-07
申请号:PCT/US2021/063340
申请日:2021-12-14
申请人: SNAP INC.
IPC分类号: G06F3/01 , G06F3/03 , G06F3/04842 , G06F3/04847 , G06F3/0485 , G06F3/0486
摘要: Example systems, devices, media, and methods are described for controlling virtual elements or graphical elements on a display in response to hand gestures detected by an eyewear device that is capturing frames of video data with its camera system. An image processing system detects a series of hand shapes in the video data and determines whether it matches a predefined series of hand gestures. Each predefined series of hand gestures is associated with an action. The system controls movement of the virtual element, relative to the display, in accordance with the associated action. In an example hand shape that includes a thumb sliding along an extended finger, the system establishes a finger scale along the extended finger, calibrates a graphical scale with the finger scale, and controls movement of an interactive graphical element, such as a slider, according to the current thumb position relative to the calibrated graphical scale.
-
公开(公告)号:WO2022125280A1
公开(公告)日:2022-06-16
申请号:PCT/US2021/059696
申请日:2021-11-17
申请人: SNAP INC. [US]/[US]
发明人: CANBERK, Ilteris , KANG, Shin, Hwun
IPC分类号: G02B27/01
摘要: Devices, media, and methods are presented for an immersive augmented reality (AR) experience using an eyewear device with spatial audio. The eyewear device has a processor, a memory, and image sensor, and a speaker system. The eyewear device captures image information for an environment surrounding the device and identifies an object location within the same environment. The eyewear device then associates a virtual object with the identified object location. The eyewear device monitors the position of the device with respect to the virtual object and presents audio signals to alert the user that the identified object is in the environment.
-
公开(公告)号:WO2022005693A1
公开(公告)日:2022-01-06
申请号:PCT/US2021/035840
申请日:2021-06-04
申请人: SNAP INC.
IPC分类号: G06F3/01 , G06F3/16 , G10L15/22 , G02B2027/0178 , G02B27/0176 , G06F3/011 , G06F3/013 , G06F3/017 , G06F3/167 , G06T19/006 , G10L15/26
摘要: Augmented reality experiences with an eyewear device including a position detection system and a display system are provided. The eyewear device acquires text from a user input, a data input, or a speech recognition system. The eyewear device presents a visual text graphic at a predefined location with respect to the eyewear on the display by the display system. The eyewear device allows the user to manipulate the visual text graphics in a number of ways.
-
-
-
-
-
-
-