公开(公告)号：US11874960B2

公开(公告)日：2024-01-16

申请号：US17704404

申请日：2022-03-25

Applicant: Snap Inc.

Inventor： Dmitry Ryuma ,  Farid Zare Seisan

IPC: G06F3/01 ,  G06T19/00

CPC classification number: G06F3/013 ,  G06F3/011 ,  G06T19/006

Abstract: Systems and methods herein describe pausing operation of an augmented reality device based on user facial movement by monitoring user eye movement of a user of a head-wearable apparatus, determining that the user eye movement is directionally facing away from a display device coupled to the head-wearable apparatus, based on the determination, pausing operation of one or more sensors of the head-wearable apparatus.

公开(公告)号：US20220377309A1

公开(公告)日：2022-11-24

申请号：US17716786

申请日：2022-04-08

Applicant: Snap Inc.

Inventor： Dmitry Ryuma ,  Farid Zare Seisan

IPC: H04N13/239 ,  H04N13/161 ,  H04N13/167 ,  H04N13/296

Abstract: A system to perform stereo stitching of image frames comprises a stereo camera system and a hardware encoder. The hardware encoder receives a left image stream and a right image stream from the stereo camera system simultaneously and processes the left and right image stream to generate a single stitched encoded frame. The apparatus can also comprise a processor and a memory having instructions stored thereon, when executed by the processor, causes the processor to perform operations comprising receiving the left image stream and the right image stream, processing the left and right image streams and generating a single stitched encoded frame.

公开(公告)号：US20220319061A1

公开(公告)日：2022-10-06

申请号：US17704398

申请日：2022-03-25

Applicant: Snap Inc.

Inventor： Dmitry Ryuma ,  Farid Zare Seisan

IPC: G06T11/00 ,  H04B10/114 ,  H04N7/22 ,  G06V20/20 ,  G06V30/30

Abstract: Systems and methods herein describe transmitting metadata to an augmented reality device using infrared light by receiving a stream of infrared light in real-time from a camera coupled to a head-wearable apparatus, accessing a set of images from the stream of infrared light, generating a set of metadata based on the set of images, generating a plurality of augmented reality content items based on the set of metadata, causing display of the plurality of augmented reality content items on a display device coupled to the head-wearable apparatus as the stream of infrared light is being received.

公开(公告)号：US20220103757A1

公开(公告)日：2022-03-31

申请号：US17460244

申请日：2021-08-29

Applicant: Snap Inc.

Inventor： Bo Ding ,  Chintan Doshi ,  Alexander Kane ,  John James Robertson ,  Dmitry Ryuma

IPC: H04N5/232 ,  G06T1/20 ,  G06T3/40 ,  H04N5/247 ,  H04N5/04 ,  H04N5/265

Abstract: Eyewear having an image signal processor (ISP) dynamically operable in a camera pipeline for augmented reality (AR) and computer vision (CV) systems. Multi-purpose cameras are used for simultaneous image capture and CV on wearable AR devices. The cameras are coupled to a frame and configured to generate images, wherein the cameras and the ISP are configured to operate in a first AR mode and capture images having a first resolution suitable for use in AR, and are configured to operate in a second CV mode to provide the images having a second resolution suitable for use in CV. The first resolution in the AR mode is higher than the second resolution in the CV mode, and the cameras and the ISP consume less power in the second CV mode than the first AR mode. The cameras and the ISP save significant system power by operating in the low power mode CV mode.