-
公开(公告)号:US11719939B2
公开(公告)日:2023-08-08
申请号:US17739551
申请日:2022-05-09
Applicant: Snap Inc.
Inventor: Sumant Hanumante , Bernhard Jung , Matthias Kalkgruber , Anton Kondratenko , Edward Lee Kim-Koon , Gerald Nilles , John James Robertson , Dmitry Ryuma , Alexander Sourov , Daniel Wolf
CPC classification number: G02B27/0172 , G01K7/00 , G06F1/26 , G06F3/011 , G06T19/006 , G01K2215/00 , G02B27/0093 , G02B2027/014 , G02B2027/0138 , G02B2027/0178
Abstract: Devices and methods for dynamic power configuration (e.g., reduction) for thermal management (e.g., mitigation) in a wearable electronic device such as an eyewear device. The wearable electronic device monitors its temperature and, responsive to the temperature, configures the services is provides to operate in different modes for thermal mitigation (e.g., to prevent overheating). For example, based on temperature, the wearable electronic device adjusts sensors (e.g., turns cameras on or off, changes the sampling rate, or a combination thereof) and adjusts display components (e.g., adjusted rate at which a graphical processing unit generates images and a visual display is updated). This enables the wearable electronic device to consume less power when temperatures are too high in order to provide thermal mitigation.
-
公开(公告)号:US20220365348A1
公开(公告)日:2022-11-17
申请号:US17739551
申请日:2022-05-09
Applicant: Snap Inc.
Inventor: Sumant Hanumante , Bernhard Jung , Matthias Kalkgruber , Anton Kondratenko , Edward Lee Kim-Koon , Gerald Nilles , John James Robertson , Dmitry Ryuma , Alexander Sourov , Daniel Wolf
Abstract: Devices and methods for dynamic power configuration (e.g., reduction) for thermal management (e.g., mitigation) in a wearable electronic device such as an eyewear device. The wearable electronic device monitors its temperature and, responsive to the temperature, configures the services is provides to operate in different modes for thermal mitigation (e.g., to prevent overheating). For example, based on temperature, the wearable electronic device adjusts sensors (e.g., turns cameras on or off, changes the sampling rate, or a combination thereof) and adjusts display components (e.g., adjusted rate at which a graphical processing unit generates images and a visual display is updated). This enables the wearable electronic device to consume less power when temperatures are too high in order to provide thermal mitigation.
-
公开(公告)号:US20220109820A1
公开(公告)日:2022-04-07
申请号:US17553287
申请日:2021-12-16
Applicant: Snap Inc.
Inventor: Dmitry Ryuma , David Ben Ezra , Dunxu Hu , Patrick Timothy McSweeney Simons
IPC: H04N13/246 , H04N13/239 , H04N13/344 , G06T7/80 , G02B27/01
Abstract: Camera compensation methods and systems that compensate for misalignment of sensors/camera in stereoscopic camera systems. The compensation includes identifying a pitch angle offset between a first camera and a second camera, determining misalignment of the first and second cameras from the identified pitch angle offset, determining a relative compensation delay responsive to the determined misalignment, introducing the relative compensation delay to image streams produced by the cameras, and producing a stereoscopic image on a display from the first and second image streams with the introduced delay.
-
公开(公告)号:US11805322B2
公开(公告)日:2023-10-31
申请号:US17690160
申请日:2022-03-09
Applicant: Snap Inc.
Inventor: Bo Ding , Dmitry Ryuma
CPC classification number: H04N23/73 , G03B7/093 , G03B17/48 , G02B2027/0138
Abstract: Imaging methods and imagers for image capture devices. Still images are captured by gathering ambient light data using an ambient light sensor of the image capture device, selecting a frame rate for the imager corresponding to the gathered ambient light data, determining optimal image capture parameters for the imager by executing an auto exposure algorithm with a processor using the selected frame rate as an initialization parameter for the auto exposure algorithm, and capturing a still image with the imager after execution of the auto exposure algorithm using the selected frame rate.
-
公开(公告)号:US11575874B2
公开(公告)日:2023-02-07
申请号:US17553287
申请日:2021-12-16
Applicant: Snap Inc.
Inventor: Dmitry Ryuma , David Ben Ezra , Dunxu Hu , Patrick Timothy McSweeney Simons
IPC: H04N13/246 , H04N13/239 , H04N13/344 , G06T7/80 , G02B27/01
Abstract: Camera compensation methods and systems that compensate for misalignment of sensors/camera in stereoscopic camera systems. The compensation includes identifying a pitch angle offset between a first camera and a second camera, determining misalignment of the first and second cameras from the identified pitch angle offset, determining a relative compensation delay responsive to the determined misalignment, introducing the relative compensation delay to image streams produced by the cameras, and producing a stereoscopic image on a display from the first and second image streams with the introduced delay.
-
公开(公告)号:US20220318303A1
公开(公告)日:2022-10-06
申请号:US17704387
申请日:2022-03-25
Applicant: Snap Inc.
Inventor: Dmitry Ryuma , Farid Zare Seisan
IPC: G06F16/683 , G06T19/00 , H04R3/00 , G02B27/01 , H04R1/08
Abstract: Systems and methods herein describe transmitting metadata to an augmented reality device using inaudible frequencies by receiving a first stream of inaudible sound waves in real-time, generating a first binary representation of the first stream of inaudible sound waves, generating a first set of metadata based on the first binary representation, generating a first plurality of augmented reality content items based on the first set of metadata, causing display of the first plurality of augmented reality content items on a display device coupled to the head-wearable apparatus as the first stream of inaudible sound waves is being received.
-
公开(公告)号:US20220201185A1
公开(公告)日:2022-06-23
申请号:US17690160
申请日:2022-03-09
Applicant: Snap Inc.
Inventor: Bo Ding , Dmitry Ryuma
Abstract: Imaging methods and imagers for image capture devices. Still images are captured by gathering ambient light data using an ambient light sensor of the image capture device, selecting a frame rate for the imager corresponding to the gathered ambient light data, determining optimal image capture parameters for the imager by executing an auto exposure algorithm with a processor using the selected frame rate as an initialization parameter for the auto exposure algorithm, and capturing a still image with the imager after execution of the auto exposure algorithm using the selected frame rate.
-
公开(公告)号:US20220103752A1
公开(公告)日:2022-03-31
申请号:US17485761
申请日:2021-09-27
Applicant: Snap Inc.
Inventor: Bo Ding , Chintan Doshi , Alexander Kane , Anton Kondratenko , Gerald Nilles , John James Robertson , Dmitry Ryuma , Matthias Kalkgruber
Abstract: An eyewear device having an image processor operable in a camera pipeline for computer vision (CV) and in augmented reality (AR) systems. The image processor is configured to selectively control a plurality of cameras to provide images having a first resolution in the high power AR mode, and to provide the images having a second resolution in the low power CV mode. The first resolution is higher than the second resolution, and the plurality of cameras consume less power in the CV mode than the AR mode. The image processor controls the camera pipeline to process the first resolution high IQ images from the plurality of cameras to operate in the AR mode, and controls the camera pipeline to process the second resolution lower IQ images from the plurality of cameras to operate in the CV mode. Substantial power is saved by reducing the resolution of the images using downscaling in the cameras themselves in the CV mode.
-
公开(公告)号:US12072930B2
公开(公告)日:2024-08-27
申请号:US17704387
申请日:2022-03-25
Applicant: Snap Inc.
Inventor: Dmitry Ryuma , Farid Zare Seisan
IPC: G06F16/683 , G02B27/01 , G06T19/00 , H04R1/08 , H04R3/00
CPC classification number: G06F16/683 , G02B27/017 , G06T19/006 , H04R1/08 , H04R3/005
Abstract: Systems and methods herein describe transmitting metadata to an augmented reality device using inaudible frequencies by receiving a first stream of inaudible sound waves in real-time, generating a first binary representation of the first stream of inaudible sound waves, generating a first set of metadata based on the first binary representation, generating a first plurality of augmented reality content items based on the first set of metadata, causing display of the first plurality of augmented reality content items on a display device coupled to the head-wearable apparatus as the first stream of inaudible sound waves is being received.
-
公开(公告)号:US12015842B2
公开(公告)日:2024-06-18
申请号:US17460244
申请日:2021-08-29
Applicant: Snap Inc.
Inventor: Bo Ding , Chintan Doshi , Alexander Kane , John James Robertson , Dmitry Ryuma
IPC: H04N23/65 , G06T1/20 , G06T3/40 , H04N5/04 , H04N5/265 , H04N23/667 , H04N23/90 , H04N23/951
CPC classification number: H04N23/651 , G06T1/20 , G06T3/40 , H04N5/04 , H04N5/265 , H04N23/667 , H04N23/90 , H04N23/951
Abstract: Eyewear having an image signal processor (ISP) dynamically operable in a camera pipeline for augmented reality (AR) and computer vision (CV) systems. Multi-purpose cameras are used for simultaneous image capture and CV on wearable AR devices. The cameras are coupled to a frame and configured to generate images, wherein the cameras and the ISP are configured to operate in a first AR mode and capture images having a first resolution suitable for use in AR, and are configured to operate in a second CV mode to provide the images having a second resolution suitable for use in CV. The first resolution in the AR mode is higher than the second resolution in the CV mode, and the cameras and the ISP consume less power in the second CV mode than the first AR mode. The cameras and the ISP save significant system power by operating in the low power mode CV mode.
-
-
-
-
-
-
-
-
-