-
公开(公告)号:US20220398986A1
公开(公告)日:2022-12-15
申请号:US17582633
申请日:2022-01-24
Applicant: Snap Inc.
Inventor: Jeffrey Michael DeWall , Alexander Kane , Dominik Schnitzer , Mathieu Emmanuel Vignau
Abstract: Disclosed are systems and methods for adaptively adjusting brightness of a wearable device projection system. The systems and methods perform operations comprising: causing projection elements of the AR wearable device to project an image; receiving a measure of ambient light from an ambient light sensor; adjusting one or more hardware parameters of the projection elements of the AR wearable device based on the measure of ambient light; modifying one or more color values of the image displayed by the projection elements of the AR wearable device based on the measure of ambient light; and projecting the image with the modified color values using the projection elements of the AR wearable device with the adjusted one or more hardware parameters.
-
公开(公告)号:US20220103752A1
公开(公告)日:2022-03-31
申请号:US17485761
申请日:2021-09-27
Applicant: Snap Inc.
Inventor: Bo Ding , Chintan Doshi , Alexander Kane , Anton Kondratenko , Gerald Nilles , John James Robertson , Dmitry Ryuma , Matthias Kalkgruber
Abstract: An eyewear device having an image processor operable in a camera pipeline for computer vision (CV) and in augmented reality (AR) systems. The image processor is configured to selectively control a plurality of cameras to provide images having a first resolution in the high power AR mode, and to provide the images having a second resolution in the low power CV mode. The first resolution is higher than the second resolution, and the plurality of cameras consume less power in the CV mode than the AR mode. The image processor controls the camera pipeline to process the first resolution high IQ images from the plurality of cameras to operate in the AR mode, and controls the camera pipeline to process the second resolution lower IQ images from the plurality of cameras to operate in the CV mode. Substantial power is saved by reducing the resolution of the images using downscaling in the cameras themselves in the CV mode.
-
公开(公告)号:US12108027B2
公开(公告)日:2024-10-01
申请号:US18141833
申请日:2023-05-01
Applicant: Snap Inc.
Inventor: Clemens Birklbauer , Alexander Kane , Dominik Schnitzer
IPC: H04N17/00 , H04N23/56 , H04N25/531
CPC classification number: H04N17/002 , H04N23/56 , H04N25/531
Abstract: Camera pipeline exposure timestamp error determination methods and systems that detect latency in rolling shutter camera systems. The exposure timestamp error determination system includes a rolling shutter image sensor configured to capture an image and a processor. The processor determines timestamp error by capturing the image using the rolling shutter image sensor where the image includes a bar code encoded with a barcode timestamp. The processor then obtains a system exposure timestamp corresponding to capture of the image by the rolling shutter image sensor and the barcode timestamp by decoding the bar code. Pipeline exposure timestamp error is then determined for the rolling shutter camera system by comparing the obtained barcode timestamp to the system exposure timestamp.
-
公开(公告)号:US11823634B2
公开(公告)日:2023-11-21
申请号:US17582633
申请日:2022-01-24
Applicant: Snap Inc.
Inventor: Jeffrey Michael DeWall , Alexander Kane , Dominik Schnitzer , Mathieu Emmanuel Vignau
CPC classification number: G09G3/3406 , G02B27/0101 , G02B27/0172 , G09G3/32 , G02B2027/0118 , G02B2027/0178 , G09G2320/0626 , G09G2320/0666 , G09G2360/144
Abstract: Disclosed are systems and methods for adaptively adjusting brightness of a wearable device projection system. The systems and methods perform operations comprising: causing projection elements of the AR wearable device to project an image; receiving a measure of ambient light from an ambient light sensor; adjusting one or more hardware parameters of the projection elements of the AR wearable device based on the measure of ambient light; modifying one or more color values of the image displayed by the projection elements of the AR wearable device based on the measure of ambient light; and projecting the image with the modified color values using the projection elements of the AR wearable device with the adjusted one or more hardware parameters.
-
公开(公告)号:US20240323516A1
公开(公告)日:2024-09-26
申请号:US18679739
申请日:2024-05-31
Applicant: Snap Inc.
Inventor: Bo Ding , Chintan Doshi , Alexander Kane , John James Robertson , Dmitry Ryuma
IPC: H04N23/65 , G06T1/20 , G06T3/40 , H04N5/04 , H04N5/265 , H04N23/667 , H04N23/90 , H04N23/951
CPC classification number: H04N23/651 , G06T1/20 , G06T3/40 , H04N5/04 , H04N5/265 , H04N23/667 , H04N23/90 , H04N23/951
Abstract: Eyewear having an image signal processor (ISP) dynamically operable in a camera pipeline for augmented reality (AR) and computer vision (CV) systems. Multi-purpose cameras are used for simultaneous image capture and CV on wearable AR devices. The cameras are coupled to a frame and configured to generate images, wherein the cameras and the ISP operate in a first AR mode and capture images having a first resolution suitable for use in AR, and are configured to operate in a second CV mode to provide the images having a second resolution suitable for use in CV. The first resolution in the AR mode is higher than the second resolution in the CV mode, and the cameras and the ISP consume less power in the second CV mode than the first AR mode. The cameras and the ISP save significant system power by operating in the low power mode CV mode.
-
公开(公告)号:US20230412928A1
公开(公告)日:2023-12-21
申请号:US17845478
申请日:2022-06-21
Applicant: Snap Inc.
Inventor: Julian Grahsl , Alexander Kane
IPC: H04N5/235 , H04N13/111
CPC classification number: H04N5/2352 , H04N13/111 , H04N2213/008 , H04N13/243
Abstract: A method of determining an image capture timestamp offset or error includes generating optical flashes at an optical flash rate. A set of images of the optical flashes are captured at an image capture rate. The image capture rate is different from the optical flash rate, and each image includes an associated image timestamp. Signals associated with the generation of the optical flashes are also timestamped. The intensity of each image in the set of images is determined, and the image having the greatest intensity in the set of images is identified. The timestamp offset or error is determined as the difference between the timestamp of the image having the greatest intensity and the timestamp of the corresponding optical flash.
-
公开(公告)号:US12015842B2
公开(公告)日:2024-06-18
申请号:US17460244
申请日:2021-08-29
Applicant: Snap Inc.
Inventor: Bo Ding , Chintan Doshi , Alexander Kane , John James Robertson , Dmitry Ryuma
IPC: H04N23/65 , G06T1/20 , G06T3/40 , H04N5/04 , H04N5/265 , H04N23/667 , H04N23/90 , H04N23/951
CPC classification number: H04N23/651 , G06T1/20 , G06T3/40 , H04N5/04 , H04N5/265 , H04N23/667 , H04N23/90 , H04N23/951
Abstract: Eyewear having an image signal processor (ISP) dynamically operable in a camera pipeline for augmented reality (AR) and computer vision (CV) systems. Multi-purpose cameras are used for simultaneous image capture and CV on wearable AR devices. The cameras are coupled to a frame and configured to generate images, wherein the cameras and the ISP are configured to operate in a first AR mode and capture images having a first resolution suitable for use in AR, and are configured to operate in a second CV mode to provide the images having a second resolution suitable for use in CV. The first resolution in the AR mode is higher than the second resolution in the CV mode, and the cameras and the ISP consume less power in the second CV mode than the first AR mode. The cameras and the ISP save significant system power by operating in the low power mode CV mode.
-
公开(公告)号:US12003862B2
公开(公告)日:2024-06-04
申请号:US17845478
申请日:2022-06-21
Applicant: Snap Inc.
Inventor: Julian Grahsl , Alexander Kane
IPC: H04N23/72 , H04N13/111 , H04N13/243
CPC classification number: H04N23/72 , H04N13/111 , H04N13/243 , H04N2213/008
Abstract: A method of determining an image capture timestamp offset or error includes generating optical flashes at an optical flash rate. A set of images of the optical flashes are captured at an image capture rate. The image capture rate is different from the optical flash rate, and each image includes an associated image timestamp. Signals associated with the generation of the optical flashes are also timestamped. The intensity of each image in the set of images is determined, and the image having the greatest intensity in the set of images is identified. The timestamp offset or error is determined as the difference between the timestamp of the image having the greatest intensity and the timestamp of the corresponding optical flash.
-
公开(公告)号:US20220103757A1
公开(公告)日:2022-03-31
申请号:US17460244
申请日:2021-08-29
Applicant: Snap Inc.
Inventor: Bo Ding , Chintan Doshi , Alexander Kane , John James Robertson , Dmitry Ryuma
Abstract: Eyewear having an image signal processor (ISP) dynamically operable in a camera pipeline for augmented reality (AR) and computer vision (CV) systems. Multi-purpose cameras are used for simultaneous image capture and CV on wearable AR devices. The cameras are coupled to a frame and configured to generate images, wherein the cameras and the ISP are configured to operate in a first AR mode and capture images having a first resolution suitable for use in AR, and are configured to operate in a second CV mode to provide the images having a second resolution suitable for use in CV. The first resolution in the AR mode is higher than the second resolution in the CV mode, and the cameras and the ISP consume less power in the second CV mode than the first AR mode. The cameras and the ISP save significant system power by operating in the low power mode CV mode.
-
-
-
-
-
-
-
-