-
公开(公告)号:US11303819B1
公开(公告)日:2022-04-12
申请号:US16939369
申请日:2020-07-27
Applicant: Snap Inc.
Inventor: Bo Ding , Dmitry Ryuma
Abstract: Imaging methods and imagers for image capture devices. Still images are captured by gathering ambient light data using an ambient light sensor of the image capture device, selecting a frame rate for the imager corresponding to the gathered ambient light data, determining optimal image capture parameters for the imager by executing an auto exposure algorithm with a processor using the selected frame rate as an initialization parameter for the auto exposure algorithm, and capturing a still image with the imager after execution of the auto exposure algorithm using the selected frame rate.
-
公开(公告)号:US20240323516A1
公开(公告)日:2024-09-26
申请号:US18679739
申请日:2024-05-31
Applicant: Snap Inc.
Inventor: Bo Ding , Chintan Doshi , Alexander Kane , John James Robertson , Dmitry Ryuma
IPC: H04N23/65 , G06T1/20 , G06T3/40 , H04N5/04 , H04N5/265 , H04N23/667 , H04N23/90 , H04N23/951
CPC classification number: H04N23/651 , G06T1/20 , G06T3/40 , H04N5/04 , H04N5/265 , H04N23/667 , H04N23/90 , H04N23/951
Abstract: Eyewear having an image signal processor (ISP) dynamically operable in a camera pipeline for augmented reality (AR) and computer vision (CV) systems. Multi-purpose cameras are used for simultaneous image capture and CV on wearable AR devices. The cameras are coupled to a frame and configured to generate images, wherein the cameras and the ISP operate in a first AR mode and capture images having a first resolution suitable for use in AR, and are configured to operate in a second CV mode to provide the images having a second resolution suitable for use in CV. The first resolution in the AR mode is higher than the second resolution in the CV mode, and the cameras and the ISP consume less power in the second CV mode than the first AR mode. The cameras and the ISP save significant system power by operating in the low power mode CV mode.
-
公开(公告)号:US20230388632A1
公开(公告)日:2023-11-30
申请号:US18233729
申请日:2023-08-14
Applicant: Snap Inc.
Inventor: Bo Ding , Ozi Egri , Matthias Kalkgruber , Daniel Wolf
IPC: H04N23/68
CPC classification number: H04N23/6811 , H04N23/684 , H04N23/6812 , G06T19/006
Abstract: A method for limiting motion blur in a visual tracking system is described. In one aspect, the method includes accessing a first image generated by an optical sensor of the visual tracking system, identifying camera operating parameters of the optical sensor for the first image, determining a motion of the optical sensor for the first image, determining a motion blur level of the first image based on the camera operating parameters of the optical sensor and the motion of the optical sensor, and adjusting the camera operating parameters of the optical sensor based on the motion blur level.
-
公开(公告)号:US11805322B2
公开(公告)日:2023-10-31
申请号:US17690160
申请日:2022-03-09
Applicant: Snap Inc.
Inventor: Bo Ding , Dmitry Ryuma
CPC classification number: H04N23/73 , G03B7/093 , G03B17/48 , G02B2027/0138
Abstract: Imaging methods and imagers for image capture devices. Still images are captured by gathering ambient light data using an ambient light sensor of the image capture device, selecting a frame rate for the imager corresponding to the gathered ambient light data, determining optimal image capture parameters for the imager by executing an auto exposure algorithm with a processor using the selected frame rate as an initialization parameter for the auto exposure algorithm, and capturing a still image with the imager after execution of the auto exposure algorithm using the selected frame rate.
-
公开(公告)号:US20220201185A1
公开(公告)日:2022-06-23
申请号:US17690160
申请日:2022-03-09
Applicant: Snap Inc.
Inventor: Bo Ding , Dmitry Ryuma
Abstract: Imaging methods and imagers for image capture devices. Still images are captured by gathering ambient light data using an ambient light sensor of the image capture device, selecting a frame rate for the imager corresponding to the gathered ambient light data, determining optimal image capture parameters for the imager by executing an auto exposure algorithm with a processor using the selected frame rate as an initialization parameter for the auto exposure algorithm, and capturing a still image with the imager after execution of the auto exposure algorithm using the selected frame rate.
-
公开(公告)号:US20220103752A1
公开(公告)日:2022-03-31
申请号:US17485761
申请日:2021-09-27
Applicant: Snap Inc.
Inventor: Bo Ding , Chintan Doshi , Alexander Kane , Anton Kondratenko , Gerald Nilles , John James Robertson , Dmitry Ryuma , Matthias Kalkgruber
Abstract: An eyewear device having an image processor operable in a camera pipeline for computer vision (CV) and in augmented reality (AR) systems. The image processor is configured to selectively control a plurality of cameras to provide images having a first resolution in the high power AR mode, and to provide the images having a second resolution in the low power CV mode. The first resolution is higher than the second resolution, and the plurality of cameras consume less power in the CV mode than the AR mode. The image processor controls the camera pipeline to process the first resolution high IQ images from the plurality of cameras to operate in the AR mode, and controls the camera pipeline to process the second resolution lower IQ images from the plurality of cameras to operate in the CV mode. Substantial power is saved by reducing the resolution of the images using downscaling in the cameras themselves in the CV mode.
-
公开(公告)号:US20210174123A1
公开(公告)日:2021-06-10
申请号:US17177987
申请日:2021-02-17
Applicant: Snap Inc.
Inventor: Scott Lerner , Bo Ding
Abstract: The present application discloses various systems, methods and non-transitory computer-readable mediums that include a first device and a second device to perform processing on a digital image. According to one example, a second one or more edits made using the second device are user subjective and a first one or more edits made using the first device are user agnostic. The second one or more edits are reliant on the first one or more edits for processing flexibility to achieve a desired image attribute.
-
公开(公告)号:US10956770B1
公开(公告)日:2021-03-23
申请号:US15812712
申请日:2017-11-14
Applicant: Snap Inc.
Inventor: Scott Lerner , Bo Ding
Abstract: The present application discloses various systems, methods and non-transitory computer-readable mediums that include a first device and a second device to perform processing on a digital image. According to one example, a second one or more edits made using the second device are user subjective and a first one or more edits made using the first device are user agnostic. The second one or more edits are reliant on the first one or more edits for processing flexibility to achieve a desired image attribute.
-
公开(公告)号:US12015842B2
公开(公告)日:2024-06-18
申请号:US17460244
申请日:2021-08-29
Applicant: Snap Inc.
Inventor: Bo Ding , Chintan Doshi , Alexander Kane , John James Robertson , Dmitry Ryuma
IPC: H04N23/65 , G06T1/20 , G06T3/40 , H04N5/04 , H04N5/265 , H04N23/667 , H04N23/90 , H04N23/951
CPC classification number: H04N23/651 , G06T1/20 , G06T3/40 , H04N5/04 , H04N5/265 , H04N23/667 , H04N23/90 , H04N23/951
Abstract: Eyewear having an image signal processor (ISP) dynamically operable in a camera pipeline for augmented reality (AR) and computer vision (CV) systems. Multi-purpose cameras are used for simultaneous image capture and CV on wearable AR devices. The cameras are coupled to a frame and configured to generate images, wherein the cameras and the ISP are configured to operate in a first AR mode and capture images having a first resolution suitable for use in AR, and are configured to operate in a second CV mode to provide the images having a second resolution suitable for use in CV. The first resolution in the AR mode is higher than the second resolution in the CV mode, and the cameras and the ISP consume less power in the second CV mode than the first AR mode. The cameras and the ISP save significant system power by operating in the low power mode CV mode.
-
公开(公告)号:US11765457B2
公开(公告)日:2023-09-19
申请号:US17522642
申请日:2021-11-09
Applicant: Snap Inc.
Inventor: Bo Ding , Ozi Egri , Matthias Kalkgruber , Daniel Wolf
CPC classification number: H04N23/6811 , H04N23/684 , H04N23/6812 , G06T19/006
Abstract: A method for limiting motion blur in a visual tracking system is described. In one aspect, the method includes accessing a first image generated by an optical sensor of the visual tracking system, identifying camera operating parameters of the optical sensor for the first image, determining a motion of the optical sensor for the first image, determining a motion blur level of the first image based on the camera operating parameters of the optical sensor and the motion of the optical sensor, and adjusting the camera operating parameters of the optical sensor based on the motion blur level.
-
-
-
-
-
-
-
-
-