公开(公告)号：WO2022072097A1

公开(公告)日：2022-04-07

申请号：PCT/US2021/048123

申请日：2021-08-29

Applicant: SNAP INC.

Inventor： DING, Bo ,  DOSHI, Chintan ,  KANE, Alexander ,  ROBERTSON, John James ,  RYUMA, Dmitry

IPC: H04N13/239 ,  H04N13/296 ,  H04N5/232

Abstract: Eyewear having an image signal processor (ISP) dynamically operable in a camera pipeline for augmented reality (AR) and computer vision (CV) systems. Multi-purpose cameras are used for simultaneous image capture and CV on wearable AR devices. The cameras are coupled to a frame and configured to generate images, wherein the cameras and the ISP are configured to operate in a first AR mode and capture images having a first resolution suitable for use in AR, and are configured to operate in a second CV mode to provide the images having a second resolution suitable for use in CV. The first resolution in the AR mode is higher than the second resolution in the CV mode, and the cameras and the ISP consume less power in the second CV mode than the first AR mode. The cameras and the ISP save significant system power by operating in the low power mode CV mode.

公开(公告)号：WO2022245648A1

公开(公告)日：2022-11-24

申请号：PCT/US2022/029182

申请日：2022-05-13

Applicant: SNAP INC.

Inventor： DING, Bo ,  EGRI, Ozi ,  KALKGRUBER, Matthias ,  WOLF, Daniel

IPC: H04N5/232 ,  G02B27/01 ,  G06T19/00

Abstract: A method for limiting motion blur in a visual tracking system is described. In one aspect, the method includes accessing a first image generated by an optical sensor of the visual tracking system, identifying camera operating parameters of the optical sensor for the first image, determining a motion of the optical sensor for the first image, determining a motion blur level of the first image based on the camera operating parameters of the optical sensor and the motion of the optical sensor, and adjusting the camera operating parameters of the optical sensor based on the motion blur level.