ULTRA LOW POWER CAMERA PIPELINE FOR CV IN AR SYSTEMS

    公开(公告)号:US20220103752A1

    公开(公告)日:2022-03-31

    申请号:US17485761

    申请日:2021-09-27

    申请人: Snap Inc.

    摘要: An eyewear device having an image processor operable in a camera pipeline for computer vision (CV) and in augmented reality (AR) systems. The image processor is configured to selectively control a plurality of cameras to provide images having a first resolution in the high power AR mode, and to provide the images having a second resolution in the low power CV mode. The first resolution is higher than the second resolution, and the plurality of cameras consume less power in the CV mode than the AR mode. The image processor controls the camera pipeline to process the first resolution high IQ images from the plurality of cameras to operate in the AR mode, and controls the camera pipeline to process the second resolution lower IQ images from the plurality of cameras to operate in the CV mode. Substantial power is saved by reducing the resolution of the images using downscaling in the cameras themselves in the CV mode.

    MULTI-PURPOSE CAMERAS FOR SIMULTANEOUS CAPTURE AND CV ON WEARABLE AR DEVICES

    公开(公告)号:US20220103757A1

    公开(公告)日:2022-03-31

    申请号:US17460244

    申请日:2021-08-29

    申请人: Snap Inc.

    摘要: Eyewear having an image signal processor (ISP) dynamically operable in a camera pipeline for augmented reality (AR) and computer vision (CV) systems. Multi-purpose cameras are used for simultaneous image capture and CV on wearable AR devices. The cameras are coupled to a frame and configured to generate images, wherein the cameras and the ISP are configured to operate in a first AR mode and capture images having a first resolution suitable for use in AR, and are configured to operate in a second CV mode to provide the images having a second resolution suitable for use in CV. The first resolution in the AR mode is higher than the second resolution in the CV mode, and the cameras and the ISP consume less power in the second CV mode than the first AR mode. The cameras and the ISP save significant system power by operating in the low power mode CV mode.