-
公开(公告)号:US20220103752A1
公开(公告)日:2022-03-31
申请号:US17485761
申请日:2021-09-27
申请人: Snap Inc.
发明人: Bo Ding , Chintan Doshi , Alexander Kane , Anton Kondratenko , Gerald Nilles , John James Robertson , Dmitry Ryuma , Matthias Kalkgruber
摘要: An eyewear device having an image processor operable in a camera pipeline for computer vision (CV) and in augmented reality (AR) systems. The image processor is configured to selectively control a plurality of cameras to provide images having a first resolution in the high power AR mode, and to provide the images having a second resolution in the low power CV mode. The first resolution is higher than the second resolution, and the plurality of cameras consume less power in the CV mode than the AR mode. The image processor controls the camera pipeline to process the first resolution high IQ images from the plurality of cameras to operate in the AR mode, and controls the camera pipeline to process the second resolution lower IQ images from the plurality of cameras to operate in the CV mode. Substantial power is saved by reducing the resolution of the images using downscaling in the cameras themselves in the CV mode.
-
公开(公告)号:US20240323516A1
公开(公告)日:2024-09-26
申请号:US18679739
申请日:2024-05-31
申请人: Snap Inc.
发明人: Bo Ding , Chintan Doshi , Alexander Kane , John James Robertson , Dmitry Ryuma
IPC分类号: H04N23/65 , G06T1/20 , G06T3/40 , H04N5/04 , H04N5/265 , H04N23/667 , H04N23/90 , H04N23/951
CPC分类号: H04N23/651 , G06T1/20 , G06T3/40 , H04N5/04 , H04N5/265 , H04N23/667 , H04N23/90 , H04N23/951
摘要: Eyewear having an image signal processor (ISP) dynamically operable in a camera pipeline for augmented reality (AR) and computer vision (CV) systems. Multi-purpose cameras are used for simultaneous image capture and CV on wearable AR devices. The cameras are coupled to a frame and configured to generate images, wherein the cameras and the ISP operate in a first AR mode and capture images having a first resolution suitable for use in AR, and are configured to operate in a second CV mode to provide the images having a second resolution suitable for use in CV. The first resolution in the AR mode is higher than the second resolution in the CV mode, and the cameras and the ISP consume less power in the second CV mode than the first AR mode. The cameras and the ISP save significant system power by operating in the low power mode CV mode.
-
公开(公告)号:US12015842B2
公开(公告)日:2024-06-18
申请号:US17460244
申请日:2021-08-29
申请人: Snap Inc.
发明人: Bo Ding , Chintan Doshi , Alexander Kane , John James Robertson , Dmitry Ryuma
IPC分类号: H04N23/65 , G06T1/20 , G06T3/40 , H04N5/04 , H04N5/265 , H04N23/667 , H04N23/90 , H04N23/951
CPC分类号: H04N23/651 , G06T1/20 , G06T3/40 , H04N5/04 , H04N5/265 , H04N23/667 , H04N23/90 , H04N23/951
摘要: Eyewear having an image signal processor (ISP) dynamically operable in a camera pipeline for augmented reality (AR) and computer vision (CV) systems. Multi-purpose cameras are used for simultaneous image capture and CV on wearable AR devices. The cameras are coupled to a frame and configured to generate images, wherein the cameras and the ISP are configured to operate in a first AR mode and capture images having a first resolution suitable for use in AR, and are configured to operate in a second CV mode to provide the images having a second resolution suitable for use in CV. The first resolution in the AR mode is higher than the second resolution in the CV mode, and the cameras and the ISP consume less power in the second CV mode than the first AR mode. The cameras and the ISP save significant system power by operating in the low power mode CV mode.
-
公开(公告)号:US20220207840A1
公开(公告)日:2022-06-30
申请号:US17646431
申请日:2021-12-29
申请人: Snap Inc.
发明人: Omer Cansizoglu , Chintan Doshi , Yuechuan Li , Stanislav Minakov , Fedir Poliakov , Justin Wilder
摘要: The subject technology sends captured image data and metadata to a first set of computing processes for processing. The subject technology receives, asynchronously from a second set of computing processes, second metadata. The subject technology detects a signal indicating a command to stop image data capturing. The subject technology, in response to the detected signal, generating a composite AR content item based on the metadata and the captured image data. The subject technology provides the composite AR content item for rendering for display on an eyewear device.
-
公开(公告)号:US20220103757A1
公开(公告)日:2022-03-31
申请号:US17460244
申请日:2021-08-29
申请人: Snap Inc.
发明人: Bo Ding , Chintan Doshi , Alexander Kane , John James Robertson , Dmitry Ryuma
摘要: Eyewear having an image signal processor (ISP) dynamically operable in a camera pipeline for augmented reality (AR) and computer vision (CV) systems. Multi-purpose cameras are used for simultaneous image capture and CV on wearable AR devices. The cameras are coupled to a frame and configured to generate images, wherein the cameras and the ISP are configured to operate in a first AR mode and capture images having a first resolution suitable for use in AR, and are configured to operate in a second CV mode to provide the images having a second resolution suitable for use in CV. The first resolution in the AR mode is higher than the second resolution in the CV mode, and the cameras and the ISP consume less power in the second CV mode than the first AR mode. The cameras and the ISP save significant system power by operating in the low power mode CV mode.
-
-
-
-