公开(公告)号：US09324172B2

公开(公告)日：2016-04-26

申请号：US14675744

申请日：2015-04-01

Applicant: Capso Vision, Inc.

Inventor： Chenyu Wu ,  Yi Xu ,  Kang-Huai Wang

IPC: G06K9/00 ,  G06T11/60 ,  A61B1/00 ,  A61B1/04

CPC classification number: G06T7/0014 ,  A61B1/00009 ,  A61B1/041 ,  G06T5/006 ,  G06T7/11 ,  G06T7/13 ,  G06T7/136 ,  G06T7/174 ,  G06T7/337 ,  G06T7/37 ,  G06T7/40 ,  G06T7/73 ,  G06T11/60 ,  G06T2207/10068 ,  G06T2207/20048 ,  G06T2207/20072 ,  G06T2207/20081 ,  G06T2207/20221 ,  G06T2207/30004 ,  G06T2207/30028 ,  G06T2207/30032 ,  H04N5/2252 ,  H04N5/23229 ,  H04N5/247 ,  H04N5/265

Abstract: A method of processing images captured by an in vivo capsule camera is disclosed. The images having large overlap exceeding a threshold are stitched into larger images. If the current image and none of its neighboring images has large overlap, the current image is designated as a non-stitched image. Any image, that exists between two images stitched and is not included in the stitched image, is also designated as a non-stitched image. The large-overlap stitching can be performed on the images iteratively by treating the stitched images and non-stitched image as to be processed images in the next round. A second stage stitching can be applied to stitch small-overlap images. The small-overlap image stitching can also be applied iteratively. A third stage stitching can be further applied to stitch the output images from the second stage processing.

Abstract translation: 公开了一种处理由体内胶囊照相机拍摄的图像的方法。 具有超过阈值的大重叠的图像被缝合成较大的图像。 如果当前图像并且其相邻图像中没有一个具有大的重叠，则将当前图像指定为非缝合图像。 存在于缝合的两个图像之间并且不包括在缝合图像中的任何图像也被指定为非缝合图像。 可以通过在下一轮中处理缝合图像和非缝合图像作为处理图像来重复地对图像执行大重叠缝合。 可以应用第二阶段缝合来缝合小重叠图像。 小重叠图像拼接也可以迭代应用。 可以进一步应用第三阶段缝合来对来自第二阶段处理的输出图像进行缝合。

公开(公告)号：US10785428B2

公开(公告)日：2020-09-22

申请号：US16589022

申请日：2019-09-30

Applicant: CAPSO VISION, Inc.

Inventor： Kang-Huai Wang ,  Yi Xu ,  Gordon C. Wilson ,  Chenyu Wu

IPC: H04N5/353 ,  H04N5/355 ,  H04N13/271 ,  A61B1/04 ,  A61B1/00 ,  A61B1/06 ,  H04N13/286 ,  H04N13/296 ,  G02B23/24 ,  H04N5/378 ,  H04N9/04 ,  G01B11/25 ,  H04N5/225

Abstract: A method and apparatus for imaging a body lumen are disclosed. According to the method, an imaging apparatus is induced into the body lumen. Structured light from the imaging apparatus is projected into the body lumen. The structured light reflected from anatomical features in the body lumen is detected by the imaging apparatus. A first structured light image is generated from the detected structured light by the imaging apparatus. Non-structured light is emitted from the imaging apparatus into the body lumen. The non-structured light reflected from the anatomical features in the body lumen is detected by the imaging apparatus. A non-structured light image is generated from the detected non-structured light by the imaging apparatus. The frame period of the first structured light image is shorter than the frame period of the non-structured light image. In one embodiment, the imaging apparatus corresponds to a capsule endoscope.

公开(公告)号：US20200036919A1

公开(公告)日：2020-01-30

申请号：US16578338

申请日：2019-09-21

Applicant: Capso Vision, Inc

Inventor： Kang-Huai Wang ,  Yi Xu ,  Gordon C. Wilson ,  Chenyu Wu

IPC: H04N5/355 ,  G06T7/521 ,  G06T7/55 ,  H04N5/353 ,  G01B11/25 ,  H04N9/04 ,  H04N5/225 ,  H04N13/271

Abstract: A method and device for improving the accuracy of depth information derived from a structured-light image for a regular image are disclosed. In one example, an additional structured-light image is captured before a first structured-light image or after a regular image. The depth information for the regular image can be derived from the first structured-light image and corrected by incorporating depth information from the additional structured-light image. A model for depth information can be used to predict or interpolate depth information for the regular image. In another example, two regular sub-images may be captured with a structured-light image in between. If substantial frame differences or substantial global motion vector/block motion vectors are detected, the two regular sub-images will not be combined in order to avoid possible motion smear. Instead, one of the two sub-images will be selected and scaled as the output regular image.

公开(公告)号：US20200007802A1

公开(公告)日：2020-01-02

申请号：US16563458

申请日：2019-09-06

Applicant: CAPSO VISION, Inc.

Inventor： Kang-Huai Wang ,  Yi Xu ,  Gordon C. Wilson ,  Chenyu Wu

IPC: H04N5/355 ,  H04N13/286 ,  H04N13/296 ,  G02B23/24 ,  H04N5/353 ,  H04N5/378 ,  H04N9/04

Abstract: An integrated image sensor for capturing a mixed structured-light image and regular image using an integrated image sensor are disclosed. The integrated image sensor comprises a pixel array, one or more output circuits, one or more analog-to-digital converters, and one or more timing and control circuits. The timing and control circuits are arranged to perform a set of actions including capturing a regular image and a structured-light image. According to the present invention, the structured-light image captured before or after the regular image is used to derive depth or shape information for the regular image. An endoscope based on the above integrated image sensor is also disclosed. The endoscope may comprises a capsule housing adapted to be swallowed, where the components of integrated image sensor, a structured light source and anon-structured light source are enclosed and sealed in the capsule housing.

公开(公告)号：US09936151B2

公开(公告)日：2018-04-03

申请号：US14884788

申请日：2015-10-16

Applicant: Capso Vision, Inc.

Inventor： Kang-Huai Wang ,  Yi Xu ,  Gordon C. Wilson ,  Chenyu Wu

IPC: A61B1/04 ,  G02B23/24 ,  H04N5/355 ,  H04N5/353 ,  H04N5/378 ,  H04N9/04 ,  H04N13/02 ,  H04N5/225

CPC classification number: H04N5/35581 ,  G01B11/2513 ,  G02B23/2415 ,  G02B23/2484 ,  H04N5/3535 ,  H04N5/3559 ,  H04N5/378 ,  H04N9/045 ,  H04N13/254 ,  H04N13/271 ,  H04N13/286 ,  H04N13/296 ,  H04N2005/2255

Abstract: A method and device for capturing a mixed structured-light image and regular image using an integrated image sensor are disclosed, where the structured-light image is captured using a shorter frame period than the regular image. In order to achieve a shorter frame period for the structured-light image, the structured-light image may correspond to an image captured with reduced dynamic range, reduced spatial resolution, or a combination of them. The capturing process comprises applying reset signals to a pixel array to reset rows of pixels of the pixel array, reading-out analog signals from the rows of pixels of the pixel array and converting the analog signals from the rows of pixels of the pixel array into digital outputs for the image using one or more analog-to-digital converters.

公开(公告)号：US11102428B2

公开(公告)日：2021-08-24

申请号：US16563458

申请日：2019-09-06

Applicant: CAPSO VISION, Inc.

Inventor： Kang-Huai Wang ,  Yi Xu ,  Gordon C. Wilson ,  Chenyu Wu

IPC: H04N7/18 ,  H04N5/355 ,  H04N13/286 ,  H04N13/296 ,  G01B11/25 ,  H04N13/271 ,  A61B1/04 ,  H04N5/353 ,  A61B1/00 ,  A61B1/06 ,  H04N5/369 ,  G02B23/24 ,  H04N5/378 ,  H04N5/225

Abstract: An integrated image sensor for capturing a mixed structured-light image and regular image using an integrated image sensor are disclosed. The integrated image sensor comprises a pixel array, one or more output circuits, one or more analog-to-digital converters, and one or more timing and control circuits. The timing and control circuits are arranged to perform a set of actions including capturing a regular image and a structured-light image. According to the present invention, the structured-light image captured before or after the regular image is used to derive depth or shape information for the regular image. An endoscope based on the above integrated image sensor is also disclosed. The endoscope may comprises a capsule housing adapted to be swallowed, where the components of integrated image sensor, a structured light source and anon-structured light source are enclosed and sealed in the capsule housing.

公开(公告)号：US10742909B2

公开(公告)日：2020-08-11

申请号：US16578338

申请日：2019-09-21

Applicant: Capso Vision, Inc

Inventor： Kang-Huai Wang ,  Yi Xu ,  Gordon C. Wilson ,  Chenyu Wu

IPC: H04N5/355 ,  H04N5/225 ,  H04N13/271 ,  G06T7/521 ,  G06T7/55 ,  H04N5/353 ,  G01B11/25 ,  H04N9/04

Abstract: A method and device for improving the accuracy of depth information derived from a structured-light image for a regular image are disclosed. In one example, an additional structured-light image is captured before a first structured-light image or after a regular image. The depth information for the regular image can be derived from the first structured-light image and corrected by incorporating depth information from the additional structured-light image. A model for depth information can be used to predict or interpolate depth information for the regular image. In another example, two regular sub-images may be captured with a structured-light image in between. If substantial frame differences or substantial global motion vector/block motion vectors are detected, the two regular sub-images will not be combined in order to avoid possible motion smear. Instead, one of the two sub-images will be selected and scaled as the output regular image.

公开(公告)号：US20200036920A1

公开(公告)日：2020-01-30

申请号：US16589022

申请日：2019-09-30

Applicant: CAPSO VISION, Inc.

Inventor： Kang-Huai Wang ,  Yi Xu ,  Gordon C. Wilson ,  Chenyu Wu

IPC: H04N5/355 ,  G01B11/25 ,  H04N13/271 ,  A61B1/04 ,  H04N5/353 ,  A61B1/00 ,  A61B1/06 ,  H04N13/286 ,  H04N13/296 ,  G02B23/24 ,  H04N5/378 ,  H04N9/04

Abstract: A method and apparatus for imaging a body lumen are disclosed. According to the method, an imaging apparatus is induced into the body lumen. Structured light from the imaging apparatus is projected into the body lumen. The structured light reflected from anatomical features in the body lumen is detected by the imaging apparatus. A first structured light image is generated from the detected structured light by the imaging apparatus. Non-structured light is emitted from the imaging apparatus into the body lumen. The non-structured light reflected from the anatomical features in the body lumen is detected by the imaging apparatus. A non-structured light image is generated from the detected non-structured light by the imaging apparatus. The frame period of the first structured light image is shorter than the frame period of the non-structured light image. In one embodiment, the imaging apparatus corresponds to a capsule endoscope.

公开(公告)号：US20170046825A1

公开(公告)日：2017-02-16

申请号：US14827325

申请日：2015-08-15

Applicant: Capso Vision, Inc.

Inventor： Yi Xu ,  Chenyu Wu ,  Kang-Huai Wang

IPC: G06T7/00 ,  G06T5/00

CPC classification number: G06T7/0014 ,  A61B1/00009 ,  A61B1/041 ,  G06T5/006 ,  G06T7/11 ,  G06T7/13 ,  G06T7/136 ,  G06T7/174 ,  G06T7/337 ,  G06T7/37 ,  G06T7/40 ,  G06T7/73 ,  G06T11/60 ,  G06T2207/10068 ,  G06T2207/20048 ,  G06T2207/20072 ,  G06T2207/20081 ,  G06T2207/20221 ,  G06T2207/30004 ,  G06T2207/30028 ,  G06T2207/30032 ,  H04N5/2252 ,  H04N5/23229 ,  H04N5/247 ,  H04N5/265

Abstract: A method of processing images captured using a capsule camera is disclosed. According to one embodiment, two images designated as a reference image and a float image are received, where the float image corresponds to a captured capsule image and the reference image corresponds to a previously composite image or another captured capsule image prior to the float image. Automatic segmentation is applied to the float image and the reference image to detect any non-GI (non-gastrointestinal) region. The non-GI regions are excluded in match measure between the reference image and a deformed float image during the registration process. The two images are stitched together by rendering the two images at the common coordinate. In another embodiment, large area of non-GI regions are removed directly from the input image, and remaining portions are stitched together to form a new image without performing image registration.

Abstract translation: 公开了一种处理使用胶囊照相机拍摄的图像的方法。 根据一个实施例，接收指定为参考图像和浮动图像的两个图像，其中浮动图像对应于所捕获的胶囊图像，并且参考图像对应于在浮动图像之前的先前合成图像或另一捕获的胶囊图像。 自动分割应用于浮动图像和参考图像以检测任何非GI（非胃肠）区域。 在注册过程中，在参考图像和变形的浮动图像之间的匹配度量中排除非GI区域。 通过将两个图像渲染在共同坐标处将两个图像拼接在一起。 在另一个实施例中，直接从输入图像中去除大面积的非GI区域，并且将剩余部分缝合在一起以形成新图像而不执行图像配准。

公开(公告)号：US20170017518A1

公开(公告)日：2017-01-19

申请号：US14803030

申请日：2015-07-18

Applicant: Capso Vision, Inc.

Inventor： Kang-Huai Wang ,  Yi Xu

IPC: G06F9/48

CPC classification number: G06F9/485 ,  G06F1/3203 ,  G06F1/3206 ,  G06F1/329 ,  G06F9/5022 ,  G06F9/5094 ,  Y02D10/22 ,  Y02D10/24

Abstract: A method of automatic allocation of processing power and system resource for an image viewing and processing application is disclosed. The usage of a processing unit or system resources consumed by other computing-processes on the computer is determined. The usage required by the image viewing and processing application is determined. Then, based on the usage consumed by other computing-processes and the usage required by the image viewing and processing application, the adequacy of the processing unit or system resources for executing the image viewing and processing application is assessed. If the adequacy of the processing unit or system resources for executing the image viewing and processing application is not satisfied, the usage of the processing unit or system resources consumed by other computing-processes associated with other applications is displayed. Also, options to select one or more other applications for termination via a user interface are displayed. The selected applications selected are terminated to reduce the usage of the processing unit or system resources.

Abstract translation: 公开了一种用于图像查看和处理应用的处理能力和系统资源的自动分配的方法。 确定计算机上其他计算过程消耗的处理单元或系统资源的使用。 确定图像观看和处理应用所需的使用。 然后，基于其他计算处理所消耗的用途和图像查看和处理应用所需的使用量，评估用于执行图像观看和处理应用的处理单元或系统资源的充分性。 如果不满足用于执行图像查看和处理应用的处理单元或系统资源的充分性，则显示与其他应用相关联的其他计算处理所消耗的处理单元或系统资源的使用。 此外，显示通过用户界面选择一个或多个其他应用程序进行终止的选项。 所选择的所选择的应用程序被终止以减少处理单元或系统资源的使用。