公开(公告)号：US20170213085A1

公开(公告)日：2017-07-27

申请号：US15328002

申请日：2015-12-15

Applicant: SHENZHEN INSTITUTES OF ADVANCED TECHNOLOGY CHINESE ACADEMY OF SCIENCES

Inventor： Nan FU ,  Yaoqin XIE ,  Yanchun ZHU ,  Shaode YU ,  Zhicheng ZHANG

IPC: G06K9/00 ,  G06T19/00 ,  G06T7/33 ,  G06K9/46 ,  G06T7/73

CPC classification number: G06K9/00671 ,  G02B2027/0132 ,  G02B2027/014 ,  G02B2027/0178 ,  G06K9/3216 ,  G06K9/4604 ,  G06T7/344 ,  G06T7/75 ,  G06T19/006 ,  G06T2207/30204

Abstract: Disclosed is see-through smart glasses (100) and see-through methods thereof. The see-through smart glasses (100) includes a model storing module (110), an image processing module (130) and an image displaying module (120). The model storing module (110) is used for storing a 3D model of a target; the image processing module (130) is used for identifying target extrinsic marker (210′) of the target (200) based on a user's viewing angle, find out a spatial correlation between the target extrinsic marker (210′) and internal structure (220) based on the 3D model of the target (200), and generating an interior image of the target (200) corresponding to the viewing angle based on the spatial correlation; and the image displaying module (120) is used for displaying the interior image. With the present application, on the premise of not breaking a surface and an entire structure of a target, an internal structure (220) image corresponding to the user's viewing angle can be generated, so that the user can observe the internal structure of the object correctly, intuitively and visually with ease.

公开(公告)号：US20180300954A1

公开(公告)日：2018-10-18

申请号：US16008815

申请日：2018-06-14

Applicant: SHENZHEN INSTITUTES OF ADVANCED TECHNOLOGY CHINESE ACADEMY OF SCIENCES

Inventor： Nan FU ,  Yaoqin XIE ,  Yanchun ZHU ,  Shaode YU ,  Yili CHEN ,  Zhicheng ZHANG

IPC: G06T19/00 ,  G06T15/20 ,  G02B27/01

Abstract: The invention provides a method and a device for seeing through an obstruction based on smart glasses, and a computer-readable storage medium, the method comprising: acquiring a first image of user's view by smart glasses and recognizing an obstruction image in the first image; acquiring a second image of the user's view by at least one image acquisition device; replacing the obstruction image in the first image with portion of the second image that corresponds to the obstruction image, which are spliced to generate an unobstruction image of the user's view. In the invention, the obstruction image in the first image is replaced with a portion of the second image that corresponds to the obstruction image, which can achieve seeing through an obstruction.