公开(公告)号：US11062521B2

公开(公告)日：2021-07-13

申请号：US16676074

申请日：2019-11-06

Applicant: INSTITUTE FOR INFORMATION INDUSTRY

Inventor： Jia-Wei Hong ,  Jing-Tong Fu ,  Ming-Fang Weng

IPC: G06T19/00 ,  G06K9/00 ,  G06T7/73 ,  G06T7/60 ,  G06T7/13

Abstract: A virtuality-reality overlapping method is provided. A point cloud map related to a real scene is constructed. Respective outline border vertexes of a plurality of objects are located by using 3D object detection. According to the outline border vertexes of the objects, the point cloud coordinates of the final candidate outline border vertexes are located according to the screening result of a plurality of projected key frames. Then, the point cloud map is projected to the real scene for overlapping a virtual content with the real scene.

公开(公告)号：US11663752B1

公开(公告)日：2023-05-30

申请号：US17575649

申请日：2022-01-14

Applicant: INSTITUTE FOR INFORMATION INDUSTRY

Inventor： Jhih-Rong Chen ,  Jia-Wei Hong ,  Ming-Fang Weng

IPC: G06T11/00 ,  G06T7/73 ,  G06V10/44 ,  G06T7/33 ,  G06T3/00 ,  G06F18/22

CPC classification number: G06T11/00 ,  G06F18/22 ,  G06T3/0056 ,  G06T7/337 ,  G06T7/73 ,  G06V10/443 ,  G06T2210/56

Abstract: An augmented reality processing device is provided, comprising an image capturing circuit and a processor. The processor is connected to the image capturing circuit, and execute operations of: generating an original point cloud image according to the first environment image and a physical object in the first environment image; generating an expanded point cloud image corresponding to the physical object from the second environment image according to the first environment image and the physical object point cloud set, and generating a superimposed point cloud image according to the expanded point cloud image and the original point cloud image; and generating a transformation matrix according to the original point cloud image and the expanded point cloud image, and superimposing a virtual object to the second environment image according to the superimposed point cloud image and the transformation matrix.

公开(公告)号：US10769811B2

公开(公告)日：2020-09-08

申请号：US16049798

申请日：2018-07-30

Applicant: Institute For Information Industry

Inventor： Jia-Wei Hong ,  Shih-Kai Huang ,  Ming-Fang Weng ,  Ching-Wen Lin

IPC: G06K9/00 ,  G06T7/73 ,  G01B11/00 ,  G06K9/62

Abstract: A space coordinate converting server and method thereof are provided. The space coordinate converting server receives a field video recorded with a 3D object from an image capturing device, and generates a point cloud model accordingly. The space coordinate converting server determines key frames of the field video, and maps the point cloud model to key images of the key frames based on rotation and translation information of the image capturing device for generating a characterized 3D coordinate set. The space coordinate converting server determines 2D coordinates of the 3D object in key images, and selects 3D coordinates from the characterized 3D coordinate set according to the 2D coordinates. The space coordinate converting server determines a space coordinate converting relation according to marked points of the 3D object and the 3D coordinates.

公开(公告)号：US09412331B2

公开(公告)日：2016-08-09

申请号：US14504439

申请日：2014-10-02

Applicant: INSTITUTE FOR INFORMATION INDUSTRY

Inventor： Teng-Chang Chang ,  Ming-Fang Weng

IPC: G09G5/00 ,  G06F3/03 ,  G09G5/02

CPC classification number: G09G5/005 ,  G06F3/03 ,  G09G5/026 ,  G09G2340/0464 ,  G09G2380/02

Abstract: A display system, an image compensation method and a non-transitory computer readable storage medium thereof are provided. The display system includes a flexible panel, a prediction unit, a compensation unit, an image synthesis unit and a control unit. The prediction unit predicts a prediction angle of the flexible panel in a final time. The compensation unit generates a first compensation image according to an initial display angle of the flexible panel in an initial time, and generates a second compensation image according to the prediction angle. The image synthesis unit synthesizes a first display image according to the first compensation image and the second compensation image. The control unit selectively substitutes the first display image for an image displayed on the flexible panel in the final time.

Abstract translation: 提供了显示系统，图像补偿方法和非暂时性计算机可读存储介质。 显示系统包括柔性面板，预测单元，补偿单元，图像合成单元和控制单元。 预测单元最终预测柔性面板的预测角度。 补偿单元根据初始时间的柔性面板的初始显示角度生成第一补偿图像，并根据预测角度生成第二补偿图像。 图像合成单元根据第一补偿图像和第二补偿图像合成第一显示图像。 控制单元在最终时间中选择性地将第一显示图像替换为在柔性面板上显示的图像。

公开(公告)号：US11430190B2

公开(公告)日：2022-08-30

申请号：US17148509

申请日：2021-01-13

Applicant: INSTITUTE FOR INFORMATION INDUSTRY

Inventor： Li-Ting Chen ,  Ming-Fang Weng

IPC: G06T19/00 ,  H04N13/239 ,  H04N13/332

Abstract: A virtual and real image fusion method is disclosed. The method comprises the following operations: obtaining a picture of a three dimensional space by a first camera, in which the picture comprises a screen picture and a tag picture of an entity tag and the screen picture is projected on the entity tag; obtaining a corresponding point data of the entity tag on the screen picture according to the picture by a processor; obtaining a spatial correction parameter according to the corresponding point data by the processor; and displaying an image on the screen picture according to the spatial correction parameter by the processor.

公开(公告)号：US10250801B2

公开(公告)日：2019-04-02

申请号：US15487420

申请日：2017-04-13

Applicant: Institute For Information Industry

Inventor： Ming-Fang Weng ,  Ching-Wen Lin

IPC: H04N5/232 ,  G06T7/194 ,  G06T7/77 ,  G06T7/73

Abstract: A camera system and an image-providing method are disclosed to overcome that conventional cameras cannot make a decision by themselves as for whether and/or how to capture images. The disclosed camera system includes a camera for capturing images and a computer device used to calculate an estimated camera location and pose for the camera. The camera system also includes a location adjusting device and a pose adjusting device to adjust the camera to the estimated camera location and pose.

公开(公告)号：US10043077B2

公开(公告)日：2018-08-07

申请号：US15347356

申请日：2016-11-09

Applicant: Institute For Information Industry

Inventor： Ching-Wen Lin ,  Ming-Fang Weng

IPC: G06K9/00 ,  G06K9/20 ,  G06K9/36 ,  G06K9/46 ,  G06T7/00

Abstract: A visual positioning apparatus, method, and non-transitory computer readable storage medium thereof are provided. The visual positioning apparatus derives an image by sensing a visual code marker in a space and performs the following operations: (a) identifying an identified marker image included in the image, (b) searching out the corner positions of the identified marker image, (c) deciding a marker structure of the identified marker image according to the corner positions, wherein the marker structure includes vertices, (d) selecting a portion of the vertices as first feature points, (e) searching out a second feature point for each first feature point, (f) updating the vertices of the marker structure according to the second feature points, (g) selecting a portion of the updated vertices as the third feature points, and (h) calculating the position of the visual positioning apparatus according to the third feature points.