公开(公告)号：US20230148172A1

公开(公告)日：2023-05-11

申请号：US17575649

申请日：2022-01-14

Applicant: INSTITUTE FOR INFORMATION INDUSTRY

Inventor： Jhih-Rong CHEN ,  Jia-Wei HONG ,  Ming-Fang WENG

IPC: G06T11/00 ,  G06T7/73 ,  G06V10/44 ,  G06T3/00 ,  G06K9/62 ,  G06T7/33

CPC classification number: G06T11/00 ,  G06T7/73 ,  G06V10/443 ,  G06T3/0056 ,  G06K9/6215 ,  G06T7/337 ,  G06T2210/56

Abstract: An augmented reality processing device is provided, comprising an image capturing circuit and a processor. The processor is connected to the image capturing circuit, and execute operations of: generating an original point cloud image according to the first environment image and a physical object in the first environment image; generating an expanded point cloud image corresponding to the physical object from the second environment image according to the first environment image and the physical object point cloud set, and generating a superimposed point cloud image according to the expanded point cloud image and the original point cloud image; and generating a transformation matrix according to the original point cloud image and the expanded point cloud image, and superimposing a virtual object to the second environment image according to the superimposed point cloud image and the transformation matrix.

公开(公告)号：US20210090339A1

公开(公告)日：2021-03-25

申请号：US16676074

申请日：2019-11-06

Applicant: INSTITUTE FOR INFORMATION INDUSTRY

Inventor： Jia-Wei HONG ,  Jing-Tong FU ,  Ming-Fang WENG

IPC: G06T19/00 ,  G06K9/00 ,  G06T7/73 ,  G06T7/13 ,  G06T7/60

Abstract: A virtuality-reality overlapping method is provided. A point cloud map related to a real scene is constructed. Respective outline border vertexes of a plurality of objects are located by using 3D object detection. According to the outline border vertexes of the objects, the point cloud coordinates of the final candidate outline border vertexes are located according to the screening result of a plurality of projected key frames. Then, the point cloud map is projected to the real scene for overlapping a virtual content with the real scene.

公开(公告)号：US20200013187A1

公开(公告)日：2020-01-09

申请号：US16049798

申请日：2018-07-30

Applicant: Institute For Information Industry

Inventor： Jia-Wei HONG ,  Shih-Kai HUANG ,  Ming-Fang WENG ,  Ching-Wen LIN

IPC: G06T7/73 ,  G01B11/00 ,  G06K9/00 ,  G06K9/62

Abstract: A space coordinate converting server and method thereof are provided. The space coordinate converting server receives a field video recorded with a 3D object from an image capturing device, and generates a point cloud model accordingly. The space coordinate converting server determines key frames of the field video, and maps the point cloud model to key images of the key frames based on rotation and translation information of the image capturing device for generating a characterized 3D coordinate set. The space coordinate converting server determines 2D coordinates of the 3D object in key images, and selects 3D coordinates from the characterized 3D coordinate set according to the 2D coordinates. The space coordinate converting server determines a space coordinate converting relation according to marked points of the 3D object and the 3D coordinates.