公开(公告)号：US20210217194A1

公开(公告)日：2021-07-15

申请号：US17146895

申请日：2021-01-12

Applicant: Samsung Electronics Co., Ltd.

Inventor： Chao ZHANG ,  Weiming LI ,  Qiang WANG ,  Sunghoon HONG ,  Wooshik KIM

IPC: G06T7/73 ,  G06T19/00 ,  G06N3/04 ,  G06T19/20

Abstract: An electronic device for estimating object information and generating a virtual object and a method of operating the electronic device are disclosed. The method includes obtaining an image, obtaining a class feature, a pose feature, and a relationship feature of an object included in the image, correcting each of the class feature, the pose feature, and the relationship feature using any combination of any two or more of the class feature, the pose feature, and the relationship feature of the object, and obtaining class information, pose information, and relationship information of the object based on the corrected class feature, the corrected pose feature, and the corrected relationship feature, respectively.

公开(公告)号：US20210150755A1

公开(公告)日：2021-05-20

申请号：US17093944

申请日：2020-11-10

Applicant: Samsung Electronics Co., Ltd.

Inventor： Tianhao GAO ,  Xiaolong SHI ,  Xiongfeng PENG ,  Kuan MA ,  Hongseok LEE ,  Myungjae JEON ,  Qiang WANG ,  Yuntae KIM ,  Zhihua LIU

IPC: G06T7/73 ,  G06T7/55

Abstract: A simultaneous localization and mapping device is provided. The device includes an image obtaining device configured to capture color images and depth images of a surrounding environment; an initial pose estimating device configured to estimate an initial pose based on the color images and the depth images; a map constructing device configured to construct a three-dimensional map based on the depth images and the color images; and a pose determining device configured to determine a final pose based on the initial pose and the three-dimensional map.

公开(公告)号：US20200160616A1

公开(公告)日：2020-05-21

申请号：US16674139

申请日：2019-11-05

Applicant: Samsung Electronics Co., Ltd.

Inventor： Weiming LI ,  Hyong Euk LEE ,  Hao WANG ,  Seungin PARK ,  Qiang WANG ,  Yang LIU ,  Yueying KAO

IPC: G06T19/20 ,  G06T7/70 ,  G06K9/62 ,  G06N3/08 ,  G06N20/00

Abstract: Provided is a method and apparatus for aligning a three-dimensional (3D) model. The 3D model alignment method includes acquiring, by a processor, at least one two-dimensional (2D) image including an object, detecting, by the processor, a feature point of the object in the at least one 2D input image using a neural network, estimating, by the processor, a 3D pose of the object in the at least one 2D input image using the neural network, retrieving, by the processor, a target 3D model based on the estimated 3D pose, and aligning, by the processor, the target 3D model and the object based on the feature point.

公开(公告)号：US20200160547A1

公开(公告)日：2020-05-21

申请号：US16550985

申请日：2019-08-26

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Zhihua LIU ,  Leewon HEE ,  Lin MA ,  Qiang WANG ,  Tianhao GAO ,  Yamin MAO

IPC: G06T7/593 ,  G06T5/00 ,  G06T5/50 ,  G06K9/62 ,  G06N3/04

Abstract: A method and apparatus for outputting three-dimensional (3D) lines. The apparatus acquires a first image and a second image including lines on a road, generates, based on a first feature map acquired from the first image, a line probability map representing a probability that a pixel point of the first feature map belongs to the lines, calculates matching information of the first image and the second image based on the first feature map and a second feature map acquired from the second image, predicts depth values of the lines using the line probability map and the matching information, detects the lines based on the line probability map, generates 3D lines based on the detected lines and the depth values of the lines, and outputs the 3D lines.

公开(公告)号：US20190220993A1

公开(公告)日：2019-07-18

申请号：US16238785

申请日：2019-01-03

Applicant: Samsung Electronics Co., Ltd.

Inventor： Weiming LI ,  Zairan WANG ,  Dongdong YU ,  Hao WANG ,  Minsu AHN ,  Qiang WANG ,  Sunghoon HONG ,  Yang LIU ,  Yueying KAO

IPC: G06T7/73

CPC classification number: G06T7/73 ,  G06T2207/20084

Abstract: Disclosed are a pose estimation methods and apparatuses of displaying a virtual object using an estimated pose. The pose estimation method includes receiving an input image and estimating pose information of an object from the input image based on local information of the object.

公开(公告)号：US20180137673A1

公开(公告)日：2018-05-17

申请号：US15811200

申请日：2017-11-13

Applicant: SAMSUNG ELECTRONICS CO., LTD. ,  Beijing Samsung Telecom R&D Center

Inventor： Feng SHI ,  Dong Qing ZOU ,  Wei Heng LIU ,  De Heng QIAN ,  Hyun Surk RYU ,  Jia LI ,  Jing Tao XU ,  Kyoobin LEE ,  Qiang WANG

IPC: G06T15/20 ,  G06T15/04 ,  G06K9/62

CPC classification number: G06T15/20 ,  G06K9/605 ,  G06K9/6202 ,  G06K2009/00738 ,  G06T15/04 ,  G06T2207/10028 ,  G06T2207/20208 ,  G06T2207/30244

Abstract: Embodiments of the present invention provide a method and device for processing Dynamic Vision Sensor (DVS) events. The method comprises the operations of: acquiring a DVS event map sequence; for any DVS event map in the DVS event map sequence, extracting a DVS event feature descriptor, where the DVS event feature descriptor has a scale-invariant feature and/or a rotation-invariant feature; determining, according to the extracted DVS event feature descriptor, a three-dimensional space pose of the DVS event map at the current moment; and, generating, according to the three-dimensional space pose of each DVS event map, a DVS event map sequence with temporal consistency. The embodiments of the present invention are used for generating, from a DVS event map sequence, a DVS event map sequence with temporal consistency.

公开(公告)号：US20250093953A1

公开(公告)日：2025-03-20

申请号：US18884996

申请日：2024-09-13

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Weiming LI ,  SoonYong CHO ,  Lin MA ,  Chaoqun ZHUANG ,  Jingrui SONG ,  Qiang WANG ,  Young Hun SUNG

IPC: G06F3/01 ,  G06T7/246 ,  G06T7/73 ,  G06V40/18

Abstract: An electronic device may operate a plurality of light sources, where each light source operates according to a light source code of a light source code set, each light source code being unique with respect to each other light source code, capture a glint signal corresponding to light emitted from the plurality of light sources through an event camera, obtain glint information from event data from the event camera, estimate a corneal sphere center position and an eye rotation center position based on the glint information, and determine three-dimensional (3D) gaze-related information based on the corneal sphere center position and the eye rotation center position.

公开(公告)号：US20240303846A1

公开(公告)日：2024-09-12

申请号：US18597107

申请日：2024-03-06

Applicant: Samsung Electronics Co., Ltd.

Inventor： Xiongfeng PENG ,  Zhihua LIU ,  Kyungboo JUNG ,  Myungjae JEON ,  Qiang WANG ,  Young Hun SUNG

IPC: G06T7/579 ,  G06T7/246 ,  G06T7/73 ,  G06T17/05

CPC classification number: G06T7/579 ,  G06T7/248 ,  G06T7/74 ,  G06T17/05 ,  G06T2207/20084 ,  G06T2207/30244

Abstract: A processor-implemented method includes obtaining a visual association feature indicating an association between a first image frame and a second image frame and a visual appearance feature indicating the same object appearance in the first image frame and the second image frame, constructing a visual reprojection constraint based on the visual association feature, constructing a visual feature metric constraint based on the visual appearance feature, and performing localization and mapping based on the visual reprojection constraint and the visual feature metric constraint.

公开(公告)号：US20240185519A1

公开(公告)日：2024-06-06

申请号：US18527903

申请日：2023-12-04

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Weiming LI ,  Namseop KWON ,  Kyungboo JUNG ,  Lin MA ,  Myungjae JEON ,  Qiang WANG ,  Young Hun SUNG ,  Bao HE

IPC: G06T17/00 ,  G06T7/20 ,  G06T7/70 ,  G06V10/25 ,  G06V10/44 ,  H04N5/74

CPC classification number: G06T17/00 ,  G06T7/20 ,  G06T7/70 ,  G06V10/25 ,  G06V10/44 ,  H04N5/74 ,  G06T2207/10024 ,  G06T2207/10028 ,  G06T2207/20084

Abstract: A processor-implemented method includes obtaining a first motion matrix corresponding to an extended reality (XR) system and a second motion matrix based on a conversion coefficient from an XR system coordinate system into a rolling shutter (RS) camera coordinate system, and projecting an RS color image of a current frame onto a global shutter (GS) color image coordinate system based on the second motion matrix and generating a GS color image of the current frame, wherein the second motion matrix is a motion matrix of a timestamp of a depth image captured by a GS camera corresponding to a timestamp of a first scanline of an RS color image captured by the GS camera.

公开(公告)号：US20240046505A1

公开(公告)日：2024-02-08

申请号：US18363798

申请日：2023-08-02

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Zhihua LIU ,  Paul OH ,  Qiang WANG ,  Yamin MAO

IPC: G06T7/70 ,  G06V10/77 ,  G06V10/82

CPC classification number: G06T7/70 ,  G06V10/7715 ,  G06V10/82

Abstract: An electronic device for predicting a pose and a method of operating the electronic device are provided. The method includes extracting a feature map from an input image, predicting coordinates of a joint point from the feature map using an ordinal regression model, and predicting a pose of an object using the predicted coordinates of the joint point.