公开(公告)号：US11587360B2

公开(公告)日：2023-02-21

申请号：US17722848

申请日：2022-04-18

Applicant: SAMSUNG ELECTRONICS CO., LTD. ,  Korea University Research and Business Foundation

Inventor： Yuntae Kim ,  Sanghoon Sull ,  Geeyoung Sung ,  Hongseok Lee ,  Myungjae Jeon

IPC: G06V40/20 ,  G06F3/01 ,  G06N3/04 ,  G06T19/00 ,  G06N3/049

Abstract: An augmented reality (AR) device and a method of predicting a pose in the AR device is provided. In the augmented reality (AR) device inertial measurement unit (IMU) values corresponding to the movement of the AR device are obtained at an IMU rate, intermediate 6-degrees of freedom (6D) poses of the AR device are estimated based on the IMU values and images around the AR device via a visual-inertial simultaneous localization and mapping (VI-SLAM) module, and a pose prediction model for predicting relative 6D poses of the AR device is generated by performing learning by using a deep neural network.

公开(公告)号：US11514560B2

公开(公告)日：2022-11-29

申请号：US17350541

申请日：2021-06-17

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Namseop Kwon ,  Myungjae Jeon ,  Hongseok Lee

IPC: G06T5/00 ,  G09G5/37 ,  G06T7/73

Abstract: A method of correcting image latency in implementing augmented reality includes receiving a first image including frames, in which a time point and a pose of an electronic apparatus for each frame are recorded, from an external apparatus; rendering the first image; receiving first data corresponding to a first time point of a first frame; receiving second data corresponding to a second time point of a second frame; calculating a respective pose of the electronic apparatus for each scan line of a second image based on the first data and the second data; calculating a pixel shift for each pixel in each scan line based on the respective pose calculated for each scan line; generating the second image by correcting the first image based on the pixel shift; and transmitting the second image to the external apparatus.

公开(公告)号：US20230133574A1

公开(公告)日：2023-05-04

申请号：US18090985

申请日：2022-12-29

Applicant: SAMSUNG ELECTRONICS CO., LTD. ,  Korea University Research and Business Foundation

Inventor： Yuntae KIM ,  Sanghoon Sull ,  Geeyoung Sung ,  Hongseok Lee ,  Myungjae Jeon

IPC: G06V40/20 ,  G06F3/01 ,  G06N3/049 ,  G06T19/00

Abstract: An augmented reality (AR) device and a method of predicting a pose in the AR device is provided. In the augmented reality (AR) device inertial measurement unit (IMU) values corresponding to the movement of the AR device are obtained at an IMU rate, intermediate 6-degrees of freedom (6D) poses of the AR device are estimated based on the IMU values and images around the AR device via a visual-inertial simultaneous localization and mapping (VI-SLAM) module, and a pose prediction model for predicting relative 6D poses of the AR device is generated by performing learning by using a deep neural network.

公开(公告)号：US11334747B2

公开(公告)日：2022-05-17

申请号：US17037102

申请日：2020-09-29

Applicant: SAMSUNG ELECTRONICS CO., LTD. ,  Korea University Research and Business Foundation

Inventor： Yuntae Kim ,  Sanghoon Sull ,  Geeyoung Sung ,  Hongseok Lee ,  Myungjae Jeon

IPC: G06K9/00 ,  G06F3/01 ,  G06N3/04 ,  G06T19/00

Abstract: An augmented reality (AR) device and a method of predicting a pose in the AR device is provided. In the augmented reality (AR) device inertial measurement unit (IMU) values corresponding to the movement of the AR device are obtained at an IMU rate, intermediate 6-degrees of freedom (6D) poses of the AR device are estimated based on the IMU values and images around the AR device via a visual-inertial simultaneous localization and mapping (VI-SLAM) module, and a pose prediction model for predicting relative 6D poses of the AR device is generated by performing learning by using a deep neural network.

公开(公告)号：US11327488B2

公开(公告)日：2022-05-10

申请号：US15644173

申请日：2017-07-07

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Jangwoo You ,  Namseop Kwon ,  Yonghwa Park ,  Jisan Lee ,  Myungjae Jeon

IPC: G05D1/00 ,  G01S17/89 ,  G01S17/04 ,  G01S17/931 ,  G01S7/481 ,  G05D1/02

Abstract: Provided are non-uniform light-emitting lidar (light detection and ranging) apparatuses and autonomous robots including the same. A lidar apparatus may include a light source configured to emit light, an optical unit arranged on an optical path of light emitted from the light source and configured to change an optical profile of the light to be non-uniform, and a 3D sensor configured to sense location of an object by receiving reflection light from the object.

公开(公告)号：US10511826B2

公开(公告)日：2019-12-17

申请号：US15883437

申请日：2018-01-30

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Myungjae Jeon ,  Yonghwa Park ,  Jangwoo You ,  Heesun Yoon

IPC: G01C3/08 ,  H04N13/207 ,  H04N5/232 ,  H04N13/254 ,  H04N13/271 ,  H04N13/296

Abstract: A three-dimensional (3D) image sensor device and an electronic apparatus including the 3D image sensor device are provided. The 3D image sensor device includes: a shutter driver that generates a driving voltage of a sine wave biased with a first bias voltage, from a loss-compensated recycling energy; an optical shutter that varies transmittance of reflective light reflected from a subject, according to the driving voltage, and modulates the reflective light to generate at least two optical modulation signals having different phases; and an image generator that generates 3D image data for the subject which includes depth information calculated based on a phase difference between the at least two optical modulation signals.

公开(公告)号：US20180088680A1

公开(公告)日：2018-03-29

申请号：US15824163

申请日：2017-11-28

Applicant: Samsung Electronics Co., Ltd.

Inventor： Heesun YOON ,  Jangwoo You ,  Myungjae Jeon ,  Yonghwa Park

IPC: G06F3/01 ,  G06F3/0488 ,  G06F3/042 ,  G06F1/16 ,  G06F3/03

CPC classification number: G06F3/017 ,  G06F1/163 ,  G06F3/0304 ,  G06F3/0425 ,  G06F3/04883

Abstract: Provided is an apparatus and method of recognizing a movement of a subject. The apparatus includes a light source configured to emit light to the subject and an image sensor configured to receive light reflected from the subject. The apparatus includes a processor configured to detect a pixel that is receiving the reflected light, the pixel being included in a pixel array of the image sensor. The processor is configured to track the movement of the subject based on a change in a position of the detected pixel.

公开(公告)号：US12288349B2

公开(公告)日：2025-04-29

申请号：US17516990

申请日：2021-11-02

Applicant: SAMSUNG ELECTRONICS CO., LTD. ,  University of Seoul Industry Cooperation Foundation

Inventor： Myungjae Jeon ,  Kichul Kim ,  Yongkyu Kim ,  Hongseok Lee ,  San Kim ,  Hyekwan Yun ,  Donggeun Lee

IPC: G06T7/579 ,  G02B27/01 ,  G06T7/80

Abstract: Provided is an accelerator provided in an electronic device and configured to perform simultaneous localization and mapping (SLAM), the accelerator including a factor graph database, a memory, and a back-end processor, wherein the back-end processor is configured to receive a first piece of data corresponding to map points and camera positions from the factor graph database, convert the received first piece of data into a matrix for the map points and a matrix for the camera positions, store, in the memory, results obtained by performing an optimization calculation on the matrix for the map points and a matrix for at least one camera position, among the camera positions, corresponding to the map points, and obtain a second piece of data optimized with respect to the first piece of data based on the results stored in the memory.

公开(公告)号：US11763433B2

公开(公告)日：2023-09-19

申请号：US17094932

申请日：2020-11-11

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Zhihua Liu ,  Yamin Mao ,  Tianhao Gao ,  Hongseok Lee ,  Myungjae Jeon ,  Qiang Wang ,  Yuntae Kim

IPC: G06T5/50 ,  G06T7/00 ,  G06T7/593 ,  G06N3/084 ,  G06F18/22 ,  G06N3/045

CPC classification number: G06T5/50 ,  G06F18/22 ,  G06N3/045 ,  G06N3/084 ,  G06T7/593 ,  G06T7/97 ,  G06T2207/10012 ,  G06T2207/10028 ,  G06T2207/20024 ,  G06T2207/20081 ,  G06T2207/20084 ,  G06T2207/20221

Abstract: A depth image generation method includes obtaining a first depth image, based on a binocular image, obtaining a second depth image, using a depth camera, and obtaining a final depth image by performing image fusion on the obtained first depth image and the obtained second depth image.

公开(公告)号：US11721084B2

公开(公告)日：2023-08-08

申请号：US17570712

申请日：2022-01-07

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Namseop Kwon ,  Myungjae Jeon ,  Hongseok Lee

IPC: G06V10/75 ,  G02B27/01 ,  G06T7/55 ,  G06T5/50

CPC classification number: G06V10/7515 ,  G02B27/017 ,  G02B27/0179 ,  G06T5/50 ,  G06T7/55 ,  G02B2027/0178 ,  G02B2027/0187

Abstract: An electronic device includes a communication interface and a processor, wherein the processor receives a first image predistorted and rendered at a first time, from an external device through the communication interface, calculates a pixel shift for each pixel of the received first image at a second time that is different from the first time, generates a second image by reprojecting the first image based on the calculated pixel shift, and transmits the generated second image to the external device through the communication interface.