-
公开(公告)号：US12062145B2
公开(公告)日：2024-08-13
申请号：US17811012
申请日：2022-07-06
Applicant: Samsung Electronics Co., Ltd.
Inventor： Yingen Xiong , Christopher A. Peri
IPC: G06T19/00 , G01B11/22 , G01C21/16 , G06T7/50 , G06T7/70 , G06T17/20 , G06V10/25 , G06V10/26 , G06V10/77 , G06V20/20
CPC classification number: G06T19/006 , G01B11/22 , G01C21/1656 , G06T7/50 , G06T7/70 , G06T17/20 , G06V10/25 , G06V10/26 , G06V10/7715 , G06V20/20 , G06T2207/30244
Abstract: A method includes receiving depth data of a real-world scene from a depth sensor, receiving image data of the scene from an image sensor, receiving movement data of the depth and image sensors from an IMU, and determining an initial 6DOF pose of an apparatus based on the depth data, image data, and/or movement data. The method also includes passing the 6DOF pose to a back end to obtain an optimized pose and generating, based on the optimized pose, image data, and depth data, a three-dimensional reconstruction of the scene. The reconstruction includes a dense depth map, a dense surface mesh, and/or one or more semantically segmented objects. The method further includes passing the reconstruction to a front end and rendering, at the front end, an XR frame. The XR frame includes a three-dimensional XR object projected on one or more surfaces of the scene.
-
公开(公告)号：US11900845B2
公开(公告)日：2024-02-13
申请号：US17696729
申请日：2022-03-16
Applicant: Samsung Electronics Co., Ltd.
Inventor： Yingen Xiong , Christopher A. Peri
IPC: G09G3/20
CPC classification number: G09G3/2003 , G09G2320/0242 , G09G2320/0285
Abstract: A system and method for display distortion calibration are configured to capture distortion with image patterns and calibrate distortion with ray tracing for an optical pipeline with lenses. The system includes an image sensor and a processor to perform the method for display distortion calibration. The method includes generating an image pattern to encode display image pixels by encoding display distortion associated with a plurality of image patterns. The method also includes determining a distortion of the image pattern resulting from a lens on a head-mounted display (HMD) and decoding the distorted image patterns to obtain distortion of pixels on a display. A lookup table is created of angular distortion of all the pixels on the display. The method further includes providing a compensation factor for the distortion by creating distortion correction based on the lookup table of angular distortion.
-
公开(公告)号：US20230410414A1
公开(公告)日：2023-12-21
申请号：US18052827
申请日：2022-11-04
Applicant: Samsung Electronics Co., Ltd.
Inventor： Yingen Xiong , Christopher A. Peri
CPC classification number: G06T15/20 , G06T7/55 , G06T2207/10016 , G06F3/013 , G06T19/006 , G06T5/005
Abstract: A method of video transformation for a video see-through (VST) augmented reality (AR) device includes obtaining video frames from multiple cameras associated with the VST AR device, where each video frame is associated with position data. The method also includes generating camera viewpoint depth maps associated with the video frames based on the video frames and the position data. The method further includes performing depth re-projection to transform the video frames from camera viewpoints to rendering viewpoints using the camera viewpoint depth maps. The method also includes performing hole filling of one or more holes created in one or more occlusion areas of at least one of the transformed video frames during the depth re-projection to generate at least one hole-filled video frame. In addition, the method includes displaying the transformed video frames including the at least one hole-filled video frame on multiple displays associated with the VST AR device.
-
公开(公告)号：US20220406013A1
公开(公告)日：2022-12-22
申请号：US17500817
申请日：2021-10-13
Applicant: SAMSUNG ELECTRONICS CO., LTD.
Inventor： Yingen Xiong , Christopher A. Peri
Abstract: Generating a 3D scene reconstruction using depth fusion can include creating a high-resolution sparse depth map by mapping sensor depths from a low-resolution depth map to points corresponding to pixels of a high-resolution color image of a scene. The high-resolution sparse depth map can have the same resolution as the high-resolution color image. A fused sparse depth map can be produced by combining the high-resolution sparse depth map with sparse depths reconstructed from the high-resolution color image. The high-resolution dense depth map can be generated based on fused sparse depths of the fused sparse depth map.
-
15.发明申请公开(公告)号：US20220382356A1
公开(公告)日：2022-12-01
申请号：US17750960
申请日：2022-05-23
Applicant: Samsung Electronics Co., Ltd.
Inventor： Christopher A. Peri , Moiz Kaizar Sonasath , Lu Luo
IPC: G06F1/329 , G06F1/3212
Abstract: A method includes obtaining a request for one of multiple operational modes from an application installed on an extended reality (XR) device or an XR runtime/renderer of the XR device. The method also includes selecting a first mode of the operational modes, based at least partly on a real-time system performance of the XR device. The method also includes publishing the selected first mode to the XR runtime/renderer or the application. The method also includes performing a task related to at least one of image rendering or computer vision calculations for the application, using an algorithm associated with the selected first mode.
-
Patent Agency Ranking
公开(公告)号：US11481871B2
公开(公告)日：2022-10-25
申请号：US17402005
申请日：2021-08-13
Applicant: SAMSUNG ELECTRONICS CO., LTD.
Inventor： Yingen Xiong , Christopher A. Peri
Abstract: Updating an image during real-time rendering of images by a display device can include determining a depth for each pixel of a color frame received from a source device and corresponding to the image. Each pixel's depth is determined by image-guided propagation of depths of sparse points extracted from a depth map generated at the source device. With respect to pixels corresponding to an extracted sparse depth point, image-guided depth propagation can include retaining the depth of the corresponding sparse depth point unchanged from the source depth map. With respect to each pixel corresponding to a non-sparse depth point, image-guided depth propagation can include propagating to the corresponding non-sparse depth point a depth of a sparse depth point lying within a neighborhood of the non-sparse depth point. Pixel coordinates of the color frame can be transformed for generating a space-warped rendering of the image.
-
公开(公告)号：US20220230398A1
公开(公告)日：2022-07-21
申请号：US17346105
申请日：2021-06-11
Applicant: Samsung Electronics Co., Ltd.
Inventor： Christopher A. Peri , Yingen Xiong , Haihui Guan
Abstract: A method includes obtaining scene data, wherein the scene data includes image data of a scene and depth data of the scene, and the depth data includes depth measurement values of points of a point cloud. The method further includes defining a first detection area, wherein the first detection area includes a spatially defined subset of the scene data, defining a plane model based on points of the point cloud within the first detection area, and defining a plane based on the plane model. The method includes determining at least one value of a usable size of the plane based on points of the point cloud, comparing at least one value of a characteristic size of a digital object to the at least one value of the usable size of the plane, and generating a display including the digital object positioned upon the plane based on the plane model.
-
公开(公告)号：US20220165041A1
公开(公告)日：2022-05-26
申请号：US17463037
申请日：2021-08-31
Applicant: SAMSUNG ELECTRONICS CO., LTD.
Inventor： Yingen Xiong , Christopher A. Peri
Abstract: An electronic device that reprojects two-dimensional (2D) images to three-dimensional (3D) images includes a memory configured to store instructions, and a processor configured to execute the instructions to: propagate an intensity for at least one pixel of an image based on a depth guide of neighboring pixels of the at least one pixel, wherein the at least one pixel is considered a hole during 2D to 3D image reprojection; propagate a color for the at least one pixel based on an intensity guide of the neighboring pixels of the at least one pixel; and compute at least one weight for the at least one pixel based on the intensity and color propagation.
-
公开(公告)号：US20190012803A1
公开(公告)日：2019-01-10
申请号：US15805750
申请日：2017-11-07
Applicant: Samsung Electronics Co., Ltd.
Inventor： Christopher A. Peri
Abstract: A method, electronic device, and non-transitory computer readable medium for optical tracking are provided. The method includes identifying at least one object within an environment, from received image data. The method also includes assigning a volatility rating to the identified object. Additionally, the method includes determining one or more tracking points associated with the identified object. The method also includes determining a priority rating for the each of the one or more tracking points associated with the identified object based on the assigned volatility rating of the identified object. The method also includes selecting the one or more tracking points for optical tracking based on the priority rating.
-
公开(公告)号：US20180278918A1
公开(公告)日：2018-09-27
申请号：US15830832
申请日：2017-12-04
Applicant: Samsung Electronics Co., Ltd
Inventor： Christopher A. Peri
IPC: H04N13/271 , H04N5/247 , H04N13/106 , H04N13/296 , H04N5/232
Abstract: A method, electronic device, and non-transitory computer readable medium for transmitting information is provided. The method includes receiving, from each of two 360-degree cameras, image data. The method also includes synchronizing the received image data from each of the two cameras. Additionally, the method includes creating a depth map from the received the image data based in part on a distance between the two cameras. The method also includes generating multi-dimensional content by combining the created depth map with the synchronized image data of at least one of the two cameras.
-
-
-
-
-
-
-
-
-
Search Results
40
records
(took 0.028 seconds)
