公开(公告)号：US20240046577A1

公开(公告)日：2024-02-08

申请号：US18136228

申请日：2023-04-18

Applicant: Samsung Electronics Co., Ltd.

Inventor： Yingen Xiong

IPC: G06T19/00 ,  G06T5/00 ,  H04N13/117 ,  H04N13/239 ,  H04N13/383

CPC classification number: G06T19/006 ,  G06T5/006 ,  H04N13/117 ,  H04N13/239 ,  H04N13/383

Abstract: In one embodiment, a method includes accessing an image captured by a camera of a pair of stereoscopic cameras of a video see-through augmented-reality (AR) system. The method further includes determining, based on each of one or more models of one or more components of the video see-through AR system, a modification to the image and generating, based on the modification to the image, a transformation map for the camera that captured the accessed image. The transformation map identifies frame-independent transformations to apply for rendering a scene based on one or more subsequent images captured by that camera.

公开(公告)号：US20230419595A1

公开(公告)日：2023-12-28

申请号：US18055304

申请日：2022-11-14

Applicant: Samsung Electronics Co., Ltd.

Inventor： Yingen Xiong

IPC: G06T15/20 ,  H04N13/156 ,  H04N13/128 ,  G02B27/01

CPC classification number: G06T15/205 ,  H04N13/156 ,  H04N13/128 ,  G02B27/0172 ,  H04N2013/0081

Abstract: A method includes capturing an image and associating the image with a camera pose for each of multiple cameras. The method also includes determining, for each camera, a first contribution of the image for a first virtual view for display on a first display and a second contribution of the image for a second virtual view for display on a second display. The method further includes determining, for each camera, a first confidence map for the first virtual view based on the camera pose and a position of the camera in relation to a first virtual camera and a second confidence map for the second virtual view based on the camera pose and the position of the camera in relation to a second virtual camera. In addition, the method includes generating the first virtual view by combining the first contribution using the first confidence map for each of the cameras and the second virtual view by combining the second contribution using the second confidence map for each of the cameras.

公开(公告)号：US11670063B2

公开(公告)日：2023-06-06

申请号：US17463037

申请日：2021-08-31

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Yingen Xiong ,  Christopher A. Peri

IPC: G06T19/20 ,  G06T5/00

CPC classification number: G06T19/20 ,  G06T5/005 ,  G06T2207/10024 ,  G06T2207/20221 ,  G06T2219/2012

Abstract: An electronic device that reprojects two-dimensional (2D) images to three-dimensional (3D) images includes a memory configured to store instructions, and a processor configured to execute the instructions to: propagate an intensity for at least one pixel of an image based on a depth guide of neighboring pixels of the at least one pixel, wherein the at least one pixel is considered a hole during 2D to 3D image reprojection; propagate a color for the at least one pixel based on an intensity guide of the neighboring pixels of the at least one pixel; and compute at least one weight for the at least one pixel based on the intensity and color propagation.

公开(公告)号：US20220292631A1

公开(公告)日：2022-09-15

申请号：US17402005

申请日：2021-08-13

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Yingen Xiong ,  Christopher A. Peri

IPC: G06T3/00 ,  G06T7/50 ,  G06F3/01 ,  G06T7/13

Abstract: Updating an image during real-time rendering of images by a display device can include determining a depth for each pixel of a color frame received from a source device and corresponding to the image. Each pixel's depth is determined by image-guided propagation of depths of sparse points extracted from a depth map generated at the source device. With respect to pixels corresponding to an extracted sparse depth point, image-guided depth propagation can include retaining the depth of the corresponding sparse depth point unchanged from the source depth map. With respect to each pixel corresponding to a non-sparse depth point, image-guided depth propagation can include propagating to the corresponding non-sparse depth point a depth of a sparse depth point lying within a neighborhood of the non-sparse depth point. Pixel coordinates of the color frame can be transformed for generating a space-warped rendering of the image.

公开(公告)号：US20210311307A1

公开(公告)日：2021-10-07

申请号：US16990779

申请日：2020-08-11

Applicant: Samsung Electronics Co., Ltd.

Inventor： Christopher A. Peri ,  Yingen Xiong ,  Lu Luo

IPC: G02B27/01 ,  G06T11/00 ,  G06T19/20 ,  G06F3/01

Abstract: A method includes obtaining, from a memory of an electronic device connected to a head mounted display (HMD), a first reference frame, wherein the first reference frame comprises a first set of pixels associated with a first time. The method includes, rendering, at the electronic device, a source image as a new frame, wherein the new frame includes a second set of pixels associated with a display to be provided by the HMD at a second time, and generating, by the electronic device, a differential frame, wherein the differential frame is based on a difference operation between pixels of the new frame with pixels of the first reference frame to identify pixels unique to the new frame. Still further, the method includes sending the differential frame to the HMD, and storing the new frame in the memory of the electronic device as a second reference frame.