公开(公告)号：US11127195B2

公开(公告)日：2021-09-21

申请号：US16877413

申请日：2020-05-18

申请人： Magic Leap, Inc.

发明人： Ivan Li Chuen Yeoh ,  Lionel Ernest Edwin ,  Samuel A. Miller

IPC分类号： G06T15/20 ,  G06F3/0481 ,  H04N13/344 ,  H04N13/117 ,  H04N13/383 ,  G06T1/60 ,  G06T15/00 ,  G06T19/00 ,  A63F13/00 ,  G06T13/00 ,  G02B27/01 ,  G06F3/01

摘要： Embodiments of the present disclosure relate to continuous and/or binocular time warping methods to account for head movement of the user without having to re-render a displayed image. Continuous time warping allows for transformation of an image from a first perspective to a second perspective of the viewer without having to re-render the image from the second perspective. Binocular time warp refers to the late-frame time warp used in connection with a display device including a left display unit for the left eye and a right display unit for the right eye where the late-frame time warp is performed separately for the left display unit and the right display unit. Warped images are sent to the left and the right display units where photons are generated and emitted toward respective eyes of the viewer, thereby displaying an image on the left and the right display units at the same time.

公开(公告)号：US20210274232A1

公开(公告)日：2021-09-02

申请号：US17320850

申请日：2021-05-14

申请人： Comcast Cable Communications, LLC

发明人： Jeffrey Allen Hall ,  Federico Buratti ,  Justin Thompson

IPC分类号： H04N21/25 ,  H04N21/466 ,  H04N21/4725 ,  H04N21/41 ,  H04N21/442 ,  H04N21/81 ,  H04N13/117 ,  H04N13/194 ,  H04N5/232

摘要： Methods, systems, and apparatuses for predicting a user field-of-view change and determining transmission regions of immersive video (IV) content for an IV device are presented. A field-of-view change of a user device may be predicted. A transmission region in one or more video frames of the IV content may be determined based on the predicted change.

公开(公告)号：US11109009B2

公开(公告)日：2021-08-31

申请号：US16603076

申请日：2018-07-05

申请人： SONY CORPORATION

发明人： Tetsuya Kikukawa

IPC分类号： H04N13/117 ,  G06T19/00 ,  G02B27/10 ,  H04N13/128 ,  H04N13/383 ,  H04N13/344

摘要： A disparity image in a stereoscopic image is generated not to collapse. In a case where a viewing position in the entire celestial image space, specified on the basis of position information of a user, is within a range of a predetermined distance from an original point in a coordinate system of the entire celestial image, a disparity image based on the viewing position is generated, and in a case where the viewing position in the entire celestial image space is not within the range of a predetermined distance from the original point in the coordinate system of the entire celestial image, the viewing position in the entire celestial image space is moved to the original point of the entire celestial image space, and the disparity image is generated. The present disclosure can be applied to an HMD.

公开(公告)号：US11089281B2

公开(公告)日：2021-08-10

申请号：US16201586

申请日：2018-11-27

申请人： AT&T Intellectual Property I, L.P.

发明人： Lee Begeja ,  Eric Zavesky ,  Behzad Shahraray ,  Zhu Liu

IPC分类号： H04N13/156 ,  H04N13/117 ,  G06T17/00 ,  G06T15/04 ,  H04N13/167 ,  G06T7/70 ,  G06K9/00 ,  G06K9/62 ,  H04N5/232

摘要： A processing system having at least one processor may obtain at least a first source video from a first endpoint device and a second source video from a second endpoint device, where each of the first source video and the second source video is a two-dimensional video, determine that the first source video and the second source video share at least one feature that is the same for both the first source video and the second source video, and generate a volumetric video from the first source video and the second source video, where the volumetric video comprises a photogrammetric combination of the first source video and the second source video.

公开(公告)号：US20210243418A1

公开(公告)日：2021-08-05

申请号：US17049917

申请日：2019-04-17

申请人： PCMS Holdings, Inc.

发明人： Pasi Sakari Ojala

IPC分类号： H04N13/117 ,  H04N13/178 ,  H04N13/398 ,  H04N13/366 ,  H04N13/189

摘要： Some embodiments of a method may include: receiving metadata indicating which portion of an immersive video corresponds to a first viewport of the immersive video displayed on a first display; tracking an orientation of a second display relative to the first display; determining a second viewport of the immersive video synchronized in time and orientation relative to the immersive video displayed on the first display based on the metadata and the orientation of the second display relative to the first display; and displaying the second viewport on the second display.

公开(公告)号：US11055901B2

公开(公告)日：2021-07-06

申请号：US16810565

申请日：2020-03-05

申请人： Alibaba Group Holding Limited

发明人： Xiaojie Sheng

IPC分类号： H04N13/282 ,  G06T15/20 ,  H04N13/128 ,  H04N13/167 ,  H04N13/117 ,  H04N13/139 ,  G06T15/04 ,  H04N13/189 ,  H04N13/268 ,  H04N13/279 ,  H04N13/296 ,  H04N13/156 ,  G06F3/0484 ,  G06F3/0488 ,  G06F3/16 ,  G06K9/00 ,  H04N13/293 ,  G06T3/40 ,  H04N13/349 ,  H04N13/172 ,  H04N13/00

摘要： Methods, apparatuses, media, and devices for generating multi-angle free-perspective video data are provided. The method for generating multi-angle free-perspective video data includes: acquiring multiple frame-synchronized videos, wherein shooting angles of the multiple frame-synchronized videos are different; parsing a respective video of the multiple frame-synchronized videos to obtain an image combination at a respective frame moment of multiple frame moments, wherein the image combination includes multiple frame-synchronized frame images; determining depth data of a respective frame image in the image combination based on the image combination at the respective frame moment; and generating a stitched image corresponding to the respective frame moment, wherein the stitched image includes a first field storing pixel data of the respective frame image in the image combination, and a second field storing the depth data of the respective frame image in the image combination.

公开(公告)号：US11050993B2

公开(公告)日：2021-06-29

申请号：US16630061

申请日：2018-05-21

申请人： SONY INTERACTIVE ENTERTAINMENT INC.

发明人： Nobuo Sasaki

IPC分类号： H04N13/122 ,  H04N13/15 ,  H04N13/366 ,  H04N13/106 ,  H04N13/344 ,  H04N13/117

摘要： A position and posture acquiring section 250 of an image generating apparatus 200 acquires information related to the position and posture of the user's head. A view screen control section 252 sets a view screen corresponding to a viewpoint of the user. An original image manipulating section 254 determines displacement of pixels and acquires color values for an image corresponding to the viewpoint of the user such that an object appears fixed according to movement of the viewpoint of the user, and performs synthesis of color values in a color map corresponding to the viewpoint of a preceding frame, to acquire a new color map. A display image generating section 268 determines a value for each of the pixels in the view screen in accordance with a color map for a corresponding position to generate a display image. An output section 270 outputs the display image.

公开(公告)号：US11037365B2

公开(公告)日：2021-06-15

申请号：US16810237

申请日：2020-03-05

申请人： Alibaba Group Holding Limited

发明人： Xiaojie Sheng

IPC分类号： H04N13/00 ,  G06T15/20 ,  H04N13/128 ,  H04N13/167 ,  H04N13/117 ,  H04N13/139 ,  H04N13/282 ,  G06T15/04 ,  H04N13/189 ,  H04N13/268 ,  H04N13/279 ,  H04N13/296 ,  H04N13/156 ,  G06F3/0484 ,  G06F3/0488 ,  G06F3/16 ,  G06K9/00 ,  H04N13/293 ,  G06T3/40 ,  H04N13/349 ,  H04N13/172

摘要： A method, an apparatus, a medium, a terminal, and a device for processing multi-angle free-perspective data are disclosed. The method includes: acquiring a data header file; determining a defined format of a data file according to a parsing result of the data header file; reading and obtaining a data combination from the data file based on the defined format, where the data combination includes pixel data and depth data of multiple synchronized images, and the multiple synchronized images have different perspectives with respect a to-be-viewed area, and pixel data and depth data of each image of the multiple synchronized images has an association relationship; and performing image or video reconstruction of a virtual viewpoint according to the read data combination, where the virtual viewpoint is selected from a multi-angle free-perspective range, and the multi-angle free-perspective range is a range supporting virtual viewpoint switching viewing of the to-be-viewed area.

公开(公告)号：US10986324B2

公开(公告)日：2021-04-20

申请号：US16193620

申请日：2018-11-16

申请人： CANON KABUSHIKI KAISHA

发明人： Shugo Higuchi

IPC分类号： H04N13/117 ,  H04N13/167 ,  H04N13/282 ,  G06K9/32 ,  G06K9/00 ,  G06T15/20 ,  G06K9/20

摘要： An image processing apparatus includes: an image obtaining unit configured to obtain images based on image capturing by a plurality of cameras capturing an imaging area in a plurality of directions; an information obtaining unit configured to obtain viewpoint information that indicates a virtual viewpoint; and a generation unit configured to generate a virtual viewpoint image based on the images obtained by the image obtaining unit and the viewpoint information obtained by the information obtaining unit, so that in the virtual viewpoint image, transparency of an object at a position that shields an object of interest determined among a plurality of objects positioned in the imaging area is higher than transparency of an object at a position that does not shield the object of interest.

公开(公告)号：US20210092489A1

公开(公告)日：2021-03-25

申请号：US16962500

申请日：2018-11-26

申请人： Samsung Electronics Co., Ltd.

发明人： Bhaskar DUTTA ,  Manoj VERMA ,  Rahul JAIN

IPC分类号： H04N21/472 ,  H04N13/117 ,  H04N5/232 ,  G11B27/00 ,  H04N21/81

摘要： According to an embodiment of the present disclosure, a method comprises playing, by the media player, a 360-degree video. The method further comprises recording, by the media player, one or more viewing angles corresponding to a user's viewing of the 360-degree video. Further, the method comprises detecting, by the media player, a video seek event to a seek point of the 360-degree video. The method further comprises playing, by the media player, the 360-degree video from the seek point according to a viewing angle determined based on at least one of (a) a recorded viewing angle and (b) a view mode.