公开(公告)号：US20210218905A1

公开(公告)日：2021-07-15

申请号：US16741297

申请日：2020-01-13

Applicant: Charter Communications Operating, LLC

Inventor： Dell Wolfensparger ,  Andrew Ip ,  Dhananjay Lal ,  Matthew Ringenberg

IPC: H04N5/272 ,  G06K9/00 ,  G06T11/00 ,  G06T7/50 ,  G06T7/70

Abstract: Method and apparatus for overlaying themed imagery onto real-world objects in a head-mounted display device (HMDD). A computing device receives, from an HMDD, depth data that identifies distances from the HMDD to surfaces of a plurality of objects in a user space. The computing device detects at least one object in the user space based at least in part on the depth data. The computing device determines a classification of video content being presented on a display system of the HMDD. The computing device selects, based on the classification, a particular image theme from a plurality of different image themes, the image theme comprising one or more image textures. The computing device sends, to the HMDD, at least one image texture for overlaying the at least one object during presentation of the at least one object on the display system of the HMDD in conjunction with the video content.

公开(公告)号：US20210218790A1

公开(公告)日：2021-07-15

申请号：US16743805

申请日：2020-01-15

Applicant: Charter Communications Operating, LLC

Inventor： Matthew Ringenberg ,  Dhananjay Lal ,  Dell Wolfensparger ,  Andrew Ip

IPC: H04L29/06 ,  H04N13/327 ,  H04L12/26

Abstract: Measuring quality-of-experience (QoE) for virtual reality (VR) streaming content is disclosed. A network computing device receives a client-side VR stream capture and a client pose data set that are generated by a client computing device based on a VR content and one or more induced network impairments (e.g., latency, packet loss, and/or jitter, as non-limiting examples). Using the same VR content and the client pose data set, the network computing device generates a source VR stream capture that is not subjected to the one or more induced network impairments. The network computing device performs a frame-by-frame comparison of the client-side VR stream capture and the source VR stream capture. Based on the frame-by-frame comparison, the network computing device generates a QoE metric that indicates a degree of degradation of the client-side VR stream capture relative to the source VR stream capture.

公开(公告)号：US20250119365A1

公开(公告)日：2025-04-10

申请号：US18987015

申请日：2024-12-19

Applicant: Charter Communications Operating, LLC

Inventor： Matthew Ringenberg ,  Dhananjay Lal ,  Dell Wolfensparger ,  Andrew Ip

IPC: H04L43/0864 ,  G06F3/01 ,  G06F3/14 ,  H04L41/5067 ,  H04L65/60

Abstract: Virtual reality content (VR content) streaming based on quality of experience level is disclosed. In response to a request from a head-mounted display device (HMDD) to serve a VR content, a computing device determines a head motion quantifier (HMQ) associated with the VR content. The computing device is configured to dynamically provide to the HMDD imagery from the VR content based on head movements of a user of the HMDD. The computing device determines a latency value associated with a round-trip time of data between the computing device and the HMDD. The computing device determines a quality of experience level of a plurality of different quality of experience levels based on the HMQ and the latency value, and performs an action based on the quality of experience level.

公开(公告)号：US11711415B2

公开(公告)日：2023-07-25

申请号：US17374565

申请日：2021-07-13

Applicant: Charter Communications Operating, LLC

Inventor： Matthew Ringenberg ,  Dhananjay Lal ,  Dell Wolfensparger ,  Andrew Ip

IPC: H04L65/80 ,  H04L43/0829 ,  H04L43/087 ,  H04N13/327 ,  H04L65/70 ,  G06F3/01

CPC classification number: H04L65/80 ,  G06F3/012 ,  H04L43/087 ,  H04L43/0829 ,  H04L65/70 ,  H04N13/327

Abstract: Measuring quality-of-experience (QoE) for virtual reality (VR) streaming content is disclosed. A network computing device receives a client-side VR stream capture and a client pose data set that are generated by a client computing device based on a VR content and one or more induced network impairments (e.g., latency, packet loss, and/or jitter, as non-limiting examples). Using the same VR content and the client pose data set, the network computing device generates a source VR stream capture that is not subjected to the one or more induced network impairments. The network computing device performs a frame-by-frame comparison of the client-side VR stream capture and the source VR stream capture. Based on the frame-by-frame comparison, the network computing device generates a QoE metric that indicates a degree of degradation of the client-side VR stream capture relative to the source VR stream capture.

公开(公告)号：US11527043B2

公开(公告)日：2022-12-13

申请号：US16786621

申请日：2020-02-10

Applicant: Charter Communications Operating, LLC

Inventor： Dell Wolfensparger ,  Dhananjay Lal ,  Matthew Ringenberg ,  Andrew Ip

IPC: G06T19/00 ,  G06F3/01 ,  G06F3/04815

Abstract: Providing selectable virtual reality (VR) viewpoints within a VR environment is disclosed. In one embodiment, a network computing device provides downloadable VR content that defines a VR environment comprising a plurality of viewpoints. The plurality of viewpoints may include, as non-limiting examples, one or more viewpoints corresponding to one or more VR participants within the VR environment, and/or one or more predefined non-participant viewpoints. The network computing device receives a viewpoint selection indication from a client computing device of a spectator of the VR environment, wherein the viewpoint selection indication corresponds to a selected viewpoint of the plurality of viewpoints. The network computing device then transmits, to the client computing device, a pose data stream comprising pose data corresponding to the selected viewpoint. The client computing device may then display the VR environment based on the VR content and the pose data corresponding to the selected viewpoint.

公开(公告)号：US20220116554A1

公开(公告)日：2022-04-14

申请号：US17553898

申请日：2021-12-17

Applicant: Charter Communications Operating, LLC

Inventor： Dell Wolfensparger ,  Andrew Ip ,  Dhananjay Lal ,  Matthew Ringenberg

IPC: H04N5/272 ,  G06T11/00 ,  G06T7/70 ,  G06T7/50 ,  G06V20/10 ,  G06V20/40

Abstract: Method and apparatus for overlaying themed imagery onto real-world objects in a head-mounted display device (HMDD). A computing device receives, from an HMDD, depth data that identifies distances from the HMDD to surfaces of a plurality of objects in a user space. The computing device detects at least one object in the user space based at least in part on the depth data. The computing device determines a classification of video content being presented on a display system of the HMDD. The computing device selects, based on the classification, a particular image theme from a plurality of different image themes, the image theme comprising one or more image textures. The computing device sends, to the HMDD, at least one image texture for overlaying the at least one object during presentation of the at least one object on the display system of the HMDD in conjunction with the video content.

公开(公告)号：US20210344736A1

公开(公告)日：2021-11-04

申请号：US17374565

申请日：2021-07-13

Applicant: Charter Communications Operating, LLC

Inventor： Matthew Ringenberg ,  Dhananjay Lal ,  Dell Wolfensparger ,  Andrew Ip

IPC: H04L29/06 ,  H04L12/26 ,  H04N13/327

Abstract: Measuring quality-of-experience (QoE) for virtual reality (VR) streaming content is disclosed. A network computing device receives a client-side VR stream capture and a client pose data set that are generated by a client computing device based on a VR content and one or more induced network impairments (e.g., latency, packet loss, and/or jitter, as non-limiting examples). Using the same VR content and the client pose data set, the network computing device generates a source VR stream capture that is not subjected to the one or more induced network impairments. The network computing device performs a frame-by-frame comparison of the client-side VR stream capture and the source VR stream capture. Based on the frame-by-frame comparison, the network computing device generates a QoE metric that indicates a degree of degradation of the client-side VR stream capture relative to the source VR stream capture.

公开(公告)号：US11082475B1

公开(公告)日：2021-08-03

申请号：US16743805

申请日：2020-01-15

Applicant: Charter Communications Operating, LLC

Inventor： Matthew Ringenberg ,  Dhananjay Lal ,  Dell Wolfensparger ,  Andrew Ip

IPC: H04L29/06 ,  H04L12/26 ,  H04N13/327

Abstract: Measuring quality-of-experience (QoE) for virtual reality (VR) streaming content is disclosed. A network computing device receives a client-side VR stream capture and a client pose data set that are generated by a client computing device based on a VR content and one or more induced network impairments (e.g., latency, packet loss, and/or jitter, as non-limiting examples). Using the same VR content and the client pose data set, the network computing device generates a source VR stream capture that is not subjected to the one or more induced network impairments. The network computing device performs a frame-by-frame comparison of the client-side VR stream capture and the source VR stream capture. Based on the frame-by-frame comparison, the network computing device generates a QoE metric that indicates a degree of degradation of the client-side VR stream capture relative to the source VR stream capture.

公开(公告)号：US20210217386A1

公开(公告)日：2021-07-15

申请号：US16743765

申请日：2020-01-15

Applicant: Charter Communications Operating, LLC

Inventor： Dhananjay Lal ,  Andrew Ip ,  Matthew Ringenberg ,  Dell Wolfensparger ,  Mun G. Choi

IPC: G09G5/37 ,  H04L12/26 ,  G06F3/01 ,  G09G5/14

Abstract: Compensating for latency in a streaming virtual reality environment is disclosed. A computing device receives from a head-mounted display device (HMDD) having a field of view (FOV), first pose data that identifies an orientation of the HMDD worn by a participant viewing a virtual world via the HMDD. The computing device renders, based at least in part on the first pose data and a first oversized FOV that is greater than the FOV, oversized imagery that depicts a portion of the virtual world within the FOV of the HMDD and a portion of the virtual world outside of the FOV of the HMDD. The computing device communicates the oversized imagery to the HMDD.