-
公开(公告)号:EP4290873A1
公开(公告)日:2023-12-13
申请号:EP22178326.9
申请日:2022-06-10
申请人: Holo-Light GmbH
IPC分类号: H04N21/81 , G06F3/01 , G06Q30/00 , H04N21/835
摘要: An extended reality (XR) streaming system (10) with integrated copyright protection is described. The XR streaming system (10) comprises an asset database (30) and at least one XR streaming instance (26). The asset database (30) is configured to store asset data that is associated with a plurality of different digital assets, wherein the asset data comprises rendering data and copyright data associated with each digital asset. The rendering data corresponds to data that is necessary for the at least one XR streaming instance (26) to render an XR image associated with the respective digital asset. The XR streaming instance (26) is configured to generate an asset request, wherein the asset request corresponds to a request for a particular digital asset. The asset database (30) is configured to transmit the rendering data associated with the requested digital asset to the at least one XR streaming instance (26) based on the asset request and based on the copyright data. The at least one XR streaming instance (26) is configured to generate an XR image stream based on the transmitted rendering data. Further, an XR streaming method is described.
-
公开(公告)号:EP4329288A1
公开(公告)日:2024-02-28
申请号:EP22191746.1
申请日:2022-08-23
申请人: Holo-Light GmbH
IPC分类号: H04N5/265
摘要: A multi-user extended reality (XR) streaming method for streaming XR images between a plurality of XR application instances (26) and at least one XR device (12) is described. The XR streaming method comprises the following steps:
- streaming, by means of a first XR application instance (26) of the plurality of XR application instances (26), first XR images to the at least one XR device (12), wherein the first XR images streamed by the first XR application instance (26) are associated with a first XR application;
- streaming, by means of a second XR application instance (26) of the plurality of XR application instances (26), second XR images to the at least one XR device (12), wherein the second XR images streamed by the second XR application instance (26) are associated with a second XR application, wherein the second XR application is a multi-user XR application; and
- blending, by means of the at least one XR device (12), the first XR images received from the first XR application instance (26) with the second XR images received from the second XR application instance (26), thereby obtaining blended XR images to be displayed on the at least one XR device (12).
Further, an XR streaming system (10) is described.-
公开(公告)号:EP4280611A1
公开(公告)日:2023-11-22
申请号:EP22173886.7
申请日:2022-05-17
申请人: Holo-Light GmbH
IPC分类号: H04N21/442 , H04N21/81 , H04W28/02 , H04W36/30
摘要: An extended reality (XR) streaming method for streaming XR images between a plurality of XR application instances (26) and an XR device (12) is described. The XR streaming method comprises the following steps:
- streaming, by means of a first XR application instance of the plurality of XR application instances (26), XR images to the XR device (12), wherein the XR images are associated with an XR application;
- establishing a communication connection between a second XR application instance of the plurality of XR application instances and the XR device (12), wherein the second XR application instance is currently inactive;
- streaming, by means of the second XR application instance, XR images to the XR device (12); and
- terminating a communication connection between the XR device (12) and the first XR application instance after the communication connection between the second XR application instance and the XR device (12) has been established.
Further, an XR streaming system (10) is described.-
4.
公开(公告)号:EP4254139A1
公开(公告)日:2023-10-04
申请号:EP22165571.5
申请日:2022-03-30
申请人: Holo-Light GmbH
摘要: A reprojection method for generating reprojected image data to be displayed on an XR device (12) is described. The reprojection method comprises the following steps:
- determining momentary position data;
- generating preliminary image data based on the momentary position data;
- determining updated position data;
- inputting the momentary position data, the preliminary image data, and the updated position data into a machine-learning module (24), wherein the machine-learning module comprises a machine-learning model that is pretrained to reproject the preliminary image data based on the momentary position data, the preliminary image data, and the updated position data; and
- reprojecting the preliminary image data by means of the machine-learning module (24), thereby generating reprojected image data, wherein the reprojected image data corresponds to at least one reprojected XR image to be displayed on the XR device (12).
Further, an XR projection system (10) and a machine-learning module (24) are described.-
公开(公告)号:EP4354877A1
公开(公告)日:2024-04-17
申请号:EP22201143.9
申请日:2022-10-12
申请人: Holo-Light GmbH
IPC分类号: H04N21/218 , H04N21/6587 , H04N21/81 , H04N13/117
CPC分类号: H04N21/21805 , H04N21/6587 , H04N21/816 , H04N13/117
摘要: A multi-viewer extended reality (XR) streaming method for streaming XR images between a plurality of XR application instances (26) and a plurality of XR devices (12) is described. The multi-viewer XR streaming method comprises the following steps:
- streaming, by means of a first XR application instance (26) of the plurality of XR application instances (26), first XR images to at least one XR device (12), wherein the first XR images correspond to virtual content viewed from a first spectator position (38);
- determining a position of the at least one XR device (12) relative to the first spectator position (38); and
- reprojecting, by means of the at least one XR device (12), the first XR images based on the determined position of the at least one XR device (12).
Further, an XR streaming system (10) is described.-
公开(公告)号:EP4351157A1
公开(公告)日:2024-04-10
申请号:EP22200050.7
申请日:2022-10-06
申请人: Holo-Light GmbH
摘要: An extended reality (XR) streaming method for streaming XR images to an XR device (12) is described. The XR streaming method comprises the following steps:
- generating, by means of an XR application instance (26), virtual content to be rendered;
- partitioning, by means of the XR application instance (26), the virtual content to be rendered into a plurality of rendering jobs;
- forwarding the plurality of rendering jobs to at least two rendering instances (28), wherein the at least two rendering instances (28) comprise a first rendering instance (28) and a second rendering instance (28);
- generating, by means of the first rendering instance (28), first XR images based on the corresponding rendering job received from the XR application instance (26);
- generating, by means of the second rendering instance (28), second XR images based on the corresponding rendering job received from the XR application instance (26); and
- blending, by means of a merging instance (30), the first XR images with the second XR images, thereby obtaining blended XR images to be displayed on the XR device (12).
Further, an XR streaming system (10) is described.-
公开(公告)号:EP4254959A1
公开(公告)日:2023-10-04
申请号:EP22165555.8
申请日:2022-03-30
申请人: Holo-Light GmbH
IPC分类号: H04N19/597 , H04N19/46 , H04N13/271
摘要: A computer-implemented method for generating augmented image data comprising depth information is described. The method comprises the following steps:
- generating or receiving image data, wherein the image data comprises at least one frame having a first predetermined bit length, wherein the at least one frame comprises color information associated with pixels of at least one image;
- generating or receiving depth data, wherein the depth data comprises depth information associated with the pixels of the at least one image; and
- generating at least one augmented frame based on the image data and based on the depth data, wherein the at least one augmented frame comprises a color frame portion (28) and a frame extension (30) attached to the color frame portion (28).
The color frame portion (28) corresponds to the at least one frame and has the first predetermined bit length. The color frame portion (28) comprises the color information associated with the pixels of the at least one image. The frame extension (30) has a second predetermined bit length, and wherein the frame extension (30) comprises the depth information associated with the pixels of the at least one image. Further, a computer-implemented streaming method, an image streaming system (10), and an augmented image data stream are described.-
8.
公开(公告)号:EP4375884A3
公开(公告)日:2024-07-17
申请号:EP24169803.4
申请日:2022-03-30
申请人: Holo-Light GmbH
IPC分类号: G06F3/01 , G06T11/00 , H04N13/00 , G06N3/0464 , G06N3/09
CPC分类号: G06F3/011 , G06F3/012 , G06T11/00 , G06N3/0464 , G06N3/09
摘要: A reprojection method for generating reprojected image data to be displayed on an XR device (12) is described. The reprojection method comprises the following steps:
- determining momentary position data;
- generating preliminary image data based on the momentary position data;
- determining updated position data;
- inputting the momentary position data, the preliminary image data, and the updated position data into a machine-learning module (24), wherein the machine-learning module comprises a machine-learning model that is pre-trained to reproject the preliminary image data based on the momentary position data, the preliminary image data, and the updated position data; and
- reprojecting the preliminary image data by means of the machine-learning module (24), thereby generating reprojected image data, wherein the reprojected image data corresponds to at least one reprojected XR image to be displayed on the XR device (12).
Further, an XR projection system (10) and a machine-learning module (24) are described.-
9.
公开(公告)号:EP4375884A2
公开(公告)日:2024-05-29
申请号:EP24169803.4
申请日:2022-03-30
申请人: Holo-Light GmbH
IPC分类号: G06N3/09
CPC分类号: G06F3/011 , G06F3/012 , G06T11/00 , G06N3/0464 , G06N3/09
摘要: A reprojection method for generating reprojected image data to be displayed on an XR device (12) is described. The reprojection method comprises the following steps:
- determining momentary position data;
- generating preliminary image data based on the momentary position data;
- determining updated position data;
- inputting the momentary position data, the preliminary image data, and the updated position data into a machine-learning module (24), wherein the machine-learning module comprises a machine-learning model that is pre-trained to reproject the preliminary image data based on the momentary position data, the preliminary image data, and the updated position data; and
- reprojecting the preliminary image data by means of the machine-learning module (24), thereby generating reprojected image data, wherein the reprojected image data corresponds to at least one reprojected XR image to be displayed on the XR device (12).
Further, an XR projection system (10) and a machine-learning module (24) are described.-
公开(公告)号:EP4329284A1
公开(公告)日:2024-02-28
申请号:EP22191748.7
申请日:2022-08-23
申请人: Holo-Light GmbH
摘要: An extended reality (XR) streaming method for streaming XR images between a plurality of XR application instances (26) and an XR device (12) is described. The XR streaming method comprises the following steps:
- streaming, by means of a first XR application instance (26) of the plurality of XR application instances (26), first XR images to the XR device (12), wherein the first XR images streamed by the first XR application instance (26) are associated with a first XR application;
- streaming, by means of a second XR application instance (26) of the plurality of XR application instances (26), second XR images to the XR device (12), wherein the second XR images streamed by the second XR application instance (26) are associated with a second XR application; and
- blending, by means of the XR device (12), the first XR images received from the first XR application instance (26) with the second XR images received from the second XR application instance (26), thereby obtaining blended XR images to be displayed on the XR device (12).
Further, an XR streaming system (10) is described.
-
-
-
-
-
-
-
-
-