公开(公告)号：US20220012857A1

公开(公告)日：2022-01-13

申请号：US17349252

申请日：2021-06-16

Applicant: Pexip AS

Inventor： Håvard Graff

IPC: G06T5/30 ,  G06T7/246

Abstract: The present invention relates to an image processing device and a method of framing changes and movements in a video image divided into N×N blocks of pixel positions. The method comprises calculating a first bitmap of the video image by a DCT transform on each of the N×N blocks of pixel positions, assigning a first binary value to the pixel positions of the N×N blocks when more than an amount of change, and a second binary value to the pixel positions of the N×N blocks when less than an amount of change. Calculating a third bitmap by an OR operation between a number of bitmaps representing past time frames of the video image, calculating a fourth bitmap by performing a dilation process of the third bitmap representing the current time frame of the video image, and creating one or more frames identifying area of changes and movements in the video image based on detecting BLOBs (Binary Large Objects) in the fourth bitmaps.

公开(公告)号：US10750125B2

公开(公告)日：2020-08-18

申请号：US16432008

申请日：2019-06-05

Applicant: Pexip AS

Inventor： Håkon Dahle ,  Nico Cormier ,  Andreas Nervik Wintervold ,  Lukasz Zgrzebski ,  Peter Boba ,  Thomas Guggenbuhl

IPC: H04N7/15 ,  H04L29/06 ,  H04L29/08

Abstract: An orchestration server and a method of deploying a distributed videoconferencing system in cloud services are disclosed. The method including receiving, by an orchestration server, a proposed configuration of a distributed videoconferencing system, determining, by the orchestration server, a status of the proposed configuration of the distributed videoconferencing system, determining, by the orchestration server, based on the status of the proposed configuration of the distributed videoconferencing system, a determined configuration of the distributed videoconferencing system, initiating, by the orchestration server, according to the determined configuration of the distributed videoconferencing system at least one non-transcoding node at a first data center of a first cloud service provider, and initiating, by the orchestration server, according to the determined configuration of the distributed videoconferencing system at least one transcoding node at a second data center.

公开(公告)号：US10382337B2

公开(公告)日：2019-08-13

申请号：US15485956

申请日：2017-04-12

Applicant: Pexip AS

Inventor： Gregory Adams ,  John Robert Bassett ,  Nicolas Cormier ,  Håvard Graff ,  Eoin Stuart McLeod

IPC: H04L29/06 ,  H04L12/803 ,  H04N7/15 ,  H04L12/18 ,  H04L29/08

Abstract: Load balancing in a multimedia conference is disclosed, involving one or more internal terminals and one or more internal nodes separated from one or more external terminals and one or more external nodes by a firewall. Media data is forwarded through the firewall to at least a second one of the nodes, and received media data at the at least a second one of said nodes are processed. At a first event, reconfiguration is performed of said first one of said nodes to process received media data and of said second one of said nodes to forward received media data to said first one of said nodes. At a second event, loading is done of at least a part of said received media data being processed at the first one or second one of said nodes to at least a third one of said nodes.

公开(公告)号：US09118808B2

公开(公告)日：2015-08-25

申请号：US14192492

申请日：2014-03-26

Applicant: Pexip AS

Inventor： Havard Helland Graff ,  Hakon Dahle

IPC: H04N7/15 ,  H04L12/18 ,  H04L29/06

CPC classification number: H04N7/152 ,  H04L12/1827 ,  H04L12/185 ,  H04L12/1877 ,  H04L65/403 ,  H04L65/605 ,  H04L65/80

Abstract: A method and a device for providing for sharing encoder resources in an MCU without compromising with image quality and bandwidth adaption is provided. The method and device comprises dynamic allocation of encoders in a multi-party video conference of a number of endpoints, wherein the video conference endpoints are adapted to encode and transmit a media stream comprising the steps of creating a new encoder at a request for a new pad, determining whether a maximum number of encoders is reached, if the maximum number of encoders is not reached, then linking the new pad to the new encoder, if the maximum number of encoders is reached, then linking all existing pads to the new encoder, 15 and releasing all unused encoders.

Abstract translation: 提供了一种用于在不牺牲图像质量和带宽适配的情况下在MCU中共享编码器资源的方法和装置。 该方法和设备包括在多个端点的多方视频会议中对编码器进行动态分配，其中视频会议端点适于对媒体流进行编码和发送，包括以下步骤：在请求新的时候创建新的编码器 垫，确定是否达到最大数量的编码器，如果没有达到最大数量的编码器，则将新焊盘链接到新编码器，如果达到最大数量的编码器，则将所有现有焊盘链接到新编码器 ，15并释放所有未使用的编码器。

公开(公告)号：US08971407B2

公开(公告)日：2015-03-03

申请号：US13945152

申请日：2013-07-18

Applicant: Pexip AS

Inventor： Lars Petter Endresen

IPC: H04N7/12 ,  H04N11/02 ,  H04N11/04 ,  H04B1/66 ,  H04N5/14 ,  H04N9/64 ,  H04N19/61

CPC classification number: H04N19/00781 ,  G06F17/147 ,  H04N19/109 ,  H04N19/132 ,  H04N19/14 ,  H04N19/176 ,  H04N19/436 ,  H04N19/61 ,  H04N19/625

Abstract: A method to quickly determine whether a macroblock in H.264 or other similar standards should be encoded in skip mode in a SIMD processor environment is provided. The method exploits the fact that the processor provides enough register space to store N=4 4×4 set of 8 bits data. By performing 4 consecutive reads of 16 linear aligned values into 16 SIMD register variables each capable of storing 16 values, the entire data set for operating can be stored within the processors SIMD register variables and can be operated upon, without any memory related latency.

Abstract translation: 提供了一种快速确定H.264或其他类似标准中的宏块是否应在SIMD处理器环境中以跳过模式进行编码的方法。 该方法利用了处理器提供足够的寄存器空间来存储N = 4×4×4的8位数据的事实。 通过对16个SIMD寄存器变量执行4个连续读取16个线性对齐值，每个能够存储16个值，用于操作的整个数据集可以存储在处理器SIMD寄存器变量中，可以在没有任何内存相关延迟的情况下进行操作。

公开(公告)号：US20140354761A1

公开(公告)日：2014-12-04

申请号：US14285136

申请日：2014-05-22

Applicant: Pexip AS

Inventor： Havard GRAFF

IPC: H04N7/15

CPC classification number: H04N7/152 ,  G06F16/7834 ,  H04M3/567 ,  H04N7/147 ,  H04N7/15

Abstract: According to a general embodiment of the present invention, a computer, tablet or smart phone executable application is provided, allowing a user of the application to activate pairing of the device and a video conference session allowing e.g. for streaming of duo video content or other forms of presentations streams of the video conference session from video conference infrastructure like MCUs, conference bridges or servers.

Abstract translation: 根据本发明的一般实施例，提供了计算机，平板电脑或智能电话可执行应用程序，允许应用程序的用户激活设备的配对和视频会议会话。 用于从诸如MCU，会议桥或服务器的视频会议基础设施流式传输视频会议会议的二重视频内容或其他形式的演示流。

公开(公告)号：US20140313281A1

公开(公告)日：2014-10-23

申请号：US14192492

申请日：2014-03-26

Applicant: PEXIP AS

Inventor： Havard Helland Graff ,  Hakon Dahle

IPC: H04N7/15

CPC classification number: H04N7/152 ,  H04L12/1827 ,  H04L12/185 ,  H04L12/1877 ,  H04L65/403 ,  H04L65/605 ,  H04L65/80

Abstract: A method and a device for providing for sharing encoder resources in an MCU without compromising with image quality and bandwidth adaption is provided. The method and device comprises dynamic allocation of encoders in a multi-party video conference of a number of endpoints, wherein the video conference endpoints are adapted to encode and transmit a media stream comprising the steps of creating a new encoder at a request for a new pad, determining whether a maximum number of encoders is reached, if the maximum number of encoders is not reached, then linking the new pad to the new encoder, if the maximum number of encoders is reached, then linking all existing pads to the new encoder, 15 and releasing all unused encoders.

Abstract translation: 提供了一种用于在不牺牲图像质量和带宽适配的情况下在MCU中共享编码器资源的方法和装置。 该方法和设备包括在多个端点的多方视频会议中对编码器进行动态分配，其中视频会议端点适于对媒体流进行编码和发送，包括以下步骤：在请求新的时候创建新的编码器 垫，确定是否达到最大数量的编码器，如果没有达到最大数量的编码器，则将新焊盘链接到新编码器，如果达到最大数量的编码器，则将所有现有焊盘链接到新编码器 ，15并释放所有未使用的编码器。

公开(公告)号：US20140176666A1

公开(公告)日：2014-06-26

申请号：US13945347

申请日：2013-07-18

Applicant: Pexip AS

Inventor： Giles Russell Chamberlin ,  Hani Mustafa Elsayed Abdelkader Hashim ,  Nicolas Jean Michel Cormier ,  John-Mark Bell ,  Eoin Stuart McLeod ,  Benjamin John Hockley

IPC: H04N7/15

CPC classification number: H04N7/152 ,  H04L12/1822 ,  H04M3/563 ,  H04M3/565 ,  H04M3/567 ,  H04M2201/50

Abstract: A method for managing media streams including at least video data and audio data in a multi-party video conference involving one or more groups of one or more nodes respectively receiving a media stream from each of a plurality of associated endpoints is provided. In each of the one or more nodes of each of the one or more groups, the loudest audio of the media streams received from the respective plurality of associated endpoints is determined. An indication of the volume of the determined loudest audio and an identification of the node is transmitted to a decision maker. The highest received volume and the associated identification is determined. The node of the identification is instructed to transmit the received media stream of the endpoint to one of: all nodes in the one or more groups and to a proxy.

Abstract translation: 提供了一种在多方视频会议中管理至少包括视频数据和音频数据的媒体流的方法，所述多方视频会议涉及分别从多个关联端点中的每一个接收媒体流的一个或多个节点的一个或多个组。 在一个或多个组中的每一个的一个或多个节点的每一个中，确定从相应的多个相关联的端点接收的媒体流的最大音频。 将确定的最大音频的音量和节点的标识的指示传送给决策者。 确定最高接收量和相关标识。 指示识别的节点将接收到的端点的媒体流发送到一个或多个组中的所有节点之一，并发送到代理。