公开(公告)号：US12101370B2

公开(公告)日：2024-09-24

申请号：US18195965

申请日：2023-05-11

申请人： Agora Lab, Inc.

发明人： Sheng Zhong ,  Jiajie Jian ,  Tao Duan

IPC分类号： H04L65/80 ,  H04L1/16 ,  H04L43/0829

CPC分类号： H04L65/80 ,  H04L1/16 ,  H04L43/0829

摘要： A system and method for determining the performance of a real-time communication application, such as a video codec and transmission of the coded data. The method factors in burst data packet loss in determining a performance measure. The method uses a Hidden Markov Model on a set of data packets of a unit of data to determine the performance measure in the form a probability that all the data packets within the set are received. The measure is used to fine tune the system settings. The method causes the real-time communication application to adjust parameters of the application for improved transmission of data packets. The adjustment of a parameter can be an increase or a decrease.

公开(公告)号：US12001956B2

公开(公告)日：2024-06-04

申请号：US18319109

申请日：2023-05-17

申请人： Agora Lab, Inc.

发明人： Sheng Zhong

IPC分类号： G06N3/084 ,  G06F18/21 ,  G06N20/00 ,  G06T3/4053 ,  G06T5/00 ,  G06V10/776 ,  G06V10/82

CPC分类号： G06N3/084 ,  G06F18/217 ,  G06N20/00 ,  G06T3/4053 ,  G06T5/001 ,  G06V10/776 ,  G06V10/82 ,  G06T2207/20081 ,  G06T2207/20084

摘要： A method for image generation based on a Generative Adversarial Network (GAN) including a generator, a discriminator, and an encoder, wherein outputs of the generator are mapped, by the encoder, to a latent space adaptable to manipulate at least one characteristics of images generated by the GAN, the method including generating, by the encoder, a first encoding E(Y) of a target image Y and a second encoding E(G(Z)) of a generated image G(Z) corresponding to the target image Y, wherein the first and second encodings E(Y) and E(G(Z)) map Y and G(Z) to the latent space having a lower dimension than dimensionality of Y and G(Z), wherein the encoder is trained to minimize the differences between the first and second encodings E(Y) and E(G(Z)), and the generator is trained by using the first and second encodings E(Y) and E(G(Z)) as part of a loss function.

公开(公告)号：US11950088B2

公开(公告)日：2024-04-02

申请号：US17859181

申请日：2022-07-07

申请人： Agora Lab, Inc.

发明人： Song Li ,  Jianyuan Feng ,  Bo Wu ,  Jimeng Zheng

IPC分类号： H04R5/02 ,  H04R3/04 ,  H04S1/00 ,  H04S7/00 ,  H04L65/403 ,  H04R25/00

CPC分类号： H04S7/306 ,  H04R3/04 ,  H04S1/007 ,  H04L65/403 ,  H04S2400/11 ,  H04S2420/01

摘要： A computer-implemented method for generating spatial audio with uniform reverberation in a real-time communication session is performed by a real-time communication software application running on an electronic communication device. The method includes removing the reverberation of recorded speech signals from far-end participants by the dereverberation approach, rendering the direct sound parts by filtering the output signals by head-related transfer functions of desired directions, generating reverberant sound parts by convolving the output signals from with uniform room impulse responses or an artificial reverberator, combining direct and reverberant sound components to generate spatialized speech signals. When speakers and listeners are located in two virtual conference rooms, the reverberation of the two rooms are coupled. The reverberant sound parts are then generated by convolving the output signals and coupled RIRs from the two rooms.

公开(公告)号：US11949588B2

公开(公告)日：2024-04-02

申请号：US17203962

申请日：2021-03-17

申请人： Agora Lab, Inc.

发明人： Yong Liu ,  Yurun Sun ,  Bin Zhao

IPC分类号： H04L12/725 ,  H04L12/26 ,  H04L12/721 ,  H04L43/0852 ,  H04L43/0882 ,  H04L45/00 ,  H04L45/302

CPC分类号： H04L45/3065 ,  H04L43/0858 ,  H04L43/0882 ,  H04L45/70

摘要： A method, an apparatus for real-time multimedia communications using a software-defined network (SDN) are provided. The method includes receiving, in a periodic manner, a path metric associated with a first service node in the SDN and a second service node in the SDN, wherein the path metric comprises at least one of: a load status of at least one of the first service node or the second service node, or a transmission metric between the first service node and the second service node; and in response to receiving the path metric, updating a cascade network topology comprising an optimal path for transmitting multimedia data between a first edge node and a second edge node.

公开(公告)号：US11694085B2

公开(公告)日：2023-07-04

申请号：US17324831

申请日：2021-05-19

申请人： Agora Lab, Inc.

发明人： Sheng Zhong

IPC分类号： G06K9/62 ,  G06N3/084 ,  G06T3/40 ,  G06N20/00 ,  G06T5/00 ,  G06F18/21 ,  G06V10/776 ,  G06V10/82

CPC分类号： G06N3/084 ,  G06F18/217 ,  G06N20/00 ,  G06T3/4053 ,  G06T5/001 ,  G06V10/776 ,  G06V10/82 ,  G06T2207/20081 ,  G06T2207/20084

摘要： A method of training a generator G of a Generative Adversarial Network (GAN) includes receiving, by an encoder E, a target data Y; receiving, by the encoder E, an output G(Z) of the generator G, where the generator G generates the output G(Z) in response to receiving a random sample Z and where a discriminator D of the GAN is trained to distinguish which of the G(Z) and the target data Y; training the encoder E to minimize a difference between a first latent space representation E(G(Z)) of the output G(Z) and a second latent space representation E(Y) of the target data Y, where the output G(Z) and the target data Y are input to the encoder E; and using the first latent space representation E(G(Z)) and the second latent space representation E(Y) to constrain the training of the generator G.

公开(公告)号：US11650913B2

公开(公告)日：2023-05-16

申请号：US17891324

申请日：2022-08-19

申请人： Agora Lab, Inc.

发明人： Jiyu Bai ,  Yuhua Gong

IPC分类号： G06F9/44 ,  G06F9/445 ,  G06F9/455 ,  G06F11/36 ,  G06F9/54

CPC分类号： G06F11/3688 ,  G06F9/546 ,  G06F11/3664 ,  G06F11/3684 ,  G06F11/3692

摘要： A highly scalable automated testing system includes an automated testing controller, an automated testing message server and an automated testing message terminal running on a set of automated testing target devices. The controller and the terminals register themselves with the message server. A testing case is programmed for testing an SDK on a number of target devices concurrently and transformed into a set of command messages in JSON message format. The controller sends the set of messages to the message server. The message server then distributes the set of command messages to the terminals. In response, the terminal calls corresponding APIs of the SDK. The APIs called can be the same or different between the devices within the set of target devices. The SDK returns a result that is forwarded to the server. The server sends the results from the target devices to the controller. The controller verifies the results.

公开(公告)号：US11645079B2

公开(公告)日：2023-05-09

申请号：US16735021

申请日：2020-01-06

申请人： Agora Lab, Inc.

发明人： Zehua Gao ,  Ruofei Chen ,  Siqiang Yao ,  Shie Qian

IPC分类号： G06F9/38 ,  H04N19/126 ,  H04N19/124 ,  H04N19/176 ,  H04N19/39 ,  H04N19/65

CPC分类号： G06F9/3851 ,  H04N19/124 ,  H04N19/126 ,  H04N19/176 ,  H04N19/39 ,  H04N19/65

摘要： A method for encoding multiple descriptions for a media stream includes: determining, for a current block of the media stream, a first number of duplicate blocks, determining, for the current block, a plurality of complementary forward gain factors, and determining a first number of descriptions for the current block by applying the plurality of complementary forward gain factors to the first number of duplicate blocks. A method for decoding multiple descriptions for a media stream includes: determining, for a current block of the media stream, a first number of descriptions from the media stream, in which each description comprises a scaled block corresponding to the current block, determining backward gain factors for the first number of scaled blocks, and determining the current block by applying the backward gain factors to the first number of scaled blocks.

公开(公告)号：US11470531B2

公开(公告)日：2022-10-11

申请号：US16926855

申请日：2020-07-13

申请人： Agora Lab, Inc.

发明人： Yue Cao

IPC分类号： H04W36/30 ,  H04W36/22 ,  H04W24/08 ,  H04W76/10

摘要： An improved Wi-Fi access point dynamically determines the interference level of each channel. The access point determines that a new channel is better suited to serve an RTC/RTE application over the present channel based on the interference levels and a set of interference measure thresholds. The access point automatically creates a new basic service set on the new channel and associates the RTC/RTE device running the RTC/RTE application with the new basic service set. The access point further refuses to associate the RTC/RTE device with the previous channel when the interference level on the new channel remains low based on a second set of interference measure thresholds. In addition, the access point allows additional RTC/RTE devices to join the new basic service set with the first RTC/RTE device when the interference level on the new channel remains low based on the second set of interference measure thresholds.

公开(公告)号：US20220248270A1

公开(公告)日：2022-08-04

申请号：US17727925

申请日：2022-04-25

申请人： Agora Lab, Inc.

发明人： Yue Cao

IPC分类号： H04W28/10 ,  H04L47/2425 ,  H04W76/10 ,  H04W72/12 ,  H04L47/2441

摘要： A wireless access point software application, adapted to be run within a wireless access point, classifies network data packets with classification identifiers provided by RTC/RTE devices without scanning the content of them. The wireless access point software application receives inbound and outbound packet classification identifiers from the RTC/RTE applications running on the RTC/RTE devices. The identifiers are provided to a hardware data packet classifier. The hardware data packet classifier applies the identifiers against ingress packets and egress packets respectively. Data packets of the same class are assigned with a same priority. The prioritized network data packets are scheduled for transmission based on their respective priorities. The scheduled network data packets are forwarded to respective network interfaces for transmission.

公开(公告)号：US11380345B2

公开(公告)日：2022-07-05

申请号：US17071454

申请日：2020-10-15

申请人： Agora Lab, Inc.

发明人： Jianyuan Feng ,  Ruixiang Hang ,  Linsheng Zhao ,  Fan Li

IPC分类号： G10L21/013 ,  G10L25/51

摘要： Transforming a voice of a speaker to a reference timbre includes converting a first portion of a source signal of the voice of the speaker into a time-frequency domain to obtain a time-frequency signal; obtaining frequency bin means of magnitudes over time of the time-frequency signal; converting the frequency bin magnitude means into a Bark domain to obtain a source frequency response curve (SR), where SR(i) corresponds to magnitude mean of the ith frequency bin; obtaining respective gains of frequency bins of the Bark domain with respect to a reference frequency response curve (Rf); obtaining equalizer parameters using the respective gains of the frequency bins of the Bark domain; and transforming the first portion to the reference timbre using the equalizer parameters.