公开(公告)号：US20220374742A1

公开(公告)日：2022-11-24

申请号：US17817015

申请日：2022-08-03

Applicant: BEIJING BAIDU NETCOM SCIENCE TECHNOLOGY CO., LTD.

Inventor： Zhengxiong Yuan ,  Zhengyu Qian ,  En Shi ,  Mingren Hu ,  Jinqi Li ,  Zhenfang Chu ,  Runqing Li ,  Yue Huang

IPC: G06N5/04 ,  G06F9/48

Abstract: A method for running an inference service platform, includes: determining inference tasks to be allocated for the inference service platform, in which the inference service platform includes two or more inference service groups, versions of the inference service groups are different, and the inference service groups are configured to perform a same type of inference services; determining a flow weight of each of the inference service groups, in which the flow weight is configured to indicate a proportion of a number of inference tasks to which the corresponding inference service group need to be allocated in a total number of inference tasks; and allocating the corresponding number of inference tasks in the inference tasks to be allocated to each of the inference service groups based on the flow weight of each of the inference service groups; and performing the inference tasks by the inference service group.

公开(公告)号：US20240005182A1

公开(公告)日：2024-01-04

申请号：US17982128

申请日：2022-11-07

Applicant: Beijing Baidu Netcom Science Technology Co., Ltd.

Inventor： Jinqi Li ,  En Shi ,  Mingren Hu ,  Zhengyu Qian ,  Zhengxiong Yuan ,  Zhenfang Chu ,  Yue Huang ,  Yang Luo ,  Guobin Wang

IPC: G06N5/04

CPC classification number: G06N5/04

Abstract: Provided are a streaming media processing method based on inference service, an electronic device, and a storage medium, which relates to the field of artificial intelligence, and in particular, to the field of inference service of artificial intelligence models. The method includes: detecting, in a process of processing a k-th channel of streaming media through an i-th inference service pod, the i-th inference service pod, to obtain a detection result of the i-th inference service pod, i and k being positive integers; determining a replacement object of the i-th inference service pod, in the case where it is determined that the i-th inference service pod is in an abnormal state based on the detection result of the i-th inference service pod; and processing the k-th channel of streaming media through the replacement object of the i-th inference service pod.