公开(公告)号：US20230245339A1

公开(公告)日：2023-08-03

申请号：US17884275

申请日：2022-08-09

Applicant: Beijing Baidu Netcom Science Technology Co., Ltd.

Inventor： Guanying CHEN ,  Xiaoqing YE ,  Xiao TAN ,  Hao SUN

IPC: G06T7/73 ,  G06V20/40 ,  G06T19/20

CPC classification number: G06T7/73 ,  G06V20/46 ,  G06T19/20 ,  G06T2207/20081 ,  G06T2219/2004

Abstract: Provided are a method for adjusting a three-dimensional pose, an electronic device, and a storage medium, relates to the field of artificial intelligence, and specifically to computer vision and deep learning technologies. A specific implementation solution includes acquiring a video currently recorded; estimating multiple two-dimensional key points of a virtual three-dimensional model and an initial three-dimensional pose based on multiple image frames; performing contact detection on a target part of the virtual three-dimensional model by using the multiple two-dimensional key points, to obtain a detection result; determining multiple target three-dimensional key points by means of the detection result and multiple initial three-dimensional key points corresponding to the initial three-dimensional pose; and adjusting the initial three-dimensional pose to a target three-dimensional pose by using the multiple initial three-dimensional key points and the multiple target three-dimensional key points.

公开(公告)号：US20230245364A1

公开(公告)日：2023-08-03

申请号：US17884231

申请日：2022-08-09

Applicant: Beijing Baidu Netcom Science Technology Co., Ltd.

Inventor： Guanying CHEN ,  Zhikang ZOU ,  Xiaoqing YE ,  Hao SUN

IPC: G06T13/20 ,  G06T7/20 ,  G06T7/80

CPC classification number: G06T13/20 ,  G06T7/20 ,  G06T7/80 ,  G06T2207/30241

Abstract: The present disclosure provides a method for processing a video, an electronic device, and a storage medium. A specific implementation solution includes: generating a first three-dimensional movement trajectory of a virtual three-dimensional model in world space based on attribute information of a target contact surface of the virtual three-dimensional model in the world space; converting the first three-dimensional movement trajectory into a second three-dimensional movement trajectory in camera space, where the camera space is three-dimensional space for shooting an initial video; determining a movement sequence of the virtual three-dimensional model in the camera space according to the second three-dimensional movement trajectory; and compositing the virtual three-dimensional model and the initial video by means of texture information of the virtual three-dimensional model and the movement sequence, to obtain a to-be-played target video.

公开(公告)号：US20220358675A1

公开(公告)日：2022-11-10

申请号：US17869161

申请日：2022-07-20

Applicant: Beijing Baidu Netcom Science Technology Co., Ltd.

Inventor： Guanying CHEN ,  Xiaoqing YE ,  Xiao TAN ,  Hao SUN

IPC: G06T7/73 ,  G06T7/13 ,  G06T7/174

Abstract: A method and apparatus for training a model, a method and apparatus for processing a video, a device and a storage medium are provided. An implementation of the method for training a model includes: analyzing a sample video, to determine a plurality of human body image frames in the sample video; determining human body-related parameters and camera-related parameters corresponding to each human body image frame; determining, based on the human body-related parameters, the camera-related parameters and an initial model, predicted image parameters of an image plane corresponding to the each human body image frame, the camera-related parameters and image parameters; and training the initial model based on original image parameters of the human body image frames in the sample video and the predicted image parameters of image planes corresponding to the human body image frames, to obtain a target model.