-
公开(公告)号:US20230071661A1
公开(公告)日:2023-03-09
申请号:US18054711
申请日:2022-11-11
Inventor: Haotian PENG , Ruizhi CHEN , Chen ZHAO
IPC: G06T11/60 , G06F40/186 , G06F40/20 , G06N20/00
Abstract: The present disclosure provides a method for training an image editing model, a method for editing an image, apparatuses, a device, a storage medium and a computer program. An implementation plan is: acquiring a training sample set; and performing training steps as follows: selecting a description text sample and an image sample from the training sample set; determining a text direction vector based on the selected description text sample and a predetermined text template; inputting the text direction vector into a mapping network of the image editing model to obtain a bias vector; determining an image direction vector based on the selected image sample and the bias vector; calculating a loss value based on the text direction vector and the image direction vector; and determining, in response to the loss value meeting a threshold condition, that training of the image editing model is completed.
-
公开(公告)号:US20230043766A1
公开(公告)日:2023-02-09
申请号:US17875519
申请日:2022-07-28
Inventor: Ruizhi CHEN , Chen ZHAO
Abstract: An image processing method, an electronic device and a computer storage medium are provided, which relates to the fields of computer vision, augmented reality and artificial intelligence technologies. An implementation includes: acquiring a to-be-processed face image; reconstructing a face based on the to-be-processed face image to obtain a first blend coefficient vector based on a first blendshape base group; mapping the first blend coefficient vector to a second blendshape base group according to a pre-obtained coefficient mapping matrix between the first blendshape base group and the second blendshape base group to obtain a second blend coefficient vector based on the second blendshape base group; acquiring input face adjustment information, the face adjustment information including second blendshape base information; and obtaining a target face image based on the second blendshape base information and the second blend coefficient vector.
-
3.
公开(公告)号:US20220122337A1
公开(公告)日:2022-04-21
申请号:US17646116
申请日:2021-12-27
Inventor: Ruizhi CHEN , Sheng ZHANG
Abstract: The present disclosure discloses a method for processing a slider for a virtual character, an electronic device, and a storage medium, relating to a field of virtual reality, in particular to fields of artificial intelligence, Internet of Things, voice technology, cloud computing, etc. An implementation includes: acquiring a shape model associated with a target semantic tag; acquiring a skeleton and skinning information of a reference virtual character; fitting the shape model based on the skeleton and skinning information to obtain a skeleton linkage coefficient; and generating a slider associated with the target semantic tag based on the skeleton linkage coefficient, wherein the slider is used to drive the reference virtual character to obtain a target virtual character complying with a target semantic feature contained in the target semantic tag.
-
4.
公开(公告)号:US20230120253A1
公开(公告)日:2023-04-20
申请号:US18082997
申请日:2022-12-16
Inventor: Jie Li , Haojie LIU , Yan ZHANG , Xuecen SHEN , Ruizhi CHEN , Chen ZHAO , Yuqiao TENG , Errui DING , Tian WU , Haifeng WANG
Abstract: A method and apparatus for generating a virtual character, an electronic device and a computer readable storage medium are provided. The method includes: performing mesh simplification on an initial model of a virtual character to obtain a mesh-simplified model; obtaining a first target model by performing white model mapping rendering on an area of each material type on the mesh-simplified model, and obtaining a second target model by performing hyper-realistic rendering on the area of each material type on the mesh-simplified model; and establishing a bidirectional mapping between the first target model and the second target model, and obtaining a target virtual character through iterative updating of the bidirectional mapping.
-
公开(公告)号:US20220076476A1
公开(公告)日:2022-03-10
申请号:US17527990
申请日:2021-11-16
Inventor: Xinhang YANG , Ruizhi CHEN
IPC: G06T13/40 , H04N21/2187 , H04N21/2343 , H04N21/44 , H04N21/81
Abstract: A method and apparatus for generating a user avatar, an electronic device, and a computer readable storage medium are provided. The method may include: receiving incoming expression-driven information and a target avatar model being sent when a rate at which an original rendering device renders to obtain a corresponding dynamic avatar is less than a preset rate; driving the target avatar model based on the expression-driven information to generate a dynamic avatar of the user; and pushing the dynamic avatar as a substitute avatar of the user to another user.
-
公开(公告)号:US20220392152A1
公开(公告)日:2022-12-08
申请号:US17819739
申请日:2022-08-15
Inventor: Ruizhi CHEN
Abstract: The present application discloses a method for operating a component, an electronic device, a storage medium and a program product, relating to the field of artificial intelligence technology, such as, the computer vision technology, the image processing technology and the augmented reality technology, the method includes: in response to a drawing operation on an operable component in a three-dimensional virtual space, displaying a drawn two-dimensional pattern on the operable component; in response to a model generating operation on the operable component, processing the two-dimensional pattern to generate a three-dimensional model; and displaying the three-dimensional model in the three-dimensional virtual space. In the solution provided by the present disclosure, an operable component which may be applied in a virtual space is provided, and a user may draw a pattern in the operable component, thus enabling a system to generate a three-dimensional model corresponding to the pattern.
-
公开(公告)号:US20220058848A1
公开(公告)日:2022-02-24
申请号:US17516769
申请日:2021-11-02
Inventor: Haotian PENG , Ruizhi CHEN
IPC: G06T13/40
Abstract: Provided are a virtual avatar driving method and apparatus, a device, and a storage medium. The virtual avatar driving method includes: determining reference pose data of each of bone nodes when driving a skinned mesh bone model of a virtual avatar to a target patch model with a same topology; synchronously driving the skinned mesh bone model according to the reference pose data of each of the bone nodes; and updating the reference pose data of each of the bone nodes for subsequently driving the skinned mesh bone model.
-
公开(公告)号:US20230419610A1
公开(公告)日:2023-12-28
申请号:US18185359
申请日:2023-03-16
Inventor: Xing LIU , Ruizhi CHEN , Yan ZHANG , Chen ZHAO , Hao SUN , Jingtuo LIU , Errui DING , Tian WU , Haifeng WANG
CPC classification number: G06T17/20 , G06T5/50 , G06V10/26 , G06V10/60 , G06T2207/10028 , G06T2207/20221
Abstract: An image rendering method includes the steps below. A model of an environmental object is rendered to obtain an image of the environmental object in a target perspective. An image of a target object in the target perspective and a model of the target object are determined according to a neural radiance field of the target object. The image of the target object is fused and rendered into the image of the environmental object according to the model of the target object.
-
公开(公告)号:US20220358741A1
公开(公告)日:2022-11-10
申请号:US17870690
申请日:2022-07-21
Inventor: Ruizhi CHEN
Abstract: Provided are a method and an apparatus for determining a skeletal driving coefficient, an electronic device, and a readable storage medium, and relates to the field of image processing technologies, and in particular, to the field of artificial intelligence or augmented reality technologies. A method includes driving a deformation, based on an initial skeletal driving coefficient, on an initial skin-skeleton model to obtain a first skinned skeleton model; and in response to a difference between the first skinned skeleton model and a target skinned skeleton model does not meet a threshold, performing at least one deformation on the first skinned skeleton model until a second skinned skeleton model, the difference between which model and the target skinned skeleton model meets the condition on the difference, is obtained, and obtaining at least one target skeletal driving coefficient used for driving the at least one deformation.
-
公开(公告)号:US20220157036A1
公开(公告)日:2022-05-19
申请号:US17646117
申请日:2021-12-27
Inventor: Ruizhi CHEN , Yingchao LI , Chen ZHAO
Abstract: The present disclosure discloses a method for generating a virtual image, an electronic device, and a storage medium, relating to a field of virtual reality, in particular to fields of artificial intelligence, Internet of Things, voice technology, cloud computing, etc. An implementation includes: acquiring a language description generated by a user for a target virtual character; extracting a respective semantic feature based on the language description; and generating the target virtual character based on the semantic feature.
-
-
-
-
-
-
-
-
-