-
公开(公告)号：US20230162426A1
公开(公告)日：2023-05-25
申请号：US17880550
申请日：2022-08-03
CPC classification number: G06T15/04 , G06T11/001 , G06T7/40 , G06T2207/20084 , G06T2207/30201
Abstract: An image processing method, an electronic device, and a storage medium are provided, relates to the field of augmented/virtual reality and image processing. A specific implementation solution may include: at least one first texture coefficient of a two-dimensional face image is acquired; a first texture image of the two-dimensional face image is generated based on the at least one first texture coefficient and a first texture base of the two-dimensional face image; the at least one first texture coefficient is determined to satisfy a first target condition based on the first texture image, and the first texture base is updated based on the first texture image, to obtain a second texture base; and in response to the second texture base converging successfully, three-dimensional reconstruction is performed on the two-dimensional face image based on the second texture base, to obtain a three-dimensional face image.
-
公开(公告)号：US20230043766A1
公开(公告)日：2023-02-09
申请号：US17875519
申请日：2022-07-28
Inventor： Ruizhi CHEN , Chen ZHAO
Abstract: An image processing method, an electronic device and a computer storage medium are provided, which relates to the fields of computer vision, augmented reality and artificial intelligence technologies. An implementation includes: acquiring a to-be-processed face image; reconstructing a face based on the to-be-processed face image to obtain a first blend coefficient vector based on a first blendshape base group; mapping the first blend coefficient vector to a second blendshape base group according to a pre-obtained coefficient mapping matrix between the first blendshape base group and the second blendshape base group to obtain a second blend coefficient vector based on the second blendshape base group; acquiring input face adjustment information, the face adjustment information including second blendshape base information; and obtaining a target face image based on the second blendshape base information and the second blend coefficient vector.
-
公开(公告)号：US20230071661A1
公开(公告)日：2023-03-09
申请号：US18054711
申请日：2022-11-11
Inventor： Haotian PENG , Ruizhi CHEN , Chen ZHAO
IPC: G06T11/60 , G06F40/186 , G06F40/20 , G06N20/00
Abstract: The present disclosure provides a method for training an image editing model, a method for editing an image, apparatuses, a device, a storage medium and a computer program. An implementation plan is: acquiring a training sample set; and performing training steps as follows: selecting a description text sample and an image sample from the training sample set; determining a text direction vector based on the selected description text sample and a predetermined text template; inputting the text direction vector into a mapping network of the image editing model to obtain a bias vector; determining an image direction vector based on the selected image sample and the bias vector; calculating a loss value based on the text direction vector and the image direction vector; and determining, in response to the loss value meeting a threshold condition, that training of the image editing model is completed.
-
4.发明申请公开(公告)号：US20220414959A1
公开(公告)日：2022-12-29
申请号：US17939301
申请日：2022-09-07
Inventor： Haotian PENG , Chen ZHAO
IPC: G06T11/60 , G06V10/774 , G06V10/82 , G06V10/776
Abstract: A method and apparatus for training a virtual image generating model, a method and apparatus for generating a virtual image, a device, a storage medium, and a computer program product are provided. The method for training a virtual image generating model includes: training a first initial model using a standard image sample set and a random vector sample set as first of sample data, to obtain an image generating model; training a second initial model using a test latent vector sample set and a test image sample set as second sample data, to obtain an image encoding model; training a third initial model using a standard image sample set and a descriptive text sample set as third sample data, to obtain an image editing model; and training a fourth initial model using the third sample data based on the above models, to obtain the virtual image generating model.
-
5.发明申请公开(公告)号：US20230120253A1
公开(公告)日：2023-04-20
申请号：US18082997
申请日：2022-12-16
Inventor： Jie Li , Haojie LIU , Yan ZHANG , Xuecen SHEN , Ruizhi CHEN , Chen ZHAO , Yuqiao TENG , Errui DING , Tian WU , Haifeng WANG
Abstract: A method and apparatus for generating a virtual character, an electronic device and a computer readable storage medium are provided. The method includes: performing mesh simplification on an initial model of a virtual character to obtain a mesh-simplified model; obtaining a first target model by performing white model mapping rendering on an area of each material type on the mesh-simplified model, and obtaining a second target model by performing hyper-realistic rendering on the area of each material type on the mesh-simplified model; and establishing a bidirectional mapping between the first target model and the second target model, and obtaining a target virtual character through iterative updating of the bidirectional mapping.
-
Patent Agency Ranking
公开(公告)号：US20220375456A1
公开(公告)日：2022-11-24
申请号：US17855438
申请日：2022-06-30
Inventor： Shaoxiong YANG , Chen ZHAO
Abstract: A method for animation synthesis includes: obtaining an audio stream to be processed and a syllable sequence, wherein both the audio stream and the syllable sequence correspond to the same text and each syllable in the syllable sequence is pinyin of each character of the text; obtaining a phoneme information sequence of the audio stream by performing phoneme detection on the audio stream, wherein each piece of phoneme information in the phoneme information sequence comprises a phoneme category and a pronunciation time period; determining a pronunciation time period corresponding to each syllable in the syllable sequence based on the syllable sequence, phoneme categories and pronunciation time periods in the phoneme information sequence; and generating an animation video corresponding to the audio stream based on the pronunciation time period corresponding to each syllable in the syllable sequence and an animation frame sequence corresponding to each syllable.
-
公开(公告)号：US20230419610A1
公开(公告)日：2023-12-28
申请号：US18185359
申请日：2023-03-16
Inventor： Xing LIU , Ruizhi CHEN , Yan ZHANG , Chen ZHAO , Hao SUN , Jingtuo LIU , Errui DING , Tian WU , Haifeng WANG
CPC classification number: G06T17/20 , G06T5/50 , G06V10/26 , G06V10/60 , G06T2207/10028 , G06T2207/20221
Abstract: An image rendering method includes the steps below. A model of an environmental object is rendered to obtain an image of the environmental object in a target perspective. An image of a target object in the target perspective and a model of the target object are determined according to a neural radiance field of the target object. The image of the target object is fused and rendered into the image of the environmental object according to the model of the target object.
-
公开(公告)号：US20230206578A1
公开(公告)日：2023-06-29
申请号：US18181371
申请日：2023-03-09
CPC classification number: G06T19/20 , G06T17/20 , G06T2219/2012
Abstract: A method for generating a virtual character is provided, relating to a field of artificial intelligence technology, and in particular, to fields of computer vision, virtual/augmented reality and meta universe technologies. The implementation includes: converting a plurality of points of an initial three-dimensional virtual character into a frequency domain, so as to obtain a plurality of frequency domain points; rendering the plurality of frequency domain points, so as to generate a first three-dimensional virtual character; determining a perceptual feature of the first three-dimensional virtual character; and generating a second three-dimensional virtual character according to a difference between the perceptual feature and a predetermined style feature. An electronic device and a storage medium are also provided.
-
公开(公告)号：US20220157036A1
公开(公告)日：2022-05-19
申请号：US17646117
申请日：2021-12-27
Inventor： Ruizhi CHEN , Yingchao LI , Chen ZHAO
Abstract: The present disclosure discloses a method for generating a virtual image, an electronic device, and a storage medium, relating to a field of virtual reality, in particular to fields of artificial intelligence, Internet of Things, voice technology, cloud computing, etc. An implementation includes: acquiring a language description generated by a user for a target virtual character; extracting a respective semantic feature based on the language description; and generating the target virtual character based on the semantic feature.
-
10.发明申请公开(公告)号：US20210383607A1
公开(公告)日：2021-12-09
申请号：US17196664
申请日：2021-03-09
Inventor： Qingyue MENG , Chen ZHAO
Abstract: The present application discloses a virtual object driving method, an apparatus, an electronic device and a readable storage medium, which relate to technical fields of artificial intelligence and deep learning. A specific implementing solution is as follows: obtaining a target image of a real object acquired by a camera when the real object makes a limb movement; inputting the target image into a coordinate acquisition model to obtain coordinates of a plurality of key points on a limb of the real object; determining a posture of the limb of the real object according to coordinates of each key point; driving, according to the posture of the real object, a virtual object displayed on a screen to present the limb movement of the real object. The method greatly reduces operation complexity and cost consumption when driving a virtual image.
-
-
-
-
-
-
-
-
-
Search Results
10
records
(took 0.027 seconds)
