-
公开(公告)号:US11798190B2
公开(公告)日:2023-10-24
申请号:US17543515
申请日:2021-12-06
发明人: Xiangkai Lin , Liang Qiao , Fengming Zhu , Yu Zuo , Zeyu Yang , Yonggen Ling , Linchao Bao
CPC分类号: G06T7/73 , G06V20/20 , G06V40/11 , G06V40/12 , G06T2207/30204
摘要: Embodiments of this application disclose a method for displaying a virtual character in a plurality of real-world images captured by a camera is performed at an electronic device. The method includes: capturing an initial real-world image using the camera; simulating a display of the virtual character in the initial real-world image; capturing a subsequent real-world image using the camera after a movement of the camera; determining position and pose updates of the camera associated with the movement of the camera from tracking one or more feature points in the initial real-world image and the subsequent real-world image; and adjusting the display of the virtual character in the subsequent real-world image in accordance with the position and pose updates of the camera associated with the movement of the camera.
-
2.
公开(公告)号:US11481923B2
公开(公告)日:2022-10-25
申请号:US16915825
申请日:2020-06-29
发明人: Xiangkai Lin , Yonggen Ling , Linchao Bao , Wei Liu
IPC分类号: G06T7/73 , G06F16/901 , G06F17/16
摘要: This application discloses a repositioning method and apparatus in a camera pose tracking process, a device, and a storage medium, belonging to the field of augmented reality (AR). The method includes: obtaining a current image acquired after an ith anchor image in a plurality of anchor images; obtaining an initial feature point and an initial pose parameter in the first anchor image in the plurality of anchor images in a case that the current image satisfies a repositioning condition; performing feature point tracking on the current image relative to the first anchor image, to obtain a plurality of matching feature point pairs; filtering the plurality of matching feature point pairs according to a constraint condition, to obtain a filtered matching feature point pair; calculating a pose change amount of a camera from the initial pose parameter to a target pose parameter according to the filtered matching feature point pair; and performing repositioning according to the initial pose parameter and the pose change amount to obtain the target pose parameter of the camera.
-
3.
公开(公告)号:US11189037B2
公开(公告)日:2021-11-30
申请号:US16900634
申请日:2020-06-12
发明人: Xiangkai Lin , Yonggen Ling , Linchao Bao , Wei Liu
摘要: This application discloses a repositioning method performed by an electronic device in a camera pose tracking process, belonging to the field of augmented reality (AR). The method includes: obtaining a current image acquired by the camera after an ith anchor image in a plurality of anchor images; selecting a target keyframe from a keyframe database according to Hash index information in a case that the current image satisfies a repositioning condition; performing second repositioning on the current image relative to the target keyframe; and calculating a camera pose parameter of a camera during acquisition of the current image according to a positioning result of the first repositioning and a positioning result of the second repositioning. In a case that there are different keyframes covering a surrounding area of a camera acquisition scene, it is highly probable that repositioning can succeed, thereby improving the success probability of a repositioning process.
-
公开(公告)号:US11961325B2
公开(公告)日:2024-04-16
申请号:US17184571
申请日:2021-02-24
发明人: Xiangkai Lin , Linchao Bao , Yonggen Ling , Yibing Song , Wei Liu
CPC分类号: G06V40/16 , G06F18/253 , G06T7/0002 , G06T7/75 , G06T11/001 , G06T11/60 , G06V40/161
摘要: An image processing method and apparatus, a computer-readable medium, and an electronic device are provided. The image processing method includes: respectively projecting, according to a plurality of view angle parameters corresponding to a plurality of view angles, a face model of a target object onto a plurality of face images of the target object acquired from the plurality of view angles, to determine correspondences between regions on the face model and regions on the face image; respectively extracting, based on the correspondences and a target region in the face model that need to generate a texture image, images corresponding to the target region from the plurality of face images; and fusing the images that correspond to the target region and that are respectively extracted from the plurality of face images, to generate the texture image.
-
公开(公告)号:US11373384B2
公开(公告)日:2022-06-28
申请号:US17187219
申请日:2021-02-26
发明人: Mu Hu , Sirui Gao , Yonggen Ling , Yitong Wang , Linchao Bao , Wei Liu
摘要: This application provides a method for configuring parameters of a three-dimensional face model. The method includes: obtaining a reference face image; identifying a key facial point on the reference face image to obtain key point coordinates as reference coordinates; and determining a recommended parameter set in a face parameter value space according to the reference coordinates. The first projected coordinates are projected coordinates of the key facial point obtained by projecting a three-dimensional face model corresponding to the recommended parameter set onto a coordinate system. The proximity of the first projected coordinates to the reference coordinates meets a preset condition.
-
公开(公告)号:US11270460B2
公开(公告)日:2022-03-08
申请号:US16940148
申请日:2020-07-27
发明人: Liang Qiao , Xiangkai Lin , Linchao Bao , Yonggen Ling , Fengming Zhu
摘要: A method for determining a pose of an image capturing device is performed at an electronic device. The electronic device acquires a plurality of image frames captured by the image capturing device, extracts a plurality of matching feature points from the plurality of image frames and determines first position information of each of the matching feature points in each of the plurality of image frames. After estimating second position information of each of the matching feature points in a current image frame in the plurality of image frames by using the first position information of each of the matching feature points extracted from a previous image frame in the plurality of image frames, the electronic device determines a pose of the image capturing device based on the first position information and the second position information of each of the matching feature points in the current image frame.
-
公开(公告)号:US11158083B2
公开(公告)日:2021-10-26
申请号:US16917069
申请日:2020-06-30
发明人: Xiangkai Lin , Liang Qiao , Fengming Zhu , Yu Zuo , Zeyu Yang , Yonggen Ling , Linchao Bao
摘要: Embodiments of this application disclose a position and attitude determining method. The method includes acquiring, by tracking a feature point of a first marked image, position and attitude parameters of an image captured by a camera; using a previous image of a first image as a second marked image in response to the previous image of the first image meeting a feature point tracking condition and the first image failing to meet the feature point tracking condition; acquiring, position and attitude parameters of the image captured by the camera relative to the second marked image; acquiring position and attitude parameters according to the position and attitude parameters of the image relative to the second marked image and position and attitude parameters of each marked image relative to a previous marked image; and determining a position and an attitude of the camera according to the position and attitude parameters.
-
公开(公告)号:US12100192B2
公开(公告)日:2024-09-24
申请号:US17374810
申请日:2021-07-13
发明人: Dongdong Bai , Yonggen Ling , Wei Liu
IPC分类号: G06V10/44 , G06F18/214 , G06N3/08 , G06V10/77 , G06V10/774 , G06V10/82
CPC分类号: G06V10/454 , G06F18/2148 , G06N3/08 , G06V10/7715 , G06V10/7747 , G06V10/82
摘要: A computer device extracts local features of sample images based on a first part of a convolutional neural network (CNN) model. The sample images comprise a plurality of images taken at the same place. The device; aggregates the local features into feature vectors having a first dimensionality based on a second part of the CNN model. The device obtains compressed representation vectors of the feature vectors based on a third part of the CNN model. The compressed representation vectors have a second dimensionality less than the first dimensionality. The device trains the CNN model, and obtains a trained CNN mode satisfying a preset condition in accordance with the training.
-
公开(公告)号:US12087069B2
公开(公告)日:2024-09-10
申请号:US17516585
申请日:2021-11-01
发明人: Wanchao Chi , Chong Zhang , Yonggen Ling , Wei Liu , Zhengyou Zhang , Zejian Yuan , Ziyang Song , Ziyi Yin
IPC分类号: G06K9/00 , G06N3/045 , G06V30/242 , G06V40/20
CPC分类号: G06V30/242 , G06N3/045 , G06V40/20
摘要: An artificial intelligence-based action recognition method includes: determining, according to video data comprising an interactive object, node sequence information corresponding to video frames in the video data, the node sequence information of each video frame including position information of nodes in a node sequence, the nodes in the node sequence being nodes of the interactive object that are moved to implement a corresponding interactive action; determining action categories corresponding to the video frames in the video data, including: determining, according to the node sequence information corresponding to N consecutive video frames in the video data, action categories respectively corresponding to the N consecutive video frames; and determining, according to the action categories corresponding to the video frames in the video data, a target interactive action made by the interactive object in the video data.
-
公开(公告)号:US11978219B2
公开(公告)日:2024-05-07
申请号:US17323740
申请日:2021-05-18
发明人: Yonggen Ling , Shenghao Zhang
IPC分类号: G06T7/246
CPC分类号: G06T7/246 , G06T2207/10016
摘要: A method for determining motion information is provided to be executed by a computing device. The method includes: determining a first image and a second image, the first image and the second image each including an object; determining a first pixel region based on a target feature point on the object in the first image; determining a second pixel region according to a pixel difference among a plurality of first pixel points in the first pixel region and further according to the target feature point; and obtaining motion information of the target feature point according to the plurality of second pixel points and the second image, the motion information being used for indicating changes in locations of the target feature point in the first image and the second image.
-
-
-
-
-
-
-
-
-