-
公开(公告)号:US12266172B2
公开(公告)日:2025-04-01
申请号:US18137037
申请日:2023-04-20
Applicant: Microsoft Technology Licensing, LLC
Inventor: Hongli Deng , Joseph Milan Filcik , Hao Yan , Tony Ducheng Jin , Gabriel Blanco Saldana , Ryan Savio Menezes
Abstract: Techniques for inferring whether an event is occurring in 3D space based on 2D image data and for maintaining a camera's calibration are disclosed. An image of an environment is accessed. Input is received, where the input includes a 2D rule imposed against a ground plane. The 2D rule includes conditions indicative of an event. A bounding box is generated and encompasses a detected object. A point within the bounding box is projected from a 2D-space image plane of the image into 3D space to generate a 3D-space point. Based on the 3D-space point, a 3D-space ground contact point is generated. That 3D-space ground contact point is reprojected onto the ground plane of the image to generate a synthesized 2D ground contact point. A location of the synthesized 2D ground contact point is determined to satisfy the conditions.
-
公开(公告)号:US11488325B2
公开(公告)日:2022-11-01
申请号:US16904498
申请日:2020-06-17
Applicant: Microsoft Technology Licensing, LLC
Inventor: Hongli Deng , Ryan Savio Menezes , Gabriel Blanco Saldana , Zicheng Liu
Abstract: Techniques for improved camera calibration are disclosed. An image is analyzed to identify a first set of key points for an object. A virtual object is generated. The virtual object has a second set of key points. A reprojected version of the second set is fitted to the first set in 2D space until a fitting threshold is satisfied. To do so, a 3D alignment of the second set is generated in an attempt to fit (e.g., in 2D space) the second set to the first set. Another operation includes reprojecting the second set into 2D space. In response to comparing the reprojected second set to the first set, another operation includes determining whether a fitting error between those sets satisfies the fitting threshold. A specific 3D alignment of the second set is selected. The camera is calibrated based on resulting reprojection parameters.
-
公开(公告)号:US11663822B2
公开(公告)日:2023-05-30
申请号:US17103264
申请日:2020-11-24
Applicant: Microsoft Technology Licensing, LLC
Inventor: Hongli Deng , Joseph Milan Filcik , Hao Yan , Tony Ducheng Jin , Gabriel Blanco Saldana , Ryan Savio Menezes
CPC classification number: G06V20/40 , G06T7/80 , G06V20/647 , G06V40/10 , G06T2207/10016 , G06T2207/30196 , G06V20/44
Abstract: Techniques for inferring whether an event is occurring in 3D space based on 2D image data and for maintaining a camera's calibration are disclosed. An image of an environment is accessed. Input is received, where the input includes a 2D rule imposed against a ground plane. The 2D rule includes conditions indicative of an event. A bounding box is generated and encompasses a detected object. A point within the bounding box is projected from a 2D-space image plane of the image into 3D space to generate a 3D-space point. Based on the 3D-space point, a 3D-space ground contact point is generated. That 3D-space ground contact point is reprojected onto the ground plane of the image to generate a synthesized 2D ground contact point. A location of the synthesized 2D ground contact point is determined to satisfy the conditions.
-
公开(公告)号:US11776160B2
公开(公告)日:2023-10-03
申请号:US17971894
申请日:2022-10-24
Applicant: Microsoft Technology Licensing, LLC
Inventor: Hongli Deng , Ryan Savio Menezes , Gabriel Blanco Saldana , Zicheng Liu
CPC classification number: G06T7/80 , G06T7/11 , G06T2207/10016 , G06T2207/20081 , G06T2207/30196 , G06T2207/30232 , G06T2207/30248
Abstract: Techniques for improved camera calibration are disclosed. An image is analyzed to identify a first set of key points for an object. A virtual object is generated. The virtual object has a second set of key points. A reprojected version of the second set is fitted to the first set in 2D space until a fitting threshold is satisfied. To do so, a 3D alignment of the second set is generated in an attempt to fit (e.g., in 2D space) the second set to the first set. Another operation includes reprojecting the second set into 2D space. In response to comparing the reprojected second set to the first set, another operation includes determining whether a fitting error between those sets satisfies the fitting threshold. A specific 3D alignment of the second set is selected. The camera is calibrated based on resulting reprojection parameters.
-
公开(公告)号:US12183039B2
公开(公告)日:2024-12-31
申请号:US17717354
申请日:2022-04-11
Applicant: Microsoft Technology Licensing, LLC
Inventor: Hongli Deng , Duong Nguyen , Gabriel Blanco Saldana , Ryan S. Menezes
Abstract: The description relates to cameras, and camera calibration for enhancing user experiences. One example can receive a first image of a user at a first location relative to a camera. The first image can include the user's upper body but does not include the user from head to toe. The example can receive a second image of the user at a second location relative to a camera. The second image can include the user's upper body but does not include the user from head to toe. The example can estimate a distance of the second location from the first location relative to the camera and calibrate a height and tilt angle of the camera from the first image, the second image, and the estimated distance and without a full body image of the user.
-
公开(公告)号:US11341674B2
公开(公告)日:2022-05-24
申请号:US16904507
申请日:2020-06-17
Applicant: Microsoft Technology Licensing, LLC
Inventor: Hongli Deng , Ryan Savio Menezes , Gabriel Blanco Saldana , Zicheng Liu
Abstract: Improved techniques for determining an object's 3D orientation. An image is analyzed to identify a 2D object and a first set of key points. The first set defines a first polygon. A 3D virtual object is generated. This 3D virtual object has a second set of key points defining a second polygon representing an orientation of the 3D virtual object. The second polygon is rotated a selected number of times. For each rotation, each rotated polygon is reprojected into 2D space, and a matching score is determined between each reprojected polygon and the first polygon. A specific reprojected polygon is selected whose corresponding matching score is lowest. The orientation of the 3D virtual object is set to an orientation corresponding to the specific reprojected polygon. Based on the orientation of the 3D virtual object, an area of focus of the 2D object is determined.
-
-
-
-
-