-
公开(公告)号：US11928771B2
公开(公告)日：2024-03-12
申请号：US17832792
申请日：2022-06-06
发明人： Yi Xu , Shuxue Quan
CPC分类号： G06T15/06 , G06T7/70 , G06T19/006 , H04N23/73 , G06T2207/30244
摘要： An exemplary method of detecting a light source using an electronic device having a camera and a sensor may include: scanning a real environment using the camera to establish an environment map of the real environment; capturing, using the camera, a first image of a real light source from a first location in the real environment and a second image of the real light source from a second location in the real environment; tracking, using the sensor, a first position and a first orientation of the camera in the environment map while the first image is captured, and a second position and a second orientation of the camera in the environment map while the second image is captured; and computing a position of the real light source in the environment map based on the first position, the first orientation, the second position, and the second orientation.
-
公开(公告)号：US11899848B2
公开(公告)日：2024-02-13
申请号：US18087494
申请日：2022-12-22
IPC分类号： G06F3/01 , G06V40/10 , G06F3/0338 , G06V20/20
CPC分类号： G06F3/017 , G06F3/012 , G06F3/0338 , G06V40/11 , G06V20/20
摘要： A method includes: sensing, by a mobile device when the mobile device is tethered to a head-mounted display (HMD) and when the mobile device is held by a first hand, first data; detecting, by the mobile device, information indicating which hand is used to perform a gesture from the first data; sending, by the mobile device, the information to the HMD; receiving, by the HMD, the information, and not detecting, by the HMD, the information by an image-based detection method; wherein the gesture is performed by a second hand and the information is an updated indication with respect to the gesture considering a hand switch state during a first elapsed duration from a sensing time of the first data to a sensing time of the first image data; and performing, by the HMD, side-adapted hand pose estimation on the first image data using the information.
-
公开(公告)号：US20220230383A1
公开(公告)日：2022-07-21
申请号：US17714918
申请日：2022-04-06
发明人： Yuan Tian , Yi Xu , Yuxin Ma , Shuxue Quan
摘要： Techniques for occlusion and collision detection in an AR session are described. In an example, a depth sensor is used to generate a depth image. Distortions in the depth image are reduced or eliminated by at least dividing the depth image into depth layers and moving depth pixels between the layers. An RGBD image is generated from the depth image, as updated, and an RGB image generated at substantially the same time as the depth image. Occlusion of a virtual object is detected based on the RGBD image. Further, a 3D model of the real-world environment is generated from the depth images, as updated, and includes multi-level voxels. Collision with the virtual object is detected based on the multi-level voxels. Rendering of the virtual object in an AR session is based on the occlusion and collision detection.
-
公开(公告)号：US12026835B2
公开(公告)日：2024-07-02
申请号：US17857314
申请日：2022-07-05
CPC分类号： G06T17/20 , G06T15/08 , G06T19/006 , G06T2210/12
摘要： The present disclosure provides a computer-implemented method. The method includes: acquiring 3D volumetric data for representing a real-world scene; acquiring a current set of active 3D volumetric data from the 3D volumetric data in response to an activating action on the 3D volumetric data; updating a plurality of sets of active 3D volumetric data based on the current set of active 3D volumetric data, the plurality of sets of active 3D volumetric data being acquired from the 3D volumetric data; constructing a surface based on the plurality of updated sets of active 3D volumetric data; and simulating a deformation of a part of the real-world scene based on the surface, the part of the real-world scene corresponding to the plurality of updated sets of active 3D volumetric data. In addition, the present disclosure also provides an electronic device, and a storage medium.
-
公开(公告)号：US11928778B2
公开(公告)日：2024-03-12
申请号：US17707681
申请日：2022-03-29
发明人： Zhong Li , Yi Xu , Shuxue Quan
CPC分类号： G06T17/20 , G06T7/11 , G06T19/20 , G06T2207/30201 , G06T2219/2004
摘要： A method for human body model reconstruction and a reconstruction system are disclosed. The method includes acquiring a target image, and acquiring a segmented image by segmenting the target image based on an object to be reconstructed in the target image, the target image being one front image of the object; acquiring an initial estimate shape and a part of texture information of the object respectively, according to the segmented image; determining an initial 3D model of the object through the initial estimate shape, the initial 3D model being a 3D model without texture; acquiring complete texture information of the object according to the part of texture information and a texture generation model; and generating a 3D reconstruction model of the object based on the initial 3D model and the complete texture information, the 3D reconstruction model being a 3D model with texture.
-
公开(公告)号：US12125233B2
公开(公告)日：2024-10-22
申请号：US17723227
申请日：2022-04-18
发明人： Yi Xu
CPC分类号： G06T7/70 , G06T7/97 , G06T19/006 , G06T2207/30204
摘要： Methods and systems are disclosed for mapping the coordinate systems of devices for AR applications. A third device may receive a first pose from a first device associated with a first coordinate system and a second pose from a second device associated with a second coordinate system. The third device may receive an image that includes fiducial markers presented by each of the first device and the second device. The first pose and the portion of the image including the first fiducial marker may define a first set of 3D coordinates. The second pose and the portion of the image including the second fiducial marker may define a second set of 3D coordinates. A coordinate-system transform can be generated from a correspondence between the first set and the second of 3D coordinates. The coordinate-system transform may be transmitted to the first device and/or the second device.
-
公开(公告)号：US20220301256A1
公开(公告)日：2022-09-22
申请号：US17832792
申请日：2022-06-06
发明人： Yi Xu , Shuxue Quan
摘要： An exemplary method of detecting a light source using an electronic device having a camera and a sensor may include: scanning a real environment using the camera to establish an environment map of the real environment; capturing, using the camera, a first image of a real light source from a first location in the real environment and a second image of the real light source from a second location in the real environment; tracking, using the sensor, a first position and a first orientation of the camera in the environment map while the first image is captured, and a second position and a second orientation of the camera in the environment map while the second image is captured; and computing a position of the real light source in the environment map based on the first position, the first orientation, the second position, and the second orientation.
-
公开(公告)号：US20220245851A1
公开(公告)日：2022-08-04
申请号：US17723227
申请日：2022-04-18
发明人： Yi Xu
摘要： Methods and systems are disclosed for mapping the coordinate systems of devices for AR applications. A third device may receive a first pose from a first device associated with a first coordinate system and a second pose from a second device associated with a second coordinate system. The third device may receive an image that includes fiducial markers presented by each of the first device and the second device. The first pose and the portion of the image including the first fiducial marker may define a first set of 3D coordinates. The second pose and the portion of the image including the second fiducial marker may define a second set of 3D coordinates. A coordinate-system transform can be generated from a correspondence between the first set and the second of 3D coordinates. The coordinate-system transform may be transmitted to the first device and/or the second device.
-
公开(公告)号：US11830156B2
公开(公告)日：2023-11-28
申请号：US17728022
申请日：2022-04-25
发明人： Yi Xu , Shuxue Quan
IPC分类号： G06T19/00 , G06T15/06 , H04N13/268 , G06T17/10
CPC分类号： G06T19/006 , G06T15/06 , G06T17/10 , H04N13/268 , G06T2200/04 , G06T2200/08
摘要： Techniques for rendering a 3D virtual object in an augmented-reality system are described. A system, a method, and a non-transitory memory device for augmented reality rendering of three-dimensional, virtual objects are described. In an example, a number of images of an environment are acquired; relative movement of a camera acquiring the number of images is tracked; camera pose is determined relative to the environment using the number of images and tracked relative movement of the camera; depth and normal surfaces of objects in the environment are estimated using a depth map and a normal map; a surface geometry of the environment is reconstructed using the depth map and the normal map; and the virtual object is rendered using the surface geometry of the environment.
-
公开(公告)号：US20230127549A1
公开(公告)日：2023-04-27
申请号：US18087494
申请日：2022-12-22
IPC分类号： G06F3/01 , G06F3/0338 , G06V40/10
摘要： A method includes: sensing, by a mobile device when the mobile device is tethered to a head-mounted display (HMD) and when the mobile device is held by a first hand, first data; detecting, by the mobile device, information indicating which hand is used to perform a gesture from the first data; sending, by the mobile device, the information to the HMD; receiving, by the HMD, the information, and not detecting, by the HMD, the information by an image-based detection method; wherein the gesture is performed by a second hand and the information is an updated indication with respect to the gesture considering a hand switch state during a first elapsed duration from a sensing time of the first data to a sensing time of the first image data; and performing, by the HMD, side-adapted hand pose estimation on the first image data using the information.
-
-
-
-
-
-
-
-
-
搜索结果
10 条记录 (耗时 0.019 秒)
