-
公开(公告)号：US11809617B2
公开(公告)日：2023-11-07
申请号：US17409022
申请日：2021-08-23
IPC分类号： G06F3/01 , G06F3/0346 , G08B21/02
CPC分类号： G06F3/012 , G06F3/0346 , G08B21/02
摘要： A system includes processing circuitry configured to receive sensor data regarding a user operating a head mounted display (HMD). The processing circuitry is configured to identify a plurality of reference points of a pose of the user based at least on the sensor data. The processing circuitry is configured to apply one or more models to the plurality of reference points to determine a type of the pose of the user. The processing circuitry is configured to select a mode of operation of the HMD responsive to the type of the pose.
-
公开(公告)号：US11461962B1
公开(公告)日：2022-10-04
申请号：US17360758
申请日：2021-06-28
发明人： Albert Parra Pozo , Joseph Virskus , Ganesh Venkatesh , Kai Li , Shen-Chi Chen , Amit Kumar , Rakesh Ranjan , Brian Keith Cabral , Samuel Alan Johnson , Wei Ye , Michael Alexander Snower , Yash Patel
摘要： A holographic calling system can capture and encode holographic data at a sender-side of a holographic calling pipeline and decode and present the holographic data as a 3D representation of a sender at a receiver-side of the holographic calling pipeline. The holographic calling pipeline can include stages to capture audio, color images, and depth images; densify the depth images to have a depth value for each pixel while generating parts masks and a body model; use the masks to segment the images into parts needed for hologram generation; convert depth images into a 3D mesh; paint the 3D mesh with color data; perform torso disocclusion; perform face reconstruction; and perform audio synchronization. In various implementations, different of these stages can be performed sender-side or receiver side. The holographic calling pipeline also includes sender-side compression, transmission over a communication channel, and receiver-side decompression and hologram output.
-
公开(公告)号：US12099327B2
公开(公告)日：2024-09-24
申请号：US17360693
申请日：2021-06-28
发明人： Albert Parra Pozo , Joseph Virskus , Ganesh Venkatesh , Kai Li , Shen-Chi Chen , Amit Kumar , Rakesh Ranjan , Brian Keith Cabral , Samuel Alan Johnson , Wei Ye , Michael Alexander Snower , Yash Patel
IPC分类号： G03H1/00 , G06N20/00 , G06T7/194 , G06T7/521 , G06T7/55 , G06T17/20 , G06T19/00 , G06V40/16 , H04M3/56 , H04N19/597 , G03H1/02
CPC分类号： G03H1/0005 , G06N20/00 , G06T7/194 , G06T7/521 , G06T7/55 , G06T17/20 , G06T19/006 , G06V40/176 , H04M3/567 , H04M3/568 , H04N19/597 , G03H2001/0088 , G03H2001/0204 , H04M2203/359
摘要： A holographic calling system can capture and encode holographic data at a sender-side of a holographic calling pipeline and decode and present the holographic data as a 3D representation of a sender at a receiver-side of the holographic calling pipeline. The holographic calling pipeline can include stages to capture audio, color images, and depth images; densify the depth images to have a depth value for each pixel while generating parts masks and a body model; use the masks to segment the images into parts needed for hologram generation; convert depth images into a 3D mesh; paint the 3D mesh with color data; perform torso disocclusion; perform face reconstruction; and perform audio synchronization. In various implementations, different of these stages can be performed sender-side or receiver side. The holographic calling pipeline also includes sender-side compression, transmission over a communication channel, and receiver-side decompression and hologram output.
-
公开(公告)号：US11747892B2
公开(公告)日：2023-09-05
申请号：US18057561
申请日：2022-11-21
发明人： Benjamin Antoine Georges Lefaudeux , Samuel Alan Johnson , Carsten Sebastian Stoll , Kishore Venkateshan
IPC分类号： G06F3/01 , G06T7/70 , G06N20/00 , G06N5/04 , G06F3/0346
CPC分类号： G06F3/011 , G06N5/04 , G06N20/00 , G06T7/70 , G06F3/0346 , G06T2207/20081 , G06T2207/30196
摘要： A computing system may receive sensor data from one or more sensors coupled to a user. Based on sensor data, the computing system may generate a first upper body pose that corresponds to a first portion of a body of the user, which comprises a head and an arm of the user. The computing system may process the upper body pose of the user to generate a temporal sequence of lower body poses comprising a first lower body pose associated with the first time and a second lower body pose associated with a second time, which may correspond to a second portion of the body of the user comprising a leg of the user. The computing system may generate one or more full body poses of the user based on at least the first upper body pose and the temporal sequence of lower body poses.
-
公开(公告)号：US20230245499A1
公开(公告)日：2023-08-03
申请号：US18296919
申请日：2023-04-06
发明人： Samuel Alan Johnson , Mahdi Salmani Rahimi , Benjamin Antoine Georges Lefaudeux , Kishore Venkateshan
摘要： A computing system may receive an image captured by a camera, and determine based on (1) one or more regions in the image that include a portion of a body of a user, and (2) a camera pose of the camera, a three-dimensional volume constraint that stems from the camera pose in which an elbow of the user is likely to be located. The system may infer, based on at least the three-dimensional volume constraint, an elbow pose of the user, wherein the elbow pose includes a location associated with an elbow of the user in three-dimensional space. The system may determine the location associated with the elbow is outside the three-dimensional volume constraint, and in response to the determination, adjust the inferred elbow pose. The system may generate, based on the adjusted elbow pose, a body pose of the user that includes at least the adjusted elbow pose.
-
公开(公告)号：US12020508B2
公开(公告)日：2024-06-25
申请号：US18296919
申请日：2023-04-06
发明人： Samuel Alan Johnson , Mahdi Salmani Rahimi , Benjamin Antoine Georges Lefaudeux , Kishore Venkateshan
摘要： A computing system may receive an image captured by a camera, and determine based on (1) one or more regions in the image that include a portion of a body of a user, and (2) a camera pose of the camera, a three-dimensional volume constraint that stems from the camera pose in which an elbow of the user is likely to be located. The system may infer, based on at least the three-dimensional volume constraint, an elbow pose of the user, wherein the elbow pose includes a location associated with an elbow of the user in three-dimensional space. The system may determine the location associated with the elbow is outside the three-dimensional volume constraint, and in response to the determination, adjust the inferred elbow pose. The system may generate, based on the adjusted elbow pose, a body pose of the user that includes at least the adjusted elbow pose.
-
公开(公告)号：US11972040B2
公开(公告)日：2024-04-30
申请号：US18153035
申请日：2023-01-11
发明人： Samuel Alan Johnson , Shaik Shabnam Nizamudeen Basha , Mahdi Salmani Rahimi , Benjamin Antoine Georges Lefaudeux
CPC分类号： G06F3/011 , G06T7/60 , G06T19/006 , G06T19/20 , G06T2207/20081 , G06T2219/2016
摘要： A virtual space configuration system of an artificial reality system can detect a user posture and provide various corresponding customizations of the system's virtual space. The virtual space configuration system can, when a user is in a seated posture, provide for seated virtual space customizations. In various implementations, these customizations can include allowing adjustment of a floor height; setting a flag that can be surfaced to applications to adjust the applications' mechanics for seated users; customizing display of virtual space boundaries when in seated mode to be less intrusive; providing options to detect when a user leaves seated mode and trigger corresponding actions; provide a passthrough workspace area allowing a user to interact with certain real-world objects naturally without having to remove a virtual reality headset; or automatically determining virtual space dimensions for seated users.
-
公开(公告)号：US20230400914A1
公开(公告)日：2023-12-14
申请号：US18454698
申请日：2023-08-23
发明人： Benjamin Antoine Georges Lefaudeux , Samuel Alan Johnson , Carsten Sebastian Stoll , Kishore Venkateshan
CPC分类号： G06F3/011 , G06T7/70 , G06N20/00 , G06N5/04 , G06F3/0346
摘要： A computing system may receive sensor data from one or more sensors coupled to a user. Based on sensor data, the computing system may generate an upper body pose that corresponds to a first portion of a body of the user, which comprises a head and an arm of the user. The computing system may determine contextual information associated with the user. The computing system may generate a lower body pose corresponding to a second portion of the body of the user comprising a leg of the user based on the upper body pose and the contextual information. The computing system may generate a full body pose of the user based on the first upper body pose and the lower body pose.
-
公开(公告)号：US11651625B2
公开(公告)日：2023-05-16
申请号：US17024581
申请日：2020-09-17
发明人： Samuel Alan Johnson , Mahdi Salmani Rahimi , Benjamin Antoine Georges Lefaudeux , Kishore Venkateshan
摘要： A computing system may determine a head pose and a wrist pose of a user based on sensor data captured by a head-mounted device. The computing system may further receive an image captured by a camera of the head-mounted device that includes at least portion of the body of the user. Using this image, the computing system may determine one or more regions in the image that correspond to the body of the user, and determine, based on these regions and a camera pose of the camera, a three-dimensional volume constraint in which an elbow of the user is likely to be located when the image was captured. From this information, the computing system may utilize the head pose, the wrist pose, and the three-dimensional volume constraint to infer a body pose of the user that includes at least an inferred elbow pose associated with the user.
-
公开(公告)号：US11609625B2
公开(公告)日：2023-03-21
申请号：US17500383
申请日：2021-10-13
发明人： Samuel Alan Johnson , Shaik Shabnam Nizamudeen Basha , Mahdi Salmani Rahimi , Benjamin Antoine Georges Lefaudeux
摘要： A virtual space configuration system of an artificial reality system can detect a user posture and provide various corresponding customizations of the system's virtual space. The virtual space configuration system can, when a user is in a seated posture, provide for seated virtual space customizations. In various implementations, these customizations can include allowing adjustment of a floor height; setting a flag that can be surfaced to applications to adjust the applications' mechanics for seated users; customizing display of virtual space boundaries when in seated mode to be less intrusive; providing options to detect when a user leaves seated mode and trigger corresponding actions; provide a passthrough workspace area allowing a user to interact with certain real-world objects naturally without having to remove a virtual reality headset; or automatically determining virtual space dimensions for seated users.
-
-
-
-
-
-
-
-
-
搜索结果
13 条记录 (耗时 0.02 秒)
