-
公开(公告)号:US11797105B2
公开(公告)日:2023-10-24
申请号:US17954257
申请日:2022-09-27
Applicant: Magic Leap, Inc.
Inventor: Federico Schliemann , Francisco Lopez-Fresquet , Victor Ng-Thow-Hing , Tomislav Pejsa
IPC: G06F3/0346 , G06F3/01 , G06T13/40
CPC classification number: G06F3/0346 , G06F3/012 , G06T13/40
Abstract: Examples of systems and methods for improved hand tracking of a user in a mixed reality environment are disclosed. The systems and methods may be configured to estimate the hand pose and shape of a user's hands for applications such as animating a hand on a user's avatar. Data from multiple sources, such as a totem internal measurement unit (“IMU”), external totem location tracking, vision cameras, and depth sensors, may be manipulated using a set of rules that are based on historical data, ergonomics data, and motion data.
-
公开(公告)号:US11378798B2
公开(公告)日:2022-07-05
申请号:US17352528
申请日:2021-06-21
Applicant: MAGIC LEAP, INC.
Inventor: Victor Ng-Thow-Hing
IPC: G06F3/01 , G06F3/0481 , G06F3/04815 , G06T17/20 , G06V20/20 , G02F1/29 , G02B27/00 , G02B27/01 , H04N13/194 , H04N13/344 , G06F3/03 , H04N13/383 , G06F3/04812 , G02B30/52 , G02B30/26 , H04N13/239 , G06T19/00
Abstract: A method of generating a simulation of a physical object in an image of a physical environment. The method also includes generating a planar polygon mesh from at least the image. The method further includes extracting a boundary polygon of the planar polygon mesh. Moreover, the method includes generating a convex hull for the boundary polygon of the surface mesh. In addition, the method includes generating a minimal area oriented boundary polygon from the convex hull. The method may also include generating a maximal area oriented internal polygon (MAOBP) inside of the boundary polygon of the planar polygon mesh. The MAOBP is utilized to generate a 3-D surface model of the physical object, and the 3-D surface model is used to generate a simulation involving an interaction with the 3-D surface model of the physical object.
-
公开(公告)号:US20220137724A1
公开(公告)日:2022-05-05
申请号:US17522739
申请日:2021-11-09
Applicant: Magic Leap, Inc.
Inventor: Federico Schliemann , Francisco Lopez-Fresquet , Victor Ng-Thow-Hing , Tomislav Pejsa
IPC: G06F3/0346 , G06F3/01 , G06T13/40
Abstract: Examples of systems and methods for improved hand tracking of a user in a mixed reality environment are disclosed. The systems and methods may be configured to estimate the hand pose and shape of a user's hands for applications such as animating a hand on a user's avatar. Data from multiple sources, such as a totem internal measurement unit (“IMU”), external totem location tracking, vision cameras, and depth sensors, may be manipulated using a set of rules that are based on historical data, ergonomics data, and motion data.
-
公开(公告)号:US20190188895A1
公开(公告)日:2019-06-20
申请号:US16208119
申请日:2018-12-03
Applicant: Magic Leap, Inc.
Inventor: Thomas Marshall Miller, IV , Josh Anon , Frank Alexander Hamilton, IV , Cole Parker Heiner , Victor Ng-Thow-Hing , Rodrigo Cano , Karen Stolzenberg , Lorena Pazmino , Gregory Minh Tran , Stephane Antoine Joseph Imbert , Anthony Marinello
CPC classification number: G06T13/40 , G06F3/013 , G06F3/017 , G06F17/18 , G06K9/00335 , G06T19/006
Abstract: Examples of systems and methods for rendering an avatar in a mixed reality environment are disclosed. The systems and methods may be configured to automatically scale an avatar or to render an avatar based on a determined intention of a user, an interesting impulse, environmental stimuli, or user saccade points. The disclosed systems and methods may apply discomfort curves when rendering an avatar. The disclosed systems and methods may provide a more realistic interaction between a human user and an avatar.
-
公开(公告)号:US11699255B2
公开(公告)日:2023-07-11
申请号:US17833508
申请日:2022-06-06
Applicant: Magic Leap, Inc.
Inventor: Thomas Marshall Miller, IV , Josh Anon , Frank Alexander Hamilton, IV , Cole Parker Heiner , Victor Ng-Thow-Hing , Rodrigo Cano , Karen Stolzenberg , Lorena Pazmino , Gregory Minh Tran , Stephane Antoine Joseph Imbert , Anthony Marinello
CPC classification number: G06T13/40 , G06F3/011 , G06F3/012 , G06F3/013 , G06F3/017 , G06F3/0304 , G06F17/18 , G06T19/006 , G06V40/20 , H04N7/157
Abstract: Examples of systems and methods for rendering an avatar in a mixed reality environment are disclosed. The systems and methods may be configured to automatically scale an avatar or to render an avatar based on a determined intention of a user, an interesting impulse, environmental stimuli, or user saccade points. The disclosed systems and methods may apply discomfort curves when rendering an avatar. The disclosed systems and methods may provide a more realistic interaction between a human user and an avatar.
-
公开(公告)号:US20220366626A1
公开(公告)日:2022-11-17
申请号:US17833508
申请日:2022-06-06
Applicant: Magic Leap, Inc.
Inventor: Thomas Marshall Miller, IV , Josh Anon , Frank Alexander Hamilton, IV , Cole Parker Heiner , Victor Ng-Thow-Hing , Rodrigo Cano , Karen Stolzenberg , Lorena Pazmino , Gregory Minh Tran , Stephane Antoine Joseph Imbert , Anthony Marinello
Abstract: Examples of systems and methods for rendering an avatar in a mixed reality environment are disclosed. The systems and methods may be configured to automatically scale an avatar or to render an avatar based on a determined intention of a user, an interesting impulse, environmental stimuli, or user saccade points. The disclosed systems and methods may apply discomfort curves when rendering an avatar. The disclosed systems and methods may provide a more realistic interaction between a human user and an avatar.
-
公开(公告)号:US11073690B2
公开(公告)日:2021-07-27
申请号:US16777280
申请日:2020-01-30
Applicant: MAGIC LEAP, INC.
Inventor: Victor Ng-Thow-Hing
IPC: G06K9/00 , G06T17/20 , G02B27/00 , G06F3/01 , G06T19/00 , G02B27/01 , H04N13/194 , G06F3/0481 , H04N13/344 , G06F3/03 , H04N13/383 , G02B30/26 , G02B30/52 , H04N13/239 , G02F1/29
Abstract: A method of generating a surface model of a physical environment includes obtaining an image of the physical environment. The method also includes generating a planar polygon mesh from at least the image. The method further includes extracting a boundary polygon of the planar polygon mesh. Moreover, the method includes generating a convex hull for the boundary polygon of the surface mesh. In addition, the method includes generating a minimal area oriented boundary polygon from the convex hull. The method may also include generating a maximal area oriented internal polygon inside of the boundary polygon of the planar polygon mesh.
-
公开(公告)号:US10585278B2
公开(公告)日:2020-03-10
申请号:US15725801
申请日:2017-10-05
Applicant: MAGIC LEAP, INC.
Inventor: Victor Ng-Thow-Hing
IPC: G02B27/00 , G02B27/22 , G06F3/01 , G06K9/00 , G06T19/00 , G02B27/01 , H04N13/194 , G06F3/0481 , H04N13/344 , G06F3/03 , H04N13/383 , G06T17/20 , H04N13/239 , G02F1/29
Abstract: A method of generating a surface model of a physical environment includes obtaining an image of the physical environment. The method also includes generating a planar polygon mesh from at least the image. The method further includes extracting a boundary polygon of the planar polygon mesh. Moreover, the method includes generating a convex hull for the boundary polygon of the surface mesh. In addition, the method includes generating a minimal area oriented boundary polygon from the convex hull. The method may also include generating a maximal area oriented internal polygon inside of the boundary polygon of the planar polygon mesh.
-
9.
公开(公告)号:US20230177785A1
公开(公告)日:2023-06-08
申请号:US18161307
申请日:2023-01-30
Applicant: Magic Leap, Inc.
Inventor: Tomislav Pejsa , Dushan Vasilevski , Victor Ng-Thow-Hing , Koichi Mori
CPC classification number: G06T19/006 , G06T13/40 , G06N5/04 , G06F21/6245 , G02B27/0093 , G02B27/017 , G06F21/31 , G06F3/011
Abstract: Wearable systems for privacy preserving expression generation for augmented or virtual reality client applications. An example method includes receiving, by an expression manager configured to communicate expression information to client applications, a request from a client application for access to the expression information. The expression information reflects information derived from one or more sensors of the wearable system, with the client application being configured to present virtual content including an avatar rendered based on the expression information. A user interface is output for presentation which requests user authorization for the client application to access the expression information. In response to receiving user input indicating user authorization, enabling access to the expression information is enabled. The client application obtains periodic updates to the expression information, and the avatar is rendered based on the periodic updates.
-
公开(公告)号:US11373376B2
公开(公告)日:2022-06-28
申请号:US17142210
申请日:2021-01-05
Applicant: MAGIC LEAP, INC.
Inventor: Denys Bastov , Victor Ng-Thow-Hing , Benjamin Zaaron Reinhardt , Leonid Zolotarev , Yannick Pellet , Aleksei Marchenko , Brian Everett Meaney , Marc Coleman Shelton , Megan Ann Geiman , John A. Gotcher , Matthew Schon Bogue , Shivakumar Balasubramanyam , Jeffrey Edward Ruediger , David Charles Lundmark
IPC: G06T19/00 , G06T19/20 , G06F3/01 , G06F3/04815 , H04N21/254 , H04N21/431 , H04N21/81
Abstract: Systems and methods for matching content elements to surfaces in a spatially organized 3D environment. The method includes receiving content, identifying one or more elements in the content, determining one or more surfaces, matching the one or more elements to the one or more surfaces, and displaying the one or more elements as virtual content onto the one or more surfaces.
-
-
-
-
-
-
-
-
-