公开(公告)号：US20230222830A1

公开(公告)日：2023-07-13

申请号：US17573186

申请日：2022-01-11

Applicant: Arm Limited

Inventor： Roberto Lopez Mendez ,  Daren Croxford ,  Peter James Samuel Ferguson ,  Judicael Sean Eugene Clair ,  Koki Mitsunami ,  Benjamin Charles Clark ,  Mina Ivanova Dimova ,  Pavel Rudko

IPC: G06V40/10 ,  G06V10/82 ,  G06T7/73 ,  G06T7/50

CPC classification number: G06V40/10 ,  G06T7/50 ,  G06T7/75 ,  G06V10/82 ,  G06T2207/10024 ,  G06T2207/10028 ,  G06T2207/20081 ,  G06T2207/20084

Abstract: Systems, apparatuses, devices and methods for body pose tracking are provided that are simple, inexpensive, flexible, accurate and robust. One body pose tracking system includes a mobile device, such as a smartphone, and active or passive marker bands. Images and depth information captured by the smartphone may be analyzed using an Inverse Kinematic (IK) model, and, in certain cases, the IK model solution may be augmented by machine learning. Other body pose tracking systems include an augmented-reality/virtual-reality (AR/VR) head-mounted-display (HMD) and/or AR/VR glasses rather than a smartphone. An AR/VR HMD device may include a depth sensor and multiple environment-facing cameras.

公开(公告)号：US11699064B2

公开(公告)日：2023-07-11

申请号：US16392391

申请日：2019-04-23

Applicant: Apical Limited ,  Arm Limited

Inventor： Daren Croxford ,  Roberto Lopez Mendez

IPC: G06N3/04

CPC classification number: G06N3/04

Abstract: A neural network system executable on a processor. The neural network system, when executed on the processor, comprises a merged layer shareable between a first neural network and a second neural network. The merged layer is configured to receive input data from a prior layer of at least one of the first and second neural networks. The merged layer is configured to apply a superset of weights to the input data to generate intermediate feature data representative of at least one feature of the input data, the superset of weights being combined from a first set of weights associated with the first neural network and a second set of weights associated with the second neural network. The merged layer is also configured to output the intermediate feature data to at least one subsequent layer, the at least one subsequent layer serving the first and second neural networks.

公开(公告)号：US11682368B1

公开(公告)日：2023-06-20

申请号：US17848565

申请日：2022-06-24

Applicant: Arm Limited

Inventor： Roberto Lopez Mendez ,  Daren Croxford

IPC: G09G5/391 ,  G06F3/01 ,  G06T7/593 ,  G06F1/3212 ,  G06T7/521

CPC classification number: G09G5/391 ,  G06F1/3212 ,  G06F3/013 ,  G06T7/521 ,  G06T7/593 ,  G09G2360/144

Abstract: A method of operating a mobile device, the method comprising: identifying a first image parameter for an image to be displayed on a display of the mobile device; determining a distance between the display of the mobile device and a user of the mobile device; modifying the first image parameter dependent upon the distance between the display of the mobile device and the user of the mobile device; and displaying an image on the display using the modified first image parameter.

公开(公告)号：US11500204B2

公开(公告)日：2022-11-15

申请号：US16896853

申请日：2020-06-09

Applicant: Arm Limited

Inventor： Daren Croxford ,  Roberto Lopez Mendez ,  Erik Persson ,  Sean Tristram Leguay Ellis

IPC: G02B27/01

Abstract: A head-mounted display (HMD) comprising a first side for facing a user of the HMD, a second side opposite to the first side, and a reflective layer for at least partially reflecting incident light incident on the second side. At least one processor of the HMD is configured to obtain luminance data indicative of a luminance of the incident light and control a display device, based on the luminance data, to control a luminance of a portion of emitted light directed towards the user of the HMD during the display of the image. Further examples relate to an HMD with a display device configured to emit light of at least one predetermined wavelength range during display of an image by the display device, and a layer arranged to at least partially prevent transmission of the light of the at least one predetermined wavelength range outward from the HMD.

公开(公告)号：US11138812B1

公开(公告)日：2021-10-05

申请号：US16831363

申请日：2020-03-26

Applicant: Arm Limited

Inventor： Daren Croxford ,  Roberto Lopez Mendez

IPC: G06T19/20 ,  G06T19/00 ,  G06N7/00 ,  G06N20/00

Abstract: Examples of the present disclosure relate to methods for performing image processing. In one such example, a model of an environment is stored. Image data representative of a captured observation of the environment is obtained and the image data is processed using an object classifier to determine whether one or more objects belonging to a plurality of predetermined classes of objects is present in the environment. The stored model is updated based on the processing. In response to determining at least one of the one or more objects is present, object class characteristic data indicative of a characteristic of the at least one object that is determined to be present is retrieved and a probability of change associated with the at least one object is determined on the basis of the object class characteristic data. The updating of the stored model is adjusted based on the determined probability of change.

公开(公告)号：US10282895B2

公开(公告)日：2019-05-07

申请号：US15325700

申请日：2015-07-16

Applicant: ARM Limited

Inventor： Sylwester Krzysztof Bala ,  Roberto Lopez Mendez

IPC: G06T15/60 ,  G06T15/04

Abstract: In a graphics processing system, a bounding volume (20) representing the volume of a scene to be rendered and a cube texture (30) representing the transparency of the surface of the bounding volume are defined. Then, when the scene is to be rendered for output, a vector (28) from a sampling point (25) being considered to a light source (22) external of the bounding volume is determined and then used to determine how to sample the texture that represents the transparency of the surface of the bounding volume to determine the transparency of the surface of the bounding volume between the sampling point and the light source. The so-determined transparency is then used to simulate the effect of shadows cast by the external light source (22) at the sampling point (25).

公开(公告)号：US20170161917A1

公开(公告)日：2017-06-08

申请号：US15325700

申请日：2015-07-16

Applicant: ARM Limited

Inventor： Sylwester Krzysztof Bala ,  Roberto Lopez Mendez

IPC: G06T15/50

CPC classification number: G06T15/60 ,  G06T15/04 ,  G06T2210/12 ,  G06T2215/12

Abstract: In a graphics processing system, a bounding volume (20) representing the volume of a scene to be rendered and a cube texture (30) representing the transparency of the surface of the bounding volume are defined. Then, when the scene is to be rendered for output, a vector (28) from a sampling point (25) being considered to a light source (22) external of the bounding volume is determined and then used to determine how to sample the texture that represents the transparency of the surface of the bounding volume to determine the transparency of the surface of the bounding volume between the sampling point and the light source. The so-determined transparency is then used to simulate the effect of shadows cast by the external light source (22) at the sampling point (25).