公开(公告)号：US20220230396A1

公开(公告)日：2022-07-21

申请号：US17150566

申请日：2021-01-15

Applicant: Arm Limited

Inventor： Daren CROXFORD ,  Roberto LOPEZ MENDEZ

IPC: G06T19/00 ,  G02B27/01

Abstract: An AR system includes one or more image sensors arranged to capture image data representing a scene located within a field of view of the one or more image sensors, a display arranged to enable a user of the AR system to observe a representation or view of the scene, and an augmentation engine. The augmentation engine is arranged to process the captured image data to determine one or more visual characteristics for the captured image data and to determine, in dependence on the determined one or more visual characteristics, one or more properties for an image element to be presented on the display. The augmentation engine is arranged to present the image element, with the determined one or more properties, on the display to overlay the representation or view of the scene.

公开(公告)号：US20220174111A1

公开(公告)日：2022-06-02

申请号：US17106932

申请日：2020-11-30

Applicant: Arm Limited ,  Apical Limited

Inventor： Roberto LOPEZ MENDEZ ,  Daren CROXFORD ,  Laura Johanna LÄHTEENMÄKI

IPC: H04L29/08 ,  G06T7/70 ,  G06T1/60

Abstract: An extended-reality system is described which determines extended-reality data to be obtained from the remote network-connected storage based on a location of the extended-reality system. The extended-reality system determines a communication method by which to obtain the extended-reality data, wherein the extended-reality data may be obtained by one or more requests to the remote network-connected storage or by one or more requests to a local device outside of the extended-reality system. A request is sent to at least one of the local device via a peer-to-peer network and the remote network-connected storage in dependence upon the determination by the extended-reality system.

公开(公告)号：US20210390777A1

公开(公告)日：2021-12-16

申请号：US16897596

申请日：2020-06-10

Applicant: Arm Limited

Inventor： Roberto LOPEZ MENDEZ ,  Daren CROXFORD ,  Ioan-Cristian SZABO ,  Mina Ivanova DIMOVA

IPC: G06T19/00 ,  G06T17/00 ,  G06T7/10 ,  G06K9/00

Abstract: An AR system is provided, the AR system including one or more sensors, storage, one or more communications modules, and one or more processors. The one or more sensors generate sensed data representing at least part of an environment in which the AR system is located. The one or more communications modules transmit localization data to be used in determining the location and orientation of the AR system. The one or more processors are arranged to obtain sensed data representing an environment in which the AR system is located, process the sensed data to identify a first portion of the sensed data which represents redundant information, derive localization data, wherein the localization data is derived from the sensed data and the first portion is obscured during the derivation of the localization data, and transmit at least a portion of the localization data using the one or more communication modules.

公开(公告)号：US20210304514A1

公开(公告)日：2021-09-30

申请号：US16831363

申请日：2020-03-26

Applicant: Arm Limited

Inventor： Daren CROXFORD ,  Roberto LOPEZ MENDEZ

IPC: G06T19/20 ,  G06T19/00 ,  G06N20/00 ,  G06N7/00

Abstract: Examples of the present disclosure relate to methods for performing image processing. In one such example, a model of an environment is stored. Image data representative of a captured observation of the environment is obtained and the image data is processed using an object classifier to determine whether one or more objects belonging to a plurality of predetermined classes of objects is present in the environment. The stored model is updated based on the processing. In response to determining at least one of the one or more objects is present, object class characteristic data indicative of a characteristic of the at least one object that is determined to be present is retrieved and a probability of change associated with the at least one object is determined on the basis of the object class characteristic data. The updating of the stored model is adjusted based on the determined probability of change.

公开(公告)号：US20200226840A1

公开(公告)日：2020-07-16

申请号：US16829964

申请日：2020-03-25

Applicant: Arm Limited

Inventor： Roberto LOPEZ MENDEZ ,  Daren CROXFORD

IPC: G06T19/00 ,  A63F13/26 ,  A63F13/211

Abstract: A computing device 2, such as a general-purpose smartphone or general-purpose tablet computing device, comprises one or more inertial sensors and an image sensor. The device 2 produces stereoscopic images of a virtual environment on the display during a virtual reality (VR) session controlled by a user of the computing device. The device conducts visual odometry using at least image data received from the image sensor, and selectively activates and deactivates the visual odometry according to activity of the user during the virtual reality session. When the visual odometry is activated, the device controls the virtual reality session by at least position information from the visual odometry. When the visual odometry is deactivated, the device controls the virtual reality session by at least orientation information from the one or more inertial sensors.

公开(公告)号：US20210272533A1

公开(公告)日：2021-09-02

申请号：US16805407

申请日：2020-02-28

Applicant: Arm Limited

Inventor： Daren CROXFORD ,  Roberto LOPEZ MENDEZ

IPC: G09G5/37 ,  G06F3/01

Abstract: A user-mountable extended reality (XR) device capable of receiving and storing at least one of a plurality of user vision capability profiles. The user-mountable XR device comprises a data processing system configured to process input data representative of an input image to perform a modification of the input image based on performing a selection of a given profile of the at least one of the plurality of user vision capability profiles, thereby generating output data representative of an output image for display by the user-mountable XR device. Also described is a method of controlling such a device.

公开(公告)号：US20200342291A1

公开(公告)日：2020-10-29

申请号：US16392366

申请日：2019-04-23

Applicant: Apical Limited ,  Arm Limited

Inventor： Daren CROXFORD ,  Roberto LOPEZ MENDEZ

IPC: G06N3/04 ,  G06T7/50 ,  G06F9/50

Abstract: A method of processing sensor-originated data using a computing device. The sensor-originated data is representative of one or more physical quantities measured by one or more sensors. The method comprises selecting between a plurality of neural networks, including a first neural network and a second neural network, on the basis of at least one current operative condition of the computing device. Each of the first and second neural networks is configured to generate output data of the same type. The first neural network is configured to receive a first set of input data types and the second neural network is configured to receive a second set of input data types, the second set including at least one data type not included in the first set. The method comprises processing the sensor-originated data using at least the selected neural network.

公开(公告)号：US20200342285A1

公开(公告)日：2020-10-29

申请号：US16392391

申请日：2019-04-23

Applicant: Apical Limited ,  Arm Limited

Inventor： Daren CROXFORD ,  Roberto LOPEZ MENDEZ

IPC: G06N3/04

Abstract: A neural network system executable on a processor. The neural network system, when executed on the processor, comprises a merged layer shareable between a first neural network and a second neural network. The merged layer is configured to receive input data from a prior layer of at least one of the first and second neural networks. The merged layer is configured to apply a superset of weights to the input data to generate intermediate feature data representative of at least one feature of the input data, the superset of weights being combined from a first set of weights associated with the first neural network and a second set of weights associated with the second neural network. The merged layer is also configured to output the intermediate feature data to at least one subsequent layer, the at least one subsequent layer serving the first and second neural networks.

公开(公告)号：US20200034617A1

公开(公告)日：2020-01-30

申请号：US16044153

申请日：2018-07-24

Applicant: Apical Ltd ,  Arm Limited

Inventor： Daren CROXFORD ,  Roberto LOPEZ MENDEZ

IPC: G06K9/00 ,  G06T7/70 ,  G06N3/04 ,  G01C21/32

Abstract: Examples of the present disclosure relate to methods for performing object detection. In one such example, data representing an image is received. The image comprises at least one target region and a further region. The at least one target region is identifiable using data indicative of a gaze direction of a viewer of the image. A first portion of the data is processed using a first processing scheme to perform object detection in the at least one target region of the image. The first portion of the data represents the at least one target region of the image. A second portion of the data is processed using a second, different, processing scheme. The second portion of the data represents the further region of the image.

公开(公告)号：US20220244543A1

公开(公告)日：2022-08-04

申请号：US17649754

申请日：2022-02-02

Applicant: Arm Limited

Inventor： Daren CROXFORD ,  Roberto LOPEZ MENDEZ

IPC: G02B27/01 ,  G06F3/01

Abstract: A method of controlling an imaging system for a Head Mounted Display (HMD) device. The method comprises capturing an external scene, for example using a camera, determining an attenuation pattern, for rendering a filter area. The method also comprises determining, based on the captured external scene, a compensation pattern to for compensating at least part of the filter area, attenuating the external scene using the attenuation pattern and generating a holographic image of a virtual object, the holographic image including the compensation pattern.