-
公开(公告)号:US11270492B2
公开(公告)日:2022-03-08
申请号:US16452231
申请日:2019-06-25
Applicant: Arm Limited , Apical Limited
Inventor: Daren Croxford , Roberto Lopez Mendez
Abstract: A method of operating a graphics processing system that generates “spacewarped” frames for display is disclosed. Primitive motion vectors are used to determine the motion of objects appearing in rendered application frames. The so-determined motion is then used to generate “spacewarped” versions of the rendered application frames.
-
公开(公告)号:US11164386B2
公开(公告)日:2021-11-02
申请号:US16829964
申请日:2020-03-25
Applicant: Arm Limited
Inventor: Roberto Lopez Mendez , Daren Croxford
IPC: G06T19/00 , A63F13/211 , A63F13/26
Abstract: A computing device 2, such as a general-purpose smartphone or general-purpose tablet computing device, comprises one or more inertial sensors and an image sensor. The device 2 produces stereoscopic images of a virtual environment on the display during a virtual reality (VR) session controlled by a user of the computing device. The device conducts visual odometry using at least image data received from the image sensor, and selectively activates and deactivates the visual odometry according to activity of the user during the virtual reality session. When the visual odometry is activated, the device controls the virtual reality session by at least position information from the visual odometry. When the visual odometry is deactivated, the device controls the virtual reality session by at least orientation information from the one or more inertial sensors.
-
公开(公告)号:US11087562B2
公开(公告)日:2021-08-10
申请号:US16576532
申请日:2019-09-19
Applicant: Apical Limited , Arm Limited
Inventor: Daren Croxford , Roberto Lopez Mendez
Abstract: A method of data processing for an augmented reality system. The method comprises obtaining augmented reality data output by an augmented reality application operating at a second trust level. The augmented reality data is for modifying a representation of a real-world environment for a user of the augmented reality system. The method also comprises obtaining object recognition data determined by an object recognition system operating at a first trust level. The object recognition data comprises an indication of an object belonging to a predetermined class of objects being present in the real-world environment. The method also comprises triggering modification of the augmented reality data in response to the object recognition data, based on prioritization of the first trust level over the second trust level.
-
公开(公告)号:US20170069129A1
公开(公告)日:2017-03-09
申请号:US15247272
申请日:2016-08-25
Applicant: ARM Limited
Inventor: Roberto Lopez Mendez , Sylwester Krzysztof Bala
CPC classification number: G06T15/04 , G06T15/08 , G06T2210/12
Abstract: In a graphics processing system, a bounding volume 20 representing the volume of a scene to be rendered and a cube texture 30 representing the transparency of the surface of the bounding volume are defined. Then, when the scene is to be rendered for output, a colour to be used to represent a first sampling point 25 as seen from a viewpoint position 24 for the scene is determined by determining, for each of plural second sampling points 27 along a vector 26 from the first sampling point 25 to the viewpoint position 24, a transparency parameter indicative of the amount of light that falls on the second sampling point 27, and then using the determined transparency parameter values for each of the plural second sampling points 27 to determine the colour. Each transparency parameter is determined by determining a vector 29 to be used to sample a graphics texture 30 that represents the transparency of the surface of the bounding volume 20 in the scene, and then using the determined vector 29 to sample the graphics texture 30 to determine the transparency parameter value for the light source 22 for the second sampling point 27.
Abstract translation: 在图形处理系统中,定义表示要呈现的场景的体积的界限体积20和表示边界体积的表面的透明度的立方体纹理30。 然后,当要渲染场景用于输出时,通过针对沿着矢量的多个第二采样点27中的每一个确定用于表示从场景的视点位置24看到的第一采样点25的颜色 26,从第一采样点25到视点位置24,指示落在第二采样点27上的光量的透明度参数,然后使用所确定的多个第二采样点27中的透明度参数值来确定 颜色。 每个透明度参数通过确定用于对表示场景中的界限体积20的表面的透明度的图形纹理30进行采样的矢量29来确定,然后使用确定的矢量29对图形纹理30进行采样以确定 用于第二采样点27的光源22的透明度参数值。
-
公开(公告)号:US11948255B2
公开(公告)日:2024-04-02
申请号:US17650972
申请日:2022-02-14
Applicant: Arm Limited
Inventor: Daren Croxford , Roberto Lopez Mendez
IPC: G06T19/00 , G06F3/01 , G06T3/4046 , G06V10/764
CPC classification number: G06T19/006 , G06F3/013 , G06T3/4046 , G06V10/764 , G06T2207/10016
Abstract: An image processing system for an extended reality, XR, device comprising an eye-tracking subsystem, for determining a focus region of the eye, and a processor. The processor is configured to process application data to render image content for an application for display on the XR device, and obtain metadata indicating that a virtual object is to be generated as a hologram as part of the image content for display. Based on a determination that the virtual object belongs to a predetermined class of objects and is to be displayed in the focus region, the processor performs, using a neural network corresponding to the predetermined class of objects, foveated processing of the image content, including at least part of the hologram, such that relatively high-quality image content is generated for display in the focus region and relatively low-quality image content is generated for display outside the focus region.
-
公开(公告)号:US20240033175A1
公开(公告)日:2024-02-01
申请号:US18357472
申请日:2023-07-24
Applicant: Arm Limited
Inventor: Daren Croxford , Roberto Lopez Mendez
CPC classification number: A61H23/0245 , G06F3/011 , G06T7/20 , H04R1/1041 , H04R3/12 , H04R1/403 , G06T2207/10016 , G06T2200/24 , H04R2499/15 , A61H2201/1604 , A61H2201/5043 , A61H2230/625 , A61H23/0236 , A61H2201/165
Abstract: A method to operate a head-mountable processing system, is provided. The head-mountable processing system comprising generating one or more control signals based upon a visual motion of a sequence of images for display by the head-mountable processing system, and transmitting the generated one or more control signals to a plurality of transducers to stimulate a wearer's vestibular system.
-
公开(公告)号:US20230316694A1
公开(公告)日:2023-10-05
申请号:US17713119
申请日:2022-04-04
Applicant: Arm Limited
Inventor: Daren Croxford , Roberto Lopez Mendez , Mina Ivanova Dimova
CPC classification number: G06V10/25 , G06N3/0454 , G06V10/82 , G06V10/87
Abstract: When processing regions of interest in frames in a data processing system that can execute a plurality of neural networks that are each configured to more optimally process a region of interest of a respective size, a region of interest is first identified within a frame, the size of the region of interest is determined, and one of the plurality of available neural networks is selected to use to process the region of interest based on the determined size. The region of interest is scaled to produce a scaled version of the region of interest, where the scaling is determined based on the selected neural network. The scaled version of the region of interest is then processed using the selected neural network.
-
公开(公告)号:US11652878B2
公开(公告)日:2023-05-16
申请号:US17106932
申请日:2020-11-30
Applicant: Arm Limited , Apical Limited
Inventor: Roberto Lopez Mendez , Daren Croxford , Laura Johanna Lähteenmäki
IPC: G06F15/177 , H04L67/1074 , G06T1/60 , G06T7/70 , H04L67/568
CPC classification number: H04L67/1074 , G06T1/60 , G06T7/70 , H04L67/568
Abstract: An extended-reality system is described which determines extended-reality data to be obtained from the remote network-connected storage based on a location of the extended-reality system. The extended-reality system determines a communication method by which to obtain the extended-reality data, wherein the extended-reality data may be obtained by one or more requests to the remote network-connected storage or by one or more requests to a local device outside of the extended-reality system. A request is sent to at least one of the local device via a peer-to-peer network and the remote network-connected storage in dependence upon the determination by the extended-reality system.
-
公开(公告)号:US11647076B2
公开(公告)日:2023-05-09
申请号:US17164101
申请日:2021-02-01
Applicant: Arm Limited
Inventor: Daren Croxford , Roberto Lopez Mendez , Samuel Marc Town
IPC: H04L67/1074 , G06T19/00 , H04L67/1061 , H04L67/1087 , H04L67/52
CPC classification number: H04L67/1078 , G06T19/006 , H04L67/1063 , H04L67/1089 , H04L67/52 , H04N2201/3245
Abstract: When providing augmented reality display to users in an environment, two or more electronic devices operable to analyse the environment for augmented reality display purposes that are near to each other share data and/or processing relating to the analysis of the environment for augmented reality display purposes, with each device then using the data it receives from the other device when providing an augmented reality display to a user.
-
公开(公告)号:US20230115678A1
公开(公告)日:2023-04-13
申请号:US17484490
申请日:2021-09-24
Applicant: Arm Limited
Inventor: Roberto Lopez Mendez , Daren Croxford
Abstract: There is provided a display apparatus to focus light for a user. The apparatus comprises a tuneable lens having controllable optical properties, an eye-tracker device to determine a position at which the user is looking, and circuitry to control the optical properties of the tuneable lens to bring an object at the depth of the position into focus for the user. A method of focusing light is also provided. The method comprises determining a position at which the user is looking and controlling optical properties of a tuneable lens to bring an object at the depth of the position into focus for the user.
-
-
-
-
-
-
-
-
-