COMPLEX RENDERING USING TILE BUFFERS
    1.
    发明公开

    公开(公告)号:US20240037835A1

    公开(公告)日:2024-02-01

    申请号:US18362439

    申请日:2023-07-31

    Applicant: ARM Limited

    CPC classification number: G06T15/005 G06T1/60

    Abstract: There is provided an apparatus configured to operate as a shader core, the shader core configured to perform a complex rendering process comprising a rendering process and a machine learning process, the shader core comprising: one or more tile buffers configured to store data locally to the shader core, wherein during the rendering process, the one or more tile buffers are configured to store rendered fragment data relating to a tile; and during the machine learning process, the one or more tile buffers are configured to store an input feature map, kernel weights or an output feature map relating to the machine learning process.

    AUGMENTED REALITY SYSTEM
    2.
    发明申请

    公开(公告)号:US20210390777A1

    公开(公告)日:2021-12-16

    申请号:US16897596

    申请日:2020-06-10

    Applicant: Arm Limited

    Abstract: An AR system is provided, the AR system including one or more sensors, storage, one or more communications modules, and one or more processors. The one or more sensors generate sensed data representing at least part of an environment in which the AR system is located. The one or more communications modules transmit localization data to be used in determining the location and orientation of the AR system. The one or more processors are arranged to obtain sensed data representing an environment in which the AR system is located, process the sensed data to identify a first portion of the sensed data which represents redundant information, derive localization data, wherein the localization data is derived from the sensed data and the first portion is obscured during the derivation of the localization data, and transmit at least a portion of the localization data using the one or more communication modules.

    IMAGE PROCESSING FOR UPDATING A MODEL OF AN ENVIRONMENT

    公开(公告)号:US20210304514A1

    公开(公告)日:2021-09-30

    申请号:US16831363

    申请日:2020-03-26

    Applicant: Arm Limited

    Abstract: Examples of the present disclosure relate to methods for performing image processing. In one such example, a model of an environment is stored. Image data representative of a captured observation of the environment is obtained and the image data is processed using an object classifier to determine whether one or more objects belonging to a plurality of predetermined classes of objects is present in the environment. The stored model is updated based on the processing. In response to determining at least one of the one or more objects is present, object class characteristic data indicative of a characteristic of the at least one object that is determined to be present is retrieved and a probability of change associated with the at least one object is determined on the basis of the object class characteristic data. The updating of the stored model is adjusted based on the determined probability of change.

    MOTION SENSING
    4.
    发明申请
    MOTION SENSING 审中-公开

    公开(公告)号:US20200226840A1

    公开(公告)日:2020-07-16

    申请号:US16829964

    申请日:2020-03-25

    Applicant: Arm Limited

    Abstract: A computing device 2, such as a general-purpose smartphone or general-purpose tablet computing device, comprises one or more inertial sensors and an image sensor. The device 2 produces stereoscopic images of a virtual environment on the display during a virtual reality (VR) session controlled by a user of the computing device. The device conducts visual odometry using at least image data received from the image sensor, and selectively activates and deactivates the visual odometry according to activity of the user during the virtual reality session. When the visual odometry is activated, the device controls the virtual reality session by at least position information from the visual odometry. When the visual odometry is deactivated, the device controls the virtual reality session by at least orientation information from the one or more inertial sensors.

    GRAPHICS TILE COMPOSITING CONTROL
    5.
    发明申请
    GRAPHICS TILE COMPOSITING CONTROL 有权
    图形层组成控制

    公开(公告)号:US20150049118A1

    公开(公告)日:2015-02-19

    申请号:US14309487

    申请日:2014-06-19

    Applicant: ARM Limited

    CPC classification number: G06T11/60 G06T11/40 G06T15/005

    Abstract: A graphics processing apparatus (2) performs tile based compositing operations. Tile metadata includes flag data (tfd), such as transparency and/or intensity flag data, indicating whether a given input graphics tile make less than a predetermined first threshold level of contribution or more than a second predetermined threshold level of contribution to a corresponding output graphics tile. For example, if an input graphics tile is transparent, then its reading from a memory (6) and/or subsequent processing may be suppressed. If a given input graphics tile is opaque, then any underlying input graphics tiles were are obscured may have their reading and/or further processing suppressed.

    Abstract translation: 图形处理装置(2)执行基于瓦片的合成操作。 平铺元数据包括诸如透明度和/或强度标志数据的标志数据(tfd),其指示给定的输入图形图块是否小于预定的第一阈值贡献水平,或者大于对相应输出的第二预定阈值水平 图形瓦片。 例如,如果输入图形瓦片是透明的,则可以抑制其从存储器(6)的读取和/或后续处理。 如果给定的输入图形瓦片是不透明的,那么任何底层的输入图形瓦片被遮蔽可能会使其阅读和/或进一步的处理受到抑制。

    ADAPTIVE FRAME BUFFER COMPRESSION
    6.
    发明申请
    ADAPTIVE FRAME BUFFER COMPRESSION 有权
    自适应帧缓冲器压缩

    公开(公告)号:US20130314429A1

    公开(公告)日:2013-11-28

    申请号:US13898510

    申请日:2013-05-21

    Applicant: ARM LIMITED

    Abstract: Image data is subject to compression and decompression when it is respectively written to and read from a frame buffer. If a portion of the image data is identified as static (subject to less than a threshold amount of change for greater than a threshold time), then compression control parameters used for compression of that portion of the image are adjusted so as to increase the compression ratio achieved, hold the degree of lossiness substantially constant and increase the energy consumed while compressing that portion. The increased energy consumption during this high compression ratio compression is likely compensated for by a reduction in energy subsequently consumed when writing that frame-buffer image data to the frame buffer and reading that frame-buffer image data multiple times from the frame buffer. The compression characteristics varied may be to increase the block size used in the compression. Other variations in compression applied may be to change from single-pass compression to multi-pass compression, switch compression on and off altogether, or reorder the data when it has been compressed so as to match the order it will be read and so achieve support for longer read burst.

    Abstract translation: 当图像数据被分别写入帧缓冲器并从帧缓冲器读取时,其被压缩和解压缩。 如果图像数据的一部分被识别为静态(经受小于阈值的变化量大于阈值时间),则调整用于压缩该部分图像的压缩控制参数,以便增加压缩 比率达到,保持损耗程度基本上恒定,并增加在压缩该部分时消耗的能量。 在该高压缩比压缩期间增加的能量消耗可能通过将帧缓冲器图像数据写入帧缓冲器并从帧缓冲器多次读取该帧缓冲器图像数据而随后消耗的能量的减少来补偿。 压缩特性变化可能是增加在压缩中使用的块尺寸。 压缩应用的其他变化可能是从单程压缩转换为多遍压缩,完全切换压缩,或者在压缩数据时重新排序数据,以便匹配读取的顺序,从而实现支持 更长的读取脉冲串。

    FOVEATION FOR A HOLOGRAPHIC IMAGING SYSTEM

    公开(公告)号:US20220262079A1

    公开(公告)日:2022-08-18

    申请号:US17650972

    申请日:2022-02-14

    Applicant: Arm Limited

    Abstract: An image processing system for an extended reality, XR, device comprising an eye-tracking subsystem, for determining a focus region of the eye, and a processor. The processor is configured to process application data to render image content for an application for display on the XR device, and obtain metadata indicating that a virtual object is to be generated as a hologram as part of the image content for display. Based on a determination that the virtual object belongs to a predetermined class of objects and is to be displayed in the focus region, the processor performs, using a neural network corresponding to the predetermined class of objects, foveated processing of the image content, including at least part of the hologram, such that relatively high-quality image content is generated for display in the focus region and relatively low-quality image content is generated for display outside the focus region.

    HEAD-MOUNTED DISPLAY
    8.
    发明申请

    公开(公告)号:US20210382306A1

    公开(公告)日:2021-12-09

    申请号:US16896853

    申请日:2020-06-09

    Applicant: Arm Limited

    Abstract: A head-mounted display (HMD) comprising a first side for facing a user of the HMD, a second side opposite to the first side, and a reflective layer for at least partially reflecting incident light incident on the second side. At least one processor of the HMD is configured to obtain luminance data indicative of a luminance of the incident light and control a display device, based on the luminance data, to control a luminance of a portion of emitted light directed towards the user of the HMD during the display of the image. Further examples relate to an HMD with a display device configured to emit light of at least one predetermined wavelength range during display of an image by the display device, and a layer arranged to at least partially prevent transmission of the light of the at least one predetermined wavelength range outward from the HMD.

    DEVICES AND HEADSETS
    10.
    发明申请

    公开(公告)号:US20210295464A1

    公开(公告)日:2021-09-23

    申请号:US16824040

    申请日:2020-03-19

    Applicant: Arm Limited

    Abstract: A device has a content processing component operable in first and second content processing states, a display, at least one sensor operable to output sensor data indicative of at least one eye positional characteristic of a user, and a processor. The processor is configured to process the data, and in the first processing state, determine a region of the display corresponding to a foveal region of an eye of a user, and perform foveated processing of content to be displayed on the display such that a relatively high-quality video content is generated for display in the region and a relatively low-quality video content is generated for display outside the region. The second processing state is entered in response to a trigger. In the second processing state, the foveated processing used is overridden such that relatively low-quality video content is generated for display in at least a portion of the region.

Patent Agency Ranking