-
公开(公告)号:US12045362B2
公开(公告)日:2024-07-23
申请号:US17889956
申请日:2022-08-17
Applicant: ATI TECHNOLOGIES ULC , ADVANCED MICRO DEVICES, INC.
Inventor: Benjamin Koon Pan Chan , William Lloyd Atkinson , Tung Chuen Kwong , Guhan Krishnan
CPC classification number: G06F21/6218 , G06V10/955
Abstract: A computer vision processor in an image cluster defines a fenced memory region (FMR) that controls access to image data stored in a first portion of a trusted memory region (TMR). The computer vision processor receives FMR requests from an application implemented in a processing cluster. The FMR requests are to access the image data in the first portion of the TMR. The computer vision processor selectively allows the requesting application to access the image data. In some cases, the computer vision processor acquires the image data and stores the image data in the first portion of the TMR, such as buffers in the TMR. A data fabric selectively permits the image processing application to access the data stored in the TMR based on whether the image cluster has opened or closed the FMR for the portion of the TMR.
-
公开(公告)号:US11954792B2
公开(公告)日:2024-04-09
申请号:US17408034
申请日:2021-08-20
Applicant: ATI Technologies ULC
Inventor: Benjamin Koon Pan Chan , William Lloyd Atkinson , Clarence Ip , Tung Chuen Kwong
CPC classification number: G06T15/205 , G06F15/7814 , G06T1/20 , G09G5/14 , G09G2320/0261
Abstract: Systems, apparatuses, and methods for performing real-time video rendering with performance guaranteed power management are disclosed. A system includes at least a software driver, a power management unit, and a plurality of processing elements for performing rendering tasks. The system receives inputs which correspond to rendering tasks which need to be performed. The software driver monitors the inputs that are received and the number of rendering tasks to which they correspond. The software driver also monitors the amount of time remaining until the next video synchronization signal. The software driver determines which performance setting will minimize power consumption while still allowing enough time to finish the rendering tasks for the current frame before the next video synchronization signal. Then, the software driver causes the power management unit to provide this performance setting to the plurality of processing elements as they perform the rendering tasks for the current frame.
-
公开(公告)号:US11443051B2
公开(公告)日:2022-09-13
申请号:US16228349
申请日:2018-12-20
Applicant: ATI TECHNOLOGIES ULC , ADVANCED MICRO DEVICES, INC.
Inventor: Benjamin Koon Pan Chan , William Lloyd Atkinson , Tung Chuen Kwong , Guhan Krishnan
Abstract: A computer vision processor in an image cluster defines a fenced memory region (FMR) that controls access to image data stored in a first portion of a trusted memory region (TMR). The computer vision processor receives FMR requests from an application implemented in a processing cluster. The FMR requests are to access the image data in the first portion of the TMR. The computer vision processor selectively allows the requesting application to access the image data. In some cases, the computer vision processor acquires the image data and stores the image data in the first portion of the TMR, such as buffers in the TMR. A data fabric selectively permits the image processing application to access the data stored in the TMR based on whether the image cluster has opened or closed the FMR for the portion of the TMR.
-
公开(公告)号:US11210199B2
公开(公告)日:2021-12-28
申请号:US16427941
申请日:2019-05-31
Applicant: ATI Technologies ULC
Inventor: Tung Chuen Kwong , Benjamin Koon Pan Chan , Clarence Ip , Meghana Manjunatha
Abstract: Systems, apparatuses, and methods for implementing a safety monitor framework for a safety-critical computer vision (CV) application are disclosed. A system includes a safety-critical CV application, a safety monitor, and a CV accelerator engine. The safety monitor receives an input image, test data, and a CV graph from the safety-critical CV application. The safety monitor generates a modified image by adding additional objects outside of the input image. The safety monitor provides the modified image and CV graph to the CV accelerator which processes the modified image and provides outputs to the safety monitor. The safety monitor determines the likelihood of erroneous processing of the original input image by comparing the outputs for the additional objects with a known good result. The safety monitor complements the overall fault coverage of the CV accelerator engine and covers faults only observable at the level of the CV graph.
-
公开(公告)号:US20210383596A1
公开(公告)日:2021-12-09
申请号:US17408034
申请日:2021-08-20
Applicant: ATI Technologies ULC
Inventor: Benjamin Koon Pan Chan , William Lloyd Atkinson , Clarence Ip , Tung Chuen Kwong
Abstract: Systems, apparatuses, and methods for performing real-time video rendering with performance guaranteed power management are disclosed. A system includes at least a software driver, a power management unit, and a plurality of processing elements for performing rendering tasks. The system receives inputs which correspond to rendering tasks which need to be performed. The software driver monitors the inputs that are received and the number of rendering tasks to which they correspond. The software driver also monitors the amount of time remaining until the next video synchronization signal. The software driver determines which performance setting will minimize power consumption while still allowing enough time to finish the rendering tasks for the current frame before the next video synchronization signal. Then, the software driver causes the power management unit to provide this performance setting to the plurality of processing elements as they perform the rendering tasks for the current frame.
-
公开(公告)号:US20200379877A1
公开(公告)日:2020-12-03
申请号:US16427941
申请日:2019-05-31
Applicant: ATI Technologies ULC
Inventor: Tung Chuen Kwong , Benjamin Koon Pan Chan , Clarence Ip , Meghana Manjunatha
Abstract: Systems, apparatuses, and methods for implementing a safety monitor framework for a safety-critical computer vision (CV) application are disclosed. A system includes a safety-critical CV application, a safety monitor, and a CV accelerator engine. The safety monitor receives an input image, test data, and a CV graph from the safety-critical CV application. The safety monitor generates a modified image by adding additional objects outside of the input image. The safety monitor provides the modified image and CV graph to the CV accelerator which processes the modified image and provides outputs to the safety monitor. The safety monitor determines the likelihood of erroneous processing of the original input image by comparing the outputs for the additional objects with a known good result. The safety monitor complements the overall fault coverage of the CV accelerator engine and covers faults only observable at the level of the CV graph.
-
公开(公告)号:US12045675B2
公开(公告)日:2024-07-23
申请号:US16457237
申请日:2019-06-28
Applicant: ATI Technologies ULC
Inventor: Tung Chuen Kwong , Clarence Ip , Benjamin Koon Pan Chan , Edward Lee Kim-Koon , Meghana Manjunatha
CPC classification number: G06F9/545 , G06F9/30036 , G06F9/3877 , G06F9/5072 , G06F9/541 , G06F11/3672
Abstract: Systems, apparatuses, and methods for implementing a safety monitor framework for a safety-critical graphics processing unit (GPU) compute application are disclosed. A system includes a safety-critical GPU compute application, a safety monitor, and a GPU. The safety monitor receives a compute grid, test vectors, and a compute kernel from the safety-critical GPU compute application. The safety monitor generates a modified compute grid by adding extra tiles to the original compute grid, with the extra tiles generated based on the test vectors. The safety monitor provides the modified compute grid and compute kernel to the GPU for processing. The safety monitor determines the likelihood of erroneous processing of the original compute grid by comparing the actual results for the extra tiles with known good results. The safety monitor complements the overall fault coverage of the GPU hardware and covers faults only observable at the application programming interface (API) level.
-
公开(公告)号:US11960410B2
公开(公告)日:2024-04-16
申请号:US17105331
申请日:2020-11-25
Applicant: ATI Technologies ULC
Inventor: Tung Chuen Kwong , Benjamin Koon Pan Chan , William Lloyd Atkinson
IPC: G06F12/1009 , G06F9/54 , G06F12/02
CPC classification number: G06F12/1009 , G06F9/544 , G06F9/545 , G06F12/0246
Abstract: Systems, apparatuses, and methods for implementing a unified kernel virtual address space for heterogeneous computing are disclosed. A system includes at least a first subsystem running a first kernel, an input/output memory management unit (IOMMU), and a second subsystem running a second kernel. In order to share a memory buffer between the two subsystems, the first subsystem allocates a block of memory in part of the system memory controlled by the first subsystem. A first mapping is created from a first logical address of the kernel address space of the first subsystem to the block of memory. Then, the IOMMU creates a second mapping to map the physical address of that block of memory from a second logical address of the kernel address space of the second subsystem. These mappings allow the first and second subsystems to share buffer pointers which reference the block of memory.
-
公开(公告)号:US20220207783A1
公开(公告)日:2022-06-30
申请号:US17138817
申请日:2020-12-30
Applicant: Advanced Micro Devices, Inc. , ATI Technologies ULC
Inventor: Tung Chuen Kwong , David Porpino Sobreira Marques , King Chiu Tam , Shilpa Rajagopalan , Benjamin Koon Pan Chan , Vickie Youmin Wu
Abstract: Methods and devices are provided for processing image data on a sub-frame portion basis using layers of a convolutional neural network. The processing device comprises memory and a processor. The processor is configured to receive frames of image data comprising sub-frame portions, schedule a first sub-frame portion of a first frame to be processed by a first layer of the convolutional neural network when the first sub-frame portion is available for processing, process the first sub-frame portion by the first layer and continue the processing of the first sub-frame portion by the first layer when it is determined that there is sufficient image data available for the first layer to continue processing of the first sub-frame portion. Processing on a sub-frame portion basis continues for subsequent layers such that processing by a layer can begin as soon as sufficient data is available for the layer.
-
公开(公告)号:US11100698B2
公开(公告)日:2021-08-24
申请号:US16457179
申请日:2019-06-28
Applicant: ATI Technologies ULC
Inventor: Benjamin Koon Pan Chan , William Lloyd Atkinson , Clarence Ip , Tung Chuen Kwong
Abstract: Systems, apparatuses, and methods for performing real-time video rendering with performance guaranteed power management are disclosed. A system includes at least a software driver, a power management unit, and a plurality of processing elements for performing rendering tasks. The system receives inputs which correspond to rendering tasks which need to be performed. The software driver monitors the inputs that are received and the number of rendering tasks to which they correspond. The software driver also monitors the amount of time remaining until the next video synchronization signal. The software driver determines which performance setting will minimize power consumption while still allowing enough time to finish the rendering tasks for the current frame before the next video synchronization signal. Then, the software driver causes the power management unit to provide this performance setting to the plurality of processing elements as they perform the rendering tasks for the current frame.
-
-
-
-
-
-
-
-
-