公开(公告)号：US20200050488A1

公开(公告)日：2020-02-13

申请号：US16658989

申请日：2019-10-21

Applicant: Google LLC

Inventor： Hyunchul Park ,  Albert Meixner

IPC: G06F9/50 ,  G06T1/60 ,  G06F9/48 ,  G06T1/20

Abstract: A method is described. The method includes constructing an image processing software data flow in which a buffer stores and forwards image data being transferred from a producing kernel to one or more consuming kernels. The method also includes recognizing that the buffer has insufficient resources to store and forward the image data. The method also includes modifying the image processing software data flow to include multiple buffers that store and forward the image data during the transfer of the image data from the producing kernel to the one or more consuming kernels.

公开(公告)号：US20200020069A1

公开(公告)日：2020-01-16

申请号：US16529633

申请日：2019-08-01

Applicant: Google LLC

Inventor： Albert Meixner ,  Hyunchul Park ,  William R. Mark ,  Daniel Frederic Finchelstein ,  Ofer Shacham

IPC: G06T1/20 ,  G06F8/41 ,  G06F9/50

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for restructuring an image processing pipeline. The method includes compiling program code targeted for an image processor having programmable stencil processors composed of respective two-dimensional execution lane and shift register circuit structures. The program code is to implement a directed acyclic graph and is composed of multiple kernels that are to execute on respective ones of the stencil processors, wherein the compiling includes performing any of: horizontal fusion of kernels; vertical fusion of kernels; fission of one of the kernels into multiple kernels; spatial partitioning of a kernel into multiple spatially partitioned kernels; or splitting the directed acyclic graph into smaller graphs.

公开(公告)号：US10467056B2

公开(公告)日：2019-11-05

申请号：US15594529

申请日：2017-05-12

Applicant: Google LLC

Inventor： Hyunchul Park ,  Albert Meixner

IPC: G06F9/50 ,  G06T1/20

Abstract: A method is described. The method includes calculating data transfer metrics for kernel-to-kernel connections of a program having a plurality of kernels that is to execute on an image processor. The image processor includes a plurality of processing cores and a network connecting the plurality of processing cores. Each of the kernel-to-kernel connections include a producing kernel that is to execute on one of the processing cores and a consuming kernel that is to execute on another one of the processing cores. The consuming kernel is to operate on data generated by the producing kernel. The method also includes assigning kernels of the plurality of kernels to respective ones of the processing cores based on the calculated data transfer metrics.

公开(公告)号：US10685423B2

公开(公告)日：2020-06-16

申请号：US16585834

申请日：2019-09-27

Applicant: Google LLC

Inventor： Hyunchul Park ,  Albert Meixner ,  Qiuling Zhu ,  William Mark

IPC: G06T1/60 ,  G06T1/20 ,  G09G5/36 ,  G06F3/06 ,  G06F9/50 ,  G06F30/20 ,  G06F30/33 ,  G06F12/084 ,  G06F12/0842 ,  G06F117/08

Abstract: A method is described. The method includes simulating execution of an image processing application software program. The simulating includes intercepting kernel-to-kernel communications with simulated line buffer memories that store and forward lines of image data communicated from models of producing kernels to models of consuming kernels. The simulating further includes tracking respective amounts of image data stored in the respective line buffer memories over a simulation runtime. The method also includes determining respective hardware memory allocations for corresponding hardware line buffer memories from the tracked respective amounts of image data. The method also includes generating configuration information for an image processor to execute the image processing application software program. The configuration information describes the hardware memory allocations for the hardware line buffer memories of the image processor.

公开(公告)号：US10430919B2

公开(公告)日：2019-10-01

申请号：US15594512

申请日：2017-05-12

Applicant: Google LLC

Inventor： Hyunchul Park ,  Albert Meixner ,  Qiuling Zhu ,  William Mark

IPC: G06F17/50 ,  G06T1/60 ,  G06T1/20 ,  G06F3/06 ,  G09G5/36 ,  G06F9/50 ,  G06F12/084 ,  G06F12/0842

Abstract: A method is described. The method includes simulating execution of an image processing application software program. The simulating includes intercepting kernel-to-kernel communications with simulated line buffer memories that store and forward lines of image data communicated from models of producing kernels to models of consuming kernels. The simulating further includes tracking respective amounts of image data stored in the respective line buffer memories over a simulation runtime. The method also includes determining respective hardware memory allocations for corresponding hardware line buffer memories from the tracked respective amounts of image data. The method also includes generating configuration information for an image processor to execute the image processing application software program. The configuration information describes the hardware memory allocations for the hardware line buffer memories of the image processor.