-
公开(公告)号:US11488935B1
公开(公告)日:2022-11-01
申请号:US17314857
申请日:2021-05-07
Applicant: Applied Materials, Inc.
Inventor: Naveed Zaman , Myron Shak , Tameesh Suri , Bilal Shafi Sheikh
IPC: G11C5/06 , H01L25/065 , G11C11/412 , H01L23/522 , H01L27/11 , H01L23/528
Abstract: A network-on-package (NoPK) for connecting a plurality of chiplets may include a plurality of interface bridges configured to convert a plurality of protocols used by the plurality of chiplets into a common protocol, a routing network configured to route traffic between the plurality of interface bridges using the common protocol, and a controller configured to program the plurality of interface bridges and the routing network based on types of the plurality of chiplets connected to the NoPK. The NoPK may provide a scalable connection for any number of chiplets from different ecosystems using different communication protocols.
-
公开(公告)号:US20240403258A1
公开(公告)日:2024-12-05
申请号:US18328852
申请日:2023-06-05
Applicant: Applied Materials, Inc.
Inventor: Bilal Shafi Sheikh , Tameesh Suri , Nathaniel See , Sutapa Dutta , Yun-Ting Sun , Udaykumar Diliprao Hanmante , Naveed Zaman
Abstract: A chiplet-based architecture may quantize, or reduce, the number of bits at various stages of the data path in an artificial-intelligence processor. This architecture may leverage the synergy between quantizing multiple dimensions together to greatly decrease the memory usage and data path bandwidth. Internal weights may be quantized statically after a training procedure. Accumulator bits and activation bits may be quantized dynamically during an inference operation. New hardware logic may be configured to quantize the outputs of each operation directly from the core or other processing node before the tensor is stored in memory. Quantization may use a statistic from a previous tensor for a current output tensor, while also calculating a statistic to be used on a subsequent output tensor. In addition to quantizing based on a statistic, bits can be further quantized using a Kth percentile clamping operation.
-
公开(公告)号:US12095653B2
公开(公告)日:2024-09-17
申请号:US17348183
申请日:2021-06-15
Applicant: Applied Materials, Inc.
Inventor: Tameesh Suri , Bilal Shafi Sheikh , Myron Shak , Naveed Zaman
IPC: H04L45/00 , G06F18/21 , H04L45/74 , H04L47/122 , H04L47/30
CPC classification number: H04L45/20 , G06F18/217 , H04L45/74 , H04L47/122 , H04L47/30
Abstract: A router may include input buffers that receive a packet being transmitted from a source to a destination, a state generator that determines a state for the packet, and a memory representing weights for actions corresponding to possible states. The memory may be configured to return an action corresponding to the state of the packet, where the action may indicate a next hop in the route between the source and the destination. The router may also include reward logic configured to generate the weights for the plurality of actions in the memory. The reward logic may receive a global reward corresponding to the route between the source and the destination, calculate a local reward corresponding to next hops available to the router; and combine the global reward and the local reward to generate the weights for the plurality of actions in the memory.
-
公开(公告)号:US20220359464A1
公开(公告)日:2022-11-10
申请号:US17314857
申请日:2021-05-07
Applicant: Applied Materials, Inc.
Inventor: Naveed Zaman , Myron Shak , Tameesh Suri , Bilal Shafi Sheikh
IPC: H01L25/065 , G11C5/06 , H01L23/528 , H01L23/522 , H01L27/11 , G11C11/412
Abstract: A network-on-package (NoPK) for connecting a plurality of chiplets may include a plurality of interface bridges configured to convert a plurality of protocols used by the plurality of chiplets into a common protocol, a routing network configured to route traffic between the plurality of interface bridges using the common protocol, and a controller configured to program the plurality of interface bridges and the routing network based on types of the plurality of chiplets connected to the NoPK. The NoPK may provide a scalable connection for any number of chiplets from different ecosystems using different communication protocols.
-
公开(公告)号:US20220400073A1
公开(公告)日:2022-12-15
申请号:US17348183
申请日:2021-06-15
Applicant: Applied Materials, Inc.
Inventor: Tameesh Suri , Bilal Shafi Sheikh , Myron Shak , Naveed Zaman
IPC: H04L12/733 , H04L12/741 , H04L12/803 , H04L12/835 , G06K9/62
Abstract: A router may include input buffers that receive a packet being transmitted from a source to a destination, a state generator that determines a state for the packet, and a memory representing weights for actions corresponding to possible states. The memory may be configured to return an action corresponding to the state of the packet, where the action may indicate a next hop in the route between the source and the destination. The router may also include reward logic configured to generate the weights for the plurality of actions in the memory. The reward logic may receive a global reward corresponding to the route between the source and the destination, calculate a local reward corresponding to next hops available to the router; and combine the global reward and the local reward to generate the weights for the plurality of actions in the memory.
-
公开(公告)号:US20220383121A1
公开(公告)日:2022-12-01
申请号:US17330096
申请日:2021-05-25
Applicant: Applied Materials, Inc.
Inventor: Tameesh Suri , Bor-Chau Juang , Nathaniel See , Bilal Shafi Sheikh , Naveed Zaman , Myron Shak , Sachin Dangayach , Udaykumar Diliprao Hanmante
Abstract: A method of inducing sparsity for outputs of neural network layer may include receiving outputs from a layer of a neural network; partitioning the outputs into a plurality of partitions; identifying first partitions in the plurality of partitions that can be treated as having zero values; generating an encoding that identifies locations of the first partitions among remaining second partitions in the plurality of partitions; and sending the encoding and the second partitions to a subsequent layer in the neural network.
-
-
-
-
-