公开(公告)号：US20160219284A1

公开(公告)日：2016-07-28

申请号：US15089854

申请日：2016-04-04

Applicant: Texas Instruments Incorporated

Inventor： Uday Pudipeddi Kiran ,  Deepak Kumar Poddar ,  Pramod Kumar Swami ,  Arun Shankar Kudana

IPC: H04N19/423 ,  H04N19/44 ,  H04N19/577 ,  H04N19/177

CPC classification number: H04N19/423 ,  H04N19/177 ,  H04N19/44 ,  H04N19/577

Abstract: Several methods and systems for facilitating multimedia data encoding are disclosed. In an embodiment, a plurality of picture buffers associated with multimedia data are received in an order of capture associated with the plurality of picture buffers. Buffer information is configured for each picture buffer from among the plurality of picture buffers comprising at least one of a metadata associated with the corresponding picture buffer and one or more encoding parameters for the corresponding picture buffer. A provision of picture buffers in an order of encoding is facilitated based on the configured buffer information.

Abstract translation: 公开了用于促进多媒体数据编码的几种方法和系统。 在一个实施例中，以与多个图像缓冲器相关联的捕获顺序接收与多媒体数据相关联的多个图像缓冲器。 对于包括与对应的图像缓冲器相关联的元数据中的至少一个和用于相应图像缓冲器的一个或多个编码参数的多个图像缓冲器中的每个图像缓冲器配置缓冲器信息。 基于配置的缓冲器信息，便于按编码顺序提供图像缓冲器。

公开(公告)号：US12099930B2

公开(公告)日：2024-09-24

申请号：US17117271

申请日：2020-12-10

Applicant: Texas Instruments Incorporated

Inventor： Manu Mathew ,  Kumar Desappan ,  Soyeb Noormohammed Nagori ,  Debapriya Maji ,  Pramod Kumar Swami

IPC: G06N3/048 ,  G06N3/04 ,  G06N3/084

CPC classification number: G06N3/084 ,  G06N3/04 ,  G06N3/048

Abstract: In described examples of a method for quantizing data for a convolutional neural network (CNN) is provided. A set of data is received and quantized the using a power-of-2 parametric activation (PACT2) function. The PACT2 function arranges the set of data as a histogram and discards a portion of the data corresponding to a tail of the histogram to form a remaining set of data. A clipping value is determined by expanding the remaining set of data to a nearest power of two value. The set of data is then quantized using the clipping value. With PACT2, a model can be quantized either using post training quantization or using quantization aware training. PACT2 helps a quantized model to achieve close accuracy compared to the corresponding floating-point model.

公开(公告)号：US11580719B2

公开(公告)日：2023-02-14

申请号：US17128365

申请日：2020-12-21

Applicant: Texas Instruments Incorporated

Inventor： Kumar Desappan ,  Manu Mathew ,  Pramod Kumar Swami ,  Praveen Eppa

IPC: G06V10/28 ,  G06K9/62 ,  G06N3/04 ,  G06N3/08 ,  G06N3/063 ,  G06V10/44

Abstract: A method for dynamically quantizing feature maps of a received image. The method includes convolving an image based on a predicted maximum value, a predicted minimum value, trained kernel weights and the image data. The input data is quantized based on the predicted minimum value and predicted maximum value. The output of the convolution is computed into an accumulator and re-quantized. The re-quantized value is output to an external memory. The predicted min value and the predicted max value are computed based on the previous max values and min values with a weighted average or a pre-determined formula. Initial min value and max value are computed based on known quantization methods and utilized for initializing the predicted min value and predicted max value in the quantization process.

公开(公告)号：US20220377322A1

公开(公告)日：2022-11-24

申请号：US17875305

申请日：2022-07-27

Applicant: TEXAS INSTRUMENTS INCORPORATED

Inventor： Soyeb Nagori ,  Manu Mathew ,  Pramod Kumar Swami

IPC: H04N19/107 ,  H04N19/176 ,  H04N19/147 ,  H04N19/50

Abstract: This invention predicts that intra mode prediction is more effective for the macroblocks where motion estimation in inter mode prediction fails. This failure is indicated by a large value of the inter mode SAD. This invention performs intra mode prediction for only macro blocks have larger inter mode SADs. The definition of a large inter mode SAD differs for different content. This invention compares the inter mode SAD of a current macroblock with an adaptive threshold. This adaptive threshold depends on the average and variance of the SADs of the previous predicted frame. An adaptive threshold is calculated for each new predictive frame.

公开(公告)号：US20220327810A1

公开(公告)日：2022-10-13

申请号：US17555435

申请日：2021-12-18

Applicant: Texas Instruments Incorporated

Inventor： Soyeb Noormohammed Nagori ,  Manu Mathew ,  Debapriya Maji ,  Pramod Kumar Swami

IPC: G06V10/774 ,  G06N3/08 ,  G06V10/82

Abstract: A method for multi-label image classification in a convolutional neural network (CNN) is provided that includes forming a composite image from a plurality of clipped images, and processing the composite image by the CNN to generate a probability vector for each clipped image of the plurality of clipped images, wherein a length of a probability vector is equal to a number of classes the CNN is designed to classify.

公开(公告)号：US20220327355A1

公开(公告)日：2022-10-13

申请号：US17809677

申请日：2022-06-29

Applicant: Texas Instruments Incorporated

Inventor： Manu Mathew ,  Kumar Desappan ,  Pramod Kumar Swami

IPC: G06N3/04 ,  G06N3/08 ,  G06F17/15 ,  G06F7/544

Abstract: A method for generating a sparsified convolutional neural network (CNN) is provided that includes training the CNN to generate coefficient values of filters of convolution layers, and performing sparsified fine tuning on the convolution layers to generate the sparsified CNN, wherein the sparsified fine tuning causes selected nonzero coefficient values of the filters to be set to zero.

公开(公告)号：US11425371B2

公开(公告)日：2022-08-23

申请号：US17008247

申请日：2020-08-31

Applicant: TEXAS INSTRUMENTS INCORPORATED

Inventor： Soyeb Nagori ,  Manu Mathew ,  Pramod Kumar Swami

IPC: H04N19/107 ,  H04N19/176 ,  H04N19/147 ,  H04N19/50

Abstract: This invention predicts that intra mode prediction is more effective for the macroblocks where motion estimation in inter mode prediction fails. This failure is indicated by a large value of the inter mode SAD. This invention performs intra mode prediction for only macro blocks have larger inter mode SADs. The definition of a large inter mode SAD differs for different content. This invention compares the inter mode SAD of a current macroblock with an adaptive threshold. This adaptive threshold depends on the average and variance of the SADs of the previous predicted frame. An adaptive threshold is calculated for each new predictive frame.

公开(公告)号：US20210279550A1

公开(公告)日：2021-09-09

申请号：US17327988

申请日：2021-05-24

Applicant: TEXAS INSTRUMENTS INCORPORATED

Inventor： Manu Mathew ,  Kumar Desappan ,  Pramod Kumar Swami

IPC: G06N3/04 ,  G06N3/08 ,  G06F17/15 ,  G06F7/544

Abstract: A method for convolution in a convolutional neural network (CNN) is provided that includes accessing a coefficient value of a filter corresponding to an input feature map of a convolution layer of the CNN, and performing a block multiply accumulation operation on a block of data elements of the input feature map, the block of data elements corresponding to the coefficient value, wherein, for each data element of the block of data elements, a value of the data element is multiplied by the coefficient value and a result of the multiply is added to a corresponding data element in a corresponding output block of data elements comprised in an output feature map.

公开(公告)号：US20210224658A1

公开(公告)日：2021-07-22

申请号：US17117271

申请日：2020-12-10

Applicant: Texas Instruments Incorporated

Inventor： Manu Mathew ,  Kumar Desappan ,  Soyeb Noormohammed Nagori ,  Debapriya Maji ,  Pramod Kumar Swami

IPC: G06N3/08 ,  G06N3/04

Abstract: In described examples of a method for quantizing data for a convolutional neural network (CNN) is provided. A set of data is received and quantized the using a power-of-2 parametric activation (PACT2) function. The PACT2 function arranges the set of data as a histogram and discards a portion of the data corresponding to a tail of the histogram to form a remaining set of data. A clipping value is determined by expanding the remaining set of data to a nearest power of two value. The set of data is then quantized using the clipping value. With PACT2, a model can be quantized either using post training quantization or using quantization aware training. PACT2 helps a quantized model to achieve close accuracy compared to the corresponding floating-point model.

公开(公告)号：US10949694B2

公开(公告)日：2021-03-16

申请号：US16580434

申请日：2019-09-24

Applicant: Texas Instruments Incorporated

Inventor： Deepak Kumar Poddar ,  Pramod Kumar Swami

IPC: G06K9/00 ,  G06K9/46

Abstract: A method of determining a summation of pixel characteristics for a rectangular region of a digital image includes determining if a base address for a data element in an integral image buffer is aligned for an SIMD operation by a processor embedded in an electronic assembly configured to perform Haar-like feature calculations. The data element represents a corner of the rectangular region of an integral image. The integral image is a representation of the digital image. The integral image is formed by data elements stored in the integral image buffer. The data element is loaded from the integral image buffer to the processor when the base address is aligned for the SIMD operation. An offset data element of an offset integral image is loaded from an offset integral buffer when the base address is non-aligned for the SIMD operation. The offset data element represents the corner of the rectangular region.