公开(公告)号：US11983625B2

公开(公告)日：2024-05-14

申请号：US16911100

申请日：2020-06-24

申请人： Intel Corporation

发明人： Nilesh Ahuja ,  Ignacio J. Alvarez ,  Ranganath Krishnan ,  Ibrahima J. Ndiour ,  Mahesh Subedar ,  Omesh Tickoo

IPC分类号： G06N3/08 ,  G05B13/02 ,  G06F18/2431 ,  G06F18/25 ,  G06N5/046 ,  G06N7/01

CPC分类号： G06N3/08 ,  G05B13/026 ,  G05B13/027 ,  G06F18/2431 ,  G06F18/251 ,  G06N5/046 ,  G06N7/01

摘要： Techniques are disclosed for using neural network architectures to estimate predictive uncertainty measures, which quantify how much trust should be placed in the deep neural network (DNN) results. The techniques include measuring reliable uncertainty scores for a neural network, which are widely used in perception and decision-making tasks in automated driving. The uncertainty measurements are made with respect to both model uncertainty and data uncertainty, and may implement Bayesian neural networks or other types of neural networks.

公开(公告)号：US11521024B2

公开(公告)日：2022-12-06

申请号：US16948861

申请日：2020-10-02

申请人： Intel Corporation

发明人： Yen-Kuang Chen ,  Shao-Wen Yang ,  Ibrahima J. Ndiour ,  Yiting Liao ,  Vallabhajosyula S. Somayazulu ,  Omesh Tickoo ,  Srenivas Varadarajan

IPC分类号： G06K9/62 ,  H04L9/06 ,  G06F21/64 ,  G06F21/53 ,  G06N5/02 ,  G06N3/04 ,  G06F21/45 ,  H04L9/32 ,  H04W4/70 ,  G06F21/44 ,  G06F16/538 ,  G06F16/535 ,  G06F16/54 ,  G06F21/62 ,  G06F9/50 ,  G06N3/063 ,  G06V10/20 ,  G06V10/40 ,  G06V10/75 ,  G06V10/44 ,  G06V20/00 ,  G06V40/20 ,  G06V40/16 ,  G06F9/48 ,  H04L67/51 ,  G06T7/11 ,  G06V10/96 ,  G06V30/262 ,  G06K15/02 ,  G06N3/08 ,  H04L67/12 ,  H04N19/80 ,  G06F16/951 ,  H04N19/46 ,  G06T7/70 ,  H04W12/02 ,  H04L9/00 ,  H04N19/12 ,  H04N19/124 ,  H04N19/167 ,  H04N19/172 ,  H04N19/176 ,  H04N19/44 ,  H04N19/48 ,  H04N19/513 ,  G06V30/194 ,  G06T7/20 ,  H04N19/42 ,  H04N19/625 ,  H04N19/63 ,  G06T7/223 ,  H04L67/10

摘要： In one embodiment, an apparatus comprises a communication interface and a processor. The communication interface is to communicate with a plurality of devices. The processor is to: receive compressed data from a first device, wherein the compressed data is associated with visual data captured by sensor(s); perform a current stage of processing on the compressed data using a current CNN, wherein the current stage of processing corresponds to one of a plurality of processing stages associated with the visual data, and wherein the current CNN corresponds to one of a plurality of CNNs associated with the plurality of processing stages; obtain an output associated with the current stage of processing; determine, based on the output, whether processing associated with the visual data is complete; if the processing is complete, output a result associated with the visual data; if the processing is incomplete, transmit the compressed data to a second device.

公开(公告)号：US11570466B2

公开(公告)日：2023-01-31

申请号：US17509246

申请日：2021-10-25

申请人： Intel Corporation

发明人： Yiting Liao ,  Yen-Kuang Chen ,  Shao-Wen Yang ,  Vallabhajosyula S. Somayazulu ,  Srenivas Varadarajan ,  Omesh Tickoo ,  Ibrahima J. Ndiour

IPC分类号： H04N19/52 ,  H04N19/523 ,  H04N19/172 ,  G06V10/20 ,  G06N3/04 ,  G06K9/62

摘要： In one embodiment, an apparatus comprises processing circuitry to: receive, via a communication interface, a compressed video stream captured by a camera, wherein the compressed video stream comprises: a first compressed frame; and a second compressed frame, wherein the second compressed frame is compressed based at least in part on the first compressed frame, and wherein the second compressed frame comprises a plurality of motion vectors; decompress the first compressed frame into a first decompressed frame; perform pixel-domain object detection to detect an object at a first position in the first decompressed frame; and perform compressed-domain object detection to detect the object at a second position in the second compressed frame, wherein the object is detected at the second position in the second compressed frame based on: the first position of the object in the first decompressed frame; and the plurality of motion vectors from the second compressed frame.

公开(公告)号：US20210194674A1

公开(公告)日：2021-06-24

申请号：US16947590

申请日：2020-08-07

申请人： Intel Corporation

发明人： Yen-Kuang Chen ,  Shao-Wen Yang ,  Ibrahima J. Ndiour ,  Yiting Liao ,  Vallabhajosyula S. Somayazulu ,  Omesh Tickoo ,  Srenivas Varadarajan

IPC分类号： H04L9/06 ,  G06F21/64 ,  G06F21/53 ,  G06N5/02 ,  G06K9/00 ,  G06N3/04 ,  H04L29/08 ,  G06F21/45 ,  H04L9/32 ,  H04W4/70 ,  G06F21/44 ,  G06K9/46 ,  G06K9/62 ,  G06F16/538 ,  G06F16/535 ,  G06F16/54 ,  G06F21/62 ,  G06F9/50 ,  G06N3/063 ,  G06N3/08 ,  H04N19/80 ,  G06F16/951 ,  G06K9/36 ,  H04N19/46 ,  G06T7/70 ,  G06K9/64 ,  G06K9/72

摘要： In one embodiment, an apparatus comprises a storage device and a processor. The storage device may store a plurality of compressed images comprising one or more compressed master images and one or more compressed slave images. The processor may: identify an uncompressed image; access context information associated with the uncompressed image and the one or more compressed master images; determine, based on the context information, whether the uncompressed image is associated with a corresponding master image; upon a determination that the uncompressed image is associated with the corresponding master image, compress the uncompressed image into a corresponding compressed image with reference to the corresponding master image; upon a determination that the uncompressed image is not associated with the corresponding master image, compress the uncompressed image into the corresponding compressed image without reference to the one or more compressed master images; and store the corresponding compressed image on the storage device.

公开(公告)号：US10349060B2

公开(公告)日：2019-07-09

申请号：US15640202

申请日：2017-06-30

申请人： INTEL CORPORATION

发明人： Srenivas Varadarajan ,  Yiting Liao ,  Vallabhajosyula S. Somayazulu ,  Omesh Tickoo ,  Ibrahima J. Ndiour ,  Javier Perez-Ramirez

IPC分类号： H04N19/167 ,  H04N19/17 ,  H04N19/176

摘要： An example apparatus for encoding video frames includes a receiver to receive video frames and a heat map from a camera and expected object regions from a video database. The apparatus also includes a region of interest (ROI) map generator to detect a region of interest in a video frame based on the expected object regions. The ROI map generator can also detect a region of interest in the video frame based on the heat map. The ROI map generator can then generate an ROI map based on the detected regions of interest. The apparatus further includes a parameter adjuster to adjust an encoding parameter based on the ROI map. The apparatus also further includes a video encoder to encode the video frame using the adjusted encoding parameter.

公开(公告)号：US20230237144A1

公开(公告)日：2023-07-27

申请号：US18157154

申请日：2023-01-20

申请人： Intel Corporation

发明人： Yen-Kuang Chen ,  Shao-Wen Yang ,  Ibrahima J. Ndiour ,  Yiting Liao ,  Vallabhajosyula S. Somayazulu ,  Omesh Tickoo ,  Srenivas Varadarajan

IPC分类号： G06F21/44 ,  H04L9/06 ,  G06F21/64 ,  G06F21/53 ,  G06N5/022 ,  G06F21/45 ,  H04L9/32 ,  H04W4/70 ,  G06F16/538 ,  G06F16/535 ,  G06F16/54 ,  G06F21/62 ,  G06F9/50 ,  G06N3/04 ,  G06N3/063 ,  G06V10/44 ,  G06V20/00 ,  G06V40/20 ,  G06V40/16 ,  G06F9/48 ,  H04L67/51 ,  G06T7/11 ,  G06V10/96 ,  G06V30/262 ,  G06K15/02 ,  G06F18/24 ,  G06F18/21 ,  G06F18/22 ,  G06F18/211 ,  G06F18/213 ,  G06F18/2413 ,  G06N3/045 ,  G06V30/19 ,  G06V10/82 ,  G06V10/94 ,  G06V10/75 ,  G06V10/20 ,  G06V10/40 ,  G06N3/08 ,  H04L67/12 ,  H04N19/80 ,  G06F16/951 ,  H04N19/46 ,  G06T7/70

CPC分类号： G06F21/44 ,  H04L9/0643 ,  G06F21/64 ,  G06F21/53 ,  G06N5/022 ,  G06F21/45 ,  H04L9/3239 ,  H04W4/70 ,  G06F16/538 ,  G06F16/535 ,  G06F16/54 ,  G06F21/6254 ,  G06F9/5044 ,  G06F9/5072 ,  G06N3/04 ,  G06N3/063 ,  G06V10/454 ,  G06V20/00 ,  G06V40/20 ,  G06V40/161 ,  G06F9/4881 ,  G06F9/5066 ,  H04L67/51 ,  G06T7/11 ,  G06V10/96 ,  G06V30/274 ,  G06K15/1886 ,  G06F18/24 ,  G06F18/21 ,  G06F18/22 ,  G06F18/211 ,  G06F18/213 ,  G06F18/2163 ,  G06F18/24143 ,  G06N3/045 ,  G06V30/19173 ,  G06V10/82 ,  G06V10/95 ,  G06V10/75 ,  G06V10/20 ,  G06V10/40 ,  G06N3/08 ,  H04L67/12 ,  H04N19/80 ,  G06F16/951 ,  H04N19/46 ,  G06T7/70 ,  H04W12/02

摘要： In one embodiment, an apparatus comprises a memory and a processor. The memory is to store visual data associated with a visual representation captured by one or more sensors. The processor is to: obtain the visual data associated with the visual representation captured by the one or more sensors, wherein the visual data comprises uncompressed visual data or compressed visual data; process the visual data using a convolutional neural network (CNN), wherein the CNN comprises a plurality of layers, wherein the plurality of layers comprises a plurality of filters, and wherein the plurality of filters comprises one or more pixel-domain filters to perform processing associated with uncompressed data and one or more compressed-domain filters to perform processing associated with compressed data; and classify the visual data based on an output of the CNN.

公开(公告)号：US20230185895A1

公开(公告)日：2023-06-15

申请号：US18060207

申请日：2022-11-30

申请人： Intel Corporation

发明人： Yen-Kuang Chen ,  Shao-Wen Yang ,  Ibrahima J. Ndiour ,  Yiting Liao ,  Vallabhajosyula S. Somayazulu ,  Omesh Tickoo ,  Srenivas Varadarajan

IPC分类号： G06F21/44 ,  H04L9/06 ,  G06F21/64 ,  G06F21/53 ,  G06N5/022 ,  G06F21/45 ,  H04L9/32 ,  H04W4/70 ,  G06F16/538 ,  G06F16/535 ,  G06F16/54 ,  G06F21/62 ,  G06F9/50 ,  G06N3/04 ,  G06N3/063 ,  G06V10/44 ,  G06V20/00 ,  G06V40/20 ,  G06V40/16 ,  G06F9/48 ,  H04L67/51 ,  G06T7/11 ,  G06V10/96 ,  G06V30/262 ,  G06K15/02 ,  G06F18/24 ,  G06F18/21 ,  G06F18/22 ,  G06F18/211 ,  G06F18/213 ,  G06F18/2413 ,  G06N3/045 ,  G06V30/19 ,  G06V10/82 ,  G06V10/94 ,  G06V10/75 ,  G06V10/20 ,  G06V10/40 ,  G06N3/08 ,  H04L67/12 ,  H04N19/80 ,  G06F16/951 ,  H04N19/46 ,  G06T7/70

CPC分类号： G06F21/44 ,  G06F9/4881 ,  G06F9/5044 ,  G06F9/5066 ,  G06F9/5072 ,  G06F16/54 ,  G06F16/535 ,  G06F16/538 ,  G06F16/951 ,  G06F18/21 ,  G06F18/22 ,  G06F18/24 ,  G06F18/211 ,  G06F18/213 ,  G06F18/2163 ,  G06F18/24143 ,  G06F21/45 ,  G06F21/53 ,  G06F21/64 ,  G06F21/6254 ,  G06K15/1886 ,  G06N3/04 ,  G06N3/08 ,  G06N3/045 ,  G06N3/063 ,  G06N5/022 ,  G06T7/11 ,  G06T7/70 ,  G06V10/20 ,  G06V10/40 ,  G06V10/75 ,  G06V10/82 ,  G06V10/95 ,  G06V10/96 ,  G06V10/454 ,  G06V20/00 ,  G06V30/274 ,  G06V30/19173 ,  G06V40/20 ,  G06V40/161 ,  H04L9/0643 ,  H04L9/3239 ,  H04L67/12 ,  H04L67/51 ,  H04N19/46 ,  H04N19/80 ,  H04W4/70 ,  H04W12/02

摘要： In one embodiment, an apparatus comprises a communication interface and a processor. The communication interface is to communicate with a plurality of devices. The processor is to: receive compressed data from a first device, wherein the compressed data is associated with visual data captured by sensor(s); perform a current stage of processing on the compressed data using a current CNN, wherein the current stage of processing corresponds to one of a plurality of processing stages associated with the visual data, and wherein the current CNN corresponds to one of a plurality of CNNs associated with the plurality of processing stages; obtain an output associated with the current stage of processing; determine, based on the output, whether processing associated with the visual data is complete; if the processing is complete, output a result associated with the visual data; if the processing is incomplete, transmit the compressed data to a second device.

公开(公告)号：US20210266145A1

公开(公告)日：2021-08-26

申请号：US16948861

申请日：2020-10-02

申请人： Intel Corporation

发明人： Yen-Kuang Chen ,  Shao-Wen Yang ,  Ibrahima J. Ndiour ,  Yiting Liao ,  Vallabhajosyula S. Somayazulu ,  Omesh Tickoo ,  Srenivas Varadarajan

IPC分类号： H04L9/06 ,  G06F21/64 ,  G06F21/53 ,  G06N5/02 ,  G06K9/00 ,  G06N3/04 ,  H04L29/08 ,  G06F21/45 ,  H04L9/32 ,  H04W4/70 ,  G06F21/44 ,  G06K9/46 ,  G06K9/62 ,  G06F16/538 ,  G06F16/535 ,  G06F16/54 ,  G06F21/62 ,  G06F9/50 ,  G06N3/063 ,  G06N3/08 ,  H04N19/80 ,  G06F16/951 ,  G06K9/36 ,  H04N19/46 ,  G06T7/70 ,  G06K9/64 ,  G06K9/72

摘要： In one embodiment, an apparatus comprises a communication interface and a processor. The communication interface is to communicate with a plurality of devices. The processor is to: receive compressed data from a first device, wherein the compressed data is associated with visual data captured by sensor(s); perform a current stage of processing on the compressed data using a current CNN, wherein the current stage of processing corresponds to one of a plurality of processing stages associated with the visual data, and wherein the current CNN corresponds to one of a plurality of CNNs associated with the plurality of processing stages; obtain an output associated with the current stage of processing; determine, based on the output, whether processing associated with the visual data is complete; if the processing is complete, output a result associated with the visual data; if the processing is incomplete, transmit the compressed data to a second device.

公开(公告)号：US10797863B2

公开(公告)日：2020-10-06

申请号：US16024356

申请日：2018-06-29

申请人： Intel Corporation

发明人： Yen-Kuang Chen ,  Shao-Wen Yang ,  Ibrahima J. Ndiour ,  Yiting Liao ,  Vallabhajosyula S. Somayazulu ,  Omesh Tickoo ,  Srenivas Varadarajan

IPC分类号： H04L9/06 ,  G06F21/64 ,  G06F21/53 ,  G06N5/02 ,  G06K9/00 ,  G06N3/04 ,  H04L29/08 ,  G06F21/45 ,  H04L9/32 ,  H04W4/70 ,  G06F21/44 ,  G06K9/46 ,  G06K9/62 ,  G06N3/08 ,  H04N19/80 ,  G06F16/951 ,  G06K9/36 ,  H04N19/46 ,  G06T7/70 ,  G06K9/64 ,  G06K9/72 ,  H04W12/02 ,  H04N19/42 ,  H04N19/625 ,  H04N19/63 ,  G06T7/223

摘要： In one embodiment, an apparatus comprises a communication interface and a processor. The communication interface is to communicate with a plurality of devices. The processor is to: receive compressed data from a first device, wherein the compressed data is associated with visual data captured by sensor(s); perform a current stage of processing on the compressed data using a current CNN, wherein the current stage of processing corresponds to one of a plurality of processing stages associated with the visual data, and wherein the current CNN corresponds to one of a plurality of CNNs associated with the plurality of processing stages; obtain an output associated with the current stage of processing; determine, based on the output, whether processing associated with the visual data is complete; if the processing is complete, output a result associated with the visual data; if the processing is incomplete, transmit the compressed data to a second device.

公开(公告)号：US20190007690A1

公开(公告)日：2019-01-03

申请号：US15640202

申请日：2017-06-30

申请人： INTEL CORPORATION

发明人： Srenivas Varadarajan ,  Yiting Liao ,  Vallabhajosyula S. Somayazulu ,  Omesh Tickoo ,  Ibrahima J. Ndiour ,  Javier Perez-Ramirez

IPC分类号： H04N19/167 ,  H04N19/17 ,  H04N19/176

CPC分类号： H04N19/167 ,  G06K9/00 ,  H04N19/124 ,  H04N19/17 ,  H04N19/176

摘要： An example apparatus for encoding video frames includes a receiver to receive video frames and a heat map from a camera and expected object regions from a video database. The apparatus also includes a region of interest (ROI) map generator to detect a region of interest in a video frame based on the expected object regions. The ROI map generator can also detect a region of interest in the video frame based on the heat map. The ROI map generator can then generate an ROI map based on the detected regions of interest. The apparatus further includes a parameter adjuster to adjust an encoding parameter based on the ROI map. The apparatus also further includes a video encoder to encode the video frame using the adjusted encoding parameter.