PARTIALLY SHARED NEURAL NETWORKS FOR MULTIPLE TASKS

    公开(公告)号:US20180157972A1

    公开(公告)日:2018-06-07

    申请号:US15828399

    申请日:2017-11-30

    申请人: Apple Inc.

    摘要: A system includes a neural network organized into layers corresponding to stages of inferences. The neural network includes a common portion, a first portion, and a second portion. The first portion includes a first set of layers dedicated to performing a first inference task on an input data. The second portion includes a second set of layers dedicated to performing a second inference task on the same input data. The common portion includes a third set of layers, which may include an input layer to the neural network, that are used in the performance of both the first and second inference tasks. The system may receive an input data and perform both inference tasks on the input data in a single pass. During training, a training sample with annotations for both inference tasks may be used to train the neural network in a single pass.

    Encoding Three-Dimensional Data For Processing By Capsule Neural Networks

    公开(公告)号:US20210090302A1

    公开(公告)日:2021-03-25

    申请号:US16836028

    申请日:2020-03-31

    申请人: Apple Inc.

    摘要: A method includes defining a geometric capsule that is interpretable by a capsule neural network, wherein the geometric capsule includes a feature representation and a pose. The method also includes determining multiple viewpoints relative to the geometric capsule and determining a first appearance representation of the geometric capsule for each of the multiple viewpoints. The method also includes determining a transform for each of the multiple viewpoints that moves each of the multiple viewpoints to a respective transformed viewpoint and determining second appearance representations that each correspond to one of the transformed viewpoints. The method also includes combining the second appearance representations to define an agreed appearance representation. The method also includes updating the feature representation for the geometric capsule based on the agreed appearance representation.

    Method and device for improved localization and mapping

    公开(公告)号:US10776948B1

    公开(公告)日:2020-09-15

    申请号:US16113647

    申请日:2018-08-27

    申请人: Apple Inc.

    摘要: In accordance with some embodiments, a method is performed at a device with one or more processors and non-transitory memory. The method includes obtaining location vector data characterizing an object. The method includes determining a neural pose graph associated with a respective time-period based on an initial local pose estimation as a function of respective location vector data. The method includes determining a meta pose estimation associated with the respective time-period by aggregating the neural pose graph associated with the respective time-period and one or more other neural pose graphs associated with one or more temporally adjacent time-periods. The method includes synthesizing a corrected pose estimation by correcting the meta pose estimation associated with the respective time-period based on a function of the meta pose estimation associated with the respective time-period and meta pose estimations associated with one or more temporally adjacent time-periods in order to correct accumulated errors in the initial local pose estimation.

    Method and device for improved localization and mapping

    公开(公告)号:US11189052B2

    公开(公告)日:2021-11-30

    申请号:US16990510

    申请日:2020-08-11

    申请人: Apple Inc.

    摘要: In accordance with some embodiments, a method is performed at a device with one or more processors and non-transitory memory. The method includes obtaining location vector data characterizing an object. The method includes determining a neural pose graph associated with a respective time-period based on an initial local pose estimation as a function of respective location vector data. The method includes determining a meta pose estimation associated with the respective time-period by aggregating the neural pose graph associated with the respective time-period and one or more other neural pose graphs associated with one or more temporally adjacent time-periods. The method includes synthesizing a corrected pose estimation by correcting the meta pose estimation associated with the respective time-period based on a function of the meta pose estimation associated with the respective time-period and meta pose estimations associated with one or more temporally adjacent time-periods in order to correct accumulated errors in the initial local pose estimation.

    Inspection neural network for assessing neural network reliability

    公开(公告)号:US10943148B2

    公开(公告)日:2021-03-09

    申请号:US15828408

    申请日:2017-11-30

    申请人: Apple Inc.

    摘要: A system employs an inspection neural network (INN) to inspect data generated during an inference process of a primary neural network (PNN) to generate an indication of reliability for an output generated by the PNN. The system includes a sensor configured to capture sensor data. Sensor data captured by the sensor is provided to a data analyzer to generate an output using the PNN. An analyzer inspector is configured to capture inspection data associated with the generation of the output by the data analyzer, and use the INN to generate an indication of reliability for the PNN's output based on the inspection data. The INN is trained using a set of training data that is distinct from the training data used to train the PNN.

    METHOD AND DEVICE FOR IMPROVED LOCALIZATION AND MAPPING

    公开(公告)号:US20200372675A1

    公开(公告)日:2020-11-26

    申请号:US16990510

    申请日:2020-08-11

    申请人: Apple Inc.

    摘要: In accordance with some embodiments, a method is performed at a device with one or more processors and non-transitory memory. The method includes obtaining location vector data characterizing an object. The method includes determining a neural pose graph associated with a respective time-period based on an initial local pose estimation as a function of respective location vector data. The method includes determining a meta pose estimation associated with the respective time-period by aggregating the neural pose graph associated with the respective time-period and one or more other neural pose graphs associated with one or more temporally adjacent time-periods. The method includes synthesizing a corrected pose estimation by correcting the meta pose estimation associated with the respective time-period based on a function of the meta pose estimation associated with the respective time-period and meta pose estimations associated with one or more temporally adjacent time-periods in order to correct accumulated errors in the initial local pose estimation.