Systems and methods for DSP fast boot

    公开(公告)号:US11190681B1

    公开(公告)日:2021-11-30

    申请号:US15206032

    申请日:2016-07-08

    Applicant: Snap Inc.

    Abstract: System, methods, devices, and instructions are described for fast boot of a processor as part of camera operation. In some embodiments, in response to a camera input, a digital signal processor (DSP) of a device is booted using a first set of instructions. Capture of image sensor data is initiated using the first set of instructions at the DSP. The DSP then receives a second set of instructions and the DSP is programmed using the second set of instructions after at least a first frame of the image sensor data is stored in a memory of the device. The first frame of the image sensor data is processed using the DSP as programmed by the second set of instructions. In some embodiments, the first set of instructions includes only instructions for setting camera sensor values, and the second set of instructions includes instructions for processing raw sensor data into formatted image files.

    Image and point cloud based tracking and in augmented reality systems

    公开(公告)号:US10657708B1

    公开(公告)日:2020-05-19

    申请号:US15971566

    申请日:2018-05-04

    Applicant: Snap Inc.

    Abstract: Systems and methods for image based location estimation are described. In one example embodiment, a first positioning system is used to generate a first position estimate. A 3D point cloud data describing an environment is then accessed. A first image of an environment is captured, and a portion of the image is matched to a portion of key points in the 3D point cloud data. An augmented reality object is then aligned within one or more images of the environment based on the match of the 3D point cloud with the image. In some embodiments, building façade data may additionally be used to determine a device location and place the augmented reality object within an image.

    Systems and methods for DSP fast boot

    公开(公告)号:US12022184B2

    公开(公告)日:2024-06-25

    申请号:US18119142

    申请日:2023-03-08

    Applicant: Snap Inc.

    CPC classification number: H04N23/617 H04N23/65 H04N23/71 H04N23/73

    Abstract: System, methods, devices, and instructions are described for fast boot of a processor as part of camera operation. In some embodiments, in response to a camera input, a digital signal processor (DSP) of a device is booted using a first set of instructions. Capture of image sensor data is initiated using the first set of instructions at the DSP. The DSP then receives a second set of instructions and the DSP is programmed using the second set of instructions after at least a first frame of the image sensor data is stored in a memory of the device. The first frame of the image sensor data is processed using the DSP as programmed by the second set of instructions. In some embodiments, the first set of instructions includes only instructions for setting camera sensor values, and the second set of instructions includes instructions for processing raw sensor data into formatted image files.

    Image and point cloud based tracking and in augmented reality systems

    公开(公告)号:US10997783B2

    公开(公告)日:2021-05-04

    申请号:US16824297

    申请日:2020-03-19

    Applicant: Snap Inc.

    Abstract: Systems and methods for image based location estimation are described. In one example embodiment, a first positioning system is used to generate a first position estimate. Point cloud data describing an environment is then accessed. A two-dimensional surface of an image of an environment is captured, and a portion of the image is matched to a portion of key points in the point cloud data. An augmented reality object is then aligned within one or more images of the environment based on the match of the point cloud with the image. In some embodiments, building façade data may additionally be used to determine a device location and place the augmented reality object within an image.

Patent Agency Ranking