METHOD AND DEVICE FOR LATENCY REDUCTION OF AN IMAGE PROCESSING PIPELINE

    公开(公告)号:US20230053205A1

    公开(公告)日:2023-02-16

    申请号:US17979630

    申请日:2022-11-02

    Applicant: Apple Inc.

    Abstract: In some implementations, a method includes: determining a complexity value for first image data associated with of a physical environment that corresponds to a first time period; determining an estimated composite setup time based on the complexity value for the first image data and virtual content for compositing with the first image data; in accordance with a determination that the estimated composite setup time exceeds the threshold time: forgoing rendering the virtual content from the perspective that corresponds to the camera pose of the device relative to the physical environment during the first time period; and compositing a previous render of the virtual content for a previous time period with the first image data to generate the graphical environment for the first time period.

    Method and device for latency reduction of an image processing pipeline

    公开(公告)号:US11521291B1

    公开(公告)日:2022-12-06

    申请号:US17215151

    申请日:2021-03-29

    Applicant: Apple Inc.

    Abstract: In some implementations, a method of reducing latency associated with an image read-out operation is performed at a device including one or more processors, non-transitory memory, an image processing architecture, and an image capture device. The method includes: obtaining first image data corresponding to a physical environment; reading a first slice of the first image data into an input buffer; performing processing operations on the first slice of the first image data to obtain a first portion of second image data; reading a second slice of the first image data into the input buffer; performing the image processing operations on the second slice of the first image data to obtain a second portion of the second image data; and generating an image frame of the physical environment based at least in part on the first and second portions of the second image data.

    Controlling an image sensor based on GPU temporal processing values

    公开(公告)号:US11736822B1

    公开(公告)日:2023-08-22

    申请号:US17176771

    申请日:2021-02-16

    Applicant: Apple Inc.

    CPC classification number: H04N5/351 G06T1/20 G06T1/60 H04N23/80

    Abstract: A method includes obtaining a first plurality of image frames that are provided by an image sensor at a first output rate. The method includes determining a GPU temporal processing value characterizing the GPU processing of the first plurality of image frames. The GPU temporal processing value is a function of an amount of information associated with the first plurality of image frames. The method includes determining an operation value associated with the image sensor based on a function of the GPU temporal processing value. The operation value modifies the operation of the image sensor. The method includes changing, using a controller, the operation of the image sensor as a function of the operation value so that the image sensor provides a second plurality of image frames at a second output rate.

Patent Agency Ranking