Seamless preview stitching for multiple cameras

    公开(公告)号:US11276145B2

    公开(公告)日:2022-03-15

    申请号:US16835551

    申请日:2020-03-31

    Applicant: Apple Inc.

    Abstract: Systems and methods for stitching videos are disclosed. Image-based registration between frames from a first video source and frames from a second video source is performed at a first rate. Calibration-based registration between frames from the first video source and frames from the second video source are performed at a second rate higher than the first rate. Then, for a first frame from the first video source for which calibration-based registration data and image-based registration data have been generated, a stitching transform that maps the first frame to a counterpart frame from the second video source based on image-based registration data is generated. A delta transform from the image-based registration data and the calibration-based registration data at the first frame is also derived. For a subsequent frame from the first video source for which calibration-based registration data have been generated, but no image-based registration data have been generated, a stitching transform that maps the subsequent frame to a counterpart frame from the second video source based on the calibration-based registration data and the delta transform is generated. Frames from the first video source and frames from the second video source are stitched according to their respective generated stitching transforms.

    Method for Camera Alignment Mitigations for Systems with Multiple Cameras

    公开(公告)号:US20250088731A1

    公开(公告)日:2025-03-13

    申请号:US18621999

    申请日:2024-03-29

    Applicant: Apple Inc.

    Abstract: Mitigations for camera alignment during image capture preview involve receiving a zoom level request for a multicamera system comprising a first camera having a first optical zoom metric and a second camera having a second optical zoom metric, and obtaining an image frame from the first camera. A target transformation is determined based on difference between the first optical zoom and a requested zoom level, the second camera's native optical zoom level, the relative orientation of the first and second cameras within the system framework and the relative intrinsics on the two cameras. The transformation is applied before, in conjunction with, or followed by a separate digital zoom transform to the image frame to obtain a transformed and digitally zoomed image frame transformation.

    Memory Bank Hotspotting
    4.
    发明申请

    公开(公告)号:US20220357879A1

    公开(公告)日:2022-11-10

    申请号:US17313811

    申请日:2021-05-06

    Applicant: Apple Inc.

    Abstract: Systems, apparatuses, and methods for addressing bank hotspotting are described. A computing system includes a memory controller with an arbiter for determining how to arbitrate access to one or more memory device(s) for received requests. The arbiter categorizes each request in a manner that helps to ensure fair virtual channel distribution across the banks of the memory device(s). The category system includes bank hotspotting functions to give banks that have more requests more chances to go over banks with fewer requests. The category system is implemented proportionally with more category credits given to banks with higher bank depths within the virtual channel.

    METHODS TO ACHIEVE SMOOTH ZOOM FOR VIDEO IN CAMERAS

    公开(公告)号:US20240080564A1

    公开(公告)日:2024-03-07

    申请号:US18173443

    申请日:2023-02-23

    Applicant: Apple Inc.

    CPC classification number: H04N23/69 H04N23/45 H04N23/6842

    Abstract: Electronic devices, methods, and program storage devices for achieving smooth zooming operations during video capture are disclosed. In particular, smooth zooming may be desirable during video capture operations that involve a single image capture device and/or transitioning between two or more distinct image capture devices, e.g., having different optical and/or zooming properties, during the video capture. When video zooming is done abruptly, it can lead to an unpleasant user experience. The techniques described herein to improve the smoothness of zooming operations include: the use of longer zoom “ramps” for image capture devices; the “early” transitioning between image capture devices during video capture; and the performance of additional “digital zoom smoothing-aware” video image stabilization operations. The embodiments described herein also provide for a more consistent user experience between video streaming (i.e., “preview”) modes and the recorded (i.e., “final”) zoomed video that is produced using the various zoom smoothing techniques described herein.

    Multi-camera video stabilization techniques

    公开(公告)号:US10911677B1

    公开(公告)日:2021-02-02

    申请号:US16564132

    申请日:2019-09-09

    Applicant: Apple Inc.

    Abstract: Various techniques are disclosed herein, which comprise obtaining a first stream of images from a first camera and a second stream of images from a second camera, wherein the first camera and second camera have different poses, and at least a portion of the image streams are captured concurrently. Next, a first stabilized trajectory and corresponding set of corrections used to stabilize the first stream of images are calculated. Based on determined differences between the poses of the first camera and second camera during the capture of the first and second streams of images, a second set of corrections to be applied to the second stream of images are derived to match the first stabilized trajectory. If desired, e.g., in response to determining that the stabilized first stream of images does not meet a stabilization criterion, the second stream of images may be stabilized using the second set of corrections.

    Camera Preview Stabilization
    8.
    发明申请

    公开(公告)号:US20250088742A1

    公开(公告)日:2025-03-13

    申请号:US18621956

    申请日:2024-03-29

    Applicant: Apple Inc.

    Abstract: Stabilizing camera preview frames involves obtaining preview frames and associated camera motion signals, smoothing out the trajectory of these frames to correct for camera movement, and then displaying the corrected frames. The process includes comparing current and prior preview frames and their motion signals to calculate smoothed trajectories and apply appropriate rotation and translation corrections. The specifics of trajectory smoothing take into account factors such as motion state, lighting, or capture mode, which can influence the strength of the smoothing parameter. Transform matrices are utilized based on correction rotation to adjust sample points within images, and special considerations like camera sag are factored into the image corrections.

Patent Agency Ranking