公开(公告)号：US12136182B2

公开(公告)日：2024-11-05

申请号：US17662884

申请日：2022-05-11

Applicant: GoPro, Inc.

Inventor： Robert McIntosh

IPC: G06K9/00 ,  G06T3/4007 ,  G06T5/50 ,  G06T7/246

Abstract: Systems, apparatus, and methods for motion transfer between different media. Two videos shot simultaneously are combined with aspects of each used to produce a higher-resolution frame interpolated video than would otherwise be possible by the devices alone. The interpolated video may be used in slow motion footage, a higher frame rate (e.g., virtual reality) application, or to add a realistic motion blur effect in post-processing (rather than in capture). A post-processing device may receive high-speed video from a high-speed camera and a low-speed video from a low-speed camera. The post-processing device may use motion data from the high-speed video to interpolate frames of (high-resolution) low-speed video producing low-speed interpolated video.

公开(公告)号：US11756171B1

公开(公告)日：2023-09-12

申请号：US17369766

申请日：2021-07-07

Applicant: GoPro, Inc.

Inventor： Robert McIntosh

IPC: G06T5/00 ,  G06T3/00 ,  G06T3/40

CPC classification number: G06T5/006 ,  G06T3/0018 ,  G06T3/0093 ,  G06T3/4053 ,  G06T5/003 ,  G06T2207/20132

Abstract: Image captured through a non-rectilinear lens may exhibit distortions. The distortions may be reduced by warping the image. However, warping the image may degrade the fidelity of the image. The warped image may be enhanced to increase the fidelity of the image. The enhancement may be applied to the portions of the image that were degraded from the warping.

公开(公告)号：US20210344814A1

公开(公告)日：2021-11-04

申请号：US17153615

申请日：2021-01-20

Applicant: GoPro, Inc.

Inventor： Robert McIntosh ,  Andrew Russell

IPC: H04N5/05 ,  H04N5/10

Abstract: An image capture device may capture video frames while experiencing motion. The video frames may be stored in a visual track, and rotational positions of the image capture device may be stored in a rotational position track. The visual track and the rotational position track may not be temporally aligned. A looping stabilized view of the view frames and a synchronization adjustment option may be presented on a display. The synchronization adjustment option may enable user modification of timing of the rotational positions stored within the rotational position track. Timing modification of the rotational positions may cause changes in the looping stabilized view, which may be used as feedback on whether the synchronization between the visual track and the rotational position track is being improved or not by the timing modification of the rotational positions.

公开(公告)号：US10924636B1

公开(公告)日：2021-02-16

申请号：US15929391

申请日：2020-04-30

Applicant: GoPro, Inc.

Inventor： Robert McIntosh ,  Andrew Russell

IPC: H04N5/05 ,  H04N5/10

Abstract: An image capture device may capture video frames while experiencing motion. The video frames may be stored in a visual track, and rotational positions of the image capture device may be stored in a rotational position track. The visual track and the rotational position track may not be temporally aligned. A looping stabilized view of the view frames and a synchronization adjustment option may be presented on a display. The synchronization adjustment option may enable user modification of timing of the rotational positions stored within the rotational position track. Timing modification of the rotational positions may cause changes in the looping stabilized view, which may be used as feedback on whether the synchronization between the visual track and the rotational position track is being improved or not by the timing modification of the rotational positions.

公开(公告)号：US12262115B2

公开(公告)日：2025-03-25

申请号：US17804661

申请日：2022-05-31

Applicant: GoPro, Inc.

Inventor： Daryl Stimm ,  Kyler William Schwartz ,  Andrew Russell ,  Robert McIntosh

IPC: H04N23/68 ,  H04N23/45 ,  H04N23/698

Abstract: Methods and apparatus for stabilizing image data based on a lens polynomial. Non-rectilinear footage can be captured and rectified in-camera; the rectified images may be stabilized to provide rectified stable video. In one exemplary embodiment, the footage is rectified and stabilized based on a lens polynomial and the camera's own movement. In some variants, the rectified stable video may be stored along with its margin track. In-camera rectified stable video provides several benefits over traditional techniques (e.g., the ability to share rectilinear content from the camera without additional post-processing, as well as reduced file sizes of the shared videos). Lens-aware post-processing can reuse portions of the in-camera rectified stable videos while providing additional benefits (e.g., the ability to re-frame the video in post-production).

公开(公告)号：US12035044B2

公开(公告)日：2024-07-09

申请号：US17449713

申请日：2021-10-01

Applicant: GoPro, Inc.

Inventor： Daryl Stimm ,  Andrew Russell ,  Robert McIntosh

IPC: H04N23/68 ,  H04N7/01 ,  H04N23/80

CPC classification number: H04N23/683 ,  H04N7/0137 ,  H04N23/6811 ,  H04N23/6812 ,  H04N23/80

Abstract: Methods and apparatus for post-processing in-camera stabilized video. Embodiments of the present disclosure reconstruct and re-stabilize an in-camera stabilized video to provide for improved stabilization (e.g., a wider crop, etc.) In-camera sensor data may be stored and used to re-calculate orientation metadata in post-production. In-camera stabilization provides several benefits (e.g., the ability to share stabilized videos from the camera without additional post-processing as well as reduced file sizes of the shared videos). Camera-aware post-processing can reuse portions of the in-camera stabilized videos while providing additional benefits (e.g., the ability to regenerate the original captured videos in post-production and re-stabilize the videos). Camera-aware post-processing can also improve orientation metadata and remove sensor error. The disclosed techniques also enable assisted optical flow-based stabilization using the refined metadata.

公开(公告)号：US20230419461A1

公开(公告)日：2023-12-28

申请号：US18463922

申请日：2023-09-08

Applicant: GoPro, Inc.

Inventor： Robert McIntosh

IPC: G06T5/00 ,  G06T3/00 ,  G06T3/40

CPC classification number: G06T5/006 ,  G06T3/0093 ,  G06T5/003 ,  G06T3/4053 ,  G06T3/0018 ,  G06T2207/20132

Abstract: Image captured through a non-rectilinear lens may exhibit distortions. The distortions may be reduced by warping the image. However, warping the image may degrade the fidelity of the image. The warped image may be enhanced to increase the fidelity of the image. The enhancement may be applied to the portions of the image that were degraded from the warping.

公开(公告)号：US20230247292A1

公开(公告)日：2023-08-03

申请号：US17804661

申请日：2022-05-31

Applicant: GoPro, Inc.

Inventor： Daryl Stimm ,  Kyler William Schwartz ,  Andrew Russell ,  Robert McIntosh

IPC: H04N5/232 ,  H04N5/225

CPC classification number: H04N5/23267 ,  H04N5/23258 ,  H04N5/23238 ,  H04N5/2258 ,  H04N5/23254

Abstract: Methods and apparatus for stabilizing image data based on a lens polynomial. Non-rectilinear footage can be captured and rectified in-camera; the rectified images may be stabilized to provide rectified stable video. In one exemplary embodiment, the footage is rectified and stabilized based on a lens polynomial and the camera's own movement. In some variants, the rectified stable video may be stored along with its margin track. In-camera rectified stable video provides several benefits over traditional techniques (e.g., the ability to share rectilinear content from the camera without additional post-processing, as well as reduced file sizes of the shared videos). Lens-aware post-processing can reuse portions of the in-camera rectified stable videos while providing additional benefits (e.g., the ability to re-frame the video in post-production).

公开(公告)号：US20230245688A1

公开(公告)日：2023-08-03

申请号：US17805180

申请日：2022-06-02

Applicant: GoPro, Inc.

Inventor： David Newman ,  Robert McIntosh

IPC: G11B27/10 ,  G06F3/16 ,  G11B27/031

CPC classification number: G11B27/10 ,  G06F3/162 ,  G11B27/031

Abstract: Systems, apparatus, and methods for encoding telemetry data as audio waveforms. Action cameras may be used to capture telemetry data, which in some applications, may be more useful than its audio/visual media capture. For example, a user may desire the “look-and-feel” of one camera but would like to use the telemetry track information from an action camera. In so-called “piggybacking” operation, the user may rigidly affix the two cameras and use the video track with the telemetry track in post-processing. Unfortunately, time-aligning the two tracks can result in relative drift over time. Various embodiments of the present disclosure transfer telemetry data as data-over-audio. The data-over-audio may be sampled according to the recipient device and recorded at capture. Subsequent post-processing may be performed with the time-aligned tracks.

公开(公告)号：US11611702B1

公开(公告)日：2023-03-21

申请号：US17028407

申请日：2020-09-22

Applicant: GoPro, Inc.

Inventor： Robert McIntosh ,  Andrew Russell

IPC: H04N5/232 ,  G06T7/215

Abstract: An image capture device may capture a video while experiencing motion. Motion of the image capture device during video capture may be determined based on optical flow and structure from motion solve of the video. Optical flow derived motion and/or the motion solve derived motion of the image capture device may be selected to perform stabilization of the video.