公开(公告)号：US20160205381A1

公开(公告)日：2016-07-14

申请号：US15077911

申请日：2016-03-23

Applicant: GoPro, Inc.

Inventor： Timothy Macmillan ,  Scott Patrick Campbell ,  David A. Newman ,  Yajie Sun

IPC: H04N13/02

CPC classification number: H04N13/246 ,  H04N5/23203 ,  H04N5/23238 ,  H04N5/247 ,  H04N5/265 ,  H04N5/3532 ,  H04N13/00 ,  H04N13/239 ,  H04N13/296 ,  H04N17/002

Abstract: A pair of cameras having an overlapping field of view is aligned based on images captured by image sensors of the pair of cameras. A pixel shift is identified between the images. Based on the identified pixel shift, a calibration is applied to one or both of the pair of cameras. To determine the pixel shift, the camera applies correlation methods including edge matching. Calibrating the pair of cameras may include adjusting a read window on an image sensor. The pixel shift can also be used to determine a time lag, which can be used to synchronize subsequent image captures.

Abstract translation: 具有重叠视野的一对相机基于由该对相机的图像传感器捕获的图像来对准。 在图像之间识别像素漂移。 基于所识别的像素偏移，校准被应用于该对照相机中的一个或两个。 为了确定像素偏移，相机应用包括边缘匹配的相关方法。 校准一对相机可能包括调整图像传感器上的读取窗口。 像素偏移也可用于确定时间滞后，可用于同步后续图像捕获。

公开(公告)号：US20150271483A1

公开(公告)日：2015-09-24

申请号：US14221256

申请日：2014-03-20

Applicant: GoPro, Inc.

Inventor： Yajie Sun ,  Timothy Macmillan ,  Elizabeth Torres Martin ,  Sumit Chawla

IPC: H04N17/00 ,  G06K9/52 ,  G06K9/62 ,  H04N5/232 ,  G06K9/46

CPC classification number: G06T3/4038 ,  G06K9/4604 ,  G06K9/52 ,  G06K9/6201 ,  G06T5/002 ,  G06T7/13 ,  G06T7/337 ,  G06T7/80 ,  G06T7/85 ,  H04N5/23229 ,  H04N5/2329 ,  H04N5/349 ,  H04N5/374 ,  H04N13/239 ,  H04N13/246 ,  H04N13/271 ,  H04N13/296 ,  H04N17/002 ,  H04N2013/0081

Abstract: A pair of cameras having an overlapping field of view is aligned based on images captured by image sensors of the pair of cameras. A pixel shift is identified between the images. Based on the identified pixel shift, a calibration is applied to one or both of the pair of cameras. To determine the pixel shift, the camera applies correlation methods including edge matching. Calibrating the pair of cameras may include adjusting a read window on an image sensor. The pixel shift can also be used to determine a time lag, which can be used to synchronize subsequent image captures.

Abstract translation: 具有重叠视野的一对相机基于由该对相机的图像传感器捕获的图像来对准。 在图像之间识别像素漂移。 基于所识别的像素偏移，校准被应用于该对照相机中的一个或两个。 为了确定像素偏移，相机应用包括边缘匹配的相关方法。 校准一对相机可能包括调整图像传感器上的读取窗口。 像素偏移也可用于确定时间滞后，可用于同步后续图像捕获。

公开(公告)号：US20250045863A1

公开(公告)日：2025-02-06

申请号：US18920047

申请日：2024-10-18

Applicant: GoPro, Inc.

Inventor： David A. Newman ,  Joshua Edward Bodinet ,  Otto Kenneth Sievert ,  Timothy Macmillan

IPC: G06T3/047 ,  G06T3/00 ,  G06T3/40 ,  G06T5/80

Abstract: In a video capture system, a virtual lens is simulated when applying a crop or zoom effect to an input video. An input video frame is received from the input video that has a first field of view and an input lens distortion. A selection of a sub-frame representing a portion of the input video frame is obtained that has a second field of view smaller than the first field of view. The sub-frame is processed to remap the input lens distortion to a desired lens distortion in the sub-frame. The processed sub-frame is output.

公开(公告)号：US20220092729A1

公开(公告)日：2022-03-24

申请号：US17457738

申请日：2021-12-06

Applicant: GoPro, Inc.

Inventor： Joseph Steel ,  Timothy Macmillan

IPC: G06T3/00

Abstract: Hyper-hemispherical images may be combined to generate a rectangular projection of a spherical image having an equatorial stitch line along of a line of lowest distortion in the two images. First and second circular images are received representing respective hyper-hemispherical fields of view. A video processing device may project each circular image to a respective rectangular image by mapping an outer edge of the circular image to a first edge of the rectangular image and mapping a center point of the circular image to a second edge of the first rectangular image. The rectangular images may be stitched together along the edges corresponding to the outer edge of the original circular image.

公开(公告)号：US20210144356A1

公开(公告)日：2021-05-13

申请号：US17061885

申请日：2020-10-02

Applicant: GoPro, Inc.

Inventor： Timothy Macmillan ,  Scott Patrick Campbell ,  David A. Newman ,  Yajie Sun

IPC: H04N13/246 ,  H04N17/00 ,  H04N13/296 ,  H04N5/247 ,  H04N13/239 ,  H04N5/232 ,  H04N5/265 ,  H04N5/353 ,  H04N13/00

Abstract: An image capture device having multiple image sensors having overlapping fields of view that aligns the image sensors based on images captured by image sensors. A pixel shift is identified between the images. Based on the identified pixel shift, a calibration is applied to one or more of the image sensors. To determine the pixel shift, a processor applies correlation methods including edge matching. Calibrating the image sensors may include adjusting a read window on an image sensor. The pixel shift can also be used to determine a time lag, which can be used to synchronize subsequent image captures.

公开(公告)号：US10650487B2

公开(公告)日：2020-05-12

申请号：US16450672

申请日：2019-06-24

Applicant: GoPro, Inc.

Inventor： Joseph Steel ,  Timothy Macmillan

IPC: G06T3/00

Abstract: Hyper-hemispherical images may be combined to generate a rectangular projection of a spherical image having an equatorial stitch line along of a line of lowest distortion in the two images. First and second circular images are received representing respective hyper-hemispherical fields of view. A video processing device may project each circular image to a respective rectangular image by mapping an outer edge of the circular image to a first edge of the rectangular image and mapping a center point of the circular image to a second edge of the first rectangular image. The rectangular images may be stitched together along the edges corresponding to the outer edge of the original circular image.

公开(公告)号：US10277886B2

公开(公告)日：2019-04-30

申请号：US15357968

申请日：2016-11-21

Applicant: GoPro, Inc.

Inventor： Timothy Macmillan ,  Adeel Abbas

IPC: G06T9/00 ,  G06T17/00 ,  H04N13/243 ,  H04N5/232 ,  H04N19/136 ,  H04N19/44 ,  G06K9/46 ,  G06K9/52 ,  G06K9/62 ,  G06T3/00 ,  G06T3/20 ,  G06T7/00 ,  G06T11/60 ,  G06T15/20 ,  H04N13/302 ,  H04N13/344 ,  H04N13/10 ,  H04N13/334 ,  H04N13/282 ,  G06T7/38 ,  G06T7/73 ,  G06T7/593 ,  G06T7/55 ,  H04N5/265 ,  H04N13/161

Abstract: A system receives an encoded image representative of the 2D projection of a cubic image, the encoded image generated from two overlapping hemispherical images separated along a longitudinal plane of a sphere. The system decodes the encoded image to produce a decoded 2D projection of the cubic image, and perform a stitching operation to portions of the decoded 2D projection representative of overlapping portions of the hemispherical images to produce stitched overlapping portions. The system combine the stitched overlapping portions with portions of the decoded 2D projection representative of the non-overlapping portions of the hemispherical images to produce a stitched 2D projection of the cubic image, and encode the stitched 2D projection of the cubic image to produce an encoded cubic projection of the stitched hemispherical images.

公开(公告)号：US10148939B2

公开(公告)日：2018-12-04

申请号：US15357963

申请日：2016-11-21

Applicant: GoPro, Inc.

Inventor： Timothy Macmillan ,  Adeel Abbas

IPC: H04N13/243 ,  H04N5/232 ,  H04N5/265 ,  H04N19/136 ,  H04N19/44 ,  G06K9/46 ,  G06K9/52 ,  G06K9/62 ,  G06T3/00 ,  G06T3/20 ,  G06T7/00 ,  G06T11/60 ,  G06T15/20 ,  H04N13/302 ,  H04N13/344 ,  H04N13/10 ,  H04N13/334 ,  H04N13/282 ,  H04N13/161

Abstract: A system captures a first hemispherical image and a second hemispherical image, each hemispherical image including an overlap portion, the overlap portions capturing a same field of view, the two hemispherical images collectively comprising a spherical FOV and separated along a longitudinal plane. The system maps a modified first hemispherical image to a first portion of the 2D projection of a cubic image, the modified first hemispherical image including a non-overlap portion of the first hemispherical image, and maps a modified second hemispherical image to a second portion of the 2D projection of the cubic image, the modified second hemispherical image also including a non-overlap portion. The system maps the overlap portions of the first hemispherical image and the second hemispherical image to the 2D projection of the cubic image, and encodes the 2D projection of the cubic image to generate an encoded image representative of the spherical FOV.

公开(公告)号：US10055816B2

公开(公告)日：2018-08-21

申请号：US15711951

申请日：2017-09-21

Applicant: GoPro, Inc.

Inventor： Yajie Sun ,  Timothy Macmillan ,  Elizabeth Torres Edwards ,  Sumit Chawla

IPC: G06T7/13 ,  G06T3/40 ,  H04N17/00 ,  G06K9/52 ,  G06K9/62 ,  G06T5/00 ,  G06T7/33 ,  G06T7/80 ,  H04N5/232 ,  H04N5/349 ,  H04N5/374 ,  H04N13/02 ,  G06K9/46 ,  H04N13/239 ,  H04N13/246 ,  H04N13/271 ,  H04N13/296 ,  H04N13/00

CPC classification number: G06T3/4038 ,  G06K9/4604 ,  G06K9/52 ,  G06K9/6201 ,  G06T5/002 ,  G06T7/13 ,  G06T7/337 ,  G06T7/80 ,  G06T7/85 ,  H04N5/23229 ,  H04N5/2329 ,  H04N5/349 ,  H04N5/374 ,  H04N13/239 ,  H04N13/246 ,  H04N13/271 ,  H04N13/296 ,  H04N17/002 ,  H04N2013/0081

Abstract: A pair of cameras having an overlapping field of view is aligned based on images captured by image sensors of the pair of cameras. A pixel shift is identified between the images. Based on the identified pixel shift, a calibration is applied to one or both of the pair of cameras. To determine the pixel shift, the camera applies correlation methods including edge matching. Calibrating the pair of cameras may include adjusting a read window on an image sensor. The pixel shift can also be used to determine a time lag, which can be used to synchronize subsequent image captures.

公开(公告)号：US20180146122A1

公开(公告)日：2018-05-24

申请号：US15430692

申请日：2017-02-13

Applicant: GoPro, Inc.

Inventor： Scott Patrick Campbell ,  Timothy Macmillan ,  Andrew Ganzon

IPC: H04N5/225

CPC classification number: H04N5/2252 ,  G03B17/08 ,  G03B17/561 ,  G03B37/04 ,  H04N5/2253 ,  H04N5/2254 ,  H04N5/2258

Abstract: An underwater housing comprises a laterally offset back-to-back dome configuration. A dual-lens camera having laterally offset back-to-back lenses is mounted within the housing such that the optical axes of the camera lenses align with the optical axes of the domes. This configuration beneficially minimizes effects introduced by the dome on field of view and focus.