-
公开(公告)号:US11818468B2
公开(公告)日:2023-11-14
申请号:US17818792
申请日:2022-08-10
Applicant: GoPro, Inc.
Inventor: David Newman , Daryl Stimm
IPC: H04N23/698 , H04N23/90 , G06T3/40 , H04N5/262
CPC classification number: H04N23/698 , G06T3/4038 , H04N5/2628 , H04N23/90
Abstract: Methods and apparatus for shear correction in spherical projections. Embedded devices generally lack the compute and/or memory resources to implement two-dimensional (2D) stitches for spherical projections. Objects (such as a mounting fixture) within a certain distance of the camera may experience a 2D “tear” or “shear” artifact when stitched. Various embodiments of the present disclosure perform two orthogonal 1D stitches: (i) latitudinally across the meridian and (ii) longitudinally along the meridian to approximate the effect of a 2D stitch. Notably, the 1D stitch may be less precise than a true 2D stitch, however the image portion being stitched (e.g., the camera mount) is not the user's subject of interest and can be rendered much more loosely without adverse consequence. Temporal smoothing optimizations are additionally disclosed.
-
公开(公告)号:US11790488B2
公开(公告)日:2023-10-17
申请号:US17332953
申请日:2021-05-27
Applicant: GoPro, Inc.
Inventor: David Newman , Daryl Stimm , Adeel Abbas
CPC classification number: G06T3/4038 , G06T3/0018 , G06T3/0062 , H04N19/80
Abstract: Methods and apparatus for multi-encoder processing of high resolution content. In one embodiment, the method includes capturing high resolution imaging content; splitting up the captured high resolution imaging content into respective portions; feeding the split up portions to respective imaging encoders; packing encoded content from the respective imaging encoders into an A/V container; and storing and/or transmitting the A/V container. In another embodiment, the method includes retrieving and/or receiving an A/V container; splitting up the retrieved and/or received A/V container into respective portions; feeding the split up portions to respective imaging decoders; stitching the decoded imaging portions into a common imaging portion; and storing and/or displaying at least a portion of the common imaging portion.
-
公开(公告)号:US20230007173A1
公开(公告)日:2023-01-05
申请号:US17939542
申请日:2022-09-07
Applicant: GoPro, Inc.
Inventor: Nicholas Ryan Gilmour , David Newman
IPC: H04N5/232 , H04N13/239 , H04N13/106 , G03B37/04 , G06F9/30
Abstract: An image capture device may switch operation between a spherical capture mode or a non-spherical capture mode. Operation of the image capture device in the spherical capture mode includes generation of spherical visual content based on the visual content generated by multiple image sensors. Operation of the image capture device in the non-spherical capture mode includes generation of non-spherical visual content based on visual content generated by a single image sensor.
-
公开(公告)号:US20220385811A1
公开(公告)日:2022-12-01
申请号:US17818792
申请日:2022-08-10
Applicant: GoPro, Inc.
Inventor: David Newman , Daryl Stimm
Abstract: Methods and apparatus for shear correction in spherical projections. Embedded devices generally lack the compute and/or memory resources to implement two-dimensional (2D) stitches for spherical projections. Objects (such as a mounting fixture) within a certain distance of the camera may experience a 2D “tear” or “shear” artifact when stitched. Various embodiments of the present disclosure perform two orthogonal 1D stitches: (i) latitudinally across the meridian and (ii) longitudinally along the meridian to approximate the effect of a 2D stitch. Notably, the 1D stitch may be less precise than a true 2D stitch, however the image portion being stitched (e.g., the camera mount) is not the user's subject of interest and can be rendered much more loosely without adverse consequence. Temporal smoothing optimizations are additionally disclosed.
-
公开(公告)号:US11379949B1
公开(公告)日:2022-07-05
申请号:US17001409
申请日:2020-08-24
Applicant: GoPro, Inc.
Inventor: David Newman
IPC: G06T3/00
Abstract: Multiple single lens distortion regions and one or more boundary regions may be determined within an image. Individual single lens distortion regions may have pixel displacement defined by a single lens distortion and individual boundary regions may have pixel displacement defined by a blend of at least two lens distortions. Multiple lens distortions may be simulated within the image by shifting pixels of the image input positions to output positions based on locations of pixels within a single lens distortion region and the corresponding single lens distortion or within a boundary region and a blend of corresponding lens distortions.
-
公开(公告)号:US20210333874A1
公开(公告)日:2021-10-28
申请号:US17371058
申请日:2021-07-08
Applicant: GOPRO, INC.
Inventor: David Newman
Abstract: Visual information defining visual content may be accessed. The visual content may include one or more views of one or more scenes. The scene(s) may include one or more human subjects. Gaze directions of the human subject(s) may be determined. The gaze directions may indicate one or more viewing directions in which the human subject(s) are looking. One or more directions of view for the visual content may be determined based on the gaze directions of the human subject(s). The direction(s) of view may include one or more of the viewing directions looked at by the human subject(s). The visual content may be presented on a display based on the direction(s) of view for the visual content.
-
公开(公告)号:US20210287337A1
公开(公告)日:2021-09-16
申请号:US17332953
申请日:2021-05-27
Applicant: GoPro, Inc.
Inventor: David Newman , Daryl Stimm , Adeel Abbas
Abstract: Methods and apparatus for multi-encoder processing of high resolution content. In one embodiment, the method includes capturing high resolution imaging content; splitting up the captured high resolution imaging content into respective portions; feeding the split up portions to respective imaging encoders; packing encoded content from the respective imaging encoders into an A/V container; and storing and/or transmitting the A/V container. In another embodiment, the method includes retrieving and/or receiving an A/V container; splitting up the retrieved and/or received A/V container into respective portions; feeding the split up portions to respective imaging decoders; stitching the decoded imaging portions into a common imaging portion; and storing and/or displaying at least a portion of the common imaging portion.
-
公开(公告)号:US11050938B2
公开(公告)日:2021-06-29
申请号:US16503320
申请日:2019-07-03
Applicant: GoPro, Inc.
Inventor: David Newman
Abstract: Apparatus and methods for the pre-processing of image data so as to enhance quality of subsequent encoding and rendering. In one embodiment, a capture device is disclosed that includes a processing apparatus and a non-transitory computer readable apparatus comprising a storage medium have one or more instructions stored thereon. The one or more instructions, when executed by the processing apparatus, are configured to: receive captured image data (such as that sourced from two or more separate image sensors) and pre-process the data to enable stabilization of the corresponding images prior to encoding. In some implementations, the pre-processing includes combination (e.g., stitching) of the captured image data associated with the two or more sensors to facilitate the stabilization. Advantageously, undesirable artifacts such as object “jitter” can be reduced or eliminated. Methods and non-transitory computer readable apparatus are also disclosed.
-
公开(公告)号:US20210174470A1
公开(公告)日:2021-06-10
申请号:US17132379
申请日:2020-12-23
Applicant: GoPro, Inc.
Inventor: Daryl Stimm , David Newman
IPC: G06T3/40 , H04N5/232 , H04N7/01 , H04N19/196
Abstract: Apparatus and methods for the non-uniform downsampling of captured panoramic images. In one embodiment, a computing device is disclosed that includes a processing apparatus and a non-transitory computer readable apparatus comprising a storage medium have one or more instructions stored thereon. The one or more instructions, when executed by the processing apparatus, being configured to: receive captured images, the captured images obtained using two or more image sensors; non-uniformly downsample the received captured images; and encode the non-uniformly downsampled images. In some variants, the non-uniformly downsampled images take into account a desired area of interest within the captured images. In some implementations, the computing device includes an image capture device. Methods and non-transitory computer readable apparatus are also disclosed.
-
公开(公告)号:US11024008B1
公开(公告)日:2021-06-01
申请号:US16781953
申请日:2020-02-04
Applicant: GoPro, Inc.
Inventor: David Newman , Daryl Stimm , Adeel Abbas
Abstract: Methods and apparatus for multi-encoder processing of high resolution content. In one embodiment, the method includes capturing high resolution imaging content; splitting up the captured high resolution imaging content into respective portions; feeding the split up portions to respective imaging encoders; packing encoded content from the respective imaging encoders into an A/V container; and storing and/or transmitting the A/V container. In another embodiment, the method includes retrieving and/or receiving an A/V container; splitting up the retrieved and/or received A/V container into respective portions; feeding the split up portions to respective imaging decoders; stitching the decoded imaging portions into a common imaging portion; and storing and/or displaying at least a portion of the common imaging portion.
-
-
-
-
-
-
-
-
-