Methods and apparatus for shear correction in image projections

    公开(公告)号:US11818468B2

    公开(公告)日:2023-11-14

    申请号:US17818792

    申请日:2022-08-10

    Applicant: GoPro, Inc.

    CPC classification number: H04N23/698 G06T3/4038 H04N5/2628 H04N23/90

    Abstract: Methods and apparatus for shear correction in spherical projections. Embedded devices generally lack the compute and/or memory resources to implement two-dimensional (2D) stitches for spherical projections. Objects (such as a mounting fixture) within a certain distance of the camera may experience a 2D “tear” or “shear” artifact when stitched. Various embodiments of the present disclosure perform two orthogonal 1D stitches: (i) latitudinally across the meridian and (ii) longitudinally along the meridian to approximate the effect of a 2D stitch. Notably, the 1D stitch may be less precise than a true 2D stitch, however the image portion being stitched (e.g., the camera mount) is not the user's subject of interest and can be rendered much more loosely without adverse consequence. Temporal smoothing optimizations are additionally disclosed.

    Methods and apparatus for multi-encoder processing of high resolution content

    公开(公告)号:US11790488B2

    公开(公告)日:2023-10-17

    申请号:US17332953

    申请日:2021-05-27

    Applicant: GoPro, Inc.

    CPC classification number: G06T3/4038 G06T3/0018 G06T3/0062 H04N19/80

    Abstract: Methods and apparatus for multi-encoder processing of high resolution content. In one embodiment, the method includes capturing high resolution imaging content; splitting up the captured high resolution imaging content into respective portions; feeding the split up portions to respective imaging encoders; packing encoded content from the respective imaging encoders into an A/V container; and storing and/or transmitting the A/V container. In another embodiment, the method includes retrieving and/or receiving an A/V container; splitting up the retrieved and/or received A/V container into respective portions; feeding the split up portions to respective imaging decoders; stitching the decoded imaging portions into a common imaging portion; and storing and/or displaying at least a portion of the common imaging portion.

    METHODS AND APPARATUS FOR SHEAR CORRECTION IN IMAGE PROJECTIONS

    公开(公告)号:US20220385811A1

    公开(公告)日:2022-12-01

    申请号:US17818792

    申请日:2022-08-10

    Applicant: GoPro, Inc.

    Abstract: Methods and apparatus for shear correction in spherical projections. Embedded devices generally lack the compute and/or memory resources to implement two-dimensional (2D) stitches for spherical projections. Objects (such as a mounting fixture) within a certain distance of the camera may experience a 2D “tear” or “shear” artifact when stitched. Various embodiments of the present disclosure perform two orthogonal 1D stitches: (i) latitudinally across the meridian and (ii) longitudinally along the meridian to approximate the effect of a 2D stitch. Notably, the 1D stitch may be less precise than a true 2D stitch, however the image portion being stitched (e.g., the camera mount) is not the user's subject of interest and can be rendered much more loosely without adverse consequence. Temporal smoothing optimizations are additionally disclosed.

    Systems and methods for simulating multiple lens distortions within a single image

    公开(公告)号:US11379949B1

    公开(公告)日:2022-07-05

    申请号:US17001409

    申请日:2020-08-24

    Applicant: GoPro, Inc.

    Inventor: David Newman

    Abstract: Multiple single lens distortion regions and one or more boundary regions may be determined within an image. Individual single lens distortion regions may have pixel displacement defined by a single lens distortion and individual boundary regions may have pixel displacement defined by a blend of at least two lens distortions. Multiple lens distortions may be simulated within the image by shifting pixels of the image input positions to output positions based on locations of pixels within a single lens distortion region and the corresponding single lens distortion or within a boundary region and a blend of corresponding lens distortions.

    SYSTEMS AND METHODS FOR GENERATING VIEWPOINTS FOR VISUAL CONTENT BASED ON GAZE

    公开(公告)号:US20210333874A1

    公开(公告)日:2021-10-28

    申请号:US17371058

    申请日:2021-07-08

    Applicant: GOPRO, INC.

    Inventor: David Newman

    Abstract: Visual information defining visual content may be accessed. The visual content may include one or more views of one or more scenes. The scene(s) may include one or more human subjects. Gaze directions of the human subject(s) may be determined. The gaze directions may indicate one or more viewing directions in which the human subject(s) are looking. One or more directions of view for the visual content may be determined based on the gaze directions of the human subject(s). The direction(s) of view may include one or more of the viewing directions looked at by the human subject(s). The visual content may be presented on a display based on the direction(s) of view for the visual content.

    METHODS AND APPARATUS FOR MULTI-ENCODER PROCESSING OF HIGH RESOLUTION CONTENT

    公开(公告)号:US20210287337A1

    公开(公告)日:2021-09-16

    申请号:US17332953

    申请日:2021-05-27

    Applicant: GoPro, Inc.

    Abstract: Methods and apparatus for multi-encoder processing of high resolution content. In one embodiment, the method includes capturing high resolution imaging content; splitting up the captured high resolution imaging content into respective portions; feeding the split up portions to respective imaging encoders; packing encoded content from the respective imaging encoders into an A/V container; and storing and/or transmitting the A/V container. In another embodiment, the method includes retrieving and/or receiving an A/V container; splitting up the retrieved and/or received A/V container into respective portions; feeding the split up portions to respective imaging decoders; stitching the decoded imaging portions into a common imaging portion; and storing and/or displaying at least a portion of the common imaging portion.

    Apparatus and methods for pre-processing and stabilization of captured image data

    公开(公告)号:US11050938B2

    公开(公告)日:2021-06-29

    申请号:US16503320

    申请日:2019-07-03

    Applicant: GoPro, Inc.

    Inventor: David Newman

    Abstract: Apparatus and methods for the pre-processing of image data so as to enhance quality of subsequent encoding and rendering. In one embodiment, a capture device is disclosed that includes a processing apparatus and a non-transitory computer readable apparatus comprising a storage medium have one or more instructions stored thereon. The one or more instructions, when executed by the processing apparatus, are configured to: receive captured image data (such as that sourced from two or more separate image sensors) and pre-process the data to enable stabilization of the corresponding images prior to encoding. In some implementations, the pre-processing includes combination (e.g., stitching) of the captured image data associated with the two or more sensors to facilitate the stabilization. Advantageously, undesirable artifacts such as object “jitter” can be reduced or eliminated. Methods and non-transitory computer readable apparatus are also disclosed.

    Apparatus and Methods for Non-Uniform Downsampling of Captured Panoramic Images

    公开(公告)号:US20210174470A1

    公开(公告)日:2021-06-10

    申请号:US17132379

    申请日:2020-12-23

    Applicant: GoPro, Inc.

    Abstract: Apparatus and methods for the non-uniform downsampling of captured panoramic images. In one embodiment, a computing device is disclosed that includes a processing apparatus and a non-transitory computer readable apparatus comprising a storage medium have one or more instructions stored thereon. The one or more instructions, when executed by the processing apparatus, being configured to: receive captured images, the captured images obtained using two or more image sensors; non-uniformly downsample the received captured images; and encode the non-uniformly downsampled images. In some variants, the non-uniformly downsampled images take into account a desired area of interest within the captured images. In some implementations, the computing device includes an image capture device. Methods and non-transitory computer readable apparatus are also disclosed.

    Methods and apparatus for multi-encoder processing of high resolution content

    公开(公告)号:US11024008B1

    公开(公告)日:2021-06-01

    申请号:US16781953

    申请日:2020-02-04

    Applicant: GoPro, Inc.

    Abstract: Methods and apparatus for multi-encoder processing of high resolution content. In one embodiment, the method includes capturing high resolution imaging content; splitting up the captured high resolution imaging content into respective portions; feeding the split up portions to respective imaging encoders; packing encoded content from the respective imaging encoders into an A/V container; and storing and/or transmitting the A/V container. In another embodiment, the method includes retrieving and/or receiving an A/V container; splitting up the retrieved and/or received A/V container into respective portions; feeding the split up portions to respective imaging decoders; stitching the decoded imaging portions into a common imaging portion; and storing and/or displaying at least a portion of the common imaging portion.

Patent Agency Ranking