Systems, methods and apparatus for compressing video content

    公开(公告)号:US11228749B2

    公开(公告)日:2022-01-18

    申请号:US16866447

    申请日:2020-05-04

    Applicant: GoPro, Inc.

    Abstract: Apparatus and methods for characterizing panoramic content, such as by a wide field of view and large image size. In one implementation, a panoramic image may be mapped to a cube or any other projection e.g icosahedron or octahedron. The disclosure exploits content continuity between facets, such as in the case of encoding/decoding cube-projected images. One facet may be encoded/decoded independently from other facets to obtain a seed facet. One or more transformed versions of the seed facet may be obtained; e.g., one corresponding to a 90° counterclockwise rotation, another to a 90° clockwise rotation, and one to an 180° rotation. Transformed versions may be used to form an augmented image. The remaining facets of the cube may be encoded using transformed versions within the augmented image. Continuity between transformed facets in the top row of the augmented image and facets in the middle row of the augmented image may be utilized for motion or intra prediction, and to obtain greater encoding performance compared to encoding facets independently.

    Systems and methods for generating viewpoints for visual content based on gaze

    公开(公告)号:US11061474B2

    公开(公告)日:2021-07-13

    申请号:US16884565

    申请日:2020-05-27

    Applicant: GoPro, Inc.

    Inventor: David Newman

    Abstract: Visual information defining visual content may be accessed. The visual content may include one or more views of one or more scenes. The scene(s) may include one or more human subjects. Gaze directions of the human subject(s) may be determined. The gaze directions may indicate one or more viewing directions in which the human subject(s) are looking. One or more directions of view for the visual content may be determined based on the gaze directions of the human subject(s). The direction(s) of view may include one or more of the viewing directions looked at by the human subject(s). The visual content may be presented on a display based on the direction(s) of view for the visual content.

    Methods and apparatus for multi-encoder processing of high resolution content

    公开(公告)号:US11049219B2

    公开(公告)日:2021-06-29

    申请号:US16234396

    申请日:2018-12-27

    Applicant: GOPRO, INC.

    Abstract: Methods and apparatus for multi-encoder processing of high resolution content. In one embodiment, the method includes capturing high resolution imaging content; splitting up the captured high resolution imaging content into respective portions; feeding the split up portions to respective imaging encoders; packing encoded content from the respective imaging encoders into an A/V container; and storing and/or transmitting the A/V container. In another embodiment, the method includes retrieving and/or receiving an A/V container; splitting up the retrieved and/or received A/V container into respective portions; feeding the split up portions to respective imaging decoders; stitching the decoded imaging portions into a common imaging portion; and storing and/or displaying at least a portion of the common imaging portion.

    SYSTEMS AND METHODS FOR MODIFYING IMAGE DISTORTION (CURVATURE) FOR VIEWING DISTANCE IN POST CAPTURE

    公开(公告)号:US20210042877A1

    公开(公告)日:2021-02-11

    申请号:US17079404

    申请日:2020-10-23

    Applicant: GoPro, Inc.

    Abstract: Systems and methods for modifying image distortion (curvature) for viewing distance in post capture. Presentation of imaging content on a content display device may be characterized by a presentation field of view (FOV). Presentation FOV may be configured based on screen dimensions of the display device and distance between the viewer and the screen. Imaging content may be obtained by an activity capture device characterized by a wide capture field of view lens (e.g., fish-eye). Images may be transformed into rectilinear representation for viewing. When viewing images using presentation FOV that may narrower than capture FOV, transformed rectilinear images may appear distorted. A transformation operation may be configured to account for presentation FOV—capture FOV mismatch. In some implementations, the transformation may include fish-eye to rectilinear transformation characterized by a transformation strength that may be configured based on a ratio of the presentation FOV to the capture FOV.

    APPARATUS AND METHODS FOR NON-UNIFORM PROCESSING OF IMAGE DATA

    公开(公告)号:US20210004932A1

    公开(公告)日:2021-01-07

    申请号:US16503336

    申请日:2019-07-03

    Applicant: GoPro, Inc.

    Abstract: Methods and apparatus for processing of high resolution content so as to obey desired encoder constraints. In one embodiment, the method includes capturing high resolution imaging spherical content; mapping the spherical content to another frame of reference (e.g., a non-uniform mapping and scaling) splitting up the mapped and scaled content into respective portions; feeding the split up portions to respective imaging encoders; packing encoded content from the respective imaging encoders into an A/V container; and storing and/or transmitting the A/V container. In one variant, the mapping and scaling are chosen to enable rendering of 1080P content in a desired scope or range (e.g., 360 degrees) using commodity encoder hardware and software.

    Methods and apparatus for block-based layout for non-rectangular regions between non-contiguous imaging regions

    公开(公告)号:US10728551B2

    公开(公告)日:2020-07-28

    申请号:US16143224

    申请日:2018-09-26

    Applicant: GoPro, Inc.

    Abstract: Apparatus and methods for providing block-based layouts for non-rectangular regions between non-contiguous imaging regions in projections such as, for example, Rotated Sphere Projections (RSP). In one embodiment, methods and apparatus for selecting coding unit block sizes for non-rectangular regions disposed between non-contiguous imaging portions is disclosed. The methods and apparatus may be configured to obtain a frame of captured imaging content, the frame of captured imaging content including the non-rectangular regions disposed between the non-contiguous imaging portions; select a plurality of differing coding block sizes for each of a plurality of regions located within the non-rectangular regions disposed between the non-contiguous imaging portions; determine which one of the plurality of differing coding block sizes optimizes an encoding efficiency for the obtained frame of captured imaging content; and encode the obtained frame of captured imaging content in accordance with the determined one off the plurality of differing coding block sizes.

    Storage of metadata and images
    18.
    发明授权

    公开(公告)号:US10678844B2

    公开(公告)日:2020-06-09

    申请号:US15924904

    申请日:2018-03-19

    Applicant: GoPro, Inc.

    Abstract: Media capture apparatus and methods for obtaining metadata. Metadata may be collected and stored in a container independent of audio and/or image (media) content. Some container implementations may be configured to store metadata for a given interval, and media content for a portion of the interval. In action camera implementations, metadata may provide a context related to time, physical conditions of a person, location, surroundings of the video capture. In event recording applications, the metadata container may provide information related to a timeline of the event, environmental conditions, proximity of other capture devices. Metadata may be utilized for processing, viewing, and/or sharing of media content. Individual capture devices may communicate and/or combine metadata to one another in order to expand metadata content. Metadata, video and/or images may be shared between users and/or devices using a container.

    Apparatus and methods for video compression using multi-resolution scalable coding

    公开(公告)号:US10652558B2

    公开(公告)日:2020-05-12

    申请号:US16234214

    申请日:2018-12-27

    Applicant: GoPro, Inc.

    Abstract: Apparatus and methods for digital video data compression via a scalable, multi-resolution approach. In one embodiment, the video content may be encoded using a multi-resolution and/or multi-quality scalable coding approach that reduces computational and/or energy load on a client device. In one implementation, a low fidelity image is obtained based on a first full resolution image. The low fidelity image may be encoded to obtain a low fidelity bitstream. A second full resolution image may be obtained based on the low fidelity bitstream. A portion of a difference image obtained based on the second full resolution image and the first full resolution may be encoded to obtain a high fidelity bitstream. The low fidelity bitstream and the high fidelity bitstream may be provided to e.g., a receiving device.

    Apparatus and methods for video compression

    公开(公告)号:US10602191B2

    公开(公告)日:2020-03-24

    申请号:US15415603

    申请日:2017-01-25

    Applicant: GoPro, Inc.

    Abstract: Panoramic content may be characterized by a wide field of view and large image size. Panoramic image may be mapped to cube projection. When encoding/decoding cube-projected images, the disclosure exploits content continuity between cube facets. One facet may be encoded/decoded independently from other facets to obtain a seed facet. One or more transformed versions of the seed facet may be obtained, for example, one corresponding to a 90° counterclockwise rotation, another to a 90° clockwise rotation, and one to an 180° rotation. Transformed versions may be used to form an augmented image. The remained facets of the cube may be encoded using transformed versions within the augmented image. Boundary filtering may be applied to one or more edges of one or more facets.

Patent Agency Ranking