-
公开(公告)号:US11228749B2
公开(公告)日:2022-01-18
申请号:US16866447
申请日:2020-05-04
Applicant: GoPro, Inc.
Inventor: Adeel Abbas , Balineedu Chowdary Adsumilli , David Newman
IPC: H04N13/111 , H04N13/194 , H04N13/243 , H04N13/344 , H04N13/161 , H04N13/282 , H04N5/232 , H04N19/597 , H04N5/225
Abstract: Apparatus and methods for characterizing panoramic content, such as by a wide field of view and large image size. In one implementation, a panoramic image may be mapped to a cube or any other projection e.g icosahedron or octahedron. The disclosure exploits content continuity between facets, such as in the case of encoding/decoding cube-projected images. One facet may be encoded/decoded independently from other facets to obtain a seed facet. One or more transformed versions of the seed facet may be obtained; e.g., one corresponding to a 90° counterclockwise rotation, another to a 90° clockwise rotation, and one to an 180° rotation. Transformed versions may be used to form an augmented image. The remaining facets of the cube may be encoded using transformed versions within the augmented image. Continuity between transformed facets in the top row of the augmented image and facets in the middle row of the augmented image may be utilized for motion or intra prediction, and to obtain greater encoding performance compared to encoding facets independently.
-
公开(公告)号:US11061474B2
公开(公告)日:2021-07-13
申请号:US16884565
申请日:2020-05-27
Applicant: GoPro, Inc.
Inventor: David Newman
Abstract: Visual information defining visual content may be accessed. The visual content may include one or more views of one or more scenes. The scene(s) may include one or more human subjects. Gaze directions of the human subject(s) may be determined. The gaze directions may indicate one or more viewing directions in which the human subject(s) are looking. One or more directions of view for the visual content may be determined based on the gaze directions of the human subject(s). The direction(s) of view may include one or more of the viewing directions looked at by the human subject(s). The visual content may be presented on a display based on the direction(s) of view for the visual content.
-
公开(公告)号:US11049219B2
公开(公告)日:2021-06-29
申请号:US16234396
申请日:2018-12-27
Applicant: GOPRO, INC.
Inventor: David Newman , Daryl Stimm , Adeel Abbas
Abstract: Methods and apparatus for multi-encoder processing of high resolution content. In one embodiment, the method includes capturing high resolution imaging content; splitting up the captured high resolution imaging content into respective portions; feeding the split up portions to respective imaging encoders; packing encoded content from the respective imaging encoders into an A/V container; and storing and/or transmitting the A/V container. In another embodiment, the method includes retrieving and/or receiving an A/V container; splitting up the retrieved and/or received A/V container into respective portions; feeding the split up portions to respective imaging decoders; stitching the decoded imaging portions into a common imaging portion; and storing and/or displaying at least a portion of the common imaging portion.
-
14.
公开(公告)号:US20210042877A1
公开(公告)日:2021-02-11
申请号:US17079404
申请日:2020-10-23
Applicant: GoPro, Inc.
Inventor: David Newman , Balineedu Chowdary Adsumilli
Abstract: Systems and methods for modifying image distortion (curvature) for viewing distance in post capture. Presentation of imaging content on a content display device may be characterized by a presentation field of view (FOV). Presentation FOV may be configured based on screen dimensions of the display device and distance between the viewer and the screen. Imaging content may be obtained by an activity capture device characterized by a wide capture field of view lens (e.g., fish-eye). Images may be transformed into rectilinear representation for viewing. When viewing images using presentation FOV that may narrower than capture FOV, transformed rectilinear images may appear distorted. A transformation operation may be configured to account for presentation FOV—capture FOV mismatch. In some implementations, the transformation may include fish-eye to rectilinear transformation characterized by a transformation strength that may be configured based on a ratio of the presentation FOV to the capture FOV.
-
公开(公告)号:US20210004932A1
公开(公告)日:2021-01-07
申请号:US16503336
申请日:2019-07-03
Applicant: GoPro, Inc.
Inventor: David Newman , Cesar Douady
IPC: G06T3/40 , H04N13/156 , H04N13/178 , G06T3/00
Abstract: Methods and apparatus for processing of high resolution content so as to obey desired encoder constraints. In one embodiment, the method includes capturing high resolution imaging spherical content; mapping the spherical content to another frame of reference (e.g., a non-uniform mapping and scaling) splitting up the mapped and scaled content into respective portions; feeding the split up portions to respective imaging encoders; packing encoded content from the respective imaging encoders into an A/V container; and storing and/or transmitting the A/V container. In one variant, the mapping and scaling are chosen to enable rendering of 1080P content in a desired scope or range (e.g., 360 degrees) using commodity encoder hardware and software.
-
公开(公告)号:US10827157B1
公开(公告)日:2020-11-03
申请号:US16409499
申请日:2019-05-10
Applicant: GoPro, Inc.
Inventor: Nicholas Ryan Gilmour , David Newman , Vadim Polonichko , Tyler Gee , Jessica Bonner
IPC: H04N9/802 , G11B27/00 , G11B27/036 , H04N5/225
Abstract: An image capture device may capture visual content during a visual capture duration and audio content during an audio capture duration. The audio capture duration may be shorter than the visual capture duration. The captured audio content may provide audio for playback of the captured visual content.
-
公开(公告)号:US10728551B2
公开(公告)日:2020-07-28
申请号:US16143224
申请日:2018-09-26
Applicant: GoPro, Inc.
Inventor: Adeel Abbas , David Newman
IPC: H04N19/119 , H04N19/124 , H04N19/14 , H04N19/172 , H04N19/176
Abstract: Apparatus and methods for providing block-based layouts for non-rectangular regions between non-contiguous imaging regions in projections such as, for example, Rotated Sphere Projections (RSP). In one embodiment, methods and apparatus for selecting coding unit block sizes for non-rectangular regions disposed between non-contiguous imaging portions is disclosed. The methods and apparatus may be configured to obtain a frame of captured imaging content, the frame of captured imaging content including the non-rectangular regions disposed between the non-contiguous imaging portions; select a plurality of differing coding block sizes for each of a plurality of regions located within the non-rectangular regions disposed between the non-contiguous imaging portions; determine which one of the plurality of differing coding block sizes optimizes an encoding efficiency for the obtained frame of captured imaging content; and encode the obtained frame of captured imaging content in accordance with the determined one off the plurality of differing coding block sizes.
-
公开(公告)号:US10678844B2
公开(公告)日:2020-06-09
申请号:US15924904
申请日:2018-03-19
Applicant: GoPro, Inc.
Inventor: David Newman , Mark Vaden , Rolf Fischer
Abstract: Media capture apparatus and methods for obtaining metadata. Metadata may be collected and stored in a container independent of audio and/or image (media) content. Some container implementations may be configured to store metadata for a given interval, and media content for a portion of the interval. In action camera implementations, metadata may provide a context related to time, physical conditions of a person, location, surroundings of the video capture. In event recording applications, the metadata container may provide information related to a timeline of the event, environmental conditions, proximity of other capture devices. Metadata may be utilized for processing, viewing, and/or sharing of media content. Individual capture devices may communicate and/or combine metadata to one another in order to expand metadata content. Metadata, video and/or images may be shared between users and/or devices using a container.
-
公开(公告)号:US10652558B2
公开(公告)日:2020-05-12
申请号:US16234214
申请日:2018-12-27
Applicant: GoPro, Inc.
Inventor: Adeel Abbas , Balineedu Chowdary Adsumilli , David Newman
IPC: H04N19/30 , H04N19/187 , H04N19/167 , H04N19/29 , H04N19/146 , H04N19/59
Abstract: Apparatus and methods for digital video data compression via a scalable, multi-resolution approach. In one embodiment, the video content may be encoded using a multi-resolution and/or multi-quality scalable coding approach that reduces computational and/or energy load on a client device. In one implementation, a low fidelity image is obtained based on a first full resolution image. The low fidelity image may be encoded to obtain a low fidelity bitstream. A second full resolution image may be obtained based on the low fidelity bitstream. A portion of a difference image obtained based on the second full resolution image and the first full resolution may be encoded to obtain a high fidelity bitstream. The low fidelity bitstream and the high fidelity bitstream may be provided to e.g., a receiving device.
-
公开(公告)号:US10602191B2
公开(公告)日:2020-03-24
申请号:US15415603
申请日:2017-01-25
Applicant: GoPro, Inc.
Inventor: Adeel Abbas , David Newman
Abstract: Panoramic content may be characterized by a wide field of view and large image size. Panoramic image may be mapped to cube projection. When encoding/decoding cube-projected images, the disclosure exploits content continuity between cube facets. One facet may be encoded/decoded independently from other facets to obtain a seed facet. One or more transformed versions of the seed facet may be obtained, for example, one corresponding to a 90° counterclockwise rotation, another to a 90° clockwise rotation, and one to an 180° rotation. Transformed versions may be used to form an augmented image. The remained facets of the cube may be encoded using transformed versions within the augmented image. Boundary filtering may be applied to one or more edges of one or more facets.
-
-
-
-
-
-
-
-
-