公开(公告)号：US11282547B1

公开(公告)日：2022-03-22

申请号：US17006486

申请日：2020-08-28

Applicant: GoPro, Inc.

Inventor： Steven Fortunato ,  Daryl Stimm

IPC: G06F3/048 ,  G11B27/34 ,  G06F3/04842 ,  G06F3/0482 ,  G11B27/10 ,  G06F3/04847

Abstract: A graphical user interface for framing a video may include a framing element. Responsive to user interaction with the framing element, a framing of the video at a moment may be determined. The framing of the video may define viewing direction, viewing size, viewing rotation, and/or viewing projection for a viewing window. The framing of the video at the moment may be determined based on how the video is being presented when the user interacted with the framing element.

公开(公告)号：US20220060738A1

公开(公告)日：2022-02-24

申请号：US17453217

申请日：2021-11-02

Applicant: GoPro, Inc.

Inventor： David A. Newman ,  Cesar Douady ,  Alexis Lefebvre ,  Daryl Stimm ,  Michael Kraak

IPC: H04N19/52 ,  H04N19/182 ,  G06T3/00 ,  H04N19/40 ,  H04N19/196

Abstract: Methods and apparatus for processing of video content to optimize codec bandwidth. In one embodiment, the method includes capturing panoramic imaging content (e.g., a 360° panorama), mapping the panoramic imaging content into an equi-angular cubemap (EAC) format, and splitting the EAC format into segments for transmission to maximize codec bandwidth. In one exemplary embodiment, the EAC segments are transmitted at a different frame rate than the subsequent display rate of the panoramic imaging content. For example, the mapping and frame rate may be chosen to enable the rendering of 8K, 360° content at 24 fps, using commodity encoder hardware and software that nominally supports 4K content at 60 fps.

公开(公告)号：US20210392375A1

公开(公告)日：2021-12-16

申请号：US17460880

申请日：2021-08-30

Applicant: GoPro, Inc.

Inventor： David A. Newman ,  Cesar Douady ,  Alexis Lefebvre ,  Daryl Stimm ,  Michael Kraak

IPC: H04N19/597 ,  H04N19/176 ,  H04N19/146 ,  H04N19/13

Abstract: Methods and apparatus for processing of video content to optimize codec bandwidth. In one embodiment, the method includes capturing panoramic imaging content (e.g., a 360° panorama), mapping the panoramic imaging content into an equi-angular cubemap (EAC) format, and splitting the EAC format into segments for transmission to maximize codec bandwidth. In one exemplary embodiment, the EAC segments are transmitted at a different frame rate than the subsequent display rate of the panoramic imaging content. For example, the mapping and frame rate may be chosen to enable the rendering of 8K, 360° content at 24 fps, using commodity encoder hardware and software that nominally supports 4K content at 60 fps.

公开(公告)号：US20210329215A1

公开(公告)日：2021-10-21

申请号：US17361070

申请日：2021-06-28

Applicant: GOPRO, INC.

Inventor： Daryl Stimm ,  William Edward MacDonald ,  Kyler William Schwartz

IPC: H04N13/167 ,  H04N13/117

Abstract: A viewing direction may define an angle/visual portion of a spherical video at which a viewing window is directed. A trajectory of viewing direction may include changes in viewing directions for playback of spherical video. Abrupt changes in the viewing directions may result in jerky or shaky views of the spherical video. Changes in the viewing directions may be stabilized to provide stabilized views of the spherical video. Amount of stabilization may be limited by a margin constraint.

公开(公告)号：US20210287337A1

公开(公告)日：2021-09-16

申请号：US17332953

申请日：2021-05-27

Applicant: GoPro, Inc.

Inventor： David Newman ,  Daryl Stimm ,  Adeel Abbas

IPC: G06T3/40 ,  H04N19/80 ,  G06T3/00

Abstract: Methods and apparatus for multi-encoder processing of high resolution content. In one embodiment, the method includes capturing high resolution imaging content; splitting up the captured high resolution imaging content into respective portions; feeding the split up portions to respective imaging encoders; packing encoded content from the respective imaging encoders into an A/V container; and storing and/or transmitting the A/V container. In another embodiment, the method includes retrieving and/or receiving an A/V container; splitting up the retrieved and/or received A/V container into respective portions; feeding the split up portions to respective imaging decoders; stitching the decoded imaging portions into a common imaging portion; and storing and/or displaying at least a portion of the common imaging portion.

公开(公告)号：US11109067B2

公开(公告)日：2021-08-31

申请号：US16730839

申请日：2019-12-30

Applicant: GoPro, Inc.

Inventor： David A. Newman ,  Cesar Douady ,  Alexis Lefebvre ,  Daryl Stimm ,  Michael Kraak

IPC: H04N19/597 ,  H04N19/176 ,  H04N19/146 ,  H04N19/13

Abstract: Methods and apparatus for processing of video content to optimize codec bandwidth. In one embodiment, the method includes capturing panoramic imaging content (e.g., a 360° panorama), mapping the panoramic imaging content into an equi-angular cubemap (EAC) format, and splitting the EAC format into segments for transmission to maximize codec bandwidth. In one exemplary embodiment, the EAC segments are transmitted at a different frame rate than the subsequent display rate of the panoramic imaging content. For example, the mapping and frame rate may be chosen to enable the rendering of 8K, 360-degree content at 24 fps, using commodity encoder hardware and software that nominally supports 4K content at 60 fps.

公开(公告)号：US20210174470A1

公开(公告)日：2021-06-10

申请号：US17132379

申请日：2020-12-23

Applicant: GoPro, Inc.

Inventor： Daryl Stimm ,  David Newman

IPC: G06T3/40 ,  H04N5/232 ,  H04N7/01 ,  H04N19/196

Abstract: Apparatus and methods for the non-uniform downsampling of captured panoramic images. In one embodiment, a computing device is disclosed that includes a processing apparatus and a non-transitory computer readable apparatus comprising a storage medium have one or more instructions stored thereon. The one or more instructions, when executed by the processing apparatus, being configured to: receive captured images, the captured images obtained using two or more image sensors; non-uniformly downsample the received captured images; and encode the non-uniformly downsampled images. In some variants, the non-uniformly downsampled images take into account a desired area of interest within the captured images. In some implementations, the computing device includes an image capture device. Methods and non-transitory computer readable apparatus are also disclosed.

公开(公告)号：US11024008B1

公开(公告)日：2021-06-01

申请号：US16781953

申请日：2020-02-04

Applicant: GoPro, Inc.

Inventor： David Newman ,  Daryl Stimm ,  Adeel Abbas

IPC: G06T3/40 ,  G06T3/00 ,  H04N19/80

Abstract: Methods and apparatus for multi-encoder processing of high resolution content. In one embodiment, the method includes capturing high resolution imaging content; splitting up the captured high resolution imaging content into respective portions; feeding the split up portions to respective imaging encoders; packing encoded content from the respective imaging encoders into an A/V container; and storing and/or transmitting the A/V container. In another embodiment, the method includes retrieving and/or receiving an A/V container; splitting up the retrieved and/or received A/V container into respective portions; feeding the split up portions to respective imaging decoders; stitching the decoded imaging portions into a common imaging portion; and storing and/or displaying at least a portion of the common imaging portion.

公开(公告)号：US11004176B1

公开(公告)日：2021-05-11

申请号：US16781946

申请日：2020-02-04

Applicant: GoPro, Inc.

Inventor： David Newman ,  Daryl Stimm ,  Adeel Abbas

IPC: G06T3/40 ,  G06T3/00 ,  H04N19/80

Abstract: Methods and apparatus for multi-encoder processing of high resolution content. In one embodiment, the method includes capturing high resolution imaging content; splitting up the captured high resolution imaging content into respective portions; feeding the split up portions to respective imaging encoders; packing encoded content from the respective imaging encoders into an A/V container; and storing and/or transmitting the A/V container. In another embodiment, the method includes retrieving and/or receiving an A/V container; splitting up the retrieved and/or received A/V container into respective portions; feeding the split up portions to respective imaging decoders; stitching the decoded imaging portions into a common imaging portion; and storing and/or displaying at least a portion of the common imaging portion.

公开(公告)号：US20240388801A1

公开(公告)日：2024-11-21

申请号：US18787025

申请日：2024-07-29

Applicant: GoPro, Inc.

Inventor： Daryl Stimm ,  Kyler William Schwartz ,  Kevin Marcus Grant

IPC: H04N23/68 ,  H04N5/14

Abstract: Positions of an image capture device during capture of a video may be transferred to a computing device before the video is transferred to the computing device. The positions of the image capture device may be used to determine a viewing window for the video before the video is obtained. The viewing window may be used to present a stabilized view of the video when the video is obtained. For example, a stabilized view of the video may be presented as the video is streamed to the computing device.