公开(公告)号：US11024008B1

公开(公告)日：2021-06-01

申请号：US16781953

申请日：2020-02-04

Applicant: GoPro, Inc.

Inventor： David Newman ,  Daryl Stimm ,  Adeel Abbas

IPC: G06T3/40 ,  G06T3/00 ,  H04N19/80

Abstract: Methods and apparatus for multi-encoder processing of high resolution content. In one embodiment, the method includes capturing high resolution imaging content; splitting up the captured high resolution imaging content into respective portions; feeding the split up portions to respective imaging encoders; packing encoded content from the respective imaging encoders into an A/V container; and storing and/or transmitting the A/V container. In another embodiment, the method includes retrieving and/or receiving an A/V container; splitting up the retrieved and/or received A/V container into respective portions; feeding the split up portions to respective imaging decoders; stitching the decoded imaging portions into a common imaging portion; and storing and/or displaying at least a portion of the common imaging portion.

公开(公告)号：US11004176B1

公开(公告)日：2021-05-11

申请号：US16781946

申请日：2020-02-04

Applicant: GoPro, Inc.

Inventor： David Newman ,  Daryl Stimm ,  Adeel Abbas

IPC: G06T3/40 ,  G06T3/00 ,  H04N19/80

Abstract: Methods and apparatus for multi-encoder processing of high resolution content. In one embodiment, the method includes capturing high resolution imaging content; splitting up the captured high resolution imaging content into respective portions; feeding the split up portions to respective imaging encoders; packing encoded content from the respective imaging encoders into an A/V container; and storing and/or transmitting the A/V container. In another embodiment, the method includes retrieving and/or receiving an A/V container; splitting up the retrieved and/or received A/V container into respective portions; feeding the split up portions to respective imaging decoders; stitching the decoded imaging portions into a common imaging portion; and storing and/or displaying at least a portion of the common imaging portion.

公开(公告)号：US10999483B2

公开(公告)日：2021-05-04

申请号：US16431622

申请日：2019-06-04

Applicant: GoPro, Inc.

Inventor： David Newman

IPC: H04N5/225 ,  G06T7/80 ,  H04N9/04 ,  G06T5/50 ,  H04N5/235 ,  H04N5/243

Abstract: Apparatus and methods for a light-field camera and display system. In one embodiment, a light-field camera and display apparatus is provided, which may include a display screen and photosensor layer. In one variant, the display screen includes a plurality of pinholes or microlenses and a plurality of pixels configured according to a certain configuration. Additionally, in one variant, the photosensor layer includes multiple arrays of photosensors implemented to capture light that travels through the pinholes or microlenses. Yet additionally, methods for operating and calibrating the light-field camera and display apparatus are provided. In one embodiment, logic is provided which subtracts leakage light from the generated image that is displayed to the user.

公开(公告)号：US10997693B2

公开(公告)日：2021-05-04

申请号：US16503336

申请日：2019-07-03

Applicant: GoPro, Inc.

Inventor： David Newman ,  Cesar Douady

IPC: G06T3/40 ,  G06T3/00 ,  H04N13/178 ,  H04N13/156

Abstract: Methods and apparatus for processing of high resolution content so as to obey desired encoder constraints. In one embodiment, the method includes capturing high resolution imaging spherical content; mapping the spherical content to another frame of reference (e.g., a non-uniform mapping and scaling) splitting up the mapped and scaled content into respective portions; feeding the split up portions to respective imaging encoders; packing encoded content from the respective imaging encoders into an A/V container; and storing and/or transmitting the A/V container. In one variant, the mapping and scaling are chosen to enable rendering of 1080P content in a desired scope or range (e.g., 360 degrees) using commodity encoder hardware and software.

公开(公告)号：US20210006719A1

公开(公告)日：2021-01-07

申请号：US16503320

申请日：2019-07-03

Applicant: GoPro, Inc.

Inventor： David Newman

IPC: H04N5/232 ,  G06T3/40 ,  H04N19/15

Abstract: Apparatus and methods for the pre-processing of image data so as to enhance quality of subsequent encoding and rendering. In one embodiment, a capture device is disclosed that includes a processing apparatus and a non-transitory computer readable apparatus comprising a storage medium have one or more instructions stored thereon. The one or more instructions, when executed by the processing apparatus, are configured to: receive captured image data (such as that sourced from two or more separate image snesors) and pre-process the data to enable stabilization of the corresponding images priro to encoding. In some implementations, the pre-processing includes combination (e.g., stitching) of the captured image data associated with the two or more sensors to facilitates the stabilization. Advantageously, undesirable artifacts such as object “jitter” can be reduced or eliminated. Methods and non-transitory computer readable apparatus are also disclosed.

公开(公告)号：US20200285315A1

公开(公告)日：2020-09-10

申请号：US16884565

申请日：2020-05-27

Applicant: GoPro, Inc.

Inventor： David Newman

IPC: G06F3/01 ,  G06K9/00 ,  H04N5/232

Abstract: Visual information defining visual content may be accessed. The visual content may include one or more views of one or more scenes. The scene(s) may include one or more human subjects. Gaze directions of the human subject(s) may be determined. The gaze directions may indicate one or more viewing directions in which the human subject(s) are looking. One or more directions of view for the visual content may be determined based on the gaze directions of the human subject(s). The direction(s) of view may include one or more of the viewing directions looked at by the human subject(s). The visual content may be presented on a display based on the direction(s) of view for the visual content.

公开(公告)号：US10686967B2

公开(公告)日：2020-06-16

申请号：US16537290

申请日：2019-08-09

Applicant: GoPro, Inc.

Inventor： David Newman ,  Gregory Oaul Stewart

IPC: H04N5/073

Abstract: Multiple image capture devices may individually generate time information and capture images. Individual image captures devices may receive time information of other image capture device(s). Individual image capture devices may transmit its time information to other image capture device(s) independent of reception of the time information of other image capture device(s). Individual image capture devices may generate time synchronization information for the captured images based on its time information and the received time information of other image capture device(s). Images captured by different image capture devices may be time-synchronized based on at least one of generated time-synchronization information.

公开(公告)号：US10402938B1

公开(公告)日：2019-09-03

申请号：US15476884

申请日：2017-03-31

Applicant: GOPRO, INC.

Inventor： David Newman ,  Balu Adsumilli

IPC: G06T3/00 ,  H04N5/232 ,  G06K9/20 ,  H04N5/262

Abstract: Systems and methods for modifying image distortion (curvature) for viewing distance in post capture. Presentation of imaging content on a content display device may be characterized by a presentation field of view (FOV). Presentation FOV may be configured based on screen dimensions of the display device and distance between the viewer and the screen. Imaging content may be obtained by an activity capture device characterized by a wide capture field of view lens (e.g., fish-eye). Images may be transformed into rectilinear representation for viewing. When viewing images using presentation FOV that may narrower than capture FOV, transformed rectilinear images may appear distorted. A transformation operation may be configured to account for presentation FOV-capture FOV mismatch. In some implementations, the transformation may include fish-eye to rectilinear transformation characterized by a transformation strength that may be configured based on a ratio of the presentation FOV to the capture FOV.

公开(公告)号：US20190246126A1

公开(公告)日：2019-08-08

申请号：US16234214

申请日：2018-12-27

Applicant: GoPro, Inc.

Inventor： Adeel Abbas ,  Balineedu Chowdary Adsumilli ,  David Newman

IPC: H04N19/30 ,  H04N19/29 ,  H04N19/167 ,  H04N19/146 ,  H04N19/59 ,  H04N19/187

CPC classification number: H04N19/30 ,  H04N19/146 ,  H04N19/167 ,  H04N19/187 ,  H04N19/29 ,  H04N19/59

Abstract: Apparatus and methods for digital video data compression via a scalable, multi-resolution approach. In one embodiment, the video content may be encoded using a multi-resolution and/or multi-quality scalable coding approach that reduces computational and/or energy load on a client device. In one implementation, a low fidelity image is obtained based on a first full resolution image. The low fidelity image may be encoded to obtain a low fidelity bitstream. A second full resolution image may be obtained based on the low fidelity bitstream. A portion of a difference image obtained based on the second full resolution image and the first full resolution may be encoded to obtain a high fidelity bitstream. The low fidelity bitstream and the high fidelity bitstream may be provided to e.g., a receiving device.

公开(公告)号：US20190012332A1

公开(公告)日：2019-01-10

申请号：US16131542

申请日：2018-09-14

Applicant: GoPro, Inc.

Inventor： David Newman ,  Mark Vaden ,  Rolf Fischer ,  Vadim Polonichko

IPC: G06F17/30 ,  H04N5/247 ,  H04N1/00 ,  H04N1/21

CPC classification number: G06F16/58 ,  G06F16/78 ,  H04N1/00209 ,  H04N1/2112 ,  H04N1/2158 ,  H04N5/23206 ,  H04N5/23245 ,  H04N5/23254 ,  H04N5/23293 ,  H04N5/247

Abstract: Content proxy may be obtained. Content may include video captured by an action camera. Content proxy may include metadata information obtained contemporaneous with the content and stored in a session container. Content proxy may include lower data rate version of the content (thumbnails). Content proxy information may be viewed and/or analyzed in order to obtain one or more highlights. Content portion corresponding to the highlight may be obtained. Multiple versions of content proxy obtained by multiple cameras may be used to identify, display, and/or share content portions in a multi-camera/multiuser applications.