公开(公告)号：US12022227B2

公开(公告)日：2024-06-25

申请号：US18349929

申请日：2023-07-10

Applicant: GoPro, Inc.

Inventor： Adeel Abbas ,  Cesar Douady ,  Timothy MacMillan

IPC: H04N5/265 ,  H04N7/18 ,  H04N23/698 ,  H04N23/90

CPC classification number: H04N5/265 ,  H04N7/181 ,  H04N23/698 ,  H04N23/90

Abstract: Apparatus and methods for stitching images, or re-stitching previously stitched images. Specifically, the disclosed systems in one implementation save stitching information and/or original overlap source data during an original stitching process. During subsequent retrieval, rendering, and/or display of the stitched images, the originally stitched image can be flexibly augmented, and/or re-stitched to improve the original stitch quality. Practical applications of the disclosed solutions enable, among other things, a user to create and stitch a wide field of view (FOV) panorama from multiple source images on a device with limited processing capability (such as a mobile phone or other capture device). Moreover, post-processing stitching allows for the user to convert from one image projection to another without fidelity loss (or with an acceptable level of loss).

公开(公告)号：US20230362319A1

公开(公告)日：2023-11-09

申请号：US18349929

申请日：2023-07-10

Applicant: GoPro, Inc.

Inventor： Adeel Abbas ,  Cesar Douady ,  Timothy MacMillan

IPC: H04N5/265 ,  H04N7/18 ,  H04N23/90 ,  H04N23/698

CPC classification number: H04N5/265 ,  H04N7/181 ,  H04N23/90 ,  H04N23/698

Abstract: Apparatus and methods for stitching images, or re-stitching previously stitched images. Specifically, the disclosed systems in one implementation save stitching information and/or original overlap source data during an original stitching process. During subsequent retrieval, rendering, and/or display of the stitched images, the originally stitched image can be flexibly augmented, and/or re-stitched to improve the original stitch quality. Practical applications of the disclosed solutions enable, among other things, a user to create and stitch a wide field of view (FOV) panorama from multiple source images on a device with limited processing capability (such as a mobile phone or other capture device). Moreover, post-processing stitching allows for the user to convert from one image projection to another without fidelity loss (or with an acceptable level of loss).

公开(公告)号：US20230077880A1

公开(公告)日：2023-03-16

申请号：US17992592

申请日：2022-11-22

Applicant: GoPro, Inc.

Inventor： Cesar Douady ,  Alexis Lefebvre

IPC: H04N5/262 ,  H04N5/232 ,  H04N5/225 ,  G06T3/00 ,  G06T3/40 ,  G06V20/40

Abstract: An image or a video may include a spherical capture of a scene. A punchout of the image or the video may be generated by placement of a viewing window at a center of a two-dimensional plane onto which the image or the video is mapped. The punchout of the image or the video may provide a panoramic view of the scene.

公开(公告)号：US11477395B2

公开(公告)日：2022-10-18

申请号：US17240868

申请日：2021-04-26

Applicant: GoPro, Inc.

Inventor： Adeel Abbas ,  Cesar Douady ,  Timothy MacMillan

IPC: H04N5/265 ,  H04N7/18 ,  H04N5/232 ,  H04N5/247

Abstract: Apparatus and methods for stitching images, or re-stitching previously stitched images. Specifically, the disclosed systems in one implementation save stitching information and/or original overlap source data during an original stitching process. During subsequent retrieval, rendering, and/or display of the stitched images, the originally stitched image can be flexibly augmented, and/or re-stitched to improve the original stitch quality. Practical applications of the disclosed solutions enable, among other things, a user to create and stitch a wide field of view (FOV) panorama from multiple source images on a device with limited processing capability (such as a mobile phone or other capture device). Moreover, post-processing stitching allows for the user to convert from one image projection to another without fidelity loss (or with an acceptable level of loss).

公开(公告)号：US20220303467A1

公开(公告)日：2022-09-22

申请号：US17837013

申请日：2022-06-09

Applicant: GoPro, Inc.

Inventor： Thomas Derbanne ,  Cesar Douady ,  Maxim Karpushin

IPC: H04N5/232

Abstract: Images with an optical field of view are captured by an image capture device. An observed trajectory of the image capture device reflects the positions of the image capture device at different moments may be determined. A capture trajectory of the image capture device reflects virtual positions of the image capture device from which video content may be generated. The capture trajectory is determined based on a subsequent portion of the observed trajectory such that a portion of the capture trajectory corresponding to a portion of the observed trajectory is determined based on a subsequent portion of the observed trajectory. Orientations of punch-outs for the images are determined based on the capture trajectory. Video content is generated based on visual content of the images within the punch-outs.

公开(公告)号：US20220060738A1

公开(公告)日：2022-02-24

申请号：US17453217

申请日：2021-11-02

Applicant: GoPro, Inc.

Inventor： David A. Newman ,  Cesar Douady ,  Alexis Lefebvre ,  Daryl Stimm ,  Michael Kraak

IPC: H04N19/52 ,  H04N19/182 ,  G06T3/00 ,  H04N19/40 ,  H04N19/196

Abstract: Methods and apparatus for processing of video content to optimize codec bandwidth. In one embodiment, the method includes capturing panoramic imaging content (e.g., a 360° panorama), mapping the panoramic imaging content into an equi-angular cubemap (EAC) format, and splitting the EAC format into segments for transmission to maximize codec bandwidth. In one exemplary embodiment, the EAC segments are transmitted at a different frame rate than the subsequent display rate of the panoramic imaging content. For example, the mapping and frame rate may be chosen to enable the rendering of 8K, 360° content at 24 fps, using commodity encoder hardware and software that nominally supports 4K content at 60 fps.

公开(公告)号：US20210392375A1

公开(公告)日：2021-12-16

申请号：US17460880

申请日：2021-08-30

Applicant: GoPro, Inc.

Inventor： David A. Newman ,  Cesar Douady ,  Alexis Lefebvre ,  Daryl Stimm ,  Michael Kraak

IPC: H04N19/597 ,  H04N19/176 ,  H04N19/146 ,  H04N19/13

Abstract: Methods and apparatus for processing of video content to optimize codec bandwidth. In one embodiment, the method includes capturing panoramic imaging content (e.g., a 360° panorama), mapping the panoramic imaging content into an equi-angular cubemap (EAC) format, and splitting the EAC format into segments for transmission to maximize codec bandwidth. In one exemplary embodiment, the EAC segments are transmitted at a different frame rate than the subsequent display rate of the panoramic imaging content. For example, the mapping and frame rate may be chosen to enable the rendering of 8K, 360° content at 24 fps, using commodity encoder hardware and software that nominally supports 4K content at 60 fps.

公开(公告)号：US20210327025A1

公开(公告)日：2021-10-21

申请号：US17230135

申请日：2021-04-14

Applicant: GoPro, Inc.

Inventor： Gladys Jocelyne Marc ,  Alexis Lefebvre ,  Cesar Douady ,  Guillaume Guerin

IPC: G06T3/40 ,  G06T3/00 ,  G06T7/30

Abstract: Methods and apparatus for shared image processing among multiple devices. In one embodiment, an exemplary action camera performs a partial multiband blend. Even though the action camera may not have resources to handle the multiband blend of the entire action camera's footage, it can do a significant portion. The partially blended content can be used in ready-to-share applications, or completely blended by another device.

公开(公告)号：US11109067B2

公开(公告)日：2021-08-31

申请号：US16730839

申请日：2019-12-30

Applicant: GoPro, Inc.

Inventor： David A. Newman ,  Cesar Douady ,  Alexis Lefebvre ,  Daryl Stimm ,  Michael Kraak

IPC: H04N19/597 ,  H04N19/176 ,  H04N19/146 ,  H04N19/13

Abstract: Methods and apparatus for processing of video content to optimize codec bandwidth. In one embodiment, the method includes capturing panoramic imaging content (e.g., a 360° panorama), mapping the panoramic imaging content into an equi-angular cubemap (EAC) format, and splitting the EAC format into segments for transmission to maximize codec bandwidth. In one exemplary embodiment, the EAC segments are transmitted at a different frame rate than the subsequent display rate of the panoramic imaging content. For example, the mapping and frame rate may be chosen to enable the rendering of 8K, 360-degree content at 24 fps, using commodity encoder hardware and software that nominally supports 4K content at 60 fps.

公开(公告)号：US10997693B2

公开(公告)日：2021-05-04

申请号：US16503336

申请日：2019-07-03

Applicant: GoPro, Inc.

Inventor： David Newman ,  Cesar Douady

IPC: G06T3/40 ,  G06T3/00 ,  H04N13/178 ,  H04N13/156

Abstract: Methods and apparatus for processing of high resolution content so as to obey desired encoder constraints. In one embodiment, the method includes capturing high resolution imaging spherical content; mapping the spherical content to another frame of reference (e.g., a non-uniform mapping and scaling) splitting up the mapped and scaled content into respective portions; feeding the split up portions to respective imaging encoders; packing encoded content from the respective imaging encoders into an A/V container; and storing and/or transmitting the A/V container. In one variant, the mapping and scaling are chosen to enable rendering of 1080P content in a desired scope or range (e.g., 360 degrees) using commodity encoder hardware and software.