公开(公告)号：US09684949B2

公开(公告)日：2017-06-20

申请号：US15411201

申请日：2017-01-20

Applicant: GoPro, Inc.

Inventor： Scott Patrick Campbell ,  Paul Mobbs ,  Balineedu Chowdary Adsumilli ,  Sumit Chawla

IPC: H04N5/232 ,  G06T3/40 ,  H04N9/04 ,  H04N1/60 ,  H04N19/63 ,  H04N19/517 ,  H04N19/169 ,  H04N19/186 ,  H04N19/91 ,  H04N19/102

CPC classification number: G06T1/20 ,  G06T3/4015 ,  H04N1/6019 ,  H04N1/6027 ,  H04N5/232 ,  H04N5/23212 ,  H04N5/23216 ,  H04N5/23222 ,  H04N5/23229 ,  H04N5/23241 ,  H04N5/23245 ,  H04N5/23254 ,  H04N5/23267 ,  H04N5/23296 ,  H04N5/2353 ,  H04N5/247 ,  H04N5/374 ,  H04N5/378 ,  H04N9/045 ,  H04N9/09 ,  H04N9/735 ,  H04N9/8042 ,  H04N19/102 ,  H04N19/12 ,  H04N19/132 ,  H04N19/156 ,  H04N19/164 ,  H04N19/172 ,  H04N19/186 ,  H04N19/1883 ,  H04N19/33 ,  H04N19/42 ,  H04N19/423 ,  H04N19/44 ,  H04N19/517 ,  H04N19/63 ,  H04N19/91

Abstract: An image capture accelerator performs accelerated processing of image data. In one embodiment, the image capture accelerator includes accelerator circuitry including a pre-processing engine and a compression engine. The pre-processing engine is configured to perform accelerated processing on received image data, and the compression engine is configured to compress processed image data received from the pre-processing engine. In one embodiment, the image capture accelerator further includes a demultiplexer configured to receive image data captured by an image sensor array implemented within, for example, an image sensor chip. The demultiplexer may output the received image data to an image signal processor when the image data is captured by the image sensor array in a standard capture mode, and may output the received image data to the accelerator circuitry when the image data is captured by the image sensor array in an accelerated capture mode.

公开(公告)号：US09666232B2

公开(公告)日：2017-05-30

申请号：US15091539

申请日：2016-04-05

Applicant: GOPRO, INC.

Inventor： Balineedu Chowdary Adsumilli ,  Ryan Lustig ,  David A. Newman

IPC: H04N9/80 ,  H04N5/93 ,  G11B27/10 ,  G06K9/00 ,  G11B27/30 ,  G11B27/031 ,  G10L15/06 ,  G10L15/22 ,  H04N5/77 ,  H04N5/91 ,  H04N9/82 ,  G11B27/13 ,  G11B27/34 ,  G10L25/57 ,  G10L25/54

CPC classification number: G11B27/10 ,  G06K9/00718 ,  G06K9/00751 ,  G06K2009/00738 ,  G10L15/063 ,  G10L15/22 ,  G10L25/54 ,  G10L25/57 ,  G10L2015/0631 ,  G10L2015/223 ,  G11B27/031 ,  G11B27/13 ,  G11B27/28 ,  G11B27/3081 ,  G11B27/34 ,  H04N5/77 ,  H04N5/772 ,  H04N5/91 ,  H04N9/8205

Abstract: Video and corresponding metadata is accessed. Events of interest within the video are identified based on the corresponding metadata, and best scenes are identified based on the identified events of interest. In one example, best scenes are identified based on the motion values associated with frames or portions of a frame of a video. Motion values are determined for each frame and portions of the video including frames with the most motion are identified as best scenes. Best scenes may also be identified based on the motion profile of a video. The motion profile of a video is a measure of global or local motion within frames throughout the video. For example, best scenes are identified from portion of the video including steady global motion. A video summary can be generated including one or more of the identified best scenes.

公开(公告)号：US20170132756A1

公开(公告)日：2017-05-11

申请号：US15411201

申请日：2017-01-20

Applicant: GoPro, Inc.

Inventor： Scott Patrick Campbell ,  Paul Mobbs ,  Balineedu Chowdary Adsumilli ,  Sumit Chawla

IPC: G06T3/40 ,  H04N1/60 ,  H04N19/91 ,  H04N19/517 ,  H04N19/169 ,  H04N19/186 ,  H04N9/04 ,  H04N19/63

CPC classification number: G06T1/20 ,  G06T3/4015 ,  H04N1/6019 ,  H04N1/6027 ,  H04N5/232 ,  H04N5/23212 ,  H04N5/23216 ,  H04N5/23222 ,  H04N5/23229 ,  H04N5/23241 ,  H04N5/23245 ,  H04N5/23254 ,  H04N5/23267 ,  H04N5/23296 ,  H04N5/2353 ,  H04N5/247 ,  H04N5/374 ,  H04N5/378 ,  H04N9/045 ,  H04N9/09 ,  H04N9/735 ,  H04N9/8042 ,  H04N19/102 ,  H04N19/12 ,  H04N19/132 ,  H04N19/156 ,  H04N19/164 ,  H04N19/172 ,  H04N19/186 ,  H04N19/1883 ,  H04N19/33 ,  H04N19/42 ,  H04N19/423 ,  H04N19/44 ,  H04N19/517 ,  H04N19/63 ,  H04N19/91

Abstract: An image capture accelerator performs accelerated processing of image data. In one embodiment, the image capture accelerator includes accelerator circuitry including a pre-processing engine and a compression engine. The pre-processing engine is configured to perform accelerated processing on received image data, and the compression engine is configured to compress processed image data received from the pre-processing engine. In one embodiment, the image capture accelerator further includes a demultiplexer configured to receive image data captured by an image sensor array implemented within, for example, an image sensor chip. The demultiplexer may output the received image data to an image signal processor when the image data is captured by the image sensor array in a standard capture mode, and may output the received image data to the accelerator circuitry when the image data is captured by the image sensor array in an accelerated capture mode.

公开(公告)号：US20170094192A1

公开(公告)日：2017-03-30

申请号：US15080280

申请日：2016-03-24

Applicant: GoPro, Inc.

Inventor： Balineedu Chowdary Adsumilli ,  Ryan Lustig

IPC: H04N5/272 ,  G06T15/50 ,  G06T7/20

CPC classification number: H04N5/272 ,  G06T5/002 ,  G06T7/11 ,  G06T7/143 ,  G06T7/174 ,  G06T7/194 ,  G06T7/20 ,  G06T7/254 ,  G06T11/60 ,  G06T15/503 ,  G06T2207/10016 ,  G06T2207/10021 ,  G06T2207/20036 ,  H04N5/2356 ,  H04N13/128 ,  H04N2013/0085 ,  H04N2013/0092

Abstract: A processing device generates composite images from a sequence of images. The composite images may be used as frames of video. A foreground/background segmentation is performed at selected frames to extract a plurality of foreground object images depicting a foreground object at different locations as it moves across a scene. The foreground object images are stored to a foreground object list. The foreground object images in the foreground object list are overlaid onto subsequent video frames that follow the respective frames from which they were extracted, thereby generating a composite video.

公开(公告)号：US09591217B2

公开(公告)日：2017-03-07

申请号：US15282326

申请日：2016-09-30

Applicant: GoPro, Inc.

Inventor： Scott Patrick Campbell ,  Paul Mobbs ,  Balineedu Chowdary Adsumilli ,  Sumit Chawla

IPC: H04N5/232 ,  H04N19/102 ,  H04N19/44 ,  H04N19/423 ,  G06T3/40 ,  H04N5/247 ,  H04N1/60 ,  H04N9/09 ,  H04N9/73 ,  H04N19/172 ,  H04N19/169 ,  H04N19/91 ,  H04N19/63

CPC classification number: G06T1/20 ,  G06T3/4015 ,  H04N1/6019 ,  H04N1/6027 ,  H04N5/232 ,  H04N5/23212 ,  H04N5/23216 ,  H04N5/23222 ,  H04N5/23229 ,  H04N5/23241 ,  H04N5/23245 ,  H04N5/23254 ,  H04N5/23267 ,  H04N5/23296 ,  H04N5/2353 ,  H04N5/247 ,  H04N5/374 ,  H04N5/378 ,  H04N9/045 ,  H04N9/09 ,  H04N9/735 ,  H04N9/8042 ,  H04N19/102 ,  H04N19/12 ,  H04N19/132 ,  H04N19/156 ,  H04N19/164 ,  H04N19/172 ,  H04N19/186 ,  H04N19/1883 ,  H04N19/33 ,  H04N19/42 ,  H04N19/423 ,  H04N19/44 ,  H04N19/517 ,  H04N19/63 ,  H04N19/91

Abstract: An image capture accelerator performs accelerated processing of image data. In one embodiment, the image capture accelerator includes accelerator circuitry including a pre-processing engine and a compression engine. The pre-processing engine is configured to perform accelerated processing on received image data, and the compression engine is configured to compress processed image data received from the pre-processing engine. In one embodiment, the image capture accelerator further includes a demultiplexer configured to receive image data captured by an image sensor array implemented within, for example, an image sensor chip. The demultiplexer may output the received image data to an image signal processor when the image data is captured by the image sensor array in a standard capture mode, and may output the received image data to the accelerator circuitry when the image data is captured by the image sensor array in an accelerated capture mode.

Abstract translation: 图像捕获加速器执行图像数据的加速处理。 在一个实施例中，图像捕获加速器包括包括预处理引擎和压缩引擎的加速器电路。 预处理引擎被配置为对接收的图像数据执行加速处理，并且压缩引擎被配置为压缩从预处理引擎接收的经处理的图像数据。 在一个实施例中，图像捕获加速器还包括解复用器，其被配置为接收由例如图像传感器芯片内实现的图像传感器阵列捕获的图像数据。 当图像数据以标准捕捉模式被图像传感器阵列捕获时，解复用器可以将接收的图像数据输出到图像信号处理器，并且当图像数据被图像捕获时，可以将接收到的图像数据输出到加速器电路 传感器阵列处于加速捕获模式。

公开(公告)号：US09570113B2

公开(公告)日：2017-02-14

申请号：US14789706

申请日：2015-07-01

Applicant: GoPro, Inc.

Inventor： Scott Patrick Campbell ,  Zhinian Jing ,  Timothy MacMillan ,  David A. Newman ,  Balineedu Chowdary Adsumilli

IPC: H04N9/80 ,  G11B27/30 ,  H04N5/77 ,  H04N5/232 ,  H04N9/806 ,  H04N9/82

CPC classification number: G11B27/3081 ,  H04N5/23238 ,  H04N5/77 ,  H04N9/806 ,  H04N9/8205 ,  H04N9/8211

Abstract: A spherical content capture system captures spherical video and audio content. In one embodiment, captured metadata or video/audio processing is used to identify content relevant to a particular user based on time and location information. The platform can then generate an output video from one or more shared spherical content files relevant to the user. The output video may include a non-spherical reduced field of view such as those commonly associated with conventional camera systems. Particularly, relevant sub-frames having a reduced field of view may be extracted from each frame of spherical video to generate an output video that tracks a particular individual or object of interest. For each sub-frame, a corresponding portion of an audio track is generated that includes a directional audio signal having a directionality based on the selected sub-frame.

Abstract translation: 球面内容捕获系统捕获球面视频和音频内容。 在一个实施例中，捕获的元数据或视频/音频处理被用于基于时间和位置信息来识别与特定用户相关的内容。 然后，平台可以从与用户相关的一个或多个共享球面内容文件生成输出视频。 输出视频可以包括诸如通常与常规相机系统相关联的非球面缩小视场。 特别地，可以从球面视频的每个帧中提取具有减小的视场的相关子帧，以产生跟踪特定个人或感兴趣对象的输出视频。 对于每个子帧，生成音频轨道的对应部分，其包括具有基于所选择的子帧的方向性的定向音频信号。

公开(公告)号：US09485418B2

公开(公告)日：2016-11-01

申请号：US15049012

申请日：2016-02-20

Applicant: GoPro, Inc.

Inventor： Scott Patrick Campbell ,  Paul Mobbs ,  Balineedu Chowdary Adsumilli ,  Sumit Chawla

IPC: H04N5/232 ,  H04N19/102 ,  H04N19/91 ,  H04N19/63 ,  H04N19/169 ,  G06T3/40 ,  H04N5/378 ,  H04N9/04 ,  H04N5/235 ,  H04N9/73 ,  H04N19/164 ,  H04N19/172 ,  H04N5/247

CPC classification number: G06T1/20 ,  G06T3/4015 ,  H04N1/6019 ,  H04N1/6027 ,  H04N5/232 ,  H04N5/23212 ,  H04N5/23216 ,  H04N5/23222 ,  H04N5/23229 ,  H04N5/23241 ,  H04N5/23245 ,  H04N5/23254 ,  H04N5/23267 ,  H04N5/23296 ,  H04N5/2353 ,  H04N5/247 ,  H04N5/374 ,  H04N5/378 ,  H04N9/045 ,  H04N9/09 ,  H04N9/735 ,  H04N9/8042 ,  H04N19/102 ,  H04N19/12 ,  H04N19/132 ,  H04N19/156 ,  H04N19/164 ,  H04N19/172 ,  H04N19/186 ,  H04N19/1883 ,  H04N19/33 ,  H04N19/42 ,  H04N19/423 ,  H04N19/44 ,  H04N19/517 ,  H04N19/63 ,  H04N19/91

Abstract: An image capture accelerator performs accelerated processing of image data. In one embodiment, the image capture accelerator includes accelerator circuitry including a pre-processing engine and a compression engine. The pre-processing engine is configured to perform accelerated processing on received image data, and the compression engine is configured to compress processed image data received from the pre-processing engine. In one embodiment, the image capture accelerator further includes a demultiplexer configured to receive image data captured by an image sensor array implemented within, for example, an image sensor chip. The demultiplexer may output the received image data to an image signal processor when the image data is captured by the image sensor array in a standard capture mode, and may output the received image data to the accelerator circuitry when the image data is captured by the image sensor array in an accelerated capture mode.

Abstract translation: 图像捕获加速器执行图像数据的加速处理。 在一个实施例中，图像捕获加速器包括包括预处理引擎和压缩引擎的加速器电路。 预处理引擎被配置为对接收的图像数据执行加速处理，并且压缩引擎被配置为压缩从预处理引擎接收的经处理的图像数据。 在一个实施例中，图像捕获加速器还包括解复用器，其被配置为接收由例如图像传感器芯片内实现的图像传感器阵列捕获的图像数据。 当图像数据以标准捕捉模式被图像传感器阵列捕获时，解复用器可以将接收的图像数据输出到图像信号处理器，并且当图像数据被图像捕获时，可以将接收到的图像数据输出到加速器电路 传感器阵列处于加速捕获模式。

公开(公告)号：US20160173780A1

公开(公告)日：2016-06-16

申请号：US15049016

申请日：2016-02-20

Applicant: GoPro, Inc.

Inventor： Scott Patrick Campbell ,  Paul Mobbs ,  Balineedu Chowdary Adsumilli ,  Sumit Chawla

IPC: H04N5/232

CPC classification number: G06T1/20 ,  G06T3/4015 ,  H04N1/6019 ,  H04N1/6027 ,  H04N5/232 ,  H04N5/23212 ,  H04N5/23216 ,  H04N5/23222 ,  H04N5/23229 ,  H04N5/23241 ,  H04N5/23245 ,  H04N5/23254 ,  H04N5/23267 ,  H04N5/23296 ,  H04N5/2353 ,  H04N5/247 ,  H04N5/374 ,  H04N5/378 ,  H04N9/045 ,  H04N9/09 ,  H04N9/735 ,  H04N9/8042 ,  H04N19/102 ,  H04N19/12 ,  H04N19/132 ,  H04N19/156 ,  H04N19/164 ,  H04N19/172 ,  H04N19/186 ,  H04N19/1883 ,  H04N19/33 ,  H04N19/42 ,  H04N19/423 ,  H04N19/44 ,  H04N19/517 ,  H04N19/63 ,  H04N19/91

Abstract: An image capture accelerator performs accelerated processing of image data. In one embodiment, the image capture accelerator includes accelerator circuitry including a pre-processing engine and a compression engine. The pre-processing engine is configured to perform accelerated processing on received image data, and the compression engine is configured to compress processed image data received from the pre-processing engine. In one embodiment, the image capture accelerator further includes a demultiplexer configured to receive image data captured by an image sensor array implemented within, for example, an image sensor chip. The demultiplexer may output the received image data to an image signal processor when the image data is captured by the image sensor array in a standard capture mode, and may output the received image data to the accelerator circuitry when the image data is captured by the image sensor array in an accelerated capture mode.

Abstract translation: 图像捕获加速器执行图像数据的加速处理。 在一个实施例中，图像捕获加速器包括包括预处理引擎和压缩引擎的加速器电路。 预处理引擎被配置为对接收的图像数据执行加速处理，并且压缩引擎被配置为压缩从预处理引擎接收的经处理的图像数据。 在一个实施例中，图像捕获加速器还包括解复用器，其被配置为接收由例如图像传感器芯片内实现的图像传感器阵列捕获的图像数据。 当图像数据以标准捕捉模式被图像传感器阵列捕获时，解复用器可以将接收的图像数据输出到图像信号处理器，并且当图像数据被图像捕获时，可以将接收到的图像数据输出到加速器电路 传感器阵列处于加速捕获模式。

公开(公告)号：US20150256746A1

公开(公告)日：2015-09-10

申请号：US14637193

申请日：2015-03-03

Applicant: GoPro, Inc.

Inventor： Timothy MacMillan ,  David A. Newman ,  Balineedu Chowdary Adsumilli ,  Scott Patrick Campbell

IPC: H04N5/232 ,  G06T3/00 ,  H04N21/234 ,  G06K9/00 ,  H04N21/233

CPC classification number: H04N5/23238 ,  G03B37/04 ,  G06F17/30858 ,  G06K9/00281 ,  G06K9/00355 ,  G06K9/00711 ,  G06T3/0062 ,  G06T7/246 ,  G06T2207/10016 ,  G06T2207/30201 ,  H04L65/00 ,  H04L65/4084 ,  H04L65/602 ,  H04L67/42 ,  H04N13/106 ,  H04N21/233 ,  H04N21/23418

Abstract: A spherical content capture system captures spherical video content. A spherical video sharing platform enables users to share the captured spherical content and enables users to access spherical content shared by other users. In one embodiment, captured metadata or video/audio processing is used to identify content relevant to a particular user based on time and location information. The platform can then generate an output video from one or more shared spherical content files relevant to the user. The output video may include anon-spherical reduced field of view such as those commonly associated with conventional camera systems. Particularly, relevant sub-frames having a reduced field of view may be extracted from each frame of spherical video o generate an output video that tracks a particular individual or object of interest.

Abstract translation: 球面内容捕获系统捕获球面视频内容。 一个球面视频共享平台使用户能够共享所捕获的球面内容，并使用户能够访问其他用户共享的球面内容。 在一个实施例中，捕获的元数据或视频/音频处理被用于基于时间和位置信息来识别与特定用户相关的内容。 然后，平台可以从与用户相关的一个或多个共享球面内容文件生成输出视频。 输出视频可以包括例如通常与常规相机系统相关联的非球面减小视场。 特别地，可以从球面视频的每个帧中提取具有减小的视场的相关子帧，以产生跟踪特定个人或感兴趣对象的输出视频。

公开(公告)号：US12003692B2

公开(公告)日：2024-06-04

申请号：US17545156

申请日：2021-12-08

Applicant: GoPro, Inc.

Inventor： Adeel Abbas ,  Balineedu Chowdary Adsumilli ,  David Newman

IPC: H04N13/161 ,  H04N13/111 ,  H04N13/194 ,  H04N13/243 ,  H04N13/282 ,  H04N13/344 ,  H04N19/597 ,  H04N23/51 ,  H04N23/698

CPC classification number: H04N13/161 ,  H04N13/111 ,  H04N13/194 ,  H04N13/243 ,  H04N13/282 ,  H04N13/344 ,  H04N19/597 ,  H04N23/51 ,  H04N23/698

Abstract: A device includes a processor that is configured to obtain first facets of a first wide field-of-view image. An object is identified in a facet of the first facets. A second wide field-of-view image is obtained. A location of the object is identified in the second wide field-of-view image. Using the location of the object, the second wide field-of-view image is partitioned into second facets such that no boundary of any of the second facets overlaps the object. The second facets are then encoded in a compressed bitstream.