-
51.
公开(公告)号:US08879861B2
公开(公告)日:2014-11-04
申请号:US14222549
申请日:2014-03-21
Applicant: GoPro, Inc.
Inventor: David A. Newman
IPC: G06K9/36 , G06K9/46 , H04N19/136 , H04N1/64 , H04N9/04 , G06T9/00 , H04N19/117 , H04N19/44 , H04N19/186
CPC classification number: H04N5/23293 , G06F3/0484 , G06K9/36 , G06T9/00 , H04N1/648 , H04N5/23245 , H04N5/265 , H04N9/045 , H04N19/117 , H04N19/136 , H04N19/186 , H04N19/44 , H04N19/85
Abstract: A method is described to greatly improve the efficiency of and reduce the complexity of image compression when using single-sensor color imagers for video acquisition. The method in addition allows for this new image compression type to be compatible with existing video processing tools, improving the workflow for film and television production.
Abstract translation: 描述了一种方法,以便在使用单传感器彩色成像器进行视频采集时,大大提高图像压缩效率并降低图像压缩的复杂度。 该方法另外允许这种新的图像压缩类型与现有的视频处理工具兼容,从而改善电影和电视制作的工作流程。
-
52.
公开(公告)号:US08830367B1
公开(公告)日:2014-09-09
申请号:US14189967
申请日:2014-02-25
Applicant: GoPro, Inc.
Inventor: Paul Mobbs , Scott Patrick Campbell , David A. Newman , Kasturi Rangam , Sumit Chawla
CPC classification number: H04N5/2329 , H04N1/2137 , H04N1/215 , H04N5/23229 , H04N5/23232 , H04N5/23277 , H04N5/3532 , H04N5/35572 , H04N2101/00
Abstract: An image sensor of a camera system captures an image over an image capture interval of time, and waits a blanking interval of time before capturing an additional image. The captured image is provided to a frame controller, and is buffered until an image signal processor accesses the captured image. The image signal processor processes the accessed image over an image processing interval of time, producing a processed image. The image processing interval of time is selected to be greater than the image capture interval of time, but less than the sum of the image capture interval of time and the blanking interval of time. By reducing the image capture interval of time but maintaining an image processing interval of time, rolling shutter artifacts are beneficially reduced without increasing the processing resources or power required by the image signal processor to process the image.
Abstract translation: 相机系统的图像传感器通过图像捕获时间间隔拍摄图像,并且在捕获附加图像之前等待消隐间隔时间。 将捕获的图像提供给帧控制器,并且被缓冲直到图像信号处理器访问所捕获的图像。 图像信号处理器在图像处理间隔处理所访问的图像,产生经处理的图像。 图像处理时间间隔选择为大于图像捕获时间间隔,但小于图像捕获间隔时间和消隐间隔时间之和。 通过减小图像捕获时间间隔,但是保持图像处理时间间隔,有利地减少滚动快门伪影,而不增加图像信号处理器处理图像所需的处理资源或功率。
-
53.
公开(公告)号:US20140205191A1
公开(公告)日:2014-07-24
申请号:US14222549
申请日:2014-03-21
Applicant: GoPro, Inc.
Inventor: David A. Newman
IPC: H04N19/44
CPC classification number: H04N5/23293 , G06F3/0484 , G06K9/36 , G06T9/00 , H04N1/648 , H04N5/23245 , H04N5/265 , H04N9/045 , H04N19/117 , H04N19/136 , H04N19/186 , H04N19/44 , H04N19/85
Abstract: A method is described to greatly improve the efficiency of and reduce the complexity of image compression when using single-sensor color imagers for video acquisition. The method in addition allows for this new image compression type to be compatible with existing video processing tools, improving the workflow for film and television production.
Abstract translation: 描述了一种方法,以便在使用单传感器彩色成像器进行视频采集时,大大提高图像压缩效率并降低图像压缩的复杂度。 该方法另外允许这种新的图像压缩类型与现有的视频处理工具兼容,从而改善电影和电视制作的工作流程。
-
公开(公告)号:US20140152871A1
公开(公告)日:2014-06-05
申请号:US14174812
申请日:2014-02-06
Applicant: GoPro, Inc.
Inventor: Scott Patrick Campbell , David A. Newman , Brian G. Schunck
IPC: H04N19/423 , H04N1/21
CPC classification number: H04N1/2137 , H04N1/00209 , H04N5/23206 , H04N5/335 , H04N5/341 , H04N5/374 , H04N9/045 , H04N19/0049 , H04N19/137 , H04N19/156 , H04N19/172 , H04N19/423 , H04N19/426 , H04N19/625 , H04N19/63 , H04N19/91
Abstract: An image sensor compresses image data prior to transmitting the image data to a DSP. The image sensor captures light representing an image, for instance via a camera's aperture. A focal plane array converts the captured light into pixel data. The pixel data is sorted into categories, and is compressed in parallel by a compression engine. The compressed pixel data is then sent to a DSP, which may be located off-chip. The DSP then decompresses the compressed pixel data, performs image signal processing operations on the compressed pixel data, and then compresses the processed pixel data into a digital image format. The image sensor may buffer the pixel data for one or more images to accommodate for slowdown by the compression engine. The pixel data may be sorted by row and column of a pixel array. Alternatively, the pixel data may be sorted by color from a Bayer color filter.
Abstract translation: 图像传感器在将图像数据发送到DSP之前压缩图像数据。 图像传感器例如通过相机的光圈捕获表示图像的光。 焦平面阵列将捕获的光转换成像素数据。 像素数据被分类并被压缩引擎并行压缩。 压缩的像素数据然后被发送到可以位于芯片外的DSP。 然后,DSP解压缩压缩像素数据,对压缩像素数据执行图像信号处理操作,然后将经处理的像素数据压缩为数字图像格式。 图像传感器可以缓冲一个或多个图像的像素数据,以适应压缩引擎的减速。 像素数据可以按像素阵列的行和列排序。 或者,像素数据可以由拜耳滤色器的颜色分类。
-
公开(公告)号:US20240004171A1
公开(公告)日:2024-01-04
申请号:US18468598
申请日:2023-09-15
Applicant: GoPro, Inc.
Inventor: David A. Newman
CPC classification number: G02B13/16 , G02B3/08 , H04N23/698
Abstract: Methods and apparatus for seamlessly transitioning between lens projections. In one exemplary embodiment, a piecewise lens projection is composed of three (3) functions: (i) a first polynomial-based lens projection, (ii) a second “joining” lens projection, and (iii) a trigonometric lens projection. The piecewise lens projection characterizes virtualized lens distortion as a function of FOV; image data can be dynamically projected based on the virtualized lens distortion, regardless of FOV. In this manner, a user may achieve the visually familiar effects associated with a first lens definition for a first FOV, while still smoothly animating transitions to other lens projections (e.g., a larger FOV using stereographic projections).
-
公开(公告)号:US11769231B2
公开(公告)日:2023-09-26
申请号:US18145205
申请日:2022-12-22
Applicant: GoPro, Inc.
Inventor: David A. Newman
IPC: G06T5/00 , G06T7/11 , G06T5/20 , G06T7/194 , H04N23/698
CPC classification number: G06T5/002 , G06T5/20 , G06T7/11 , G06T7/194 , H04N23/698
Abstract: Apparatus and methods for applying motion blur to overcapture content. In one embodiment, the motion blur is applied by selecting a number of frames of the captured image content for application of motion blur; selecting a plurality of pixel locations within the number of frames of the captured image content for the application of motion blur; applying motion blur to the captured image content in accordance with the selected number of frames and the selected plurality of pixel locations; and outputting the captured image content with the applied motion blur. In some implementations, motion blur is applied via implementation of a virtualized neutral density filter. Computerized devices and computer-readable apparatus for the application of motion blur are also disclosed.
-
公开(公告)号:US11375173B2
公开(公告)日:2022-06-28
申请号:US17061885
申请日:2020-10-02
Applicant: GoPro, Inc.
Inventor: Timothy Macmillan , Scott Patrick Campbell , David A. Newman , Yajie Sun
IPC: H04N13/246 , H04N17/00 , H04N13/296 , H04N5/247 , H04N13/239 , H04N5/232 , H04N5/265 , H04N5/353 , H04N13/00
Abstract: An image capture device having multiple image sensors having overlapping fields of view that aligns the image sensors based on images captured by image sensors. A pixel shift is identified between the images. Based on the identified pixel shift, a calibration is applied to one or more of the image sensors. To determine the pixel shift, a processor applies correlation methods including edge matching. Calibrating the image sensors may include adjusting a read window on an image sensor. The pixel shift can also be used to determine a time lag, which can be used to synchronize subsequent image captures.
-
公开(公告)号:US11375139B2
公开(公告)日:2022-06-28
申请号:US16914934
申请日:2020-06-29
Applicant: GoPro, Inc.
Inventor: Scott Patrick Campbell , David A. Newman , Brian G. Schunck
IPC: H04N5/341 , H04N5/232 , H04N19/423 , H04N19/426 , H04N9/04 , H04N1/21 , H04N5/335 , H04N1/00 , H04N19/137 , H04N19/156 , H04N19/172 , H04N19/625 , H04N19/63 , H04N19/91
Abstract: Systems and methods are disclosed that capture and compress frames of pixel data. In an implementation, an image sensor chip is configured to convert light into pixel data and generate compressed pixel data at a variable compression rate including applying a transform to pixel data associated with a pixel category from a plurality of pixel categories. The variable compression rate is within an available bandwidth of an output bus configured to output the compressed pixel data.
-
公开(公告)号:US11368623B2
公开(公告)日:2022-06-21
申请号:US16914853
申请日:2020-06-29
Applicant: GoPro, Inc.
Inventor: Paul Mobbs , Scott Patrick Campbell , David A. Newman , Kasturi Rangam , Sumit Chawla
Abstract: Systems and methods are provided that capture and process frames of frame data. An image sensor captures frames of frame data representative of light incident upon the image sensor using a rolling shutter and outputs the frames of frame data. The image sensor captures at least one of the frames over a frame capture interval and then waits over a blanking interval before capturing another frame. A buffer receives and stores the frames output by the image sensor. An image signal processor retrieves the frames from the buffer and processes the frames over successive frame processing intervals to generate a video having a time interval per frame greater than the frame capture interval. At least one of the successive frame processing intervals is greater than the frame capture interval and is less than or equal to a sum of the frame capture interval and the blanking interval.
-
公开(公告)号:US11069380B2
公开(公告)日:2021-07-20
申请号:US16382600
申请日:2019-04-12
Applicant: GoPro, Inc.
Inventor: David A. Newman , Adam Silver
IPC: G11B27/10 , G06K9/00 , G11B27/30 , G11B27/031 , G10L25/57 , H04N5/91 , H04N9/82 , G11B27/28 , G10L15/06 , G10L15/22 , H04N5/77 , G11B27/13 , G11B27/34 , H04N19/513 , G06T7/246 , G10L25/54
Abstract: Video and corresponding metadata is accessed. Events of interest within the video are identified based on the corresponding metadata, and best scenes are identified based on the identified events of interest. A video summary can be generated including one or more of the identified best scenes. The video summary can be generated using a video summary template with slots corresponding to video clips selected from among sets of candidate video clips. Best scenes can also be identified by receiving an indication of an event of interest within video from a user during the capture of the video. Metadata patterns representing activities identified within video clips can be identified within other videos, which can subsequently be associated with the identified activities.
-
-
-
-
-
-
-
-
-