公开(公告)号：US20170339389A1

公开(公告)日：2017-11-23

申请号：US15593629

申请日：2017-05-12

Applicant: GoPro, Inc.

Inventor： Sandeep Doshi

IPC: H04N9/79 ,  H04N9/04 ,  G06T7/90 ,  H04N19/124 ,  H04N19/85 ,  H04N19/186 ,  H04N9/67 ,  G06T1/20

CPC classification number: G06K9/4647 ,  G06K9/38 ,  G06K9/4652 ,  G06T1/20 ,  G06T7/40 ,  G06T7/90 ,  H04N5/23232 ,  H04N5/77 ,  H04N9/045 ,  H04N9/8042 ,  H04N19/124 ,  H04N19/186 ,  H04N19/85

Abstract: A camera system processes images based on image luminance data. The camera system includes an image sensor, an image pipeline, an encoder and a memory. The image sensor converts light incident upon the image sensor into raw image data. The image pipeline converts raw image data into color-space image data and calculates luminance levels of the color-space image data. The encoder can determine one or more of quantization levels, determining GOP structure or reference frame spacing for the color-space image data based on the luminance levels. The memory stores the color-space image data and the luminance levels.

公开(公告)号：US10728474B2

公开(公告)日：2020-07-28

申请号：US16303428

申请日：2017-05-25

Applicant: GoPro, Inc. ,  Bruno César Douady ,  Sandeep Doshi

Inventor： Bruno César Douady ,  Sandeep Doshi

IPC: H04N5/357 ,  H04N5/247 ,  H04N5/232 ,  H04N17/00 ,  G06T7/80 ,  G06T3/40 ,  H04N19/10 ,  H04N19/136 ,  H04N19/176 ,  H04N19/423 ,  H04N19/70 ,  H04N19/90 ,  H04N13/271 ,  G06T5/20 ,  G06T5/50 ,  H04N19/85 ,  G06T3/00 ,  H04N5/225 ,  H04N13/239 ,  H04N13/122 ,  G06T5/00

Abstract: Image signal processing including generating image signal processing based encoding hints for motion estimation may include an image signal processor obtaining an input image portion of an input image from the input image signal, generating motion information for the input image portion, processing the input image portion based on the motion information, outputting processed image data, and outputting the motion information as encoding hints, such that the motion information is accessible by an encoder for generating an encoded output bitstream by obtaining the processed image data as source image data, obtaining the motion information, generating prediction data for encoding the source image data based on the motion information, generating encoded image data based on the prediction data, and including the encoded image data in an encoded output bitstream.

公开(公告)号：US10536715B1

公开(公告)日：2020-01-14

申请号：US15462323

申请日：2017-03-17

Applicant: GOPRO, INC.

Inventor： Sandeep Doshi ,  Sumit Chawla ,  Adeel Abbas

IPC: H04N19/167 ,  H04N19/56 ,  H04N19/543 ,  H04N19/107

Abstract: Systems and methods for utilizing on-camera sensor information to improve video and/or image encoding quality are discussed herein. Specifically, the systems and methods may utilize on-camera sensor information to efficiently determine whether to encode a particular frame within a set of frames as an intra frame. When captured on video, a particular arrangement of a group of pixels within a frame may comprise a visual representation of an object within the frame. When encoding video footage, motion information characterizing motion of an image capturing device over time may be used to predict displacement of an arrangement of group of pixels between frames. These predictions may be used to efficiently determine whether to encode a particular frame as an intra frame.

公开(公告)号：US10536700B1

公开(公告)日：2020-01-14

申请号：US15594380

申请日：2017-05-12

Applicant: GoPro, Inc.

Inventor： Sandeep Doshi

IPC: H04N7/12 ,  H04N11/02 ,  H04N19/126 ,  H04N19/177 ,  H04N19/122 ,  H04N19/105 ,  H04N19/159 ,  G06K9/62 ,  H04N7/18

Abstract: Video information defining video content to be encoded may be obtained. Scene composition information for the video content may be obtained. The scene composition information may be determined by a convolutional neural network based on visuals represented within the video content. The video content may be encoded based on the scene composition information. The encoding of the video content may generate encoded video information defining the encoded video content.

公开(公告)号：US10509982B2

公开(公告)日：2019-12-17

申请号：US16230383

申请日：2018-12-21

Applicant: GoPro, Inc.

Inventor： Sandeep Doshi

IPC: G06K9/46 ,  H04N9/04 ,  H04N19/124 ,  G06T1/20 ,  H04N19/186 ,  H04N19/85 ,  G06T7/90 ,  H04N5/232 ,  H04N5/77 ,  H04N9/804 ,  H04N19/14 ,  G06K9/38 ,  G06T7/40

Abstract: A camera system processes images based on image luminance data. The camera system includes an image sensor, an image pipeline, an encoder and a memory. The image sensor converts light incident upon the image sensor into raw image data. The image pipeline converts raw image data into color-space image data and calculates luminance levels of the color-space image data. The encoder can determine one or more of quantization levels, determining GOP structure or reference frame spacing for the color-space image data based on the luminance levels. The memory stores the color-space image data and the luminance levels.

公开(公告)号：US20190197341A1

公开(公告)日：2019-06-27

申请号：US16230383

申请日：2018-12-21

Applicant: GoPro, Inc.

Inventor： Sandeep Doshi

IPC: G06K9/46 ,  G06T7/90 ,  G06T1/20 ,  H04N9/04 ,  H04N19/85 ,  H04N19/186 ,  H04N19/124 ,  H04N19/14 ,  H04N5/77 ,  H04N5/232 ,  G06T7/40 ,  G06K9/38 ,  H04N9/804

CPC classification number: G06K9/4647 ,  G06K9/38 ,  G06K9/4652 ,  G06T1/20 ,  G06T7/40 ,  G06T7/90 ,  H04N5/23232 ,  H04N5/77 ,  H04N9/045 ,  H04N9/8042 ,  H04N19/124 ,  H04N19/14 ,  H04N19/186 ,  H04N19/85

Abstract: A camera system processes images based on image luminance data. The camera system includes an image sensor, an image pipeline, an encoder and a memory. The image sensor converts light incident upon the image sensor into raw image data. The image pipeline converts raw image data into color-space image data and calculates luminance levels of the color-space image data. The encoder can determine one or more of quantization levels, determining GOP structure or reference frame spacing for the color-space image data based on the luminance levels. The memory stores the color-space image data and the luminance levels.

公开(公告)号：US10163030B2

公开(公告)日：2018-12-25

申请号：US15593630

申请日：2017-05-12

Applicant: GoPro, Inc.

Inventor： Sandeep Doshi

IPC: G06K9/46 ,  H04N9/04 ,  H04N19/124 ,  G06T1/20 ,  H04N19/186 ,  H04N19/85 ,  G06T7/90 ,  G06K9/38 ,  G06T7/40 ,  H04N5/232 ,  H04N5/77 ,  H04N9/804

Abstract: A camera system processes images based on image activity data. The camera system includes an image sensor, an image pipeline, an encoder and a memory. The image sensor converts light incident upon the image sensor into raw image data. The image pipeline converts raw image data into color-space image data and calculates activity variances of the color-space image data. The encoder can determine one or more of quantization levels, block type (Intra vs Inter), determining transform size and type, and determining GOP structure or reference frame spacing for the color-space image data based on the activity variances. The memory stores the color-space image data and the activity variances.

公开(公告)号：US20170347044A1

公开(公告)日：2017-11-30

申请号：US15399269

申请日：2017-01-05

Applicant: GoPro, Inc.

Inventor： Bruno Cesar Douady-Pleven ,  Sandeep Doshi ,  Sophana Kok

IPC: H04N5/357 ,  H04N19/85 ,  G06T3/00 ,  H04N5/225

CPC classification number: H04N5/3572 ,  G06T3/0093 ,  G06T3/4038 ,  G06T7/85 ,  G06T2207/10016 ,  H04N5/2258 ,  H04N5/23238 ,  H04N5/247 ,  H04N17/002 ,  H04N19/85

Abstract: Systems and methods are disclosed for image signal processing. For example, methods may include receiving, by an image signal processor, one or more input image signals from one or more image sensors; determining a mapping based on the input image signal(s), wherein the mapping includes records that associate image portions of an output image with corresponding image portions of the input image signal(s); sorting the records of the mapping according to an order of the corresponding image portions of the input image signal(s); applying, by the image signal processor, image processing to image portions of the input image signal(s) to determine image portions of one or more processed images in the order; and determining, by the image signal processor, the image portions of the output image based at least in part on the mapping and the corresponding image portions of the processed image(s) in the order.