-
21.发明申请公开(公告)号：US20180027178A1
公开(公告)日：2018-01-25
申请号：US15357963
申请日：2016-11-21
Applicant: GoPro, Inc.
Inventor： Timothy Macmillan , Adeel Abbas
CPC classification number: H04N13/243 , G06K9/4609 , G06K9/52 , G06K9/6201 , G06K9/6212 , G06T3/0043 , G06T3/0068 , G06T3/20 , G06T7/0002 , G06T7/0038 , G06T7/0042 , G06T7/0075 , G06T7/38 , G06T7/593 , G06T7/73 , G06T11/60 , G06T15/20 , G06T2200/04 , G06T2207/20221 , H04N5/23238 , H04N13/10 , H04N13/161 , H04N13/282 , H04N13/302 , H04N13/334 , H04N13/344 , H04N19/136 , H04N19/44
Abstract: A system captures a first hemispherical image and a second hemispherical image, each hemispherical image including an overlap portion, the overlap potions capturing a same field of view, the two hemispherical images collectively comprising a spherical FOV and separated along a longitudinal plane. The system maps a modified first hemispherical image to a first portion of the 2D projection of a cubic image, the modified first hemispherical image including a non-overlap portion of the first hemispherical image, and maps a modified second hemispherical image to a second portion of the 2D projection of the cubic image, the modified second hemispherical image also including a non-overlap portion. The system maps the overlap portions of the first hemispherical image and the second hemispherical image to the 2D projection of the cubic image, and encodes the 2D projection of the cubic image to generate an encoded image representative of the spherical FOV.
-
公开(公告)号：US09792667B2
公开(公告)日：2017-10-17
申请号：US15345002
申请日：2016-11-07
Applicant: GoPro, Inc.
Inventor： Yajie Sun , Timothy Macmillan , Elizabeth Torres Edwards , Sumit Chawla
IPC: G06T3/40 , H04N17/00 , H04N5/232 , G06K9/46 , G06K9/62 , G06K9/52 , H04N5/349 , H04N5/374 , H04N13/02 , G06T7/80 , G06T5/00 , G06T7/33 , G06T7/13 , H04N13/00
CPC classification number: G06T3/4038 , G06K9/4604 , G06K9/52 , G06K9/6201 , G06T5/002 , G06T7/13 , G06T7/337 , G06T7/80 , G06T7/85 , H04N5/23229 , H04N5/2329 , H04N5/349 , H04N5/374 , H04N13/239 , H04N13/246 , H04N13/271 , H04N13/296 , H04N17/002 , H04N2013/0081
Abstract: A pair of cameras having an overlapping field of view is aligned based on images captured by image sensors of the pair of cameras. A pixel shift is identified between the images. Based on the identified pixel shift, a calibration is applied to one or both of the pair of cameras. To determine the pixel shift, the camera applies correlation methods including edge matching. Calibrating the pair of cameras may include adjusting a read window on an image sensor. The pixel shift can also be used to determine a time lag, which can be used to synchronize subsequent image captures.
-
公开(公告)号：US09749738B1
公开(公告)日：2017-08-29
申请号：US15187700
申请日：2016-06-20
Applicant: GoPro, Inc.
Inventor： Balineedu Chowdary Adsumilli , Timothy Macmillan
CPC classification number: H04R3/005 , G01S3/803 , G01S5/16 , G01S5/18 , G06T7/2093 , G10L25/57 , H04R2420/07 , H04R2420/09
Abstract: Disclosed is a system and method for generating a model of the geometric relationships between various audio sources recorded by a multi-camera system. The spatial audio scene module associates source signals, extracted from recorded audio, of audio sources to visual objects identified in videos recorded by one or more cameras. This association may be based on estimated positions of the audio sources based on relative signal gains and delays of the source signal received at each microphone. The estimated positions of audio sources are tracked indirectly by tracking the associated visual objects with computer vision. A virtual microphone module may receive a position for a virtual microphone and synthesize a signal corresponding to the virtual microphone position based on the estimated positions of the audio sources.
-
公开(公告)号：US09736404B2
公开(公告)日：2017-08-15
申请号：US15396295
申请日：2016-12-30
Applicant: GoPro, Inc.
Inventor： Balineedu Chowdary Adsumilli , Timothy Macmillan
CPC classification number: H04N5/3415 , G01B2210/52 , G03G15/36 , G06T5/008 , G06T2207/20208 , H04N5/23238 , H04N5/247 , H04N5/265 , H04N5/355 , H04N9/646 , H04N9/77
Abstract: Use of separate range tone mapping for combined images can help minimize loss of image information in scenes that have drastically different luminance values, i.e., scenes that have both bright and shadowed regions. Separate range tone mapping is particularly useful for combined images, such as those from spherical camera systems, which may have a higher probability of including luminance variability. The resulting increased bit depth of separate range tone mapping can make the transition between different images that make up a combined image more subtle. Each of a plurality of images that make up a combined image can use a different tone map that is optimized for the particular image data of the image. Multiple tone maps that are applied to overlapping regions of the plurality of images can subsequently be combined to expand the bit depth of the overlapping regions.
-
25.发明申请公开(公告)号：US20170053392A1
公开(公告)日：2017-02-23
申请号：US15345002
申请日：2016-11-07
Applicant: GoPro, Inc.
Inventor： Yajie Sun , Timothy Macmillan , Elizabeth Torres Edwards , Sumit Chawla
CPC classification number: G06T3/4038 , G06K9/4604 , G06K9/52 , G06K9/6201 , G06T5/002 , G06T7/13 , G06T7/337 , G06T7/80 , G06T7/85 , H04N5/23229 , H04N5/2329 , H04N5/349 , H04N5/374 , H04N13/239 , H04N13/246 , H04N13/271 , H04N13/296 , H04N17/002 , H04N2013/0081
Abstract: A pair of cameras having an overlapping field of view is aligned based on images captured by image sensors of the pair of cameras. A pixel shift is identified between the images. Based on the identified pixel shift, a calibration is applied to one or both of the pair of cameras. To determine the pixel shift, the camera applies correlation methods including edge matching. Calibrating the pair of cameras may include adjusting a read window on an image sensor. The pixel shift can also be used to determine a time lag, which can be used to synchronize subsequent image captures.
Abstract translation: 具有重叠视野的一对相机基于由该对相机的图像传感器捕获的图像来对准。 在图像之间识别像素漂移。 基于所识别的像素偏移，校准被应用于该对照相机中的一个或两个。 为了确定像素偏移，相机应用包括边缘匹配的相关方法。 校准一对相机可能包括调整图像传感器上的读取窗口。 像素偏移也可用于确定时间滞后，可用于同步后续图像捕获。
-
Patent Agency Ranking
公开(公告)号：US20170013209A1
公开(公告)日：2017-01-12
申请号：US15262159
申请日：2016-09-12
Applicant: GoPro, Inc.
Inventor： Timothy Macmillan , Scott Patrick Campbell
CPC classification number: H04N5/3415 , G06T3/0068 , G06T3/0093 , G06T3/4038 , G06T5/006 , G06T5/50 , G06T7/344 , G06T2207/10004 , G06T2207/20128 , G06T2207/20221 , G06T2210/22 , H04N5/2252 , H04N5/2253 , H04N5/2257 , H04N5/2258 , H04N5/23216 , H04N5/23229 , H04N5/23232 , H04N5/23238 , H04N5/247 , H04N5/2624 , H04N5/2628
Abstract: Multiple cameras are arranged in an array at a pitch, roll, and yaw that allow the cameras to have adjacent fields of view such that each camera is pointed inward relative to the array. The read window of an image sensor of each camera in a multi-camera array can be adjusted to minimize the overlap between adjacent fields of view, to maximize the correlation within the overlapping portions of the fields of view, and to correct for manufacturing and assembly tolerances. Images from cameras in a multi-camera array with adjacent fields of view can be manipulated using low-power warping and cropping techniques, and can be taped together to form a final image.
Abstract translation: 多个相机以阵列，俯仰和偏转方式布置，允许相机具有相邻的视野，使得每个相机相对于阵列向内指向。 可以调整多相机阵列中每个相机的图像传感器的读取窗口，以使相邻视场之间的重叠最小化，以使视场的重叠部分之间的相关性最大化，并纠正制造和组装 公差。 可以使用低功率翘曲和裁剪技术来操纵具有相邻视场的多相机阵列中的相机的图像，并且可以将其粘贴在一起以形成最终图像。
-
27.发明授权公开(公告)号：US11756152B2
公开(公告)日：2023-09-12
申请号：US17960040
申请日：2022-10-04
Applicant: GoPro, Inc.
Inventor： Adeel Abbas , Timothy Macmillan , Cesar Douady-Pleven
IPC: G06T3/00 , H04N23/45 , H04N23/698 , G06T3/40
CPC classification number: G06T3/005 , G06T3/0062 , G06T3/0068 , G06T3/4038 , H04N23/45 , H04N23/698
Abstract: Apparatus and methods for the stitch zone calculation of a generated projection of a spherical image. In one embodiment, a computing device is disclosed which includes logic configured to: obtain a plurality of images; map the plurality of images onto a spherical image; re-orient the spherical image in accordance with a desired stitch line and a desired projection for the desired stitch line; and map the spherical image to the desired projection having the desired stitch line. In a variant, the desired stitch line is mapped onto an optimal stitch zone, the optimal stitch zone characterized as a set of points that defines a single line on the desired projection in which the set of points along the desired projection lie closest to the spherical image in a mean square sense.
-
公开(公告)号：US11631155B2
公开(公告)日：2023-04-18
申请号：US17457738
申请日：2021-12-06
Applicant: GoPro, Inc.
Inventor： Joseph Steel , Timothy Macmillan
IPC: G06T3/00
Abstract: Hyper-hemispherical images may be combined to generate a rectangular projection of a spherical image having an equatorial stitch line along of a line of lowest distortion in the two images. First and second circular images are received representing respective hyper-hemispherical fields of view. A video processing device may project each circular image to a respective rectangular image by mapping an outer edge of the circular image to a first edge of the rectangular image and mapping a center point of the circular image to a second edge of the first rectangular image. The rectangular images may be stitched together along the edges corresponding to the outer edge of the original circular image.
-
公开(公告)号：US20200135238A1
公开(公告)日：2020-04-30
申请号：US16721561
申请日：2019-12-19
Applicant: GoPro, Inc.
Inventor： Scott Patrick Campbell , Zhinian Jing , Timothy Macmillan , David A. Newman , Balineedu Chowdary Adsumilli
Abstract: A spherical content capture system captures spherical video and audio content. In one embodiment, captured metadata or video/audio processing is used to identify content relevant to a particular user based on time and location information. The platform can then generate an output video from one or more shared spherical content files relevant to the user. The output video may include a non-spherical reduced field of view such as those commonly associated with conventional camera systems. Particularly, relevant sub-frames having a reduced field of view may be extracted from each frame of spherical video to generate an output video that tracks a particular individual or object of interest. For each sub-frame, a corresponding portion of an audio track is generated that includes a directional audio signal having a directionality based on the selected sub-frame.
-
30.发明申请公开(公告)号：US20190385273A1
公开(公告)日：2019-12-19
申请号：US16459482
申请日：2019-07-01
Applicant: GoPro, Inc.
Inventor： Adeel Abbas , Timothy Macmillan , Cesar Douady-Pleven
Abstract: Apparatus and methods for the stitch zone calculation of a generated projection of a spherical image. In one embodiment, a computing device is disclosed which includes logic configured to: obtain a plurality of images; map the plurality of images onto a spherical image; re-orient the spherical image in accordance with a desired stitch line and a desired projection for the desired stitch line; and map the spherical image to the desired projection having the desired stitch line. In a variant, the desired stitch line is mapped onto an optimal stitch zone, the optimal stitch zone characterized as a set of points that defines a single line on the desired projection in which the set of points along the desired projection lie closest to the spherical image in a mean square sense.
-
-
-
-
-
-
-
-
-
Search Results
84
records
(took 0.024 seconds)
