公开(公告)号：US11064133B2

公开(公告)日：2021-07-13

申请号：US16544008

申请日：2019-08-19

Applicant: Samsung Electronics Co., Ltd.

Inventor： Ruiwen Zhen ,  John W. Glotzbach ,  Hamid R. Sheikh ,  Ibrahim Pekkucuksen ,  Zhen Tong ,  Long N. Le

IPC: H04N5/235 ,  G06T5/40 ,  G06T5/50 ,  G06T5/00

Abstract: A method includes obtaining multiple image frames of a scene using at least one sensor of an electronic device. The multiple image frames include a first image frame and a second image frame having a longer exposure than the first image frame. The method also includes generating a label map that identifies pixels in the multiple image frames that are to be used in an image. The method further includes generating the image of the scene using the pixels extracted from the image frames based on the label map. The label map may include multiple labels, and each label may be associated with at least one corresponding pixel and may include a discrete value that identifies one of the multiple image frames from which the at least one corresponding pixel is extracted.

公开(公告)号：US20200267300A1

公开(公告)日：2020-08-20

申请号：US16277630

申请日：2019-02-15

Applicant: Samsung Electronics Co., Ltd.

Inventor： Ruiwen Zhen ,  John Glotzbach ,  Ibrahim Pekkucuksen ,  Hamid R. Sheikh

IPC: H04N5/235 ,  G06T7/20 ,  G06T7/44 ,  G06T5/40 ,  G06T5/00

Abstract: An electronic device, method, and computer readable medium for compositing high dynamic range frames are provided. The electronic device includes a camera, and a processor coupled to the camera. The processor registers the plurality of multi-exposure frames with a hybrid of matched features to align non-reference frames with a reference frame; generates blending maps of the plurality of multi-exposure frames to reduce moving ghost artifacts and identify local areas that are well-exposed in the plurality of multi-exposure frames; and blends the plurality of multi-exposure frames weighted by the blending maps using a two-step weight-constrained exposure fusion technique into a high dynamic range (HDR) frame.

公开(公告)号：US20200265555A1

公开(公告)日：2020-08-20

申请号：US16278567

申请日：2019-02-18

Applicant: Samsung Electronics Co., Ltd.

Inventor： Omar A. Elgendy ,  John W. Glotzbach ,  Hamid R. Sheikh

IPC: G06T3/40 ,  G06T3/00 ,  G06T5/10 ,  G06T5/50

Abstract: A method includes obtaining multiple image frames of a scene using at least one camera of an electronic device and processing the multiple image frames to generate a higher-resolution image of the scene. Processing the multiple image frames includes generating an initial estimate of the scene based on the multiple image frames. Processing the multiple image frames also includes, in each of multiple iterations, (i) generating a current estimate of the scene based on the image frames and a prior estimate of the scene and (ii) regularizing the generated current estimate of the scene. The regularized current estimate of the scene from one iteration represents the prior estimate of the scene in a subsequent iteration. The iterations continue until the estimates of the scene converge on the higher-resolution image of the scene.

公开(公告)号：US10742892B1

公开(公告)日：2020-08-11

申请号：US16278543

申请日：2019-02-18

Applicant: Samsung Electronics Co., Ltd.

Inventor： Long N. Le ,  Hamid R. Sheikh ,  John W. Glotzbach

IPC: H04N5/235 ,  G06T5/00 ,  G06T5/40 ,  G06T5/50

Abstract: A method includes capturing multiple ambient images of a scene using at least one camera of an electronic device and without using a flash of the electronic device. The method also includes capturing multiple flash images of the scene using the at least one camera of the electronic device and during firing of a pilot flash sequence using the flash. The method further includes analyzing multiple pairs of images to estimate exposure differences obtained using the flash, where each pair of images includes one of the ambient images and one of the flash images that are both captured using a common camera exposure and where different pairs of images are captured using different camera exposures. In addition, the method includes determining a flash strength for the scene based on the estimate of the exposure differences and firing the flash based on the determined flash strength.

公开(公告)号：US20190011978A1

公开(公告)日：2019-01-10

申请号：US15646048

申请日：2017-07-10

Applicant: Samsung Electronics Co., Ltd

Inventor： Sourabh Ravindran ,  Hamid R. Sheikh ,  Michael Polley ,  Youngjun Yoo

IPC: G06F3/01 ,  G06F3/147 ,  H04N5/225

Abstract: An embodiment of this disclosure provides a wearable device. The wearable device includes a memory configured to store a plurality of content for display, a transceiver configured to receive the plurality of content from a connected device, a display configured to display the plurality of content, and a processor coupled to the memory, the display, and the transceiver. The processor is configured to control the display to display at least some of the plurality of content in a spatially arranged format. The displayed content is on the display at a display position. The plurality of content, when shown on the connected device, is not in the spatially arranged format. The processor is also configured to receive movement information based on a movement of the wearable device. The processor is also configured to adjust the display position of the displayed content according to the movement information of the wearable device.

公开(公告)号：US20180189937A1

公开(公告)日：2018-07-05

申请号：US15862492

申请日：2018-01-04

Applicant: Samsung Electronics Co., Ltd.

Inventor： Raja Bala ,  Hamid R. Sheikh ,  John Glotzbach

IPC: G06T5/50 ,  G06T7/33

CPC classification number: G06T5/50 ,  G06T7/337 ,  G06T2207/20221 ,  G06T2207/30168

Abstract: An electronic device, method, and computer readable medium for multi-frame image processing using semantic saliency are provided. The electronic device includes a camera, a display, and a processor. The processor is coupled to the camera and the display. The processor receives a plurality of frames captured by the camera during a capture event; identifies a salient region in each of the plurality of frames; determines a reference frame from the plurality of frames based on the identified salient regions; fuses non-reference frames with the determined reference frame into a completed image output.

公开(公告)号：US09531962B2

公开(公告)日：2016-12-27

申请号：US14682895

申请日：2015-04-09

Applicant: Samsung Electronics Co., Ltd.

Inventor： Osman G. Sezer ,  John W. Glotzbach ,  Hamid R. Sheikh

IPC: G06K9/32 ,  H04N5/262 ,  G06T7/00 ,  H04N5/232 ,  H04N5/265 ,  H04N5/235 ,  G06T3/40

CPC classification number: H04N5/2628 ,  G06T3/4038 ,  G06T7/33 ,  G06T7/337 ,  G06T2207/10016 ,  G06T2207/10024 ,  G06T2207/20221 ,  H04N5/23229 ,  H04N5/23267 ,  H04N5/23296 ,  H04N5/2355 ,  H04N5/2625 ,  H04N5/265

Abstract: A method includes identifying feature points in an image in images generated of a scene by a camera and identifying locations of the identified feature points in remaining images in the images. The method also includes selecting a group of the identified feature points indicative of relative motion of the camera between image captures and aligning a set of the images using the selected group of feature points. The method may further include selecting a reference image from the set of aligned images, weighting other images the set, and combining the reference image with the weighted images. Weighting of the other images may include, for each other image in the set, comparing the other image and the reference image to identify one or more moving objects in the other image and applying a weight to pixel locations in the other image.

Abstract translation: 一种方法包括通过照相机识别由场景产生的图像中的图像中的特征点，并且识别图像中剩余图像中所识别的特征点的位置。 该方法还包括选择一组识别的特征点，其指示相机在图像拍摄之间的相对运动并且使用所选择的特征点组对准一组图像。 该方法还可以包括从对准的图像集合中选择参考图像，对集合的其它图像加权，以及将参考图像与加权图像组合。 其他图像的权重可以包括对于集合中的每个其他图像，比较其他图像和参考图像以识别另一图像中的一个或多个移动对象，并且对另一图像中的像素位置应用权重。

公开(公告)号：US20160028967A1

公开(公告)日：2016-01-28

申请号：US14682895

申请日：2015-04-09

Applicant: Samsung Electronics Co., Ltd.

Inventor： Osman G. Sezer ,  John W. Glotzbach ,  Hamid R. Sheikh

IPC: H04N5/262 ,  H04N5/232 ,  H04N5/265 ,  G06T7/00

CPC classification number: H04N5/2628 ,  G06T3/4038 ,  G06T7/33 ,  G06T7/337 ,  G06T2207/10016 ,  G06T2207/10024 ,  G06T2207/20221 ,  H04N5/23229 ,  H04N5/23267 ,  H04N5/23296 ,  H04N5/2355 ,  H04N5/2625 ,  H04N5/265

Abstract: A method and apparatus for aligning and combining images. The method includes identifying feature points in an image in images generated of a scene by a camera and identifying locations of the identified feature points in remaining images in the images. The method also includes selecting a group of the identified feature points indicative of relative motion of the camera between image captures and aligning a set of the images using the selected group of feature points. The method may further include selecting a reference image from the set of aligned images, weighting other images the set, and combining the reference image with the weighted images. Weighting of the other images may include, for each other image in the set, comparing the other image and the reference image to identify one or more moving objects in the other image and applying a weight to pixel locations in the other image.

Abstract translation: 用于对准和组合图像的方法和装置。 该方法包括通过照相机识别由场景产生的图像中的图像中的特征点，以及识别图像中剩余图像中识别的特征点的位置。 该方法还包括选择一组识别的特征点，其指示相机在图像拍摄之间的相对运动并且使用所选择的特征点组对准一组图像。 该方法还可以包括从对准的图像集合中选择参考图像，对集合的其它图像加权，以及将参考图像与加权图像组合。 其他图像的权重可以包括对于集合中的每个其他图像，比较其他图像和参考图像以识别另一图像中的一个或多个移动对象，并且对另一图像中的像素位置应用权重。

公开(公告)号：US20160028966A1

公开(公告)日：2016-01-28

申请号：US14690046

申请日：2015-04-17

Applicant: Samsung Electronics Co., Ltd.

Inventor： Hamid R. Sheikh ,  John W. Glotzbach ,  Osman G. Sezer

IPC: H04N5/232 ,  G06T3/00 ,  G06T3/40 ,  H04N5/265 ,  G06T5/50 ,  G06T7/20 ,  G06K9/46 ,  G06T3/60

CPC classification number: H04N5/23296 ,  G06K9/46 ,  G06T3/0006 ,  G06T3/4007 ,  G06T3/4053 ,  G06T3/60 ,  G06T5/50 ,  G06T7/20 ,  G06T2200/12 ,  G06T2207/20024 ,  G06T2207/20182 ,  G06T2207/20212 ,  H04N5/23229 ,  H04N5/23232 ,  H04N5/23245 ,  H04N5/23258 ,  H04N5/262 ,  H04N5/265

Abstract: A mobile device includes an embedded digital camera that is configured to capture a burst of N images. The mobile device includes processing circuitry comprising a registration module configured to, for each image within the burst of images: analyze an amount of warp of the image and generate a set of affine matrices indicating the amount of warp of the image. The processing circuitry includes a High Fidelity Interpolation block configured to, for each image within the burst of images: perform affine transformation using the set of affine matrices associated with the image, apply an aliasing-retaining interpolation filter, and implement rotation transformation and sub-pixel shifts, yielding an interpolated image. The processing circuitry includes a blending module configured to receive the N interpolated images and blend the N interpolated images into a single-blended image having a user-selected digital zoom ratio.

Abstract translation: 移动设备包括被配置为捕获N个图像的突发的嵌入式数字照相机。 移动设备包括处理电路，其包括配置为针对图像脉冲串内的每个图像的注册模块：分析图像的扭曲量并生成表示图像的扭曲量的一组仿射矩阵。 所述处理电路包括：高保真插值块，被配置为针对所述图像脉冲串内的每个图像：使用与所述图像相关联的所述一组仿射矩阵执行仿射变换，应用混叠保持内插滤波器，以及实施旋转变换和子像素， 像素移位，产生内插图像。 处理电路包括混合模块，其被配置为接收N个内插图像，并将N个内插图像混合成具有用户选择的数字缩放比率的单一混合图像。