公开(公告)号：US11711613B2

公开(公告)日：2023-07-25

申请号：US17241742

申请日：2021-04-27

Applicant: QUALCOMM Incorporated

Inventor： Shang-Chih Chuang ,  Ron Gaizman ,  Pradeep Veeramalla ,  Shizhong Liu ,  Weiliang Liu ,  Xiaoyun Jiang ,  Narayana Karthik Ravirala ,  Jiafu Luo ,  Srinath Anekere Narayan ,  Wei Zou

IPC: H04N23/68

CPC classification number: H04N23/689 ,  H04N23/6812

Abstract: Image frames for computational photography may be corrected, such as through rolling shutter correction (RSC), prior to fusion of the image frames to reduce wobble and jitter artifacts present in a video sequence of HDR-enhanced image frames. First and second motion data regarding motion of the image capture device may be determined for times corresponding to the capturing of the first and second image frames, respectively. The rolling shutter correction (RSC) may be applied to the first and second image frames based on both the first and second motion data. The corrected first and second image frames may then be aligned and fused to obtain a single output image frame with higher dynamic range than either of the first or second image frames.

公开(公告)号：US20200084432A1

公开(公告)日：2020-03-12

申请号：US16123561

申请日：2018-09-06

Applicant: QUALCOMM Incorporated

Inventor： Narayana Karthik Ravirala ,  Jiafu Luo ,  Shizhong Liu ,  Karthikeyan Shanmugavadivelu

IPC: H04N13/296 ,  H04N13/239 ,  H04N5/353

Abstract: Systems and methods for synchronizing frame captures for cameras with different fields of capture are described. An example device includes a first camera and second camera. The first camera includes a first camera sensor and a first rolling shutter. The first camera is configured to prevent scanning pixels from a first row to a row n of the first camera sensor and configured to begin sequentially scanning pixels of the row n of the first camera sensor. The second camera includes a second camera sensor and a second rolling shutter. The second camera is configured to begin sequentially scanning pixels of a first row of the second camera sensor concurrently with beginning to sequentially scan pixels of the row n of the first camera sensor. The first row of the second camera sensor corresponds to a row within a predefined number of rows after the first camera sensor's row n.

公开(公告)号：US09692997B2

公开(公告)日：2017-06-27

申请号：US15082326

申请日：2016-03-28

Applicant: QUALCOMM Incorporated

Inventor： Biay-Cheng Hseih ,  Jiafu Luo ,  Sergiu Radu Goma

IPC: H04N5/363 ,  H04N5/378 ,  H04N5/374 ,  H04N5/355 ,  H04N5/376 ,  H04N5/3745

CPC classification number: H04N5/363 ,  H04N5/35572 ,  H04N5/35581 ,  H04N5/3559 ,  H04N5/374 ,  H04N5/3745 ,  H04N5/37452 ,  H04N5/37457 ,  H04N5/3765 ,  H04N5/378

Abstract: Certain aspects relate to systems and techniques for full well capacity extension. For example, a storage capacitor included in the pixel readout architecture can enable multiple charge dumps from a pixel in the analog domain, extending the full well capacity of the pixel. Further, multiple reads can be integrated in the digital domain using a memory, for example DRAM, in communication with the pixel readout architecture. This also can effectively multiply a small pixel's full well capacity. In some examples, multiple reads in the digital domain can be used to reduce, eliminate, or compensate for kTC noise in the pixel readout architecture.

公开(公告)号：US09332200B1

公开(公告)日：2016-05-03

申请号：US14562444

申请日：2014-12-05

Applicant: QUALCOMM Incorporated

Inventor： Biay-Cheng Hseih ,  Jiafu Luo ,  Sergiu Radu Goma

IPC: H04N5/363 ,  H04N5/378 ,  H04N5/374 ,  H04N5/3745

CPC classification number: H04N5/363 ,  H04N5/35572 ,  H04N5/35581 ,  H04N5/3559 ,  H04N5/374 ,  H04N5/3745 ,  H04N5/37452 ,  H04N5/37457 ,  H04N5/3765 ,  H04N5/378

Abstract: Certain aspects relate to systems and techniques for full well capacity extension. For example, a storage capacitor included in the pixel readout architecture can enable multiple charge dumps from a pixel in the analog domain, extending the full well capacity of the pixel. Further, multiple reads can be integrated in the digital domain using a memory, for example DRAM, in communication with the pixel readout architecture. This also can effectively multiply a small pixel's full well capacity. In some examples, multiple reads in the digital domain can be used to reduce, eliminate, or compensate for kTC noise in the pixel readout architecture.

Abstract translation: 某些方面涉及全井容量扩展的系统和技术。 例如，包括在像素读出结构中的存储电容器可以实现来自模拟域中的像素的多次电荷转储，从而延长像素的全部阱容量。 此外，可以使用与像素读出架构通信的存储器（例如DRAM）在数字域中集成多个读取。 这也可以有效地增加小像素的满井容量。 在一些示例中，可以使用数字域中的多次读取来减少，消除或补偿像素读出架构中的kTC噪声。

公开(公告)号：US09307161B2

公开(公告)日：2016-04-05

申请号：US14152888

申请日：2014-01-10

Applicant: QUALCOMM Incorporated

Inventor： Ji Soo Lee ,  Jiafu Luo

IPC: H04N5/374 ,  H04N5/355 ,  H04N5/235 ,  H04N5/353 ,  H04N5/3745

CPC classification number: H04N5/2355 ,  H04N5/3532 ,  H04N5/3535 ,  H04N5/35554 ,  H04N5/35581 ,  H04N5/374 ,  H04N5/3745

Abstract: Methods, devices, and computer program products for image sensors with overlapped exposure brackets supporting multiple short exposures are described. In one aspect, a method of capturing an image is disclosed. The method includes capturing, on a first subset of pixels on an image sensor, a first image with a first exposure length. The method further includes simultaneously capturing, on a second subset of pixels on an image sensor, a plurality of images with a second exposure length, wherein the second exposure length is shorter than the first exposure length. The method further includes combining the plurality of images with a second exposure length into a second image. Finally, the method includes combining the first image and the second image.

Abstract translation: 描述了支持多次短曝光的重叠曝光支架的图像传感器的方法，设备和计算机程序产品。 一方面，公开了拍摄图像的方法。 该方法包括在图像传感器上的像素的第一子集上捕获具有第一曝光长度的第一图像。 该方法还包括同时在第二曝光长度短于第一曝光长度的同时在图像传感器上的第二像素子集上捕获具有第二曝光长度的多个图像。 该方法还包括将多个图像与第二曝光长度组合成第二图像。 最后，该方法包括组合第一图像和第二图像。

公开(公告)号：US20240357224A1

公开(公告)日：2024-10-24

申请号：US18305304

申请日：2023-04-21

Applicant: QUALCOMM Incorporated

Inventor： Jiafu Luo ,  Xiaoyun Jiang ,  Narayana Karthik Ravirala ,  Jianyou Li

IPC: H04N23/63 ,  G06T7/00 ,  H04N23/57 ,  H04N23/65 ,  H04N23/69 ,  H04N25/46 ,  H04N25/47

CPC classification number: H04N23/632 ,  G06T7/97 ,  H04N23/57 ,  H04N23/65 ,  H04N23/69 ,  H04N25/46 ,  H04N25/47 ,  G06T2207/10144 ,  G06T2207/20104 ,  G06T2207/20221

Abstract: Systems and methods for image fusing are described. In examples, a first image of a scene may be obtained associated with a first parameter and a second image of the scene may be obtained associated with a second parameter. The first image and the second image may be fused to obtain at least one first fused image. A third image of the scene may be obtained associated with a third parameter and a fourth image of the scene may be obtained associated with a fourth image. At least one parameter associated with the third image and the fourth image used to obtain the images may be adjusted, wherein the adjustment may be based at least in part on a field of view of the at least one first fused image. The third image and the fourth image may be fused to obtain a second fused image.

公开(公告)号：US12101563B2

公开(公告)日：2024-09-24

申请号：US17456117

申请日：2021-11-22

Applicant: QUALCOMM Incorporated

Inventor： Jing Wang ,  Jiafu Luo ,  Silei Ma ,  Xiaoyun Jiang

IPC: H04N23/741 ,  H04N23/73 ,  H04N25/585

CPC classification number: H04N23/741 ,  H04N23/73 ,  H04N25/585

Abstract: This disclosure provides systems, methods, and devices for image signal processing that support improved detail keeping in photography through increased dynamic range and/or highlight-keeping. The image signal processing may be performed on data received from a split-pixel image sensor with two sets of sensor elements with different sensitivities. The image signal processing may include receiving image data comprising: first data from a first set of sensor elements and second data from a second set of sensor elements capturing a representation of the scene with a different sensitivity that the first set of sensor elements; determining an output dynamic range for an output image frame; and determining an output image frame based on at least one of the first data and the second data and based on the output dynamic range. Other aspects and features are also claimed and described.

公开(公告)号：US12015835B2

公开(公告)日：2024-06-18

申请号：US17584119

申请日：2022-01-25

Applicant: QUALCOMM Incorporated

Inventor： Micha Galor Gluskin ,  Jing Wang ,  Jiafu Luo

IPC: H04N23/16 ,  G06T7/90 ,  H04N9/64 ,  H04N9/67

CPC classification number: H04N23/16 ,  G06T7/90 ,  H04N9/646 ,  H04N9/67 ,  G06T2207/10024 ,  G06T2207/10048

Abstract: Systems and techniques are provided for processing images. For example, a process can include obtaining a first color image including first one or more pixels from a first image sensor and obtaining a second color image including second one or more pixels from a second sensor, the second color image including infrared (IR) information from a second image sensor. The process can include determining a transformation between colors associated with the first one or more pixels and colors associated with the second one or more pixels based on a comparison associated with the first one or more pixels and the second one or more pixels. The process can include generating a color corrected image at least in part by transforming the second color image including IR information to a color corrected image based on the determined transformation.

公开(公告)号：US20230164447A1

公开(公告)日：2023-05-25

申请号：US17456117

申请日：2021-11-22

Applicant: QUALCOMM Incorporated

Inventor： Jing Wang ,  Jiafu Luo ,  Silei Ma ,  Xiaoyun Jiang

IPC: H04N5/235 ,  H04N5/355

CPC classification number: H04N5/2355 ,  H04N5/2353 ,  H04N5/35563

Abstract: This disclosure provides systems, methods, and devices for image signal processing that support improved detail keeping in photography through increased dynamic range and/or highlight-keeping. The image signal processing may be performed on data received from a split-pixel image sensor with two sets of sensor elements with different sensitivities. The image signal processing may include receiving image data comprising: first data from a first set of sensor elements and second data from a second set of sensor elements capturing a representation of the scene with a different sensitivity that the first set of sensor elements; determining an output dynamic range for an output image frame; and determining an output image frame based on at least one of the first data and the second data and based on the output dynamic range. Other aspects and features are also claimed and described.

公开(公告)号：US10904637B2

公开(公告)日：2021-01-26

申请号：US16222885

申请日：2018-12-17

Applicant: QUALCOMM Incorporated

Inventor： Hau Hwang ,  Jisoo Lee ,  Jiafu Luo

IPC: H04N7/173 ,  H04N21/6547 ,  G06N3/04 ,  G06N3/08 ,  H04N21/235 ,  H04N21/443 ,  H04N21/84

Abstract: Techniques and systems are provided for providing a rendering engine model for raw media data. In some examples, a system obtains media data captured by a data capturing device and embeds, in a media item containing the media data, a rendering engine model including a description of a neural network configured to process the media data and generate a particular media data output, the description defining a neural network architecture for the neural network. The system then outputs the media item with the rendering engine model embedded in the media item, the rendering engine model indicating how to execute the neural network to process the media data in the media item and generate the particular media data output based on the description of the neural network.