公开(公告)号：US08934034B2

公开(公告)日：2015-01-13

申请号：US12736333

申请日：2009-03-27

申请人： Shree K Nayar ,  Fumihito Yasuma ,  Tomoo Mitsunaga

发明人： Shree K Nayar ,  Fumihito Yasuma ,  Tomoo Mitsunaga

IPC分类号： H04N3/14 ,  H04N5/335 ,  H04N9/04 ,  H01L27/146 ,  H04N5/33

CPC分类号： H04N5/238 ,  H01L27/14621 ,  H04N5/332 ,  H04N9/045 ,  H04N9/64

摘要： Generalized assorted pixel camera systems and methods are provided. In accordance with some embodiments, the generalized assorted pixel camera systems include a color filter array, where the color filter array includes a plurality of primary filters and a plurality of secondary filters. Each filter has a particular spectral response and each filter is formed on a corresponding pixel of a plurality of pixels. Each of the plurality of primary filters and the plurality of secondary filters enhances an attribute of image quality and the information obtained using the plurality of primary filters and the plurality of secondary filters is used to balance spectral resolution, dynamic range, and spatial resolution for generating an image of a plurality of image types.

摘要翻译： 提供广泛的各种像素摄像机系统和方法。 根据一些实施例，广义的各种像素相机系统包括滤色器阵列，其中滤色器阵列包括多个初级滤光器和多个次级滤光器。 每个滤波器具有特定的光谱响应，并且每个滤波器形成在多个像素的相应像素上。 多个初级滤波器和多个次级滤波器中的每一个增强了图像质量的属性，并且使用多个初级滤波器和多个次级滤波器获得的信息用于平衡用于产生的光谱分辨率，动态范围和空间分辨率 多个图像类型的图像。

公开(公告)号：US08610789B1

公开(公告)日：2013-12-17

申请号：US13104606

申请日：2011-05-10

申请人： Shree K. Nayar ,  Tomoo Mitsunaga

发明人： Shree K. Nayar ,  Tomoo Mitsunaga

IPC分类号： H04N5/228

CPC分类号： H04N5/235 ,  H04N5/35563

摘要： The application provides techniques for obtaining a relatively high dynamic range image of a scene using a relatively low dynamic range image sensor exposed to incident light from the scene for capturing an image. The image sensor has a multiplicity of light-sensing elements in an array and each light sensing element has a particular one of a plurality of sensitivity levels to incident light in accordance with a predetermined sensitivity pattern for the array of light-sensing elements and has a response function. Each light sensing element is responsive to incident light from the scene for producing a captured image brightness value at a corresponding one of a multiplicity of pixel positions of a pixel position array. Each one of the multiplicity of pixel positions corresponds to a particular one of the plurality of sensitivity levels of the light sensing elements.

摘要翻译： 该应用提供了使用暴露于来自场景的入射光以捕获图像的相对低的动态范围图像传感器来获得场景的相对高的动态范围图像的技术。 图像传感器具有阵列中的多个感光元件，并且每个光感测元件根据用于光感测元件阵列的预定灵敏度图案具有对入射光的多个灵敏度水平中的特定一个，并且具有 响应功能。 每个光感测元件响应来自场景的入射光，以在像素位置阵列的多个像素位置中的相应一个处产生捕获的图像亮度值。 多个像素位置中的每一个对应于光感测元件的多个灵敏度级别中的特定一个。

公开(公告)号：US20110157419A1

公开(公告)日：2011-06-30

申请号：US13045270

申请日：2011-03-10

申请人： Shree K. Nayar ,  Tomoo Mitsunaga

发明人： Shree K. Nayar ,  Tomoo Mitsunaga

IPC分类号： H04N5/235

CPC分类号： H04N5/2355 ,  H04N5/235

摘要： Apparatus and methods are provided for obtaining high dynamic range images using a low dynamic range image sensor. The scene is exposed to the image sensor in a spatially varying manner. A variable-transmittance mask, which is interposed between the scene and the image sensor, imposes a spatially varying attenuation on the scene light incident on the image sensor. The mask includes light transmitting cells whose transmittance is controlled by application of suitable control signals. The mask is configured to generate a spatially varying light attenuation pattern across the image sensor. The image frame sensed by the image sensor is normalized with respect to the spatially varying light attenuation pattern. The normalized image data can be interpolated to account for image sensor pixels that are either under or over exposed to enhance the dynamic range of the image sensor.

摘要翻译： 提供了使用低动态范围图像传感器获得高动态范围图像的装置和方法。 场景以空间变化的方式暴露于图像传感器。 介于场景和图像传感器之间的可变透射掩模对入射在图像传感器上的场景光强加空间变化的衰减。 掩模包括通过施加适当的控制信号来控制透光率的透光单元。 掩模被配置为在图像传感器上产生空间变化的光衰减图案。 由图像传感器感测的图像帧相对于空间变化的光衰减图案被归一化。 可以对归一化图像数据进行内插，以考虑到暴露于或超过曝光的图像传感器像素，以增强图像传感器的动态范围。

公开(公告)号：US06864916B1

公开(公告)日：2005-03-08

申请号：US09326422

申请日：1999-06-04

申请人： Shree K. Nayar ,  Tomoo Mitsunaga

发明人： Shree K. Nayar ,  Tomoo Mitsunaga

IPC分类号： H01L27/14 ,  H04N1/407 ,  H04N5/235 ,  H04N5/238 ,  H04N5/243 ,  H04N9/73

CPC分类号： H04N5/2355 ,  H04N5/235

摘要： Apparatus and methods are provided for obtaining high dynamic range images using a low dynamic range image sensor. The image of a scene is captured with an image sensor using a spatially varying exposure function. The spatially varying exposure function can be implemented in a number of ways, such as by using as an optical mask with a fixed spatial attenuation pattern or by using an array of light sensing elements having spatially varying photosensitivities. The captured image is then normalized with respect to the spatially varying exposure function. The normalized image data can be interpolated to account for pixels that are either saturated or blackened to enhance the dynamic range of the image sensor.

摘要翻译： 提供了使用低动态范围图像传感器获得高动态范围图像的装置和方法。 使用空间变化曝光功能的图像传感器拍摄场景的图像。 空间变化的曝光功能可以以多种方式实现，例如通过使用具有固定的空间衰减图案的光学掩模或通过使用具有空间变化光敏度的光感测元件的阵列。 捕获的图像然后相对于空间变化的曝光功能被归一化。 归一化图像数据可被内插以考虑饱和或变黑的像素以增强图像传感器的动态范围。

公开(公告)号：US20110211099A1

公开(公告)日：2011-09-01

申请号：US12736333

申请日：2009-03-27

申请人： Shree K. Nayar ,  Fumihito Yasuma ,  Tomoo Mitsunaga

发明人： Shree K. Nayar ,  Fumihito Yasuma ,  Tomoo Mitsunaga

IPC分类号： H04N5/335

CPC分类号： H04N5/238 ,  H01L27/14621 ,  H04N5/332 ,  H04N9/045 ,  H04N9/64

摘要： Generalized assorted pixel camera systems and methods are provided. In accordance with some embodiments, the generalized assorted pixel camera systems include a color filter array, where the color filter array includes a plurality of primary filters and a plurality of secondary filters. Each filter has a particular spectral response and each filter is formed on a corresponding pixel of a plurality of pixels. Each of the plurality of primary filters and the plurality of secondary filters enhances an attribute of image quality and the information obtained using the plurality of primary filters and the plurality of secondary filters is used to balance spectral resolution, dynamic range, and spatial resolution for generating an image of a plurality of image types.

摘要翻译： 提供广泛的各种像素摄像机系统和方法。 根据一些实施例，广义的各种像素相机系统包括滤色器阵列，其中滤色器阵列包括多个初级滤光器和多个次级滤光器。 每个滤波器具有特定的光谱响应，并且每个滤波器形成在多个像素的相应像素上。 多个初级滤波器和多个次级滤波器中的每一个增强了图像质量的属性，并且使用多个初级滤波器和多个次级滤波器获得的信息用于平衡用于产生的光谱分辨率，动态范围和空间分辨率 多个图像类型的图像。

公开(公告)号：US07924321B2

公开(公告)日：2011-04-12

申请号：US10886746

申请日：2004-07-07

申请人： Shree K. Nayar ,  Tomoo Mitsunaga

发明人： Shree K. Nayar ,  Tomoo Mitsunaga

IPC分类号： H04N5/235 ,  H04N9/73

CPC分类号： H04N5/2355 ,  H04N5/235

摘要： Apparatus and methods are provided for obtaining high dynamic range images using a low dynamic range image sensor. The scene is exposed to the image sensor in a spatially varying manner. A variable-transmittance mask, which is interposed between the scene and the image sensor, imposes a spatially varying attenuation on the scene light incident on the image sensor. The mask includes light transmitting cells whose transmittance is controlled by application of suitable control signals. The mask is configured to generate a spatially varying light attenuation pattern across the image sensor. The image frame sensed by the image sensor is normalized with respect to the spatially varying light attenuation pattern. The normalized image data can be interpolated to account for image sensor pixels that are either under or over exposed to enhance the dynamic range of the image sensor.

摘要翻译： 提供了使用低动态范围图像传感器获得高动态范围图像的装置和方法。 场景以空间变化的方式暴露于图像传感器。 介于场景和图像传感器之间的可变透射掩模对入射在图像传感器上的场景光强加空间变化的衰减。 掩模包括通过施加适当的控制信号来控制透光率的透光单元。 掩模被配置为在图像传感器上产生空间变化的光衰减图案。 由图像传感器感测的图像帧相对于空间变化的光衰减图案被归一化。 可以对归一化图像数据进行内插，以考虑到暴露于或超过曝光的图像传感器像素，以增强图像传感器的动态范围。

公开(公告)号：US09100514B2

公开(公告)日：2015-08-04

申请号：US13504905

申请日：2010-10-28

申请人： Jinwei Gu ,  Yasunobu Hitomi ,  Tomoo Mitsunaga ,  Shree K. Nayar

发明人： Jinwei Gu ,  Yasunobu Hitomi ,  Tomoo Mitsunaga ,  Shree K. Nayar

IPC分类号： H04N3/14 ,  H04N5/335 ,  H04N7/00 ,  H04N5/232 ,  H04N5/235 ,  H04N5/353 ,  H04N5/355 ,  G06T5/00

CPC分类号： H04N7/002 ,  G06T5/003 ,  G06T2207/20201 ,  H04N5/2329 ,  H04N5/2353 ,  H04N5/3532 ,  H04N5/3535 ,  H04N5/35554 ,  H04N5/374 ,  H04N5/378 ,  H04N7/00

摘要： Methods and systems for coded rolling shutter are provided. In accordance with some embodiments, methods and system are provided that control the readout timing and exposure length for each row of a pixel array in an image sensor, thereby flexibly sampling the three-dimensional space-time value of a scene and capturing sub-images that effectively encode motion and dynamic range information within a single captured image.

摘要翻译： 提供编码滚动快门的方法和系统。 根据一些实施例，提供了控制图像传感器中的像素阵列的每行的读出定时和曝光长度的方法和系统，从而灵活地对场景的三维时空值进行采样并捕获子图像 其在单个捕获图像内有效地编码运动和动态范围信息。

公开(公告)号：US08934029B2

公开(公告)日：2015-01-13

申请号：US13045270

申请日：2011-03-10

申请人： Shree K. Nayar ,  Tomoo Mitsunaga

发明人： Shree K. Nayar ,  Tomoo Mitsunaga

IPC分类号： H04N5/235 ,  H04N9/73

CPC分类号： H04N5/2355 ,  H04N5/235

摘要： Apparatus and methods are provided for obtaining high dynamic range images using a low dynamic range image sensor. The scene is exposed to the image sensor in a spatially varying manner. A variable-transmittance mask, which is interposed between the scene and the image sensor, imposes a spatially varying attenuation on the scene light incident on the image sensor. The mask includes light transmitting cells whose transmittance is controlled by application of suitable control signals. The mask is configured to generate a spatially varying light attenuation pattern across the image sensor. The image frame sensed by the image sensor is normalized with respect to the spatially varying light attenuation pattern. The normalized image data can be interpolated to account for image sensor pixels that are either under or over exposed to enhance the dynamic range of the image sensor.

摘要翻译： 提供了使用低动态范围图像传感器获得高动态范围图像的装置和方法。 场景以空间变化的方式暴露于图像传感器。 介于场景和图像传感器之间的可变透射掩模对入射在图像传感器上的场景光强加空间变化的衰减。 掩模包括通过施加适当的控制信号来控制透光率的透光单元。 掩模被配置为在图像传感器上产生空间变化的光衰减图案。 由图像传感器感测的图像帧相对于空间变化的光衰减图案被归一化。 可以对归一化图像数据进行内插，以考虑到暴露于或超过曝光的图像传感器像素，以增强图像传感器的动态范围。

公开(公告)号：US20140192235A1

公开(公告)日：2014-07-10

申请号：US14001139

申请日：2012-02-27

申请人： Yasunobu Hitomi ,  Jinwei Gu ,  Mohit Gupta ,  Tomoo Mitsunaga ,  Shree K. Nayar

发明人： Yasunobu Hitomi ,  Jinwei Gu ,  Mohit Gupta ,  Tomoo Mitsunaga ,  Shree K. Nayar

IPC分类号： G06T5/00

CPC分类号： H04N13/106 ,  G06T1/0007 ,  G06T5/002 ,  G06T7/50 ,  G06T2200/21 ,  H04N5/2353 ,  H04N5/341 ,  H04N5/3535 ,  H04N13/128 ,  H04N13/296 ,  H04N13/388

摘要： Systems, methods, and media for reconstructing a space-time volume from a coded image are provided. In accordance with some embodiments, systems for reconstructing a space-time volume from a coded image are provided, the systems comprising: an image sensor that outputs image data; and at least one processor that: causes a projection of the space-time volume to be captured in a single image of the image data in accordance with a coded shutter function; receives the image data; and performs a reconstruction process on the image data to provide a space-time volume corresponding to the image data.

摘要翻译： 提供了用于从编码图像重构空时卷的系统，方法和介质。 根据一些实施例，提供了用于从编码图像重构空时体积的系统，所述系统包括：输出图像数据的图像传感器; 以及至少一个处理器，其根据编码的快门功能使得将空间体积的投影捕获在图像数据的单个图像中; 接收图像数据; 对图像数据进行重建处理，以提供与图像数据对应的时空容量。

公开(公告)号：US20130070121A1

公开(公告)日：2013-03-21

申请号：US13504905

申请日：2010-10-28

申请人： Jinwei Gu ,  Yasunobu Hitomi ,  Tomoo Mitsunaga ,  Shree K. Nayar

发明人： Jinwei Gu ,  Yasunobu Hitomi ,  Tomoo Mitsunaga ,  Shree K. Nayar

IPC分类号： H04N7/00

CPC分类号： H04N7/002 ,  G06T5/003 ,  G06T2207/20201 ,  H04N5/2329 ,  H04N5/2353 ,  H04N5/3532 ,  H04N5/3535 ,  H04N5/35554 ,  H04N5/374 ,  H04N5/378 ,  H04N7/00

摘要： Methods and systems for coded rolling shutter are provided. In accordance with some embodiments, methods and system are provided that control the readout timing and exposure length for each row of a pixel array in an image sensor, thereby flexibly sampling the three-dimensional space-time value of a scene and capturing sub-images that effectively encode motion and dynamic range information within a single captured image.