公开(公告)号：US09088714B2

公开(公告)日：2015-07-21

申请号：US13109941

申请日：2011-05-17

申请人： Frank Doepke ,  Ralph Brunner

发明人： Frank Doepke ,  Ralph Brunner

IPC分类号： H04N5/225 ,  H04N5/232

CPC分类号： H04N5/23238

摘要： This disclosure pertains to devices, methods, and computer readable media for performing positional sensor-assisted panoramic photography techniques in handheld personal electronic devices. Generalized steps that may be used to carry out the panoramic photography techniques described herein include, but are not necessarily limited to: 1.) acquiring image data from the electronic device's image sensor; 2.) performing “motion filtering” on the acquired image data, e.g., using information returned from positional sensors of the electronic device to inform the processing of the image data; 3.) performing image registration between adjacent captured images; 4.) performing geometric corrections on captured image data, e.g., due to perspective changes and/or camera rotation about a non-center of perspective (COP) camera point; and 5.) “stitching” the captured images together to create the panoramic scene, e.g., blending the image data in the overlap area between adjacent captured images. The resultant stitched panoramic image may be cropped before final storage.

摘要翻译： 本公开涉及用于在手持式个人电子设备中执行位置传感器辅助全景摄影技术的设备，方法和计算机可读介质。 可以用于执行本文描述的全景摄影技术的通用步骤包括但不限于：1.从电子设备的图像传感器获取图像数据; 2.对所获取的图像数据执行“运动滤波”，例如使用从电子设备的位置传感器返回的信息来通知图像数据的处理; 3）在相邻拍摄图像之间执行图像配准; 4.）对捕获的图像数据进行几何校正，例如由于透视变化和/或关于非中心透镜（COP）相机点的相机旋转; 和5.）将捕获的图像拼接在一起以创建全景场景，例如，将相邻拍摄图像之间的重叠区域中的图像数据混合。 最终的缝合全景图像可以在最终存储之前被裁剪。

公开(公告)号：US08793576B2

公开(公告)日：2014-07-29

申请号：US11251215

申请日：2005-10-14

申请人： Mark Zimmer ,  Ralph Brunner ,  Imran Chaudhri

发明人： Mark Zimmer ,  Ralph Brunner ,  Imran Chaudhri

IPC分类号： G06F3/00 ,  G06F17/00 ,  G06F3/048

CPC分类号： G09G5/363 ,  G06F9/451 ,  G06T1/20 ,  G06T11/001 ,  G09G5/14

摘要： Disclosed are a system and method for computing a desktop picture. Instead of loading a file that contains the desktop image from memory, the present invention provides for a system and method for opening and retaining a procedural recipe and a small set of instructions that can be executed to compute a desktop picture. The desktop picture can be computed very quickly using a GPU (graphics processing unit), and can be made to move on demand. When a part of the desktop image is needed to composite, that part is computed using a fragment program on the GPU using the procedural recipe and a specially written fragment program into a temporary VRAM buffer. After it is computed and composited, the buffer containing the result of the fragment program may be discarded.

摘要翻译： 公开了一种用于计算桌面图片的系统和方法。 本发明不是从存储器加载包含桌面图像的文件，而是提供用于打开和保留程序配方的系统和方法以及可以执行以计算桌面图片的一小组指令。 可以使用GPU（图形处理单元）非常快速地计算桌面图像，并且可以根据需要进行移动。 当桌面图像的一部分需要复合时，该部分使用程序配方的GPU上的片段程序和特殊写入的片段程序计算到临时VRAM缓冲区中。 在计算和合成之后，可能会丢弃包含片段程序结果的缓冲区。

公开(公告)号：US08405736B2

公开(公告)日：2013-03-26

申请号：US12755693

申请日：2010-04-07

申请人： Ralph Brunner

发明人： Ralph Brunner

IPC分类号： H04N5/228 ,  H04N5/238 ,  G06K9/00 ,  G06K9/36

CPC分类号： H04N5/23219

摘要： Techniques for reducing the amount of time a camera device requires to automatically adjust focus and/or exposure settings prior to image capture are described. As disclosed, sensor data is used to identify the camera device's orientation. Once known, face detection operations are performed for only that orientation thereby dramatically reducing the amount of processing time required to perform the face detection. The result of the face detection operations may be used to automatically adjust the image capture device's focus and/or exposure.

摘要翻译： 描述了用于减少相机设备在图像捕获之前自动调整焦点和/或曝光设置所需的时间量的技术。 如所公开的，传感器数据用于识别摄像机设备的方向。 一旦知道，仅针对该方向执行面部检测操作，从而显着减少执行面部检测所需的处理时间量。 面部检测操作的结果可以用于自动调整图像捕获装置的焦点和/或曝光。

公开(公告)号：US20130074077A1

公开(公告)日：2013-03-21

申请号：US13616856

申请日：2012-09-14

申请人： Howard Miller ,  Ralph Brunner

发明人： Howard Miller ,  Ralph Brunner

IPC分类号： G06F9/46

CPC分类号： G06F15/16 ,  G06F1/3203 ,  G06F1/329 ,  G06F9/5044 ,  G06F9/5094 ,  G06F2209/501 ,  Y02D10/22 ,  Y02D10/24

摘要： Exemplary embodiments of methods and apparatuses to dynamically redistribute computational processes in a system that includes a plurality of processing units are described. The power consumption, the performance, and the power/performance value are determined for various computational processes between a plurality of subsystems where each of the subsystems is capable of performing the computational processes. The computational processes are exemplarily graphics rendering process, image processing process, signal processing process, Bayer decoding process, or video decoding process, which can be performed by a central processing unit, a graphics processing units or a digital signal processing unit. In one embodiment, the distribution of computational processes between capable subsystems is based on a power setting, a performance setting, a dynamic setting or a value setting.

摘要翻译： 描述了在包括多个处理单元的系统中动态地重新分布计算过程的方法和装置的示例性实施例。 为多个子系统之间的各种计算过程确定功耗，性能和功率/性能值，其中每个子系统能够执行计算过程。 计算过程是示例性的图形渲染处理，图像处理处理，信号处理处理，拜耳解码处理或视频解码处理，其可以由中央处理单元，图形处理单元或数字信号处理单元执行。 在一个实施例中，能力子系统之间的计算过程的分布基于功率设置，性能设置，动态设置或值设置。

公开(公告)号：US08358351B2

公开(公告)日：2013-01-22

申请号：US12479629

申请日：2009-06-05

申请人： Ralph Brunner ,  Mark Zimmer ,  Guy Cote

发明人： Ralph Brunner ,  Mark Zimmer ,  Guy Cote

IPC分类号： H04N5/228 ,  H04N5/202

CPC分类号： H04N5/202

摘要： A device, method, computer useable medium, and processor programmed to automatically generate tone mapping curves in a digital camera based on image metadata are described. By examining image metadata from a digital camera's sensor, such as the light-product, one can detect sun-lit, high-light, and low-light scenes. Once the light-product value has been calculated for a given image, a tone mapping curve can automatically be generated within the sensor and adjusted appropriately for the scene based on predetermined parameters. Further, it has been determined that independently varying the slopes of the tone mapping curve at the low end (S0) and high end (S1) of the curve results in more visually appealing images. By dynamically and independently selecting S0 and S1 values based on image metadata, more visually pleasing images can be generated.

摘要翻译： 描述了基于图像元数据在数字照相机中自动生成色调映射曲线的设备，方法，计算机可用介质和处理器。 通过从数码相机的传感器（如光产品）中检查图像元数据，可以检测到日光，高光和低光的场景。 一旦为给定图像计算了光产品值，就可以在传感器内自动生成色调映射曲线，并根据预定参数对场景进行适当调整。 此外，已经确定，在曲线的低端（S0）和高端（S1）处独立地改变色调映射曲线的斜率导致更加视觉吸引人的图像。 通过基于图像元数据动态地且独立地选择S0和S1值，可以产生更令人满意的图像。

公开(公告)号：US08274583B2

公开(公告)日：2012-09-25

申请号：US12755574

申请日：2010-04-07

申请人： Mark Zimmer ,  Ralph Brunner ,  David Hayward

发明人： Mark Zimmer ,  Ralph Brunner ,  David Hayward

IPC分类号： H04N9/64 ,  H04N5/217 ,  G06K9/40

CPC分类号： H04N9/646 ,  G06T5/002 ,  G06T5/009 ,  H04N5/3572 ,  H04N9/045

摘要： A system, apparatus, computer readable medium, and method for radially-dependent noise reduction in image capturing devices involving an edge-preserving blur window are disclosed. In one embodiment, the edge-preserving blur includes only those pixels in the blur window that are within a threshold value of the blur window's current center pixel in its blurring calculation. By creating a threshold function that varies radially from the center of the image sensor's light intensity falloff function, a more appropriate threshold value can be chosen for each pixel, allowing for more noise farther from the center of the image, and allowing for less noise closer to the center of the image. Light-product information taken from the image's metadata may be used to scale the threshold value parameters dynamically. This allows the method to perform the appropriate amount of processing depending on the lighting situation of the image that is currently being processed.

摘要翻译： 公开了一种用于涉及边缘保持模糊窗口的图像捕获设备中用于径向依赖性降噪的系统，设备，计算机可读介质和方法。 在一个实施例中，边缘保留模糊仅包括在其模糊计算中在模糊窗口当前中心像素的阈值内的模糊窗口中的那些像素。 通过创建从图像传感器的光强度衰减功能的中心径向变化的阈值函数，可以为每个像素选择更合适的阈值，允许更多的噪声离图像中心更远，并允许更少的噪声更接近 到图像的中心。 可以使用从图像的元数据获得的光产品信息来动态地缩放阈值参数。 这允许该方法根据当前正在处理的图像的照明情况来执行适当的处​​理量。

公开(公告)号：US08255826B2

公开(公告)日：2012-08-28

申请号：US11985380

申请日：2007-11-14

申请人： Ralph Brunner ,  Peter Graffagnino ,  Andrew Barnes

发明人： Ralph Brunner ,  Peter Graffagnino ,  Andrew Barnes

IPC分类号： G06F3/048 ,  G06F17/00

CPC分类号： G06F9/4443 ,  G06F9/451

摘要： Methods and apparatuses for resizing buffered windows. In one aspect of the invention, a method to resize a buffered window on a data processing system includes: determining an estimated size for a window which has a first pixel image of a first size buffered in a first window buffer; allocating a second window buffer which is large enough to buffer the window in the estimated size; and buffering a second pixel image of the window in a second size in the second window buffer. In one example according to this aspect, a portion of a frame buffer is updated to the second pixel image to display the window in the second size. A portion of the second window buffer, storing the data that represents the second pixel image, is clipped to update the corresponding portion of the frame buffer.

摘要翻译： 调整缓冲窗口大小的方法和设备。 在本发明的一个方面，一种在数据处理系统上调整缓冲窗口尺寸的方法包括：确定具有在第一窗口缓冲器中缓冲的第一尺寸的第一像素图像的窗口的估计大小; 分配足够大的第二窗口缓冲器以在估计的大小中缓冲窗口; 以及在所述第二窗口缓冲器中以第二大小缓冲所述窗口的第二像素图像。 在根据该方面的一个示例中，帧缓冲器的一部分被更新为第二像素图像以将窗口显示为第二大小。 存储表示第二像素图像的数据的第二窗口缓冲器的一部分被剪切以更新帧缓冲器的相应部分。

公开(公告)号：US08189070B1

公开(公告)日：2012-05-29

申请号：US12479743

申请日：2009-06-05

申请人： Ralph Brunner ,  Monique Perez Relova

发明人： Ralph Brunner ,  Monique Perez Relova

IPC分类号： H04N5/235 ,  H04N9/73 ,  H04N5/238

CPC分类号： H04N5/2351 ,  H04N1/00307 ,  H04N5/2353

摘要： Several methods and apparatuses for implementing automatic exposure mechanisms for image capturing devices are described. In one embodiment, an automatic exposure mechanism can use data from a light meter of an image capturing device to determine a metered exposure value associated with incident light. The automatic exposure mechanism can determine a rule based exposure value based on a predetermined rule and exposure settings (e.g., a predetermined light sensitivity of a capture media and a predetermined f-number of the image capturing device). The automatic exposure mechanisms can select either the metered exposure value or the rule based exposure value to set an exposure setting for the image capturing device.

摘要翻译： 描述了用于实现图像捕获设备的自动曝光机构的几种方法和装置。 在一个实施例中，自动曝光机构可以使用来自图像捕获装置的光度计的数据来确定与入射光相关联的计量曝光值。 自动曝光机构可以基于预定规则和曝光设置（例如，捕获介质的预定光敏度和图像捕获装置的预定f数）来确定基于规则的曝光值。 自动曝光机构可以选择计量曝光值或基于规则的曝光值来设置图像拍摄装置的曝光设置。

公开(公告)号：US08134561B2

公开(公告)日：2012-03-13

申请号：US10825694

申请日：2004-04-16

申请人： John Harper ,  Ralph Brunner ,  Peter Graffagnino ,  Mark Zimmer

发明人： John Harper ,  Ralph Brunner ,  Peter Graffagnino ,  Mark Zimmer

IPC分类号： G06F15/00 ,  G06T1/00

CPC分类号： G06T1/20 ,  G06F15/76 ,  G06F15/80 ,  G09G5/02

摘要： Disclosed is a system for producing images including techniques for reducing the memory and processing power required for such operations. The system provides techniques for programmatically representing a graphics problem. The system further provides techniques for reducing and optimizing graphics problems for rendering with consideration of the system resources, such as the availability of a compatible GPU.

摘要翻译： 公开了一种用于产生图像的系统，包括用于减少这种操作所需的存储器和处理能力的技术。 该系统提供以编程方式表示图形问题的技术。 该系统进一步提供了用于减少和优化图形问题以用于考虑系统资源（诸如兼容GPU的可用性）的渲染的技术。

公开(公告)号：US20110292246A1

公开(公告)日：2011-12-01

申请号：US12786712

申请日：2010-05-25

申请人： Ralph Brunner

发明人： Ralph Brunner

IPC分类号： G06K9/00 ,  H04N5/76

CPC分类号： H04N5/235 ,  G06T5/009 ,  G06T5/40

摘要： An apparatus, method, computer useable medium, and processor programmed to automatically generate tone mapping curves in a digital camera based on image metadata are described. Rather than having a static tone mapping curve for all images, the curve can be varied automatically based on, e.g., the brightness histogram of the image. In one embodiment, a certain percentage of the least bright pixels and a certain percentage of the brightest pixels can be disregarded, while the remaining pixels can be linearly stretched to encompass the original range of brightness values. Based on the distribution of the resultant stretched brightness histogram, slopes for the low end (S0) and high end (S1) of the tone mapping curve can be independently determined, and the tone mapping curve can be automatically generated. The improved, automatically generated tone mapping curve may be able to lift shadows more aggressively and/or increase the dynamic range of the image.

摘要翻译： 描述了一种基于图像元数据在数字照相机中自动生成色调映射曲线的装置，方法，计算机可用介质和处理器。 不是对所有图像具有静态色调映射曲线，而是可以基于例如图像的亮度直方图自动改变曲线。 在一个实施例中，可以忽略特定百分比的最亮度像素和一定百分比的最亮像素，而剩余像素可以被线性地拉伸以包含原始亮度范围。 基于得到的拉伸亮度直方图的分布，可以独立地确定色调映射曲线的低端（S0）和高端（S1）的斜率，并且可以自动生成色调映射曲线。 改进的自动生成的色调映射曲线可能能够更积极地提升阴影和/或增加图像的动态范围。