公开(公告)号：US07860343B2

公开(公告)日：2010-12-28

申请号：US11402306

申请日：2006-04-10

申请人： Marius Tico ,  Markku Vehviläinen ,  Jani Boutellier ,  Olli Silven

发明人： Marius Tico ,  Markku Vehviläinen ,  Jani Boutellier ,  Olli Silven

IPC分类号： G06K9/36

CPC分类号： G06T7/0002 ,  G06T3/4038 ,  G06T2207/30168 ,  H04N5/232 ,  H04N5/23232 ,  H04N5/23238 ,  H04N2101/00

摘要： A new method, system, apparatus and software product for constructing by an electronic device an image panorama from a plurality of images based on their visual quality is presented. The same portion of a panoramic image scene is typically captured on multiple neighborhood video frames from which one can choose the best visual representation to be pasted into the panorama. Constructing the image panorama from the plurality of captured images can comprise the following steps: a) evaluating image quality of K consecutive frames out of the captured plurality of images using a predetermined criterion, b) selecting one image out of the evaluated K frames with the best image quality using a predetermined rule, and c) appending the selected frame to previously selected frames for constructing the image panorama. On-line and off-line implementations are possible.

摘要翻译： 提出了一种用于由电子设备构建基于其视觉质量的来自多个图像的图像全景的新方法，系统，装置和软件产品。 全景图像场景的相同部分通常被捕获在多个邻域视频帧上，从该视频帧可以选择要粘贴到全景中的最佳视觉表示。 从多个拍摄图像构建图像全景图可以包括以下步骤：a）使用预定标准评估所捕获的多个图像中的K个连续帧的图像质量，b）从所评估的K个帧中选择一个图像，其中 使用预定规则的最佳图像质量，以及c）将所选择的帧附加到用于构建图像全景的先前选择的帧。 在线和离线实现是可能的。

公开(公告)号：US07558405B2

公开(公告)日：2009-07-07

申请号：US11174297

申请日：2005-06-30

申请人： Marius Tico ,  Markku Vehviläinen

发明人： Marius Tico ,  Markku Vehviläinen

IPC分类号： G06K9/00 ,  H04N7/14 ,  H04N5/228

CPC分类号： H04N21/41407 ,  G06T5/50 ,  G06T7/277 ,  H04M2250/52 ,  H04N5/23248 ,  H04N5/23254 ,  H04N5/23264 ,  H04N5/772

摘要： For applying a motion filter of a video stabilization system to a sequence of video frames, an estimate of a motion in the current video frame compared to a first video frame of the sequence of video frames is received. Based on the received motion estimate and on at least one state variable of the motion filter, a correction value for the motion in the current video frame is computed. The at least one state variable is updated in the computation. In case the computed correction value exceeds a system constraint of the video stabilization system, the at least one state variable is adjusted in accordance with an extent by which the system constraint is exceeded. The correction value is then recomputed based on the motion estimate and on the adjusted state variable.

摘要翻译： 为了将视频稳定系统的运动滤波器应用于视频帧序列，与视频帧序列的第一视频帧相比，接收当前视频帧中运动的估计。 基于接收到的运动估计和运动滤波器的至少一个状态变量，计算当前视频帧中运动的校正值。 在计算中更新至少一个状态变量。 在计算的校正值超过视频稳定系统的系统约束的情况下，根据超过系统约束的程度来调整至少一个状态变量。 然后基于运动估计和调整状态变量重新计算校正值。

公开(公告)号：US20090161982A1

公开(公告)日：2009-06-25

申请号：US12004469

申请日：2007-12-19

申请人： Marius Tico ,  Markku Vehvilainen

发明人： Marius Tico ,  Markku Vehvilainen

IPC分类号： G06K9/40

CPC分类号： G06T5/001 ,  G06T5/20 ,  G06T5/50 ,  G06T2207/20021

摘要： The specification and drawings present a new method, apparatus and software product for restoring (i.e., de-noising and/or stabilizing) images using similar blocks of pixels of one or more different sizes in one or more available image frames of the same scene for providing, e.g., multi-frame image restoration/de-noising/stabilization.

摘要翻译： 说明书和附图提出了一种用于在同一场景的一个或多个可用图像帧中使用相似的一个或多个不同大小的像素块来恢复（即，去噪和/或稳定）图像的新方法，装置和软件产品，用于 提供例如多帧图像恢复/去噪/稳定化。

公开(公告)号：US20080170126A1

公开(公告)日：2008-07-17

申请号：US11787907

申请日：2007-04-19

申请人： Marius Tico ,  Sakari Alenius ,  Markku Vehvilainen

发明人： Marius Tico ,  Sakari Alenius ,  Markku Vehvilainen

IPC分类号： H04N5/228

CPC分类号： H04N5/23248 ,  H04N5/23254 ,  H04N5/23267 ,  H04N5/23277 ,  H04N5/2353

摘要： A method of improving image quality of a digital image is provided. In particular, the motion blur in an image taken in a long exposure time is reduced by dividing the exposure time into several shorter periods and capturing a series of images in those shorter periods. Among the images, one reference image is selected and the remaining images are registered in reference to the reference image by image warping, for example. After identifying the pixels in each of the remaining images and the corresponding pixels in the reference image, a weighting factor is assigned to each of the pixels in the remaining images based on the similarity in the pixel values between the remaining images and reference image. A weight average operation is carried out to sum the corresponding pixels in the reference and the remaining images to generate the final image.

摘要翻译： 提供了一种改善数字图像的图像质量的方法。 特别地，通过将​​曝光时间分成几个较短的时间段并在这些较短的周期中捕获一系列的图像来减少在长时间曝光时间拍摄的图像中的运动模糊。 在这些图像中，例如，通过图像扭曲来选择一个参考图像并且参照参考图像登记剩余的图像。 在识别参考图像中的每个剩余图像和相应像素中的像素之后，基于剩余图像和参考图像之间的像素值的相似度，对剩余图像中的每个像素分配加权因子。 执行加权平均操作以对参考中的相应像素和剩余图像求和以生成最终图像。

公开(公告)号：US20050114136A1

公开(公告)日：2005-05-26

申请号：US10723242

申请日：2003-11-26

申请人： Matti Hamalainen ,  Marius Tico

发明人： Matti Hamalainen ,  Marius Tico

IPC分类号： G10H7/02 ,  G10L13/00

CPC分类号： G10H7/02

摘要： In wavetable based sound synthesis, the wavetable data may comprise samples in a loop section, which samples may be reused for a playback in a loop as often as required. According to a first aspect of the invention, it is proposed that the internal state of a decoder operating on a frame-by-frame basis is restored before each repetition of a decoding of a stored encoded frame comprising the beginning of a loop section. According to a second aspect of the invention, the original wavetable data is padded at the beginning before encoding the wavetable data on a frame-by-frame basis for storage, such that all samples of the loop section are included in a single frame, if possible. According to a third aspect of the invention, a last, possibly incomplete frame provided for encoding is filled up with samples resulting from a periodic extension of the loop section.

摘要翻译： 在基于波音的声音合成中，波形数据可以包括循环部分中的样本，该样本可以根据需要经常在循环中再次用于回放。 根据本发明的第一方面，提出了在每次重复包括循环部分的开始的存储的编码帧的每个重复之前，逐帧地基于操作的解码器的内部状态被恢复。 根据本发明的第二方面，原始波表数据在开始编码波形数据之前开始被填充，以便逐帧存储，使得环路部分的所有样本都包括在单个帧中，如果 可能。 根据本发明的第三方面，提供用于编码的最后一个可能不完整的帧由循环部分的周期性扩展产生的样本填充。

公开(公告)号：US08300086B2

公开(公告)日：2012-10-30

申请号：US12005038

申请日：2007-12-20

申请人： Lachlan Pockett ,  Marius Tico ,  Timo Pylvänäinen ,  Sakari Alenius

发明人： Lachlan Pockett ,  Marius Tico ,  Timo Pylvänäinen ,  Sakari Alenius

IPC分类号： H04N13/00

CPC分类号： H04N13/133 ,  H04N13/122 ,  H04N13/239 ,  H04N13/246 ,  H04N13/25

摘要： An image processing is applied in common to image data for a first image and to image data for a second image. The image data for the first image and the image data for the second image are moreover compared as a basis for matching a visual appearance of images for a stereoscopic presentation. The visual appearance can be matched in the current pair of images by adjusting at least one of the images accordingly and/or in future pairs of images by adjusting parameters of at least one of the image capturing components providing the image data.

摘要翻译： 对第一图像的图像数据和第二图像的图像数据共同应用图像处理。 此外，比较第一图像的图像数据和第二图像的图像数据作为用于匹配用于立体呈现的图像的视觉外观的基础。 通过调整提供图像数据的图像捕获组件中的至少一个的参数，通过相应地和/或在将来的图像对中调整至少一个图像，可以在当前图像对中匹配视觉外观。

公开(公告)号：US20080143841A1

公开(公告)日：2008-06-19

申请号：US11640529

申请日：2006-12-15

申请人： Marius Tico ,  Mejdi Trimeche

发明人： Marius Tico ,  Mejdi Trimeche

IPC分类号： H04N5/228

CPC分类号： H04N5/3458 ,  H04N5/23248 ,  H04N5/345 ,  H04N5/35554 ,  H04N5/374 ,  H04N9/045

摘要： The specification and drawings present a new method, apparatus and software product for image stabilization of an image taken with a fixed (i.e., pre-selected) multi-exposure pattern for at least one color channel by an image sensor of a camera, wherein a plurality of groups of pixels of the image sensor have different pre-selected exposure times for said at least one color channel. The camera can be a part of, e.g., an electronic device such as mobile phone or a portable electronic device.

摘要翻译： 说明书和附图提出了一种用于通过照相机的图像传感器对于至少一个颜色通道的固定（即预先选择的）多曝光图案拍摄的图像的图像稳定化的新方法，装置和软件产品，其中 图像传感器的多组像素组对于所述至少一个颜色通道具有不同的预选曝光时间。 相机可以是例如诸如移动电话或便携式电子设备的电子设备的一部分。

公开(公告)号：US10306140B2

公开(公告)日：2019-05-28

申请号：US13490031

申请日：2012-06-06

申请人： Marius Tico ,  Frank Doepke

发明人： Marius Tico ,  Frank Doepke

IPC分类号： H04N7/00 ,  H04N5/232

摘要： Systems, methods, and computer readable media for adaptively selecting what portion (aka slice) of a first image (aka frame) is selected to overlap and blend with a second frame during frame capture operations are disclosed. In general, for every new frame captured in a sequence the overlap between it and the slice selected from a prior frame may be determined based, at least in part, on sensor output. If the overlap so determined is below a desired threshold, the position of the current frame's slice may be adjusted so as to provide the desired overlap.

公开(公告)号：US09098922B2

公开(公告)日：2015-08-04

申请号：US13490183

申请日：2012-06-06

申请人： Marius Tico

发明人： Marius Tico

IPC分类号： G06K9/36 ,  H04N7/00 ,  G06T3/40 ,  H04N5/232

CPC分类号： G06T3/4038 ,  H04N5/23238

摘要： Special blend operations (referred to as “image seam-matching”) are described that keep the pixel values in the two images being blended the same along their transition border or seam, and smoothly increases/decreases pixel values on either side of the seam through the images' transition band (an area around the seam in which image blend operations are constrained). Image seam-matching provides many of the benefits of gradient blending (e.g., the avoidance of ghosting), without the associated computational overhead. This makes image seam-matching a particularly useful approach for real-time image processing such as during the real-time generation of wide area-of-view images. In situations where image seam-matching may be inappropriate, such as when the images being blended include long objects that span an entire overlap region(s), a mechanism is described which allows the selection of either, or both, seam-matching and cross-fading blend operations in a graceful or smooth manner.

摘要翻译： 描述了特殊混合操作（称为“图像缝合匹配”），使两个图像中的像素值沿其过渡边界或接缝相同，并且平滑地增加/减少接缝两侧的像素值 图像的过渡带（图像混合操作被约束的接缝周围的区域）。 图像缝合匹配提供梯度混合的许多益处（例如，避免重影），而没有相关联的计算开销。 这使得图像缝合匹配对于实时图像处理特别有用，例如在实时生成宽视野图像期间。 在图像缝合匹配可能不合适的情况下，例如当混合的图像包括跨越整个重叠区域的长对象时，描述允许选择任一或两者的缝合匹配和交叉的机制 以优雅或平稳的方式进行混合操作。

公开(公告)号：US08964040B2

公开(公告)日：2015-02-24

申请号：US13489609

申请日：2012-06-06

申请人： Marius Tico ,  Jianping Zhou ,  Todd S. Sachs

发明人： Marius Tico ,  Jianping Zhou ,  Todd S. Sachs

IPC分类号： H04N5/228 ,  H04N5/225 ,  H04N7/18

CPC分类号： H04N5/225 ,  H04N5/23258 ,  H04N5/23277 ,  H04N5/2355 ,  H04N5/262

摘要： Motion sensor data may be used to register a sequence of standard dynamic range images for producing a high dynamic range (HDR) image, reducing use of computational resources over software visual feature mapping techniques. A rotational motion sensor may produce information about orientation changes in the imaging device between images in the sequence of images sufficient to allow registration of the images, instead of using registration based on analysis of visual features of the images. If the imaging device has been moved laterally, then the motion sensor data may not be useful and visual feature mapping techniques may be employed to produce the HDR image.

摘要翻译： 可以使用运动传感器数据来注册用于产生高动态范围（HDR）图像的标准动态范围图像序列，从而减少计算资源在软件视觉特征映射技术上的使用。 旋转运动传感器可以产生关于图像序列中的图像之间的成像装置中的取向变化的信息，足以允许图像的注册，而不是基于对图像的视觉特征的分析来使用注册。 如果成像设备已被横向移动，则运动传感器数据可能不是有用的，并且可以采用视觉特征映射技术来产生HDR图像。