公开(公告)号：WO2016100756A1

公开(公告)日：2016-06-23

申请号：PCT/US2015/066532

申请日：2015-12-17

Applicant: THE LIGHTCO INC.

Inventor： SHROFF, Sapna, A. ,  LAROIA, Rajiv

IPC: H04N5/33 ,  G03B17/00

CPC classification number: H04N5/2252 ,  H04N5/2253 ,  H04N5/2254 ,  H04N5/2257 ,  H04N5/2258 ,  H04N5/23238 ,  H04N5/23296 ,  H04N5/265

Abstract: A camera device with a sensor which is mounted at an angle relative to a mounting surface or other reference surface is described. Camera modules, which include mirrors for light redirection, which are mounted at different angles in the camera device have sensors with different amounts of rotation. In some embodiments modules without mirrors use camera modules without rotated sensors while camera modules with mirrors may or may not use sensors which are rotated depending on the angle at which the modules are mounted in the camera device. By rotating the sensors of some camera modules rotation that maybe introduced by the angle at which a camera module is mounted can be offset. The images captured by different camera modules are combined in some embodiments without the need for computationally rotating an image thanks to the rotation of the sensor in the camera module used to capture the image.

Abstract translation: 描述了具有相对于安装表面或其它参考表面成一定角度安装的传感器的相机装置。 相机模块，其包括用于光重定向的镜子，其在相机装置中以不同的角度安装，具有不同旋转量的传感器。 在一些实施例中，没有反射镜的模块使用没有旋转传感器的相机模块，而具有反射镜的相机模块可以或可以不使用根据模块安装在相机装置中的角度旋转的传感器。 通过旋转一些摄像机模块的传感器，可以通过安装摄像机模块的角度引入旋转。 在一些实施例中，由不同相机模块捕获的图像被组合，而不需要计算地旋转图像，这是由于用于捕获图像的相机模块中的传感器的旋转。

公开(公告)号：WO2016004422A1

公开(公告)日：2016-01-07

申请号：PCT/US2015/039161

申请日：2015-07-03

Applicant: THE LIGHTCO INC.

Inventor： LAROIA, Rajiv ,  SHROFF, Sapna, A.

IPC: G06K9/62 ,  G03B17/00 ,  B08B11/00

CPC classification number: G03B17/18 ,  G02B27/0006 ,  G03B17/02 ,  H04N5/2171 ,  H04N5/2258 ,  H04N5/232 ,  H04N5/35563 ,  H04N5/35581

Abstract: The present application relates to image capture and generation methods and apparatus and, more particularly, to methods and apparatus which detect and/or indicate a dirty lens condition. One embodiment of the present invention includes a method of operating a camera including the steps of capturing a first image using a first lens of the camera; determining, based on at least the first image, if a dirty camera lens condition exists; and in response to determining that a dirty lens condition exists, generating a dirty lens condition notification or initiating an automatic camera lens cleaning operation. In some embodiments multiple captured images with overlapping image regions are compared to determine if a dirty lens condition exists.

Abstract translation: 本申请涉及图像捕获和生成方法和装置，更具体地，涉及检测和/或指示脏透镜状况的方法和装置。 本发明的一个实施例包括一种操作相机的方法，包括以下步骤：使用相机的第一透镜捕获第一图像; 基于至少第一图像确定是否存在不良的相机镜头状况; 并且响应于确定存在脏透镜条件，产生不透镜状态通知或启动自动相机镜头清洁操作。 在一些实施例中，比较具有重叠图像区域的多个捕获图像以确定是否存在脏透镜条件。

公开(公告)号：WO2015066571A1

公开(公告)日：2015-05-07

申请号：PCT/US2014/063601

申请日：2014-11-01

Applicant: THE LIGHTCO INC.

Inventor： LAROIA, Rajiv ,  SHROFF, Sapna A.

IPC: H04N5/77 ,  H04N5/76

CPC classification number: H04N5/77 ,  H04N5/2257 ,  H04N5/23238 ,  H04N5/23245 ,  H04N5/247

Abstract: Methods and apparatus for processing images captured by a camera device including multiple optical chains, e.g., camera modules, are described. Three, 4, 5 or more optical chains maybe used. Different optical chains capture different images due to different perspectives. Multiple images, e.g., corresponding to different perspectives, are captured during a time period and are combined to generate a composite image. In some embodiments one of the captured images or a synthesized image is used as a reference image during composite image generation. The image used as the reference image is selected to keep the perspective of sequentially generated composite images consistent despite unintentional came movement and/or in accordance with an expected path of travel. Thus, which camera module provides the reference image may vary over time taking into consideration unintended camera movement. Composite image generation may be performed external to the camera device or in the camera device.

Abstract translation: 描述了用于处理由包括多个光链的照相机装置捕获的图像的方法和装置，例如相机模块。 可以使用3,4,5或更多的光链。 不同的光链由于不同的观点而捕获不同的图像。 在一段时间内捕获多个图像，例如对应于不同的透视图，并被组合以产生合成图像。 在一些实施例中，在合成图像生成期间，捕获的图像之一或合成图像被用作参考图像。 选择用作参考图像的图像以保持顺序生成的复合图像的透视一致，尽管无意的移动和/或根据期望的行进路径。 因此，提供参考图像的相机模块可以随着时间而变化，考虑到非预期的相机移动。 复合图像生成可以在相机设备外部或相机设备中执行。

公开(公告)号：WO2015058156A1

公开(公告)日：2015-04-23

申请号：PCT/US2014/061257

申请日：2014-10-17

Applicant: THE LIGHTCO INC.

Inventor： LAROIA, Rajiv

IPC: H04N5/225 ,  H04N5/262 ,  H04N5/232

CPC classification number: H04N5/2254 ,  G02B5/04 ,  G02B13/0065 ,  G02B17/008 ,  G02B17/08 ,  H04N5/2258 ,  H04N5/23212 ,  H04N5/23232 ,  H04N5/23258 ,  H04N5/23287 ,  H04N5/28

Abstract: In various embodiments light redirection device positions of one or more optical chains are moved between image capture times while the position of the camera device including the multiple optical chains remains fixed. Some features relate to performing a zoom operation using multiple optical chains of the camera. Zoom settings may, and in some embodiments are, used in determining the angle to which the light redirection device should be set. In some embodiments different zoom focal length settings correspond to different scene capture areas for the optical chain with the moveable light redirection device. In some embodiments multiple optical chains are used in parallel, each with its own image sensor and light redirection device. Depth information is generated and used in some but not all embodiments to combine the images in a manner intended to minimize or avoid parallax distortions in the composite image which is produced.

Abstract translation: 在各种实施例中，一个或多个光链的光重定向装置位置在图像捕获时间之间移动，而包括多个光链的照相机装置的位置保持固定。 一些功能涉及使用相机的多个光链进行变焦操作。 在一些实施例中，缩放设置可以用于确定光重定向装置应被设置的角度。 在一些实施例中，不同的变焦焦距设置对应于具有可移动光重定向装置的光链的不同场景捕捉区域。 在一些实施例中，并行使用多个光链，每个具有其自己的图像传感器和光重定向装置。 在一些但不是全部实施例中生成和使用深度信息以组合图像以使生成的合成图像中的视差失真最小化或避免视差失真的方式。

公开(公告)号：WO2016061565A1

公开(公告)日：2016-04-21

申请号：PCT/US2015/056117

申请日：2015-10-17

Applicant: THE LIGHTCO INC.

Inventor： LAROIA, Rajiv ,  SHROFF, Nitesh ,  SHROFF, Sapna, A.

IPC: H04N5/225 ,  G03B37/04

CPC classification number: H04N5/23245 ,  G06T7/20 ,  G06T11/60 ,  G06T2207/10144 ,  G06T2207/10148 ,  G06T2207/20221 ,  H04N5/2254 ,  H04N5/2257 ,  H04N5/2258 ,  H04N5/23216 ,  H04N5/23229 ,  H04N5/2353 ,  H04N5/2356 ,  H04N5/265

Abstract: In various embodiments a camera with multiple optical chains, e.g., camera modules, is controlled to operate in one of a variety of supported modes of operation. The modes include a non-motion mode, a motion mode, a normal burst mode and/or a reduced data burst mode. Motion mode is well suited for capturing an image including motion, e.g., moving object(s) with some modules being used to capture scene areas using a shorter exposure time than other modules and the captured images then being combined taking into consideration locations of motion. A reduced data burst mode is supported in some embodiments in which camera modules with different focal lengths capture images at different rates. While the camera modules of different focal length operate at different image capture rates in the reduced data burst mode, images are combined to support a desired composite image output rate, e.g., a desired frame rate.

Abstract translation: 在各种实施例中，具有多个光链（例如相机模块）的照相机被控制为以各种支持的操作模式之一操作。 这些模式包括非运动模式，运动模式，正常突发模式和/或减少的数据突发模式。 运动模式非常适合于捕获包括运动的图像，例如运动物体，其中一些模块被用于使用比其他模块更短的曝光时间拍摄场景区域，并且所考虑的图像然后考虑到运动的位置而被组合。 在具有不同焦距的相机模块以不同速率捕获图像的一些实施例中，支持减少的数据突发模式。 虽然不同焦距的相机模块在减少的数据突发模式下以不同的图像捕获速率工作，但是图像被组合以支持期望的合成图像输出速率，例如期望的帧速率。

公开(公告)号：WO2015127329A1

公开(公告)日：2015-08-27

申请号：PCT/US2015/016988

申请日：2015-02-21

Applicant: THE LIGHTCO INC.

Inventor： LAROIA, Rajiv ,  SHROFF, Sapna, A.

IPC: G03B17/00 ,  F16M11/12 ,  F16M13/04 ,  G12B9/08 ,  H04N5/222

CPC classification number: H04N5/23216 ,  F16M11/10 ,  F16M11/18 ,  F16M11/2014 ,  F16M13/04 ,  G03B17/561 ,  G03B17/563 ,  G03B2217/005 ,  H04N5/2254 ,  H04N5/2258 ,  H04N5/23212 ,  H04N5/23245 ,  H04N5/23258 ,  H04N5/23296

Abstract: Handled camera related methods and apparatus are described. Intuitive zoom control and/or focus control based on camera acceleration and/or motion are described. Also described are handheld camera holder device methods and apparatus. The camera holder can be held in a hand and used to automatically stabilize a camera, e.g., a camera designed to be held in one hand. The stabilization is provided by gyroscopes alone or in combination with closed loop camera orientation control which can use information from one or more sensors included in the camera. The camera holder is designed so that, at least for some but not necessarily all cameras which may be placed in the camera holder, controllable axis of rotation intersect with the center of mass of the camera when the camera is present the holder thereby requiring little power to control and/or maintain camera orientation.

Abstract translation: 描述处理相机的方法和装置。 描述基于相机加速度和/或运动的直观变焦控制和/或焦点控制。 还描述了手持相机支架装置的方法和装置。 照相机保持器可以握在手中并用于自动稳定照相机，例如设计成保持在一只手中的照相机。 稳定性由单独的陀螺仪或与可以使用来自相机中包括的一个或多个传感器的信息的闭环相机取向控制组合提供。 相机支架设计成使得至少对于可能放置在相机支架中的一些但不一定全部的相机，当相机存在时，可控的旋转轴线与相机的质心相交，因此需要较小的电力 控制和/或维护照相机方向。

公开(公告)号：WO2015103345A1

公开(公告)日：2015-07-09

申请号：PCT/US2014/072907

申请日：2014-12-30

Applicant: THE LIGHTCO INC.

Inventor： LAROIA, Rajiv ,  SHROFF, Sapna, A.

IPC: H04N5/232 ,  G02B7/28

CPC classification number: H04N5/23212

Abstract: Methods and apparatus that facilitate or implement focus control in a camera and/or can be used to set the camera focus distance, e.g., the distance between the camera and an object which will appear in focus when the objects picture is taken by the camera. A depth map is generated for an image area, e.g., an area corresponding to an image which is captured by the camera. Based on said depth map, in various exemplary embodiments, a visual indication of which portions of an image captured by the camera device are in focus is generated. A user may indicate a change in the desired focus distance by touching a portion of the screen corresponding to an object at the desired focus distance or by varying a slider or other focus distance control.

Abstract translation: 在相机中促进或实现焦点控制的方法和装置和/或可以用于设置相机聚焦距离，例如当照相机拍摄对象照片时相机和将出现焦点的物体之间的距离。 为图像区域生成深度图，例如与由相机拍摄的图像相对应的区域。 基于所述深度图，在各种示例性实施例中，生成由相机装置捕获的图像的哪些部分被焦点的视觉指示。 用户可以通过在期望的对焦距离处触摸与对象相对应的屏幕的一部分，或者通过改变滑块或其他焦距来控制来指示期望焦距的改变。

公开(公告)号：WO2016168783A1

公开(公告)日：2016-10-20

申请号：PCT/US2016/028011

申请日：2016-04-17

Applicant: THE LIGHTCO INC.

Inventor： LAROIA, Rajiv ,  SHROFF, Nitesh ,  SHROFF, Sapna, A.

IPC: G06T7/00 ,  H04N5/357

CPC classification number: H04N13/106 ,  G06T5/002 ,  G06T5/20 ,  G06T5/50 ,  G06T2207/10024 ,  G06T2207/10028 ,  H04N5/2258 ,  H04N5/23212 ,  H04N5/23245 ,  H04N5/23258 ,  H04N5/2328 ,  H04N5/23296 ,  H04N5/2353 ,  H04N5/2354 ,  H04N5/247 ,  H04N5/357 ,  H04N13/271

Abstract: Features relating to reducing and/or eliminating noise from images are described. In some embodiments depth based denoising is used on images captured by one or more camera modules based on depth information of a scene area and optical characteristics of the one or more camera modules used to capture the images. By taking into consideration the camera module optics and the depth of the object or objects included in the image portion being processed, a maximum expected frequency can be determined and the image portion is then filtered to reduce or remove frequencies above the maximum expected frequency. Noise can be reduced or eliminated from image portions captured by one or more camera modules (131,..., 133). In some embodiments a maximum expected frequency is determined on a per camera module and depth basis. A composite image is generated based on, e.g., from, filtered portions of one or more images.

Abstract translation: 描述了与降低和/或消除图像噪声有关的特征。 在一些实施例中，基于基于景物区域的深度信息和用于捕获图像的一个或多个照相机模块的光学特性，由一个或多个照相机模块拍摄的图像上使用基于深度的去噪。 通过考虑相机模块光学元件和被处理的图像部分中包括的对象或物体的深度，可以确定最大预期频率，然后对图像部分进行滤波以减少或去除高于最大预期频率的频率。 可以从由一个或多个相机模块（131，...，133）拍摄的图像部分减少或消除噪点。 在一些实施例中，在每个相机模块和深度基础上确定最大预期频率。 基于例如一个或多个图像的滤波部分生成合成图像。

公开(公告)号：WO2016168781A1

公开(公告)日：2016-10-20

申请号：PCT/US2016/028009

申请日：2016-04-17

Applicant: THE LIGHTCO INC.

Inventor： LAROIA, Rajiv ,  SHROFF, Nitesh

IPC: H04N5/225 ,  G03B37/04

CPC classification number: H04N5/3765 ,  H04N5/2258 ,  H04N5/232 ,  H04N5/23232 ,  H04N5/23258 ,  H04N5/23296 ,  H04N5/2353 ,  H04N5/247 ,  H04N5/2624 ,  H04N5/3456 ,  H04N5/378

Abstract: Methods and apparatus for reading out pixel values from sensors in a synchronized manner are described. Readout of rows of pixel values from different sensors are controlled so that pixel values of different sensors corresponding to the same portion of a scene are read out in a way that the same portions of a scene are captured at the same or nearly the same time by different sensors. In one embodiment a first sensor which captures a large scene area alternates between reading out rows of pixel values from a top portion and a bottom portion of the first sensor while sensors corresponding to smaller areas of the scene read out rows of pixel values in a consecutive manner. Sensors may read out rows of pixel values at the same rate despite corresponding to optical chains with different focal lengths. The image captured by the first sensor facilitates image combining.

Abstract translation: 描述了以同步方式从传感器读出像素值的方法和装置。 控制来自不同传感器的像素值行的读出，使得对应于场景的相同部分的不同传感器的像素值以相同或几乎相同的时间相同或几乎相同的时间被捕获的方式被读出 不同的传感器。 在一个实施例中，捕获大场景区域的第一传感器在从第一传感器的顶部部分和底部部分读出像素值行之间交替，而对应于场景的较小区域的传感器以连续的方式读出像素值行 方式。 尽管对应于具有不同焦距的光链，传感器可以以相同的速率读出行像素值。 由第一传感器拍摄的图像有助于图像组合。

公开(公告)号：WO2015061769A1

公开(公告)日：2015-04-30

申请号：PCT/US2014/062306

申请日：2014-10-26

Applicant: THE LIGHTCO INC.

Inventor： LAROIA, Rajiv

IPC: H04N5/232 ,  H04N5/225

CPC classification number: H04N5/23296 ,  H04N5/2258 ,  H04N5/23212 ,  H04N5/23238

Abstract: Methods and apparatus for supporting zoom operations using a plurality of optical chain modules, e.g., camera modules, are described. Switching between use of groups of optical chains with different focal lengths is used to support zoom operations. Digital zoom is used in some cases to support zoom levels corresponding to levels between the zoom levels of different optical chain groups or discrete focal lengths to which optical chains may be switched. In some embodiments optical chains have adjustable focal lengths and are switched between different focal lengths. In other embodiments optical chains have fixed focal lengths with different optical chain groups corresponding to different fixed focal lengths. Composite images are generate from images captured by multiple optical chains of the same group and/or different groups. Composite image is in accordance with a user zoom control setting. Individual composite images may be generated and/or a video sequence.

Abstract translation: 描述了使用多个光链模块（例如相机模块）来支持缩放操作的方法和装置。 在使用具有不同焦距的光链的组之间进行切换用于支持缩放操作。 在某些情况下，使用数字变焦来支持对应于可以切换光链的不同光链组的缩放级别或离散焦距之间的级别的缩放级别。 在一些实施例中，光链具有可调焦距并且在不同焦距之间切换。 在其它实施例中，光链具有不同的光链组的固定焦距，对应于不同的固定焦距。 由相同组和/或不同组的多个光链所捕获的图像生成复合图像。 复合图像符合用户变焦控制设置。 可以生成单个合成图像和/或视频序列。