-
公开(公告)号:US20210223664A1
公开(公告)日:2021-07-22
申请号:US16746872
申请日:2020-01-19
申请人: Light Labs Inc.
发明人: Atul Maharshi , Pablo A. Anigstein , Rajiv Laroia
摘要: Methods and apparatus for using a controllable filter, e.g., an liquid crystal panel, in front of a camera are described. The filter is controlled based on the luminosity of object in a scene being captured by the camera to reduce or eliminate luminosity related image defects such as flaring, blooming or ghosting. Multiple cameras and filters can be used to capture multiple images as part of a depth determination processes where pixel values captured by cameras at different locations are matched to determine the depth, e.g., distance from the camera or camera system to object in the environment. Pixel values are normalized in some embodiments based on the amount of filtering applied to a sensor region and sensor exposure time. The filtering allows for regional sensor exposure control at an individual camera even though the overall exposure time of the pixel sensors maybe and often will be the same.
-
公开(公告)号:US20210064020A1
公开(公告)日:2021-03-04
申请号:US17008634
申请日:2020-08-31
申请人: Light Labs Inc.
发明人: Florin Cutu
摘要: A drone is deployed from a vehicle, e.g., an autonomous or semi-autonomous vehicle, to assist in vehicle control, e.g. in situations in which the vehicle's embedded sensors may not provide sufficient information to perform a desired operation safely, e.g. backing up, parking in a tight environment, traversing a very narrow road, navigating a sharp corner, or bypassing an obstruction, etc. The deployed drone includes sensors, e.g. cameras, radars, LIDARs, etc, which capture sensor data from a position offset from the vehicle. Captured sensor data is communicated from the drone to a vehicle control system in the vehicle and/or to a remote control system, e.g., including an operator who can make decisions. Based on the captured sensor data, which supplements sensor data collected by the vehicle's embedded sensors, vehicle movement is controlled.
-
公开(公告)号:US10365480B2
公开(公告)日:2019-07-30
申请号:US15195985
申请日:2016-06-28
申请人: LIGHT LABS INC.
发明人: Rajiv Laroia , Sapna A Shroff , James Schmieder
IPC分类号: G02B27/00 , G03B17/02 , H04N5/217 , H04N5/232 , H04N5/225 , G02B17/00 , H04N5/247 , H04N5/262
摘要: Methods and apparatus relating to a camera including one or more optical chains with a light redirection device, e.g., mirror, and an outer protective cover are described. The cover maybe a flat or sloped surface or a lens. Features avoid stray light rays from reaching an image sensor of an optical chain. In some but not all embodiments a 2-sided anti-reflection coating is used on the cover to avoid or reduce back reflections from the cover into the optical system. In some embodiments mirror angles are limited to a range in which stray light reflections are directed away from the camera module. In some embodiments a tilted cover configuration is used where the cover is sloped relative to a face of the camera and/or camera module. Different features such as the sloped cover glass, control of mirror angle, and/or antireflective coating can be used alone or in combination.
-
公开(公告)号:US10225445B2
公开(公告)日:2019-03-05
申请号:US14976765
申请日:2015-12-21
申请人: LIGHT LABS INC.
发明人: Bradley Lautenbach
摘要: Methods and apparatus for providing a user of a camera information about the status of one or more lenses and/or providing a subject of a photograph an indicator of where to look during image capture are described. In some embodiments different sets of camera modules are used for taking photographs depending on user input and/or the distance to the objects to be captured. In various embodiments an indicator, e.g., light emitting element, is associated with each of the different sets of camera modules which maybe used to indicate where a subject should look during image capture by the corresponding set of camera modules. In some embodiment dirty lenses of the camera are detected and the user is notified of the dirty lenses through an audible and/or visual indication. In some embodiments the indication of which lens/lenses are dirty is provided by illuminating light emitting elements corresponding to the dirty lens(es).
-
公开(公告)号:US10038860B2
公开(公告)日:2018-07-31
申请号:US15412996
申请日:2017-01-23
申请人: LIGHT LABS INC.
发明人: Rajiv Laroia
CPC分类号: G02B7/04 , G02B7/09 , G02B7/102 , G02B7/1805 , G02B7/182 , G02B13/0065 , G02B13/009 , G02B17/008 , G03B5/00 , G03B13/36 , G03B17/17 , G03B37/04 , G03B2205/0046 , H04N5/2252 , H04N5/2253 , H04N5/2254 , H04N5/2257 , H04N5/2258 , H04N5/23206 , H04N5/23212 , H04N5/23238 , H04N5/23293 , H04N5/23296 , H04N5/2354 , H04N5/2622 , H04N5/2624 , H04N5/265 , H04N5/335 , H04N5/3532 , H04N5/3765 , H04N5/378 , H04N13/243
摘要: Methods and apparatus relating to capturing images of a scene area in a synchronized manner using a plurality of optical chains are described. In various embodiments image sensors corresponding to the plurality of optical chains of a camera are operated in rolling shutter mode to read out rows of pixel values corresponding to a current scan position when the image sensors have a row of pixel values corresponding to the current scan position. In some embodiments a scene area of interest is captured by initiating a scan and thus image capture of the scene area by one or more optical chains which are operated in a coordinated manner. In some embodiments a controller controls the plurality of image sensors to perform a read out of pixel values in a synchronized manner, e.g., with rows of pixel values being read out sequentially in accordance with operation of a rolling shutter implementation.
-
公开(公告)号:US09948832B2
公开(公告)日:2018-04-17
申请号:US15190156
申请日:2016-06-22
申请人: THE LIGHTCO INC.
发明人: Rajiv Laroia
CPC分类号: H04N5/04 , G06T11/60 , H04N5/2257 , H04N5/2258 , H04N5/23232 , H04N5/247
摘要: Camera device including multiple optical chains, e.g., camera modules, some of which have different orientations relative to the base of the camera device and methods of using such a camera device are described. The orientation of the camera modules within the camera device is taken into consideration when determining the direction in which lines of the sensors of the individual camera modules are read out. Information with regard to the read out direction to be used with particular camera modules is stored in some embodiments and used to control the readout of sensors, e.g., sensors which use a rolling shutter to capture images of a scene area. The sensors may have the same field of view or overlapping fields of view.
-
公开(公告)号:US09557520B2
公开(公告)日:2017-01-31
申请号:US14327518
申请日:2014-07-09
申请人: The LightCo Inc.
发明人: Rajiv Laroia
IPC分类号: G02B13/16 , H04N5/225 , G02B7/04 , G02B13/00 , H04N5/265 , H04N5/335 , H04N5/232 , G03B13/36 , H04N5/262 , H04N5/235 , H04N5/353 , H04N5/378 , G03B5/00 , G03B17/17 , G02B7/10 , G03B37/04
CPC分类号: H04N5/3532 , G02B7/04 , G02B7/09 , G02B7/102 , G02B7/1805 , G02B7/182 , G02B13/0065 , G02B13/009 , G02B17/008 , G03B5/00 , G03B13/36 , G03B17/17 , G03B37/04 , G03B2205/0046 , H04N5/2252 , H04N5/2253 , H04N5/2254 , H04N5/2257 , H04N5/2258 , H04N5/23206 , H04N5/23212 , H04N5/23238 , H04N5/23293 , H04N5/23296 , H04N5/2354 , H04N5/2622 , H04N5/2624 , H04N5/265 , H04N5/335 , H04N5/3765 , H04N5/378 , H04N13/243
摘要: Methods and apparatus relating to controlling optical chains (OCs) of a camera device to scan a scene area of interest, thereby capturing images of the scene area, in a synchronized manner are described. In various embodiments a synchronized rolling shutter read out of two or more image sensors included in two or more corresponding OCs is implemented controlling the sensors to read out rows of pixel values corresponding to a portion of the scene at the same time, e.g., concurrently. While two or more of the OCs are controlled to read out at the same time, some other OCs in the camera maybe controlled not to read out pixel values while other image sensors are reading out. In various embodiments the read out rate of the two or more sensors corresponding to two or more optical chains is controlled as a function of the focal lengths of the corresponding OCs.
摘要翻译: 描述了以同步方式控制相机装置的光链(OC)的控制方法和装置,以扫描场景区域,从而拍摄场景区域的图像。 在各种实施例中,实现了从包括在两个或更多个相应的OC中的两个或更多个图像传感器中读出的同步卷帘,其控制传感器以同时(例如同时)读出对应于场景的一部分的像素值行。 虽然两个或多个OC被同时控制读出,但是在其他图像传感器正在读出的情况下,照相机中的其他一些OC可能被控制为不读取像素值。 在各种实施例中,对应于两个或更多个光链的两个或更多个传感器的读出速率被控制为相应的OC的焦距的函数。
-
公开(公告)号:US09547160B2
公开(公告)日:2017-01-17
申请号:US14147584
申请日:2014-01-05
申请人: The LightCo Inc.
发明人: Rajiv Laroia
IPC分类号: G02B13/00 , H04N5/235 , H04N5/225 , G02B7/18 , G03B17/17 , G06T11/60 , G02B13/22 , G02B13/16 , G02B17/00 , G02B17/08 , H04N5/238 , H04N5/265 , G02B3/00
CPC分类号: G02B13/0065 , G02B3/0056 , G02B7/18 , G02B13/16 , G02B13/22 , G02B17/008 , G02B17/0896 , G03B17/17 , G06T11/60 , H04N5/2251 , H04N5/2253 , H04N5/2254 , H04N5/2257 , H04N5/2258 , H04N5/2353 , H04N5/2355 , H04N5/238 , H04N5/265
摘要: Methods and apparatus for capturing or generating images using multiple optical chains operating in parallel are described. Pixel values captured by individual optical chains corresponding to the same scene area are combined to provide an image with at least some of the benefits which would have been provided by capturing an image of the scene using a larger lens than that of the individual lenses of the optical chain modules. By using multiple optical chains in parallel at least some benefits normally obtained from using a large lens can be obtained without the need for a large lens. Furthermore in at least some embodiments, a wide dynamic range can be supported through the use of multiple sensors with the overall supported dynamic range being potentially larger than that of the individual sensors. Some lens and/or optical chain configurations are designed for use in small handheld devices, e.g., cell phones.
摘要翻译: 描述了使用并行操作的多个光链来捕获或生成图像的方法和装置。 将对应于相同场景区域的单个光链所捕获的像素值组合,以提供具有通过使用比单独的透镜的单个透镜更大的透镜捕获场景的图像将提供的至少一些益处的图像 光链模块。 通过并联使用多个光链,可以获得通常从使用大透镜获得的至少一些益处,而不需要大的透镜。 此外,在至少一些实施例中,可以通过使用多个传感器来支持宽的动态范围,其中总体支持的动态范围潜在地大于各个传感器的动态范围。 一些透镜和/或光链配置被设计用于小型手持设备,例如手机。
-
公开(公告)号:US20220028101A1
公开(公告)日:2022-01-27
申请号:US17382335
申请日:2021-07-21
申请人: Light Labs Inc.
发明人: Atul Maharshi , Pablo A Anigstein , Rajiv Laroia
摘要: Methods and apparatus for processing images captured by cameras for use in stereo depth determinations are described and/or for using depth information generated by processing such images is described. Images are captured using a reference camera and at least one additional camera. Filtering is implemented as part of a patch matching process to reduce the risk of erroneous matches, e.g., due to image blur in one image but not another. The filtering may be, and sometimes is, implemented on a patch basis. A candidate patch is generated by filtering a portion of an image captured by a camera, e.g., a second camera by performing a sharpening or blurring operation to a portion of the image to generate a candidate patch. The amount of blurring or sharpening that is applied to generate the candidate patch depends, in some embodiments, on the relative difference between the candidate patch and the reference patch. Thus in some embodiments the amount of sharpening and blurring is dependent on both the content of the reference patch as well as the portion of the second image used to generate the candidate patch.
-
公开(公告)号:US10674050B2
公开(公告)日:2020-06-02
申请号:US16006540
申请日:2018-06-12
申请人: Light Labs Inc.
发明人: Rajiv Laroia , Sapna A. Shroff
摘要: A camera device with a sensor which is mounted at an angle relative to a mounting surface or other reference surface is described. Camera modules, which include mirrors for light redirection, which are mounted at different angles in the camera device have sensors with different amounts of rotation. In some embodiments modules without mirrors use camera modules without rotated sensors while camera modules with mirrors may or may not use sensors which are rotated depending on the angle at which the modules are mounted in the camera device. By rotating the sensors of some camera modules rotation that maybe introduced by the angle at which a camera module is mounted can be offset. The images captured by different camera modules are combined in some embodiments without the need for computationally rotating an image thanks to the rotation of the sensor in the camera module used to capture the image.
-
-
-
-
-
-
-
-
-