METHODS AND APPARATUS FOR USING A CONTROLLABLE PHYSICAL LIGHT FILTER AS PART OF AN IMAGE CAPTURE SYSTEM AND FOR PROCESSING CAPTURED IMAGES

    公开(公告)号:US20210223664A1

    公开(公告)日:2021-07-22

    申请号:US16746872

    申请日:2020-01-19

    申请人: Light Labs Inc.

    IPC分类号: G03B11/00 G06T7/20 G06T1/20

    摘要: Methods and apparatus for using a controllable filter, e.g., an liquid crystal panel, in front of a camera are described. The filter is controlled based on the luminosity of object in a scene being captured by the camera to reduce or eliminate luminosity related image defects such as flaring, blooming or ghosting. Multiple cameras and filters can be used to capture multiple images as part of a depth determination processes where pixel values captured by cameras at different locations are matched to determine the depth, e.g., distance from the camera or camera system to object in the environment. Pixel values are normalized in some embodiments based on the amount of filtering applied to a sensor region and sensor exposure time. The filtering allows for regional sensor exposure control at an individual camera even though the overall exposure time of the pixel sensors maybe and often will be the same.

    METHODS AND APPARATUS FOR VEHICLE CONTROL

    公开(公告)号:US20210064020A1

    公开(公告)日:2021-03-04

    申请号:US17008634

    申请日:2020-08-31

    申请人: Light Labs Inc.

    发明人: Florin Cutu

    摘要: A drone is deployed from a vehicle, e.g., an autonomous or semi-autonomous vehicle, to assist in vehicle control, e.g. in situations in which the vehicle's embedded sensors may not provide sufficient information to perform a desired operation safely, e.g. backing up, parking in a tight environment, traversing a very narrow road, navigating a sharp corner, or bypassing an obstruction, etc. The deployed drone includes sensors, e.g. cameras, radars, LIDARs, etc, which capture sensor data from a position offset from the vehicle. Captured sensor data is communicated from the drone to a vehicle control system in the vehicle and/or to a remote control system, e.g., including an operator who can make decisions. Based on the captured sensor data, which supplements sensor data collected by the vehicle's embedded sensors, vehicle movement is controlled.

    Methods and apparatus for implementing and/or using camera devices with one or more light redirection devices

    公开(公告)号:US10365480B2

    公开(公告)日:2019-07-30

    申请号:US15195985

    申请日:2016-06-28

    申请人: LIGHT LABS INC.

    摘要: Methods and apparatus relating to a camera including one or more optical chains with a light redirection device, e.g., mirror, and an outer protective cover are described. The cover maybe a flat or sloped surface or a lens. Features avoid stray light rays from reaching an image sensor of an optical chain. In some but not all embodiments a 2-sided anti-reflection coating is used on the cover to avoid or reduce back reflections from the cover into the optical system. In some embodiments mirror angles are limited to a range in which stray light reflections are directed away from the camera module. In some embodiments a tilted cover configuration is used where the cover is sloped relative to a face of the camera and/or camera module. Different features such as the sloped cover glass, control of mirror angle, and/or antireflective coating can be used alone or in combination.

    Methods and apparatus for providing a camera lens or viewing point indicator

    公开(公告)号:US10225445B2

    公开(公告)日:2019-03-05

    申请号:US14976765

    申请日:2015-12-21

    申请人: LIGHT LABS INC.

    摘要: Methods and apparatus for providing a user of a camera information about the status of one or more lenses and/or providing a subject of a photograph an indicator of where to look during image capture are described. In some embodiments different sets of camera modules are used for taking photographs depending on user input and/or the distance to the objects to be captured. In various embodiments an indicator, e.g., light emitting element, is associated with each of the different sets of camera modules which maybe used to indicate where a subject should look during image capture by the corresponding set of camera modules. In some embodiment dirty lenses of the camera are detected and the user is notified of the dirty lenses through an audible and/or visual indication. In some embodiments the indication of which lens/lenses are dirty is provided by illuminating light emitting elements corresponding to the dirty lens(es).

    Methods and apparatus for capturing and/or processing images
    8.
    发明授权
    Methods and apparatus for capturing and/or processing images 有权
    用于捕获和/或处理图像的方法和装置

    公开(公告)号:US09547160B2

    公开(公告)日:2017-01-17

    申请号:US14147584

    申请日:2014-01-05

    申请人: The LightCo Inc.

    发明人: Rajiv Laroia

    摘要: Methods and apparatus for capturing or generating images using multiple optical chains operating in parallel are described. Pixel values captured by individual optical chains corresponding to the same scene area are combined to provide an image with at least some of the benefits which would have been provided by capturing an image of the scene using a larger lens than that of the individual lenses of the optical chain modules. By using multiple optical chains in parallel at least some benefits normally obtained from using a large lens can be obtained without the need for a large lens. Furthermore in at least some embodiments, a wide dynamic range can be supported through the use of multiple sensors with the overall supported dynamic range being potentially larger than that of the individual sensors. Some lens and/or optical chain configurations are designed for use in small handheld devices, e.g., cell phones.

    摘要翻译: 描述了使用并行操作的多个光链来捕获或生成图像的方法和装置。 将对应于相同场景区域的单个光链所捕获的像素值组合,以提供具有通过使用比单独的透镜的单个透镜更大的透镜捕获场景的图像将提供的至少一些益处的图像 光链模块。 通过并联使用多个光链,可以获得通常从使用大透镜获得的至少一些益处,而不需要大的透镜。 此外,在至少一些实施例中,可以通过使用多个传感器来支持宽的动态范围,其中总体支持的动态范围潜在地大于各个传感器的动态范围。 一些透镜和/或光链配置被设计用于小型手持设备,例如手机。

    METHODS AND APPARATUS FOR USING FILTERING TO IMPROVE IMAGE PATCH MATCHING AND/OR FOR USING DEPTH INFORMATION GENERATED FROM STEREO IMAGES

    公开(公告)号:US20220028101A1

    公开(公告)日:2022-01-27

    申请号:US17382335

    申请日:2021-07-21

    申请人: Light Labs Inc.

    IPC分类号: G06T7/55 G06T5/00 G06T5/50

    摘要: Methods and apparatus for processing images captured by cameras for use in stereo depth determinations are described and/or for using depth information generated by processing such images is described. Images are captured using a reference camera and at least one additional camera. Filtering is implemented as part of a patch matching process to reduce the risk of erroneous matches, e.g., due to image blur in one image but not another. The filtering may be, and sometimes is, implemented on a patch basis. A candidate patch is generated by filtering a portion of an image captured by a camera, e.g., a second camera by performing a sharpening or blurring operation to a portion of the image to generate a candidate patch. The amount of blurring or sharpening that is applied to generate the candidate patch depends, in some embodiments, on the relative difference between the candidate patch and the reference patch. Thus in some embodiments the amount of sharpening and blurring is dependent on both the content of the reference patch as well as the portion of the second image used to generate the candidate patch.

    Methods and apparatus for implementing and using camera devices

    公开(公告)号:US10674050B2

    公开(公告)日:2020-06-02

    申请号:US16006540

    申请日:2018-06-12

    申请人: Light Labs Inc.

    IPC分类号: H04N5/225 H04N5/232 H04N5/265

    摘要: A camera device with a sensor which is mounted at an angle relative to a mounting surface or other reference surface is described. Camera modules, which include mirrors for light redirection, which are mounted at different angles in the camera device have sensors with different amounts of rotation. In some embodiments modules without mirrors use camera modules without rotated sensors while camera modules with mirrors may or may not use sensors which are rotated depending on the angle at which the modules are mounted in the camera device. By rotating the sensors of some camera modules rotation that maybe introduced by the angle at which a camera module is mounted can be offset. The images captured by different camera modules are combined in some embodiments without the need for computationally rotating an image thanks to the rotation of the sensor in the camera module used to capture the image.