Machine vision for ego-motion, segmenting, and classifying objects

    公开(公告)号:US10043282B2

    公开(公告)日:2018-08-07

    申请号:US15098285

    申请日:2016-04-13

    Abstract: Systems and methods for machine vision are presented. Such machine vision includes ego-motion, as well as the segmentation and/or classification of image data of one or more targets of interest. The projection and detection of scanning light beams that generate a pattern are employed. Real-time continuous and accurate spatial-temporal 3D sensing is achieved. The relative motion between an observer and a projection surface is determined. A combination of visible and non-visible patterns, as well as a combination of visible and non-visible sensor arrays is employed to sense 3D coordinates of target features, as well as acquire color image data to generate 3D color images of targets. Stereoscopic pairs of cameras are employed to generate 3D image data. Such cameras are dynamically aligned and calibrated. Information may be encoded in the transmitted patterns. The information is decoded upon detection of the pattern and employed to determine features of the reflecting surface.

    SYSTEMS AND METHODS FOR MACHINE PERCEPTION
    62.
    发明申请

    公开(公告)号:US20180180733A1

    公开(公告)日:2018-06-28

    申请号:US15853783

    申请日:2017-12-23

    Abstract: A system to determine a position of one or more objects includes a transmitter to emit a beam of photons to sequentially illuminate regions of one or more objects; multiple cameras that are spaced-apart with each camera having an array of pixels to detect photons; and one or more processor devices that execute stored instructions to perform actions of a method, including: directing the transmitter to sequentially illuminate regions of one or more objects with the beam of photons; for each of the regions, receiving, from the cameras, an array position of each pixel that detected photons of the beam reflected or scattered by the region of the one or more objects; and, for each of the regions detected by the cameras, determining a position of the regions using the received array positions of the pixels that detected the photons of the beam reflected or scattered by that region.

    Real time position sensing of objects

    公开(公告)号:US09753126B2

    公开(公告)日:2017-09-05

    申请号:US15384227

    申请日:2016-12-19

    CPC classification number: G01S7/484 G01S7/4808 G01S17/003 G01S17/10 G01S17/48

    Abstract: Embodiments are directed toward measuring a three dimensional range to a target. A transmitter emits light toward the target. An aperture may receive light reflections from the target. The aperture may direct the reflections toward a sensor that comprises rows of pixels that have columns. The sensor is offset a predetermined distance from the transmitter. Anticipated arrival times of the reflections on the sensor are based on the departure times and the predetermined offset distance. A portion of the pixels are sequentially activated based on the anticipated arrival times. The target's three dimensional range measurement is based on the reflections detected by the portion of the pixels.

    Method, apparatus, and manufacture for document writing and annotation with virtual ink
    65.
    发明授权
    Method, apparatus, and manufacture for document writing and annotation with virtual ink 有权
    使用虚拟墨水进行文件写入和注释的方法,设备和制造

    公开(公告)号:US09501176B1

    公开(公告)日:2016-11-22

    申请号:US14636062

    申请日:2015-03-02

    Abstract: A method, apparatus, and manufacture for writing and annotation is provided. An image is provided on a surface. In one embodiment, each time invisible ink is deposited on the surface, the location of the invisible ink deposited on the surface is detected before the invisible ink vanishes from the surface. In another embodiment, when a tip of a stylus is in contact with a location of an image on the surface, employing three or more light detectors to detect light at the location. The detected light is employed to determine a position and an orientation of the tip of the stylus and the location on the surface, and modifying the image based on the stored information.

    Abstract translation: 提供了一种用于写入和注释的方法,装置和制造。 在表面上提供图像。 在一个实施例中,每次不可见墨水沉积在表面上时,在不可见墨从表面消失之前检测沉积在表面上的不可见墨水的位置。 在另一个实施例中,当触针的尖端与表面上的图像的位置接触时,采用三个或更多个光检测器来检测该位置处的光。 采用检测到的光来确定触针的尖端的位置和取向以及表面上的位置,并且基于存储的信息修改图像。

    Three-dimensional triangulation and time-of-flight based tracking systems and methods
    66.
    发明授权
    Three-dimensional triangulation and time-of-flight based tracking systems and methods 有权
    三维三角测量和基于飞行时间的跟踪系统和方法

    公开(公告)号:US09377533B2

    公开(公告)日:2016-06-28

    申请号:US14823668

    申请日:2015-08-11

    Abstract: A three-dimension position tracking system is presented. The system includes transmitters and receivers. A transmitter scans continuous or pulsed coherent light beams across a target. The receiver detects the reflected beams. The system recursively determines the location of the target, as a function of time, via triangulation and observation of the time-of-flight of the incoming and outgoing beams. The transmitter includes ultra-fast scanning optics to scan the receiver's field-of-view. The receiver includes arrays of ultra-fast photosensitive pixels. The system determines the angles of the incoming beams based on the line-of-sight of the triggered pixels. By observing the incoming angles and correlating timestamps associated with the outgoing and incoming beams, the system accurately, and in near real-time, determines the location of the target. By combining the geometry of the scattered beams, as well as the beams' time-of-flight, ambiguities inherent to triangulation and ambiguities inherent to time-of-flight location methods are resolved.

    Abstract translation: 提出了三维位置跟踪系统。 该系统包括发射机和接收机。 发射器扫描目标上的连续或脉冲相干光束。 接收机检测反射光束。 系统通过三角测量和观察入射和射出射束的飞行时间,递归地确定目标的位置,作为时间的函数。 发射器包括超快速扫描光学元件,用于扫描接收机的视场。 接收机包括超快感光像素阵列。 系统基于触发像素的视线确定入射光束的角度。 通过观察入射角度和与出射光束和入射光束相关联的时间戳,系统准确地并且近乎实时地确定目标的位置。 通过组合散射光束的几何形状以及光束的飞行时间,解决了三维测量固有的模糊和飞行时间定位方法固有的模糊性。

    METHOD, APPARATUS, AND MANUFACTURE FOR A TRACKING CAMERA OR DETECTOR WITH FAST ASYNCHRONOUS TRIGGERING
    67.
    发明申请
    METHOD, APPARATUS, AND MANUFACTURE FOR A TRACKING CAMERA OR DETECTOR WITH FAST ASYNCHRONOUS TRIGGERING 有权
    用快速异步触发的跟踪摄像机或探测器的方法,装置和制造

    公开(公告)号:US20130229669A1

    公开(公告)日:2013-09-05

    申请号:US13858762

    申请日:2013-04-08

    Abstract: An image projection device for displaying an image onto a remote surface. The image projection device employs a scanner to project image beams of visible light and tracer beams of light onto a remote surface to form a display of the image. The device also employs a light detector to sense at least the reflections of light from the tracer beam pulses incident on the remote surface. The device employs the sensed tracer beam light pulses to predict the trajectory of subsequent image beam light pulses and tracer beam light pulses that form a display of the image on the remote surface in a pseudo random pattern. The trajectory of the projected image beam light pulses can be predicted so that the image is displayed from a point of view that can be selected by, or automatically adjusted for, a viewer of the displayed image.

    Abstract translation: 一种用于将图像显示在远程表面上的图像投影装置。 图像投影装置使用扫描仪将可见光和示踪光束的图像投影到远程表面上以形成图像的显示。 该装置还使用光检测器来感测来自入射在远程表面上的示踪光束脉冲的光的至少反射。 该装置采用所感测的示踪光束光脉冲来预测随后的图像束光脉冲和示踪光束光脉冲的轨迹,其以伪随机图案在远程表面上形成图像的显示。 可以预测投影图像束光脉冲的轨迹,使得从可以通过显示图像的观看者选择或自动调整的观点来显示图像。

    PHOTONJET SCANNER PROJECTOR
    68.
    发明申请
    PHOTONJET SCANNER PROJECTOR 有权
    光电扫描仪投影机

    公开(公告)号:US20130003081A1

    公开(公告)日:2013-01-03

    申请号:US13605948

    申请日:2012-09-06

    Abstract: An image projection device for displaying an image onto a remote surface. The image projection device employs a scanner to project image beams of visible light and tracer beams of light onto a remote surface to form a display of the image. The device also employs a light detector to sense at least the reflections of light from the tracer beam pulses incident on the remote surface. The device employs the sensed tracer beam light pulses to predict the trajectory of subsequent image beam light pulses and tracer beam light pulses that form a display of the image on the remote surface in a pseudo random pattern. The trajectory of the projected image beam light pulses can be predicted so that the image is displayed from a point of view that can be selected by, or automatically adjusted for, a viewer of the displayed image.

    Abstract translation: 一种用于将图像显示在远程表面上的图像投影装置。 图像投影装置使用扫描仪将可见光和示踪光束的图像投影到远程表面上以形成图像的显示。 该装置还使用光检测器来感测来自入射在远程表面上的示踪光束脉冲的光的至少反射。 该装置采用所感测的示踪光束光脉冲来预测随后的图像束光脉冲和示踪光束光脉冲的轨迹,其以伪随机图案在远程表面上形成图像的显示。 可以预测投影图像束光脉冲的轨迹,使得从可以通过显示图像的观看者选择或自动调整的观点来显示图像。

    APPARATUS AND METHOD FOR A FOLDED OPTICAL ELEMENT WAVEGUIDE FOR USE WITH LIGHT BASED TOUCH SCREENS
    69.
    发明申请
    APPARATUS AND METHOD FOR A FOLDED OPTICAL ELEMENT WAVEGUIDE FOR USE WITH LIGHT BASED TOUCH SCREENS 审中-公开
    用于基于光的触摸屏使用折叠光学元件波形的装置和方法

    公开(公告)号:US20120212456A1

    公开(公告)日:2012-08-23

    申请号:US13460142

    申请日:2012-04-30

    CPC classification number: G02B6/0018 G06F3/0421

    Abstract: A folded optical element waveguide that allows a minimum width bezel to be used around the perimeter of a light-based touch screen display. The apparatus and method includes a touch screen and a waveguide substrate provided adjacent the touch screen. The waveguide substrate includes a plurality of waveguides and a plurality of optical elements provided adjacent the touch screen. The waveguides include an internally reflective surface to reflect light perpendicular to the surface of the touch screen. The emitting and detecting waveguides are thus folded and provided around the side edges of the display. As a result, the width of the bezel around the display can be minimized.

    Abstract translation: 折叠光学元件波导,其允许在基于光的触摸屏显示器的周边周围使用最小宽度的边框。 所述装置和方法包括设置在触摸屏附近的触摸屏和波导基板。 波导基板包括多个波导和邻近触摸屏设置的多个光学元件。 波导包括内反射表面以反射垂直于触摸屏表面的光。 因此,发射和检测波导被折叠并设置在显示器的侧边缘周围。 结果,可以使显示器周围的边框的宽度最小化。

    Fingerprint sensor using beams of light and methods of manufacture and use
    70.
    发明授权
    Fingerprint sensor using beams of light and methods of manufacture and use 有权
    使用光束的指纹传感器和制造和使用方法

    公开(公告)号:US08189881B1

    公开(公告)日:2012-05-29

    申请号:US11945944

    申请日:2007-11-27

    CPC classification number: G06K9/00026 G06K9/00046

    Abstract: A fingerprint sensor uses beams of light to detect a fingerprint as the finger is swiped over a ridged surface. The beams of light are directed toward individual regions of the ridged surface so that the light beams will generally be totally internally reflected when a finger is not touching the ridge. The total internal reflection characteristics of the ridged surface are altered at regions touched by the ridges on the finger as the finger is swiped over the sensor. This alters the amount of light reflected by the ridged surface. These changes in light reflection as the finger is swiped over the ridged surface can be observed simultaneously over multiple channels, preferably disposed laterally with respect to each other, to provide a fingerprint.

    Abstract translation: 指纹传感器使用光束来检测指纹,因为手指在脊状表面上滑动。 光束指向脊状表面的各个区域,使得当手指不接触脊时,光束通常将完全内部反射。 当手指在传感器上滑动时,脊状表面的全内反射特性在手指上的脊部触摸的区域被改变。 这会改变由脊状表面反射的光量。 可以在多个通道上同时观察到手指在脊状表面上滑动时的光反射的这些变化,优选相对于彼此横向设置,以提供指纹。

Patent Agency Ranking