公开(公告)号：US20170039432A1

公开(公告)日：2017-02-09

申请号：US15297572

申请日：2016-10-19

Applicant: Xerox Corporation

Inventor： Orhan Bulan ,  Edgar A. Bernal ,  Aaron M. Burry ,  Yusuf Oguzhan Artan

IPC: G06K9/00 ,  G06T7/00 ,  G06K9/46 ,  G06K9/62 ,  G06T7/20

CPC classification number: G06K9/00785 ,  G06K9/00771 ,  G06K9/4609 ,  G06K9/6212 ,  G06K9/6267 ,  G06Q50/12 ,  G06T7/20 ,  G06T7/74 ,  G06T2207/20081 ,  G06T2207/30236 ,  G06T2207/30248 ,  H04N5/23229

Abstract: This disclosure provides a method and system for automated sequencing of vehicles in side-by-side drive-thru configurations via appearance-based classification. According to an exemplary embodiment, an automated sequencing method includes computer-implemented method of automated sequencing of vehicles in a side-by-side drive-thru, the method comprising: a) an image capturing device capturing video of a merge-point area associated with multiple lanes of traffic merging; b) detecting in the video a vehicle as it traverses the merge-point area; c) classifying the detected vehicle associated with traversing the merge-point area as coming from one of the merging lanes; and d) aggregating vehicle classifications performed in step c) to generate a merge sequence of detected vehicles.

Abstract translation: 本公开提供了一种通过基于外观的分类来并行驱动通过配置的车辆的自动排序的方法和系统。 根据示例性实施例，自动排序方法包括以并行驱动的车辆的自动排序的计算机实现的方法，所述方法包括：a）图像捕获装置，其捕获与相关联的合并点区域的视频 多个车道合并; b）当车辆横穿合并点区域时，视频中检测车辆; c）将与遍历合并点区域相关联的检测到的车辆分类为来自合并车道之一; 以及d）聚合在步骤c）中执行的车辆分类，以产生检测到的车辆的合并序列。

公开(公告)号：US09514366B2

公开(公告)日：2016-12-06

申请号：US14171022

申请日：2014-02-03

Applicant: Xerox Corporation

Inventor： Stuart Alan Schweid ,  Orhan Bulan ,  Yao Rong Wang ,  Wencheng Wu ,  Robert Paul Loce

IPC: H04N7/18 ,  G06K9/00

CPC classification number: G06K9/00624 ,  G06K9/00771 ,  G06K2209/23

Abstract: This disclosure provides vehicle detection methods and systems including irrelevant search window elimination and/or window score degradation. According to one exemplary embodiment, provided is a method of detecting one or more parked vehicles in a video frame, wherein candidate search windows are limited to one or more predefined window shapes. According to another exemplary embodiment, the method includes degrading a classification score of a candidate search window based on aspect ratio, window overlap area and/or a global maximal classification.

Abstract translation: 本公开提供了车辆检测方法和系统，包括无关的搜索窗口消除和/或窗口评分降级。 根据一个示例性实施例，提供了一种检测视频帧中的一个或多个停放车辆的方法，其中候选搜索窗口被限制为一个或多个预定窗口形状。 根据另一示例性实施例，该方法包括基于宽高比，窗口重叠区域和/或全局最大分类来降级候选搜索窗口的分类分数。

公开(公告)号：US20160342841A1

公开(公告)日：2016-11-24

申请号：US14715787

申请日：2015-05-19

Applicant: Xerox Corporation

Inventor： Orhan Bulan ,  Aaron M. Burry

IPC: G06K9/00 ,  G06Q30/06 ,  H04N7/18 ,  G06Q50/12

CPC classification number: H04N7/181 ,  G06K9/00785 ,  G06K9/6254 ,  G06Q30/0635 ,  G06Q50/12

Abstract: Multi-stage vehicle detection systems and methods for side-by-side drive-thru configurations. One or more video cameras for an image-capturing unit) can be employed for capturing video of a drive-thru of interest in a monitored area. A group of modules can be provided, which define multiple virtual detection loops in the video and sequentially perform classification with respect to each virtual detection loops among the multiple virtual detection loops, starting from a virtual detection loop closest to an order point, and when a vehicle having a car ID is sitting in a drive-thru queue, so as to improve vehicle detection performance in automated post-merge sequencing.

Abstract translation: 多级车辆检测系统和并行驱动通过配置的方法。 用于图像捕获单元的一个或多个摄像机）可用于捕获被监视区域中感兴趣的驱动器的视频。 可以提供一组模块，其在视频中定义多个虚拟检测环路，并且从多个虚拟检测环路中的每个虚拟检测环路顺序执行分类，从最靠近订单点的虚拟检测循环开始，并且当 具有车辆ID的车辆坐在驱动队列中，以便在自动后合并排序中提高车辆检测性能。

公开(公告)号：US09471889B2

公开(公告)日：2016-10-18

申请号：US14260915

申请日：2014-04-24

Applicant: Xerox Corporation

Inventor： Aaron M. Burry ,  Peter Paul ,  Edgar A. Bernal ,  Orhan Bulan

IPC: G06T7/00 ,  G06T7/20 ,  H04N5/232 ,  G06K9/00 ,  G06Q10/06 ,  G06K9/62 ,  G06Q50/12

CPC classification number: G06Q10/06316 ,  G06K9/00711 ,  G06K9/00785 ,  G06K9/00791 ,  G06K9/6267 ,  G06Q50/12 ,  G06T7/20

Abstract: A method for updating an event sequence includes acquiring video data of a queue area from at least one image source; searching the frames for subjects located at least near a region of interest (ROI) of defined start points in the video data; tracking a movement of each detected subject through the queue area over a subsequent series of frames; using the tracking, determining if a location of the a tracked subject reaches a predefined merge point where multiple queues in the queue area converge into a single queue lane; in response to the tracked subject reaching the predefined merge point, computing an observed sequence of where the tracked subject places among other subjects approaching an end-event point; and, updating a sequence of end-events to match the observed sequence of subjects in the single queue lane.

Abstract translation: 一种用于更新事件序列的方法包括从至少一个图像源获取队列区域的视频数据; 在所述帧中搜索位于所述视频数据中定义的起点的至少接近感兴趣区域（ROI）的对象; 在随后的一系列帧中跟踪每个检测到的对象通过队列区域的移动; 使用所述跟踪，确定被跟踪对象的位置是否到达所述队列区域中的多个队列收敛到单个队列通道中的预定义合并点; 响应于被跟踪的对象到达预定义的合并点，计算被跟踪对象在接近终点事件点的其他主体中所在的观察序列; 并且更新结束事件序列以匹配在单个队列通道中观察到的受试者序列。

公开(公告)号：US09400936B2

公开(公告)日：2016-07-26

申请号：US14567000

申请日：2014-12-11

Applicant: Xerox Corporation

Inventor： Orhan Bulan ,  Howard Mizes ,  Vladimir Kozitsky ,  Aaron M. Burry

IPC: G06K9/00 ,  G06K9/20 ,  G06K9/32 ,  G06T7/00

CPC classification number: G06K9/3241 ,  G06K9/3258 ,  G06K9/723 ,  G06K2209/01 ,  G06K2209/15

Abstract: Methods and systems for tag recognition in captured images. A candidate region can be localized from regions of interest with respect to a tag and a tag number shown in the regions of interest within a side image of a vehicle. A number of confidence levels can then be calculated with respect to each digit recognized as a result of an optical character recognition operation performed with respect to the tag number. Optimal candidates within the candidate region can be determined for the tag number based on individual character confidence levels among the confidence levels. Optimal candidates from a pool of valid tag numbers can then be validated using prior appearance probabilities and data returned, which is indicative of the most probable tag to be detected to improve image recognition accuracy.

Abstract translation: 捕获图像中标签识别的方法和系统。 候选区域可以相对于标签和感兴趣区域中所示的在车辆侧面图像内的标签号进行定位。 然后可以相对于作为对标签号执行的光学字符识别操作的结果识别的每个数字来计算多个置信水平。 可以基于置信水平中的个人字符置信水平来确定候选区域内的最佳候选人的标签号码。 然后可以使用先前出现的概率和返回的数据来验证来自有效标签号码池的最佳候选者，这表示要检测的最可能标签以提高图像识别精度。

公开(公告)号：US20160162761A1

公开(公告)日：2016-06-09

申请号：US14564347

申请日：2014-12-09

Applicant: Xerox Corporation

Inventor： Orhan Bulan ,  Howard Mizes ,  Vladimir Kozitsky ,  Aaron M. Burry

IPC: G06K9/72 ,  G06K9/42 ,  G06K9/46 ,  G06K9/00 ,  G06K9/60 ,  G06K9/62 ,  G06K9/78 ,  G06K9/32 ,  G06K9/58

CPC classification number: G06K9/00456 ,  G06K9/00771 ,  G06K9/325 ,  G06K2209/01 ,  G06K2209/15

Abstract: Methods and systems for localizing numbers and characters in captured images. A side image of a vehicle captured by one or more cameras can be preprocessed to determine a region of interest. A confidence value of series of windows within regions of interest of different sizes and aspect ratios containing a structure of interest can be calculated. Highest confidence candidate regions can then be identified with respect to the regions of interest and at least one region adjacent to the highest confidence candidate regions. An OCR operation can then be performed in the adjacent region. An identifier can then be returned from the adjacent region in order to localize numbers and characters in the side image of the vehicle.

Abstract translation: 用于本地化捕获图像中的数字和字符的方法和系统。 可以对由一个或多个摄像机捕获的车辆的侧面图像进行预处理，以确定感兴趣的区域。 可以计算不同尺寸和高宽比的感兴趣区域中的一系列窗口的置信度值，其中包含感兴趣的结构。 然后可以相对于感兴趣区域和与最高置信候选区域相邻的至少一个区域来识别最高置信候选区域。 然后可以在相邻区域中执行OCR操作。 然后可以从相邻区域返回标识符，以便定位车辆侧面图像中的数字和字符。

公开(公告)号：US20160035037A1

公开(公告)日：2016-02-04

申请号：US14446938

申请日：2014-07-30

Applicant: Xerox Corporation

Inventor： Orhan Bulan ,  Aaron M. Burry ,  Abu S. Islam ,  Peter Paul ,  David Martin Todd Jackson

IPC: G06Q40/08 ,  G06K9/32 ,  G06K9/34

CPC classification number: G06Q40/08 ,  G06K9/3258 ,  G06K9/4661

Abstract: A video sequence can be continuously acquired at a predetermined frame rate and resolution by an image capturing unit installed at a location. A video frame can be extracted from the video sequence when a vehicle is detected at an optimal position for license plate recognition by detecting a blob corresponding to the vehicle and a virtual line on an image plane. The video frame can be pruned to eliminate a false positive and multiple frames with respect to a similar vehicle before transmitting the frame via a network. A license plate detection/localization can be performed on the extracted video frame to identify a sub-region with respect to the video frame that are most likely to contain a license plate. A license plate recognition operation can be performed and an overall confidence assigned to the license plate recognition result.

Abstract translation: 可以通过安装在位置的图像捕获单元以预定的帧率和分辨率连续地获取视频序列。 当在车牌识别的最佳位置检测到车辆时，可以通过检测与车辆相对应的车队和图像平面上的虚拟线路，从视频序列中提取视频帧。 在通过网络发送帧之前，可以修剪视频帧以消除相对于类似车辆的假正和多帧。 可以对所提取的视频帧执行车牌检测/定位，以识别相对于最可能包含车牌的视频帧的子区域。 可以执行车牌识别操作，并且得到分配给牌照识别的总体置信度。

公开(公告)号：US20150310624A1

公开(公告)日：2015-10-29

申请号：US14632237

申请日：2015-02-26

Applicant: Xerox Corporation

Inventor： Orhan Bulan ,  Yusuf Oguzhan Artan ,  Aaron Michael Burry

IPC: G06T7/20 ,  G06K9/62 ,  G06K9/66 ,  G06T7/00

CPC classification number: G06K9/66 ,  G06K9/00785 ,  G06T7/215 ,  G06T7/248 ,  G06T7/254 ,  G06T2207/30232 ,  G06T2207/30236

Abstract: Provided is a method and system of tracking partially occluded objects using an elastic deformation model. According to an exemplary method and system, partially occluded vehicles are detected and tracked in a scene including side-by-side drive-thru lanes. A method for updating an event sequence includes acquiring video data of a queue area from at least one image source; searching the frames for subjects located at least near a region of interest (ROI) of defined start points in the video data; tracking a movement of each detected subject through the queue area over a subsequent series of frames; using the tracking, determining if a location of the a tracked subject reaches a predefined merge point where multiple queues in the queue area converge into a single queue lane; in response to the tracked subject reaching the predefined merge point, computing an observed sequence of where the tracked subject places among other subjects approaching an end-event point; and, updating a sequence of end-events to match the observed sequence of subjects in the single queue lane.

Abstract translation: 提供了使用弹性变形模型跟踪部分遮挡物体的方法和系统。 根据示例性方法和系统，在包括并排驱动通道的场景中检测和跟踪部分遮挡的车辆。 一种用于更新事件序列的方法包括从至少一个图像源获取队列区域的视频数据; 在所述帧中搜索位于所述视频数据中定义的起点的至少接近感兴趣区域（ROI）的对象; 在随后的一系列帧中跟踪每个检测到的对象通过队列区域的移动; 使用所述跟踪，确定被跟踪对象的位置是否到达所述队列区域中的多个队列收敛到单个队列通道中的预定义合并点; 响应于被跟踪的对象到达预定义的合并点，计算被跟踪对象在接近终点事件点的其他主体中所在的观察序列; 并且更新结束事件序列以匹配在单个队列通道中观察到的受试者序列。

公开(公告)号：US20150310615A1

公开(公告)日：2015-10-29

申请号：US14632587

申请日：2015-02-26

Applicant: Xerox Corporation

Inventor： Orhan Bulan ,  Edgar A. Bernal ,  Aaron M. Burry ,  Yusuf Oguzhan Artan

IPC: G06T7/00 ,  G06T7/20 ,  H04N5/232

CPC classification number: G06K9/00785 ,  G06K9/00771 ,  G06K9/4609 ,  G06K9/6212 ,  G06K9/6267 ,  G06Q50/12 ,  G06T7/0044 ,  G06T7/20 ,  G06T7/74 ,  G06T2207/20081 ,  G06T2207/30236 ,  G06T2207/30248 ,  H04N5/23229

Abstract: This disclosure provides a method and system for automated sequencing of vehicles in side-by-side drive-thru configurations via appearance-based classification. According to an exemplary embodiment, an automated sequencing method includes computer-implemented method of automated sequencing of vehicles in a side-by-side drive-thru, the method comprising: a) an image capturing device capturing video of a merge-point area associated with multiple lanes of traffic merging; b) detecting in the video a vehicle as it traverses the merge-point area; c) classifying the detected vehicle associated with traversing the merge-point area as coming from one of the merging lanes; and d) aggregating vehicle classifications performed in step c) to generate a merge sequence of detected vehicles.

Abstract translation: 本公开提供了一种通过基于外观的分类来并行驱动通过配置的车辆的自动排序的方法和系统。 根据示例性实施例，自动排序方法包括以并行驱动的车辆的自动排序的计算机实现的方法，所述方法包括：a）图像捕获装置，其捕获与相关联的合并点区域的视频 多个车道合并; b）当车辆横穿合并点区域时，视频中检测车辆; c）将与遍历合并点区域相关联的检测到的车辆分类为来自合并车道之一; 以及d）聚合在步骤c）中执行的车辆分类，以产生检测到的车辆的合并序列。

公开(公告)号：US20150278609A1

公开(公告)日：2015-10-01

申请号：US14226078

申请日：2014-03-26

Applicant: XEROX CORPORATION

Inventor： Wencheng Wu ,  Edgar A. Bernal ,  Yao Rong Wang ,  Robert P. Loce ,  Orhan Bulan

IPC: G06K9/00 ,  G06K9/62 ,  G06T5/00 ,  G06T7/00 ,  G06T3/40 ,  G06K9/46 ,  G06K9/52

CPC classification number: G06K9/00785 ,  G06K9/3241 ,  G06K9/46 ,  G06K9/52 ,  G06K9/6256 ,  G06K9/6267 ,  G06K2009/4666

Abstract: A method for training a vehicle detection system used in a street occupancy estimation of stationary vehicles. The method includes defining first and second areas on an image plane of an image capture device associated with monitoring for detection of vehicles. The method includes receiving video-data from a sequence of frames captured from the image capture device. The method includes determining candidate frames that include objects relevant to a classification task in the second area. The method includes extracting the objects from the candidate frames, extracting features of each extracted object, and assigning labels to the each extracted object. The method includes training at least one classifier using the labels and extracted features. The method includes using the at least one trained classifier to classify a stationary vehicle detected in the first area.

Abstract translation: 一种在固定车辆的街道占用估计中使用的车辆检测系统的训练方法。 该方法包括在与用于检测车辆的监视相关联的图像捕获装置的图像平面上限定第一和第二区域。 该方法包括从从图像捕获设备捕获的帧序列中接收视频数据。 该方法包括确定包括与第二区域中的分类任务相关的对象的候选帧。 该方法包括从候选帧中提取对象，提取每个提取的对象的特征，以及为每个提取的对象分配标签。 该方法包括使用标签和提取的特征来训练至少一个分类器。 该方法包括使用至少一个经过训练的分类器对在第一区域中检测到的静止车辆进行分类。