公开(公告)号：US09747497B1

公开(公告)日：2017-08-29

申请号：US12386655

申请日：2009-04-21

申请人： Rajeev Sharma ,  Varij Saurabh ,  Namsoon Jung

发明人： Rajeev Sharma ,  Varij Saurabh ,  Namsoon Jung

IPC分类号： G06K9/00

CPC分类号： G06K9/00369 ,  G06K9/00771 ,  G06Q30/00

摘要： The present invention is a method and system for rating in-store media elements based on the measurement for behavior patterns and demographics of the audience in the vicinity of the media element, where a plurality of input images of the audience are captured by at least a means for capturing images in the vicinity of the media element. The input images are processed by automated video analytic algorithms in order to measure the behavior patterns and demographics of each person in the audience tied to the media element. The measurements for the behavior patterns and demographics of the audience from the target media elements are aggregated. A set of ratings for the media element is calculated based on the measurements. The measured media elements are sampled, and the audience measurement for the sample is extrapolated to other media elements for in-store locations or for a group of stores. The ratings are converted into a standardized output. The standardized output facilitates comparisons among a plurality of media elements. The rating can be used to plan media types in the media element for reaching targeted demographics.

公开(公告)号：US09740977B1

公开(公告)日：2017-08-22

申请号：US12455295

申请日：2009-05-29

申请人： Hankyu Moon ,  Rajeev Sharma ,  Namsoon Jung

发明人： Hankyu Moon ,  Rajeev Sharma ,  Namsoon Jung

IPC分类号： G06N5/00 ,  G06N7/00 ,  G06T7/00

CPC分类号： G06N5/00 ,  G06K9/00771 ,  G06N7/005 ,  G06Q30/02 ,  G06T7/00

摘要： The present invention is a method and system for automatically recognizing which products a shopper intends to find or purchase based on the shopper's trajectory in a retail aisle. First, the system detects and tracks the person to generate the trajectory of the shopper. Then some of the dynamic features are extracted from the shopper trajectory. The shopper trajectory features of a given trajectory are typically the positions, the motion orientations, and speeds at each point of the trajectory. A shopper behavior model is designed based on some of the primitive actions of shoppers. The last step of the method is to analyze a given shopper trajectory to estimate the shopper's intention. The step either utilizes decision rules based on the extracted shopper trajectory features, or utilizes a trained Hidden Markov Model, to estimate the progression of the primitive actions from the trajectory. The decoded progression of the shopper behavior states is then interpreted to finally determine the shopper's intention.

公开(公告)号：US08570376B1

公开(公告)日：2013-10-29

申请号：US12313359

申请日：2008-11-19

申请人： Rajeev Sharma ,  Namsoon Jung

发明人： Rajeev Sharma ,  Namsoon Jung

IPC分类号： H04N7/18 ,  G06K9/00

CPC分类号： H04N7/18 ,  G06K9/00751 ,  G06K9/00771 ,  G06Q30/02

摘要： The present invention is a method and system for selecting and storing videos by applying semantically-meaningful selection criteria to the track sequences of the trips made by people in an area covered by overlapping multiple cameras. The present invention captures video streams of the people in the area by multiple cameras and tracks the people in each of the video streams, producing track sequences in each video stream. The present invention determines a first set of video segments that contains the trip information of the people, and compacts each of the video streams by removing a second set of video segments that do not contain the trip information of the people from each of the video streams. The present invention selects video segments from the first set of video segments based on predefined selection criteria for the statistical behavior analysis. The stored video data is an efficient compact format of video segments that contain the track sequences of the people and selected according to semantically-meaningful and domain-specific selection criteria. The final storage format of the videos is a trip-centered format, which sequences videos from across multiple cameras, and it can be used to facilitate multiple applications dealing with behavior analysis in a specific domain.

摘要翻译： 本发明是一种通过将语义上有意义的选择标准应用于由重叠的多个照相机覆盖的区域中的人们进行的旅行的轨道序列来选择和存储视频的方法和系统。 本发明通过多个摄像机捕获该区域中的人的视频流，并且跟踪每个视频流中的人，并产生每个视频流中的轨道序列。 本发明确定包含人员的行程信息的第一组视频段，并通过从每个视频流中移除不包含人员的行程信息的第二组视频段来压缩每个视频流 。 本发明基于用于统计行为分析的预定义的选择标准从第一组视频片段中选择视频段。 存储的视频数据是包含人的轨道序列并根据语义有意义的和特定于领域的选择标准来选择的视频片段的有效的紧凑格式。 视频的最终存储格式是一种以行程为中心的格式，可以对来自多个摄像机的视频进行排序，并可用于促进处理特定域中行为分析的多个应用程序。

公开(公告)号：US08412656B1

公开(公告)日：2013-04-02

申请号：US12583080

申请日：2009-08-13

申请人： Priya Baboo ,  Satish Mummareddy ,  Rajeev Sharma ,  Varij Saurabh ,  Namsoon Jung

发明人： Priya Baboo ,  Satish Mummareddy ,  Rajeev Sharma ,  Varij Saurabh ,  Namsoon Jung

IPC分类号： G06E1/00 ,  G06E3/00 ,  G06F15/18 ,  G06G7/00

CPC分类号： G06Q30/0282 ,  G06Q30/0201 ,  G06Q30/06

摘要： The present invention is a system and method for determining the hierarchical purchase decision process of consumers in front of a product category. The decision path of consumers is obtained by combining behavior data with the category layout and transaction data based on observed actual in-store purchase behavior using a set of video cameras and software for extracting sequence and timing of each consumer's decision process. A hierarchical decision tree structure comprises nodes and edges, wherein a node represents the state-of-mind of the consumer, the number of nodes is predefined, and an edge represents the transition of the decision. The decisions for each product group are captured down to the product attribute level and analyzed by demographic group. The outcome provides relative importance of each product attribute in the purchase decision process, and helps retailers and manufacturers to evaluate the layout of the category and customize it for key segment.

摘要翻译： 本发明是用于确定消费者在产品类别之前的分层购买决策过程的系统和方法。 消费者的决策路径是通过使用一组摄像机和软件，基于观察到的实际店内购买行为，通过将行为数据与类别布局和交易数据相结合来获取，以提取每个消费者决策过程的顺序和时间。 分层决策树结构包括节点和边缘，其中节点表示消费者的心态，预定的节点数量，边缘表示决策的转换。 每个产品组的决策被捕获到产品属性级别，并由人口统计组进行分析。 结果在购买决策过程中提供了每个产品属性的相对重要性，并帮助零售商和制造商评估该类别的布局，并为关键部分进行定制。

公开(公告)号：US08189926B2

公开(公告)日：2012-05-29

申请号：US11999656

申请日：2007-12-06

申请人： Rajeev Sharma ,  Satish Mummareddy ,  Priya Baboo ,  Jeff Hershey ,  Namsoon Jung

发明人： Rajeev Sharma ,  Satish Mummareddy ,  Priya Baboo ,  Jeff Hershey ,  Namsoon Jung

IPC分类号： G06K9/62

CPC分类号： G06K9/00771

摘要： The present invention is a method and system for automatically analyzing a category in a plurality of the categories in a physical space based on the visual characterization, such as behavior analysis or segmentation, of the persons with regard to the category. The present invention captures a plurality of input images of the persons in the category by a plurality of means for capturing images. The present invention processes the plurality of input images in order to understand the shopping behavior of the persons with the sub-categories of the category and analyzes the level of engagement and decision process at the sub-category level. The processes are based on a novel usage of a plurality of computer vision technologies to analyze the visual characterization of the persons from the plurality of input images. The physical space may be a retail space, and the persons may be customers in the retail space.

摘要翻译： 本发明是一种用于基于诸如针对该类别的人的行为分析或分割的视觉表征来自动分析物理空间中的多个类别中的类别的方法和系统。 本发明通过用于捕获图像的多个装置捕获类别中的人的多个输入图像。 本发明处理多个输入图像，以便了解具有该类别的子类别的人的购物行为，并分析子类别级别的参与和决策过程的水平。 这些过程基于多个计算机视觉技术的新颖用途，以分析来自多个输入图像的人的视觉表征。 物理空间可能是零售空间，人员可能是零售空间的客户。

公开(公告)号：US07930204B1

公开(公告)日：2011-04-19

申请号：US11880421

申请日：2007-07-20

申请人： Rajeev Sharma ,  Satish Mummareddy ,  Jeff Hershey ,  Akhil Kamat ,  Chris Ahlers

发明人： Rajeev Sharma ,  Satish Mummareddy ,  Jeff Hershey ,  Akhil Kamat ,  Chris Ahlers

IPC分类号： G06F17/60

CPC分类号： G06Q30/02 ,  G06Q30/0203

摘要： The present invention is a method and system for automatically changing the advertisement contents on a means for displaying the contents based on a customer's behavior or a group of customers' behavior in a retail store. The analysis of behavioral pattern is performed automatically and in real-time based on the visual information from the shopping and walkthrough history of a customer or a group of customers, using arrays of sensing devices, such as a plurality of means for capturing images, and a plurality of computer vision technologies on the visual information.

摘要翻译： 本发明是一种用于根据客户行为或一组客户行为在零售商店中显示内容的装置自动地改变广告内容的方法和系统。 基于来自顾客或一组客户的购物和演练历史的视觉信息，使用诸如多个用于捕获图像的装置的感测装置的阵列，自动和实时地执行行为模式的分析，以及 视觉信息的多种计算机视觉技术。

公开(公告)号：US07319779B1

公开(公告)日：2008-01-15

申请号：US11004299

申请日：2004-12-03

申请人： Satish Mummareddy ,  Rajeev Sharma

发明人： Satish Mummareddy ,  Rajeev Sharma

IPC分类号： G06K9/00

CPC分类号： G06K9/00288 ,  G06K9/6282 ,  G06K2009/00322

摘要： The present invention includes a method and system for automatically extracting the multi-class age category information of a person from digital images. The system detects the face of the person(s) in an image, extracts features from the face(s), and then classifies into one of the multiple age categories. Using appearance information from the entire face gives better results as compared to currently known techniques. Moreover, the described technique can be used to extract age category information in more robust manner than currently known methods, in environments with a high degree of variability in illumination, pose and presence of occlusion. Besides use as an automated data collection system wherein given the necessary facial information as the data, the age category of the person is determined automatically, the method could also be used for targeting certain age-groups in advertisements, surveillance, human computer interaction, security enhancements and immersive computer games.

摘要翻译： 本发明包括一种用于从数字图像中自动提取人的多类别年龄类别信息的方法和系统。 系统检测图像中人物的脸部，从脸部提取特征，然后分类为多个年龄类别中的一个。 与现有技术相比，使用整个脸部的外观信息可以获得更好的效果。 此外，在照明，姿势和存在闭塞的高度变异性的环境中，所描述的技术可以用于以比目前已知的方法更鲁棒的方式提取年龄类别信息。 除了作为自动数据收集系统使用，其中给定必要的面部信息作为数据，人的年龄类别被自动确定，该方法还可以用于针对广告，监视，人机交互，安全性中的某些年龄组 增强和沉浸式电脑游戏。

公开(公告)号：US10354262B1

公开(公告)日：2019-07-16

申请号：US15171873

申请日：2016-06-02

申请人： Jeff Hershey ,  Rajeev Sharma ,  Richard Hirata ,  Krishna Botla

发明人： Jeff Hershey ,  Rajeev Sharma ,  Richard Hirata ,  Krishna Botla

IPC分类号： G06Q10/00 ,  G06Q30/02 ,  H04L29/08

摘要： A method and system for analyzing shopper switching behavior over multiple shopping trips. Specifically, shopper behavior can be analyzed to generate a shopper behavior profile. Aggregating profile data across many shopping trips over time can then be used to generate analytics regarding the shopper's behavior regarding switching between products or brands and whether the shopper's purchase decisions occurred at-shelf or pre-shelf. Further, the data can be aggregated across many shoppers The analysis can then be used to make recommendations to manufacturers or retailers about how to influence shoppers to switch to a brand from a competitor, or to prevent a shopper from switching to a competitor. A deployment of cameras and mobile signal sensors can be utilized to recognize shoppers and track their behavior. Demographics information can also be estimated about the tracked shoppers. The visual and mobile signal trajectories can be fused to form a single shopper trajectory, then associated with Point of Sale (PoS) data. This results in a dataset describing the shopping trip for each tracked shopper.

公开(公告)号：US08462996B2

公开(公告)日：2013-06-11

申请号：US12154002

申请日：2008-05-19

申请人： Hankyu Moon ,  Rajeev Sharma ,  Namsoon Jung

发明人： Hankyu Moon ,  Rajeev Sharma ,  Namsoon Jung

IPC分类号： G06K9/00

CPC分类号： G06K9/00335 ,  G06K9/00315

摘要： The present invention is a method and system for measuring human emotional response to visual stimulus, based on the person's facial expressions. Given a detected and tracked human face, it is accurately localized so that the facial features are correctly identified and localized. Face and facial features are localized using the geometrically specialized learning machines. Then the emotion-sensitive features, such as the shapes of the facial features or facial wrinkles, are extracted. The facial muscle actions are estimated using a learning machine trained on the emotion-sensitive features. The instantaneous facial muscle actions are projected to a point in affect space, using the relation between the facial muscle actions and the affective state (arousal, valence, and stance). The series of estimated emotional changes renders a trajectory in affect space, which is further analyzed in relation to the temporal changes in visual stimulus, to determine the response.

公开(公告)号：US08380558B1

公开(公告)日：2013-02-19

申请号：US11999717

申请日：2007-12-06

申请人： Rajeev Sharma ,  Satish Mummareddy ,  Jeff Hershey ,  Namsoon Jung

发明人： Rajeev Sharma ,  Satish Mummareddy ,  Jeff Hershey ,  Namsoon Jung

IPC分类号： G06Q10/00 ,  H04N5/225

CPC分类号： G06Q30/02

摘要： The present invention is a method and system for analyzing shopping behavior by associating RFID data, such as tracking data by the RFID tag identifications, with video-based behavior and segmentation data, such as behavior analysis and demographic composition analysis of the customers, utilizing a plurality of means for sensing and using RFID tags, a plurality of means for capturing images, and a plurality of computer vision technologies. In the present invention, the association can further comprise the association of the RFID with the transaction data or any time-based measurement in the retail space. The analyzed shopping behavior in the present invention helps people to better understand business elements in a retail space. It is one of the objectives of the present invention to provide an automatic video-based segmentation of customers in the association with the RFID based tracking of the customers, based on a novel usage of a plurality of means for capturing images and a plurality of computer vision technologies on the captured visual information of the people in the retail space. The plurality of computer vision technologies can comprise face detection, person tracking, body parts detection, and demographic classification of the people, on the captured visual information of the people in the retail space.

摘要翻译： 本发明是一种用于通过将RFID数据（例如通过RFID标签标识跟踪数据）与基于视频的行为和分段数据（诸如客户的行为分析和人口统计分析）相关联来分析购物行为的方法和系统，利用 用于感测和使用RFID标签的多个装置，用于捕获图像的多个装置以及多个计算机视觉技术。 在本发明中，关联可以进一步包括RFID与交易数据或零售空间中的任何基于时间的测量的关联。 在本发明中分析的购物行为帮助人们更好地了解零售空间中的商业元素。 基于用于捕获图像的多个装置的新颖用途和多个计算机，本发明的目标之一是提供与客户的基于RFID的跟踪相关联的客户的基于视频的自动分割 视觉技术在零售空间中捕获的视觉信息。 多个计算机视觉技术可以包括面部检测，人物跟踪，身体部位检测和人群的人口统计分类，在零售空间中捕获的人的视觉信息。