-
公开(公告)号:US11972352B2
公开(公告)日:2024-04-30
申请号:US17980715
申请日:2022-11-04
发明人: Sima Taheri , Gang Qian , Sung Chun Lee , Sravanthi Bondugula , Allison Beach
IPC分类号: G06K9/00 , G06N3/084 , G06T7/254 , G06V10/20 , G06V10/764 , G06V10/778 , G06V10/82 , G06V10/98 , G06V40/20 , G06N5/046
CPC分类号: G06N3/084 , G06T7/254 , G06V10/255 , G06V10/764 , G06V10/7788 , G06V10/82 , G06V10/98 , G06V40/20 , G06V40/23 , G06N5/046 , G06T2207/10024 , G06T2207/20081 , G06T2207/20084 , G06T2207/20224 , G06T2207/30196
摘要: Methods, systems, and apparatus for motion-based human video detection are disclosed. A method includes generating a representation of a difference between two frames of a video; providing, to an object detector, a particular frame of the two frames and the representation of the difference between two frames of the video; receiving an indication that the object detector detected an object in the particular frame; determining that detection of the object in the particular frame was a false positive detection; determining an amount of motion energy where the object was detected in the particular frame; and training the object detector based on penalization of the false positive detection in accordance with the amount of motion energy where the object was detected in the particular frame.
-
公开(公告)号:US20210407107A1
公开(公告)日:2021-12-30
申请号:US17348047
申请日:2021-06-15
发明人: Sung Chun Lee , Gang Qian , Sima Taheri , Sravanthi Bondugula , Allison Beach
摘要: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for tracking moving objects depicted in multiple images. One of the methods includes determining, for an image captured by a camera, a first bounding box that represents a first moving object depicted in the image, determining that the first bounding box and a second bounding box overlap in an overlap area, determining that the first moving object represented by the first bounding box was farther from the camera that captured the image than a second moving object represented by the second bounding box, generating a mask for the first bounding box based on the overlap area, and determining, using data from the image that is associated with the mask, that the first moving object matches an appearance of another moving object depicted in another image captured by the camera.
-
公开(公告)号:US11978220B2
公开(公告)日:2024-05-07
申请号:US17349342
申请日:2021-06-16
发明人: Sung Chun Lee , Gang Qian , Sima Taheri , Sravanthi Bondugula , Narayanan Ramanathan , Allison Beach
摘要: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for using feature descriptors to track objects depicted in images. One of the methods includes receiving hue, saturation, value data for an image and data that indicates an object detected in the image, generating a feature descriptor that includes hue data and saturation data, determining, for each of two or more tracked objects that each have a historical feature descriptor that includes historical hue data and historical saturation data, a distance between (i) the respective historical feature descriptor and (ii) the feature descriptor, associating the feature descriptor for the object with a tracked object from the two or more tracked objects, and tracking the tracked object in one or more images from a video sequence using the feature descriptor and the historical feature descriptor.
-
公开(公告)号:US11954868B2
公开(公告)日:2024-04-09
申请号:US17963768
申请日:2022-10-11
发明人: Sung Chun Lee , Gang Qian , Sima Taheri , Sravanthi Bondugula , Allison Beach
CPC分类号: G06T7/246 , G06F18/213 , G06T7/73 , G06T11/20 , G06V20/52 , G06V40/103 , G06T2207/30196 , G06T2210/12
摘要: Methods, systems, an apparatus, including computer programs encoded on a storage device, for tracking human movement in video images. A method includes obtaining a first image of a scene captured by a camera; identifying a bounding box around a human detected in the first image; determining a scale amount that corresponds to a size of the bounding box; obtaining a second image of the scene captured by the camera after the first image was captured; and detecting the human in the second image based on both the first image scaled by the scale amount and the second image scaled by the scale amount. Detecting the human in the second image can include identifying a second scaled bounding box around the human detected in the second image scaled by the scale amount.
-
公开(公告)号:US11900706B1
公开(公告)日:2024-02-13
申请号:US17030965
申请日:2020-09-24
发明人: Gang Qian , Allison Beach , Sima Taheri , Sravanthi Bondugula , Sung Chun Lee , Narayanan Ramanathan
IPC分类号: G06T7/20 , G06N20/00 , G06T7/70 , G06V40/10 , G06F18/2113
CPC分类号: G06V40/10 , G06F18/2113 , G06N20/00 , G06T7/20 , G06T7/70 , G06T2207/20081
摘要: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for tracking objects of interest using distance-based thresholding. One of the methods includes detecting an object depicted in an image captured by a camera, determining a predicted physical distance between the object and the camera, selecting, from a plurality of predetermined confidence thresholds, a confidence threshold for the predicted physical distance, each confidence threshold in the plurality of predetermined confidence thresholds for a different physical distance range, the confidence threshold having a physical distance range that includes the predicted physical distance, and determining, using the confidence threshold and a confidence score that indicates a likelihood that the object is an object of interest, that the object is likely an object of interest.
-
公开(公告)号:US20220335725A1
公开(公告)日:2022-10-20
申请号:US17721667
申请日:2022-04-15
发明人: Sima Taheri , Gang Qian , Allison Beach
摘要: Methods and systems, including computer-readable media, are described for monitoring presence or absence of an object at a property using local region matching. A system generates images while monitoring an area of the property and, based on the images, detects an object in a region of interest in the area. For each of the images: the system iteratively computes interest points for the object using photometric augmentation applied to the image before each iteration of computing the interest points. A digital representation of the region and the object is generated based on interest points that repeat across the images after each application of the photometric augmentation. Based on the digital representation, a set of anchor points are determined from the interest points that repeat across images. Using the set of anchor points, the system detects an absence or a continued presence of the object in the area of the property.
-
公开(公告)号:US20220083782A1
公开(公告)日:2022-03-17
申请号:US17476605
申请日:2021-09-16
发明人: Gang Qian , Allison Beach , Sima Taheri , Sravanthi Bondugula , Sung Chun Lee , Narayanan Ramanathan
摘要: Methods and systems, including computer programs encoded on a storage medium, are described for implementing item monitoring using a doorbell camera. A system generates an input video stream that has image frames corresponding to detection of activity at a property. Timing information is generated for the video stream and includes a timestamp for each image frame of the stream. Using the timing information, the system processes a pre-event image frame that precedes detection of the activity and a post-event image frame that coincides with detection of the activity. An image score is computed with respect to placement of a candidate item at the property in response to processing the pre-event and post-event image frames. The image score is used to determine that a first item was delivered to the property or that a second item was removed after being delivered to the property.
-
公开(公告)号:US12014271B2
公开(公告)日:2024-06-18
申请号:US18108282
申请日:2023-02-10
发明人: Sravanthi Bondugula , Gang Qian , Sung Chun Lee , Sima Taheri , Allison Beach
IPC分类号: G06N3/08 , G06F18/214 , G06T7/194 , G06V10/20 , G06V10/25 , G06V10/774 , G06V10/82
CPC分类号: G06N3/08 , G06F18/2148 , G06T7/194 , G06V10/25 , G06V10/255 , G06V10/7747 , G06V10/82
摘要: Methods, systems, an apparatus, including computer programs encoded on a storage device, for training an image classifier. A method includes receiving an image that includes a depiction of an object; generating a set of poorly localized bounding boxes; and generating a set of accurately localized bounding boxes. The method includes training, at a first learning rate and using the poorly localized bounding boxes, an object classifier to classify the object; and training, at a second learning rate that is lower than the first learning rate, and using the accurately localized bounding boxes, the object classifier to classify the object. The method includes receiving a second image that includes a depiction of an object; and providing, to the trained object classifier, the second image. The method includes receiving an indication that the object classifier classified the object in the second image; and performing one or more actions.
-
公开(公告)号:US11935297B2
公开(公告)日:2024-03-19
申请号:US17476605
申请日:2021-09-16
发明人: Gang Qian , Allison Beach , Sima Taheri , Sravanthi Bondugula , Sung Chun Lee , Narayanan Ramanathan
CPC分类号: G06V20/41 , G06F18/214 , G06F18/22 , G06V10/225 , G06V10/25 , G06V20/46 , G06V20/48 , G06V20/52 , H04N7/18 , G06V20/44
摘要: Methods and systems, including computer programs encoded on a storage medium, are described for implementing item monitoring using a doorbell camera. A system generates an input video stream that has image frames corresponding to detection of activity at a property. Timing information is generated for the video stream and includes a timestamp for each image frame of the stream. Using the timing information, the system processes a pre-event image frame that precedes detection of the activity and a post-event image frame that coincides with detection of the activity. An image score is computed with respect to placement of a candidate item at the property in response to processing the pre-event and post-event image frames. The image score is used to determine that a first item was delivered to the property or that a second item was removed after being delivered to the property.
-
公开(公告)号:US20230054918A1
公开(公告)日:2023-02-23
申请号:US17980715
申请日:2022-11-04
发明人: Sima Taheri , Gang Qian , Sung Chun Lee , Sravanthi Bondugula , Allison Beach
摘要: Methods, systems, and apparatus for motion-based human video detection are disclosed. A method includes generating a representation of a difference between two frames of a video; providing, to an object detector, a particular frame of the two frames and the representation of the difference between two frames of the video; receiving an indication that the object detector detected an object in the particular frame; determining that detection of the object in the particular frame was a false positive detection; determining an amount of motion energy where the object was detected in the particular frame; and training the object detector based on penalization of the false positive detection in accordance with the amount of motion energy where the object was detected in the particular frame.
-
-
-
-
-
-
-
-
-