公开(公告)号：US20210110191A1

公开(公告)日：2021-04-15

申请号：US17071171

申请日：2020-10-15

申请人： Rutgers, The State University of New Jersey

发明人： Marco Gruteser ,  Luyang Liu ,  Hongyu Li

IPC分类号： G06K9/32 ,  G06K9/00 ,  G06N3/08

摘要： Systems and methods for edge assisted real-time object detection for mobile augmented reality are provided. The system employs a low latency offloading process, decouples the rendering pipeline from the offloading pipeline, and uses a fast object tracking method to maintain detection accuracy. The system can operate on a mobile device, such as an AR device, and dynamically offloads computationally-intensive object detection functions to an edge cloud device using an adaptive offloading process. The system also includes dynamic RoI encoding and motion vector-based object tracking processes that operate in a tracking and rendering pipeline executing on the AR device.

公开(公告)号：US11727255B2

公开(公告)日：2023-08-15

申请号：US17071171

申请日：2020-10-15

申请人： Rutgers, The State University of New Jersey

发明人： Marco Gruteser ,  Luyang Liu ,  Hongyu Li

IPC分类号： G06N3/00 ,  G06N3/063 ,  G06N3/08 ,  G06V10/25 ,  G06V20/20 ,  G06V10/764 ,  G06V10/82 ,  G06V20/40

CPC分类号： G06N3/063 ,  G06N3/08 ,  G06V10/25 ,  G06V10/764 ,  G06V10/82 ,  G06V20/20 ,  G06V20/40

摘要： Systems and methods for edge assisted real-time object detection for mobile augmented reality are provided. The system employs a low latency offloading process, decouples the rendering pipeline from the offloading pipeline, and uses a fast object tracking method to maintain detection accuracy. The system can operate on a mobile device, such as an AR device, and dynamically offloads computationally-intensive object detection functions to an edge cloud device using an adaptive offloading process. The system also includes dynamic RoI encoding and motion vector-based object tracking processes that operate in a tracking and rendering pipeline executing on the AR device.