公开(公告)号：WO2022258657A1

公开(公告)日：2022-12-15

申请号：PCT/EP2022/065484

申请日：2022-06-08

Applicant: FIVE AI LIMITED

Inventor： WHITESIDE, Iain ,  FERRI, Marco ,  GRAVES, Ben ,  CRUICKSHANK, Jamie

IPC: G06F11/32 ,  G06F11/36 ,  G06N3/00 ,  G06N5/00

Abstract: A computer system for rendering a graphical user interface for visualising runs of a driving scenario in which an ego agent navigates a road layout, comprising an input configured to receive a map of the road layout and run data comprising a sequence of timestamped ego agent states and a time-varying numerical score quantifying the performance of the ego agent with respect a set of run evaluation rules; and a rendering component configured to cause a graphical user interface to display, for each rule: a plot of the time-varying numerical score, and a marker denoting a selected time index of the plot, the marker movable along the time axis to change the selected time index; and a scenario visualization comprising a visualization of the run at the selected time index, whereby moving the marker along the time axis causes the scenario visualisation to update as the time index is changed.

公开(公告)号：WO2023078938A1

公开(公告)日：2023-05-11

申请号：PCT/EP2022/080564

申请日：2022-11-02

Applicant: FIVE AI LIMITED

Inventor： WHITESIDE, Iain ,  FERRI, Marco

IPC: B60W60/00 ,  G06F11/36 ,  G06F11/34

Abstract: A computer-implemented method of evaluating the performance of a trajectory planner for a mobile robot in a scenario, in which the trajectory planner is used to control the mobile robot responsive to at least one other agent of the scenario the method comprising: determining a scenario parameter set for the scenario and a likelihood of the scenario parameter set; computing an impact score for a failure event or near failure event between the mobile robot and the other agent occurring in the scenario instance, the impact score quantifying severity of the failure event or near failure event; and computing a risk score for the instance of the scenario based on the impact score and the likelihood of the scenario parameter set.

公开(公告)号：WO2022184652A1

公开(公告)日：2022-09-09

申请号：PCT/EP2022/055008

申请日：2022-02-28

Applicant: FIVE AI LIMITED

Inventor： PETERS, Benedict ,  FERRI, Marco

IPC: G06F11/36 ,  G06F30/20

Abstract: A computer-implemented method of evaluating the performance of a trajectory planner in simulation comprises running first instances of a scenario in a simulator, the first instances run with a first set of parameterizations of the scenario, the trajectory planner used to control an ego agent responsive in each scenario instance; evaluating performance of the trajectory planner in each scenario instance, thereby computing a set of test results for the first set of scenario parameterizations; identifying at least one target parameterization of the first set based on the set of test results; and based on the target parameterization, determining a second set of parameterizations of the scenario for running second instances of the scenario for exploring a subspace of the parameter space in the vicinity of the target parameterization.

公开(公告)号：WO2022223816A1

公开(公告)日：2022-10-27

申请号：PCT/EP2022/060764

申请日：2022-04-22

Applicant: FIVE AI LIMITED

Inventor： WHITESIDE, Iain ,  FERRI, Marco

IPC: G06F30/20 ,  G05B13/04 ,  G05B1/00 ,  G05D1/00

Abstract: A computer-implemented method of evaluating the performance of a trajectory planner for a mobile robot in a real or simulated scenario, the method comprising: receiving scenario ground truth of the scenario, the scenario ground truth generated using the trajectory planner to control an ego agent of the scenario responsive to at least one other agent of the scenario, and comprising an ego trace of the ego agent and an agent trace of the other agent; evaluating the ego trace, by a test oracle, in order to assign at least one time series of test results to the ego agent, the time-series of test results pertaining to at least one performance evaluation rule; extracting one or more predetermined blame assessment parameters based on the agent trace; and applying one or more predetermined blame assessment rules to the blame assessment parameters, and thereby determining whether failure on the at least one performance evaluation rule is acceptable.