-
公开(公告)号:WO2018039644A1
公开(公告)日:2018-03-01
申请号:PCT/US2017/048750
申请日:2017-08-25
摘要: A system for directing the motion of a vehicle, comprising receiving commands in natural language using a processor, the commands specifying a relative path to be taken by the vehicle with respect to other objects in the environment; and determining an absolute path for the vehicle to follow based on the relative path using the processor, the absolute path comprising a series of coordinates in the environment; and directing the vehicle along the absolute path. Also provided is a system for training a lexicon of a natural language processing system, comprising receiving a data set containing a corpus of absolute paths driven by a vehicle annotated with natural language descriptions of the absolute paths using a processor, and determining parameters of the lexicon based on the data set.
摘要翻译: 一种用于引导车辆的运动的系统,包括使用处理器接收自然语言的命令,所述命令指定车辆将相对于环境中的其它物体采取的相对路径; 以及基于使用所述处理器的所述相对路径来确定所述车辆遵循的绝对路径,所述绝对路径包括所述环境中的一系列坐标; 并沿着绝对路径引导车辆。 还提供了一种用于训练自然语言处理系统的词典的系统,包括:使用处理器接收包含由用绝对路径的自然语言描述注解的车辆驱动的绝对路径的语料库的数据集;以及确定词典的参数 基于数据集。 p>
-
2.
公开(公告)号:WO2017214208A1
公开(公告)日:2017-12-14
申请号:PCT/US2017/036232
申请日:2017-06-06
发明人: SISKIND, Jeffrey, Mark , YU, Haonan
摘要: A system and method for determining the locations and types of objects in a plurality of videos. The method comprises pairing each video with one or more sentences describing the activity or activities in which those objects participate in the associated video, wherein no use is made of a pretrained object detector. The object locations are specified as rectangles, the object types are specified as nouns, and sentences describe the relative positions and motions of the objects in the videos referred to by the nouns in the sentences. The relative positions and motions of the objects in the video are described by a conjunction of predicates constructed to represent the activity described by the sentences associated with the videos.
摘要翻译: 用于确定多个视频中的对象的位置和类型的系统和方法。 该方法包括将每个视频与描述这些对象参与相关视频的活动或活动的一个或多个句子配对,其中不使用预训练对象检测器。 对象位置被指定为矩形,对象类型被指定为名词,并且句子描述句子中名词所指的视频中的对象的相对位置和运动。 视频中对象的相对位置和运动由谓词的连接词来描述,这些谓词被构造来表示由与视频相关的句子描述的活动。 p>
-