公开(公告)号：US10169324B2

公开(公告)日：2019-01-01

申请号：US15373204

申请日：2016-12-08

Applicant: HEWLETT PACKARD ENTERPRISE DEVELOPMENT LP

Inventor： Edo Nir ,  Albert Ribakovsky ,  Oren Gavriel ,  Gabi Shalev

IPC: G06F17/27

Abstract: An example lexical analysis system may include lexical analyzer instructions and training instructions. The lexical analyzer instructions, when executed, may form a universal lexical analyzer that is to lexically analyze an input program by evaluating a function that maps an input tuple of lexemes to an output tuple of tokens based on input probability parameters. The universal lexical analyzer may be configurable for any programming language by inputting a set of probability parameters for the respective programming language as the input probability parameters of the function. The training instructions, when executed, may generate a set of probability parameters for any programming language by: receiving training programs that are in the respective programming language, each comprising a tuple of lexemes with associated tokens, and determining the set of probability parameters for the respective programming language based on lexemes and tokens in the training programs that are in the respective programming language.

公开(公告)号：US20180165273A1

公开(公告)日：2018-06-14

申请号：US15373204

申请日：2016-12-08

Applicant: HEWLETT PACKARD ENTERPRISE DEVELOPMENT LP

Inventor： Edo Nir ,  Albert Ribakovsky ,  Oren Gavriel ,  Gabi Shalev

IPC: G06F17/27

CPC classification number: G06F8/425

Abstract: An example lexical analysis system may include lexical analyzer instructions and training instructions. The lexical analyzer instructions, when executed, may form a universal lexical analyzer that is to lexically analyze an input program by evaluating a function that maps an input tuple of lexemes to an output tuple of tokens based on input probability parameters. The universal lexical analyzer may be configurable for any programming language by inputting a set of probability parameters for the respective programming language as the input probability parameters of the function. The training instructions, when executed, may generate a set of probability parameters for any programming language by: receiving training programs that are in the respective programming language, each comprising a tuple of lexemes with associated tokens, and determining the set of probability parameters for the respective programming language based on lexemes and tokens in the training programs that are in the respective programming language.