A system and method for assessing translation quality are disclosed. In one example, a computer system receives data associated with a translation from a first text in a first natural language to a second text in a second natural language, wherein the data comprises a first value that is based on one or more semantic errors of the second text, a second value that is based on extraneous content in the second text, and a third value that is based on missing content in the second text; and determining by the computer system, based on the first value, the second value, and the third value, a score that quantifies translation quality of the second text with respect to the first text.