What is the Acceptability Rating Task?
- The task is to rate the quality of the translation given the source sentence. You should rate the translations based on whether the meaning of the source sentence is transferred to the translation.
How to do this?
-
Please assign a score to the translation by clicking and dragging on the slider below. Any point along the slider can be chosen and you can refer to the descriptions to make a judgment.
-
The descriptions from best to worst are (From above):
-
A: Perfect: The meaning of the translation is completely consistent with the source and reads like it was formulated by a native speaker.
-
B: Retain score meaning with minor mistakes: The translated sentence retains the core meaning of the source sentence, but may have some minor grammar mistakes, awkward formulations, and/or might omit some insignificant parts.
-
C: Preserve some meaning with major mistakes: The translated sentence preserves some of the meaning of the source sentence but misses significant parts, or contains major errors.
-
D: Nonsense or unrelated: A completely nonsense translation that is not related to the source string.
-
Where “Perfect” is the very far right of the scale and “Nonsense” is the very far left.
-
Cautions⚠️
- Please consider different interpretations of the source sentence, and use the interpretation that is closest to the translation when making judgement.
- If the source sentence has common typos or punctuation errors, be sure to interpret based on the closest intended meaning.
- If the source sentence makes no sense, a literal "word by word” translation is deemed acceptable. Please always rate the sentence even if the source sentence is hard to understand.
Source sentence Issues
- If there are problems in the source sentence, please specify by clicking “Flag” on the upper right corner of the source string and selecting the corresponding reasons.
- Optionally, you can also specify translation errors by clicking “Add details” on the upper right corner of the translated string. Adding translation errors are not required and please only do so if it helps you make judgments.