Task introduction
It is a task type that you evaluate a revised sentence made by other users. Please refer to the task instructions to proceed with the task.
Task instructions
1. You will be given a revised sentence/sentences of another user. You may be given one or two sentences.
2. Please evaluate a given revised sentence.
'Accept' Example
✓ A revised sentence has a different expression from the AI translation, but it is considered to have the same meaning
✓ A revised sentence contains no error
'Reject' Example
✕ A translated sentence contains an error(s): Uncompleted translation : Omitting a word “continuously” / Punctuation error : Omitting double quotation marks(“ “) and commas(,).
For sentences you have given a Reject, you need to check all applicable error criteria.
1. Accuracy
☑️ Mistranslation: Mark if the translation is inappropriate or incorrect.
☑️ Uncompleted translation: Mark if the text is not translated or partially translated.
☑️ Localization error: Mark if the name of a place/city/person is not localized.
Example: Apple Pie (US) → Apple Crumble (UK) ⭕
☑️ Transliteration error: Mark if the name of a place/city/person in the target language is not transliterated.
Example: Chris had a meal (US) → 크리스는 밥을 먹었다 (KO) ️⭕
Example: Chris had a meal (US) → Chris는 밥을 먹었다 (KO) ❌
☑️ Gender representation error: Mark if the gender specified in the source text is not followed.
If gender is not specified, you can choose male or female words in the target language.
2. Fluency criteria
☑️Overly Literal translation: Mark if the target text is over 'word-to-word' translated and sounds unnatural.
☑️ Grammar error: Mark if there's an error in consistency such as part of speech, word order, tense of subject and verb
☑️Different tone, Honorifics & Style: Mark if the source and target texts have different text forms.
Example : “123” -> “123” ⭕
Example : “123” -> “One hundred twenty three” ❌
3. Orthography error
☑️ Punctuation error: All the punctuation marks(ex: ? ! , .) should be included as much as possible.
- However, if the punctuation marks of the target language have a different form, use the punctuation mark of the target language.
☑️ Capitalization error: Mark if the upper case in the translated text is incorrect.
☑️ Spelling error: Mark if the spelling in the translated text is wrong.
☑️ Phonetic Symbols error: Mark if the phonetic symbols in the translated text are incorrect.
How to write 'Others box'
- Please describe errors in detail and avoid providing ambiguous, vague feedback.
- Good example: Text A is not translated
- Bad example: Translation needed, none, etc.
- Please specify the reason for Reject on 'others' if there's no corresponding error.
- If a comment contains swear words, insults, or abusive language, you may be restricted from participating in projects.
Essential task guideline
For more detailed task guidelines, you can check them while you are working on a task.
Precaution
In order to prevent any non-compliant activities, a manager is monitoring your activities in real-time. Please keep in mind the information below while working on the task.
1. When evaluating translated sentences without complying with Accept and Reject evaluation criteria 2. When not evaluating a question and randomly giving Accept or Reject If repetitive non-compliant activity is detected, further participation in this project can be restricted. |