Cognitive effort in post-editing of machine translation : evidence from eye movements, subjective ratings, and think-aloud protocols
This thesis investigates the expenditure of cognitive effort in post-editing of machine translation. A mixed-method approach involving the use of eye movements, subjective ratings and think-aloud protocols was adopted for the investigation. The project aims at revealing connections between cognitive effort and variables including linguistic characteristics of the source text and the machine-translation output, post-editorsâ individual traits, different linguistic aspects of the activity attended to during the task, and the overall quality of the post-edited text, assessed by human translators in terms of fluency (linguistic quality) and adequacy (faithfulness to the source text). Two tasks were conducted to pursue these aims: one involving eye tracking and a self-report scale of cognitive effort, and another carried out by a different, but comparable, sample of participants, under a think-aloud condition. Results indicate that variables such as an automatic machine-translation quality score and source-text type-token ratio are good predictors of cognitive effort in post-editing. The relationship between cognitive effort and post-editorsâ traits was found to be a complex one, with significant links in this
Nunes Vieira, Lucas
Cognitive effort in post-editing of machine translation : evidence from eye movements, subjective ratings, and think-aloud protocols. This thesis investigates the expenditure of cognitive effort in post-editing of machine translation. A mixed-method approach involving the use of eye movements, subjective ratings and think-aloud protocols was adopted for the investigation. The project aims at revealing connections between cognitive effort and variables including linguistic characteristics of the source text and the machine-translation output, post-editorsâ individual traits, different linguistic aspects of the activity attended to during the task, and the overall quality of the post-edited text, assessed by human translators in terms of fluency (linguistic quality) and adequacy (faithfulness to the source text). Two tasks were conducted to pursue these aims: one involving eye tracking and a self-report scale of cognitive effort, and another carried out by a different, but comparable, sample of participants, under a think-aloud condition. Results indicate that variables such as an automatic machine-translation quality score and source-text type-token ratio are good predictors of cognitive effort in post-editing. The relationship between cognitive effort and post-editorsâ traits was found to be a complex one, with significant links in this
cognitive effort post_editing machine_translation evidence eye_movement subjective rating think_aloud protocol investigates expenditure cognitive effort post_editing machine_translation mixed_method involve use eye_movement subjective rating think_aloud protocol adopt investigation project_aim reveal connection cognitive effort variable include linguistic_characteristic source_text machine_translation output post individual trait different linguistic aspect activity attend task overall quality post text assess human translator term fluency linguistic quality adequacy faithfulness source_text task conduct pursue aim involve eye track self report scale cognitive effort another carry different comparable sample participant think_aloud condition indicate variable automatic machine_translation quality score source_text type_token ratio good predictor cognitive effort post_editing relationship cognitive effort post trait find complex significant link