Large-scale reordering models for statistical machine translation
In state-of-the-art phrase-based statistical machine translation systems (SMT), modelling phrase reorderings is an important need to enhance naturalness of the translate outputs, particularly when the grammatical structures of the language pairs differ significantly. The challenge in developing machine learning methods for machine translation can be summarised in two points. First is the ability to characterise language features such as morphology, syntax and semantics. Second is adapting complex learning algorithms to process large corpora. Posing phrase movements as a classification problem, we exploit recent developments in solving large-scale SVM, Multiclass SVM and Multinomial Logistic Regression. Using dual coordinate descent methods for learning, we provide a mechanism to shrink the amount of training data required for each iteration. Hence, we produce significant saving in time and memory while preserving the accuracy of the models. These efficient classifiers allow us to build large-scale discriminative reordering models. We also explore a generative learning approach namely naive Bayes. Our Bayesian model is shown to be superior to the widely-used lexicalised reordering model. It is fast to train
Alrajeh, Abdullah
QA76 Computer software
Large-scale reordering models for statistical machine translation. In state-of-the-art phrase-based statistical machine translation systems (SMT), modelling phrase reorderings is an important need to enhance naturalness of the translate outputs, particularly when the grammatical structures of the language pairs differ significantly. The challenge in developing machine learning methods for machine translation can be summarised in two points. First is the ability to characterise language features such as morphology, syntax and semantics. Second is adapting complex learning algorithms to process large corpora. Posing phrase movements as a classification problem, we exploit recent developments in solving large-scale SVM, Multiclass SVM and Multinomial Logistic Regression. Using dual coordinate descent methods for learning, we provide a mechanism to shrink the amount of training data required for each iteration. Hence, we produce significant saving in time and memory while preserving the accuracy of the models. These efficient classifiers allow us to build large-scale discriminative reordering models. We also explore a generative learning approach namely naive Bayes. Our Bayesian model is shown to be superior to the widely-used lexicalised reordering model. It is fast to train
large_scale reordering model statistical_machine_translation state_of_the_art phrase based statistical_machine_translation system smt model phrase reordering important need enhance naturalness translate output particularly grammatical_structure language_pair differ significantly challenge develop machine_learn method machine_translation summarise point first ability characterise language feature morphology_syntax semantics second adapt complex learn algorithm process large_corpus phrase movement classification problem exploit recent_development solve large_scale logistic regression using dual coordinate descent method learn provide mechanism amount train data require hence produce significant saving time memory preserve accuracy model efficient classifier allow build large_scale reordering model also_explore generative learn namely naive bayesian_model show superior widely used lexicalise reorder model fast train