Multimodal neural machine translation

Abstract

Neural Machine Translation is a newly emerging approach to machine translation which attempts to build and train a large neural network that reads a sentence and outputs a notable translation. Nowadays the performance of such machines is in- creasingly in demand and Multilingual Neutral Machine Translation has emerged. There is an abundant bibliography on Multimodal Neutral Machine Translation as there is a consistent number of models which differ by the final aspects of trans- lation (adequacy, fidelity and fluency) and the multitude of inputs they can use (images, videos, text, speech or a combination of them). The GroundedTranslation was chosen in this work. As we know, by far, the state- of-the art provides some techniques such as using Long Short Term Memory and an encoder-decoder architecture for example to solve some training problems and they already have been implemented by Elliot Desmond for this retained solution. However, no investigation has been oriented toward the optimizer. This work aims to study multimodal neural machine translation architectures and its behavior un- der different optimization algorithms.