Machine translation (MT) evaluation is an important and essential part of research and development in MT. It is also a vital process in determining how well a particular MT system is equipped for a given task. This study aims to analyse Systran''s abilities to translate German patent abstracts in the field of information technology. One of the main interests of this study is also to analyse the advantages of dictionary coding. Before establishing a framework and embarking on the practical data analysis, different concepts of MT evaluation are explained through a brief review of recent research in the field. This study is of interest to developers, researchers and purchasers alike, as it gives a good overview of different aspects involved in MT and MT evaluation.