This paper presents a user evaluation of a technique for repairing word order errors in Greek texts. This technique reorders words in a sentence and chooses the version that maximizes the number of trigram hits according to a language model. The novelty of this method consists in the use of an efficient confusion matrix technique for reordering the words. The comparative advantage of this method is that works with a large set of words, and avoids the laborious and costly process of collecting word order errors for creating error patterns. The experimental task concerns the collection of data from human participants when asked to reorder randomly presented words in order to form a meaningful sentence. The purpose of this experiment is to show the relation that exists between the sentences the users propose and the system's output.