ASys has been tested in a real scenario of usage. The study was performed by several teachers (different form the authors) and took place at the Universitat Politècnica de València (UPV). Six Java exams of a second-year programming course where five teachers and 535 students has been considered in this study.

After ASys' experience, interviews with both the students and the professors were made. In general, the students found the tool very useful to self-evaluate their learning. The professors found the tool useful for three reasons: First, because it saved a lot of time in the assessment process. Second, because it increased the students’ autonomy, and thus they received many less questions about how to solve the exercises. And third, because it increased the assessment quality, not only because it was exhaustive, but also because it was completely fair and equally applied to all students.

In order to evaluate the platform and get feedback to improve ASys, a survey related to the use and utility of the tool was conducted. 164 students voluntarily filled the survey in. The results of the survey are summarised in the next figure.

The whole results of the surveys can be also downloaded from the next link: Survey results