The type of Usability Evaluation that will be conducted to evaluate the DSL shall be selected.
Heuristic Evaluation - a method developed by Nielsen that suggests an evaluation by HCI
specialists with experience in this type of evaluation, it also recommends that the inspection must be performed by a
number of three to five evaluators with the purpose of identifying the greatest number of usability problems. Heuristic
Evaluation is a usability inspection method and follows a set of 10 principles e.g. consistency, flexibility and
efficiencies, for which the evaluator fills a heuristic checklist containing the annotations of the problems
encountered. In the Usa-DSL Process this inspection will be conducted through a Heuristic Checklist composed by a
structure which consists of five (5) columns: the first column contains the identification of the heuristic, the second
column is related to the description of the ten (10) Nielsen's heuristics, but adapted to the context of DSLs, the
third column refers to the questions that guide the evaluation and related to each one of the heuristics, the fourth
column is the severity degree of the usability problems found and the fifth column is designed for the description of
issues found in the DSLs.
Usability Testing - This evaluation can be applied to four profiles in set Usability
Evaluation Subjects (see Task
P1a), provided as they know the language domain. These tests can be applied in a controlled
environment or in the natural environment, always respecting the chosen Empirical Study
Method. The evaluated metrics can be ease of use, task error rates, completion rate, effort, learning,
efficiency and effectiveness; these metrics generate data that can be recorded in videos, facial expressions, mouse
movements, and typed keys that are recorded in a log. They can also be obtained through Checklists, Questionnaires,
Interviews or Use Observation.
|
