A carregar...
Publicação
Estudo Comparativo entre o Cognitive Walkthrough e o Eye Tracker na Avaliação de Usabilidade de Sistemas
| Nome: | Descrição: | Tamanho: | Formato: | |
|---|---|---|---|---|
| 7.28 MB | Adobe PDF |
Autores
Orientador(es)
Resumo(s)
Cada vez mais, existe a necessidade de criar e desenvolver sistemas que respondam às
necessidades e requisitos do utilizador. Sistemas que sejam capazes de resolver de forma mais
eficaz e eficiente possível as tarefas pretendidas, dando, em simultâneo, ao utilizador um nível
de satisfação elevado.
Para isso, é necessário realizar avaliações de usabilidade capazes de testar os sistemas
sob o ponto de vista do utilizador. Ao longo dos anos, desenvolveram-se vários métodos capazes
de o fazer. Assim, o objetivo deste estudo é comparar as métricas obtidas por dois desses
métodos, o Cognitive Walkthrough (CW) e o Eye Tracking (ET), e determinar que relação existe
entre os dois num âmbito de avaliação de usabilidade de sistemas.
O CW é um método de referência na área de usabilidade que, devido às suas características,
é capaz de avaliar a usabilidade de um sistema com um grau de precisão elevado, revelando
problemas que precisam de correção e a opinião do potencial utilizador final.
O ET é uma tecnologia que consiste em determinar a posição do olhar do utilizador no
espaço. Já tem sido utilizada em vários estudos de usabilidade, mas, até agora, sem uma relação
direta com o CW.
Assim, foram realizados testes de usabilidade com 54 indivíduos (entre as idades de 18
anos e 68 anos), na plataforma Google Calendar. As métricas obtidas pelo CW foram o número
de cliques e o número de erros. As métricas obtidas pelo ET foram o número de saccades e o
número e duração das fixações.
Os resultados foram analisados recorrendo às técnicas estatísticas gráficas (histograma
e Q-Q Plot) e analíticas (Kolmogorov-Smirov, Shapiro-Wilk, teste de Levene, transformação Box-
Cox, teste One-Way ANOVA, teste Kruskal-Wallis e correlação de Pearson) que sugerem que a
correlação entre os dois métodos seja estatisticamente significativa. Além disso, foi realizada
uma análise complementar através de heat maps que completou o resultado obtido.
Increasingly, there is a need to create and develop systems that meet the user's needs and requirements. Systems that are able to solve the intended tasks as effectively and efficiently as possible, while giving the user a high level of satisfaction. Thus, it is necessary to perform usability evaluations capable of testing the systems from the user's point of view. Over the years, several methods capable of doing this have been developed. Thus, the purpose of this study is to compare the metrics obtained by two such methods, the Cognitive Walkthrough (CW) and Eye Tracking (ET), and to determine what relationship exists between the two in a system usability evaluation. CW is a reference method in the field of usability that, due to its characteristics, is able to evaluate the usability of a system with a high degree of accuracy, revealing problems that need correction and the opinion of the potential end user. ET is a technology that consists in determining the position of the user's gaze in space. It has already been used in several usability studies, but, until now, without a direct relationship to CW. Thus, usability tests were conducted with 54 individuals (between the ages of 18 years and 68 years), on the Google Calendar platform. The metrics obtained by CW were the number of clicks and the number of errors. The metrics obtained by ET were the number of saccades and the number and duration of fixations. The results were analyzed using graphical (histogram and Q-Q Plot) and analytical (Kolmogorov- Smirov, Shapiro-Wilk, Levene’s test, Box-Cox transformation, One-Way ANOVA, Kruskal-Wallis’ test, and Pearson correlation) statistical techniques which suggest that the correlation between the two methods is statistically significant. In addition, a complementary analysis was performed through heat maps that completed the obtained result.
Increasingly, there is a need to create and develop systems that meet the user's needs and requirements. Systems that are able to solve the intended tasks as effectively and efficiently as possible, while giving the user a high level of satisfaction. Thus, it is necessary to perform usability evaluations capable of testing the systems from the user's point of view. Over the years, several methods capable of doing this have been developed. Thus, the purpose of this study is to compare the metrics obtained by two such methods, the Cognitive Walkthrough (CW) and Eye Tracking (ET), and to determine what relationship exists between the two in a system usability evaluation. CW is a reference method in the field of usability that, due to its characteristics, is able to evaluate the usability of a system with a high degree of accuracy, revealing problems that need correction and the opinion of the potential end user. ET is a technology that consists in determining the position of the user's gaze in space. It has already been used in several usability studies, but, until now, without a direct relationship to CW. Thus, usability tests were conducted with 54 individuals (between the ages of 18 years and 68 years), on the Google Calendar platform. The metrics obtained by CW were the number of clicks and the number of errors. The metrics obtained by ET were the number of saccades and the number and duration of fixations. The results were analyzed using graphical (histogram and Q-Q Plot) and analytical (Kolmogorov- Smirov, Shapiro-Wilk, Levene’s test, Box-Cox transformation, One-Way ANOVA, Kruskal-Wallis’ test, and Pearson correlation) statistical techniques which suggest that the correlation between the two methods is statistically significant. In addition, a complementary analysis was performed through heat maps that completed the obtained result.
Descrição
Palavras-chave
Usabilidade Cognitive Walkthrough Eye Tracking