Web Brutalism Research Dataset
Description
This dataset contains results from two usability tests: the Nielsen's Attributes of Usability Questionnaire (NAU) and the Brooke's System Usability Scale (SUS) test. Nielsen's Attributes of Usability Questionnaire (NAU): This test had five questions and eight options for each response: from one (bad) to seven (good), and a null value in case users decide not to provide an answer. The questions included in the NAU test evaluated: Learnability (How easy was it to learn to use the system?), Efficiency (How efficient was the system performing set tasks?), Memorability (How easy was to remember the features of the system?), Errors (How easy was to correct errors done in the navigation process?), and Satisfaction (How interesting, exciting or pleasant was the system to use?). The highest possible score for each question of the NAU was seven. That means thirty-five was the highest mark a system could obtain. With that in mind, we established five tiers to qualify systems: A - Excellent (35), B - Good (between 26 and 34), C - Average (25), D - Poor (between 15 and 24), and E - Deficient (below 15). Brooke's System Usability Scale (SUS): This evaluation is comprised of ten questions and each one has associated a five-point scale that range from "Strongly disagree" to "Strongly agree." Items could therefore obtain a minimum of one point and a maximum of five. These are the questions of the SUS test: (1) I think that I would like to use this system frequently; (2) I found the system unnecessarily complex; (3) I thought the system was easy to use; (4) I think that I would need the support of a technical person to be able to use this system; (5) I found the various functions in this system were well integrated; (6) I thought there was too much inconsistency in this system; (7) I would imagine that most people would learn to use this system very quickly; (8) I found the system very cumbersome to use; (9) I felt very confident using the system; and (10) I needed to learn a lot of things before I could get going with this system. The formula to obtain a score from this test was more complex. According to Brooke (1995), "to calculate the SUS score, first sum the score contributions from each item. Each item's score contribution will range from 0 to 4. For items 1, 3, 5, 7, and 9 the score contribution is the scale position minus 1. For items 2, 4, 6, 8, and 10, the contribution is 5 minus the scale position. Multiply the sum of the scores by 2.5 to obtain the overall value of SU. SUS scores have a range of 0 to 100." Given the highest possible mark was one hundred, the five categories established to qualify systems according to their results were: A - Excellent (above 80), B - Good (between 66 and 80), C - Average (65), D - Poor (between 50 and 64), and E - Deficient (below 50).
Files
Steps to reproduce
After opening the Brutalist site of Pieter Paul Pothoven (https://www.pieterpaulpothoven.com), participants must carry out six tasks within that website: (1) Navigate to the "In Abstentia'' exhibition; (2) Recover the opening date of the "Territorial Drift'' exhibition; (3) Navigate to the "Limen'' exhibition; (4) Navigate to the "Laguard'' exhibition; (5) Return to the homepage; and (6) Find the artist's e-mail address. After that, participants should complete both the NAU and the SUS test.