Experts’ Evaluation: Datasets of Rating Questionnaires for the HEUROBOX Heuristics to Evaluate Industrial Collaborative Robotic Environments
Description
This study presents a dataset derived from expert evaluation aimed at assessing two aspects: (1) the usability of a newly developed set of heuristics (HEUROBOX), and (2) the relative importance of heuristic categories in evaluating collaborative robotic environments for industrial applications. The experts were carefully selected based on their expertise in various relevant fields, including collaborative robotics, human factors, biomechanics, and manufacturing. Their evaluations were obtained through the System Usability Scale (SUS) questionnaire and category-rating questionnaires, which were employed in conjunction with the Analytical Hierarchy Process (AHP) methodology. The resulting dataset was analyzed using AHP algorithms implemented in the R programming language. The transparency of both the data and the code allows design practitioners and researchers to utilize them for replication and further analysis, thereby adhering to the principles of reproducible research in the context of multiple-criteria decision analysis.
Files
Steps to reproduce
1. Expert Selection: The criteria for selecting the experts were carefully determined based on specific requirements and expertise relevant to the field of study. This rigorous selection process aimed to identify individuals who possessed the necessary knowledge, experience, and qualifications to offer valuable insights for the research investigation. 2. Questionnaire Administration: The recruited experts were provided with a detailed document explaining the usage of HEUROBOX. At the end of the document, they were requested to complete a set of 10 items from the System Usability Scale (SUS) questionnaire. Each item was rated on a five-point Likert scale, enabling the experts to express their level of agreement or disagreement with the provided statements. Furthermore, the experts were instructed to assess 26 category-related questions using a nine-point scale for pairwise comparisons, following the Analytical Hierarchy Process (AHP) methodology. The questionnaire was prepared in English and distributed to the experts via email during the period from October 2022 to February 2023. All expert responses were gathered by March 2023. 3. Data Processing: The raw data obtained from the expert responses were recorded in a spreadsheet format (.xlsx). To conduct the AHP analysis, the data were processed using R programming language codes (.html). These codes implemented the necessary algorithms to analyze the data according to the AHP methodology.