LAB2FAB - Human-in-the-Loop Expert System for SME Sustainability
Description
This repository contains anonymized research materials supporting the article: “Design and Evaluation of a Human-in-the-Loop Expert System for Sustainability Gap Analysis and Academic Expertise Matching in SMEs”. The repository provides the datasets, prompt templates, and evaluation artefacts used in the development and assessment of LAB2FAB, a human-in-the-loop expert system that combines sustainability assessment, knowledge-based inference, generative AI, expertise retrieval, and human supervision. Repository contents: • README.md - Description of the dataset package, structure, and anonymization procedures. • 01_sdg_criteria.md - Seven SDG-aligned sustainability assessment criteria in Portuguese, together with their associated Sustainable Development Goals and targets. • 02_prompt_templates.md - Prompt templates used during the experimental evaluation, including keyword extraction, keyword refinement, gap generation, and recommendation generation prompts across the evaluated prompting strategies. • 03_sus_item_distribution.csv - Item-level response distribution for the System Usability Scale (SUS) evaluation (N=10). • 03_sus_summary.md - Summary statistics of the SUS evaluation, including overall usability measures reported in the study. • 04_insitu_ratings_by_organisation.csv - Aggregated organisational ratings for generated artefacts collected during the in-situ evaluation. • 04_insitu_ratings_by_dimension.csv - Aggregated ratings by evaluation dimension (keywords, gap statements, and recommendations) covering 113 assessed gaps. The repository intentionally excludes identifiable SME assessment responses, organisational records, specialist identities, and other commercially sensitive data. All published files have been anonymized and aggregated to comply with confidentiality obligations and data protection requirements. The objective of this dataset is to support transparency, reproducibility, and future research on human-in-the-loop expert systems, sustainability assessment, generative AI, and academic expertise matching.
Files
Institutions
- Polytechnic Institute of PortoPorto, Porto