Delphi Expert Elicitation Dataset — MDP Framework for Expert Knowledge Management in Software Industry

Published: 23 May 2026| Version 2 | DOI: 10.17632/r7hkcsg4tg.2
Contributor:
Rodrigo Porta

Description

This dataset accompanies the manuscript "Engineering Expert Knowledge into Decision Models: A Delphi-Driven MDP Framework for the Software Industry" by Porta, R. & Roldán, M. L. (2026). The dataset contains the complete results of a three-round modified Delphi expert elicitation study conducted to calibrate the transition probabilities and model parameters of a Markov Decision Process (MDP) framework for expert knowledge management. Thirteen domain experts (5 Chief Technology Officers and 8 Senior Engineering Managers) from the Argentine software industry participated across three rounds over six weeks (combined experience: 147 years; M = 11.3, SD = 2.9). The file comprises seven sheets: (1) expert panel demographics and selection criteria; (2) the complete Delphi questionnaire instrument covering 47 parameters across the MDP transition function (P1–P20), reward function coefficients (P21–P24), fatigue and burnout dynamics (P25–P31), action cost structure (P32–P40), and instrument validation items (P41–P47); (3–5) individual expert responses for Rounds 1, 2, and 3, with convergence statistics per parameter (median, mean, SD, IQR, CV); (6) convergence analysis demonstrating full consensus by Round 3 — Mean IQR converged from 0.28 to 0.12 (threshold < 0.15), the count of probability parameters with IQR > 0.20 decreased from 23 to 0 out of 31 (threshold < 5), and Mean CV decreased from 0.41 to 0.18 (threshold < 0.25); and (7) final adopted parameter values with full traceability to the MDP transition function and reward specification. Round 3 mean values are adopted uniformly as the primary central tendency estimator for all MDP parameters (transition probabilities P1–P20, action costs P34–P38, reward coefficients P21–P24, and the fatigue multiplier threshold P26), motivated by the distributional properties of the expert responses — particularly the right-skewed distribution of parameters such as α₃ (CV = 0.687), where the mean provides a more informative estimate than the median. Likert-scale validation parameters P44–P47 constitute a single declared exception, adopting the operational integer value by scale constraint. The Round 3 median column is retained for reference and sensitivity analysis; a full means-vs-medians sensitivity is reported in Section 4.6 of the accompanying manuscript. This dataset enables complete reproducibility of all model parameters from raw expert judgment to final adopted values (47 parameters × 13 experts × 3 rounds = 1,833 data points).

Files

Categories

Software Engineering, Knowledge Management, Markov Process, Delphi Method, Intelligent Decision Making, Intellectual Capital

Licence