Evaluating readability, reliability, and scientific quality of large language models in polyendocrine metabolic ovarian syndrome: a comparative benchmarking study
Published: 2 November 2026| Version 2 | DOI: 10.17632/tktstpj99s.2
Contributors:
, , , Ye MoDescription
This comparative benchmarking study assessed four large language models (GPT-5.6Sol, Gemini 3.1 Pro, Kimi K3, DeepSeek-V4Pro) in generating patient-oriented information on polyendocrine metabolic ovarian syndrome (PMOS). Twenty questions were retained from an initial pool of 40, drawn from the 2023 International Evidence-based Guideline for PCOS, routine clinical practice and online healthcare forums, and grouped into five clinical domains. Each question was entered verbatim in English into a new session of each model's consumer web interface between 20 and 25 July 2026, yielding 80 responses. Two reviewers rated accuracy (Mika), quality and reliability (GQS, mDISCERN, PEMAT-P) and readability (five formulas). No patient records were used.
Files
Institutions
- Zhejiang Provincial People's HospitalZhejiang, Hangzhou
Categories
Artificial Intelligence, Endocrine Disorder