Evaluating the quality and readability of AI-generated information on adenomyosis: a comparative analysis of ChatGPT and deepseek regarding query-model consistency
Rattachement africain : cn. Niveau de preuve : code pays fourni par la source.
Le résumé fourni par la source
Purpose To systematically evaluate and compare the quality, readability, and query-model consistency of adenomyosis-related content generated by two large language models, ChatGPT (GPT-5) and DeepSeek (R1). Materials and methods In total, 25 high-frequency patient queries were obtained based on Google Trends. Each query was processed using two interaction modes, namely, three consecutive repetitions and three independent cycles, on both large language models (ChatGPT GPT-5.0-web, released December 2025; DeepSeek R1-web, released November 2025). The generated texts ( n = 300) were subsequently assessed for their readability [evaluated by Automated Readability Index (ARI), Flesch Reading Ease Score (FRES), and Gunning Fog Index (GFI)] and quality [assessed by DISCERN score, and Ensuring Quality Information for Patients (EQIP) tool]. Statistical comparisons were performed using non-parametric tests and t -tests. Results In the cyclic mode, both ChatGPT and DeepSeek maintained stable output text readability and quality. DeepSeek-generated text demonstrated significantly superior readability across both interaction modes (lower ARI: 11.32 vs. 14.56, p < 0.001; higher FRES: 46 vs. 27, p < 0.001; lower GFI: 12.47 vs. 14.16, p < 0.001) and higher information quality (higher DISCERN: 62 vs. 43, p < 0.001; higher EQIP: 75 vs. 70, p < 0.001). Under the repetition mode, DeepSeek's output exhibited significant fluctuations across multiple metrics (ARI: p = 0.021; FRES: p = 0.015; GFI: p = 0.004; DISCERN: p = 0.013; EQIP: p < 0.001), while ChatGPT's output remained stable (all p > 0.05). Notably, the readability scores for both models indicated reading levels equivalent to undergraduate education, which is above the recommended level for general public health information. Conclusion The findings of this study demonstrate that when generating information on adenomyosis, DeepSeek outperforms ChatGPT in terms of readability and several information quality metrics, whereas ChatGPT exhibits greater consistency in its outputs. However, the reading difficulty of texts generated by both models exceeds the level suitable for the general public, representing a key practical constraint limiting direct public use. Based on these results, AI chatbots may serve as complementary tools in patient education; however, their outputs should undergo expert review and be optimized for comprehensibility before broader clinical application. For clinicians and patients, these findings emphasize the importance of critically appraising AI-generated information and using it as a supplement to, rather than a substitute for, professional medical consultation.
Ce résumé expose les affirmations des auteurs. BNTIC ne l’interprète pas comme une validation indépendante des résultats.
Le contrôle bibliographique ouvert
DOI retrouvé dans Crossref DOI retrouvé ; titre concordant.
- Titre Crossref
- Evaluating the quality and readability of AI-generated information on adenomyosis: a comparative analysis of ChatGPT and deepseek regarding query-model consistency
- Date Crossref
- 10/06/2026
- Éditeur
- Frontiers Media SA
- Type
- journal-article
Ce recoupement confirme des métadonnées liées au DOI. Il ne confirme ni la méthode ni les conclusions de l’étude, et il ne compte pas comme une seconde source scientifique indépendante.
Où se fait cette recherche
-
Nanchong Central Hospital Department of Obstetrics and Gynecology pays non établi dans la noticeÉtablissement de santé
-
North Sichuan Medical University pays non établi dans la noticeUniversité ou école supérieure
-
Affiliated Hospital of North Sichuan Medical College pays non établi dans la noticeÉtablissement de santé
-
Chongqing Maternal and Child Health Hospital pays non établi dans la noticeÉtablissement de santé
-
Children's Hospital of Chongqing Medical University Department of Obstetrics and Gynecology pays non établi dans la noticeÉtablissement de santé
-
Chongqing Medical University pays non établi dans la noticeUniversité ou école supérieure
-
Maternal and Child Health Hospital of Sichuan Province pays non établi dans la noticeÉtablissement de santé
-
Chongqing Research Center for Prevention & Control of Maternal and Child Diseases and Public Health pays non établi dans la noticeStructure de recherche
-
Chongqing Health Center for Women and Children Department of Obstetrics and Gynecology pays non établi dans la noticeÉtablissement de santé
-
Jinjiang District Maternal and Child Health Hospital of Chengdu Department of Obstetrics and Gynecology pays non établi dans la noticeÉtablissement de santé
Department of Obstetrics and Gynecology — Nanchong Central Hospital, North Sichuan Medical University et Affiliated Hospital of North Sichuan Medical College, avec 7 autres affiliations.
Une affiliation ne permet pas de déduire la nationalité d’un auteur.