Evaluation of scientifi c validity and appropriateness of artifi cial intelligence-assisted chatgpt advices in dietary treatment of methylmalonic acidemi

• Furkan Yolcu ^[1] ; Merve Koç Yekedüz ^[1] ; Engin Köse ^[1] ; Fatima Gülhan Samur ^[2] ; Fatma Tuba Eminoğlu ^[1]
  1. [1] Ankara University

     Ankara University

     Turquía

     
  2. [2] School. Boston, MA. USA. 3 Ankara University Rare Diseases Application and Research Center. Ankara, Turkey. 4
• Localización: Nutrición hospitalaria: Órgano oficial de la Sociedad Española de Nutrición Clínica y Metabolismo (SENPE), ISSN-e 1699-5198, ISSN 0212-1611, Vol. 42, Nº. 5, 2025, págs. 910-915
• Idioma: inglés
• DOI: 10.20960/nh.06026
• Títulos paralelos:
  • Evaluación de la validez científi ca y la adecuación de los consejos dietéticos asistidos por inteligencia artifi cial de ChatGPT en el tratamiento nutricional de la acidemia metilmalónic
• Texto completo no disponible (Saber más ...)
• Resumen
  • español

    Antecedentes y objetivos: el Chat Generative Pretrained Transformer (ChatGPT) se ha convertido en una herramienta cada vez más utilizada por pacientes y profesionales de la salud para obtener información sobre salud y asesoramiento nutricional. Estudios previos han planteado preocupaciones acerca de la exactitud de las recomendaciones dietéticas proporcionadas por ChatGPT. El objetivo de este estudio fue evaluar el potencial de ChatGPT como herramienta para proporcionar tratamiento dietético en la acidemia metilmalónica (AMM) en octubre de 2024.

    Métodos y diseño del estudio: se compararon las recomendaciones dietéticas de ChatGPT (versión 4.0) para AMM con guías internacionalmente reconocidas y la literatura científica actual, y posteriormente se evaluó la capacidad del chatbot para generar tratamiento dietético en dos casos distintos de AMM. Un equipo de dietistas y médicos especialistas en metabolismo comparó las respuestas de ChatGPT con guías específicas de la enfermedad y recursos basados en la evidencia.

    Resultados: en general, ChatGPT proporcionó recomendaciones específicas: el 20,0 % de las respuestas se consideraron apropiadas y el 53,4 % se consideraron inapropiadas. Especialmente en este grupo de pacientes, cuyo único tratamiento reconocido es la terapia dietética, las recomendaciones de ChatGPT resultaron igualmente inapropiadas para los dos casos evaluados.

    Conclusiones: este estudio es el primero en evaluar la idoneidad de las recomendaciones generadas por inteligencia artificial para el manejo dietético especializado de trastornos metabólicos hereditarios. En consecuencia, la idea de que la inteligencia artificial pueda sustituir la labor humana en un futuro próximo parece poco realista, dado el bajo índice de aci

  • English

    Background and objectives: Chat Generative Pretrained Transformer (ChatGPT) has become an increasingly popular way for patients and healthcare professionals to seek information on health and nutrition advice. Previous studies have raised concerns about the accuracy of dietary advice provided by ChatGPT. We aimed to evaluate the potential of ChatGPT as a tool to provide dietary therapy for methylmalonic acidemia (MMA) in October 2024.

    Methods and study design: we compared ChatGPT’s (version 4.0) dietary advices for MMA with internationally recognized guidelines and current literature, and then evaluated the chatbot’s ability to generate dietary therapy in two different cases with MMA. A team of dietitians and metabolic physicians compared ChatGPT responses to disease-specifi c guidelines and evidence-based resources.

    Results: overall, ChatGPT provided specifi c advices: 20.0 % of responses were considered appropriate and 53.4 % were considered inappropriate. Especially in this group of patients whose only known treatment was dietary therapy, the dietary therapy recommended by ChatGPT was also inappropriate for the two cases in question.

    Conclusions: this study was the fi rst to evaluate the appropriateness of artifi cial intelligence advices for specialized dietary management of inherited metabolic disorders. Consequently, the idea that artifi cial intelligence can replace human labor in the near future seems fa

• Referencias bibliográficas
  • 1. Pinto A, Evans S, Daly A, Almeida MF, Assoun M, Belanger-Quintana A, et al. Dietary practices in methylmalonic acidaemia: a European survey....
  • 2. Manoli I, Sloan JL, Venditti CP. Isolated Methylmalonic Acidemia. 2005 Aug 16 [updated 2022 Sep 8]. In: Adam MP, Feldman J, Mirzaa GM,...
  • 3. Myles JG, Manoli I, Venditti CP. Effects of medical food leucine content in the management of methylmalonic and propionic acidemias. Current...
  • 4. Tan SS-L, Goonawardene N. Internet health information seeking and the patient-physician relationship: a systematic review. Journal of medical...
  • 5. Ponzo V, Goitre I, Favaro E, Merlo FD, Mancino MV, Riso S, et al. Is ChatGPT an Effective Tool for Providing Dietary Advice? Nutrients...
  • 6. Sallam M. ChatGPT Utility in Healthcare Education, Research, and Practice: Systematic Review on the Promising Perspectives and Valid Concerns....
  • 7. Davenport T, Kalakota R. The potential for artificial intelligence in healthcare. Future healthcare journal 2019;6(2):94-8.DOI: 10.7861/futurehosp.6-2-94
  • 8. Sharma S, Pajai S, Prasad R, Wanjari MB, Munjewar PK, Sharma R, et al. A critical review of ChatGPT as a potential substitute for diabetes...
  • 9. Garcia MB. ChatGPT as a virtual dietitian: Exploring its potential as a tool for improving nutrition knowledge. Applied System Innovation...
  • 10. Kirk D, van Eijnatten E, Camps G. Comparison of answers between ChatGPT and human dieticians to common nutrition questions. Journal of...
  • 11. Papastratis I, Stergioulas A, Konstantinidis D, Daras P, Dimitropoulos K. Can ChatGPT provide appropriate meal plans for NCD patients?...
  • 12. Chatelan A, Clerc A, Fonta P-A. ChatGPT and future artificial intelligence chatbots: what may be the influence on credentialed nutrition...
  • 13. Niszczota P, Rybicka I. The credibility of dietary advice formulated by ChatGPT: robo-diets for people with food allergies. Nutrition...
  • 14. Jurecki E, Ueda K, Frazier D, Rohr F, Thompson A, Hussa C, et al. Nutrition management guideline for propionic acidemia: An evidence-and...
  • 15. Yannicelli S. Nutrition management of patients with inherited disorders of organic acid metabolism. Nutrition management of patients with...
  • 16. Baumgartner MR, Hörster F, Dionisi-Vici C, Haliloglu G, Karall D, Chapman KA, et al. Proposed guidelines for the diagnosis and management...
  • 17. van Calcar S. Nutrition Management of Propionic Acidemia and Methylmalonic Acidemia. Nutrition Management of Inherited Metabolic Diseases:...
  • 18. Bernstein LE, Burns C, Drumm M, Gaughan S, Sailer M, Baker II PR. Impact on isoleucine and valine supplementation when decreasing use...
  • 19. Li R, Kumar A, Chen JH. How chatbots and large language model artificial intelligence systems will reshape modern medicine: fountain of...
  • 20. Sowa M. Nutrition management of propionic acidemia and methylmalonic acidemia. Nutrition Management of Inherited Metabolic Diseases: Lessons from...
  • 21. Dixon M, MacDonald A, White F, Stafford J. Disorders of amino acid metabolism, organic acidaemias and urea cycle disorders. Clinical paediatric...