Quality Assessment of a Large Language Model’s Answers to Frequently Asked Questions About Meniscus Surgery: An Observational Study

Objectives

To assess the adequacy and the need for adjustment of answers generated by a large language model to common patient questions about meniscus surgery.

Methods

Ten patient-oriented questions in Portuguese (Brazilian), reflecting frequent pre- and postoperative concerns about meniscus surgery, were submitted to ChatGPT (OpenAI; insert model version and access date) in independent sessions without follow-up prompts. Answers were qualitatively evaluated by an expert knee surgeons using a framework adapted from prior orthopedic chatbot studies: (1) Excellent and (2) Good but needs adjustment (when relevant omissions or insufficient clinical specificity were identified).

Results