Can Artificial Intelligence Counsel Men with Testicular Cancer? A Validated Comparison of ChatGPT, Gemini and Claude

Background/Objectives: Large language models (LLMs) such as ChatGPT, Gemini and Claude are increasingly used by patients to research new diagnoses, including testicular cancer. The aim of this study was to evaluate and compare the quality of responses generated by these three platforms to patient-facing frequently asked questions on testicular cancer, including a focused evaluation of fertility and sexual health questions.

Methods

Fifteen questions were developed from established patient education resources and refined by senior urology consultant review. Each question was posed to ChatGPT, Gemini and Claude using a standardised patient-perspective prompt. The 45 responses were de-identified, randomised and assessed in a single consensus meeting by a urology panel using the Quality Analysis of Medical Artificial Intelligence (QAMAI) tool. Comparative analysis used the Friedman test with Bonferroni-corrected pairwise Wilcoxon signed-rank testing.