Novel AI Tool Is Better Than ChatGPT at Diagnosing Head and Neck Cancer

A novel artificial intelligence-based tool demonstrated superior performance in the diagnosis of head and neck squamous cell carcinoma (HNSCC) compared with ChatGPT. The results were published in European Archives of Oto-Rhino-Laryngology.

The study assessed the use of the newly published LLM Claude 3 Opus and compared it with the most advanced LLM ChatGPT 4.0 for the diagnosis and therapy planning of primary HNSCC. The analysis took place in March 2024 on 50 consecutive primary head and neck cancer cases. The diagnostic and recommendation parameters were compared with recommendations from Claude 3 and ChatGPT 4.0, including clinical recommendation, explanation, and summarization, in addition to the Artificial Intelligence Performance Instrument.

The findings showed that Claude 3 achieved superior success scores for the diagnostic workup compared with ChatGPT 4.0 and provided treatment recommendations involving surgery, chemotherapy, and radiation therapy. With respect to clinical recommendations, explanation, and summarization, Claude 3 scored similarly to ChatGPT 4.0.

“This study is the first analysis of Claude 3 for primary head and neck cancer cases and demonstrates a superior performance in the diagnosis of HNSCC than ChatGPT 4.0 and similar results for therapy recommendations,” the researchers concluded. “This marks the advent of a newly launched advanced AI model that may be superior to ChatGPT 4.0 for the assessment of primary head and neck cancer cases.”