A retrospective study of 162 patients found ChatGPT-5 matched or exceeded the Alvarado score in diagnosing acute appendicitis, while revealing how case ordering can inflate AI performance.