ChatGPT Can Help Clinical Decision Making in Breast Imaging

Background: Recently, clinical decision making (CDS) in the medical setting has been advanced by the use of ChatGPT (OpenAI, San Francisco, California). ChatGPT is a large language model (LLM) that uses supervised learning and reinforcement learning. Two recent versions of this LLM technology are ChatGPT-3.5 and ChatGPT-4. Objective: To evaluate the effectiveness of ChatGPT to aid in clinical decision making for breast imaging and compare the ChatGPT-3.5 and ChatGPT-4 versions. Methods: The clinical decision making of the GPT versions was evaluated by using the American College of Radiology appropriateness criteria for breast pain and breast cancer screening. Two prompt formats were used for evaluation of the ChatGPT versions. The first format was an open-ended (OE) format in which the ChatGPT was to determine the single most appropriate imaging procedure. The second format was to select all that apply (SATA) format, including all of the follow-up breast imaging options such as ultra more...