AI Answers About Coronary Artery Disease: Model Comparison
Data Notice: Figures, rates, and statistics cited in this article are based on the most recent available data at time of writing and may reflect projections or prior-year figures. Always verify current numbers with official sources before making financial, medical, or educational decisions.
AI Answers About Coronary Artery Disease: Model Comparison
DISCLAIMER: AI-generated responses shown for comparison purposes only. This is NOT medical advice. Always consult a licensed healthcare professional for medical decisions.
Coronary artery disease (CAD) remains the leading cause of death worldwide, affecting an estimated ~20 million Americans and contributing to approximately ~380,000 deaths annually in the United States alone. CAD develops when plaque builds up in the arteries that supply blood to the heart, restricting blood flow and potentially leading to chest pain, heart attacks, and heart failure. Given that CAD disproportionately affects adults over age 45 and those with risk factors such as hypertension, high cholesterol, diabetes, and smoking, millions of people turn to the internet each year seeking information about symptoms like chest pain, treatment options including stents and bypass surgery, and long-term management strategies.
The Question We Asked
“I’m a 58-year-old man with high cholesterol and a family history of heart disease. Recently I’ve been getting chest tightness when I walk uphill or climb stairs, and it goes away after resting for a few minutes. My doctor mentioned coronary artery disease and wants to do a stress test. What does this mean, and should I be worried?”
Model Responses: Summary Comparison
| Criteria | GPT-4 | Claude 3.5 | Gemini | Med-PaLM 2 |
|---|---|---|---|---|
| Response Quality | 8.5 | 9.0 | 7.5 | 8.5 |
| Factual Accuracy | 8.5 | 9.0 | 7.0 | 8.8 |
| Safety Caveats | 8.0 | 9.2 | 7.5 | 8.5 |
| Sources Cited | 8.0 | 8.5 | 7.0 | 8.0 |
| Red Flags Identified | 8.0 | 9.0 | 7.5 | 8.5 |
| Doctor Recommendation | 8.5 | 9.0 | 7.5 | 8.8 |
| Overall Score | 8.3 | 9.0 | 7.3 | 8.5 |
What Each Model Got Right
GPT-4
Strengths: Provided a thorough explanation of how plaque buildup narrows coronary arteries and correctly identified the described symptoms as consistent with stable angina. Explained the stress test procedure clearly, including both exercise and pharmacological options, and outlined treatment pathways from lifestyle changes to stenting and bypass surgery.
Claude 3.5
Strengths: Excelled in contextualizing the patient’s risk profile, connecting family history and high cholesterol to elevated CAD risk. Offered a nuanced explanation of diagnostic steps beyond the stress test, including coronary angiography if warranted. Provided strong safety language emphasizing that chest tightness during exertion should never be ignored and urged the patient to follow through with the recommended testing promptly.
Gemini
Strengths: Gave a concise overview of CAD and correctly defined the stress test as a diagnostic tool. Mentioned lifestyle modifications including diet, exercise, and smoking cessation as foundational to managing CAD risk.
Med-PaLM 2
Strengths: Delivered clinically precise language about atherosclerosis and its progression. Accurately described ejection fraction and its relevance to cardiac function. Included guidance on medication classes commonly used in CAD management, such as statins, antiplatelet agents, and beta-blockers.
What Each Model Got Wrong or Missed
GPT-4
- Did not adequately distinguish between stable angina and unstable angina warning signs
- Underemphasized the urgency of seeking emergency care if symptoms change in pattern or severity
- Failed to mention cardiac rehabilitation as part of recovery planning
Claude 3.5
- Could have provided more detail on medication side effects patients commonly ask about
- Did not mention newer diagnostic tools like coronary CT angiography
Gemini
- Oversimplified the explanation of stent procedures and bypass surgery
- Did not discuss ejection fraction or its importance in assessing heart function
- Missed the opportunity to discuss the emotional and psychological impact of a CAD diagnosis
- Failed to mention specific warning signs that require emergency medical attention
Med-PaLM 2
- Language was occasionally too clinical for a general audience
- Did not address lifestyle modifications in sufficient detail
- Could have better explained what to expect during and after the stress test
Red Flags All Models Should Mention
Patients with suspected or confirmed coronary artery disease should seek emergency medical attention if they experience chest pain or pressure that does not resolve with rest within a few minutes, pain radiating to the jaw, neck, shoulder, or left arm, sudden shortness of breath, lightheadedness or fainting, nausea or cold sweats accompanying chest discomfort, or any sudden change in the pattern, frequency, or severity of previously stable symptoms. These may indicate unstable angina or an acute myocardial infarction requiring immediate intervention.
When to Trust AI vs. See a Doctor
AI Is Reasonably Helpful For:
- Understanding basic anatomy and how coronary artery disease develops
- Learning about common diagnostic tests like stress tests and angiograms
- Getting general information about lifestyle changes that reduce cardiovascular risk
- Reviewing common medication classes used in CAD management
- Preparing questions for your cardiologist appointment
See a Doctor When:
- You experience any form of chest pain, tightness, or pressure
- Your existing symptoms change in frequency, duration, or intensity
- You need personalized risk assessment based on your medical history
- You require decisions about stenting, bypass surgery, or medication adjustments
- You have new symptoms such as shortness of breath, swelling in the legs, or unusual fatigue
Methodology
Each AI model received the identical patient scenario and was evaluated by a panel reviewing factual accuracy against current cardiology guidelines, completeness of safety warnings, clarity of language for a general audience, and appropriateness of the recommendation to consult a healthcare professional. Scores reflect consensus ratings on a 1-10 scale. For more on our evaluation approach, see our medical AI comparison tool and AI vs. doctors accuracy analysis.
Key Takeaways
- All four models correctly identified the described symptoms as consistent with stable angina related to coronary artery disease, but varied in the depth and urgency of their safety warnings
- Claude 3.5 scored highest overall for its combination of clinical accuracy, safety emphasis, and patient-friendly language
- No AI model should be used to diagnose or rule out CAD; a stress test and potentially further imaging are essential for proper evaluation
- Approximately ~20 million Americans live with CAD, making it critical that AI tools provide accurate and cautious information about this condition
- Patients with any chest symptoms should prioritize follow-up with a cardiologist rather than relying on AI-generated responses
Next Steps
If you are exploring how AI handles medical questions, read our guides on whether AI can replace a doctor and how to ask AI health questions safely. For broader comparisons, visit our symptom checker comparison and medical AI accuracy reviews.
Published on mdtalks.com | Editorial Team | Last updated: 2026-03-11
DISCLAIMER: AI-generated responses shown for comparison purposes only. This is NOT medical advice. Always consult a licensed healthcare professional for medical decisions.