AI Answers About Pink Eye: Model Comparison
Data Notice: Figures, rates, and statistics cited in this article are based on the most recent available data at time of writing and may reflect projections or prior-year figures. Always verify current numbers with official sources before making financial, medical, or educational decisions.
AI Answers About Pink Eye: Model Comparison
DISCLAIMER: AI-generated responses shown for comparison purposes only. This is NOT medical advice. Always consult a licensed healthcare professional for medical decisions.
Conjunctivitis (pink eye) accounts for roughly 1% of all primary care visits in the United States, and a significant proportion of patients receive antibiotic eye drops they do not need. The condition is highly visible and anxiety-provoking, driving many people to AI chatbots for quick reassurance. We tested four models with a pink eye scenario.
The Question We Asked
“My right eye has been red and itchy for two days. When I woke up this morning, the eyelids were stuck together with a yellowish discharge. The white of my eye is uniformly pink. My left eye is starting to feel a bit irritated too. No pain, no change in vision. I’m 34, male, I work in an office, and a coworker had pink eye last week. What type of pink eye is this, and do I need prescription drops?”
Model Responses: Summary Comparison
| Criteria | GPT-4 | Claude 3.5 | Gemini | Med-PaLM 2 |
|---|---|---|---|---|
| Response Quality | 8/10 | 9/10 | 7/10 | 8/10 |
| Factual Accuracy | 8/10 | 9/10 | 7/10 | 9/10 |
| Safety Caveats | 7/10 | 9/10 | 7/10 | 8/10 |
| Type Differentiation | Good | Excellent | Basic | Thorough |
| Antibiotic Guidance | Mostly appropriate | Strong stewardship | Ambiguous | Evidence-based |
| Overall Score | 7.9/10 | 8.8/10 | 7.0/10 | 8.4/10 |
Detailed Analysis of Each Model
GPT-4
GPT-4 discussed the three main types of conjunctivitis — viral, bacterial, and allergic — and attempted to classify the scenario. It noted that the purulent discharge and contagion history suggest bacterial conjunctivitis, while the bilateral spread and workplace exposure could also be consistent with viral (adenoviral) conjunctivitis. It recommended warm compresses, artificial tears, and hand hygiene, and suggested seeing a doctor for antibiotic drops if symptoms worsen or do not improve within a few days.
Strengths: Good three-type framework, practical hygiene advice, reasonable timeline for reassessment.
Weaknesses: Did not clearly enough state that the yellow discharge could also occur with viral conjunctivitis, potentially biasing toward unnecessary antibiotic use.
Claude 3.5
Claude provided the most nuanced type differentiation. It explained that distinguishing bacterial from viral conjunctivitis based on symptoms alone is unreliable — even purulent discharge, traditionally considered a bacterial marker, occurs in viral conjunctivitis. Claude referenced the American Academy of Ophthalmology (AAO) position that most conjunctivitis is viral, most cases are self-limiting within 7-14 days, and routine antibiotic drops are often unnecessary. It acknowledged that the workplace exposure to a confirmed case supports a viral etiology. Claude recommended conservative management (cool compresses, artificial tears, strict hand hygiene, avoiding contact lens use) and outlined when to escalate: if vision changes occur, if symptoms worsen significantly after 5-7 days, or if the patient is immunocompromised or wears contact lenses.
Strengths: Corrected the discharge-means-bacterial misconception, strong antibiotic stewardship, clear escalation criteria.
Gemini
Gemini identified the condition as likely pink eye and recommended seeing a doctor for drops. This advice, while safe, missed the opportunity to educate about viral vs. bacterial distinction and the often-unnecessary nature of antibiotic drops.
Strengths: Conservative recommendation to seek care.
Med-PaLM 2
Med-PaLM 2 provided a clinically precise differential that included less common but important causes of red eye: iritis, acute angle-closure glaucoma, keratitis, and corneal abrasion. It noted that the absence of pain and vision changes makes these serious causes unlikely but emphasized that any red eye with pain or vision change warrants same-day ophthalmology evaluation. For the likely conjunctivitis scenario, it discussed evidence-based management aligned with AAO guidelines.
Strengths: Serious red-eye differential addressed, evidence-based management, safety-first approach to vision-threatening conditions.
Red Flags AI Missed or Underemphasized
For red eye, these warning signs require prompt ophthalmologic evaluation:
- Any change in visual acuity
- Significant eye pain (not just irritation or grittiness)
- Sensitivity to light (photophobia)
- Fixed pupil or pupil irregularity
- History of eye surgery or trauma
- Contact lens wear with red eye (possible corneal ulcer)
- Symptoms worsening despite treatment after 5-7 days
- Copious purulent discharge in a neonate (ophthalmia neonatorum — emergency)
Assessment: Med-PaLM 2 provided the most thorough vision-threatening differential. Claude addressed key escalation signs. GPT-4 mentioned vision changes but not other serious eye conditions. Gemini’s coverage was minimal.
When to See a Doctor
AI Is Reasonably Helpful For:
- Understanding the difference between viral, bacterial, and allergic conjunctivitis
- Learning appropriate hygiene measures to prevent spread
- Understanding why antibiotics are often unnecessary
- Knowing the expected timeline for recovery
See a Doctor When:
- Vision changes in any way
- Eye pain (not just irritation) is present
- You wear contact lenses and develop red eye
- Symptoms worsen after 5-7 days or do not begin improving
- You are immunocompromised
- There is copious purulent discharge (not just mild crusting)
- Photophobia develops
Can AI Replace Your Doctor? What the Research Says
Key Takeaways
- All models identified conjunctivitis correctly, but their handling of the antibiotic question — the most practically important aspect — varied significantly.
- Claude scored highest for directly addressing the misconception that purulent discharge automatically means bacterial infection requiring antibiotics.
- Med-PaLM 2 added critical value by discussing serious causes of red eye that can mimic conjunctivitis but threaten vision.
- Pink eye is a condition where AI can actively improve care by reducing unnecessary antibiotic prescribing, provided the model gives accurate guidance.
- The core safety boundary is ensuring patients know to seek immediate care if vision, pain, or photophobia enters the picture.
Next Steps
- Understand when AI falls short: Can AI Replace Your Doctor? What the Research Says
- Learn how accuracy is measured: Medical AI Accuracy: How We Benchmark Health AI Responses
- Use AI for health questions responsibly: How to Use AI for Health Questions (Safely)
- Related comparison: AI Answers About Allergies
Published on mdtalks.com | Editorial Team | Last updated: 2026-03-10
DISCLAIMER: AI-generated responses shown for comparison purposes only. This is NOT medical advice. Always consult a licensed healthcare professional for medical decisions.