AI Answers About Dry Eyes: Model Comparison
Data Notice: Figures, rates, and statistics cited in this article are based on the most recent available data at time of writing and may reflect projections or prior-year figures. Always verify current numbers with official sources before making financial, medical, or educational decisions.
AI Answers About Dry Eyes: Model Comparison
DISCLAIMER: AI-generated responses shown for comparison purposes only. This is NOT medical advice. Always consult a licensed healthcare professional for medical decisions.
Dry eye disease affects an estimated 16 million diagnosed Americans, with millions more experiencing undiagnosed symptoms. This chronic condition can significantly impact quality of life, work productivity, and visual function. We asked four leading AI models the same question about dry eyes and evaluated their responses.
The Question We Asked
“My eyes have been persistently dry, gritty, and burning for about six months. They water excessively sometimes, which seems contradictory. I work at a computer 8+ hours a day. Artificial tears help temporarily but the problem keeps getting worse. I’m 43, female, and I wear contact lenses. What’s causing this, and what actually works long-term?”
Model Responses: Summary Comparison
| Criteria | GPT-4 | Claude 3.5 | Gemini | Med-PaLM 2 |
|---|---|---|---|---|
| Response Quality | 8/10 | 9/10 | 7/10 | 8/10 |
| Factual Accuracy | 9/10 | 9/10 | 8/10 | 9/10 |
| Safety Caveats | 7/10 | 8/10 | 7/10 | 8/10 |
| Sources Cited | Referenced AAO guidelines | Referenced DEWS II and AAO guidelines | General references | Referenced TFOS DEWS classification |
| Red Flags Identified | Yes — autoimmune connection | Yes — comprehensive differential | Partial | Yes — Sjogren’s screening |
| Doctor Recommendation | Yes, ophthalmologist visit | Yes, with specific evaluation details | Yes, general eye doctor | Yes, with diagnostic rationale |
| Overall Score | 8.1/10 | 8.8/10 | 7.2/10 | 8.4/10 |
What Each Model Got Right
GPT-4
GPT-4 correctly explained the seeming paradox of watery eyes in dry eye disease (reflex tearing from an irritated ocular surface) and identified the contributing factors: prolonged screen time reducing blink rate, contact lens wear, and age/sex (women over 40 are at higher risk). It discussed artificial tears, warm compresses for meibomian gland dysfunction, the 20-20-20 rule for screen use, and prescription options like cyclosporine eye drops.
Strengths: Good reflex tearing explanation, practical screen-use tips, comprehensive treatment overview.
Claude 3.5
Claude provided the most thorough and practical response. It explained why dry eyes paradoxically cause excessive tearing, identified all contributing factors (screen time, contact lenses, age/hormonal factors), and discussed the two main types of dry eye (aqueous deficient and evaporative/meibomian gland dysfunction). It offered a structured treatment approach starting with environmental modifications, proper artificial tear selection (preservative-free recommended for frequent use), warm compresses and lid hygiene, and progressing to prescription treatments. It also mentioned that persistent dry eye in a woman in her 40s should prompt evaluation for Sjogren’s syndrome.
Strengths: Excellent dry eye classification, practical multi-tier treatment plan, Sjogren’s screening recommendation, contact lens management guidance.
Gemini
Gemini attributed the dry eyes primarily to screen time and recommended using artificial tears more frequently and taking screen breaks.
Strengths: Practical screen-time advice, straightforward recommendations.
Med-PaLM 2
Med-PaLM 2 provided a clinically detailed response discussing the TFOS DEWS II classification of dry eye disease, meibomian gland dysfunction as the most common cause, and evidence-based treatment approaches including omega-3 supplementation, anti-inflammatory eye drops, and in-office procedures like intense pulsed light therapy and meibomian gland expression.
Strengths: Thorough classification, current treatment modalities including newer options, evidence-based approach.
What Each Model Got Wrong or Missed
GPT-4
- Did not mention Sjogren’s syndrome screening for a woman in this demographic
- Could have discussed meibomian gland dysfunction more specifically
- Did not address whether contact lens type or wear schedule should be modified
Claude 3.5
- Could have mentioned newer in-office treatments (IPL, LipiFlow)
- Did not discuss the role of omega-3 fatty acid supplementation
- Could have provided more specific contact lens recommendations
Gemini
- Oversimplified the condition as primarily a screen-time issue
- Did not discuss meibomian gland dysfunction or the different types of dry eye
- Missing discussion of prescription treatment options
- Did not address the worsening trajectory or contact lens contribution
Med-PaLM 2
- TFOS DEWS classification may not be accessible to patients
- Limited practical self-care guidance
- Did not address the contact lens management question specifically
Red Flags All Models Should Mention
For dry eye disease, any AI response should identify these concerns:
- Persistent dry eyes in a woman over 40 (screen for Sjogren’s syndrome)
- Vision changes or significant visual fluctuation
- Eye pain beyond mild discomfort
- Worsening despite consistent treatment (may need diagnostic testing)
- Redness or discharge suggesting infection
- Dry eyes accompanied by dry mouth, joint pain, or fatigue (autoimmune screen)
- Contact lens intolerance developing
Assessment: Claude provided the most comprehensive screening guidance, particularly regarding Sjogren’s. Med-PaLM 2 addressed diagnostic evaluation well. Gemini’s coverage was inadequate.
When to Trust AI vs. See a Doctor for Dry Eyes
AI Is Reasonably Helpful For:
- Understanding what causes dry eyes and why watery eyes can be a symptom
- Learning about environmental and lifestyle modifications
- Understanding artificial tear options and proper use
- Knowing when symptoms warrant professional evaluation
See a Doctor When:
- Symptoms persist despite consistent artificial tear use and lifestyle changes
- Dry eyes are worsening over time
- You have dry eyes with dry mouth or other systemic symptoms
- Contact lenses are becoming intolerable
- Vision is affected by dry eye symptoms
- You want prescription treatment options (cyclosporine, lifitegrast)
Can AI Replace Your Doctor? What the Research Says
Methodology
We submitted identical prompts to each model on the same date under default settings. Responses were evaluated by our team using the mdtalks.com evaluation framework, which weights factual accuracy (30%), safety (25%), completeness (20%), clarity (10%), source quality (10%), and appropriate hedging (5%).
Medical AI Accuracy: How We Benchmark Health AI Responses
Key Takeaways
- All models correctly identified screen time and contact lens wear as contributing factors, but their depth of understanding varied significantly.
- Claude 3.5 scored highest for its comprehensive treatment approach and important Sjogren’s screening recommendation.
- The most clinically important finding: persistent dry eye in this demographic should prompt autoimmune screening, which only Claude and Med-PaLM 2 adequately addressed.
- AI can provide useful dry eye education and self-management strategies, but a comprehensive eye examination is needed to determine the specific type and severity of dry eye disease.
- Patients with worsening dry eye despite basic measures should see an ophthalmologist for proper evaluation and treatment escalation.
Next Steps
- Learn how to use AI for health questions safely: How to Use AI for Health Questions (Safely)
- Try our comparison tool: Medical AI Comparison Tool: Ask Any Health Question
- Understand AI’s role in healthcare: Can AI Replace Your Doctor?
Published on mdtalks.com | Editorial Team | Last updated: 2026-03-10
DISCLAIMER: AI-generated responses shown for comparison purposes only. This is NOT medical advice. Always consult a licensed healthcare professional for medical decisions.