Data Notice: Figures, rates, and statistics cited in this article are based on the most recent available data at time of writing and may reflect projections or prior-year figures. Always verify current numbers with official sources before making financial, medical, or educational decisions.

AI Answers About Pulmonary Fibrosis: Model Comparison

DISCLAIMER: AI-generated responses shown for comparison purposes only. This is NOT medical advice. Always consult a licensed healthcare professional for medical decisions.

Pulmonary fibrosis is a progressive lung disease characterized by scarring of the lung tissue, making it increasingly difficult to breathe. Idiopathic pulmonary fibrosis (IPF), the most common form, affects an estimated ~100,000 Americans, with approximately ~50,000 new diagnoses each year. The condition most commonly develops in adults over age 60 and carries a median survival of approximately ~3 to 5 years after diagnosis. Risk factors include smoking, environmental exposures, certain medications, and autoimmune conditions. The progressive breathlessness associated with pulmonary fibrosis drives many patients and their families to search online for information about prognosis, treatment options, and eligibility for lung transplantation.

The Question We Asked

“I’m 64 and was recently diagnosed with idiopathic pulmonary fibrosis after months of getting more and more short of breath, especially going up stairs. My pulmonologist mentioned antifibrotic medications and possibly a transplant evaluation. What can I expect going forward?”

Model Responses: Summary Comparison

Criteria	GPT-4	Claude 3.5	Gemini	Med-PaLM 2
Response Quality	8.5	9.0	7.5	8.5
Factual Accuracy	8.0	8.8	7.0	8.8
Safety Caveats	8.0	9.0	7.5	8.5
Sources Cited	8.0	8.5	7.0	8.0
Red Flags Identified	8.0	9.0	7.0	8.5
Doctor Recommendation	8.5	9.2	7.5	8.8
Overall Score	8.2	8.9	7.3	8.5

What Each Model Got Right

GPT-4

Strengths: Accurately described the two FDA-approved antifibrotic medications, pirfenidone and nintedanib, explaining that they slow disease progression but do not reverse existing scarring. Discussed pulmonary rehabilitation as an important component of care and correctly outlined supplemental oxygen use.

Claude 3.5

Strengths: Provided a compassionate and thorough explanation of what to expect with IPF, including the variable rate of progression. Excelled at balancing honest information about prognosis with a focus on maximizing quality of life. Offered practical advice about pulmonary rehabilitation, oxygen therapy, vaccination to prevent respiratory infections, and early advance care planning.

Gemini

Strengths: Gave a clear basic explanation of how lung scarring impairs gas exchange. Correctly mentioned that the cause of IPF is unknown by definition and that smoking cessation is critical for those who still smoke.

Med-PaLM 2

Strengths: Delivered clinically detailed information about high-resolution CT findings (usual interstitial pneumonia pattern), pulmonary function testing parameters including FVC decline, and lung transplant evaluation criteria including age limits and comorbidity considerations.

What Each Model Got Wrong or Missed

GPT-4

• Did not adequately discuss the psychological impact of a progressive, life-limiting diagnosis
• Underemphasized the importance of early transplant evaluation
• Failed to mention clinical trials as a potential option for patients

Claude 3.5

• Could have included more specific information about pulmonary function test monitoring
• Did not discuss the high-resolution CT findings that distinguish IPF from other forms of pulmonary fibrosis

Gemini

• Oversimplified the treatment landscape, missing key medications and interventions
• Did not discuss transplant evaluation or criteria
• Failed to address supplemental oxygen needs as the disease progresses
• Missed the importance of pulmonary rehabilitation

Med-PaLM 2

• Used overly technical language around imaging and pulmonary function parameters
• Did not adequately address quality of life and palliative care considerations
• Could have better explained what daily life looks like as the disease progresses

Red Flags All Models Should Mention

Patients with pulmonary fibrosis should seek urgent medical attention if they experience sudden worsening of shortness of breath beyond their baseline, new or worsening cough especially with blood-tinged sputum, fever or signs of respiratory infection, chest pain, cyanosis or bluish discoloration of the lips or fingertips, or significant oxygen desaturation readings on their home pulse oximeter. Acute exacerbations of IPF carry a high mortality rate and require immediate hospitalization.

When to Trust AI vs. See a Doctor

AI Is Reasonably Helpful For:

• Understanding the basics of how pulmonary fibrosis affects the lungs
• Learning about available antifibrotic medications and their general effects
• Getting an overview of what pulmonary rehabilitation involves
• Finding patient advocacy organizations like the Pulmonary Fibrosis Foundation
• Preparing questions for pulmonology appointments

See a Doctor When:

• Breathing difficulties worsen or change from baseline
• Decisions about antifibrotic medication selection or adjustment are needed
• Lung transplant evaluation and eligibility are being considered
• Supplemental oxygen needs are increasing
• Advance care planning and palliative care discussions are appropriate

Methodology

Each AI model received the identical patient scenario and was evaluated for accuracy against current IPF management guidelines, completeness of treatment information, emotional sensitivity, and language accessibility. Scores reflect consensus ratings on a 1-10 scale. Learn more at our medical AI accuracy and AI vs. doctors accuracy pages.

Key Takeaways

• All four models correctly identified antifibrotic medications as the primary treatment for IPF, but varied in their depth of discussion about transplant evaluation and quality of life
• Claude 3.5 scored highest for balancing clinical accuracy with patient-centered communication and practical guidance
• IPF affects approximately ~100,000 Americans with a median survival of ~3 to 5 years, making accurate and sensitive AI responses critical
• Early transplant evaluation and pulmonary rehabilitation are essential components that not all models emphasized
• AI tools can supplement patient education but cannot replace the specialized guidance of a pulmonologist for IPF management

Next Steps

For more on how AI handles progressive lung conditions, visit our can AI replace a doctor guide and best telehealth platforms for connecting with pulmonary specialists. See also our symptom checker comparison for broader AI tool evaluations.

Published on mdtalks.com | Editorial Team | Last updated: 2026-03-11

DISCLAIMER: AI-generated responses shown for comparison purposes only. This is NOT medical advice. Always consult a licensed healthcare professional for medical decisions.