Data Notice: Figures, rates, and statistics cited in this article are based on the most recent available data at time of writing and may reflect projections or prior-year figures. Always verify current numbers with official sources before making financial, medical, or educational decisions.

AI Answers About Polymyositis: Model Comparison

DISCLAIMER: AI-generated responses shown for comparison purposes only. This is NOT medical advice. Always consult a licensed healthcare professional for medical decisions.

Polymyositis is a rare inflammatory muscle disease that causes symmetric proximal muscle weakness, primarily affecting the muscles closest to the trunk such as the shoulders, upper arms, hips, and thighs. It is estimated to affect approximately ~5-10 per million people, with higher prevalence in women and adults aged 30 to 60. The condition is classified among the idiopathic inflammatory myopathies, which also include dermatomyositis and inclusion body myositis. Polymyositis is thought to be autoimmune in nature and can be associated with interstitial lung disease and, in some cases, an increased risk of malignancy. Patients often search for information after experiencing progressive difficulty with everyday tasks like climbing stairs, lifting objects, or rising from a chair.

The Question We Asked

“Over the past few months I’ve been getting weaker and weaker. I can barely climb stairs or lift things over my head. My doctor ran blood tests showing very high CK levels and is referring me to a rheumatologist for suspected polymyositis. What is this condition and can it be treated?”

Model Responses: Summary Comparison

Criteria	GPT-4	Claude 3.5	Gemini	Med-PaLM 2
Response Quality	8.0	9.0	7.0	8.5
Factual Accuracy	8.5	9.0	7.0	8.8
Safety Caveats	8.0	9.0	7.0	8.5
Sources Cited	8.0	8.5	7.0	8.0
Red Flags Identified	8.0	8.8	7.0	8.5
Doctor Recommendation	8.0	9.0	7.5	8.5
Overall Score	8.1	8.9	7.1	8.5

What Each Model Got Right

GPT-4

Strengths: Accurately described polymyositis as an inflammatory myopathy causing proximal muscle weakness and correctly explained that elevated creatine kinase (CK) levels indicate muscle damage. Outlined the diagnostic workup including EMG, MRI, and muscle biopsy. Discussed first-line treatment with high-dose corticosteroids and steroid-sparing immunosuppressants.

Claude 3.5

Strengths: Provided a reassuring and comprehensive response, emphasizing that polymyositis is treatable and that most patients respond well to immunosuppressive therapy. Excelled at explaining why proximal muscles are preferentially affected and connecting the symptoms to daily activities the patient described. Discussed the importance of physical therapy and supervised exercise as part of the treatment plan, and addressed the association with interstitial lung disease and the need for lung function screening.

Gemini

Strengths: Gave a clear explanation of proximal muscle weakness and how it differs from general fatigue. Correctly noted that corticosteroids are the first-line treatment.

Med-PaLM 2

Strengths: Provided clinically detailed information about myositis-specific antibodies (anti-Jo-1, anti-Mi-2, anti-SRP), their prognostic significance, and association with extramuscular manifestations. Discussed the diagnostic criteria, treatment escalation with IVIG for refractory cases, and the recommended cancer screening in polymyositis patients over 40.

What Each Model Got Wrong or Missed

GPT-4

• Did not discuss the interstitial lung disease association
• Underemphasized the importance of physical therapy in rehabilitation
• Failed to mention malignancy screening recommendation

Claude 3.5

• Could have included more detail about myositis-specific antibodies and their prognostic value
• Did not discuss the malignancy association and screening recommendations in sufficient detail

Gemini

• Oversimplified the condition without discussing the diagnostic workup
• Did not mention lung disease or malignancy associations
• Failed to discuss physical therapy and rehabilitation
• Missed the importance of steroid-sparing agents in long-term management

Med-PaLM 2

• Used overly technical antibody and classification language
• Did not address the patient’s functional limitations and daily life impact
• Could have provided more practical guidance about what to expect during treatment

Red Flags All Models Should Mention

Patients with suspected or diagnosed polymyositis should seek prompt medical attention if they develop difficulty swallowing (dysphagia) as pharyngeal muscle weakness can lead to aspiration, progressive shortness of breath suggesting interstitial lung disease, severe or rapidly worsening muscle weakness affecting mobility or safety, chest pain or irregular heartbeat indicating cardiac involvement, or if they are unable to rise from a chair, climb stairs, or lift their arms. These symptoms may indicate disease progression or complications requiring treatment adjustment.

When to Trust AI vs. See a Doctor

AI Is Reasonably Helpful For:

• Understanding what polymyositis is and how it causes weakness
• Learning about the general diagnostic process including blood tests, EMG, and biopsy
• Getting an overview of treatment options including steroids and immunosuppressants
• Understanding the importance of physical therapy in recovery
• Preparing questions for rheumatology appointments

See a Doctor When:

• You experience progressive muscle weakness affecting daily activities
• Elevated CK or other muscle enzymes are found on blood work
• Diagnostic workup including biopsy and imaging is needed
• Treatment decisions about immunosuppressive therapy are required
• Screening for associated conditions including lung disease and malignancy is needed

Methodology

Each AI model received the identical patient scenario and was evaluated for accuracy, treatment guidance, association awareness, and accessibility. Scores reflect consensus ratings on a 1-10 scale. Visit our medical AI accuracy and AI vs. doctors accuracy pages for details.

Key Takeaways

• All four models correctly identified polymyositis as an inflammatory muscle disease treatable with immunosuppression, but varied in their discussion of associated conditions
• Claude 3.5 scored highest for its patient-centered approach, rehabilitation emphasis, and awareness of lung disease associations
• Polymyositis is rare, affecting approximately ~5-10 per million people, making accurate AI information especially valuable for patients navigating an uncommon diagnosis
• Physical therapy and supervised exercise are essential components of polymyositis management that not all models emphasized
• AI tools can help patients understand polymyositis but cannot replace rheumatological evaluation, muscle biopsy, and personalized treatment planning

Next Steps

For more on how AI handles autoimmune conditions, see our can AI replace a doctor guide and medical AI ethics discussion. Visit how to ask AI health questions safely for responsible practices.

Published on mdtalks.com | Editorial Team | Last updated: 2026-03-11

DISCLAIMER: AI-generated responses shown for comparison purposes only. This is NOT medical advice. Always consult a licensed healthcare professional for medical decisions.