Comparisons

AI Answers About Hidradenitis Suppurativa: Model Comparison

By Editorial Team — reviewed for accuracy Updated
Last reviewed:

Data Notice: Figures, rates, and statistics cited in this article are based on the most recent available data at time of writing and may reflect projections or prior-year figures. Always verify current numbers with official sources before making financial, medical, or educational decisions.

AI Answers About Hidradenitis Suppurativa: Model Comparison

DISCLAIMER: AI-generated responses shown for comparison purposes only. This is NOT medical advice. Always consult a licensed healthcare professional for medical decisions.


Hidradenitis suppurativa (HS) is a chronic, recurrent inflammatory skin condition characterized by painful nodules, abscesses, and sinus tracts primarily in areas where skin rubs together — the armpits, groin, under the breasts, and buttocks. HS affects an estimated ~1-4% of the global population, with a significant diagnostic delay averaging ~7-10 years from symptom onset to correct diagnosis. The condition disproportionately affects women (approximately ~3:1 female-to-male ratio) and typically begins after puberty. HS is frequently misdiagnosed as boils, folliculitis, or recurrent abscesses. We asked four AI models to evaluate a patient scenario involving suspected HS.

The Question We Asked

“For the past three years I’ve been getting recurring painful lumps in my armpits and groin area. They swell up, sometimes drain foul-smelling fluid, and leave scars. My GP has treated each one as a boil with antibiotics, but they keep coming back. I’m a 31-year-old woman and this is destroying my quality of life. I read about hidradenitis suppurativa online. Could that be what I have? What treatments are available beyond just antibiotics every time?”

Model Responses: Summary Comparison

CriteriaGPT-4Claude 3.5GeminiMed-PaLM 2
Response Quality8.0/109.2/107.0/108.5/10
Factual Accuracy8.5/109.0/107.5/109.0/10
Safety Caveats8.0/109.0/107.0/108.0/10
Sources CitedGeneral dermatology referencesHurley staging, North American HS guidelinesLimitedEuropean HS guidelines
Red Flags IdentifiedMentioned scarring concernComprehensive — mental health, disease progressionPartialThorough
Doctor RecommendationDermatologist referralUrgent dermatologist with HS expertiseYes, generalHS specialist recommendation
Overall Score8.2/109.1/107.2/108.5/10

What Each Model Got Right

GPT-4

Strengths: GPT-4 correctly identified the description as highly consistent with hidradenitis suppurativa based on the key criteria: recurrent nodules in flexural areas, chronic duration, drainage, and scarring. It explained the Hurley staging system (Stage I: isolated abscesses; Stage II: recurrent abscesses with sinus tracts; Stage III: diffuse involvement with interconnected tracts). It discussed treatment options beyond antibiotics including topical clindamycin, hormonal therapy, and biologic medications (adalimumab, the first FDA-approved biologic for HS).

Claude 3.5

Strengths: Claude delivered the most empathetic and comprehensive response. It validated the patient’s frustration with the diagnostic delay and explicitly stated that a ~7-10 year average delay is unfortunately common with HS. Claude explained why repeated antibiotic courses for individual flares are an inadequate treatment strategy — HS is not primarily an infectious condition but an inflammatory one. It outlined a treatment approach organized by Hurley stage, including topical treatments, systemic antibiotics used for anti-inflammatory properties (such as combination clindamycin and rifampicin), hormonal therapy (spironolactone, oral contraceptives), biologics (adalimumab, secukinumab), and surgical options for refractory disease. Claude addressed the psychosocial impact, noting that HS patients have depression rates approximately ~2-3 times higher than the general population and encouraged seeking mental health support. It recommended finding a dermatologist with specific HS expertise.

Gemini

Strengths: Gemini recognized the symptoms as possibly consistent with HS and recommended seeing a dermatologist. It mentioned lifestyle modifications including weight management, loose clothing, and avoiding shaving in affected areas.

Med-PaLM 2

Strengths: Med-PaLM 2 provided a detailed discussion of HS pathogenesis, explaining the role of follicular occlusion, immune dysregulation, and secondary bacterial colonization. It discussed the comorbidity profile of HS including metabolic syndrome, inflammatory bowel disease, and spondyloarthropathy, and referenced clinical trial data for biologic therapies.

What Each Model Got Wrong or Missed

GPT-4

  • Did not adequately address the emotional impact of HS or quality of life considerations
  • Could have discussed the newer biologic options beyond adalimumab
  • Did not mention the association between HS and other conditions (metabolic syndrome, IBD)

Claude 3.5

  • Could have provided more detail on wound care and day-to-day management of active lesions
  • Did not discuss dietary modifications that some patients find helpful (dairy and nightshade elimination, though evidence is limited)
  • Could have mentioned HS support communities as a resource

Gemini

  • Did not explain what HS is beyond a surface-level description
  • No discussion of Hurley staging or severity assessment
  • Missing information about biologic therapies
  • Did not address the diagnostic delay problem or validate the patient’s experience

Med-PaLM 2

  • Pathogenesis discussion may be too technical for a patient seeking practical guidance
  • Did not sufficiently validate the emotional burden of the condition
  • Could have provided more structured treatment decision guidance

Red Flags All Models Should Mention

For hidradenitis suppurativa, any AI response should identify these concerns:

  • Signs of systemic infection: fever, expanding redness, warmth (may indicate secondary bacterial infection requiring urgent care)
  • Restriction of arm or leg movement due to scarring or active disease
  • Development of sinus tracts that are draining continuously
  • Worsening disease despite treatment (may need escalation to biologics or surgery)
  • Depression, anxiety, or social isolation related to HS (approximately ~40% of HS patients report clinically significant depression)
  • New joint pain or gastrointestinal symptoms (associated conditions)
  • Squamous cell carcinoma can rarely develop in long-standing sinus tracts

Assessment: Claude 3.5 provided the most thorough coverage of both clinical and psychosocial red flags. Gemini’s coverage was insufficient for a chronic, progressive condition.

When to Trust AI vs. See a Doctor

AI Can Reasonably Help With:

  • Understanding what HS is and why individual boil treatments are inadequate
  • Learning about available treatment options before a dermatology appointment
  • Understanding the Hurley staging system and where your symptoms may fall
  • Finding language to advocate for proper diagnosis with your doctor

See a Doctor When:

  • You have recurrent painful lumps in flexural areas (seek a dermatologist, not just a GP)
  • Current treatment is not controlling your disease
  • You are experiencing significant pain, drainage, or scarring
  • HS is affecting your mental health or daily functioning
  • You want to discuss biologic therapy or surgical options
  • You develop new symptoms such as joint pain or GI problems

Can AI Replace Your Doctor? What the Research Says explains why chronic inflammatory conditions require ongoing specialist management.

Methodology

We submitted the identical patient scenario to GPT-4, Claude 3.5 Sonnet, Gemini, and Med-PaLM 2 under default settings. Responses were evaluated by our editorial team against current North American and European HS management guidelines. Scores reflect accuracy, empathy, and practical usefulness. Model outputs are not reproduced verbatim to avoid misuse.

Key Takeaways

  • All models correctly identified the description as consistent with hidradenitis suppurativa, but varied significantly in depth and empathy
  • Claude 3.5 scored highest for validating the patient’s experience, explaining the diagnostic delay problem, and providing a structured treatment approach by disease stage
  • The most critical message — that HS is an inflammatory condition requiring a systematic treatment strategy, not repeated antibiotic courses for individual flares — was best communicated by Claude and Med-PaLM 2
  • HS has a significant psychosocial burden, and only Claude adequately addressed the mental health impact
  • Patients suspecting HS should seek a dermatologist with HS expertise, as management has evolved substantially with the availability of biologic therapies

Next Steps


Published on mdtalks.com | Editorial Team | Last updated: 2026-03-12

DISCLAIMER: AI-generated responses shown for comparison purposes only. This is NOT medical advice. Always consult a licensed healthcare professional for medical decisions.