Table 4 Example of incorrect DRG predictions.

From: DRG-LLaMA : tuning LLaMA model to predict diagnosis-related group for hospitalized patients

Case ID

Pertinent narratives in discharge summary

True DRG

Predicted DRG

Comment

Case 1

altered mental status…respiratory failure…acute blood loss anemia and anemia of chronic disease…clostridium difficile infection…hypotension…was initially on levophed and dopamine…

Heart failure and shock with mcc

Respiratory system diagnosis with ventilator support 96 hours

Difficulty in selecting base DRG

Case 2

gastrointestinal bleeding…most likely ischemic colitis…viral gastroenteritis…acute renal failure…anemia…

Renal failure with cc

Other digestive system diagnoses with cc

Difficulty in selecting base DRG

Case 3

worsening diabetic foot ulcer…diabetic foot infection…svt…cardiology was consulted…

Cellulitis without mcc

Diabetes with cc

Inadequate clinical concept extraction

Case 4

neutropenic fevers…infectious workup was negative except for a urine culture growing enterococcus…pt is neutropenic, thrombocytopenic, and anemic…hiv-stable…

Kidney and urinary tract infections without mcc

Major hematological and immunological diagnoses except sickle cell crisis and coagulation disorders with mcc

Difficulty in selecting base DRG

Case 5

reported chest pain…soliatry episode of nsvt..ua without pyuria…safe for d/c home…

Esophagitis gastroenteristis and miscellaneous digestive disorders without mcc

Cardiac arrhythmia and conduction disorders with cc

Correct information needed for DRG prediction not available

Case 6

septic arthritis, likely seeded by her recurrence of her e. coli bacteremia…rheum and id recommend wash out…wash out was deferred by orthopedics…

Septicemia or severe sepsis without mv 96 hours with mcc

Revision of hip or knee replacement with mcc

Inadequate clinical concept extraction

Case 7

acute to subacute hyponatremia…admitted with low na 120…uti with evidence of pyuria…

Kidney and urinary tract infections without mcc

Renal failure with cc

Inadequate clinical concept extraction

Case 8

presents with diffuse acute-on-chronic abdominal pain…gi bleed…treated with octreotide drip and pantoprazole iv…capsule endoscopy was performed…encephalopathy…visual hallucinations…

Septicemia or severe sepsis without mv 96 hours with mcc

G.i. hemorrhage with cc

Possible incorrect DRG label

Case 9

admitted for altered mental status…delirium….silent aspiration for which received a peg tube…hypertension treated with amlodipine…osa

Esophagitis gastroenteristis and miscellaneous digestive disorders without mcc

Esophagitis gastroenteritis and miscellaneous digestive disorders with mcc

Erroneous cc/mcc

Case 10

presents with word finding difficulties and lethargy…eeg showed moderate encephalopathy…ams was likely due to overmedication…followed by psychiatry - seroquel and abilify were held…

Psychoses

Other disorders of nervous system with cc

Inadequate clinical concept extraction

  1. We manually reviewed 10 cases for error analysis. For each case, we extracted most pertinent medical problems and their narratives from discharge summaries. Certain errors, like inadequate clinical concept extraction, indicate the model’s weaknesses. Other errors, such as the difficulty in selecting the base DRG, likely stem from the intricacies of the DRG assignment rules. Furthermore, errors such as the unavailability of correct information required for DRG prediction underscore the limitations of solely relying on discharge summaries for DRG predictions.