Table 3 Examples of extracted critical terms from de-identified MIMIC-III radiology reports

From: Weakly supervised language models for automated extraction of critical findings from radiology reports

Example 1. A positive example from a Chest CT report showing critical findings in Chest and Musculoskeletal regions.

Radiology report

1. Multifocal bilateral pneumonia with right lung cavitary lesions, right calcified granulomas, and right pleural plaques are very concerning for reactivation tuberculosis with a component of right upper lobe necrotizing pneumonia. 2. Enlarged pulmonary artery suggesting underlying pulmonary hypertension. 3. Hard and soft plaque throughout the aorta with narrowing of the origin of the celiac artery. Finding # 1 was discussed with Dr. First Name8 (NamePattern2) Last Name (NamePattern1) 92986 by phone at 3 : 40 p. m. on 2192-9 -11 immediately after discovery and attending review.

Critical findings in the report

Groundtruth

ā€˜reactivation tuberculosis’, ā€˜necrotizing pneumonia’

Mistral-PT-FS

ā€˜necrotizing pneumonia’

Mistral-WFT-FS

ā€˜reactivation tuberculosis’

BioMistral-PT-FS

NONE

BioMistral-WFT-FS

ā€˜reactivation tuberculosis’, ā€˜necrotizing pneumonia’

Example 2. A positive example from a Head CT report showing critical findings in Head and Neck regions.

Radiology report

1) New right parietal intraparenchymal hemorrhage with extensive edema. 2) Stable cerebellar hemorrhage, increased infratentorial edema. 3) Increase in subarachnoid hemorrhage. Findings were discussed with clinical team.

Critical findings in the report

Groundtruth

ā€˜intraparenchymal hemorrhage’, ā€˜subarachnoid hemorrhage’

Mistral-PT-FS

ā€˜subarachnoid hemorrhage’

Mistral-WFT-FS

ā€˜subarachnoid hemorrhage’, ā€˜parenchymal hemorrhage’

BioMistral-PT-FS

ā€˜parenchymal hemorrhage’

BioMistral-WFT-FS

ā€˜parenchymal hemorrhage’

Example 3. A false negative example from a report showing critical findings in Head and Neck regions.

Radiology Report

1) No significant interval change in the appearance of the comminuted C2 fracture, with components bilaterally involving the body/pedicle, or a hangman’s type fracture, and displaced fracture fragment of the anterior inferior aspect of the C2 body, an extensive teardrop-type fracture. Persisting mild rotary subluxation without significant encroachment upon the cervical cord. Fracture lines remain apparent without significant interval callus information. 2) Healing first and second right rib and sternal fractures.

Critical findings in the report

Groundtruth

ā€˜teardrop-type fracture’, ā€˜hangman’s type fracture’

Mistral-PT-FS

NONE

Mistral-WFT-FS

NONE

BioMistral-PT-FS

NONE

BioMistral-WFT-FS

NONE

Example 4. A false positive example from a report showing critical findings in Gastrointestinal regions.

Radiology Report

No evidence for intestinal obstruction or free intraperitoneal gas.

Critical findings in the report

Groundtruth

NONE

Mistral-PT-FS

ā€˜bowel obstruction’

Mistral-WFT-FS

ā€˜intestinal obstruction’, ā€˜free air’

BioMistral-PT-FS

ā€˜bowel obstruction’, ā€˜hematoma’

BioMistral-WFT-FS

ā€˜intestinal obstruction’

  1. PT Pretrained, WFT Weakly Fine-tuned, FS Few-Shot weak label generation.