Table 4 Specification issues, ontology

From: Iterative refinement and goal articulation to optimize large language models for clinical information extraction

Report text

C. Peripancreatic mass, excision:

- Metastatic renal cell carcinoma, clear cell type

Discordant labels

C_anatomical-site: Other- peripancreatic mass

C_anatomical-site: Pancreas

Context

- Because the mass is described as being peripancreatic, is it precise to label the site as pancreas?

- Additionally, in the context of metastasis, the histology of a tissue specimen should not be mistaken for its anatomical site

Addressing

action

- Added to anatomical site standardization instructions: “Analyze whether there are any position or direction terms that are relevant, for example, a “peripancreatic mass” would not be captured as ‘Pancreas’ as this refers to a mass in the tissue surrounding the pancreas. … renal cell carcinoma that has metastasized to the left lung would ONLY have the anatomical site ‘Lung, left’ if the specimen ONLY contains lung tissue.”

Continued error severity examples

- Major: Continued use of the label “pancreas” would be considered major, as we have now instructed that the anatomical site must be consistent with the originating tissue.

- Minor: In some cases, continued usage of the “Other” label vs a specific provided label can be justified as a minor error if the site listed in the text does not cleanly map to labels in the schema. For example, an “intradural tumor” develops within the spinal cord, thus does not cleanly map to our schema label of “Spine, vertebral column” as this has a connotation of a tumor developing in bone tissue, although for our purpose we find this mapping acceptable.