Table 3 The six masked sentences designed to seek potential alternatives for chromate in the BERT model.

From: Searching for chromate replacements using natural language processing and machine learning algorithms

#

Masked sentence

Abbreviation

1

hexavalent chromium can be replaced by [MASK]

can

2

hexavalent chromium may be replaced by [MASK]

may

3

chromate can be replaced by [MASK]

chromate

4

the best corrosion inhibitor is [MASK]

inhibitor

5

[MASK] performed better than chromate

perform

6

the best conversion coating is [MASK]

coating

  1. Chromate replacements were identified by filling mask in the finetuned BERT model. [MASK] is a ‘blank’ for the model to predict, this approach is known as Fill Mask. Six abbreviations represent six Fill Mask tasks.