Table 3 Token threshold (θ) and the number of removed and remaining tokens as a result from this filtering.
From: Combining deep learning with token selection for patient phenotyping from electronic health records
Token thresholdθ | 1 | 5 | 10 | 25 | 50 | 100 | 200 |
Removed tokens | 20,293 | 33,102 | 37,205 | 41,270 | 43,632 | 45,579 | 46,859 |
Remaining tokens | 28,555 | 15,746 | 11,643 | 7,578 | 5,216 | 3,269 | 1,989 |
