Table 4 The NER results of the Base scale models were evaluated on four entities excluding normal entities.

From: Medical language model specialized in extracting cardiac knowledge

Type

base BERT

base scratch v1

base scratch v2

base continual v1

base continual v2

base BioBERT

Cardio BERTpt

B-BP(1)

P

0.936

0.967

0.979

0.982

0.971

0.965

0.945

R

0.622

0.631

0.632

0.699

0.637

0.624

0.618

F

0.747

0.763

0.768

0.817

0.770

0.758

0.748

I-BP(2)

P

0.893

0.966

0.965

0.961

0.954

0.925

0.935

R

0.761

0.770

0.788

0.790

0.775

0.772

0.746

F

0.821

0.857

0.868

0.867

0.855

0.842

0.830

B-DN(3)

P

0.942

0.985

0.984

0.973

0.982

0.949

0.950

R

0.453

0.887

0.860

0.498

0.747

0.439

0.449

F

0.612

0.933

0.918

0.659

0.848

0.601

0.610

I-DN(4)

P

0.800

0.971

0.791

1.00

1.00

0.938

0.941

R

0.291

0.589

0.607

0.250

0.482

0.273

0.291

F

0.427

0.733

0.687

0.40

0.651

0.423

0.444

B-DN(5)

P

0.874

0.972

0.946

0.876

0.947

0.898

0.892

R

0.752

0.817

0.835

0.851

0.838

0.771

0.764

F

0.808

0.888

0.887

0.863

0.889

0.830

0.823

I-DN(6)

P

0.893

0.852

0.835

0.798

0.777

0.887

0.892

R

0.693

0.724

0.752

0.782

0.770

0.702

0.709

F

0.780

0.783

0.791

0.790

0.774

0.783

0.790

B-MP(7)

P

0.919

0.975

0.982

0.972

0.975

0.942

0.959

R

0.500

0.604

0.692

0.542

0.841

0.509

0.518

F

0.648

0.746

0.812

0.696

0.903

0.661

0.672

I-MP(8)

P

0.925

0.841

0.925

0.902

0.822

0.902

0.878

R

0.673

0.685

0.685

0.685

0.685

0.673

0.679

F

0.779

0.755

0.787

0.779

0.747

0.771

0.766

  1. In the table, the types correspond to BP, body part; DR, drug name; DN, disease name and MP, medical procedure.
  2. Significant values are in [bold].