Table 2 Summary of current benchmark categories and methods available in the JARVIS-Leaderboard at the time of writing

From: JARVIS-Leaderboard: a large scale benchmark of materials design methods

Category

General name

Method Specification

ES

DFT106

VASP81,82 (PBE87, LDA106, OptB88vdW104,

  

Opt86BvdW105, TBmBJ83,84, SCAN108, r2SCAN109, HSE06110)

  

QE115 (PBE87, PBEsol107)

  

ABINIT112,113,114 (PBE87)

  

GPAW79 (PBE87, LDA106, GLLB-sc78)

 

QMC85

QMCPACK86 (DMC85)

 

GW80

VASP81,82 (G0W080, GW080)

 

TB99

ThreeBodyTB.jl72 (Wannier90116)

AI

Descriptor

CFID184, MagPie185, MatMiner67,97, crystal feature model186,

  

ElemNet187,188,189,190, IRNet191,192,193, BRNet194,195,196, SNAP129

 

Graph-based

ALIGNN76,77, CGCNN143, SchNet142, AtomVision144,

  

ChemNLP145, DimeNet+197,198, CHGNet130, M3GNET92

,

 

kgcnn_coGN73, Potnet74, Matformer75

 

Transformers

OPT146, GPT30, T5147

FF

LJ119

LAMMPS131 (2D-Liquid)

 

EAM117

LAMMPS131 (FCC-Al)

 

REBO120

LAMMPS131 (Diamond-Si)

 

AMBER99sb-ildn199

GROMACS200 (Alanine dipeptide)

 

CHARMM36m137

GROMACS200 (α-aminoisobutyric acid)

QC

Algorithms

Qiskit96 (VQE153, VQD154)

  

PennyLane157,158 (VQE153, VQD154)

 

Circuits

Qiskit96 (PauliTwo Design96, SU(2)96)

EXP

Diffraction

XRD (Bruker D8)

 

Manometry

CO2 adsorption FACT lab95

 

Vibroscopy

Kevlar FAVIMAT168

 

Magnetometry

Susceptibility (PPMS)168

  1. More details can be found in the individual metadata.json file. Note that the number of methods is continuously growing.