Dhruv et al. introduce LLaMat, a family of LLMs for materials science, showing how specialized training enables smaller models to surpass larger general LLMs. The study reveals that extensively pretrained models like LLaMA-3 adapt less effectively than LLaMA-2 to new scientific domains.
- Dhruv Ahlawat
- Vaibhav Mishra
- N. M. Anoop Krishnan
