The distinction of liver lesions is critical for the accurate diagnosis and treatment of liver cancer. Here, the authors develop LiLNet, a deep learning-based system to identify focal liver lesions as well as benign and malignant liver tumours from CT images with high accuracy across multiple patient cohorts.