The accumulation of myeloid derived suppressor cells (MDSC) has been associated with prostate cancer progression and castration resistance. Here the authors show that loss of ARID1A, a subunit of the SWI/SNF chromatin remodeling complex, results in polymorphonuclear-MDSC infiltration and cooperates with Pten loss to accelerate prostate tumorigenesis.