All-polymer solar cells have shown high efficiencies but the ultrafast charge transfer processes are less known. Here Wang et al. show that polaron pairs play vital role facilitating the hole transfer, which is quite different from the exciton dominated pathway in polymer-fullerene blends.