Fig. 4: Representation shift decomposition.

Detailed analysis of the representation shift during fine-tuning across three datasets. The dashed lines (top row) correspond to the representation shift (approximated by the Rand index) for each individual channel, while the solid lines represent the overall method. The bottom row displays the optimized prompt weights distributed over channels.