arxiv.org

Language Models are Super Mario: Absorbing Abilities from Homologous Models as a Free Lunch

In this paper, we unveil that Language Models (LMs) can acquire new capabilities by assimilating parameters from homologous models without retraining or GPUs. We first introduce DARE to set most delta