Tools for merging pretrained large language models.
-
Updated
Sep 12, 2026 - Python
Tools for merging pretrained large language models.
Model Merging in LLMs, MLLMs, and Beyond: Methods, Theories, Applications and Opportunities. ACM Computing Surveys, 2026.
FusionBench: A Comprehensive Benchmark/Toolkit of Deep Model Fusion
[COLM 2025] LoRI: Reducing Cross-Task Interference in Multi-Task Low-Rank Adaptation
AdaMerging: Adaptive Model Merging for Multi-Task Learning. ICLR, 2024.
Flexible library for merging large language models (LLMs) via evolutionary optimization (ACL 2025 Demo).
Executable Stable Diffusion merge recipes in comfyui
A collection of weight space learning including papers, codes, and datasets.
Code release for Dataless Knowledge Fusion by Merging Weights of Language Models (https://openreview.net/forum?id=FCnohuR6AnM)
[NeurIPS'25 Spotlight🔥] Official Implementation of RobustMerge: Parameter-Efficient Model Merging for MLLMs with Direction Robustness
Official repository of "Localizing Task Information for Improved Model Merging and Compression" [ICML 2024]
Representation Surgery for Multi-Task Model Merging. ICML, 2024.
ZhiJian: A Unifying and Rapidly Deployable Toolbox for Pre-trained Model Reuse
The source code of "Merging Experts into One: Improving Computational Efficiency of Mixture of Experts (EMNLP 2023)":
[ICML 2025] No Task Left Behind: Isotropic Model Merging with Common and Task-Specific Subspaces (official repository)
Pytorch code for NeurIPS 2025 paper "Accurate and Efficient Low-Rank Model Merging in Core Space"
DELLA-Merging: Reducing Interference in Model Merging through Magnitude-Based Sampling
Model merging, task-vector rebasin, and fine-tuning for vision and LLM models.
Localize-and-Stitch: Efficient Model Merging via Sparse Task Arithmetic
To associate your repository with the model-merging topic, visit your repo's landing page and select "manage topics."