Skip to content

IBM/model-recycling

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Model Recycling

Welcome to the model recycling github. To see the best model to start from, or study the differences between finetuned models, please visit the website. Or read the paper.

Feel free to open an issue if you have any questions or suggestions.

Code

We provide code to fuse models following this paper, which offers an advancement over just intertaining. Instead of recycling one model, one can use several. The paper also explains when is it better than intertraining and when not.

Site link

To get to the site press on this sentence.

Citation

Cite information:

@article{choshen2022start,
  title={Where to start? Analyzing the potential value of intermediate models},
  author={Choshen, Leshem and Venezian, Elad and Don-Yehia, Shachar and Slonim, Noam and Katz, Yoav},
  journal={arXiv preprint arXiv:2211.00107},
  year={2022}
}

About

Ranking of fine-tuned HF models as base models.

Resources

License

Code of conduct

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Contributors 4

  •  
  •  
  •  
  •  

Languages