Hugging Face

Machine Unlearning in Small Language Models

Large language models can memorize facts during training, but removing a specific piece of knowledge after training is not straightforward. Retraining a model from scratch is …