FADE TOFU Checkpoints
Collection
Checkpoints for reproducing FADE on TOFU (arXiv:2510.12981): full model, retain-only oracles, and unlearned LoRA checkpoints. • 7 items • Updated
fade-tofu-retain
Llama 3.1 8B retain-only oracles: fine-tuned identically to fade-tofu-full but excluding the corresponding forget split (retain90/retain95/retain99, 3 independently-trained seeds each). This is the "model that never saw the forget data" FADE measures distributional equivalence against.
Part of the checkpoint collection for reproducing FADE on TOFU (arXiv:2510.12981, "Reference-Specific Unlearning Metrics Can Hide the Truth: A Reality Check"). Code, training/eval scripts, and full documentation: https://github.com/sc782/fade_unlearning/tree/main/fade-tofu
Notice
Llama 3.1 is licensed under the Llama 3.1 Community License, Copyright © Meta Platforms, Inc. All Rights Reserved.
Built with Llama.
Use of this model is governed by the Llama 3.1 Community License Agreement and Meta's Acceptable Use Policy, in addition to any terms in this repository.
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support
Model tree for sungjuncho/Llama-3.1-8B-fade-tofu-retain
Base model
NousResearch/Meta-Llama-3.1-8B-Instruct