Text Generation
PEFT
Safetensors
English
llama-factory
lora
dpo
rlaif
emotional-intelligence
gemma
Generated from Trainer
conversational
Instructions to use mario-rc/emotional-rlaif-dpo-gemma-2-9b-it with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use mario-rc/emotional-rlaif-dpo-gemma-2-9b-it with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("google/gemma-2-9b-it") model = PeftModel.from_pretrained(base_model, "mario-rc/emotional-rlaif-dpo-gemma-2-9b-it") - Notebooks
- Google Colab
- Kaggle
Standardize License section while preserving base-model requirements
Browse files- NOTICE +2 -0
- README.md +3 -1
- SHA256SUMS +2 -2
NOTICE
CHANGED
|
@@ -1,3 +1,5 @@
|
|
|
|
|
|
|
|
| 1 |
Emotional RLAIF adapter by mario-rc, 2026.
|
| 2 |
Base model: google/gemma-2-9b-it.
|
| 3 |
Modifications: matching SFT followed by DPO LoRA fine-tuning; base weights are not redistributed.
|
|
|
|
| 1 |
+
Gemma is provided under and subject to the Gemma Terms of Use found at ai.google.dev/gemma/terms
|
| 2 |
+
|
| 3 |
Emotional RLAIF adapter by mario-rc, 2026.
|
| 4 |
Base model: google/gemma-2-9b-it.
|
| 5 |
Modifications: matching SFT followed by DPO LoRA fine-tuning; base weights are not redistributed.
|
README.md
CHANGED
|
@@ -397,4 +397,6 @@ Consider these limitations before using the model.
|
|
| 397 |
|
| 398 |
## License
|
| 399 |
|
| 400 |
-
This adapter
|
|
|
|
|
|
|
|
|
| 397 |
|
| 398 |
## License
|
| 399 |
|
| 400 |
+
This adapter is subject to the base model's **Gemma Terms of Use**. See [LICENSE](https://huggingface.co/mario-rc/emotional-rlaif-dpo-gemma-2-9b-it/blob/main/LICENSE) and [NOTICE](https://huggingface.co/mario-rc/emotional-rlaif-dpo-gemma-2-9b-it/blob/main/NOTICE) for the full terms and attribution notices.
|
| 401 |
+
|
| 402 |
+
The [Gemma Prohibited Use Policy](https://huggingface.co/mario-rc/emotional-rlaif-dpo-gemma-2-9b-it/blob/main/USE_POLICY.md) also applies. Obtain access to the gated base model and accept its terms before downloading it.
|
SHA256SUMS
CHANGED
|
@@ -1,7 +1,7 @@
|
|
| 1 |
cbe849ea2fe8c561e4a30947639341ccd1cf9de17865bb5f31452f2a108783ec .gitattributes
|
| 2 |
cc46d574aa94179f5ea81627a1ddd62c0adec118ebedae50945baf7561b9411d LICENSE
|
| 3 |
-
|
| 4 |
-
|
| 5 |
b7d0278aeb0dbde202bb6f4c8362c1ce927e52d5d47e6ae03bf26136afb90f0c USE_POLICY.md
|
| 6 |
288600284ff0a917824004fa5ff5908b6b094c73e62d75385833fba16f746444 adapter_config.json
|
| 7 |
6ba739a50256d7a882c1f75cd66075a4e1da9d6f40445edbb5c6b63af2e973c8 adapter_model.safetensors
|
|
|
|
| 1 |
cbe849ea2fe8c561e4a30947639341ccd1cf9de17865bb5f31452f2a108783ec .gitattributes
|
| 2 |
cc46d574aa94179f5ea81627a1ddd62c0adec118ebedae50945baf7561b9411d LICENSE
|
| 3 |
+
25d3b2cfe529f3a54a3dc1d3773d4fdf9cba94390ae85e568f3a6fd3100c09ac NOTICE
|
| 4 |
+
eddd60e715451da615f3db92e702a1ad1526eed95174bc42bcc4af593051678f README.md
|
| 5 |
b7d0278aeb0dbde202bb6f4c8362c1ce927e52d5d47e6ae03bf26136afb90f0c USE_POLICY.md
|
| 6 |
288600284ff0a917824004fa5ff5908b6b094c73e62d75385833fba16f746444 adapter_config.json
|
| 7 |
6ba739a50256d7a882c1f75cd66075a4e1da9d6f40445edbb5c6b63af2e973c8 adapter_model.safetensors
|