Instructions to use Apel-sin/llama-3-NeuralDaredevil-8B-abliterated-exl2 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use Apel-sin/llama-3-NeuralDaredevil-8B-abliterated-exl2 with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("Apel-sin/llama-3-NeuralDaredevil-8B-abliterated-exl2", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Update README.md
Browse files
README.md
CHANGED
|
@@ -14,7 +14,6 @@ Original model: <a href="https://huggingface.co/mlabonne/NeuralDaredevil-8B-abli
|
|
| 14 |
Calibration dataset: <a href="https://huggingface.co/datasets/cosmicvalor/toxic-qna">toxic-qna</a>
|
| 15 |
|
| 16 |
## Available sizes
|
| 17 |
-
|
| 18 |
| Branch | Bits | lm_head bits | Description |
|
| 19 |
| ----- | ---- | ------- | ------------ |
|
| 20 |
| [8_0](https://huggingface.co/Apel-sin/llama-3-NeuralDaredevil-8B-abliterated-exl2/tree/8_0) | 8.0 | 8.0 | Maximum quality that ExLlamaV2 can produce, near unquantized performance. |
|
|
|
|
| 14 |
Calibration dataset: <a href="https://huggingface.co/datasets/cosmicvalor/toxic-qna">toxic-qna</a>
|
| 15 |
|
| 16 |
## Available sizes
|
|
|
|
| 17 |
| Branch | Bits | lm_head bits | Description |
|
| 18 |
| ----- | ---- | ------- | ------------ |
|
| 19 |
| [8_0](https://huggingface.co/Apel-sin/llama-3-NeuralDaredevil-8B-abliterated-exl2/tree/8_0) | 8.0 | 8.0 | Maximum quality that ExLlamaV2 can produce, near unquantized performance. |
|