Instructions to use Felladrin/gguf-sharded-OLMo-7B-Instruct with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- llama-cpp-python
How to use Felladrin/gguf-sharded-OLMo-7B-Instruct with llama-cpp-python:
# !pip install llama-cpp-python from llama_cpp import Llama llm = Llama.from_pretrained( repo_id="Felladrin/gguf-sharded-OLMo-7B-Instruct", filename="OLMo-7B-Instruct-Q4_0.shard-00001-of-00034.gguf", )
llm.create_chat_completion( messages = "No input example has been defined for this model task." )
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use Felladrin/gguf-sharded-OLMo-7B-Instruct with llama.cpp:
Install from brew
brew install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama-server -hf Felladrin/gguf-sharded-OLMo-7B-Instruct:Q4_K_M # Run inference directly in the terminal: llama-cli -hf Felladrin/gguf-sharded-OLMo-7B-Instruct:Q4_K_M
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama-server -hf Felladrin/gguf-sharded-OLMo-7B-Instruct:Q4_K_M # Run inference directly in the terminal: llama-cli -hf Felladrin/gguf-sharded-OLMo-7B-Instruct:Q4_K_M
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf Felladrin/gguf-sharded-OLMo-7B-Instruct:Q4_K_M # Run inference directly in the terminal: ./llama-cli -hf Felladrin/gguf-sharded-OLMo-7B-Instruct:Q4_K_M
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf Felladrin/gguf-sharded-OLMo-7B-Instruct:Q4_K_M # Run inference directly in the terminal: ./build/bin/llama-cli -hf Felladrin/gguf-sharded-OLMo-7B-Instruct:Q4_K_M
Use Docker
docker model run hf.co/Felladrin/gguf-sharded-OLMo-7B-Instruct:Q4_K_M
- LM Studio
- Jan
- Ollama
How to use Felladrin/gguf-sharded-OLMo-7B-Instruct with Ollama:
ollama run hf.co/Felladrin/gguf-sharded-OLMo-7B-Instruct:Q4_K_M
- Unsloth Studio
How to use Felladrin/gguf-sharded-OLMo-7B-Instruct with Unsloth Studio:
Install Unsloth Studio (macOS, Linux, WSL)
curl -fsSL https://unsloth.ai/install.sh | sh # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for Felladrin/gguf-sharded-OLMo-7B-Instruct to start chatting
Install Unsloth Studio (Windows)
irm https://unsloth.ai/install.ps1 | iex # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for Felladrin/gguf-sharded-OLMo-7B-Instruct to start chatting
Using HuggingFace Spaces for Unsloth
# No setup required # Open https://huggingface.co/spaces/unsloth/studio in your browser # Search for Felladrin/gguf-sharded-OLMo-7B-Instruct to start chatting
- Atomic Chat new
- Docker Model Runner
How to use Felladrin/gguf-sharded-OLMo-7B-Instruct with Docker Model Runner:
docker model run hf.co/Felladrin/gguf-sharded-OLMo-7B-Instruct:Q4_K_M
- Lemonade
How to use Felladrin/gguf-sharded-OLMo-7B-Instruct with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull Felladrin/gguf-sharded-OLMo-7B-Instruct:Q4_K_M
Run and chat with the model
lemonade run user.gguf-sharded-OLMo-7B-Instruct-Q4_K_M
List all available models
lemonade list
Upload 35 files
Browse files- .gitattributes +35 -0
- OLMo-7B-Instruct-Q4_K_M.shard-00001-of-00035.gguf +3 -0
- OLMo-7B-Instruct-Q4_K_M.shard-00002-of-00035.gguf +3 -0
- OLMo-7B-Instruct-Q4_K_M.shard-00003-of-00035.gguf +3 -0
- OLMo-7B-Instruct-Q4_K_M.shard-00004-of-00035.gguf +3 -0
- OLMo-7B-Instruct-Q4_K_M.shard-00005-of-00035.gguf +3 -0
- OLMo-7B-Instruct-Q4_K_M.shard-00006-of-00035.gguf +3 -0
- OLMo-7B-Instruct-Q4_K_M.shard-00007-of-00035.gguf +3 -0
- OLMo-7B-Instruct-Q4_K_M.shard-00008-of-00035.gguf +3 -0
- OLMo-7B-Instruct-Q4_K_M.shard-00009-of-00035.gguf +3 -0
- OLMo-7B-Instruct-Q4_K_M.shard-00010-of-00035.gguf +3 -0
- OLMo-7B-Instruct-Q4_K_M.shard-00011-of-00035.gguf +3 -0
- OLMo-7B-Instruct-Q4_K_M.shard-00012-of-00035.gguf +3 -0
- OLMo-7B-Instruct-Q4_K_M.shard-00013-of-00035.gguf +3 -0
- OLMo-7B-Instruct-Q4_K_M.shard-00014-of-00035.gguf +3 -0
- OLMo-7B-Instruct-Q4_K_M.shard-00015-of-00035.gguf +3 -0
- OLMo-7B-Instruct-Q4_K_M.shard-00016-of-00035.gguf +3 -0
- OLMo-7B-Instruct-Q4_K_M.shard-00017-of-00035.gguf +3 -0
- OLMo-7B-Instruct-Q4_K_M.shard-00018-of-00035.gguf +3 -0
- OLMo-7B-Instruct-Q4_K_M.shard-00019-of-00035.gguf +3 -0
- OLMo-7B-Instruct-Q4_K_M.shard-00020-of-00035.gguf +3 -0
- OLMo-7B-Instruct-Q4_K_M.shard-00021-of-00035.gguf +3 -0
- OLMo-7B-Instruct-Q4_K_M.shard-00022-of-00035.gguf +3 -0
- OLMo-7B-Instruct-Q4_K_M.shard-00023-of-00035.gguf +3 -0
- OLMo-7B-Instruct-Q4_K_M.shard-00024-of-00035.gguf +3 -0
- OLMo-7B-Instruct-Q4_K_M.shard-00025-of-00035.gguf +3 -0
- OLMo-7B-Instruct-Q4_K_M.shard-00026-of-00035.gguf +3 -0
- OLMo-7B-Instruct-Q4_K_M.shard-00027-of-00035.gguf +3 -0
- OLMo-7B-Instruct-Q4_K_M.shard-00028-of-00035.gguf +3 -0
- OLMo-7B-Instruct-Q4_K_M.shard-00029-of-00035.gguf +3 -0
- OLMo-7B-Instruct-Q4_K_M.shard-00030-of-00035.gguf +3 -0
- OLMo-7B-Instruct-Q4_K_M.shard-00031-of-00035.gguf +3 -0
- OLMo-7B-Instruct-Q4_K_M.shard-00032-of-00035.gguf +3 -0
- OLMo-7B-Instruct-Q4_K_M.shard-00033-of-00035.gguf +3 -0
- OLMo-7B-Instruct-Q4_K_M.shard-00034-of-00035.gguf +3 -0
- OLMo-7B-Instruct-Q4_K_M.shard-00035-of-00035.gguf +3 -0
.gitattributes
CHANGED
|
@@ -67,3 +67,38 @@ OLMo-7B-Instruct-Q4_K_S.shard-00031-of-00034.gguf filter=lfs diff=lfs merge=lfs
|
|
| 67 |
OLMo-7B-Instruct-Q4_K_S.shard-00032-of-00034.gguf filter=lfs diff=lfs merge=lfs -text
|
| 68 |
OLMo-7B-Instruct-Q4_K_S.shard-00033-of-00034.gguf filter=lfs diff=lfs merge=lfs -text
|
| 69 |
OLMo-7B-Instruct-Q4_K_S.shard-00034-of-00034.gguf filter=lfs diff=lfs merge=lfs -text
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 67 |
OLMo-7B-Instruct-Q4_K_S.shard-00032-of-00034.gguf filter=lfs diff=lfs merge=lfs -text
|
| 68 |
OLMo-7B-Instruct-Q4_K_S.shard-00033-of-00034.gguf filter=lfs diff=lfs merge=lfs -text
|
| 69 |
OLMo-7B-Instruct-Q4_K_S.shard-00034-of-00034.gguf filter=lfs diff=lfs merge=lfs -text
|
| 70 |
+
OLMo-7B-Instruct-Q4_K_M.shard-00001-of-00035.gguf filter=lfs diff=lfs merge=lfs -text
|
| 71 |
+
OLMo-7B-Instruct-Q4_K_M.shard-00002-of-00035.gguf filter=lfs diff=lfs merge=lfs -text
|
| 72 |
+
OLMo-7B-Instruct-Q4_K_M.shard-00003-of-00035.gguf filter=lfs diff=lfs merge=lfs -text
|
| 73 |
+
OLMo-7B-Instruct-Q4_K_M.shard-00004-of-00035.gguf filter=lfs diff=lfs merge=lfs -text
|
| 74 |
+
OLMo-7B-Instruct-Q4_K_M.shard-00005-of-00035.gguf filter=lfs diff=lfs merge=lfs -text
|
| 75 |
+
OLMo-7B-Instruct-Q4_K_M.shard-00006-of-00035.gguf filter=lfs diff=lfs merge=lfs -text
|
| 76 |
+
OLMo-7B-Instruct-Q4_K_M.shard-00007-of-00035.gguf filter=lfs diff=lfs merge=lfs -text
|
| 77 |
+
OLMo-7B-Instruct-Q4_K_M.shard-00008-of-00035.gguf filter=lfs diff=lfs merge=lfs -text
|
| 78 |
+
OLMo-7B-Instruct-Q4_K_M.shard-00009-of-00035.gguf filter=lfs diff=lfs merge=lfs -text
|
| 79 |
+
OLMo-7B-Instruct-Q4_K_M.shard-00010-of-00035.gguf filter=lfs diff=lfs merge=lfs -text
|
| 80 |
+
OLMo-7B-Instruct-Q4_K_M.shard-00011-of-00035.gguf filter=lfs diff=lfs merge=lfs -text
|
| 81 |
+
OLMo-7B-Instruct-Q4_K_M.shard-00012-of-00035.gguf filter=lfs diff=lfs merge=lfs -text
|
| 82 |
+
OLMo-7B-Instruct-Q4_K_M.shard-00013-of-00035.gguf filter=lfs diff=lfs merge=lfs -text
|
| 83 |
+
OLMo-7B-Instruct-Q4_K_M.shard-00014-of-00035.gguf filter=lfs diff=lfs merge=lfs -text
|
| 84 |
+
OLMo-7B-Instruct-Q4_K_M.shard-00015-of-00035.gguf filter=lfs diff=lfs merge=lfs -text
|
| 85 |
+
OLMo-7B-Instruct-Q4_K_M.shard-00016-of-00035.gguf filter=lfs diff=lfs merge=lfs -text
|
| 86 |
+
OLMo-7B-Instruct-Q4_K_M.shard-00017-of-00035.gguf filter=lfs diff=lfs merge=lfs -text
|
| 87 |
+
OLMo-7B-Instruct-Q4_K_M.shard-00018-of-00035.gguf filter=lfs diff=lfs merge=lfs -text
|
| 88 |
+
OLMo-7B-Instruct-Q4_K_M.shard-00019-of-00035.gguf filter=lfs diff=lfs merge=lfs -text
|
| 89 |
+
OLMo-7B-Instruct-Q4_K_M.shard-00020-of-00035.gguf filter=lfs diff=lfs merge=lfs -text
|
| 90 |
+
OLMo-7B-Instruct-Q4_K_M.shard-00021-of-00035.gguf filter=lfs diff=lfs merge=lfs -text
|
| 91 |
+
OLMo-7B-Instruct-Q4_K_M.shard-00022-of-00035.gguf filter=lfs diff=lfs merge=lfs -text
|
| 92 |
+
OLMo-7B-Instruct-Q4_K_M.shard-00023-of-00035.gguf filter=lfs diff=lfs merge=lfs -text
|
| 93 |
+
OLMo-7B-Instruct-Q4_K_M.shard-00024-of-00035.gguf filter=lfs diff=lfs merge=lfs -text
|
| 94 |
+
OLMo-7B-Instruct-Q4_K_M.shard-00025-of-00035.gguf filter=lfs diff=lfs merge=lfs -text
|
| 95 |
+
OLMo-7B-Instruct-Q4_K_M.shard-00026-of-00035.gguf filter=lfs diff=lfs merge=lfs -text
|
| 96 |
+
OLMo-7B-Instruct-Q4_K_M.shard-00027-of-00035.gguf filter=lfs diff=lfs merge=lfs -text
|
| 97 |
+
OLMo-7B-Instruct-Q4_K_M.shard-00028-of-00035.gguf filter=lfs diff=lfs merge=lfs -text
|
| 98 |
+
OLMo-7B-Instruct-Q4_K_M.shard-00029-of-00035.gguf filter=lfs diff=lfs merge=lfs -text
|
| 99 |
+
OLMo-7B-Instruct-Q4_K_M.shard-00030-of-00035.gguf filter=lfs diff=lfs merge=lfs -text
|
| 100 |
+
OLMo-7B-Instruct-Q4_K_M.shard-00031-of-00035.gguf filter=lfs diff=lfs merge=lfs -text
|
| 101 |
+
OLMo-7B-Instruct-Q4_K_M.shard-00032-of-00035.gguf filter=lfs diff=lfs merge=lfs -text
|
| 102 |
+
OLMo-7B-Instruct-Q4_K_M.shard-00033-of-00035.gguf filter=lfs diff=lfs merge=lfs -text
|
| 103 |
+
OLMo-7B-Instruct-Q4_K_M.shard-00034-of-00035.gguf filter=lfs diff=lfs merge=lfs -text
|
| 104 |
+
OLMo-7B-Instruct-Q4_K_M.shard-00035-of-00035.gguf filter=lfs diff=lfs merge=lfs -text
|
OLMo-7B-Instruct-Q4_K_M.shard-00001-of-00035.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:0aa658e6efa00cb266f1dd570b0d26862ec7ffbdd7b8f249f33f64696e1ebdbc
|
| 3 |
+
size 117669696
|
OLMo-7B-Instruct-Q4_K_M.shard-00002-of-00035.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:7fe7cc59acb349b1312ccc51bd15d25ab87abfd512c901a0916d9acbbb52c436
|
| 3 |
+
size 129786400
|
OLMo-7B-Instruct-Q4_K_M.shard-00003-of-00035.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:79431990f80027c8b20114a6ebad5329b215c52178022d984bf202e24ce412d0
|
| 3 |
+
size 129786400
|
OLMo-7B-Instruct-Q4_K_M.shard-00004-of-00035.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:7ca945a80df4a876ba2ea21a693a49c0d7753704ee5ececcbd03179f244c6d88
|
| 3 |
+
size 129786400
|
OLMo-7B-Instruct-Q4_K_M.shard-00005-of-00035.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:9608add6cce864a612fd05a19b672680302c98f081d6e578f822ebd54a9a6a5c
|
| 3 |
+
size 129786400
|
OLMo-7B-Instruct-Q4_K_M.shard-00006-of-00035.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:0a1c57d12272500031f38c422d0f8bc5fa79ca9a12bc6ca13d1471691a74d48e
|
| 3 |
+
size 123273824
|
OLMo-7B-Instruct-Q4_K_M.shard-00007-of-00035.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:9fd4e6b0fe64385ecfa6a28cf28640b93005a7920b431553a959c1a7da991d99
|
| 3 |
+
size 132711072
|
OLMo-7B-Instruct-Q4_K_M.shard-00008-of-00035.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:2382fc1c4e8dc6d18f04e94ad1dfc2a50301ea05c7044a26361b8b1b584291f7
|
| 3 |
+
size 129786400
|
OLMo-7B-Instruct-Q4_K_M.shard-00009-of-00035.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:cd6690b1c235c47b81db80b7a1c2748dbbb77ad6be737c842de65f5ba3c5f8bd
|
| 3 |
+
size 113836576
|
OLMo-7B-Instruct-Q4_K_M.shard-00010-of-00035.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:bc5f457a20548d53fe85bdfd05ec02832d6567aac53db7a577c4d35909d25ee9
|
| 3 |
+
size 118161952
|
OLMo-7B-Instruct-Q4_K_M.shard-00011-of-00035.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:919afb33ad19dd1bb561b99d92daf48b7006dbf796e10003266ce34a9fa29421
|
| 3 |
+
size 125461024
|
OLMo-7B-Instruct-Q4_K_M.shard-00012-of-00035.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:9a68f754360aca1cf36e4d721cbb0d1ad74cbbb04db7c261e248a0ebcd330ad3
|
| 3 |
+
size 113836576
|
OLMo-7B-Instruct-Q4_K_M.shard-00013-of-00035.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:f9a447e3fe971c5d5136d6a546d7abb80c095f851d958a3b70558db177ccde02
|
| 3 |
+
size 122511808
|
OLMo-7B-Instruct-Q4_K_M.shard-00014-of-00035.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:286a850a680c5eff093757c8878dfe7d336be4e05240c5413342aadc22537737
|
| 3 |
+
size 118161952
|
OLMo-7B-Instruct-Q4_K_M.shard-00015-of-00035.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:7c122eda2c792b7c1e74efdc5a7edd94472d47b34c746bff46c33abaad9d238a
|
| 3 |
+
size 113836576
|
OLMo-7B-Instruct-Q4_K_M.shard-00016-of-00035.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:55ca183aed5c6751ee044b885fd0cb24df00fd67a6060285f6b737ca2f768348
|
| 3 |
+
size 125461024
|
OLMo-7B-Instruct-Q4_K_M.shard-00017-of-00035.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:4dc482756956177b40ddfe34c6b9b555fa8d0c89179037581be165ef643656b1
|
| 3 |
+
size 118161952
|
OLMo-7B-Instruct-Q4_K_M.shard-00018-of-00035.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:89a01130ca1aebdff700c9810f9f432fa30664cf0939b284877ff8fd43896198
|
| 3 |
+
size 126223072
|
OLMo-7B-Instruct-Q4_K_M.shard-00019-of-00035.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:838996521683368bbbc11ad8202ffcad42b834c7ed63604f97b84cfece24c113
|
| 3 |
+
size 113074528
|
OLMo-7B-Instruct-Q4_K_M.shard-00020-of-00035.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:1cb61dd1d54bd1861a42730d5caf8edd28ef1528b82897244d4a84154c6bb399
|
| 3 |
+
size 118161952
|
OLMo-7B-Instruct-Q4_K_M.shard-00021-of-00035.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:f6b1525c28ebc73e58d581d41852b4978cc4017dc5ed2889ec8fa6a4d9ca9832
|
| 3 |
+
size 113836576
|
OLMo-7B-Instruct-Q4_K_M.shard-00022-of-00035.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:0b5428e74dae22f0c2279e6afa86359883fb0697b3dcc0ae549e19b08b4699c8
|
| 3 |
+
size 125461024
|
OLMo-7B-Instruct-Q4_K_M.shard-00023-of-00035.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:52491f71b4ebb506c6e529ec12d7a58270095a248f0fff54b8235ce7c8356a78
|
| 3 |
+
size 118161952
|
OLMo-7B-Instruct-Q4_K_M.shard-00024-of-00035.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:d2e558edcc07c7c5c50fa522a3f3fce3031190004b616daa45d882bdab348063
|
| 3 |
+
size 126223072
|
OLMo-7B-Instruct-Q4_K_M.shard-00025-of-00035.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:8ae2738db71f28c74130e17241dfadb3ace890e41af01cd5fb235f81c42522d0
|
| 3 |
+
size 113074528
|
OLMo-7B-Instruct-Q4_K_M.shard-00026-of-00035.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:09c8fd3ff544568206b8a4aeb65d6f84e5606922553cb4f9bfb43fb7ba7d9601
|
| 3 |
+
size 118161952
|
OLMo-7B-Instruct-Q4_K_M.shard-00027-of-00035.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:ebca7cf29a7f6045a397f54c37a94ac9e33f8f1644ee551cca766b4e69d931be
|
| 3 |
+
size 113836576
|
OLMo-7B-Instruct-Q4_K_M.shard-00028-of-00035.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:9dbef8c6e34869c43b453b8745015115355b4efdf3007647fc948bbfddd3e691
|
| 3 |
+
size 125461024
|
OLMo-7B-Instruct-Q4_K_M.shard-00029-of-00035.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:cfff35a0187bbbbcbf6ba48dbb815e7f8816bc789d4af4e0b6d7cff028d488cf
|
| 3 |
+
size 129786400
|
OLMo-7B-Instruct-Q4_K_M.shard-00030-of-00035.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:559faa8bb89952e7ed7bb2536aba31bda9e12f231b88d9f14ced261b5b95c9b1
|
| 3 |
+
size 121111200
|
OLMo-7B-Instruct-Q4_K_M.shard-00031-of-00035.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:a52424813f09119d5b02a3b9404d389c078cd41159d6e1f22dc5edbddc671f9d
|
| 3 |
+
size 13762752
|
OLMo-7B-Instruct-Q4_K_M.shard-00032-of-00035.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:3491034440f4e5767f4c8d5caa970d1aae36ef38d47db935a39e9761833e614d
|
| 3 |
+
size 169021600
|
OLMo-7B-Instruct-Q4_K_M.shard-00033-of-00035.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:956437247be304cc98bb7dd65ccc5c1ff33226e5c2719f6bcbc856bbf2d81f09
|
| 3 |
+
size 124698976
|
OLMo-7B-Instruct-Q4_K_M.shard-00034-of-00035.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:56a489378516f19494cab8355433a03a5b5548b2c6cabc9b6ee9ff65921fef3e
|
| 3 |
+
size 129786400
|
OLMo-7B-Instruct-Q4_K_M.shard-00035-of-00035.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:6875f3adc36fed6fea04fbcc7121279fd18737f53e66e1e24987cc430fd21618
|
| 3 |
+
size 92799456
|