---
license: other
language:
- en
base_model:
- meta-llama/Llama-3.1-8B
new_version: shiv1119/ollama-model-shiv
pipeline_tag: text-generation
tags:
- ollama
- local-llm
- docker
- offline
- shiv
---
# 🦙 Shiv's Custom Local LLM (Ollama Ready)

Welcome to **`ollama-model-shiv`**, a custom-built local language model designed to run **completely offline** using [Ollama](https://ollama.com/). This repo packages everything — from `Modelfile` to model blobs — ready for Docker-based deployment and local inference.

---
## Link to model - https://huggingface.co/shiv1119/ollama-model-shiv

## 📁 Directory Structure

OllamaModelBuild/
├── model_test.py # Sample Python script to interact with the model
├── .gitattributes # Git LFS or text handling config
├── ollama_clean/
│ ├── docker-compose.yml # Docker config to run Ollama with this model
│ ├── Modelfile # Ollama build instructions
│ └── models/ # Model weights & metadata
│ ├── blobs/ # Binary blobs of the model
│ └── manifests/ # Manifest describing model structure


---

## 🚀 Features

- ✅ 100% Offline — No internet or API key needed
- 🐋 Docker-ready with `docker-compose.yml`
- ⚡ Works with [Ollama CLI](https://ollama.com)
- 🔁 Full model reproducibility via blobs and manifests
- 🧠 Based on `LLaMA2` / open-weight LLM architecture

---

## 🛠️ Getting Started

### 🔧 1. Install Prerequisites

- [Install Docker](https://docs.docker.com/get-docker/)
- (Optional) [Install Ollama CLI](https://ollama.com/download) — used during build

### 🐋 2. Run the Model Using Docker

In the root of the project:

```bash
cd ollama_clean
docker-compose up --build
```

This builds and runs the model container locally with your custom blobs and Modelfile.
🧪 Test the Model (Optional)
```bash
docker-compose exec ollama ollama run tinyllama "Hello"
```
Use the included Python script to test interaction:

python model_test.py

Customize it to query your local Ollama model running at http://localhost:11434.
🧰 Model Components

    Modelfile: Blueprint for Ollama to build the model

    blobs/: Raw model weights

    manifests/: Metadata describing model format/version

    docker-compose.yml: Encapsulates build/run config

🧠 About Ollama

    Ollama makes it simple to run LLMs locally on your own machine — private, fast, and API-free.

📦 Repo Purpose

This repository was created to:

    Host a working local LLM solution

    Enable offline inference

    Serve as a template for packaging custom models with Ollama

📜 License

This repo is for educational/research purposes only. Please ensure you comply with the license of any base models used (e.g., LLaMA2, Mistral, etc.).
🙌 Credits

Crafted with ❤️ by Shiv Nandan Verma