Instructions to use ekoahamdutivnasti/VRINDA with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use ekoahamdutivnasti/VRINDA with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="ekoahamdutivnasti/VRINDA", trust_remote_code=True)
messages = [
    {"role": "user", "content": "Who are you?"},
]
pipe(messages)

# Load model directly
from transformers import AutoModelForCausalLM
model = AutoModelForCausalLM.from_pretrained("ekoahamdutivnasti/VRINDA", trust_remote_code=True, dtype="auto")

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use ekoahamdutivnasti/VRINDA with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "ekoahamdutivnasti/VRINDA"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "ekoahamdutivnasti/VRINDA",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker

docker model run hf.co/ekoahamdutivnasti/VRINDA

SGLang

How to use ekoahamdutivnasti/VRINDA with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "ekoahamdutivnasti/VRINDA" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "ekoahamdutivnasti/VRINDA",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "ekoahamdutivnasti/VRINDA" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "ekoahamdutivnasti/VRINDA",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Docker Model Runner
How to use ekoahamdutivnasti/VRINDA with Docker Model Runner:
```
docker model run hf.co/ekoahamdutivnasti/VRINDA
```

VRINDA / LICENSE

ekoahamdutivnasti

Upload VRINDA-8B merged model

2aed84b verified 6 months ago

raw

history blame contribute delete

1.98 kB

	VRINDA PROPRIETARY LICENSE
	Version 1.0, December 2024

	Copyright (c) 2024 Navneet Singh. All rights reserved.

	TERMS AND CONDITIONS

	1. OWNERSHIP
	VRINDA-8B is the exclusive property of Navneet Singh.
	All rights not explicitly granted are reserved.

	2. PERMITTED USE
	You MAY:
	a) Use the Model for personal, non-commercial purposes only
	b) Run inference for your own private use
	c) Evaluate the Model for research purposes

	3. PROHIBITED ACTIONS
	You MAY NOT:
	a) Sell, sublicense, or commercially exploit the Model
	b) Modify, fine-tune, or create derivative works
	c) Redistribute, share, or transfer the Model to others
	d) Use the Model to train other AI models
	e) Reverse engineer or extract components from the Model
	f) Remove or alter any proprietary notices
	g) Use the Model in any product or service without written permission
	h) Host the Model on any platform without authorization

	4. COMMERCIAL USE
	ANY commercial use requires explicit written permission from Navneet Singh.
	Contact: navneetsingh.dev@gmail.com

	5. NO MODIFICATIONS
	The Model must be used as-is. Any modification, fine-tuning,
	or adaptation is strictly prohibited without written consent.

	6. NO REDISTRIBUTION
	You may not distribute, publish, or share the Model weights,
	in whole or in part, through any means.

	7. ACCESS CONTROL
	Access is granted on a per-user basis and is non-transferable.
	Sharing access credentials is prohibited.

	8. TERMINATION
	This license terminates immediately upon any violation.
	Upon termination, you must delete all copies of the Model.

	9. DISCLAIMER
	THE MODEL IS PROVIDED "AS IS" WITHOUT WARRANTY OF ANY KIND.
	THE AUTHOR SHALL NOT BE LIABLE FOR ANY DAMAGES ARISING FROM USE.

	10. ENFORCEMENT
	Violations may result in legal action. This Agreement shall be
	governed by the laws of India.

	By accessing VRINDA-8B, you agree to these terms.

	For permissions: navneetsingh.dev@gmail.com