Instructions to use TorpedoSoftware/Gemma-3-27B-Roblox-Luau with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use TorpedoSoftware/Gemma-3-27B-Roblox-Luau with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf TorpedoSoftware/Gemma-3-27B-Roblox-Luau:Q4_K_M # Run inference directly in the terminal: llama cli -hf TorpedoSoftware/Gemma-3-27B-Roblox-Luau:Q4_K_M
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf TorpedoSoftware/Gemma-3-27B-Roblox-Luau:Q4_K_M # Run inference directly in the terminal: llama cli -hf TorpedoSoftware/Gemma-3-27B-Roblox-Luau:Q4_K_M
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf TorpedoSoftware/Gemma-3-27B-Roblox-Luau:Q4_K_M # Run inference directly in the terminal: ./llama-cli -hf TorpedoSoftware/Gemma-3-27B-Roblox-Luau:Q4_K_M
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf TorpedoSoftware/Gemma-3-27B-Roblox-Luau:Q4_K_M # Run inference directly in the terminal: ./build/bin/llama-cli -hf TorpedoSoftware/Gemma-3-27B-Roblox-Luau:Q4_K_M
Use Docker
docker model run hf.co/TorpedoSoftware/Gemma-3-27B-Roblox-Luau:Q4_K_M
- LM Studio
- Jan
- vLLM
How to use TorpedoSoftware/Gemma-3-27B-Roblox-Luau with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "TorpedoSoftware/Gemma-3-27B-Roblox-Luau" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "TorpedoSoftware/Gemma-3-27B-Roblox-Luau", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/TorpedoSoftware/Gemma-3-27B-Roblox-Luau:Q4_K_M
- Ollama
How to use TorpedoSoftware/Gemma-3-27B-Roblox-Luau with Ollama:
ollama run hf.co/TorpedoSoftware/Gemma-3-27B-Roblox-Luau:Q4_K_M
- Unsloth Desktop
- Docker Model Runner
How to use TorpedoSoftware/Gemma-3-27B-Roblox-Luau with Docker Model Runner:
docker model run hf.co/TorpedoSoftware/Gemma-3-27B-Roblox-Luau:Q4_K_M
- Lemonade
How to use TorpedoSoftware/Gemma-3-27B-Roblox-Luau with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull TorpedoSoftware/Gemma-3-27B-Roblox-Luau:Q4_K_M
Run and chat with the model
lemonade run user.Gemma-3-27B-Roblox-Luau-Q4_K_M
List all available models
lemonade list
- Atomic Chat
Download .gitignore from TorpedoSoftware/Gemma-3-27B-Roblox-Luau: direct link, hf CLI and curl.
- Browser
- Download file 3.42 kB
-
https://huggingface.co/TorpedoSoftware/Gemma-3-27B-Roblox-Luau/resolve/f8d9d0368dba51259a4ed26c36631f61a6cef64b/.gitignore
- Command line
-
hf download hf://TorpedoSoftware/Gemma-3-27B-Roblox-Luau@f8d9d0368dba51259a4ed26c36631f61a6cef64b/.gitignore
-
curl -L -o .gitignore https://huggingface.co/TorpedoSoftware/Gemma-3-27B-Roblox-Luau/resolve/f8d9d0368dba51259a4ed26c36631f61a6cef64b/.gitignore
3.42 kB
| cache/ | |
| # Byte-compiled / optimized / DLL files | |
| __pycache__/ | |
| *.py[cod] | |
| *$py.class | |
| # C extensions | |
| *.so | |
| # Distribution / packaging | |
| .Python | |
| build/ | |
| develop-eggs/ | |
| dist/ | |
| downloads/ | |
| eggs/ | |
| .eggs/ | |
| lib/ | |
| lib64/ | |
| parts/ | |
| sdist/ | |
| var/ | |
| wheels/ | |
| share/python-wheels/ | |
| *.egg-info/ | |
| .installed.cfg | |
| *.egg | |
| MANIFEST | |
| # PyInstaller | |
| # Usually these files are written by a python script from a template | |
| # before PyInstaller builds the exe, so as to inject date/other infos into it. | |
| *.manifest | |
| *.spec | |
| # Installer logs | |
| pip-log.txt | |
| pip-delete-this-directory.txt | |
| # Unit test / coverage reports | |
| htmlcov/ | |
| .tox/ | |
| .nox/ | |
| .coverage | |
| .coverage.* | |
| .cache | |
| nosetests.xml | |
| coverage.xml | |
| *.cover | |
| *.py,cover | |
| .hypothesis/ | |
| .pytest_cache/ | |
| cover/ | |
| # Translations | |
| *.mo | |
| *.pot | |
| # Django stuff: | |
| *.log | |
| local_settings.py | |
| db.sqlite3 | |
| db.sqlite3-journal | |
| # Flask stuff: | |
| instance/ | |
| .webassets-cache | |
| # Scrapy stuff: | |
| .scrapy | |
| # Sphinx documentation | |
| docs/_build/ | |
| # PyBuilder | |
| .pybuilder/ | |
| target/ | |
| # Jupyter Notebook | |
| .ipynb_checkpoints | |
| # IPython | |
| profile_default/ | |
| ipython_config.py | |
| # pyenv | |
| # For a library or package, you might want to ignore these files since the code is | |
| # intended to run in multiple environments; otherwise, check them in: | |
| # .python-version | |
| # pipenv | |
| # According to pypa/pipenv#598, it is recommended to include Pipfile.lock in version control. | |
| # However, in case of collaboration, if having platform-specific dependencies or dependencies | |
| # having no cross-platform support, pipenv may install dependencies that don't work, or not | |
| # install all needed dependencies. | |
| #Pipfile.lock | |
| # UV | |
| # Similar to Pipfile.lock, it is generally recommended to include uv.lock in version control. | |
| # This is especially recommended for binary packages to ensure reproducibility, and is more | |
| # commonly ignored for libraries. | |
| #uv.lock | |
| # poetry | |
| # Similar to Pipfile.lock, it is generally recommended to include poetry.lock in version control. | |
| # This is especially recommended for binary packages to ensure reproducibility, and is more | |
| # commonly ignored for libraries. | |
| # https://python-poetry.org/docs/basic-usage/#commit-your-poetrylock-file-to-version-control | |
| #poetry.lock | |
| # pdm | |
| # Similar to Pipfile.lock, it is generally recommended to include pdm.lock in version control. | |
| #pdm.lock | |
| # pdm stores project-wide configurations in .pdm.toml, but it is recommended to not include it | |
| # in version control. | |
| # https://pdm.fming.dev/latest/usage/project/#working-with-version-control | |
| .pdm.toml | |
| .pdm-python | |
| .pdm-build/ | |
| # PEP 582; used by e.g. github.com/David-OConnor/pyflow and github.com/pdm-project/pdm | |
| __pypackages__/ | |
| # Celery stuff | |
| celerybeat-schedule | |
| celerybeat.pid | |
| # SageMath parsed files | |
| *.sage.py | |
| # Environments | |
| .env | |
| .venv | |
| env/ | |
| venv/ | |
| ENV/ | |
| env.bak/ | |
| venv.bak/ | |
| # Spyder project settings | |
| .spyderproject | |
| .spyproject | |
| # Rope project settings | |
| .ropeproject | |
| # mkdocs documentation | |
| /site | |
| # mypy | |
| .mypy_cache/ | |
| .dmypy.json | |
| dmypy.json | |
| # Pyre type checker | |
| .pyre/ | |
| # pytype static type analyzer | |
| .pytype/ | |
| # Cython debug symbols | |
| cython_debug/ | |
| # PyCharm | |
| # JetBrains specific template is maintained in a separate JetBrains.gitignore that can | |
| # be found at https://github.com/github/gitignore/blob/main/Global/JetBrains.gitignore | |
| # and can be added to the global gitignore or merged into this file. For a more nuclear | |
| # option (not recommended) you can uncomment the following to ignore the entire idea folder. | |
| #.idea/ | |
| # PyPI configuration file | |
| .pypirc | |