File size: 1,409 Bytes
a63f335 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 | ---
license: apache-2.0
tags:
- code
- autocomplete
- next-edit
- gguf
---
# Sweep Next-Edit 1.5B (GGUF)
A 1.5B parameter model for next-edit autocomplete, quantized to Q8_0 GGUF format.
## Model Description
Sweep Next-Edit predicts your next code edit before you make it. It runs locally on your laptop in under 500ms (with speculative decoding) and outperforms models over 4x its size on next-edit benchmarks. More details [here](https://blog.sweep.dev/posts/oss-next-edit).
## Usage
Download `run_model.py` and the model file, then:
```bash
uv pip install llama-cpp-python huggingface_hub
python run_model.py
```
## Model Details
- **Format**: GGUF (Q8_0 quantization)
- **Parameters**: 1.5B
- **Context Length**: 8192 tokens
- **Base Model**: Qwen2.5-Coder
## Example
The model uses a specific prompt format with file context, recent diffs, and current state to predict the next edit. See `run_model.py` for a complete example.
## Links
- [Blog Post](https://blog.sweep.dev/posts/oss-next-edit) - Technical details and benchmarks
- [JetBrains Plugin](https://plugins.jetbrains.com/plugin/26860-sweep-ai-autocomplete--coding-agent) - Sweep AI JetBrains Plugin
- [HN Thread](https://news.ycombinator.com/item?id=46713106) - Discuss implementation for VSCode, Neovim & Emacs
- [Twitter Post](https://x.com/sweepai/status/2014045512417345883) - Ask us any other questions
## License
Apache 2.0
|