Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Buckets new
  • Docs
  • Enterprise
  • Pricing
    • Website
      • Tasks
      • HuggingChat
      • Collections
      • Languages
      • Organizations
    • Community
      • Blog
      • Posts
      • Daily Papers
      • Hardware
      • Learn
      • Discord
      • Forum
      • GitHub
    • Solutions
      • Team & Enterprise
      • Hugging Face PRO
      • Enterprise Support
      • Inference Providers
      • Inference Endpoints
      • Storage Buckets

  • Log In
  • Sign Up
thesven 's Collections
Datasets
Finetune
GPTQ Quants
GGUF Quants
AWQ Quants

GGUF Quants

updated Sep 13, 2024

Models that have been quantized

Upvote
-

  • thesven/Hermes-2-Theta-Llama-3-8B-GGUF

    8B • Updated May 22, 2024 • 72

  • thesven/microsoft_WizardLM-2-7B-GGUF

    7B • Updated May 25, 2024 • 106

  • thesven/Aether-Qwen2-0.5B-SFT-v0.0.2-GGUF

    0.5B • Updated Jun 13, 2024 • 62

  • thesven/Llama-3-Refueled-GGUF

    8B • Updated May 22, 2024 • 150

  • thesven/Phi-3-medium-128k-instruct-GGUF

    Text Generation • 14B • Updated May 22, 2024 • 59 • 1

  • thesven/Yi-1.5-9B-Chat-GGUF

    9B • Updated May 24, 2024 • 27

  • thesven/Mistral-7B-Instruct-v0.3-GGUF

    Updated May 24, 2024 • 101 • 1

  • thesven/SFR-Iterative-DPO-LLaMA-3-8B-R-GGUF

    8B • Updated Jul 8, 2024 • 8 • 1

  • thesven/Qwen1.5-0.5B-Chat-GGUF

    0.6B • Updated Jun 10, 2024 • 32

  • thesven/Qwen2-0.5B-Instruct-GGUF

    Text Generation • 0.5B • Updated Jun 7, 2024 • 48

  • thesven/Phi-3-mini-128k-instruct-GGUF

    Text Generation • Updated May 22, 2024

  • thesven/Qwen2-1.5B-Instruct-GGUF

    Text Generation • 2B • Updated Jun 7, 2024 • 30
Upvote
-
  • Collection guide
  • Browse collections
Company
TOS Privacy About Careers
Website
Models Datasets Spaces Pricing Docs