Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Buckets new
  • Docs
  • Enterprise
  • Pricing
    • Website
      • Tasks
      • HuggingChat
      • Collections
      • Languages
      • Organizations
    • Community
      • Blog
      • Posts
      • Daily Papers
      • Hardware
      • Learn
      • Discord
      • Forum
      • GitHub
    • Solutions
      • Team & Enterprise
      • Hugging Face PRO
      • Enterprise Support
      • Inference Providers
      • Inference Endpoints
      • Storage Buckets

  • Log In
  • Sign Up

rdtand
/
Hy3-295B-A21B-PrismaQuant-2.8bit-gguf-vllm

GGUF
quantized
mixed-precision
prismaquant
vllm
Model card Files Files and versions
xet
Community
Hy3-295B-A21B-PrismaQuant-2.8bit-gguf-vllm
104 GB
Ctrl+K
Ctrl+K
  • 1 contributor
History: 2 commits
rdtand's picture
rdtand
Add files using upload-large-folder tool
b1328a9 verified 8 days ago
  • allocation
    Add files using upload-large-folder tool 8 days ago
  • config
    Add files using upload-large-folder tool 8 days ago
  • serving
    Add files using upload-large-folder tool 8 days ago
  • .gitattributes
    1.76 kB
    Add files using upload-large-folder tool 8 days ago
  • LICENSE
    11.6 kB
    Add files using upload-large-folder tool 8 days ago
  • README.md
    3.46 kB
    Add files using upload-large-folder tool 8 days ago
  • hy3-prismaquant-2.8bpp-00001-of-00003.gguf
    44.7 GB
    xet
    Add files using upload-large-folder tool 8 days ago
  • hy3-prismaquant-2.8bpp-00002-of-00003.gguf
    44.8 GB
    xet
    Add files using upload-large-folder tool 8 days ago
  • hy3-prismaquant-2.8bpp-00003-of-00003.gguf
    14.1 GB
    xet
    Add files using upload-large-folder tool 8 days ago