turboquant

ShipItAndPray/mcp-turboquant

LLM quantization: convert models to GGUF, GPTQ and AWQ, recommend quantization settings, evaluate quality and push to Hugging Face Hub.

  • Local integrations

Installation, supported tools and required credentials are maintained by the project.

Project details

GitHub stars
5
Language
Python
License
MIT
Forks
1
Latest release
v1.0.07mo ago
Activity
updated 6mo ago
Platforms listed
macOS, Windows, Linux
  • gguf
  • llm
  • mcp
  • mcp-server
  • quantization
  • turboquant
First MCP server?Start with the basics
Esc

Type to search every entry. ↑↓ to move, Enter to open.