Open leaderboard that rates the energy efficiency of AI models for inference.
- Pricing
- Free
- Category
- AI Energy Monitoring
- Compliance
- Not stated
Verified 2026-10-22Website
Category
Model Efficiency
Compression, distillation, routing and scheduling tools that cut the compute needed to serve a model.
9 tools64 tools in the directory across 9 categories
Showing 9 of 9
k-bit quantization library for PyTorch that cuts LLM memory use for inference and training.
- Pricing
- Free
- Category
- Model Efficiency
- Compliance
- Not stated
Verified 2026-10-22Website
Open-source optimization toolkit for training and running transformer models efficiently.
- Pricing
- Free
- Category
- Model Efficiency
- Compliance
- Not stated
Verified 2026-10-22Website
C/C++ LLM inference with 1.5- to 8-bit quantization and broad hardware backend support.
- Pricing
- Free
- Category
- Model Efficiency
- Compliance
- Not stated
Verified 2026-10-22Website
Open-source library for quantizing and compressing LLMs for efficient vLLM deployment.
- Pricing
- Free
- Category
- Model Efficiency
- Compliance
- Not stated
Verified 2026-10-22Website
Open-source inference framework for LLM, vision-language and diffusion models.
- Pricing
- Free
- Category
- Model Efficiency
- Compliance
- Not stated
Verified 2026-10-22Website
Open-source library for optimizing LLM and visual generation inference on NVIDIA GPUs.
- Pricing
- Free
- Category
- Model Efficiency
- Compliance
- Not stated
Verified 2026-10-22Website
Rust, Python and gRPC toolkit for high-performance LLM serving with continuous batching.
- Pricing
- Free
- Category
- Model Efficiency
- Compliance
- Not stated
Verified 2026-10-22Website
Open-source LLM inference and serving library optimized for throughput.
- Pricing
- Free
- Category
- Model Efficiency
- Compliance
- Not stated
Verified 2026-10-22Website