llmfit

Overview

llmfit supports 497 models from 133 providers and helps you find which large language models will run optimally on your system. It detects your RAM, CPU, and GPU, scores models across quality, speed, fit, and context, and recommends the best options. The tool includes an interactive TUI (default) and classic CLI mode, supports multi-GPU setups, MoE architectures, dynamic quantization selection, speed estimation, and local runtime providers like Ollama, llama.cpp, and MLX.

Key features

• Hardware detection
• Model scoring
• Interactive TUI
• CLI mode
• Multi-GPU support
• Dynamic quantization
• Speed estimation
• Local runtime providers