llmfit
A command line tool that checks your CPU, RAM and GPU and recommends which open-source language models your machine can run comfortably.
Share on XLicense: MIT
Overview
llmfit is a command line tool written in Rust that checks your hardware and recommends which open-source language models it can run comfortably. It inspects CPU cores, system RAM, GPUs, VRAM and accelerator setup, then suggests models across common quantizations. It also has a terminal interface where you can measure real speed and submit results back to the project.
Key features
- Detects CPU, RAM, GPU, VRAM and unified memory
- Recognizes NVIDIA CUDA, Apple Silicon, AMD ROCm and Intel OneAPI
- Recommends models across popular quantizations
- Benchmarks real tokens per second from the terminal interface
- Your own measurements replace estimates in the fit table
Best for
Anyone choosing a local LLM who wants to know what fits their machine before downloading. Without a benchmark, the figures are estimates.
- Upstream
- AlexsJones/llmfit
- Fork on GitHub
- Guo-astro/llmfit
- Upstream stars
- 38k
- Category
- AI agents and LLM tools
- License
- MIT
- Forked
- 2026-02-22
- Sync status
- Diverged from upstream
More in AI agents and LLM tools
An open-source curriculum for learning AI engineering by implementing model internals, retrieval pipelines, and agent runtimes. Study through lessons, interactive labs, or staged coding projects, and inspect the code and evaluation results.
Forked 2026-10-09Last synced 2026-10-10License: MITAI agents and LLM toolsGitHub
A small, hackable character-level language model that learns patterns from line-based text files and generates similar items, such as name ideas.
Forked 2026-10-09Last synced 2026-10-10License: MITAI agents and LLM toolsGitHub
uzu is an inference engine for running AI models in apps, helping developers keep inference on-device instead of relying on remote services. Use it to download a model and build chat features.
Forked 2026-10-09Last synced 2026-10-10License: MITAI agents and LLM toolsGitHub
Anti Slop gives AI coding agents rules to avoid generic UI, filler text, and AI-shaped code. Use it as a filter alongside your own design direction.
Forked 2026-10-08Last synced 2026-10-10License: MITAI agents and LLM toolsGitHub