Which L L M
Open Source Self-Hosted Developer Tools

Whichllm

Find the best local LLM for your hardware using real benchmarks

LLM AI Developer Tools Ollama Silicon Apple Silicon CLI Local LLM Inference Benchmarks

Screenshots

A closer look at the product interface and key surfaces.

5 images

At a glance

Primary use case
Find the best local LLM for your hardware using real benchmarks
Best for
Developer Tools — LLM, AI
Stack
CLI, GGUF, HuggingFace, python
License
MIT
Maintenance
2 weeks ago
Access
Open source · Self-hosted
Documentation path
https://github.com/Andyyyy64/whichllm

About this tool

Whichllm is a CLI tool that auto-detects hardware to rank top LLMs from HuggingFace. It uses recency-aware benchmarks to recommend models that perform best on your system, avoiding the pitfalls of relying solely on parameter counts.

Repository

Stars

5,818

Forks

309

Issues

16

License

MIT

Last Push

2 weeks ago

Features

  • Detects local hardware capabilities including GPU and system VRAM.
  • Provides live rankings from HuggingFace based on performance quality.
  • Simulates performance on high-end GPUs before purchasing hardware.
Browse all tools

Published 1 month ago