Which L L M
Open Source Self-Hosted Developer Tools

Whichllm

Find the best local LLM for your hardware using real benchmarks

LLM AI Developer Tools Ollama Silicon Apple Silicon CLI Local LLM Inference Benchmarks

Screenshots

A closer look at the product interface and key surfaces.

5 images

At a glance

Primary use case
Find the best local LLM for your hardware using real benchmarks
Best for
Developer Tools — LLM, AI
Stack
CLI, GGUF, HuggingFace, python
License
MIT
Maintenance
18 hours ago
Access
Open source · Self-hosted
Documentation path
https://github.com/Andyyyy64/whichllm

About this tool

Whichllm is a CLI tool that auto-detects hardware to rank top LLMs from HuggingFace. It uses recency-aware benchmarks to recommend models that perform best on your system, avoiding the pitfalls of relying solely on parameter counts.

Repository

Stars

6,804

Forks

375

Issues

10

License

MIT

Last Push

18 hours ago

Features

  • Detects local hardware capabilities including GPU and system VRAM.
  • Provides live rankings from HuggingFace based on performance quality.
  • Simulates performance on high-end GPUs before purchasing hardware.
Browse all tools

Published 4 months ago