All tools › Models & AI Labs › Fireworks AI Fireworks AI Models & AI Labs Serverless LLM inference with fine-tuning, RAG support, and free credits for rapid prototyping 🌐 Visit website ↗ 🔗 More in Models & AI Labs Ollama ★ 180.2k Ollama is a CLI tool for running large language models locally, offering a simple interfac… llama.cpp ★ 127.1k llama.cpp is a C/C++ inference engine for large language models that runs on CPU, GPU, and… DeepSeek V3/R1 ★ 104.4k DeepSeek V3/R1 is a 671B-parameter mixture-of-experts model offering GPT-4-level reasoning… vLLM ★ 91.0k vLLM is a high-throughput serving engine for large language models, designed for productio… GPT4All ★ 77.4k GPT4All is an open-source local chat application that runs large language models directly … LocalAI ★ 48.9k LocalAI is a drop-in replacement for the OpenAI API that runs models locally on CPU, elimi…