Project Prometheus (Bezos)

Ollama is a CLI tool for running large language models locally, offering a simple interfac…

llama.cpp is a C/C++ inference engine for large language models that runs on CPU, GPU, and…

DeepSeek V3/R1 is a 671B-parameter mixture-of-experts model offering GPT-4-level reasoning…

vLLM is a high-throughput serving engine for large language models, designed for productio…

GPT4All is an open-source local chat application that runs large language models directly …

LocalAI is a drop-in replacement for the OpenAI API that runs models locally on CPU, elimi…