A high-throughput and memory-efficient inference and serving engine for LLMs

Inference code for Llama models

The definitive Web UI for local AI, with powerful features and easy setup.

DeepSeek Coder: Let the Code Write Itself

Inference code for CodeLlama models

A neurosymbolic perspective on LLMs