agentOps · ai

llama.cpp

1 production project and 0 rule sets built with llama.cpp.

Filter in Explore

Production projects

Local LLM Inference Engine & Hardware Profiler Hybrid Magnitude Performance-critical inference sits in a Rust workspace around vendored llama.cpp, while the app, CLI, agent and model management live in a Bun + Effect TypeScript monorepo. The native engine can be pinned and benchmarked on its own while the product layer changes quickly.

Often used with llama.cpp

Questions about llama.cpp

How many production projects use llama.cpp?

1 verified production project in the STACK IT FAST directory uses llama.cpp, each with a full architecture breakdown.

What is llama.cpp most often used with?

Across projects in the directory, llama.cpp is most commonly paired with TypeScript, Rust, Bun.