AI / LLM App Tech Stacks
LLM apps, agents, RAG, inference engines, and AI orchestration. 13 verified production examples.
AGENTS.md Rules & Agent Skills for AI / LLM App
FastAPI + Python + PostgreSQL (Async SQLAlchemy & Pydantic v2)
Production guidelines for FastAPI, Pydantic v2 validation, Async SQLAlchemy 2.0 (asyncpg), Alembic migrations, and PostgreSQL/Redis.
advancedLangGraph + Python + FastAPI (Agentic AI Workflows)
Production architecture for autonomous multi-agent systems, LangGraph cyclic state graphs, Pydantic v2 structured tool calling, and Chroma/Qdrant vector stores.
intermediateNode.js + Express + MongoDB
Production guidelines for Express REST APIs, Mongoose schema design, and MongoDB indexing/transaction discipline.
Production AI / LLM App Projects
MindsDB
Connects enterprise databases directly to AI and machine learning models using standard SQL statements. Enables developers to query, train, and orchestrate generative AI agents and predictive models directly over PostgreSQL, Snowflake, and MongoDB data sources.
vLLM
The gold standard for production LLM inference; invented PagedAttention to eliminate memory fragmentation in GPU KV caches, delivering 2x-4x throughput over standard Hugging Face runtimes.
LangChain
Industry standard for context-aware reasoning; modular chains and LangGraph cyclic graphs allow orchestrating stateful agents with deterministic fallbacks and tool execution.
LibreChat
Self-hosted AI conversation and autonomous agent workspace supporting all major LLMs (OpenAI, Anthropic, Ollama, HuggingFace). Built with Node.js Express, MongoDB for flexible conversation trees, Redis for rate limiting and streaming buffers, and a responsive React UI.
Qdrant
Vector database built from scratch in Rust for low-latency similarity search and payload filtering. Utilizes memory-mapped (mmap) disk storage for billion-scale embeddings, custom HNSW graph indexing with hardware SIMD acceleration (AVX-512/NEON), and dual gRPC/REST APIs.
CopilotKit
React framework for in-app AI copilots; bridges frontend UI state directly into LangGraph agent loops with bidirectional tool execution.
Open WebUI
Extensible OpenAI/Ollama interface; SvelteKit frontend delivers instant responsive streaming while Python FastAPI handles multi-modal RAG and tool calls.
Mem0
Universal memory layer for AI agents; extracts and persists structured personal facts and episodic memories across user chat sessions with low latency.
Flowise
Visual canvas for building and debugging multi-agent LLM workflows; TypeORM handles dynamic agent graph configurations across SQLite or Postgres.
Taipy
Full-stack data science & AI framework; Python business logic binds directly to reactive React frontend components without frontend coding.
Ollama
Ultra-lightweight local LLM runtime; Go REST daemon manages model distribution while C++/llama.cpp provides optimized GPU compute.
Langfuse
Specialized LLM tracing platform: high-volume generation logs streamed into ClickHouse for cost and latency analytics.
Dify.ai
High-throughput AI pipeline: visual canvas frontend with Python worker cluster for asynchronous LLM orchestration.
Frequently Asked Questions
How many AI / LLM App tech stacks are in the directory?
13 verified production AI / LLM App projects are currently indexed, each with a full architecture breakdown and copy-paste AI scaffolding prompt.
What AGENTS.md rules or agent skills apply to AI / LLM App projects?
FastAPI + Python + PostgreSQL (Async SQLAlchemy & Pydantic v2), LangGraph + Python + FastAPI (Agentic AI Workflows), Node.js + Express + MongoDB are battle-tested architecture rules for this category, each with a full AGENTS.md, CLAUDE.md, Cursor .mdc file and a Claude Code SKILL.md.
How do I get a custom stack recommendation for a AI / LLM App project?
Take the STACK IT FAST architecture survey and select "AI / LLM App" as your project type to get a ranked rule recommendation and an instant AI scaffolding prompt tailored to a "AI / LLM App" project.