Self-Hosted AI Stack is an open-source Docker Compose project for running local models, chat, documents, voice, and AI tools on infrastructure you control.
Self-Hosted AI Stack is an open-source project by Lin Song. It functions as a private AI platform that can run on infrastructure you control, with local-first principles and private by default.
The project supports running local AI models, chatting with documents, and transcribing or generating speech, deploying with Docker Compose on your own server, with optional HTTPS and NVIDIA GPU acceleration.
The platform is a composable stack with components for local models, document parsing, embeddings, transcription, speech, gateways, and tools, designed to be deployed on your own hardware.
The stack provides guidance on deployment, security, backups, and everyday operation through accompanying resources like a book and readiness guide, emphasizing that deployment happens on your own Linux server.