AcruxCore

AcruxCore is an open-source platform that sits between an app and the model providers, enabling changes to prompts and features without redeploying the application. It emphasizes self-hosting options and the ability to route calls through a gateway while keeping visibility into prompts, tools, and costs. The platform targets engineering teams that manage large language model integrations and seek controlled deployment and observability.

The platform is available hosted or self-hosted with docker compose up. It provides a single control plane to manage prompts, routing, tracing, tools, evaluation, and an audit trail. Users can render prompts, route calls, and observe model behavior while maintaining access to the underlying code and infrastructure.

Its architecture includes a prompt management component, a gateway that connects to providers, tracing that records model interactions, a tool catalog, an evaluation engine, and an audit log. These pieces are designed to work together without requiring traffic to pass through AcruxCore for every operation, though they can be used in combination for end-to-end visibility.

AcruxCore is an Apache-2.0 open-source solution that can be self-hosted or hosted, with no enterprise-only directory and no token markup on provider usage. It emphasizes transparency, configurability, and the ability to bring your own provider keys.

Use cases

• Change prompts without redeploying, while keeping traces and costs visible
• Attach tools to prompts and execute them through a single gateway