Auriko

What is Auriko?

Auriko is a platform designed to serve as the AI control plane for large language model (LLM) inference. It integrates various functionalities such as model gateway, intelligent routing, observability, and financial operations (FinOps) into a single cohesive system. The platform aims to optimize the delivery of AI models by addressing the complexities associated with different providers, including variations in pricing, latency, cache behaviors, model quality, and reliability.

The mission of Auriko is to build the infrastructure necessary for efficient AI inference. By making compute resources liquid, transparently priced, and manageable in terms of risk, Auriko seeks to enhance the overall efficiency of AI model deployment and utilization.

Auriko Features

Auriko serves as the AI control plane for LLM (Large Language Model) inference, providing a comprehensive platform that integrates model gateway, intelligent routing, observability, and financial operations (FinOps). This infrastructure is designed to optimize the deployment and management of AI models across various providers, ensuring efficient utilization and transparent pricing.

Key features and capabilities of Auriko include:

Automatic Failover: Ensures continuous uptime by backing every request with redundancy.

Key Orchestration: Maximizes key utilization through a robust orchestration engine, allowing for the use of platform keys or customer-managed keys.

Capacity Intelligence: Runs inference with awareness of capacity across providers, leveraging Auriko's global capacity reserve for on-demand needs.

Budget Controls: Sets spending limits and alerts at both workspace and API key levels to manage costs effectively.

Seamless Integration: Easily integrates with various AI ecosystems, requiring minimal code changes for setup.

Why Auriko?

Auriko offers significant cost reduction benefits, making it an attractive choice for businesses looking to optimize their AI inference expenses. The platform has demonstrated a dollar-weighted spend reduction against various comparator targets, with reductions ranging from 7.7% to 38.3%. This means that in the majority of cases, Auriko provides a more cost-effective solution compared to its competitors, with a win rate of 61–90% in non-tie sessions across six targets.

By leveraging Auriko, users can take advantage of the following benefits:

Lower costs compared to other providers, ensuring better budget management.

Increased efficiency in AI model serving, leading to improved performance.

Access to a transparent pricing model that allows for better financial planning.

Enhanced reliability and quality of service, reducing the risk of operational disruptions.

How to Use Auriko

To get started with Auriko, you can follow the quickstart guide that provides essential steps for setting up your project. This guide is designed to help you integrate Auriko's capabilities into your applications efficiently.

By utilizing the quickstart tutorial, you can take advantage of the following features:

Easy integration with your existing projects using TypeScript and cURL.

Access to comprehensive API documentation for seamless development.

Guidance on optimizing routing and cost management for AI inference.

Ready to see what Auriko can do for you?[@portabletext/react] Unknown block type "span", specify a component for it in the `components.types` propand experience the benefits firsthand.