bottest.ai

Bottest.ai provides automated quality assurance for AI chatbots. It targets teams and organizations building conversational agents who need repeatable, auditable testing without heavy coding. The tool emphasizes open-source deployment and no-code configuration, allowing users to set up tests, baselines, and evaluations through a browser extension and centralized repository.

The workflow starts with recording conversations via a Chrome Extension, creating Tests and Baselines, then running Test Suites in the dashboard or extension. New responses are compared against Baselines to determine pass or fail, and results are presented with analytics to show changes in key metrics over time.

Users configure tests, baselines, and evaluation criteria to capture what matters in their conversations. The system emphasizes transparency in failure reasons, customizable success criteria for AI-powered evaluations, and the ability to replay complex UI interactions for accurate test coverage.

Bottest.ai emphasizes self-hosting and open-source access. It offers Docker-based deployment and on-premise options, with data staying on user infrastructure and integration with existing automated workflows. The platform also promotes collaboration through a unified test repository and centralized results, while providing ongoing analytics and reports after each suite run.

Use cases

• Automated chatbot regression testing with baselines