# BenchBot — Conversational AI Testing, Red-Teaming & Governance

> BenchBot is an EU-based platform for testing, red-teaming and governing conversational AI — chatbots, voicebots and emerging AI agents — across the full lifecycle, before and after launch. It runs live attacks against your bot through 60+ Botium connectors and adds GDPR, bias, fact-checking and NLP analytics in one platform. Built by xyndata s.r.o., Prague, Czech Republic. Tagline: "Ship Chatbots You Can Actually Trust."

## What BenchBot does

BenchBot covers three jobs in one EU platform:
- **Correct** — catch hallucinations and broken flows (fact-checking / faithfulness vs. provided sources, NLP intent/entity analytics).
- **Safe** — red-team for prompt injection, jailbreaks and PII leakage, scored with severity and OWASP Top 10 for LLM Applications mapping.
- **Performant** — measure quality, behavior and bias/toxicity continuously.

Angle: "Test before attackers do" (shift-left). One platform to secure every conversational AI application you build.

## Shipped capabilities (live today)

- **AI red-teaming & vulnerability scanning** — live attack types: prompt injection, jailbreaking, PII leakage, prompt leakage. Attacks are fired at the live bot via Botium connectors and scored with severity + OWASP LLM Top 10 mapping. (Broader vulnerability coverage and a larger attack library are on the roadmap; we do not claim a specific "number of attack variants.")
- **GDPR / compliance testing** mapped to GDPR Articles 15-20 — data protection, consent, data minimization, data-subject rights. Wired end-to-end.
- **Bias, toxicity & fairness testing** across protected attributes.
- **Fact-checking & hallucination detection** (faithfulness vs. provided sources).
- **NLP analytics** — intent/entity, confidence thresholds.
- **60+ platform connectors via the Botium ecosystem** — Dialogflow/CX, Amazon Lex, Microsoft Bot Framework/Copilot, Cognigy, Rasa, Genesys, IBM Watson, Salesforce, Botpress, Kore.ai, plus REST / WebSocket / Socket.IO / voice transports. (Stated as an ecosystem target of 60+ connectors, not per-connector certification.)
- **Voice / phone testing** — TTS/STT and voice connectors.
- **AI Assistant** — in-app copilot that builds chatbots, test sets and projects and generates reports.
- **Test authoring & Bot Explorer** — no-code.
- **Audit-ready export & reporting** — PDF / XLSX / DOCX / CSV, human-readable (no opaque UUIDs).
- **Scheduling** — cron / continuous scans; idempotency-safe (a retry never re-attacks production).
- **Multi-tenant isolation, encrypted fields, RBAC**, real-time observability of scan progress.
- **UI in 9 languages** (en, es, cs, de, tr, pl, fr, bs, uk) with non-English evaluation.

## Differentiators

- One **EU-sovereign** platform (xyndata s.r.o., Prague) across the whole AI-trust lifecycle, with GDPR-Article-mapped testing — built for regulated EU finance, healthcare, pharma and government buyers concerned about data residency.
- **Conversational/voice-first** across 60+ Botium connectors, where security-only vendors are model/API-generic.
- **Auditor-grade explainability** — evaluation scores (GDPR, bias, fact-check) carry the judge's reasoning and the exact configuration that ran, and every finding exports with its evidence. **Idempotency-safe** scanning.
- **Bring-your-own-judge** across multiple LLM providers (OpenAI, Azure, Anthropic, Vertex, Cohere, LiteLLM, Ollama, custom) so evaluation runs on a model you trust — frontend panel expanding (roadmap).
- Regulator-aligned framework presets — EU AI Act / OWASP Top 10 for LLMs / OWASP ASI 2026 (expanding; roadmap).

## Standards we align with

OWASP Top 10 for LLM Applications · NIST AI Risk Management Framework (AI RMF) · ISO/IEC 42001 · EU AI Act · GDPR.

## Pricing

Tiered plans plus custom enterprise. See current pricing at https://benchbot.ai/pricing (we do not publish fixed numbers here to avoid staleness).

## Links

- Website: https://benchbot.ai
- Pricing: https://benchbot.ai/pricing
- Demo: https://benchbot.ai/demo
- Blog: https://benchbot.ai/blog
- Contact: https://benchbot.ai/contact
- About: https://benchbot.ai/about

## Company

BenchBot is developed by xyndata s.r.o., Braunerova 563/7, 180 00 Prague, Czech Republic (EU).