All categories

LLMOps

8 tools.

evalobservabilityguardrailsprompt-management
B

Braintrust

eval · observability

An AI observability and evaluation platform designed to monitor, trace, and test AI products and agents at scale.

LLM ObservabilityEvaluationTracing
C

Confident AI

eval · free

An enterprise AI evaluation, red teaming, and observability platform that helps teams monitor, trace, and stress-test LLM applications.

llm-evaluationllm-observabilityred-teaming
G

Galileo AI

eval · guardrails

An enterprise-grade AI observability and evaluation platform for LLM applications, enabling developers to run offline evaluations, auto-tune metrics, and deploy optimized low-latency guardrails using compact Luna models.

observabilityevaluationllmops
G

Guardrails AI

eval · guardrails

An AI reliability platform and framework designed for building, governing, and scaling production GenAI applications. It provides runtime guardrails to detect policy violations, hallucinations, and data leakage, alongside capabilities for simulating realistic datasets and generating evaluation datasets.

guardrailsllm-securitysynthetic-data
H

Helicone

observability

An AI gateway and LLM observability platform designed to route, debug, and analyze LLM applications.

ai-gatewayllm-observabilitymonitoring
L

Langfuse

eval · observability

An open-source AI engineering platform designed for LLM observability, tracing, prompt management, evaluation, and experiments.

llm-observabilitytracingprompt-management
R

Ragas

eval · free

An open-source framework designed to evaluate and monitor Retrieval-Augmented Generation (RAG) systems by providing automated metrics, synthetic test data generation, and online quality tracking.

rag-evaluationllm-evaluationsynthetic-data-generation
T

TruLens

eval · free

An open-source evaluation and tracing framework for AI agents and LLM applications, allowing developers to measure execution flows and application quality using metrics like groundedness and context relevance.

eval-observabilitytracingllm-evaluation