LangSmith
Tracing, evals and monitoring for LLM apps.
Visit LangSmith →Related Evals tools
- SWE-bench — Benchmark of real GitHub issues for evaluating coding agents.
- Inspect AI — UK AISI framework for LLM and agent evaluations with sandboxed tools.
- OpenAI Evals — Framework and registry for evaluating LLMs and LLM systems.
- promptfoo — CLI for testing prompts, agents and RAG with assertions and red-teaming.
- DeepEval — Pytest-like LLM evaluation framework with agentic metrics like task completion.
- Langfuse — Open-source LLM observability: traces, evals and prompt management for agents.
All Evals tools → · Best memory and evaluation tools for AI agents