Observability

Tracing, debugging, and monitoring agent execution.

Evaluation with Datasets

LangSmith datasets and the evaluate() function enable systematic, repeatable testing of agent behavior with custom evaluators and regression tracking.

LangSmith Setup

LangSmith provides automatic observability for LangChain and LangGraph applications through simple environment variable configuration.

Production Monitoring

LangSmith provides production dashboards, user feedback collection, annotation queues, and alerting to monitor agent health and catch degradation.

Tracing and Debugging

LangSmith traces provide nested span visibility into every node, edge, and LLM call, with the @traceable decorator extending coverage to custom functions.