Monitoring & Cost
Tracing, evaluation and cost tracking for LLM apps and long-running agents.
6 resources
Arize Phoenix
Open-source tracing and evaluation for LLM and agent apps, built on OpenTelemetry.arize.comccusage
CLI that reads local Claude Code usage logs and reports tokens and estimated cost by day, month or session.github.comHelicone
Open-source LLM observability gateway that logs requests, latency and cost across providers.helicone.aiLangfuse
Open-source LLM engineering platform for tracing, evals, prompt management and cost tracking; self-hostable.langfuse.comLangSmith
LangChain's platform for tracing, monitoring and evaluating LLM apps and agents.langchain.comOpenRouter
One API across many model providers with per-request pricing, usage tracking and routing.openrouter.ai