Sentry AI Monitoring Setup
Skill Verified ActiveSetup Sentry AI Agent Monitoring in any project. Use when asked to monitor LLM calls, track AI agents, or instrument OpenAI/Anthropic/Vercel AI/LangChain/Google GenAI/Pydantic AI. Detects installed AI SDKs and configures appropriate integrations.
Enable robust monitoring and observability for AI agents and LLM calls within any project by configuring Sentry, ensuring valuable insights into performance, cost, and potential issues.
Features
- Detects installed AI SDKs (OpenAI, Anthropic, LangChain, etc.)
- Configures Sentry integrations for various AI frameworks
- Provides guidance on sampling strategies for AI traces
- Warns about PII capture and requires user confirmation
- Offers manual instrumentation examples for custom setups
Use Cases
- When asked to monitor LLM calls or track AI agent performance
- When setting up AI observability in a project
- When needing to instrument OpenAI, Anthropic, or LangChain usage with Sentry
- When configuring Sentry to capture token consumption and model latency
Non-Goals
- Automatically enabling prompt/output capture without user consent
- Configuring Sentry for non-AI related features
- Replacing the need for Sentry SDKs to be installed in the project
Workflow
- Detect installed AI SDKs in the project.
- Check current Sentry sampling configuration.
- Prompt user to enable 100% AI trace sampling if necessary.
- Provide specific JavaScript or Python configuration examples based on detected SDKs.
- Advise on data capture (PII) and require explicit user confirmation.
- Verify configuration by making an LLM call and checking Sentry Traces.
Prerequisites
- Tracing enabled in Sentry SDK (`tracesSampleRate > 0`)
Installation
First, add the marketplace
/plugin marketplace add getsentry/sentry-for-ai/plugin install sentry-for-ai@sentry-plugin-marketplaceQuality Score
VerifiedTrust Signals
Similar Extensions
LangSmith Observability
99LLM observability platform for tracing, evaluation, and monitoring. Use when debugging LLM applications, evaluating model outputs against datasets, monitoring production systems, or building systematic testing pipelines for AI applications.
TradeMemory Protocol
100Domain knowledge for the Evolution Engine — LLM-powered autonomous strategy discovery from raw OHLCV data. Covers the generate-backtest-select-evolve loop, vectorized backtesting, out-of-sample validation, and strategy graduation. Use when discovering trading patterns, running backtests, evolving strategies, or reviewing evolution logs. Triggers on "evolve", "discover patterns", "backtest", "evolution", "strategy generation", "candidate strategy".
Ops Fires
100Production incidents dashboard. Reads ECS health, Sentry errors, CI failures. Offers to dispatch fix agents for active fires.
Observability Designer
100Observability Designer (POWERFUL)
Sentry Tanstack Start Sdk
100Full Sentry SDK setup for TanStack Start React. Use when asked to "add Sentry to TanStack Start", "install @sentry/tanstackstart-react", or configure error monitoring, tracing, session replay, logs, or user feedback in a TanStack Start React app.
Sentry React SDK
100Full Sentry SDK setup for React. Use when asked to "add Sentry to React", "install @sentry/react", or configure error monitoring, tracing, session replay, profiling, or logging for React applications. Supports React 16+, React Router v5-v7 non-framework mode, TanStack Router, Redux, Vite, and webpack.