AgentOps-AI /agentops
Python SDK for AI agent monitoring, LLM cost tracking, benchmarking, and more. Integrates with most LLMs and agent frameworks including CrewAI, Agno, OpenAI Agents SDK, Langchain, Autogen, AG2, and CamelAI
★ 5,960⑂ 664👁 52⑃ 939● 453▤ 108
+6
日增长
5,960
stars
664
forks
52
watchers
939
prs
453
issues
108
releases
README
Observability and DevTool platform for AI Agents
AgentOps helps developers build, evaluate, and monitor AI agents. From prototype to production.
Open Source
The AgentOps app is open source under the MIT license. Explore the code in our app directory.
Key Integrations 🔌
| | |
| ------------------------------------- | ------------------------------------------------------------- |
| 📊 Replay Analytics and Debugging | Step-by-step agent execution graphs |
| 💸 LLM Cost Management | Track spend with LLM foundation model providers |
| 🤝 Framework Integrations | Native Integrations with CrewAI, AG2 (AutoGen), Agno, LangGraph, & more |
| ⚒️ Self-Host | Want to run AgentOps on your own cloud? You're covered |
Quick Start ⌨️
bash
pip install agentops
Session replays in 2 lines of code
Initialize the AgentOps client and automatically get analytics on all your LLM calls.
Get an API key
python
import agentops
Beginning of your program (i.e. main.py, __init__.py)
agentops.init( )
...
End of program
agentops.end_session('Success')
All your sessions can be viewed on the AgentOps dashboard
Self-Hosting
Looking to run the full AgentOps app (Dashboard + API backend) on your machine? Follow the setup guide in app/README.md:
- Run the App and Backend (Dashboard + API)
Agent Debugging
Session Replays
Summary Analytics
First class Developer Experience
Add powerful observability to your agents, tools, and functions with as little code as possible: one line at a time.
Refer to our documentation
python
Create a session span (root for all other spans)
from agentops.sdk.decorators import session
@session
def my_workflow():
Your session code here
return result
python
Create an agent span for tracking agent operations
from agentops.sdk.decorators import agent
@agent
class MyAgent:
def __init__(self, name):
self.name = name
Agent methods here
python
Create operation/task spans for tracking specific operations
from agentops.sdk.decorators import operation, task
@operation or @task
def process_data(data):
Process the data
return result
python
Create workflow spans for tracking multi-operation workflows
from agentops.sdk.decorators import workflow
@workflow
def my_workflow(data):
Workflow implementation
return result
python
Nest decorators for proper span hierarchy
from agentops.sdk.decorators import session, agent, operation
@agent
class MyAgent:
@operation
def nested_operation(self, message):
return f"Processed: {meTop issues
#1338[Feature]: Token-efficient serialization to reduce agent observability overhead and inference costs12 comments · 2026-04-15#1337Integration: Cryptographic tool-call receipts from Signet8 comments · 2026-04-15#1221[Bug]: Repo for Dashboard UI missing lib folder - docker build failure8 comments · 2025-08-18#1383[Feature]: GTM / product team dashboard — non-engineer view of agent session health5 comments · 2026-05-18#1246[Bug]: Dependency on opentelemetry-sdk6 comments · 2025-09-08#1313RFC: Session-boundary behavioral drift monitoring for long-running agents5 comments · 2026-03-28#1281[Feature] WFGY problem codes as tags in AgentOps traces for multi-agent debugging4 comments · 2026-02-20#1260[Bug]: charmap and No module named 'openai.resources.beta.chat'4 comments · 2025-09-22
Discussions
#1443Field study: can real agent teams return for useful replies without engagement loops?1 comments · 2026-08-31#1440Exporting trace validation results as portable EvalPort ResultSets0 comments · 2026-08-23#1427Tura — local, open-source coding agent0 comments · 2026-07-20#1417Token and Cost Metrics not getting displayed in Dashboard1 comments · 2026-06-29#1401Observability for 9-agent teams: what metrics actually matter?0 comments · 2026-05-30#1400What tools do you use for crypto portfolio analysis?0 comments · 2026-05-30#1399What tools do you use for monitoring multi-agent teams?2 comments · 2026-05-30#1396Pre-action authority as an agent observability dimension9 comments · 2026-05-25
Latest release
0.4.21 0.4.21 2025-08-29What's Changed add back lib by @areibman in https://github.com/AgentOps-AI/agentops/pull/1222 updated gitignore by @areibman in https://github.com/AgentOps-AI/agentops/pull/1223 new screenshots by @areibman in https://github.com/AgentOps-AI/agentops/pull/1224 feat(sync): sync OSS distribution from AgentOps.Next ($(cd ../next-repo && git rev-parse --short HEAD)) by @devin-ai-integration[bot] in https://github.com/AgentOps-AI/agentops/pull/1226 feat(sync): sync documentation updates from AgentOps.Next by @devin-ai-integration[bot] in https://github.com/AgentOps-AI/agentops/pull/1227