Login to follow
Agent Monitor

Agent Monitor (ODC)

Stable version 0.1.3 (Compatible with ODC)
Uploaded on 22 May (3 weeks ago) by Truewind
Agent Monitor

Agent Monitor (ODC)

Details
Detailed Description

Agent Monitor brings observability to your ODC AI agents using a probe architecture: specialized Service Actions you drop into existing flows. Each probe captures a specific signal at a specific point in the execution chain. Nothing is recorded by default. Your team controls what gets logged and what gets redacted.

The component provides a centralized dashboard for all agents in your environment, organized by name and type. It works alongside the Agent Workbench but does not require it.

Monitor agents via Service Actions or REST APIs.

What it tracks:

  • Sessions and Executions: full lifecycle of each agent run
  • Model Attribution: which LLM was used at each step
  • Execution Time: latency per step in the chain
  • Tool Usage: Service Actions called, with inputs and outputs
  • Token Consumption: input/output token counts per execution
  • Input/Output Mapping: data that entered and exited each step

Developed by:

Limitations
  • The app is currently available only for ODC
  • No alerts or notifications. Agent Monitor is a passive observability tool. It records what agents do but does not trigger alerts based on that data.
  • Log data is not automatically purged. Teams are responsible for managing storage and defining their own retention rules.
  • Probes add overhead. Like any logging system, probe calls introduce additional operations to the flow. Overhead is minimal by design, but it is not zero.
  • No PII detection. The framework does not inspect or mask sensitive data. Your team must configure probes to avoid logging what should not be stored.
  • Manual instrumentation. Each step you want to observe must be explicitly instrumented with a probe.