Concepts

Operation

An operation is any function, event or action that is traced by Graphsignal, e.g. model API call, inference, tool call. Operation is a trace consisting from one or more spans.

Session

A session represents a sequence of operations, usually grouped by a tag, such as run_id, user_id, or model.

Score

Scores are numerical values and metadata assigned to events or objects identified by tags, e.g. generations, runs, sessions, or users to evaluate their behavior, importance, performance or impact. For example, scores are useful to analyze and act on negative user interactions.

Metric

Metrics show different aspects of execution and data in time. Graphsignal provides performance, system, and cost metrics.

Tracing

Tracing is the process of recording of operation execution with details such as latency and errors. Tracing also automatically records metrics, such as latency histograms, token usage, etc.

Tracer

Graphsignal tracer is a module that is integrated into applications and scripts. It automatically traces operation execution for natively supported libraries and exposes tracing API for manual tracing.