graphsignal-top: a live view of your inference GPUs

The open-source Graphsignal profiler serves everything it measures as JSON for agents. graphsignal-top is the same data as a live terminal screen: GPU telemetry, engine throughput and latency, and kernels ranked by time, locally or over the network.

Graphsignal vs. torch.profiler and nsys

torch.profiler and nsys already give you per-kernel GPU time, so what does Graphsignal add? Comparable JSON snapshots, telemetry in the same document, GPU probes, overhead low enough to run in production, and a runner that wraps any engine.

The Economics of Runtime Tokens

Tokens spent running tasks in production are paid on every execution and never amortize. That pushes this kind of work onto an open inference stack, where the bill is set less by the GPU-hour price than by how well you tune it to your own workload.