Introduction

What is Graphsignal

Graphsignal is an inference observability platform that helps developers accelerate and troubleshoot AI systems. With Graphsignal, developers can:

• Identify and optimize the most significant contributors to latency.
• Ensure optimal inference performance and model configuration for hosted models.
• Track errors and monitor APIs, compute, and GPU utilization.
• Analyze model API costs for deployments, models, sessions, or any custom tags.

How it works

Graphsignal tracer is added to application code. It automatically measures and records operations and sessions in single-run scripts as well as long running server applications.

Graphsignal measures latency, throughput, tokens, compute, GPUs and costs. It also computes speed deviations and other performance and reliability indicators.

After recording, the performance data is sent to Graphsignal servers, post-processed and is ready to be analyzed at app.graphsignal.com. This allows Graphsignal to run in any environment without the need to install any additional software.

Getting started

• Sign up for an account.
• See the Quick Start guide on how to add Graphsignal to your application.