Introduction

What is Graphsignal

Graphsignal is an AI optimization platform, enabling developers to achieve faster, more efficient models and applications. With Graphsignal, developers can:

• Identify and optimize the most significant contributors to latency.
• Analyze model API costs for deployments, models, sessions, or any custom tags.
• Ensure optimal inference performance and model configuration for hosted models.
• Track errors and monitor APIs, compute, and GPU utilization.

How it works

Graphsignal tracer is added to application code. It automatically measures and records operations and sessions in single-run scripts as well as long running server applications.

Graphsignal measures latency, throughput, tokens, compute, GPUs and costs. It also computes speed deviations and other performance and reliability indicators.

After recording, the performance data is sent to Graphsignal servers, post-processed and is ready to be analyzed at app.graphsignal.com. This allows Graphsignal to run in any environment without the need to install any additional software.

Getting started

• Sign up for an account.
• See the Quick Start guide on how to add Graphsignal to your application.