Inference Profiling

Introduction

Profiling provides deep insights into function and kernel performance, such as CPU time and memory usage. Profilers are essential for identifying and optimizing bottlenecks, detecting configuration issues, and reducing Mean Time to Resolution (MTTR). Graphsignal records profiles at the single-trace level for precise performance analysis.

Integration

See the Quick Start for instructions on installing and configuring the Graphsignal tracer.

Profiling is enabled automatically for auto-traced libraries, if applicable. The fraction of profiled operations is controlled via the profiling_rate parameter in the configure() method. To disable profiling, set profiling_rate to 0. To profile every operation, set it to 1.

To enable profiling for manually traced operations, add with_profile=True to the trace() call. Note that the profiling_rate also applies to manual profiling.

with graphsignal.trace('inference', with_profile=True):
    ...