50 lines
893 B
ReStructuredText
50 lines
893 B
ReStructuredText
.. _apitesting:
|
|
|
|
flashinfer.testing
|
|
==================
|
|
|
|
.. currentmodule:: flashinfer.testing
|
|
|
|
This module provides comprehensive testing utilities for benchmarking, performance analysis in FlashInfer.
|
|
|
|
Test Environment Setup
|
|
----------------------
|
|
|
|
.. autosummary::
|
|
:toctree: ../generated
|
|
|
|
set_seed
|
|
sleep_after_kernel_run
|
|
|
|
Performance Analysis
|
|
--------------------
|
|
|
|
FLOPS Calculation
|
|
~~~~~~~~~~~~~~~~~
|
|
|
|
.. autosummary::
|
|
:toctree: ../generated
|
|
|
|
attention_flops
|
|
attention_flops_with_actual_seq_lens
|
|
attention_tflops_per_sec
|
|
attention_tflops_per_sec_with_actual_seq_lens
|
|
|
|
Throughput Analysis
|
|
~~~~~~~~~~~~~~~~~~~
|
|
|
|
.. autosummary::
|
|
:toctree: ../generated
|
|
|
|
attention_tb_per_sec
|
|
attention_tb_per_sec_with_actual_seq_lens
|
|
|
|
GPU Benchmarking
|
|
----------------
|
|
|
|
.. autosummary::
|
|
:toctree: ../generated
|
|
|
|
bench_gpu_time
|
|
bench_gpu_time_with_cudagraph
|