evalscope_v0.17.0/evalscope.0.17.0/docs/en/user_guides/stress_test/index.md

Model Inference Stress Testing

A stress testing tool for large language models that can be customized to support various dataset formats and different API protocol formats, with default support for the OpenAI API format.

:::{toctree} :maxdepth: 2

quick_start.md parameters.md examples.md speed_benchmark.md custom.md :::