evalscope/docs/en/user_guides/stress_test/index.md

325 B

Model Inference Stress Testing

A stress testing tool for large language models that can be customized to support various dataset formats and different API protocol formats, with default support for the OpenAI API format.

:::{toctree} :maxdepth: 2

quick_start.md parameters.md examples.md speed_benchmark.md custom.md :::