13 lines
325 B
Markdown
13 lines
325 B
Markdown
# Model Inference Stress Testing
|
|
A stress testing tool for large language models that can be customized to support various dataset formats and different API protocol formats, with default support for the OpenAI API format.
|
|
|
|
:::{toctree}
|
|
:maxdepth: 2
|
|
|
|
quick_start.md
|
|
parameters.md
|
|
examples.md
|
|
speed_benchmark.md
|
|
custom.md
|
|
:::
|