LM/Performance: Difference between revisions
< LM
| Line 24: | Line 24: | ||
<syntaxhighlight lang="bash"> | <syntaxhighlight lang="bash"> | ||
betterbench run --endpoint https://models.nothanks.com/v1 --model my_model --api-key sk-12345678 | betterbench run --endpoint https://models.nothanks.com/v1 --model my_model --api-key sk-12345678 | ||
betterbench run \ | |||
--endpoint https://models.nothanks.com/v1 \ | |||
--model my_model --api-key sk-12345678 \ | |||
--out=path/to/bench-$(date %'MMDD') | |||
</syntaxhighlight> | </syntaxhighlight> | ||
Revision as of 09:13, 30 September 2026
Quick Test: llama-benchy
Use
llama-benchy --base-url https://models.nothanks.com/v1 --pp 512 --tg 128 --model my_model --api-key sk-12345678
llama-benchy --base-url http://models.nothanks.com/v1 \
--model my_model --api-key sk-12345678 \
--pp 512 --tg 128 --concurrency 8 \
2>/dev/null | grep "^|" -B1 -A3
Install
pipx install llama-benchy
Full Test: betterbench
Use
betterbench run --endpoint https://models.nothanks.com/v1 --model my_model --api-key sk-12345678
betterbench run \
--endpoint https://models.nothanks.com/v1 \
--model my_model --api-key sk-12345678 \
--out=path/to/bench-$(date %'MMDD')
Install
git clone https://github.com/GGZ14/BetterBench.git
uv sync
.venv/bin/activate