LM/Experience: Difference between revisions
< LM
No edit summary |
No edit summary |
||
| Line 1: | Line 1: | ||
== Comparison == | |||
=== Proxy === | |||
{| class="wikitable" | |||
! || LiteLLM || bifrost || llama-swap | |||
|- | |||
| llama.cpp || || || | |||
|- | |||
| vLLM || || || | |||
|- | |||
| User Management || || || | |||
|} | |||
== Test Model == | == Test Model == | ||
Revision as of 03:37, 21 September 2026
Comparison
Proxy
| LiteLLM | bifrost | llama-swap | |
|---|---|---|---|
| llama.cpp | |||
| vLLM | |||
| User Management |
Test Model
curl http://${IP}:5800/v1/chat/completions \
-H "Content-Type: application/json" \
-d '{
"messages": [{"role": "user", "content": "Hello"}]
}'