LM/Experience
< LM
Comparison
Proxy
| LiteLLM | bifrost | llama-swap | |
|---|---|---|---|
| llama.cpp | 🟢 | 🟢 | 🟢 |
| vLLM | 🟢 | 🟢 | ❌ |
| User Management | ⚠️ | 🟢 | ❌ |
- User Management function is a part of Enterprise version.
Test Model
curl http://${IP}:5800/v1/chat/completions \
-H "Content-Type: application/json" \
-d '{
"messages": [{"role": "user", "content": "Hello"}]
}'