LM: Difference between revisions
Jump to navigation
Jump to search
| Line 54: | Line 54: | ||
flowchart LR | flowchart LR | ||
A(LiteLLM) | A(LiteLLM) | ||
B(vLLM<br>Qwen 3.8 27B) | |||
C1(Intel Arc Pro B70) | |||
C2(Intel Arc Pro B70) | |||
A --> | A --> |Forward| B | ||
B --> |Tensor Parallelism| C1 & C2 | |||
C1 --- |XCCL| C2 | |||
</quickmmd> | </quickmmd> | ||
Revision as of 01:10, 1 October 2026
Topics
| 🤖 Agent | 🧠 Model | 🚀 Engine | ⚙️ GPU & Driver | 📊 Evaluation |
|---|---|---|---|---|
|
News
Models management
- llama-swap can launch model, cannot manage users.
- LiteLLM cannot launch model, can manage users.
Decision Tree for tinkering with Intel Arc Pro B70