LM

Topics

🤖 Agent	🧠 Model	🚀 Runner	⚙️ GPU & Driver
Continue.dev axe SKILL MCP	hf (Model Management) Qwen 3.8 27B Qwen 2.5 Coder Devstral Small 2 24B starcoder2 3B Qwen 3.6 27B Muse Glimmer Gemma 4 Experience	vLLM llama-swap llama.cpp for SYCL llama.cpp for OpenVINO lemonade for AMD NPU SGLang	Intel Arc Pro B70 Install driver Install oneAPI (SYCL) Install OpenVINO Experiment AMD Ryzen AI 7 350 Experiment Tools Install nvtop

News

• SWE Pro Benchmark for models < 32B
• OpenVINO 2026.3 supports Ubuntu 26 - 2026-08-04

Decision Tree for tinkering with Intel Arc Pro B70

File Path	/images/quickmmd/LM-tinkering-b70.svg
File Size	48.20 KB
Last modified	20:01:23
Time of SVG loading	0.00 second(s)
Time of SVG convertion	0.00 second(s)
Cache Detected	Yes
SVG Engine	Kroki API
Kroki API URL	http://kroki:8000
Mermaid syntax Reference	https://mermaid.js.org/intro/syntax-reference.html
QuickMMD Version	1.0.0 - About QuickMMD

flowchart LR
  subgraph hardware
    A(Got B70)
  end

  subgraph os
    B1(Install<br>Ubuntu 24.04):::node-okay
    B2(Install<br>Ubuntu 26.04):::node-warn
    A --> B1
    A --> B2
  end

  subgraph drvier
    C1(Install<br>PPA driver):::node-okay
    C2(Install<br>oneAPI):::node-okay
    C3(Install<br>OpenVINO):::node-okay
    C4(Install<br>PPA driver):::node-warn
    C5(Client GPU not listed in<br>oneAPI 2026.1.0):::node-fail
    C6(Cannot install<br>OpenVINO 2026.2.1):::node-fail
    C1 --> C2 & C3
    C4 --> C5 & C6
    B1 --> C1
    B2 --> C4
  end

  subgraph runtime
    D1[Build llama.cpp for<br>SYCL]:::node-okay
    D2[Build llama.cpp for<br>OpenVINO]:::node-okay
    D3[Build SGLang for<br>SYCL]:::node-todo
    D4[Build SGLang for<br>OpenVINO]:::node-todo
    C2 --> D1
    C3 --> D2
    C2 --> D3
    C3 --> D4
  end

  subgraph tools
    T1(Install<br>pipx)
    T2(Install<br>hf)
    T3(Install<br>nvtop)
    T4(Install<br>tmux)
    T5(Install<br>llama-swap)
    T1 --> T2
    B1 --> T1
    B1 --> T3
    B1 --> T4
    B1 --> T5
  end

  subgraph models
    M1(Muse-Glimmer-30B)
    M2(Devstral-Small-2)
    M3(Qwen3-Coder-30B)
    M4(Gemma-4-E4B)
    T2 --> M1 & M2 & M3 & M4
  end

  subgraph env
    V1(Optimize<br>.bashrc)
    V2(Optimize<br>llama-swap.yaml)
    C2 --> V1
    C3 --> V1
    T2 --> V1
    T4 ---> V1
    T5 ---> V2
  end

  subgraph service
    Z(service)
    M1 --> Z
    D1 --> Z
    V2 --> Z
  end

  classDef node-okay fill:#efe,stroke:#393
  classDef node-warn fill:#fff0e0,stroke:#d63
  classDef node-fail fill:#fee,stroke:#d33
  classDef node-todo fill:#eee,stroke:#777