LM

Topics

🤖 Agent	🧠 Model	🚀 Runner	⚙️ GPU & Driver	Evaluation
Continue.dev axe MCP SKILL	hf (Model Management) Qwen 3.8 27B Qwen 2.5 Coder Devstral Small 2 24B starcoder2 3B Qwen 3.6 27B Muse Glimmer Gemma 4 Experience	vLLM llama-swap llama.cpp for TurboQuant llama.cpp for SYCL llama.cpp for OpenVINO lemonade for AMD NPU SGLang	Intel Arc Pro B70 Install driver Install oneAPI (SYCL) Install OpenVINO .bashrc for B70 Experiment AMD Ryzen AI 7 350 Experiment Tools Install nvtop	Performance Security Hallucination

News

• SWE Pro Benchmark for models < 32B
• OpenVINO 2026.3 supports Ubuntu 26 - 2026-08-04

Decision Tree for tinkering with Intel Arc Pro B70

File Path	/images/quickmmd/LM-tinkering-b70.svg
File Size	48.20 KB
Last modified	20:01:23
Time of SVG loading	0.00 second(s)
Time of SVG convertion	0.00 second(s)
Cache Detected	Yes
SVG Engine	Kroki API
Kroki API URL	http://kroki:8000
Mermaid syntax Reference	https://mermaid.js.org/intro/syntax-reference.html
QuickMMD Version	1.0.0 - About QuickMMD

flowchart LR
  subgraph hardware
    A(Got B70)
  end

  subgraph os
    B1(Install<br>Ubuntu 24.04):::node-okay
    B2(Install<br>Ubuntu 26.04):::node-warn
    A --> B1
    A --> B2
  end

  subgraph drvier
    C1(Install<br>PPA driver):::node-okay
    C2(Install<br>oneAPI):::node-okay
    C3(Install<br>OpenVINO):::node-okay
    C4(Install<br>PPA driver):::node-warn
    C5(Client GPU not listed in<br>oneAPI 2026.1.0):::node-fail
    C6(Cannot install<br>OpenVINO 2026.2.1):::node-fail
    C1 --> C2 & C3
    C4 --> C5 & C6
    B1 --> C1
    B2 --> C4
  end

  subgraph runtime
    D1[Build llama.cpp for<br>SYCL]:::node-okay
    D2[Build llama.cpp for<br>OpenVINO]:::node-okay
    D3[Build SGLang for<br>SYCL]:::node-todo
    D4[Build SGLang for<br>OpenVINO]:::node-todo
    C2 --> D1
    C3 --> D2
    C2 --> D3
    C3 --> D4
  end

  subgraph tools
    T1(Install<br>pipx)
    T2(Install<br>hf)
    T3(Install<br>nvtop)
    T4(Install<br>tmux)
    T5(Install<br>llama-swap)
    T1 --> T2
    B1 --> T1
    B1 --> T3
    B1 --> T4
    B1 --> T5
  end

  subgraph models
    M1(Muse-Glimmer-30B)
    M2(Devstral-Small-2)
    M3(Qwen3-Coder-30B)
    M4(Gemma-4-E4B)
    T2 --> M1 & M2 & M3 & M4
  end

  subgraph env
    V1(Optimize<br>.bashrc)
    V2(Optimize<br>llama-swap.yaml)
    C2 --> V1
    C3 --> V1
    T2 --> V1
    T4 ---> V1
    T5 ---> V2
  end

  subgraph service
    Z(service)
    M1 --> Z
    D1 --> Z
    V2 --> Z
  end

  classDef node-okay fill:#efe,stroke:#393
  classDef node-warn fill:#fff0e0,stroke:#d63
  classDef node-fail fill:#fee,stroke:#d33
  classDef node-todo fill:#eee,stroke:#777