LM

Topics

Agent	Model	Runner	GPU & Driver
axe SKILL MCP	hf (Model Management)	SGLang llama.cpp for SYCL llama.cpp for OpenVINO lemonade for AMD NPU	Intel Arc Pro B70 xe driver oneAPI OpenVINO Experiment AMD Ryzen AI 7 350 Experiment

News

• https://huggingface.co/docs/huggingface_hub/package_reference/environment_variables
• https://huggingface.co/datasets/ScaleAI/SWE-bench_Pro

Decision Tree for tinkering with Intel Arc Pro B70

File Path	/images/quickmmd/LM-tinkering-b70.svg
File Size	47.97 KB
Last modified	20:55:15
Time of SVG loading	0.00 second(s)
Time of SVG convertion	0.00 second(s)
Cache Detected	Yes
SVG Engine	Kroki API
Kroki API URL	http://kroki:8000
Mermaid syntax Reference	https://mermaid.js.org/intro/syntax-reference.html
QuickMMD Version	1.0.0 - About QuickMMD

flowchart LR
  subgraph hardware
    A[Got B70]
  end

  subgraph os
    B1[Install<br>Ubuntu 24.04]:::node-okay
    B2[Install<br>Ubuntu 26.04]:::node-warn
    A --> B1
    A --> B2
  end

  subgraph drvier
    C1[Install<br>PPA driver]:::node-okay
    C2[Install<br>oneAPI]:::node-okay
    C3[Install<br>OpenVINO]:::node-okay
    C4[Install<br>PPA driver]:::node-warn
    C5[Cannot install<br>oneAPI]:::node-fail
    C6[Cannot install<br>OpenVINO]:::node-fail
    C1 --> C2 & C3
    C4 --> C5 & C6
    B1 --> C1
    B2 --> C4
  end

  subgraph runtime
    D1[Build llama.cpp for<br>SYCL]:::node-okay
    D2[Build llama.cpp for<br>OpenVINO]:::node-okay
    D3[Build SGLang for<br>SYCL]:::node-todo
    D4[Build SGLang for<br>OpenVINO]:::node-todo
    C2 --> D1
    C3 --> D2
    C2 --> D3
    C3 --> D4
  end

  subgraph tools
    T1[Install<br>pipx]
    T2[Install<br>hf]
    T3[Install<br>nvtop]
    T4[Install<br>screen]
    T5[Install<br>llama-swap]
    T1 --> T2
    B1 --> T1
    B1 --> T3
    B1 --> T4
    B1 --> T5
  end

  subgraph models
    M1[Muse-Glimmer-30B]
    M2[Devstral-Small-2]
    M3[Qwen3-Coder-30B]
    M4[Gemma-4-E4B]
    T2 --> M1 & M2 & M3 & M4
  end

  subgraph env
    V1[Optimize<br>.bashrc]
    V2[Optimize<br>llama-swap.yaml]
    C2 --> V1
    C3 --> V1
    T2 --> V1
    T4 ---> V1
    T5 ---> V2
  end

  subgraph service
    Z[service]
    M1 --> Z
    D1 --> Z
    V2 --> Z
  end

  classDef node-okay fill:#efe,stroke:#393
  classDef node-warn fill:#fff0e0,stroke:#d63
  classDef node-fail fill:#fee,stroke:#d33
  classDef node-todo fill:#eee,stroke:#777