LM: Difference between revisions
Jump to navigation
Jump to search
| Line 15: | Line 15: | ||
subgraph drvier | subgraph drvier | ||
C1[Install | C1[Install oneAPI] | ||
C2[Install OpenVINO] | C2[Install OpenVINO] | ||
C3[Install | C3[Install oneAPI] | ||
C4[Install OpenVINO] | C4[Install OpenVINO] | ||
B1 --> C1 | B1 --> C1 | ||
| Line 23: | Line 23: | ||
B2 --> C3 | B2 --> C3 | ||
B2 --> C4 | B2 --> C4 | ||
end | |||
subgraph runtime | |||
D1[Build llama.cpp for SYCL] | |||
D2[Build llama.cpp for OpenVINO] | |||
C1 --> D1 | |||
C2 --> D2 | |||
end | end | ||
</quickmmd> | </quickmmd> | ||
Revision as of 01:57, 13 August 2026
Decision Tree for tinkering with Intel Arc Pro B70
| File Path | /images/quickmmd/LM-tinkering-b70.svg |
|---|---|
| File Size | 20.37 KB |
| Last modified | 20:55:45 |
| Time of SVG loading | 1.70 second(s) |
| Time of SVG convertion | 0.00 second(s) |
| Cache Detected | No |
| MD5 of incoming syntax | 1588b741ee95e0b90926bdd4e5c39ca0 |
| MD5 of cached syntax | 6c1827bb6f6a512a8e4ffcb71e384f36 |
| SVG Engine | Kroki API |
| Kroki API URL | http://kroki:8000 |
| Mermaid syntax Reference | https://mermaid.js.org/intro/syntax-reference.html |
| QuickMMD Version | 1.0.0 - About QuickMMD |
flowchart LR
subgraph zero
A[Got B70]
end
subgraph os
B1[Install Ubuntu 24.04]
B2[Install Ubuntu 26.04]
A --> B1
A --> B2
end
subgraph drvier
C1[Install oneAPI]
C2[Install OpenVINO]
C3[Install oneAPI]
C4[Install OpenVINO]
B1 --> C1
B1 --> C2
B2 --> C3
B2 --> C4
end
subgraph runtime
D1[Build llama.cpp for SYCL]
D2[Build llama.cpp for OpenVINO]
C1 --> D1
C2 --> D2
end
Build environment
hf (model management)
- https://huggingface.co/docs/huggingface_hub/package_reference/environment_variables
- https://www.datalearner.com/en/leaderboards/category/code?benchmark=SWE-bench+Verified&modelSize=34b&licenseType=open
- https://huggingface.co/datasets/ScaleAI/SWE-bench_Pro
| Purpose | Command |
|---|---|
| cache management |
hf cache list
hf cache rm <model id>
hf cache prune
|
| fix WiFi problem |
HF_XET_FIXED_DOWNLOAD_CONCURRENCY=10 hf download "unsloth/Qwen3-Coder-30B-A3B-Instruct-GGUF" --include "*UD-Q4_K_XL*"
HF_XET_FIXED_DOWNLOAD_CONCURRENCY=10 hf download "unsloth/Devstral-Small-2-24B-Instruct-2512-GGUF" --include "*UD-Q4_K_XL*"
|
| search |
hf models ls --search "gemma-4" --apps llama.cpp --sort downloads --limit 10
hf models ls --search "coder" --apps llama.cpp --sort downloads --limit 10
hf models ls --search "unsloth" --apps llama.cpp --sort downloads --limit 10
|
| optimize Qwen3-Coder |
hf models ls --search "coder" --apps llama.cpp --sort downloads --limit 1 --format json | jq .
hf models ls -h "unsloth/Qwen3-Coder-30B-A3B-Instruct-GGUF"
hf download "unsloth/Qwen3-Coder-30B-A3B-Instruct-GGUF" --include "*UD-Q4_K_XL*"
|
| optimize gemma-4-E4B |
hf models ls -h unsloth/gemma-4-E4B-it-qat-GGUF
hf download unsloth/gemma-4-E4B-it-qat-GGUF --include "*UD-Q4_K_XL*"
hf download unsloth/gemma-4-E4B-it-qat-GGUF --include "mmproj-BF16.gguf"
hf download unsloth/gemma-4-E4B-it-qat-GGUF --include "mtp-gemma-4-E4B-it.gguf"
|
| optimize gemma-4-12B |
hf models ls -h unsloth/gemma-4-12B-it-qat-GGUF
hf download unsloth/gemma-4-12B-it-qat-GGUF --include "*UD-Q4_K_XL*"
hf download unsloth/gemma-4-12B-it-qat-GGUF --include "mmproj-BF16.gguf"
hf download unsloth/gemma-4-12B-it-qat-GGUF --include "mtp-gemma-4-12B-it.gguf"
|
| optimize Muse Glimmer |
hf models ls -h unsloth/Muse-Glimmer-30B-GGUF
hf download unsloth/Muse-Glimmer-30B-GGUF --include "*UD-Q4_K_XL*"
hf download unsloth/Muse-Glimmer-30B-GGUF --include "*UD-Q5_K_XL*"
hf download unsloth/Muse-Glimmer-30B-GGUF --include "*UD-Q6_K_XL*"
hf download unsloth/Muse-Glimmer-30B-GGUF --include "dflash-kquant.gguf"
hf download unsloth/Muse-Glimmer-30B-GGUF --include "mmproj-kquant.gguf"
|
tree ~/.cache/huggingface/hub/models--unsloth--Devstral-Small-2-24B-Instruct-2512-GGUF/snapshots
tree ~/.cache/huggingface/hub/models--unsloth--Qwen3-Coder-30B-A3B-Instruct-GGUF/snapshots
|