LM - Revision history

Tacoball: /* Investigating llama.cpp on Intel Arc Pro B70 */

2026-10-02T03:12:12Z

Investigating llama.cpp on Intel Arc Pro B70

← Older revision		Revision as of 03:12, 2 October 2026
Line 85:		Line 85:
	C1(Install PPA driver<br>26.27.39122.14):::node-okay		C1(Install PPA driver<br>26.27.39122.14):::node-okay
	C2(Install oneAPI<br>2026.1.1.20260724):::node-okay		C2(Install oneAPI<br>2026.1.1.20260724):::node-okay
	~~C3(Install OpenVINO<br>2026.3.0<br>hard to install):::node-warn~~		C1 --> C2
	C1 --> C2 ~~& C3~~
	B1 --> C1		B1 --> C1
	end		end
Line 92:		Line 91:
	subgraph Runtime		subgraph Runtime
	D1[Build llama.cpp for<br>SYCL]:::node-okay		D1[Build llama.cpp for<br>SYCL]:::node-okay
	~~D2[Build llama.cpp for<br>OpenVINO<br>not stable yet]:::node-warn~~
	~~%% D3[Build SGLang for<br>SYCL]:::node-todo~~
	~~%% D4[Build SGLang for<br>OpenVINO]:::node-todo~~
	C2 --> D1		C2 --> D1
	~~C3 --> D2~~
	~~%% C2 --> D3~~
	~~%% C3 --> D4~~
	end		end

Line 118:		Line 111:
	subgraph Models		subgraph Models
	M1(Qwen3.8-27B)		M1(Qwen3.8-27B)
	~~M2(Devstral-Small-2-24B)~~		T2 --> M1
	T2 --> M1 ~~& M2~~
	end		end

Line 126:		Line 118:
	V2(Optimize<br>lmsw.yaml)		V2(Optimize<br>lmsw.yaml)
	C2 --> V1		C2 --> V1
	~~C3 --> V1~~
	T2 --> V1		T2 --> V1
	T4 ---> V1		T4 ----> V1
	T6 ---> V2		T6 ---> V2
	end		end

2026-10-02T03:08:46Z

Decision Tree for tinkering with Intel Arc Pro B70

← Older revision		Revision as of 03:08, 2 October 2026
Line 67:		Line 67:
	* LiteLLM cannot launch model, can manage users.		* LiteLLM cannot launch model, can manage users.

	= ~~Decision Tree for tinkering with~~ Intel Arc Pro B70 =		= Investigating llama.cpp on Intel Arc Pro B70 =

	<quickmmd name="tinkering-b70">		<quickmmd name="tinkering-b70">

2026-10-01T11:05:26Z

Topics

← Older revision		Revision as of 11:05, 1 October 2026
Line 17:		Line 17:
	: [[LM/Experience\|Experience]]		: [[LM/Experience\|Experience]]
	\| style="width:200px;vertical-align:top" \|		\| style="width:200px;vertical-align:top" \|
			: [[LM/vLLM\|vLLM]]
	: [[LM/llama-swap\|llama-swap]]		: [[LM/llama-swap\|llama-swap]]
	~~: [[LM/vLLM\|vLLM]]~~
	: [[LM/ComfyUI\|ComfyUI]]		: [[LM/ComfyUI\|ComfyUI]]
	: [[LM/llama.cpp for SYCL\|llama.cpp for SYCL]]		: [[LM/llama.cpp for SYCL\|llama.cpp for SYCL]]

2026-10-01T06:50:43Z

Topics

2026-10-01T01:10:42Z

Models management

2026-09-30T03:36:55Z

Topics

← Older revision		Revision as of 03:36, 30 September 2026
Line 2:		Line 2:

	{\| class="wikitable"		{\| class="wikitable"
	! 🤖 Agent　 \|\| 🧠 Model　 \|\| 🚀 Engine　 \|\| ⚙️ GPU & Driver　\|\| Evaluation		! 🤖 Agent　 \|\| 🧠 Model　 \|\| 🚀 Engine　 \|\| ⚙️ GPU & Driver　\|\| 📊 Evaluation
	\|-		\|-
	\| style="width:200px;vertical-align:top" \|		\| style="width:200px;vertical-align:top" \|

2026-09-30T03:36:07Z

Topics

← Older revision		Revision as of 03:36, 30 September 2026
Line 37:		Line 37:
	: Tools		: Tools
	:: [[LM/Install nvtop\|Install nvtop]]		:: [[LM/Install nvtop\|Install nvtop]]
	~~:: [[LM/lact\|lact]]~~
	:: [[LM/PCIe Trouble Shooting\|PCIe Trouble Shooting]]		:: [[LM/PCIe Trouble Shooting\|PCIe Trouble Shooting]]
	: Comparison		: Comparison

2026-09-30T03:35:32Z

Topics

← Older revision		Revision as of 03:35, 30 September 2026
Line 10:		Line 10:
	\| style="width:200px;vertical-align:top" \|		\| style="width:200px;vertical-align:top" \|
	: [[LM/hf\|hf (Model Management)]]		: [[LM/hf\|hf (Model Management)]]
			: [[LM/Qwen Image 2.1\|Qwen Image 2.1]]
	: [[LM/Qwen 3.8 27B\|Qwen 3.8 27B]]		: [[LM/Qwen 3.8 27B\|Qwen 3.8 27B]]
	: [[LM/Gemma 4\|Gemma 4]]		: [[LM/Gemma 4\|Gemma 4]]

2026-09-21T09:49:32Z

Models management

2026-09-21T09:48:45Z

Models management

← Older revision		Revision as of 11:05, 1 October 2026
Line 17:		Line 17:
	: [[LM/Experience\|Experience]]		: [[LM/Experience\|Experience]]
	\| style="width:200px;vertical-align:top" \|		\| style="width:200px;vertical-align:top" \|
			: [[LM/vLLM\|vLLM]]
	: [[LM/llama-swap\|llama-swap]]		: [[LM/llama-swap\|llama-swap]]
	~~: [[LM/vLLM\|vLLM]]~~
	: [[LM/ComfyUI\|ComfyUI]]		: [[LM/ComfyUI\|ComfyUI]]
	: [[LM/llama.cpp for SYCL\|llama.cpp for SYCL]]		: [[LM/llama.cpp for SYCL\|llama.cpp for SYCL]]

← Older revision		Revision as of 03:35, 30 September 2026
Line 10:		Line 10:
	\| style="width:200px;vertical-align:top" \|		\| style="width:200px;vertical-align:top" \|
	: [[LM/hf\|hf (Model Management)]]		: [[LM/hf\|hf (Model Management)]]
			: [[LM/Qwen Image 2.1\|Qwen Image 2.1]]
	: [[LM/Qwen 3.8 27B\|Qwen 3.8 27B]]		: [[LM/Qwen 3.8 27B\|Qwen 3.8 27B]]
	: [[LM/Gemma 4\|Gemma 4]]		: [[LM/Gemma 4\|Gemma 4]]