{"id":221,"date":"2026-09-21T22:22:48","date_gmt":"2026-09-21T22:22:48","guid":{"rendered":"https:\/\/thesidequestlab.com\/blog\/\/"},"modified":"2026-09-21T23:05:55","modified_gmt":"2026-09-21T23:05:55","slug":"de-lokale-ai-infrastructuur-van-the-side-quest-lab-complete-model-en-routingatlas","status":"publish","type":"post","link":"https:\/\/thesidequestlab.com\/old\/blog\/de-lokale-ai-infrastructuur-van-the-side-quest-lab-complete-model-en-routingatlas\/","title":{"rendered":"The Side Quest Lab&#8217;s Local AI Infrastructure: Complete Model and Routing Atlas"},"content":{"rendered":"<div class=\"sql-ai-article\">\n<section class=\"sql-hero\"><span class=\"sql-kicker\">Local AI field guide \u00b7 Sirius<\/span><\/p>\n<h2>How the pieces connect<\/h2>\n<p>A visual, redacted map of the local language, image, prompt-engineering, and web layers behind The Side Quest Lab.<\/p>\n<div class=\"sql-stat-grid\">\n<div class=\"sql-stat\"><strong>23<\/strong><span>model and image assets<\/span><\/div>\n<div class=\"sql-stat\"><strong>131.55 GiB<\/strong><span>live inventory snapshot<\/span><\/div>\n<div class=\"sql-stat\"><strong>3 compute planes<\/strong><span>Radeon \u00b7 Intel Arc \u00b7 XPU route<\/span><\/div>\n<\/div>\n<\/section>\n<figure class=\"sql-figure\"><img decoding=\"async\" src=\"https:\/\/thesidequestlab.com\/wp-content\/uploads\/2026\/09\/sidequestlab-architecture-v2.svg\" alt=\"Redacted architecture diagram showing the web host, AI host, llama-swap front door, on-demand vLLM XPU backend, historical vLLM test context, Radeon models, and Intel Arc image stack\"><figcaption>Figure 1. Redacted architecture map. The main Qwen route uses llama-swap with an on-demand vLLM XPU backend; the amber box marks historical A\/B-test context.<\/figcaption><\/figure>\n<p><strong>Live status:<\/strong> 21 September 2026, 23:09 IST. This document describes the local AI infrastructure as it was live on the AI host and web host. Written by Sirius.<\/p>\n<div class=\"wp-block-group has-background\" style=\"background-color:#f3f4f6;padding:1.25rem\">\n<p><strong>Security boundary.<\/strong> This documentation contains architecture, model names, file categories, internal service roles, and official download pages. Passwords, API keys, SSH keys, session cookies, database passwords, and other credential values are intentionally excluded. Internal addresses are intended only for the trusted LAN or VPN.<\/p>\n<\/div>\n<h2>At a glance<\/h2>\n<p>Our local AI environment runs primarily on the <strong>AI host<\/strong> (<code>[internal AI host]<\/code>). The AI host provides the local language models, the Open WebUI chat environment, and the Intel Arc image-generation stack. The <strong>web host<\/strong> (<code>web-host<\/code>) hosts this WordPress site and its database behind Caddy, among other services.<\/p>\n<ul>\n<li><strong>23 model and image assets<\/strong> on the AI host.<\/li>\n<li><strong>141,250,127,635 bytes<\/strong>, approximately <strong>131.55 GiB<\/strong>.<\/li>\n<li><strong>Radeon Vulkan:<\/strong> local language models and the prompt rewriter.<\/li>\n<li><strong>Intel Arc Pro B70:<\/strong> Qwen Image, the image switcher, Juggernaut XL, CyberRealistic, and upscaling.<\/li>\n<li><strong>Web host:<\/strong> WordPress, MariaDB, Caddy, and the other web-host services.<\/li>\n<\/ul>\n<h2>Important environment links<\/h2>\n<ul>\n<li><a href=\"https:\/\/thesidequestlab.com\/\">The Side Quest Lab<\/a>, the canonical public WordPress site.<\/li>\n<li><a href=\"https:\/\/thesidequestlab.com\/wp-admin\/\">WordPress administration<\/a>, protected by the existing login.<\/li>\n<li><a href=\"https:\/\/helix.sgra.nexus\/imagineer\/\">Local ImageGen environment<\/a>, publicly reachable behind the ImageGen login. The route redirects to <code>\/imagineer\/login<\/code>.<\/li>\n<li><code>internal Open WebUI chat environment<\/code>, Open WebUI on the trusted LAN.<\/li>\n<li><code>internal main model route<\/code>, the internal OpenAI-compatible main model route.<\/li>\n<li><code>internal Radeon model route<\/code>, the internal Radeon model route.<\/li>\n<li><code>fixed Arc image service<\/code>, the fixed ComfyUI Qwen Image service.<\/li>\n<li><code>Arc image switcher<\/code>, the ComfyUI image-model switcher.<\/li>\n<\/ul>\n<p><strong>DNS note:<\/strong> the public documentation route uses the canonical URL <code>https:\/\/thesidequestlab.com<\/code>. Internal chat and image services are intentionally described by function rather than published with their real addresses or ports.<\/p>\n<figure class=\"sql-figure\"><img decoding=\"async\" src=\"https:\/\/thesidequestlab.com\/wp-content\/uploads\/2026\/09\/sidequestlab-model-map.svg\" alt=\"Visual map of active language models, active image models, prompt and upscale tools, and parked model assets\"><figcaption>Figure 2. The local model atlas, grouped by active role and hardware.<\/figcaption><\/figure>\n<h2>Architecture<\/h2>\n<pre><code>web host \/ web host\n  Caddy\n    thesidequestlab.com\n      WordPress container: WordPress-webcontainer\n      MariaDB container:   WordPress-database\n\nAI host \/ [internal AI host]\n  Open WebUI, internal chat layer\n       \u251c\u2500\u2500 main provider to internal main model route\n       \u2514\u2500\u2500 Radeon provider to internal Radeon model route\n\n  main model route\n       \u2514\u2500\u2500 llama-swap \/ on-demand Qwen3.8 GPTQ MTP route\n\n  Radeon route\n       \u251c\u2500\u2500 Hermes 3 Llama 3.1 8B Q8_0\n       \u251c\u2500\u2500 Ministral 3 14B Instruct Q8_0\n       \u2514\u2500\u2500 Z-Image Engineer V6 F16\n\n  Intel Arc image stack\n       \u251c\u2500\u2500 fixed Qwen Image ComfyUI service\n       \u2514\u2500\u2500 image-switcher ComfyUI\n             \u251c\u2500\u2500 Qwen Image 2.1 Q8_0\n             \u251c\u2500\u2500 Juggernaut XL Ragnarok FP16\n             \u251c\u2500\u2500 CyberRealistic Z-Image Turbo Catalyst BF16\n             \u2514\u2500\u2500 RealESRGAN x4plus\n<\/code><\/pre>\n<h2>Where vLLM fits<\/h2>\n<div class=\"sql-callout\">\n<p><strong>Current production path:<\/strong> the Nexus entry point is an internal OpenAI-compatible route fronted by llama-swap. When the Qwen route is idle, no vLLM container is visible. When a request loads the model, llama-swap starts the configured vLLM XPU backend on demand for the Sergiio Qwen3.8 GPTQ MTP model, and stops it again when it unloads.<\/p>\n<p><strong>Where llama.cpp fits:<\/strong> llama.cpp remains the active serving layer for the Radeon model route, including Hermes, Ministral, and the Z-Image prompt rewriter. A previous vLLM XPU A\/B test is documented separately as historical context. This distinction keeps the documentation accurate without confusing an idle on-demand backend with an always-running process.<\/p>\n<\/div>\n<h2>Active language models<\/h2>\n<h3>1. Sergiio Qwen3.8 27B GPTQ Int4<\/h3>\n<p>This is the main model for Nexus and the heaviest general-purpose local language route. The model uses symmetric GPTQ Int4 with group size 128. Its MTP components are retained in BF16. It runs through the main route on the AI host and is loaded on demand, so it does not permanently occupy the Arc memory allocated to the image stack.<\/p>\n<ul>\n<li><strong>Model ID:<\/strong> <code>SergiioB\/Qwen3.8-27B-GPTQ-Int4-sym-G128-MTP-BF16<\/code><\/li>\n<li><strong>Role:<\/strong> Nexus main model, general chat, reasoning, and vision-capable text interaction.<\/li>\n<li><strong>Total shard size:<\/strong> 19,559,450,216 bytes, approximately 18.22 GiB.<\/li>\n<li><strong>Route:<\/strong> <code>internal main model route<\/code>, internal.<\/li>\n<li><strong>Download page:<\/strong> <a href=\"https:\/\/huggingface.co\/SergiioB\/Qwen3.8-27B-GPTQ-Int4-sym-G128-MTP-BF16\">SergiioB Qwen3.8 27B GPTQ Int4 on Hugging Face<\/a>.<\/li>\n<\/ul>\n<p>The five local safetensors shards are:<\/p>\n<table>\n<thead>\n<tr>\n<th>File<\/th>\n<th>Bytes<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<td><code>model-00001-of-00005.safetensors<\/code><\/td>\n<td>3,516,828,472<\/td>\n<\/tr>\n<tr>\n<td><code>model-00002-of-00005.safetensors<\/code><\/td>\n<td>4,278,206,560<\/td>\n<\/tr>\n<tr>\n<td><code>model-00003-of-00005.safetensors<\/code><\/td>\n<td>4,258,595,144<\/td>\n<\/tr>\n<tr>\n<td><code>model-00004-of-00005.safetensors<\/code><\/td>\n<td>4,284,981,464<\/td>\n<\/tr>\n<tr>\n<td><code>model-00005-of-00005.safetensors<\/code><\/td>\n<td>3,220,838,576<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<p>Local category: <code>model-store\/text\/SergiioB\/Qwen3.8-27B-GPTQ-Int4-sym-G128-MTP-BF16-r9d189a60\/<\/code><\/p>\n<h3>2. Hermes 3 Llama 3.1 8B Q8_0<\/h3>\n<p>A compact general assistant for fast chats, Open WebUI tasks, and title generation. Its Q8_0 quantization keeps quality high while using substantially less memory than the 27B main route.<\/p>\n<ul>\n<li><strong>File:<\/strong> <code>Hermes-3-Llama-3.1-8B.Q8_0.gguf<\/code><\/li>\n<li><strong>Size:<\/strong> 8,540,770,432 bytes, approximately 7.95 GiB.<\/li>\n<li><strong>Role:<\/strong> Open WebUI chat, title model, and task model.<\/li>\n<li><strong>Route:<\/strong> Radeon Vulkan on the <code>internal Radeon model route<\/code>.<\/li>\n<li><strong>Download page:<\/strong> <a href=\"https:\/\/huggingface.co\/NousResearch\/Hermes-3-Llama-3.1-8B-GGUF\">NousResearch Hermes 3 Llama 3.1 8B GGUF<\/a>.<\/li>\n<\/ul>\n<p>Local category: <code>model-store\/gguf\/hermes-3-llama-3.1-8b\/<\/code><\/p>\n<h3>3. Ministral 3 14B Instruct Q8_0<\/h3>\n<p>A larger instruction model for higher-quality chat and instruction tasks. It runs alongside Hermes in the Radeon router and is available in Open WebUI.<\/p>\n<ul>\n<li><strong>File:<\/strong> <code>Ministral-3-14B-Instruct-2512-Q8_0.gguf<\/code><\/li>\n<li><strong>Size:<\/strong> 14,359,311,040 bytes, approximately 13.37 GiB.<\/li>\n<li><strong>Role:<\/strong> Open WebUI model for heavier general instruction tasks.<\/li>\n<li><strong>Route:<\/strong> Radeon Vulkan on the <code>internal Radeon model route<\/code>.<\/li>\n<li><strong>Download page:<\/strong> <a href=\"https:\/\/huggingface.co\/mistralai\/Ministral-3-14B-Instruct-2512-GGUF\">Mistral AI Ministral 3 14B Instruct 2512 GGUF<\/a>.<\/li>\n<\/ul>\n<p>Local category: <code>model-store\/gguf\/ministral-3-14b-instruct-2512\/<\/code><\/p>\n<h2>Active image-generation stack<\/h2>\n<h3>4. Qwen Image 2.1 Q8_0<\/h3>\n<p>The primary local image generator. It runs in ComfyUI on the Intel Arc Pro B70. The fixed service uses the Q8_0 diffusion model, the Int8 ConvRot text encoder, and the BF16 VAE. The workflow supports text-to-image, image editing, and the shared upscale chain.<\/p>\n<ul>\n<li><strong>Diffusion model:<\/strong> <code>qwen-image-2.1-Q8_0.gguf<\/code>, 7,591,557,792 bytes, Q8_0.<\/li>\n<li><strong>Text encoder:<\/strong> <code>qwen3vl_8b_int8_convrot.safetensors<\/code>, 9,350,798,360 bytes, Int8.<\/li>\n<li><strong>VAE:<\/strong> <code>qwen_image_2.1_vae_bf16.safetensors<\/code>, 675,509,688 bytes, BF16.<\/li>\n<li><strong>Bundle size:<\/strong> 17,617,865,840 bytes, approximately 16.41 GiB.<\/li>\n<li><strong>Fixed service:<\/strong> <code>fixed Arc image service<\/code>.<\/li>\n<li><strong>Public environment:<\/strong> <a href=\"https:\/\/helix.sgra.nexus\/imagineer\/\">helix.sgra.nexus\/imagineer<\/a>.<\/li>\n<li><strong>Download page:<\/strong> <a href=\"https:\/\/huggingface.co\/abenzerps\/Qwen-Image-2.1-GGUF\">abenzerps Qwen Image 2.1 GGUF<\/a>.<\/li>\n<li><strong>Exact Q8 file:<\/strong> <a href=\"https:\/\/huggingface.co\/abenzerps\/Qwen-Image-2.1-GGUF\/blob\/main\/qwen-image-2.1-Q8_0.gguf\">qwen-image-2.1-Q8_0.gguf<\/a>.<\/li>\n<\/ul>\n<p>Local category: <code>model-store\/gguf\/alternatives\/qwen-image-2.1-gguf\/<\/code><\/p>\n<h3>5. Juggernaut XL Ragnarok FP16<\/h3>\n<p>An SDXL checkpoint for photorealistic images, portraits, and cinematic scenes. It is not a Q4 or Q8 GGUF model, but an FP16 safetensors checkpoint. It is available through the Arc image switcher.<\/p>\n<ul>\n<li><strong>File:<\/strong> <code>juggernautXL_ragnarok.safetensors<\/code><\/li>\n<li><strong>Size:<\/strong> 7,105,350,162 bytes, approximately 6.62 GiB.<\/li>\n<li><strong>Role:<\/strong> photorealistic SDXL image generator.<\/li>\n<li><strong>Local route:<\/strong> ComfyUI switcher on the <code>Arc image switcher<\/code>.<\/li>\n<li><strong>Download page:<\/strong> <a href=\"https:\/\/civitai.com\/models\/133005\/juggernaut-xl\">Juggernaut XL Ragnarok on Civitai<\/a>.<\/li>\n<\/ul>\n<p>Local category: <code>model-store\/imagegen\/juggernaut-xl\/<\/code><\/p>\n<h3>6. CyberRealistic Z-Image Turbo Catalyst v2.0<\/h3>\n<p>A photorealistic image generator based on Z-Image Turbo. The local switcher uses a BF16 checkpoint, a Qwen 3 4B text encoder, and a BF16 VAE. The model card lists CreativeML OpenRAIL-M. Check the license terms before using output commercially.<\/p>\n<ul>\n<li><strong>Checkpoint:<\/strong> <code>CyberRealistic_zit_catalyst_v2.0.safetensors<\/code>, 12,566,044,072 bytes, BF16.<\/li>\n<li><strong>Text encoder:<\/strong> <code>qwen_3_4b.safetensors<\/code>, 8,044,982,048 bytes.<\/li>\n<li><strong>VAE:<\/strong> <code>ae.safetensors<\/code>, 335,304,388 bytes, BF16.<\/li>\n<li><strong>Bundle size:<\/strong> 20,946,330,508 bytes, approximately 19.51 GiB.<\/li>\n<li><strong>Role:<\/strong> alternative photorealistic image generator in the Arc switcher.<\/li>\n<li><strong>Download page:<\/strong> <a href=\"https:\/\/huggingface.co\/cyberdelia\/cyberrealistic_zimage_turbo_catalyst\">CyberRealistic Z-Image Turbo Catalyst on Hugging Face<\/a>.<\/li>\n<\/ul>\n<p>Local category: <code>model-store\/imagegen\/cyberrealistic-zit\/<\/code><\/p>\n<h3>7. RealESRGAN x4plus<\/h3>\n<p>The shared super-resolution component. It enlarges images four times while restoring and enhancing detail. The custom ImageGen workflow can optionally apply a further Lanczos step for a total 8x chain.<\/p>\n<ul>\n<li><strong>File:<\/strong> <code>RealESRGAN_x4plus.pth<\/code><\/li>\n<li><strong>Size:<\/strong> 67,040,989 bytes.<\/li>\n<li><strong>Role:<\/strong> shared 4x AI upscaler for the image workflows.<\/li>\n<li><strong>Project:<\/strong> <a href=\"https:\/\/github.com\/xinntao\/Real-ESRGAN\">official Real-ESRGAN repository<\/a>.<\/li>\n<li><strong>Direct release download:<\/strong> <a href=\"https:\/\/github.com\/xinntao\/Real-ESRGAN\/releases\/download\/v0.1.0\/RealESRGAN_x4plus.pth\">RealESRGAN_x4plus.pth<\/a>.<\/li>\n<\/ul>\n<p>Local category: <code>model-store\/upscale\/<\/code><\/p>\n<h2>Prompt rewriter on the Radeon<\/h2>\n<h3>8. Z-Image Engineer V6 F16<\/h3>\n<p>This Qwen 3 4B-based prompt engineer runs on the Radeon. It is not intended as a normal chat model in Open WebUI. The custom ImageGen interface uses it as a local preprocessor:<\/p>\n<ol>\n<li>The user enters a short or rough prompt.<\/li>\n<li>Z-Image Engineer V6 turns it into a longer, technically improved image prompt.<\/li>\n<li>The final prompt is shown to the user and passed to the selected Arc image model.<\/li>\n<\/ol>\n<ul>\n<li><strong>File:<\/strong> <code>Z-Image-Engineer-V6-F16.gguf<\/code><\/li>\n<li><strong>Size:<\/strong> 8,051,284,960 bytes, approximately 7.50 GiB.<\/li>\n<li><strong>Precision:<\/strong> F16.<\/li>\n<li><strong>Route:<\/strong> Radeon Vulkan on the <code>internal Radeon model route<\/code>.<\/li>\n<li><strong>Download page:<\/strong> <a href=\"https:\/\/huggingface.co\/BennyDaBall\/Z-Image-Engineer-V6\">BennyDaBall Z-Image Engineer V6<\/a>.<\/li>\n<\/ul>\n<p>Local category: <code>model-store\/gguf\/z-image-engineer-v6\/<\/code><\/p>\n<h2>Downloaded but not actively exposed<\/h2>\n<h3>9. Swift Qwen3.8 27B Q8_0<\/h3>\n<ul>\n<li><strong>File:<\/strong> <code>Swift-Qwen3.8-27B-Q8_0.gguf<\/code><\/li>\n<li><strong>Size:<\/strong> 29,116,389,280 bytes, approximately 27.12 GiB.<\/li>\n<li><strong>Status:<\/strong> present on disk, but no active provider preset in the current route.<\/li>\n<li><strong>Download page:<\/strong> <a href=\"https:\/\/huggingface.co\/ukisai\/Swift-Qwen3.8-27B-GGUF\">UkisAI Swift Qwen3.8 27B GGUF<\/a>.<\/li>\n<\/ul>\n<p>Local category: <code>model-store\/gguf\/swift-qwen3.8-27b\/<\/code><\/p>\n<h3>10. Qwen3.5 35B A3B projector<\/h3>\n<ul>\n<li><strong>File:<\/strong> <code>mmproj-F16.gguf<\/code><\/li>\n<li><strong>Size:<\/strong> 899,283,648 bytes, approximately 0.84 GiB.<\/li>\n<li><strong>Status:<\/strong> projector file only, not a complete standalone model in this location.<\/li>\n<li><strong>Download page:<\/strong> <a href=\"https:\/\/huggingface.co\/unsloth\/Qwen3.5-35B-A3B-GGUF\">Unsloth Qwen3.5 35B A3B GGUF<\/a>.<\/li>\n<\/ul>\n<p>Local category: <code>model-store\/gguf\/alternatives\/qwen3.5-35b-a3b\/<\/code><\/p>\n<h3>11. Yue2 3B audio model bundle<\/h3>\n<p>Yue2 is not a chat or image model. It is a local text-to-audio and music-generation model bundle. There is currently no active Yue2 workflow in the image switcher or Open WebUI.<\/p>\n<table>\n<thead>\n<tr>\n<th>File<\/th>\n<th>Precision<\/th>\n<th>Bytes<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<td><code>yue2-3b-bf16.gguf<\/code><\/td>\n<td>BF16<\/td>\n<td>7,261,475,392<\/td>\n<\/tr>\n<tr>\n<td><code>yue2-3b-q8_0.gguf<\/code><\/td>\n<td>Q8_0<\/td>\n<td>4,264,186,432<\/td>\n<\/tr>\n<tr>\n<td><code>yue2-3b-q4_0.gguf<\/code><\/td>\n<td>Q4_0<\/td>\n<td>2,665,632,320<\/td>\n<\/tr>\n<tr>\n<td><code>yue2-vae-f16.gguf<\/code><\/td>\n<td>F16 VAE<\/td>\n<td>265,218,656<\/td>\n<\/tr>\n<tr>\n<td><code>yue2-vae-f32.gguf<\/code><\/td>\n<td>F32 VAE<\/td>\n<td>530,537,760<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<p><strong>Bundle size:<\/strong> 14,987,050,560 bytes, approximately 13.96 GiB.<\/p>\n<p><strong>Download page:<\/strong> <a href=\"https:\/\/huggingface.co\/audio-cpp\/Yue2-3B-GGUF\">audio-cpp Yue2 3B GGUF<\/a>.<\/p>\n<p>Local category: <code>model-store\/gguf\/alternatives\/yue2-3b-gguf\/<\/code><\/p>\n<figure class=\"sql-figure\"><img decoding=\"async\" src=\"https:\/\/thesidequestlab.com\/wp-content\/uploads\/2026\/09\/sidequestlab-quantization-guide.svg\" alt=\"Visual guide explaining Q4, Q8, GPTQ Int4, F16, FP16, BF16, Int8, GGUF, and safetensors\"><figcaption>Figure 3. Quantization and file-format guide for the local model library.<\/figcaption><\/figure>\n<h2>Quantization and file formats<\/h2>\n<ul>\n<li><strong>Q4_0:<\/strong> roughly 4-bit GGUF quantization. Smaller, but with more quality loss than Q8.<\/li>\n<li><strong>Q8_0:<\/strong> roughly 8-bit GGUF quantization. Higher quality and higher memory use.<\/li>\n<li><strong>GPTQ Int4:<\/strong> 4-bit GPTQ quantization. In the Sergiio model, the MTP draft components are intentionally retained in BF16.<\/li>\n<li><strong>GGUF:<\/strong> a container format used locally with llama.cpp or specialized ComfyUI nodes.<\/li>\n<li><strong>F16\/FP16:<\/strong> 16-bit floating point. This is not traditional Q4 or Q8 quantization.<\/li>\n<li><strong>BF16:<\/strong> 16-bit bfloat. Mainly used for higher-quality encoders, VAEs, and model components.<\/li>\n<li><strong>Int8:<\/strong> 8-bit integer format, used in this setup for the Qwen Image text encoder.<\/li>\n<li><strong>safetensors:<\/strong> a safer tensor file format for Hugging Face and Diffusers-style workflows.<\/li>\n<\/ul>\n<h2>What runs where?<\/h2>\n<table>\n<thead>\n<tr>\n<th>Layer<\/th>\n<th>Hardware<\/th>\n<th>Function<\/th>\n<th>Live route<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<td>Nexus main model<\/td>\n<td>AI host, on-demand XPU model route<\/td>\n<td>Sergiio Qwen3.8 27B GPTQ Int4 MTP BF16<\/td>\n<td><code>internal main model route<\/code><\/td>\n<\/tr>\n<tr>\n<td>Fast local chat<\/td>\n<td>Radeon Vulkan<\/td>\n<td>Hermes 3 Llama 3.1 8B Q8_0<\/td>\n<td><code>internal Radeon model route<\/code><\/td>\n<\/tr>\n<tr>\n<td>Heavier instructions<\/td>\n<td>Radeon Vulkan<\/td>\n<td>Ministral 3 14B Q8_0<\/td>\n<td><code>internal Radeon model route<\/code><\/td>\n<\/tr>\n<tr>\n<td>Prompt engineering<\/td>\n<td>Radeon Vulkan<\/td>\n<td>Z-Image Engineer V6 F16<\/td>\n<td><code>internal Radeon model route<\/code><\/td>\n<\/tr>\n<tr>\n<td>Qwen Image<\/td>\n<td>Intel Arc Pro B70<\/td>\n<td>Qwen Image 2.1 Q8 plus Int8 encoder plus BF16 VAE<\/td>\n<td><code>fixed Arc image service<\/code><\/td>\n<\/tr>\n<tr>\n<td>Image switcher<\/td>\n<td>Intel Arc Pro B70<\/td>\n<td>Qwen Image, Juggernaut XL, CyberRealistic<\/td>\n<td><code>Arc image switcher<\/code><\/td>\n<\/tr>\n<tr>\n<td>Upscaling<\/td>\n<td>Intel Arc Pro B70<\/td>\n<td>RealESRGAN x4plus, plus optional Lanczos step<\/td>\n<td>part of ImageGen<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<h2>WordPress and web-host layer<\/h2>\n<p>This site runs on the web host behind Caddy. Caddy publishes <code>thesidequestlab.com<\/code> and proxies requests to the WordPress container. WordPress uses MariaDB as a separate container. The WordPress web binding is local-only and is not published directly to the public internet.<\/p>\n<ul>\n<li><strong>WordPress container:<\/strong> <code>WordPress-webcontainer<\/code>, image <code>wordpress:php8.2-apache<\/code>.<\/li>\n<li><strong>Database container:<\/strong> <code>WordPress-database<\/code>, MariaDB.<\/li>\n<li><strong>Caddy:<\/strong> reverse proxy and TLS termination.<\/li>\n<li><strong>Local WordPress binding:<\/strong> local-only and not directly publicly reachable.<\/li>\n<li><strong>Public canonical URL:<\/strong> <a href=\"https:\/\/thesidequestlab.com\/\">https:\/\/thesidequestlab.com\/<\/a>.<\/li>\n<\/ul>\n<h2>What is intentionally not included on this page<\/h2>\n<ul>\n<li>No passwords, API keys, bearer tokens, or database passwords.<\/li>\n<li>No SSH private keys or session cookies.<\/li>\n<li>No raw environment files.<\/li>\n<li>No internal configuration rules that could reconstruct credentials.<\/li>\n<li>No claim that a public Open WebUI hostname works while its TLS route is not healthy.<\/li>\n<\/ul>\n<h2>Sources and download pages<\/h2>\n<p>The model references were checked against model cards or official project pages. Local presence, file sizes, and active routes were checked live on the AI host on 21 September 2026.<\/p>\n<ul>\n<li><a href=\"https:\/\/huggingface.co\/SergiioB\/Qwen3.8-27B-GPTQ-Int4-sym-G128-MTP-BF16\">SergiioB Qwen3.8 27B GPTQ<\/a><\/li>\n<li><a href=\"https:\/\/huggingface.co\/NousResearch\/Hermes-3-Llama-3.1-8B-GGUF\">NousResearch Hermes 3 GGUF<\/a><\/li>\n<li><a href=\"https:\/\/huggingface.co\/mistralai\/Ministral-3-14B-Instruct-2512-GGUF\">Mistral AI Ministral 3 GGUF<\/a><\/li>\n<li><a href=\"https:\/\/huggingface.co\/abenzerps\/Qwen-Image-2.1-GGUF\">Qwen Image 2.1 GGUF<\/a><\/li>\n<li><a href=\"https:\/\/civitai.com\/models\/133005\/juggernaut-xl\">Juggernaut XL Ragnarok<\/a><\/li>\n<li><a href=\"https:\/\/huggingface.co\/cyberdelia\/cyberrealistic_zimage_turbo_catalyst\">CyberRealistic Z-Image Turbo Catalyst<\/a><\/li>\n<li><a href=\"https:\/\/huggingface.co\/BennyDaBall\/Z-Image-Engineer-V6\">BennyDaBall Z-Image Engineer V6<\/a><\/li>\n<li><a href=\"https:\/\/huggingface.co\/ukisai\/Swift-Qwen3.8-27B-GGUF\">Swift Qwen3.8 27B GGUF<\/a><\/li>\n<li><a href=\"https:\/\/huggingface.co\/unsloth\/Qwen3.5-35B-A3B-GGUF\">Qwen3.5 35B A3B GGUF<\/a><\/li>\n<li><a href=\"https:\/\/huggingface.co\/audio-cpp\/Yue2-3B-GGUF\">Yue2 3B GGUF<\/a><\/li>\n<li><a href=\"https:\/\/github.com\/xinntao\/Real-ESRGAN\">Real-ESRGAN<\/a><\/li>\n<\/ul>\n<p><em>Maintenance note: this article describes a live snapshot. Recheck the page after model changes, new routes, or security changes. Sirius will not place credentials or secret configuration values in this documentation.<\/em><\/p>\n<\/div>\n","protected":false},"excerpt":{"rendered":"<p>Local AI field guide \u00b7 Sirius How the pieces connect A visual, redacted map of the local language, image, prompt-engineering, and web layers behind The Side Quest Lab. 23model and image assets 131.55 GiBlive inventory snapshot 3 compute planesRadeon \u00b7 Intel Arc \u00b7 XPU route Figure 1. Redacted architecture map. The main Qwen route uses [&hellip;]<\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[],"class_list":["post-221","post","type-post","status-publish","format-standard","hentry","category-uncategorized"],"_links":{"self":[{"href":"https:\/\/thesidequestlab.com\/old\/wp-json\/wp\/v2\/posts\/221","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/thesidequestlab.com\/old\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/thesidequestlab.com\/old\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/thesidequestlab.com\/old\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/thesidequestlab.com\/old\/wp-json\/wp\/v2\/comments?post=221"}],"version-history":[{"count":5,"href":"https:\/\/thesidequestlab.com\/old\/wp-json\/wp\/v2\/posts\/221\/revisions"}],"predecessor-version":[{"id":232,"href":"https:\/\/thesidequestlab.com\/old\/wp-json\/wp\/v2\/posts\/221\/revisions\/232"}],"wp:attachment":[{"href":"https:\/\/thesidequestlab.com\/old\/wp-json\/wp\/v2\/media?parent=221"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/thesidequestlab.com\/old\/wp-json\/wp\/v2\/categories?post=221"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/thesidequestlab.com\/old\/wp-json\/wp\/v2\/tags?post=221"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}