https://cruver.ai/tags/api/ Recent content in Api on Hullabalooing Hugo en Wed, 21 Jan 2026 00:00:00 -0700 https://cruver.ai/gpu-ai/posts/gpu-config-management/ Wed, 21 Jan 2026 00:00:00 -0700 https://cruver.ai/gpu-ai/posts/gpu-config-management/ <p>Dynamic switching between GPU configurations based on workload needs.</p> <h2 id="overview">Overview<a class="anchor" href="#overview">#</a></h2> <p>Rather than running a single fixed configuration, I dynamically switch between GPU configurations. A Python service manages the transitions via HTTP API.</p> <h2 id="available-configurations">Available Configurations<a class="anchor" href="#available-configurations">#</a></h2> <table> <thead> <tr> <th>Config</th> <th>Model</th> <th>Use Case</th> </tr> </thead> <tbody> <tr> <td><code>big-chat</code></td> <td>Llama 3.3 70B (TP=2)</td> <td>Maximum quality chat</td> </tr> <tr> <td><code>coder</code></td> <td>Qwen3 32B (TP=2)</td> <td>Coding tasks with thinking mode</td> </tr> <tr> <td><code>dual-chat</code></td> <td>Qwen3 8B + 14B</td> <td>Two models, different tasks</td> </tr> <tr> <td><code>image-chat</code></td> <td>Qwen 7B + ComfyUI</td> <td>Text + image generation</td> </tr> </tbody> </table> <p>Configuration files are stored as compose YAML files.</p>