The earlier VRAM-exhaustion failure was llama-server defaulting to full GPU offload for Shieldstral while Ollama's gemma was also resident. Restarting llama-server with -ngl 0 frees the GPU for gemma and the full writer->judge ai-agents pipeline runs end to end with no VRAM contention. Not an ai-agents limitation -- it never touches GPU placement, only HTTP. |
||
|---|---|---|
| .. | ||
| agents | ||
| NOTES.md | ||
| pipeline.yaml | ||