{
  "message.content": "LLaMA.cpp prompt evaluation slowdown troubleshooting checklist:\n\n1. **Batch size** - Reduce `--batch-size` (default 512) to 128 or 64\n2. **Context size** - Check `--ctx-size` (default 512) - reduce if too large\n3. **GPU memory** - Ensure sufficient VRAM; try `--n-gpu-layers` with lower value\n4. **Model quantization** - Verify you're using appropriate Q4/K4 quantization\n5. **CPU affinity** - Set `--threads` to match your CPU cores\n6. **Memory mapping** - Try `--mmap` flag if not already enabled\n7. **Prompt length** - Check for unusually long prompts in logs\n8. **Cache issues** - Clear any prompt cache or restart server\n9. **Driver version** - Ensure CUDA drivers are up to date\n10. **Logging level** - Reduce verbosity to avoid overhead"
}