{
  "message.content": "LLaMA.cpp Prompt Eval Slowdown Troubleshooting Checklist:\n\n1. **Check context size** - Verify you're not using excessively large context windows (4096+ tokens)\n2. **Review KV cache settings** - Try disabling KV cache with --no-kv-cache or reducing cache size\n3. **Examine batch size** - Reduce --batch-size parameter (try 1-32)\n4. **Check GPU memory usage** - Ensure you're not hitting memory limits causing swapping\n5. **Verify model quantization** - Confirm you're using appropriate quantization (Q4_K_M, Q5_K_M, etc.)\n6. **Test with smaller prompt** - Isolate if specific prompt length causes slowdown\n7. **Check CPU/GPU synchronization** - Ensure proper CUDA setup and driver versions\n8. **Try different threading** - Adjust --threads parameter (usually 4-16)\n9. **Monitor system resources** - Check for CPU bottlenecks or memory pressure\n10. **Consider model architecture** - Some models (7B) may have inherent prompt eval overhead"
}